2020-11-16T20:17:02.356 INFO:root:teuthology version: 1.0.0-357fd4a 2020-11-16T20:17:02.357 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/kchai-2020-11-16_12:11:03-rados-wip-kefu-testing-2020-11-16-1845-distro-basic-smithi/5631152 --lock --owner scheduled_kchai@teuthology --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-snaps} --name kchai-2020-11-16_12:11:03-rados-wip-kefu-testing-2020-11-16-1845-distro-basic-smithi --verbose --block -- /tmp/teuthology-worker.okstyaxc.tmp 2020-11-16T20:17:02.404 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-16T20:17:02.477 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/kchai-2020-11-16_12:11:03-rados-wip-kefu-testing-2020-11-16-1845-distro-basic-smithi/5631152 branch: wip-kefu-testing-2020-11-16-1845 description: rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-snaps} email: tchaikov@gmail.com first_in_suite: false job_id: '5631152' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: kchai-2020-11-16_12:11:03-rados-wip-kefu-testing-2020-11-16-1845-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 30 os_type: rhel os_version: '8.1' overrides: admin_socket: branch: wip-kefu-testing-2020-11-16-1845 ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 3 ms bind msgr1: false ms bind msgr2: true ms inject socket failures: 5000 ms type: async osd_max_pg_log_entries: 2 osd_min_pg_log_entries: 1 osd_pg_log_trim_min: 0 osd_pool_default_min_size: 2 osd_pool_default_size: 3 osd_recovery_max_active: 10 osd_recovery_max_single_start: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd backoff on peering: true osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd heartbeat use min delay socket: true osd map cache size: 1 osd max backfills: 6 osd max markdown count: 1000 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd scrub during recovery: false osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd_max_pg_log_entries: 3000 osd_min_pg_log_entries: 3000 fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - Health detail - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - osd_map_cache_size - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - must scrub before tier agent can activate log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - Health detail sha1: 911cc35794d871071a8bebfb0919482263b1d18b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: 911cc35794d871071a8bebfb0919482263b1d18b selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 min_in: 4 workunit: branch: wip-kefu-testing-2020-11-16-1845 sha1: 911cc35794d871071a8bebfb0919482263b1d18b owner: scheduled_kchai@teuthology priority: 90 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: 911cc35794d871071a8bebfb0919482263b1d18b sleep_before_teardown: 0 suite: rados suite_branch: wip-kefu-testing-2020-11-16-1845 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-11-16-1845/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 911cc35794d871071a8bebfb0919482263b1d18b tasks: - install: null - ceph: conf: osd: debug monc: 20 - exec: mon.a: - while ! ceph balancer status ; do sleep 1 ; done - ceph balancer mode crush-compat - ceph balancer on - thrashosds: chance_pgnum_grow: 0.25 chance_pgnum_shrink: 0.25 chance_pgpnum_fix: 0.25 chance_test_map_discontinuity: 2 timeout: 1800 - exec: client.0: - sudo ceph osd pool create base 4 - sudo ceph osd pool application enable base rados - sudo ceph osd pool create cache 4 - sudo ceph osd tier add base cache - sudo ceph osd tier cache-mode cache writeback - sudo ceph osd tier set-overlay base cache - sudo ceph osd pool set cache hit_set_type bloom - sudo ceph osd pool set cache hit_set_count 8 - sudo ceph osd pool set cache hit_set_period 3600 - sudo ceph osd pool set cache target_max_objects 250 - sudo ceph osd pool set cache min_read_recency_for_promote 2 - rados: clients: - client.0 objects: 500 op_weights: cache_evict: 50 cache_flush: 50 cache_try_flush: 50 copy_from: 50 delete: 50 read: 100 rollback: 50 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 pools: - base teuthology_branch: master timestamp: 2020-11-16_12:11:03 tube: smithi user: kchai verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.24830 2020-11-16T20:17:02.477 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-11-16-1845/qa; will attempt to use it 2020-11-16T20:17:02.478 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-11-16-1845/qa/tasks 2020-11-16T20:17:02.478 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-11-16T20:17:02.480 INFO:teuthology.task.internal:Checking packages... 2020-11-16T20:17:02.500 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'basic' and ceph hash '911cc35794d871071a8bebfb0919482263b1d18b' 2020-11-16T20:17:02.500 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-11-16T20:17:02.500 INFO:teuthology.packaging:ref: None 2020-11-16T20:17:02.501 INFO:teuthology.packaging:tag: None 2020-11-16T20:17:02.501 INFO:teuthology.packaging:branch: wip-kefu-testing-2020-11-16-1845 2020-11-16T20:17:02.501 INFO:teuthology.packaging:sha1: 911cc35794d871071a8bebfb0919482263b1d18b 2020-11-16T20:17:02.501 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-kefu-testing-2020-11-16-1845 2020-11-16T20:17:02.663 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-7219.g911cc357 2020-11-16T20:17:02.664 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-11-16T20:17:02.674 INFO:teuthology.task.internal:no buildpackages task found 2020-11-16T20:17:02.674 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-11-16T20:17:02.825 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-11-16T20:17:02.826 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-16T20:17:02.881 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-16T20:17:12.900 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:17:22.914 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:17:32.929 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:17:42.939 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:17:52.955 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:18:02.973 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:18:12.991 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:18:23.009 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:18:33.026 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:18:43.043 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:18:53.062 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:19:03.078 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:19:13.094 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:19:23.110 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:19:33.128 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:19:43.149 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:19:53.170 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:20:03.189 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:20:13.202 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:20:23.217 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:20:33.235 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:20:43.253 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:20:53.267 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:21:03.285 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:21:13.304 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:21:23.313 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:21:33.330 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:21:43.349 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:21:53.367 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:22:03.385 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-16T20:22:13.403 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_kchai@teuthology', 'count': 2, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/kchai-2020-11-16_12:11:03-rados-wip-kefu-testing-2020-11-16-1845-distro-basic-smithi/5631152'} 2020-11-16T20:22:13.423 DEBUG:teuthology.lock.ops:locked ubuntu@smithi166.front.sepia.ceph.com, ubuntu@smithi059.front.sepia.ceph.com 2020-11-16T20:22:17.664 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f59735cc8c8>, signals=[15]) 2020-11-16T20:22:17.861 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of rhel 8.1 2020-11-16T20:22:17.864 INFO:teuthology.provision.fog.smithi166:Scheduling deploy of rhel 8.1 2020-11-16T20:22:18.142 INFO:teuthology.orchestra.console:Power off smithi166 2020-11-16T20:22:18.143 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi166.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-16T20:22:18.161 INFO:teuthology.orchestra.console:Power off smithi059 2020-11-16T20:22:18.162 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-16T20:22:18.172 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi166.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T20:22:18.187 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T20:22:22.198 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi166.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T20:22:22.211 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T20:22:26.313 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi166.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T20:22:34.618 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T20:22:34.819 INFO:teuthology.orchestra.console:Power off for smithi166 completed 2020-11-16T20:22:34.829 INFO:teuthology.orchestra.console:Power off for smithi059 completed 2020-11-16T20:22:34.921 INFO:teuthology.orchestra.console:Power on smithi166 2020-11-16T20:22:34.922 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi166.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-16T20:22:34.931 INFO:teuthology.orchestra.console:Power on smithi059 2020-11-16T20:22:34.932 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-16T20:22:34.942 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi166.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T20:22:34.952 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T20:22:38.963 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi166.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T20:22:38.976 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T20:22:43.077 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi166.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T20:23:03.689 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T20:23:03.891 INFO:teuthology.orchestra.console:Power on for smithi166 completed 2020-11-16T20:23:03.899 INFO:teuthology.orchestra.console:Power on for smithi059 completed 2020-11-16T20:23:03.992 INFO:teuthology.provision.fog.smithi166:Waiting for deploy to finish 2020-11-16T20:23:04.000 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish 2020-11-16T20:25:04.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T20:25:04.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T20:25:29.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T20:25:29.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T20:25:38.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T20:25:38.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T20:25:47.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T20:25:47.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T20:25:56.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T20:25:56.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T20:26:05.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T20:27:02.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T20:27:02.753 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-16T20:27:02.755 INFO:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-16T20:27:03.074 INFO:teuthology.provision.fog.smithi059:Node is ready 2020-11-16T20:27:03.074 INFO:teuthology.orchestra.run.smithi059:> hostname 2020-11-16T20:27:03.089 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com 2020-11-16T20:27:03.090 INFO:teuthology.orchestra.run.smithi059:> grep smithi059.front.sepia.ceph.com /etc/hosts 2020-11-16T20:27:03.149 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059 2020-11-16T20:27:03.150 INFO:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2020-11-16T20:27:03.293 INFO:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hosts 2020-11-16T20:27:03.329 INFO:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/172.21.15.59/172.21.15.59/g' /etc/hosts 2020-11-16T20:27:03.407 INFO:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hostname 2020-11-16T20:27:03.479 INFO:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2020-11-16T20:27:03.549 INFO:teuthology.provision.fog.smithi059:Deploy complete! 2020-11-16T20:27:03.550 DEBUG:teuthology.parallel:result is None 2020-11-16T20:27:11.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T20:27:11.855 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-16T20:27:11.856 INFO:teuthology.orchestra.run.smithi166:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-16T20:27:12.158 INFO:teuthology.provision.fog.smithi166:Node is ready 2020-11-16T20:27:12.159 INFO:teuthology.orchestra.run.smithi166:> hostname 2020-11-16T20:27:12.173 INFO:teuthology.orchestra.run.smithi166.stdout:smithi166.front.sepia.ceph.com 2020-11-16T20:27:12.173 INFO:teuthology.orchestra.run.smithi166:> grep smithi166.front.sepia.ceph.com /etc/hosts 2020-11-16T20:27:12.226 INFO:teuthology.orchestra.run.smithi166.stdout:172.21.15.166 smithi166.front.sepia.ceph.com smithi166 2020-11-16T20:27:12.227 INFO:teuthology.orchestra.run.smithi166:> sudo hostname smithi166 2020-11-16T20:27:12.348 INFO:teuthology.orchestra.run.smithi166:> sudo sed -i -e 's/smithi166.front.sepia.ceph.com/smithi166/g' /etc/hosts 2020-11-16T20:27:12.376 INFO:teuthology.orchestra.run.smithi166:> sudo sed -i -e 's/172.21.15.166/172.21.15.166/g' /etc/hosts 2020-11-16T20:27:12.443 INFO:teuthology.orchestra.run.smithi166:> sudo sed -i -e 's/smithi166.front.sepia.ceph.com/smithi166/g' /etc/hostname 2020-11-16T20:27:12.510 INFO:teuthology.orchestra.run.smithi166:> sudo hostname smithi166 2020-11-16T20:27:12.576 INFO:teuthology.provision.fog.smithi166:Deploy complete! 2020-11-16T20:27:12.577 DEBUG:teuthology.parallel:result is None 2020-11-16T20:27:21.107 INFO:teuthology.lock.ops:Checking smithi166.front.sepia.ceph.com 2020-11-16T20:27:21.108 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-16T20:27:21.124 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com 2020-11-16T20:27:21.124 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-16T20:27:21.140 INFO:teuthology.lock.ops:Updating [smithi166.front.sepia.ceph.com]: set os type and version on server 2020-11-16T20:27:21.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-16T20:27:21.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T20:27:21.206 INFO:teuthology.orchestra.run.smithi166:> true 2020-11-16T20:27:21.372 INFO:teuthology.orchestra.run.smithi166:> uname -m 2020-11-16T20:27:21.426 INFO:teuthology.orchestra.run.smithi166.stdout:x86_64 2020-11-16T20:27:21.426 INFO:teuthology.orchestra.run.smithi166:> cat /etc/os-release 2020-11-16T20:27:21.480 INFO:teuthology.orchestra.run.smithi166.stdout:NAME="Red Hat Enterprise Linux" 2020-11-16T20:27:21.480 INFO:teuthology.orchestra.run.smithi166.stdout:VERSION="8.1 (Ootpa)" 2020-11-16T20:27:21.480 INFO:teuthology.orchestra.run.smithi166.stdout:ID="rhel" 2020-11-16T20:27:21.481 INFO:teuthology.orchestra.run.smithi166.stdout:ID_LIKE="fedora" 2020-11-16T20:27:21.481 INFO:teuthology.orchestra.run.smithi166.stdout:VERSION_ID="8.1" 2020-11-16T20:27:21.481 INFO:teuthology.orchestra.run.smithi166.stdout:PLATFORM_ID="platform:el8" 2020-11-16T20:27:21.481 INFO:teuthology.orchestra.run.smithi166.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.1 (Ootpa)" 2020-11-16T20:27:21.481 INFO:teuthology.orchestra.run.smithi166.stdout:ANSI_COLOR="0;31" 2020-11-16T20:27:21.481 INFO:teuthology.orchestra.run.smithi166.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.1:GA" 2020-11-16T20:27:21.481 INFO:teuthology.orchestra.run.smithi166.stdout:HOME_URL="https://www.redhat.com/" 2020-11-16T20:27:21.482 INFO:teuthology.orchestra.run.smithi166.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-16T20:27:21.482 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:27:21.482 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-16T20:27:21.482 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.1 2020-11-16T20:27:21.482 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-16T20:27:21.482 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.1" 2020-11-16T20:27:21.483 INFO:teuthology.lock.ops:Updating smithi166.front.sepia.ceph.com on lock server 2020-11-16T20:27:21.499 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server 2020-11-16T20:27:21.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-16T20:27:21.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T20:27:21.569 INFO:teuthology.orchestra.run.smithi059:> true 2020-11-16T20:27:21.749 INFO:teuthology.orchestra.run.smithi059:> uname -m 2020-11-16T20:27:21.803 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2020-11-16T20:27:21.804 INFO:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2020-11-16T20:27:21.857 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Red Hat Enterprise Linux" 2020-11-16T20:27:21.857 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8.1 (Ootpa)" 2020-11-16T20:27:21.858 INFO:teuthology.orchestra.run.smithi059.stdout:ID="rhel" 2020-11-16T20:27:21.858 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="fedora" 2020-11-16T20:27:21.858 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8.1" 2020-11-16T20:27:21.858 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8" 2020-11-16T20:27:21.858 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.1 (Ootpa)" 2020-11-16T20:27:21.858 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2020-11-16T20:27:21.859 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.1:GA" 2020-11-16T20:27:21.859 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.redhat.com/" 2020-11-16T20:27:21.859 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-16T20:27:21.859 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:27:21.859 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-16T20:27:21.859 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.1 2020-11-16T20:27:21.860 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-16T20:27:21.860 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.1" 2020-11-16T20:27:21.861 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2020-11-16T20:27:21.877 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-11-16T20:27:21.912 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi059.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7oYQS82ySk4tgG7akExLTadov0NdJDs8VdUSoi2a/KBr0CsjPWCEj5dIjgEpyhPnMA7MLzrGBMAVPAwJac4wtx1dtS7Pd+SjxM6jnxHkoo4n9DUK4KhrUmQxuWwNCAlntkG2qZ9FD+gV7F4ZK+BJAwR/xFIyXDCuWXj5c+c7SkaXQAlLerEV6zb38i4pakfXlWdDaUD4I7J4d2R2hSRRnd1HFD2Yxt0wSd8prGps3wuYgFkpFpU4KGjOFI4xi8xqfqwKJubmPtBE5ap4c9d7MHwSLg9wteGUUrlrtBHHV43CM2/+uKjU+4/x7jWHJjrbmZ4V3zsrjLSAGMC+J5c+LvvRA0/YEbXDc+wCmc23JjgXIS8ak0NAYO1sdBSQzcv2oc75pZ2N514vmTWxOjqb9QS2brHGtadZSe644MlQubhUGIa8ar66jZLVjtpsEmQCEOkEZT9kCmHVjIYUrSmxhwUTO2a/JDK90aOAexTCgfzBfaDZs2lT5miyXDl0uSFM= smithi166.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7rsdvpmPqd/Tz9L2Z/yVrBQhzTkGcmA0W3mACgkX87AVXdW+nrqKUaKE8udM4q9V4UU+vbQs4/GaiRn0HM8OuCBNwGwRTGf1h8pCiyG6U5/Z0EQp1WwDvcos2lJ1XeFP6HOvq91fj0YXVK53Efa1xcGfsjO9ye3UkveBwwRZBo43oiGSq5Xylse7DmVPQUxrh+R4i9Qm41XJBpeOe/J2mgflDE0sUaBSjl1tbcgyMXxN2NCAx6MMAjty15H5JUHIrnJW2nOYO7DhyW3ANFpSY/7pflo5FRmb6VIo57EC58dtXei5T92s5OuqmeALlg3fs9CbEro6GOFsDALn6xMyI9swq4rX2fcPUnzEiXGMYoWnSUFf0xRomPcnFANZAzC7Jp3j6eP13ELD6wxpTixqW6Q4uLcx2MDlUzagG4K0TX1nTunqwjfm3+zJEy/Hpquvz7kc/tzsqZxgV/VOudlVpy3OVAgYDyp2RorCm8Crvj7CDcFBr3YtvYDxvySGDnnc= 2020-11-16T20:27:21.912 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-16T20:27:21.967 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-11-16T20:27:21.976 INFO:teuthology.task.internal:Saving configuration 2020-11-16T20:27:21.996 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-11-16T20:27:22.006 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-11-16T20:27:22.023 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-16 20:22:13.412955', 'description': '/home/teuthworker/archive/kchai-2020-11-16_12:11:03-rados-wip-kefu-testing-2020-11-16-1845-distro-basic-smithi/5631152', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNvQpY26HzjM1eG0Jsl21a8kpDPSg3i4+MvI2c6q9u9lnR+agXvqyBpn1kREl5NQWbUJfmC4IuJ832eYwRlL6L8=', 'os_version': '8.1', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi166.front.sepia.ceph.com'} 2020-11-16T20:27:22.040 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-16 20:22:13.412975', 'description': '/home/teuthworker/archive/kchai-2020-11-16_12:11:03-rados-wip-kefu-testing-2020-11-16-1845-distro-basic-smithi/5631152', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFIquiiFEgyO3cesFbY+cPlBcaoIqlw4q153i57FG7SLKb4XGwg6XDnbNPxtvC8fPQL4Tii0c3fo5IMPMGAWJ5w=', 'os_version': '8.1', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi059.front.sepia.ceph.com'} 2020-11-16T20:27:22.040 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-11-16T20:27:22.050 INFO:teuthology.task.internal:roles: ubuntu@smithi166.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2020-11-16T20:27:22.050 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2020-11-16T20:27:22.050 INFO:teuthology.run_tasks:Running task console_log... 2020-11-16T20:27:22.136 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f597708ea60>, signals=[15]) 2020-11-16T20:27:22.137 INFO:teuthology.run_tasks:Running task internal.connect... 2020-11-16T20:27:22.146 INFO:teuthology.task.internal:Opening connections... 2020-11-16T20:27:22.147 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi166.front.sepia.ceph.com 2020-11-16T20:27:22.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T20:27:22.219 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi059.front.sepia.ceph.com 2020-11-16T20:27:22.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T20:27:22.293 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-11-16T20:27:22.304 INFO:teuthology.orchestra.run.smithi166:> uname -m 2020-11-16T20:27:22.338 INFO:teuthology.orchestra.run.smithi166.stdout:x86_64 2020-11-16T20:27:22.338 INFO:teuthology.orchestra.run.smithi166:> cat /etc/os-release 2020-11-16T20:27:22.391 INFO:teuthology.orchestra.run.smithi166.stdout:NAME="Red Hat Enterprise Linux" 2020-11-16T20:27:22.392 INFO:teuthology.orchestra.run.smithi166.stdout:VERSION="8.1 (Ootpa)" 2020-11-16T20:27:22.392 INFO:teuthology.orchestra.run.smithi166.stdout:ID="rhel" 2020-11-16T20:27:22.392 INFO:teuthology.orchestra.run.smithi166.stdout:ID_LIKE="fedora" 2020-11-16T20:27:22.392 INFO:teuthology.orchestra.run.smithi166.stdout:VERSION_ID="8.1" 2020-11-16T20:27:22.392 INFO:teuthology.orchestra.run.smithi166.stdout:PLATFORM_ID="platform:el8" 2020-11-16T20:27:22.393 INFO:teuthology.orchestra.run.smithi166.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.1 (Ootpa)" 2020-11-16T20:27:22.393 INFO:teuthology.orchestra.run.smithi166.stdout:ANSI_COLOR="0;31" 2020-11-16T20:27:22.393 INFO:teuthology.orchestra.run.smithi166.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.1:GA" 2020-11-16T20:27:22.393 INFO:teuthology.orchestra.run.smithi166.stdout:HOME_URL="https://www.redhat.com/" 2020-11-16T20:27:22.393 INFO:teuthology.orchestra.run.smithi166.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-16T20:27:22.393 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:27:22.393 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-16T20:27:22.394 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.1 2020-11-16T20:27:22.394 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-16T20:27:22.394 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.1" 2020-11-16T20:27:22.394 INFO:teuthology.lock.ops:Updating smithi166.front.sepia.ceph.com on lock server 2020-11-16T20:27:22.409 INFO:teuthology.orchestra.run.smithi059:> uname -m 2020-11-16T20:27:22.424 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2020-11-16T20:27:22.424 INFO:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2020-11-16T20:27:22.477 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Red Hat Enterprise Linux" 2020-11-16T20:27:22.478 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8.1 (Ootpa)" 2020-11-16T20:27:22.478 INFO:teuthology.orchestra.run.smithi059.stdout:ID="rhel" 2020-11-16T20:27:22.478 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="fedora" 2020-11-16T20:27:22.478 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8.1" 2020-11-16T20:27:22.478 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8" 2020-11-16T20:27:22.479 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.1 (Ootpa)" 2020-11-16T20:27:22.479 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2020-11-16T20:27:22.479 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.1:GA" 2020-11-16T20:27:22.479 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.redhat.com/" 2020-11-16T20:27:22.479 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-16T20:27:22.479 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:27:22.479 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-16T20:27:22.480 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.1 2020-11-16T20:27:22.480 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-16T20:27:22.480 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.1" 2020-11-16T20:27:22.480 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2020-11-16T20:27:22.494 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-11-16T20:27:22.505 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-11-16T20:27:22.516 INFO:teuthology.task.internal:Checking for old test directory... 2020-11-16T20:27:22.517 INFO:teuthology.orchestra.run.smithi059:> test '!' -e /home/ubuntu/cephtest 2020-11-16T20:27:22.520 INFO:teuthology.orchestra.run.smithi166:> test '!' -e /home/ubuntu/cephtest 2020-11-16T20:27:22.533 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-11-16T20:27:22.539 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-11-16T20:27:22.540 INFO:teuthology.orchestra.run.smithi059:> test -z $(ls -A /var/lib/ceph) 2020-11-16T20:27:22.573 INFO:teuthology.orchestra.run.smithi166:> test -z $(ls -A /var/lib/ceph) 2020-11-16T20:27:22.588 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-11-16T20:27:22.628 INFO:teuthology.run_tasks:Running task kernel... 2020-11-16T20:27:22.654 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'prometheus.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.b': {'kdb': True, 'sha1': 'distro'}} 2020-11-16T20:27:22.655 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2020-11-16T20:27:22.655 INFO:teuthology.orchestra.run.smithi166:> uname -r 2020-11-16T20:27:22.668 INFO:teuthology.orchestra.run.smithi166.stdout:4.18.0-193.el8.x86_64 2020-11-16T20:27:22.669 INFO:teuthology.task.kernel:Running kernel on smithi166: 4.18.0-193.el8.x86_64 2020-11-16T20:27:22.669 INFO:teuthology.orchestra.run.smithi166:> sudo yum install -y kernel 2020-11-16T20:27:24.769 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:27:24.769 INFO:teuthology.orchestra.run.smithi166.stdout:Unable to read consumer identity 2020-11-16T20:27:24.951 INFO:teuthology.orchestra.run.smithi166.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-11-16T20:27:26.320 INFO:teuthology.orchestra.run.smithi166.stdout:Copr repo for ceph-el8 owned by ktdreyer 18 kB/s | 2.9 kB 00:00 2020-11-16T20:27:26.802 INFO:teuthology.orchestra.run.smithi166.stdout:Extra Packages for Enterprise Linux 19 MB/s | 8.3 MB 00:00 2020-11-16T20:27:28.469 INFO:teuthology.orchestra.run.smithi166.stdout:lab-extras 4.5 MB/s | 23 kB 00:00 2020-11-16T20:27:28.785 INFO:teuthology.orchestra.run.smithi166.stderr:Modular dependency problem: 2020-11-16T20:27:28.785 INFO:teuthology.orchestra.run.smithi166.stderr: 2020-11-16T20:27:28.785 INFO:teuthology.orchestra.run.smithi166.stderr: Problem: conflicting requests 2020-11-16T20:27:28.785 INFO:teuthology.orchestra.run.smithi166.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-11-16T20:27:28.990 INFO:teuthology.orchestra.run.smithi166.stdout:Package kernel-4.18.0-193.el8.x86_64 is already installed. 2020-11-16T20:27:28.990 INFO:teuthology.orchestra.run.smithi166.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-11-16T20:27:29.066 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:27:29.067 INFO:teuthology.orchestra.run.smithi166.stdout:Nothing to do. 2020-11-16T20:27:29.067 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:27:29.234 INFO:teuthology.orchestra.run.smithi166:> echo no | sudo yum reinstall kernel || true 2020-11-16T20:27:29.602 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:27:29.602 INFO:teuthology.orchestra.run.smithi166.stdout:Unable to read consumer identity 2020-11-16T20:27:29.644 INFO:teuthology.orchestra.run.smithi166.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-11-16T20:27:29.803 INFO:teuthology.orchestra.run.smithi166.stdout:Last metadata expiration check: 0:00:01 ago on Mon 16 Nov 2020 08:27:28 PM UTC. 2020-11-16T20:27:29.832 INFO:teuthology.orchestra.run.smithi166.stderr:Modular dependency problem: 2020-11-16T20:27:29.832 INFO:teuthology.orchestra.run.smithi166.stderr: 2020-11-16T20:27:29.832 INFO:teuthology.orchestra.run.smithi166.stderr: Problem: conflicting requests 2020-11-16T20:27:29.832 INFO:teuthology.orchestra.run.smithi166.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-11-16T20:27:29.910 INFO:teuthology.orchestra.run.smithi166.stdout:Installed package kernel-4.18.0-193.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-11-16T20:27:29.918 INFO:teuthology.orchestra.run.smithi166.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-11-16T20:27:30.010 INFO:teuthology.orchestra.run.smithi166.stderr:Error: No packages marked for reinstall. 2020-11-16T20:27:30.082 INFO:teuthology.orchestra.run.smithi166:> sudo yum reinstall -y kernel || true 2020-11-16T20:27:30.409 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:27:30.410 INFO:teuthology.orchestra.run.smithi166.stdout:Unable to read consumer identity 2020-11-16T20:27:30.452 INFO:teuthology.orchestra.run.smithi166.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-11-16T20:27:30.609 INFO:teuthology.orchestra.run.smithi166.stdout:Last metadata expiration check: 0:00:02 ago on Mon 16 Nov 2020 08:27:28 PM UTC. 2020-11-16T20:27:30.638 INFO:teuthology.orchestra.run.smithi166.stderr:Modular dependency problem: 2020-11-16T20:27:30.638 INFO:teuthology.orchestra.run.smithi166.stderr: 2020-11-16T20:27:30.638 INFO:teuthology.orchestra.run.smithi166.stderr: Problem: conflicting requests 2020-11-16T20:27:30.638 INFO:teuthology.orchestra.run.smithi166.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-11-16T20:27:30.722 INFO:teuthology.orchestra.run.smithi166.stdout:Installed package kernel-4.18.0-193.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-11-16T20:27:30.722 INFO:teuthology.orchestra.run.smithi166.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-11-16T20:27:30.791 INFO:teuthology.orchestra.run.smithi166.stderr:Error: No packages marked for reinstall. 2020-11-16T20:27:30.869 INFO:teuthology.orchestra.run.smithi166:> rpm -q kernel --last | head -n 1 2020-11-16T20:27:30.932 INFO:teuthology.orchestra.run.smithi166.stdout:kernel-4.18.0-193.el8.x86_64 Sun 10 May 2020 01:56:55 PM UTC 2020-11-16T20:27:30.933 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-193.el8.x86_64 2020-11-16T20:27:30.933 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-11-16T20:27:30.934 INFO:teuthology.orchestra.run.smithi059:> uname -r 2020-11-16T20:27:30.951 INFO:teuthology.orchestra.run.smithi059.stdout:4.18.0-193.el8.x86_64 2020-11-16T20:27:30.952 INFO:teuthology.task.kernel:Running kernel on smithi059: 4.18.0-193.el8.x86_64 2020-11-16T20:27:30.952 INFO:teuthology.orchestra.run.smithi059:> sudo yum install -y kernel 2020-11-16T20:27:33.139 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:27:33.140 INFO:teuthology.orchestra.run.smithi059.stdout:Unable to read consumer identity 2020-11-16T20:27:33.271 INFO:teuthology.orchestra.run.smithi059.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-11-16T20:27:34.707 INFO:teuthology.orchestra.run.smithi059.stdout:Copr repo for ceph-el8 owned by ktdreyer 32 kB/s | 2.9 kB 00:00 2020-11-16T20:27:35.251 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 17 MB/s | 8.3 MB 00:00 2020-11-16T20:27:37.027 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 4.1 MB/s | 23 kB 00:00 2020-11-16T20:27:37.368 INFO:teuthology.orchestra.run.smithi059.stderr:Modular dependency problem: 2020-11-16T20:27:37.368 INFO:teuthology.orchestra.run.smithi059.stderr: 2020-11-16T20:27:37.369 INFO:teuthology.orchestra.run.smithi059.stderr: Problem: conflicting requests 2020-11-16T20:27:37.369 INFO:teuthology.orchestra.run.smithi059.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-11-16T20:27:37.597 INFO:teuthology.orchestra.run.smithi059.stdout:Package kernel-4.18.0-193.el8.x86_64 is already installed. 2020-11-16T20:27:37.597 INFO:teuthology.orchestra.run.smithi059.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-11-16T20:27:37.676 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:27:37.678 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2020-11-16T20:27:37.678 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:27:37.870 INFO:teuthology.orchestra.run.smithi059:> echo no | sudo yum reinstall kernel || true 2020-11-16T20:27:38.220 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:27:38.221 INFO:teuthology.orchestra.run.smithi059.stdout:Unable to read consumer identity 2020-11-16T20:27:38.263 INFO:teuthology.orchestra.run.smithi059.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-11-16T20:27:38.435 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:00:01 ago on Mon 16 Nov 2020 08:27:37 PM UTC. 2020-11-16T20:27:38.466 INFO:teuthology.orchestra.run.smithi059.stderr:Modular dependency problem: 2020-11-16T20:27:38.466 INFO:teuthology.orchestra.run.smithi059.stderr: 2020-11-16T20:27:38.466 INFO:teuthology.orchestra.run.smithi059.stderr: Problem: conflicting requests 2020-11-16T20:27:38.467 INFO:teuthology.orchestra.run.smithi059.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-11-16T20:27:38.554 INFO:teuthology.orchestra.run.smithi059.stdout:Installed package kernel-4.18.0-193.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-11-16T20:27:38.554 INFO:teuthology.orchestra.run.smithi059.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-11-16T20:27:38.761 INFO:teuthology.orchestra.run.smithi059.stderr:Error: No packages marked for reinstall. 2020-11-16T20:27:38.852 INFO:teuthology.orchestra.run.smithi059:> sudo yum reinstall -y kernel || true 2020-11-16T20:27:39.202 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:27:39.203 INFO:teuthology.orchestra.run.smithi059.stdout:Unable to read consumer identity 2020-11-16T20:27:39.246 INFO:teuthology.orchestra.run.smithi059.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-11-16T20:27:39.416 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:00:02 ago on Mon 16 Nov 2020 08:27:37 PM UTC. 2020-11-16T20:27:39.447 INFO:teuthology.orchestra.run.smithi059.stderr:Modular dependency problem: 2020-11-16T20:27:39.448 INFO:teuthology.orchestra.run.smithi059.stderr: 2020-11-16T20:27:39.448 INFO:teuthology.orchestra.run.smithi059.stderr: Problem: conflicting requests 2020-11-16T20:27:39.448 INFO:teuthology.orchestra.run.smithi059.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-11-16T20:27:39.544 INFO:teuthology.orchestra.run.smithi059.stdout:Installed package kernel-4.18.0-193.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-11-16T20:27:39.545 INFO:teuthology.orchestra.run.smithi059.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-11-16T20:27:39.600 INFO:teuthology.orchestra.run.smithi059.stderr:Error: No packages marked for reinstall. 2020-11-16T20:27:39.671 INFO:teuthology.orchestra.run.smithi059:> rpm -q kernel --last | head -n 1 2020-11-16T20:27:39.737 INFO:teuthology.orchestra.run.smithi059.stdout:kernel-4.18.0-193.el8.x86_64 Sun 10 May 2020 01:56:55 PM UTC 2020-11-16T20:27:39.738 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-193.el8.x86_64 2020-11-16T20:27:39.738 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-11-16T20:27:39.739 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-11-16T20:27:39.739 INFO:teuthology.orchestra.run.smithi166:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-11-16T20:27:39.776 INFO:teuthology.orchestra.run.smithi166.stdout:ttyS1 2020-11-16T20:27:39.790 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-11-16T20:27:39.791 INFO:teuthology.orchestra.run.smithi059:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-11-16T20:27:39.829 INFO:teuthology.orchestra.run.smithi059.stdout:ttyS1 2020-11-16T20:27:39.843 INFO:teuthology.run_tasks:Running task internal.base... 2020-11-16T20:27:39.852 INFO:teuthology.task.internal:Creating test directory... 2020-11-16T20:27:39.853 INFO:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-16T20:27:39.885 INFO:teuthology.orchestra.run.smithi166:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-16T20:27:39.900 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-11-16T20:27:39.907 INFO:teuthology.run_tasks:Running task internal.archive... 2020-11-16T20:27:39.938 INFO:teuthology.task.internal:Creating archive directory... 2020-11-16T20:27:39.938 INFO:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-16T20:27:39.941 INFO:teuthology.orchestra.run.smithi166:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-16T20:27:39.965 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-11-16T20:27:39.972 INFO:teuthology.task.internal:Enabling coredump saving... 2020-11-16T20:27:39.973 INFO:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-16T20:27:40.002 INFO:teuthology.orchestra.run.smithi166:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-16T20:27:40.035 INFO:teuthology.orchestra.run.smithi166.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-16T20:27:40.046 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-16T20:27:40.049 INFO:teuthology.orchestra.run.smithi166.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-16T20:27:40.062 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-16T20:27:40.063 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-11-16T20:27:40.074 INFO:teuthology.task.internal:Configuring sudo... 2020-11-16T20:27:40.074 INFO:teuthology.orchestra.run.smithi059:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-16T20:27:40.076 INFO:teuthology.orchestra.run.smithi166:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-16T20:27:40.119 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-11-16T20:27:40.129 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-11-16T20:27:40.129 INFO:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-16T20:27:40.147 INFO:teuthology.orchestra.run.smithi166:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-16T20:27:40.174 INFO:teuthology.orchestra.run.smithi166:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-16T20:27:40.245 INFO:teuthology.orchestra.run.smithi166:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-16T20:27:40.312 INFO:teuthology.orchestra.run.smithi166:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-16T20:27:40.345 INFO:teuthology.orchestra.run.smithi166:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-16T20:27:40.395 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-16T20:27:40.396 INFO:teuthology.orchestra.run.smithi166:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-16T20:27:40.448 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-16T20:27:40.460 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-16T20:27:40.460 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-16T20:27:40.461 INFO:teuthology.orchestra.run.smithi166.stderr:152 bytes copied, 3.075e-05 s, 4.9 MB/s 2020-11-16T20:27:40.461 INFO:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-16T20:27:40.493 INFO:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-16T20:27:40.558 INFO:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-16T20:27:40.630 INFO:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-16T20:27:40.684 INFO:teuthology.orchestra.run.smithi059:> set -ex 2020-11-16T20:27:40.684 INFO:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-16T20:27:40.737 INFO:teuthology.orchestra.run.smithi059.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-16T20:27:40.753 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records in 2020-11-16T20:27:40.753 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records out 2020-11-16T20:27:40.753 INFO:teuthology.orchestra.run.smithi059.stderr:152 bytes copied, 3.1112e-05 s, 4.9 MB/s 2020-11-16T20:27:40.754 INFO:teuthology.orchestra.run.smithi059:> sudo service rsyslog restart 2020-11-16T20:27:40.796 INFO:teuthology.orchestra.run.smithi166:> sudo service rsyslog restart 2020-11-16T20:27:40.849 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-11-16T20:27:40.852 INFO:teuthology.orchestra.run.smithi166.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-11-16T20:27:41.323 INFO:teuthology.run_tasks:Running task internal.timer... 2020-11-16T20:27:41.333 INFO:teuthology.task.internal:Starting timer... 2020-11-16T20:27:41.334 INFO:teuthology.run_tasks:Running task pcp... 2020-11-16T20:27:41.360 INFO:teuthology.run_tasks:Running task selinux... 2020-11-16T20:27:41.390 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-11-16T20:27:41.390 INFO:teuthology.orchestra.run.smithi059:> sudo service auditd rotate 2020-11-16T20:27:41.456 INFO:teuthology.orchestra.run.smithi059.stdout:Rotating logs: [ OK ] 2020-11-16T20:27:41.457 INFO:teuthology.orchestra.run.smithi166:> sudo service auditd rotate 2020-11-16T20:27:41.522 INFO:teuthology.orchestra.run.smithi166.stdout:Rotating logs: [ OK ] 2020-11-16T20:27:41.524 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-11-16T20:27:41.524 INFO:teuthology.orchestra.run.smithi166:> /usr/sbin/getenforce 2020-11-16T20:27:41.545 INFO:teuthology.orchestra.run.smithi166.stdout:Permissive 2020-11-16T20:27:41.545 INFO:teuthology.orchestra.run.smithi059:> /usr/sbin/getenforce 2020-11-16T20:27:41.568 INFO:teuthology.orchestra.run.smithi059.stdout:Permissive 2020-11-16T20:27:41.569 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi166.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi059.front.sepia.ceph.com': 'permissive'} 2020-11-16T20:27:41.569 INFO:teuthology.orchestra.run.smithi166:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-11-16T20:27:41.613 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-16T20:27:41.614 INFO:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-11-16T20:27:41.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-16T20:27:41.646 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-11-16T20:27:41.646 INFO:teuthology.orchestra.run.smithi166:> sudo /usr/sbin/setenforce permissive 2020-11-16T20:27:41.680 INFO:teuthology.orchestra.run.smithi059:> sudo /usr/sbin/setenforce permissive 2020-11-16T20:27:41.717 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-11-16T20:27:41.727 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2020-11-16T20:27:41.734 INFO:teuthology.repo_utils:Fetching master from origin 2020-11-16T20:27:41.780 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-11-16T20:27:41.793 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-11-16T20:27:41.795 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi166.front.sepia.ceph.com,smithi059.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-11-16T20:27:42.104 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-11-16T20:27:47.014 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-11-16T20:27:53.469 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-11-16T20:27:53.487 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:27:53 +0000 (0:00:04.257) 0:00:04.257 ******* 2020-11-16T20:27:57.705 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:27:57 +0000 (0:00:04.217) 0:00:08.475 ******* 2020-11-16T20:28:03.381 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-11-16T20:28:03.383 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] 2020-11-16T20:28:03.421 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] 2020-11-16T20:28:03.476 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:28:03 +0000 (0:00:05.771) 0:00:14.246 ******* 2020-11-16T20:28:03.515 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:28:03 +0000 (0:00:00.038) 0:00:14.285 ******* 2020-11-16T20:28:03.789 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-11-16T20:28:03.791 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-16T20:28:03.820 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:28:03 +0000 (0:00:00.305) 0:00:14.590 ******* 2020-11-16T20:28:03.827 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-16T20:28:03.860 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:28:03 +0000 (0:00:00.038) 0:00:14.629 ******* 2020-11-16T20:28:04.226 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-11-16T20:28:04.228 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-16T20:28:04.262 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:28:04 +0000 (0:00:00.402) 0:00:15.031 ******* 2020-11-16T20:28:04.269 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-16T20:28:04.302 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:28:04 +0000 (0:00:00.040) 0:00:15.072 ******* 2020-11-16T20:28:04.307 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-11-16T20:28:04.309 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:28:04.340 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:28:04 +0000 (0:00:00.038) 0:00:15.110 ******* 2020-11-16T20:28:04.347 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:28:04.381 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:28:04 +0000 (0:00:00.040) 0:00:15.151 ******* 2020-11-16T20:28:04.646 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-11-16T20:28:04.647 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-16T20:28:04.678 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:28:04 +0000 (0:00:00.297) 0:00:15.448 ******* 2020-11-16T20:28:04.686 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-16T20:28:04.725 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:28:04 +0000 (0:00:00.046) 0:00:15.495 ******* 2020-11-16T20:28:22.359 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-11-16T20:28:22.361 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605558484.6930423-66802028004532/source", "state": "file", "uid": 0} 2020-11-16T20:28:22.401 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:28:22 +0000 (0:00:17.676) 0:00:33.171 ******* 2020-11-16T20:28:22.409 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605558484.741105-255123464334486/source", "state": "file", "uid": 0} 2020-11-16T20:28:22.450 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:28:22 +0000 (0:00:00.048) 0:00:33.220 ******* 2020-11-16T20:28:35.538 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-11-16T20:28:35.540 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-11-16T20:28:35.541 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-11-16T20:28:35.600 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-11-16T20:28:35.601 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-11-16T20:28:35.685 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-11-16T20:28:35.692 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-11-16T20:28:35.819 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:28:35 +0000 (0:00:13.368) 0:00:46.588 ******* 2020-11-16T20:28:35.848 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:28:35 +0000 (0:00:00.029) 0:00:46.618 ******* 2020-11-16T20:29:01.267 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi166.front.sepia.ceph.com] 2020-11-16T20:29:01.307 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] 2020-11-16T20:29:01.364 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-11-16T20:29:01.365 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:29:01 +0000 (0:00:25.516) 0:01:12.134 ******* 2020-11-16T20:29:01.406 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:29:01 +0000 (0:00:00.042) 0:01:12.176 ******* 2020-11-16T20:29:13.725 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-11-16T20:29:13.727 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.166257", "end": "2020-11-16 20:29:06.060780", "rc": 0, "start": "2020-11-16 20:29:05.894523", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-16T20:29:13.758 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:29:13 +0000 (0:00:12.351) 0:01:24.528 ******* 2020-11-16T20:29:13.972 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-11-16T20:29:13.973 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.011399", "end": "2020-11-16 20:29:13.948478", "failed_when_result": false, "rc": 0, "start": "2020-11-16 20:29:13.937079", "stderr": "", "stderr_lines": [], "stdout": "f148133fb0c07a635fda93cc17e7dcc2a5d008b7", "stdout_lines": ["f148133fb0c07a635fda93cc17e7dcc2a5d008b7"]} 2020-11-16T20:29:14.004 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:29:14 +0000 (0:00:00.245) 0:01:24.774 ******* 2020-11-16T20:29:14.031 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-11-16T20:29:14.032 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:29:14.062 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:29:14 +0000 (0:00:00.057) 0:01:24.831 ******* 2020-11-16T20:29:14.068 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-11-16T20:29:14.070 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.162388", "end": "2020-11-16 20:29:14.044656", "rc": 0, "start": "2020-11-16 20:29:13.882268", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-16T20:29:14.105 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:29:14 +0000 (0:00:00.043) 0:01:24.875 ******* 2020-11-16T20:29:14.113 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-11-16T20:29:14.115 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:29:14.146 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:29:14 +0000 (0:00:00.040) 0:01:24.916 ******* 2020-11-16T20:29:14.173 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:29:14.205 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:29:14 +0000 (0:00:00.059) 0:01:24.975 ******* 2020-11-16T20:29:14.232 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-11-16T20:29:14.234 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:29:14.275 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:29:14 +0000 (0:00:00.070) 0:01:25.045 ******* 2020-11-16T20:29:14.303 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-11-16T20:29:14.304 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:29:14.346 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:29:14 +0000 (0:00:00.071) 0:01:25.116 ******* 2020-11-16T20:29:14.356 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.007489", "end": "2020-11-16 20:29:14.307696", "failed_when_result": false, "rc": 0, "start": "2020-11-16 20:29:14.300207", "stderr": "", "stderr_lines": [], "stdout": "f148133fb0c07a635fda93cc17e7dcc2a5d008b7", "stdout_lines": ["f148133fb0c07a635fda93cc17e7dcc2a5d008b7"]} 2020-11-16T20:29:14.417 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:29:14 +0000 (0:00:00.070) 0:01:25.187 ******* 2020-11-16T20:29:14.447 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:29:14.491 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:29:14 +0000 (0:00:00.073) 0:01:25.260 ******* 2020-11-16T20:29:14.518 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:29:14.551 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:29:14 +0000 (0:00:00.060) 0:01:25.320 ******* 2020-11-16T20:29:14.559 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-11-16T20:29:14.561 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-16T20:29:14.594 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:29:14 +0000 (0:00:00.043) 0:01:25.364 ******* 2020-11-16T20:29:14.600 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-11-16T20:29:14.602 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:29:14.636 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:29:14 +0000 (0:00:00.040) 0:01:25.405 ******* 2020-11-16T20:29:14.663 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-11-16T20:29:14.665 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:29:14.695 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:29:14 +0000 (0:00:00.060) 0:01:25.465 ******* 2020-11-16T20:29:14.723 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-11-16T20:29:14.725 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:29:14.754 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:29:14 +0000 (0:00:00.059) 0:01:25.524 ******* 2020-11-16T20:29:19.031 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T20:29:19.033 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-11-16T20:29:27.602 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-11-16T20:29:31.607 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-11-16T20:29:31.608 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-16T20:29:31.639 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:29:31 +0000 (0:00:16.884) 0:01:42.409 ******* 2020-11-16T20:29:31.935 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T20:29:31.937 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-11-16T20:29:36.084 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-11-16T20:29:36.282 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-11-16T20:29:36.314 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2020-11-16T20:29:36.491 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-11-16T20:29:36.503 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-11-16T20:29:36.689 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2020-11-16T20:29:36.702 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-11-16T20:29:36.890 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-11-16T20:29:36.901 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-11-16T20:29:37.078 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-11-16T20:29:37.100 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-11-16T20:29:37.277 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-11-16T20:29:37.309 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-11-16T20:29:41.594 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-11-16T20:29:41.709 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-11-16T20:29:41.792 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-11-16T20:29:41.917 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-11-16T20:29:46.326 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-11-16T20:29:54.515 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-11-16T20:29:54.705 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-11-16T20:29:54.834 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-11-16T20:29:54.897 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-11-16T20:29:55.044 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-11-16T20:29:55.087 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-11-16T20:29:55.246 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-11-16T20:29:55.288 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-11-16T20:29:55.455 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-11-16T20:29:55.477 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-11-16T20:29:55.665 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-11-16T20:29:55.666 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-11-16T20:29:59.998 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-11-16T20:30:00.020 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-11-16T20:30:08.503 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-11-16T20:30:12.618 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-11-16T20:30:12.815 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-11-16T20:30:12.878 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-11-16T20:30:13.003 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-11-16T20:30:13.078 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-11-16T20:30:13.192 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-11-16T20:30:13.287 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-11-16T20:30:13.391 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-11-16T20:30:13.496 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-11-16T20:30:13.704 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-11-16T20:30:18.050 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-11-16T20:30:30.132 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-11-16T20:30:30.330 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-11-16T20:30:30.517 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-11-16T20:30:30.673 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-11-16T20:30:30.706 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-11-16T20:30:30.873 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-11-16T20:30:30.904 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-11-16T20:30:31.092 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-11-16T20:30:35.257 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-11-16T20:30:35.455 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-11-16T20:30:35.466 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-11-16T20:30:39.799 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-11-16T20:30:39.811 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-11-16T20:30:39.999 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-11-16T20:30:40.010 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-11-16T20:30:40.187 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-11-16T20:30:40.219 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-11-16T20:30:40.385 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-11-16T20:30:40.428 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-11-16T20:30:40.575 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-11-16T20:30:40.627 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-11-16T20:30:40.763 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-11-16T20:30:40.836 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-11-16T20:30:40.951 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-11-16T20:30:41.034 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-11-16T20:30:41.149 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-11-16T20:30:41.242 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-11-16T20:30:41.338 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-11-16T20:30:41.442 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-11-16T20:30:41.527 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-11-16T20:30:41.725 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-11-16T20:30:46.195 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-11-16T20:30:46.381 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-11-16T20:30:46.578 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-11-16T20:30:46.766 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-11-16T20:30:46.953 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-11-16T20:30:47.149 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-11-16T20:30:47.346 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-11-16T20:30:47.532 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-11-16T20:30:50.143 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-11-16T20:30:50.340 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-11-16T20:30:50.547 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-11-16T20:30:50.754 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-11-16T20:30:50.963 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-11-16T20:30:51.180 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-11-16T20:30:51.375 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-11-16T20:30:51.583 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-11-16T20:30:51.791 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-11-16T20:30:51.936 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-11-16T20:30:51.988 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-11-16T20:30:52.133 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-11-16T20:30:52.198 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-11-16T20:30:52.323 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-11-16T20:30:52.403 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-11-16T20:30:52.522 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-11-16T20:30:52.619 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-11-16T20:30:52.749 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-11-16T20:30:57.030 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-11-16T20:30:57.114 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-11-16T20:30:57.229 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-11-16T20:30:57.312 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-11-16T20:30:57.438 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-11-16T20:30:57.501 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-11-16T20:30:57.636 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-11-16T20:30:57.699 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-11-16T20:30:57.844 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-11-16T20:30:57.886 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-11-16T20:30:58.053 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-11-16T20:30:58.085 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-11-16T20:30:58.251 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-11-16T20:30:58.273 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-11-16T20:30:58.462 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-11-16T20:30:58.465 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-11-16T20:31:02.936 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-11-16T20:31:02.948 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-11-16T20:31:03.134 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-11-16T20:31:03.156 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-11-16T20:31:03.323 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-11-16T20:31:03.367 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-11-16T20:31:03.512 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-11-16T20:31:03.565 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-11-16T20:31:03.712 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-11-16T20:31:03.776 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-11-16T20:31:03.901 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-11-16T20:31:03.976 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-11-16T20:31:04.091 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-11-16T20:31:04.185 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-11-16T20:31:04.289 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-11-16T20:31:12.980 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-11-16T20:31:21.221 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-11-16T20:31:21.429 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-11-16T20:31:21.524 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-11-16T20:31:21.628 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-11-16T20:31:21.723 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-11-16T20:31:21.838 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-11-16T20:31:21.912 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-11-16T20:31:22.041 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-11-16T20:31:22.108 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-11-16T20:31:22.254 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-11-16T20:31:22.297 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-11-16T20:31:22.453 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-11-16T20:31:22.485 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-11-16T20:31:22.685 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-11-16T20:31:22.873 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-11-16T20:31:26.860 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-11-16T20:31:27.087 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-11-16T20:31:27.293 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-11-16T20:31:27.305 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-11-16T20:31:27.492 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-11-16T20:31:27.504 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-11-16T20:31:27.683 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-11-16T20:31:27.715 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-11-16T20:31:27.882 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-11-16T20:31:27.914 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-11-16T20:31:28.070 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-11-16T20:31:32.243 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-11-16T20:31:32.368 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-11-16T20:31:32.454 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-11-16T20:31:32.560 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-11-16T20:31:32.655 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-11-16T20:31:32.760 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-11-16T20:31:32.864 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-11-16T20:31:32.949 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-11-16T20:31:33.064 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-11-16T20:31:33.137 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-11-16T20:31:33.274 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-11-16T20:31:33.327 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-11-16T20:31:33.473 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-11-16T20:31:33.526 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-11-16T20:31:33.681 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-11-16T20:31:33.713 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-11-16T20:31:33.889 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-11-16T20:31:33.911 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-11-16T20:31:38.274 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-11-16T20:31:38.296 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-11-16T20:31:38.475 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-11-16T20:31:38.497 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-11-16T20:31:38.665 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-11-16T20:31:38.707 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-11-16T20:31:42.970 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-11-16T20:31:43.095 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-11-16T20:31:43.169 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-11-16T20:31:43.294 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-11-16T20:31:43.357 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-11-16T20:31:43.503 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-11-16T20:31:43.546 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-11-16T20:31:43.703 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-11-16T20:31:43.745 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-11-16T20:31:43.913 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-11-16T20:31:43.935 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-11-16T20:31:44.112 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-11-16T20:31:44.134 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-11-16T20:31:44.322 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-11-16T20:31:44.322 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-11-16T20:31:44.520 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-11-16T20:31:44.521 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-11-16T20:31:44.708 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2020-11-16T20:31:44.730 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-11-16T20:31:49.023 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2020-11-16T20:31:49.137 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-11-16T20:31:49.221 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2020-11-16T20:31:49.346 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-11-16T20:31:49.409 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2020-11-16T20:31:49.545 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-11-16T20:31:49.598 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2020-11-16T20:31:49.754 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-11-16T20:31:49.786 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2020-11-16T20:31:49.961 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-11-16T20:31:49.984 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2020-11-16T20:31:50.159 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-11-16T20:31:50.182 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2020-11-16T20:31:50.370 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-11-16T20:31:50.372 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2020-11-16T20:31:54.753 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2020-11-16T20:31:54.775 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-11-16T20:31:54.973 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2020-11-16T20:31:55.193 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2020-11-16T20:31:55.393 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2020-11-16T20:31:55.604 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2020-11-16T20:31:55.803 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2020-11-16T20:31:56.011 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2020-11-16T20:31:56.115 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-11-16T20:31:56.209 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2020-11-16T20:32:00.514 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2020-11-16T20:32:01.381 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "name": "prateek", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2020-11-16T20:32:06.713 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "name": "jelopez", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2020-11-16T20:32:07.836 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "name": "dcain", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2020-11-16T20:32:13.218 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "name": "sunny", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2020-11-16T20:32:17.262 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2020-11-16T20:32:29.872 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2020-11-16T20:32:31.071 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2020-11-16T20:32:32.237 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10108, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "name": "aclewett", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10108} 2020-11-16T20:32:37.482 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10109, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "name": "cblum", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10109} 2020-11-16T20:32:38.583 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10110, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10110} 2020-11-16T20:32:43.760 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10111, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10111} 2020-11-16T20:32:43.802 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-11-16T20:32:49.053 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10112, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10112} 2020-11-16T20:32:53.240 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "name": "prateek", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2020-11-16T20:32:58.537 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10113, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10113} 2020-11-16T20:32:58.538 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "name": "jelopez", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2020-11-16T20:32:59.657 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10114, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "name": "kchang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10114} 2020-11-16T20:32:59.679 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "name": "dcain", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2020-11-16T20:33:09.161 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10115, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "name": "vereddy", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10115} 2020-11-16T20:33:09.265 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "name": "sunny", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2020-11-16T20:33:14.568 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2020-11-16T20:33:14.589 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10116, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10116} 2020-11-16T20:33:19.958 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10117, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10117} 2020-11-16T20:33:20.011 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10108, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "name": "aclewett", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10108} 2020-11-16T20:33:29.381 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10118, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10118} 2020-11-16T20:33:29.548 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10109, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "name": "cblum", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10109} 2020-11-16T20:33:34.765 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10119, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10119} 2020-11-16T20:33:34.838 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10110, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10110} 2020-11-16T20:33:44.306 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10120, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "name": "julpark", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10120} 2020-11-16T20:33:44.359 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10111, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10111} 2020-11-16T20:33:49.706 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10112, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10112} 2020-11-16T20:33:49.717 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'dorinda', 'ovpn': 'dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10121, "groups": "sudo", "home": "/home/dorinda", "item": {"name": "dorinda", "ovpn": "dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14"}, "name": "dorinda", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10121} 2020-11-16T20:33:59.213 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10113, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10113} 2020-11-16T20:33:59.214 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10122, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "name": "pdhange", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10122} 2020-11-16T20:33:59.326 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:33:59 +0000 (0:04:27.686) 0:06:10.096 ******* 2020-11-16T20:34:03.501 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-11-16T20:34:03.532 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:34:03 +0000 (0:00:04.206) 0:06:14.302 ******* 2020-11-16T20:34:03.580 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-11-16T20:34:03.582 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2020-11-16T20:34:03.583 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2020-11-16T20:34:03.585 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancic 2020-11-16T20:34:03.586 INFO:teuthology.task.ansible.out:h", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkK 2020-11-16T20:34:03.588 INFO:teuthology.task.ansible.out:ztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 2020-11-16T20:34:03.589 INFO:teuthology.task.ansible.out:HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg 2020-11-16T20:34:03.591 INFO:teuthology.task.ansible.out:e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df 2020-11-16T20:34:03.592 INFO:teuthology.task.ansible.out:79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+ 2020-11-16T20:34:03.594 INFO:teuthology.task.ansible.out:7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b 2020-11-16T20:34:03.595 INFO:teuthology.task.ansible.out:0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/ 2020-11-16T20:34:03.597 INFO:teuthology.task.ansible.out:nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelope 2020-11-16T20:34:03.598 INFO:teuthology.task.ansible.out:z", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0 2020-11-16T20:34:03.600 INFO:teuthology.task.ansible.out:dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a 2020-11-16T20:34:03.600 INFO:teuthology.task.ansible.out:55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "dorinda", "ovpn": "dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}]}, "changed": false} 2020-11-16T20:34:03.637 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:34:03 +0000 (0:00:00.104) 0:06:14.407 ******* 2020-11-16T20:34:04.592 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T20:34:04.593 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10114, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "name": "kchang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10114} 2020-11-16T20:34:10.068 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10115, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "name": "vereddy", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10115} 2020-11-16T20:34:11.274 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10116, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10116} 2020-11-16T20:34:16.734 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10117, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10117} 2020-11-16T20:34:21.142 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-11-16T20:34:21.143 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com -> localhost] => {"after": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "attempts": 1, "before": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "changed": false, "remote_url_changed": false} 2020-11-16T20:34:21.174 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:34:21 +0000 (0:00:17.537) 0:06:31.944 ******* 2020-11-16T20:34:21.528 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T20:34:21.529 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-11-16T20:34:21.807 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-11-16T20:34:22.087 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-11-16T20:34:22.163 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T20:34:22.165 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10118, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10118} 2020-11-16T20:34:22.363 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw 2020-11-16T20:34:22.365 INFO:teuthology.task.ansible.out:8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2020-11-16T20:34:22.634 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-11-16T20:34:22.911 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2020-11-16T20:34:22.913 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-11-16T20:34:23.185 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-11-16T20:34:23.460 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10119, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10119} 2020-11-16T20:34:23.472 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T20:34:23.474 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2020-11-16T20:34:23.735 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-11-16T20:34:23.747 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:34:24.701 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T20:34:24.703 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10120, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "name": "julpark", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10120} 2020-11-16T20:34:28.165 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T20:34:28.167 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2020-11-16T20:34:28.169 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-11-16T20:34:32.613 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "a 2020-11-16T20:34:32.615 INFO:teuthology.task.ansible.out:emerson", "validate_certs": true} 2020-11-16T20:34:32.625 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:34:32.626 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:34:32.897 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-11-16T20:34:33.181 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2020-11-16T20:34:33.183 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-11-16T20:34:37.566 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-11-16T20:34:37.838 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-11-16T20:34:38.121 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2020-11-16T20:34:38.384 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T20:34:38.386 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'dorinda', 'ovpn': 'dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10121, "groups": "sudo", "home": "/home/dorinda", "item": {"name": "dorinda", "ovpn": "dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14"}, "name": "dorinda", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10121} 2020-11-16T20:34:38.396 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T20:34:38.398 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-11-16T20:34:38.660 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-11-16T20:34:39.670 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T20:34:39.672 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10122, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "name": "pdhange", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10122} 2020-11-16T20:34:39.780 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:34:39 +0000 (0:00:18.605) 0:06:50.550 ******* 2020-11-16T20:34:47.939 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T20:34:47.942 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-11-16T20:34:47.944 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2020-11-16T20:34:47.945 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABA 2020-11-16T20:34:47.947 INFO:teuthology.task.ansible.out:AABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@ 2020-11-16T20:34:47.948 INFO:teuthology.task.ansible.out:osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-11-16T20:34:47.959 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-11-16T20:34:48.005 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:34:48 +0000 (0:00:08.225) 0:06:58.775 ******* 2020-11-16T20:34:52.339 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-11-16T20:34:52.341 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2020-11-16T20:34:52.342 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2020-11-16T20:34:52.344 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancic 2020-11-16T20:34:52.345 INFO:teuthology.task.ansible.out:h", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkK 2020-11-16T20:34:52.347 INFO:teuthology.task.ansible.out:ztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 2020-11-16T20:34:52.349 INFO:teuthology.task.ansible.out:HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg 2020-11-16T20:34:52.350 INFO:teuthology.task.ansible.out:e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6 2020-11-16T20:34:52.350 INFO:teuthology.task.ansible.out:d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df 2020-11-16T20:34:52.352 INFO:teuthology.task.ansible.out:79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+ 2020-11-16T20:34:52.353 INFO:teuthology.task.ansible.out:7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b 2020-11-16T20:34:52.355 INFO:teuthology.task.ansible.out:0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/ 2020-11-16T20:34:52.356 INFO:teuthology.task.ansible.out:nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelope 2020-11-16T20:34:52.358 INFO:teuthology.task.ansible.out:z", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0 2020-11-16T20:34:52.360 INFO:teuthology.task.ansible.out:dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "dorinda", "ovpn": "dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa9 2020-11-16T20:34:52.360 INFO:teuthology.task.ansible.out:8b5771a1b90741fbfc908cad93ef09a14"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}]}, "changed": false} 2020-11-16T20:34:52.399 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:34:52 +0000 (0:00:04.392) 0:07:03.167 ******* 2020-11-16T20:34:52.696 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T20:34:52.698 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-11-16T20:34:52.967 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2020-11-16T20:34:52.969 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-11-16T20:34:52.989 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-11-16T20:34:52.991 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com -> localhost] => {"after": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "attempts": 1, "before": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "changed": false, "remote_url_changed": false} 2020-11-16T20:34:53.022 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:34:53 +0000 (0:00:00.624) 0:07:03.792 ******* 2020-11-16T20:34:53.239 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-11-16T20:34:53.386 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-11-16T20:34:53.512 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-11-16T20:34:53.679 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-11-16T20:34:53.794 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-11-16T20:34:58.011 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-11-16T20:34:58.095 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-11-16T20:34:58.315 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2020-11-16T20:34:58.317 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2020-11-16T20:34:58.369 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-11-16T20:34:58.631 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-11-16T20:34:58.664 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2020-11-16T20:34:58.666 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-11-16T20:34:58.927 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2020-11-16T20:34:58.929 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-11-16T20:34:58.960 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-11-16T20:34:59.223 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-11-16T20:34:59.234 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-11-16T20:35:04.250 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-11-16T20:35:04.252 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd 2020-11-16T20:35:04.255 INFO:teuthology.task.ansible.out:9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g 2020-11-16T20:35:04.257 INFO:teuthology.task.ansible.out:4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-11-16T20:35:04.316 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2020-11-16T20:35:04.318 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-11-16T20:35:04.507 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-11-16T20:35:04.624 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "a 2020-11-16T20:35:04.626 INFO:teuthology.task.ansible.out:emerson", "validate_certs": true} 2020-11-16T20:35:04.635 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:35:04.647 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:35:04.784 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-11-16T20:35:04.953 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-11-16T20:35:05.068 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-11-16T20:35:13.459 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2020-11-16T20:35:13.461 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-11-16T20:35:13.543 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-11-16T20:35:13.751 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-11-16T20:35:17.985 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2020-11-16T20:35:17.987 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-11-16T20:35:18.214 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-11-16T20:35:18.266 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2020-11-16T20:35:18.268 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-11-16T20:35:18.508 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2020-11-16T20:35:18.540 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-11-16T20:35:18.790 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-11-16T20:35:18.822 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-11-16T20:35:19.103 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-11-16T20:35:19.105 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-11-16T20:35:19.373 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2020-11-16T20:35:19.375 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-11-16T20:35:19.416 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-11-16T20:35:19.673 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2020-11-16T20:35:19.676 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2020-11-16T20:35:19.677 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-11-16T20:35:19.737 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2020-11-16T20:35:19.739 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-11-16T20:35:19.961 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-11-16T20:35:20.036 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2020-11-16T20:35:20.038 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-11-16T20:35:20.225 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-11-16T20:35:20.330 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-11-16T20:35:28.734 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-11-16T20:35:28.860 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-11-16T20:35:29.009 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-11-16T20:35:29.146 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2020-11-16T20:35:29.148 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-11-16T20:35:41.781 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-11-16T20:35:41.896 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-11-16T20:35:42.063 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2020-11-16T20:35:42.065 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-11-16T20:35:42.343 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-11-16T20:35:46.348 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-11-16T20:35:46.660 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-11-16T20:35:46.960 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-11-16T20:35:47.261 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-11-16T20:35:50.868 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-11-16T20:35:51.152 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2020-11-16T20:35:51.154 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2020-11-16T20:35:51.436 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-11-16T20:35:51.797 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2020-11-16T20:35:51.799 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-11-16T20:35:55.892 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-11-16T20:35:56.163 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2020-11-16T20:35:56.165 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-11-16T20:35:56.216 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-11-16T20:35:56.444 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-11-16T20:35:56.497 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-11-16T20:35:56.718 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-11-16T20:35:56.791 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-11-16T20:35:56.998 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-11-16T20:35:57.083 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-11-16T20:35:57.286 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-11-16T20:35:57.380 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-11-16T20:35:57.561 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-11-16T20:35:57.665 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-11-16T20:35:57.830 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-11-16T20:36:02.145 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-11-16T20:36:02.238 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-11-16T20:36:02.436 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-11-16T20:36:02.510 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-11-16T20:36:02.737 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-11-16T20:36:02.780 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-11-16T20:36:03.043 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2020-11-16T20:36:03.045 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-11-16T20:36:03.054 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-11-16T20:36:03.336 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2020-11-16T20:36:03.338 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-11-16T20:36:03.612 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-11-16T20:36:03.623 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-11-16T20:36:03.885 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-11-16T20:36:03.917 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-11-16T20:36:08.280 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-11-16T20:36:08.405 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-11-16T20:36:08.562 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-11-16T20:36:08.698 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2020-11-16T20:36:08.701 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-11-16T20:36:08.835 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-11-16T20:36:09.012 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2020-11-16T20:36:09.014 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2020-11-16T20:36:09.015 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-11-16T20:36:09.117 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-11-16T20:36:09.308 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-11-16T20:36:09.393 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-11-16T20:36:09.602 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-11-16T20:36:09.665 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-11-16T20:36:14.035 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-11-16T20:36:14.129 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-11-16T20:36:14.336 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-11-16T20:36:14.408 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3d 2020-11-16T20:36:14.410 INFO:teuthology.task.ansible.out:UPS1lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-11-16T20:36:14.649 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-11-16T20:36:14.692 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-11-16T20:36:14.941 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2020-11-16T20:36:14.943 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-11-16T20:36:14.963 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-11-16T20:36:15.232 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-11-16T20:36:15.234 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-11-16T20:36:19.655 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-11-16T20:36:19.666 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-11-16T20:36:19.925 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2020-11-16T20:36:19.927 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-11-16T20:36:19.957 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2020-11-16T20:36:19.959 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2020-11-16T20:36:24.305 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2020-11-16T20:36:24.306 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-11-16T20:36:24.430 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-11-16T20:36:24.586 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-11-16T20:36:24.721 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-11-16T20:36:24.857 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-11-16T20:36:25.016 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2020-11-16T20:36:25.018 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-11-16T20:36:25.145 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-11-16T20:36:25.324 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-11-16T20:36:25.422 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-11-16T20:36:29.753 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-11-16T20:36:29.836 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-11-16T20:36:30.055 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-11-16T20:36:30.108 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-11-16T20:36:30.348 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-11-16T20:36:30.391 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-11-16T20:36:30.643 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-11-16T20:36:30.654 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro 2020-11-16T20:36:30.656 INFO:teuthology.task.ansible.out:.local", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-11-16T20:36:30.934 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-11-16T20:36:30.936 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-11-16T20:36:36.342 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-11-16T20:36:36.344 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgB 2020-11-16T20:36:36.345 INFO:teuthology.task.ansible.out:h2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhu 2020-11-16T20:36:36.347 INFO:teuthology.task.ansible.out:ZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQ 2020-11-16T20:36:36.348 INFO:teuthology.task.ansible.out:JrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-11-16T20:36:40.545 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-11-16T20:36:40.679 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-11-16T20:36:40.815 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2020-11-16T20:36:40.817 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-11-16T20:36:40.972 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-11-16T20:36:41.093 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-11-16T20:36:41.363 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-11-16T20:36:45.358 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-11-16T20:36:45.649 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-11-16T20:36:45.754 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-11-16T20:36:45.954 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-11-16T20:36:46.039 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-11-16T20:36:46.246 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-11-16T20:36:50.514 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-11-16T20:36:50.752 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-11-16T20:36:50.783 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-11-16T20:36:51.046 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-11-16T20:36:51.058 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-11-16T20:36:51.344 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-11-16T20:36:51.346 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-11-16T20:36:51.612 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2020-11-16T20:36:51.634 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-11-16T20:36:51.896 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2020-11-16T20:36:51.929 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3d 2020-11-16T20:36:51.930 INFO:teuthology.task.ansible.out:UPS1lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-11-16T20:36:52.168 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2020-11-16T20:36:52.232 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-11-16T20:36:52.451 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2020-11-16T20:36:52.525 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-11-16T20:36:52.723 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2020-11-16T20:36:52.818 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-11-16T20:36:52.995 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2020-11-16T20:36:53.109 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-11-16T20:36:53.269 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2020-11-16T20:36:53.405 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2020-11-16T20:36:53.407 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-11-16T20:36:53.540 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2020-11-16T20:36:53.696 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2020-11-16T20:36:53.697 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-11-16T20:36:53.821 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2020-11-16T20:36:53.999 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-11-16T20:36:54.094 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2020-11-16T20:36:54.291 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-11-16T20:36:54.375 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpb 2020-11-16T20:36:54.377 INFO:teuthology.task.ansible.out:cmjLd+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2020-11-16T20:36:54.583 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-11-16T20:36:54.645 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2020-11-16T20:36:54.873 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-11-16T20:36:54.915 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2020-11-16T20:36:55.175 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-11-16T20:36:55.196 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2020-11-16T20:36:55.465 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2020-11-16T20:36:55.467 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-11-16T20:36:55.746 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2020-11-16T20:36:55.777 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-11-16T20:36:56.022 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2020-11-16T20:36:56.077 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro 2020-11-16T20:36:56.079 INFO:teuthology.task.ansible.out:.local", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-11-16T20:36:56.297 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2020-11-16T20:36:56.393 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-11-16T20:36:56.571 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2020-11-16T20:36:56.685 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-11-16T20:37:01.019 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2020-11-16T20:37:01.133 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-11-16T20:37:01.292 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2020-11-16T20:37:01.427 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-11-16T20:37:01.572 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2020-11-16T20:37:01.718 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-11-16T20:37:01.844 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2020-11-16T20:37:02.001 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-11-16T20:37:06.324 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2020-11-16T20:37:06.459 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2020-11-16T20:37:06.461 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-11-16T20:37:06.605 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'dorinda', 'ovpn': 'dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dorinda", "ovpn": "dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCi/D/4aW9zznIgklcFOMxAIVSMDeSnlU7oIBAvHnABokWyJBC+/FEjFVFmJV/z5J7j8EYxOFl+nzVITpXRmAdote1gGVCJmO7p7tSvsb6ZcAsWFGeZuZLoByG7Bw4WQ3uM4AH10Dd3W5ET7SS4qv9BspGqGlJs+qGE8idTW3Hs17mGS6vF3/3wzCmWVDXUEcygqNDmYINgrw4MT/LzvRGDrh2lfoL7gKkHhCozAffOia5a1rbGfAiptAeOa3PzufoOhglfxdZ+R2Ox485a6ez0y5Nc8cjO2AR3kNVgsjna3ehrsuHmWKi+yB06C+x7gwgFqfwsbo4eIWlIb0a0s3wz dorindabassey@gmail.com", "key_options": null, "keyfile": "/home/dorinda/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dorinda", "validate_certs": true} 2020-11-16T20:37:06.741 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-11-16T20:37:06.877 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2020-11-16T20:37:06.960 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:37:06 +0000 (0:02:13.938) 0:09:17.730 ******* 2020-11-16T20:37:07.008 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-16T20:37:07.010 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:07.020 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:07.031 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:07.031 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:07.033 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-11-16T20:37:07.043 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-16T20:37:07.045 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:07.054 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:07.056 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:07.065 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:11.509 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-11-16T20:37:11.511 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:11.521 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:11.522 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-11-16T20:37:20.140 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-16T20:37:20.142 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-11-16T20:37:20.151 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T20:37:20.153 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-11-16T20:37:20.411 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-16T20:37:20.413 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-11-16T20:37:20.422 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.433 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.444 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.445 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.455 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.456 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.466 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.477 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.479 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.488 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.499 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.501 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.510 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.512 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.521 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.532 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.543 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.544 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.554 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.556 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.565 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.576 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.578 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.587 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.589 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.599 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.609 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.611 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.620 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.631 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.633 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.642 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.653 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.655 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.664 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.666 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.676 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.687 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.688 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.698 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.709 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.710 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.720 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.721 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.731 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.742 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.743 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.753 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.764 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.765 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.775 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.777 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.786 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.797 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.799 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.808 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.810 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.820 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.832 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.842 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.853 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.855 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.864 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.875 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.877 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.886 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.888 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.897 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.908 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.910 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.919 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.930 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.932 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.941 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.943 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.953 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.963 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.965 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.975 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.986 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.987 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.997 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:20.999 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.008 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.019 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.021 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.030 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.041 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.043 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.052 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.054 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.063 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.074 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.075 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.085 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.096 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.097 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.107 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.108 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.118 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.128 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.130 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.139 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.150 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.152 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.162 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.163 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.173 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.186 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.195 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.206 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.207 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.217 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.218 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.229 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.240 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.242 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.251 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.253 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.263 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'dorinda', 'ovpn': 'dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dorinda", "ovpn": "dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.274 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.321 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:37:21 +0000 (0:00:14.360) 0:09:32.091 ******* 2020-11-16T20:37:21.359 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-11-16T20:37:21.360 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:37:21.394 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:37:21 +0000 (0:00:00.073) 0:09:32.164 ******* 2020-11-16T20:37:21.629 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:37:21.631 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-11-16T20:37:21.808 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-11-16T20:37:22.005 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-11-16T20:37:22.193 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-11-16T20:37:22.382 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-11-16T20:37:22.569 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-11-16T20:37:22.756 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-11-16T20:37:22.943 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2020-11-16T20:37:23.131 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2020-11-16T20:37:23.317 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-11-16T20:37:23.504 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-11-16T20:37:23.691 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-11-16T20:37:23.878 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-11-16T20:37:24.068 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-11-16T20:37:24.257 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-11-16T20:37:24.454 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-11-16T20:37:33.800 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T20:37:33.801 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-11-16T20:37:33.803 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi166.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} ok: [smithi166.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-11-16T20:37:33.803 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T20:37:33.803 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-11-16T20:37:33.805 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi166.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-11-16T20:37:33.805 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:37:33.805 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-11-16T20:37:33.858 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-11-16T20:37:33.890 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T20:37:33.892 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-11-16T20:37:38.156 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:37:38.158 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-11-16T20:37:38.365 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-11-16T20:37:38.376 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T20:37:38.378 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2020-11-16T20:37:38.545 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi166.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-11-16T20:37:38.690 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T20:37:38.804 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi166.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-11-16T20:37:38.921 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-11-16T20:37:38.996 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T20:37:38.997 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2020-11-16T20:37:39.111 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:37:39.113 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-11-16T20:37:39.298 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-11-16T20:37:39.330 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T20:37:39.332 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2020-11-16T20:37:39.489 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:37:39.491 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-11-16T20:37:39.624 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T20:37:39.626 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2020-11-16T20:37:39.677 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:37:39.679 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-11-16T20:37:39.865 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-11-16T20:37:39.917 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T20:37:39.919 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2020-11-16T20:37:40.054 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi166.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-11-16T20:37:40.206 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T20:37:40.208 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2020-11-16T20:37:40.249 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:37:40.251 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-11-16T20:37:48.743 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-11-16T20:37:52.970 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T20:37:52.972 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2020-11-16T20:37:53.085 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:37:53.087 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-11-16T20:38:09.832 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T20:38:09.834 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi166.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2020-11-16T20:38:10.133 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T20:38:10.135 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2020-11-16T20:38:14.636 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpb 2020-11-16T20:38:14.638 INFO:teuthology.task.ansible.out:cmjLd+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2020-11-16T20:38:14.925 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2020-11-16T20:38:15.225 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2020-11-16T20:38:15.516 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2020-11-16T20:38:15.805 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2020-11-16T20:38:20.120 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2020-11-16T20:38:20.411 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2020-11-16T20:38:20.700 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2020-11-16T20:38:20.998 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2020-11-16T20:38:21.288 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2020-11-16T20:38:21.577 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2020-11-16T20:38:21.878 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2020-11-16T20:38:22.171 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2020-11-16T20:38:22.255 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:38:22.257 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2020-11-16T20:38:22.443 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-11-16T20:38:22.465 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T20:38:22.466 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2020-11-16T20:38:22.625 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:38:22.627 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-11-16T20:38:22.762 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T20:38:22.764 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'dorinda', 'ovpn': 'dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dorinda", "ovpn": "dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCi/D/4aW9zznIgklcFOMxAIVSMDeSnlU7oIBAvHnABokWyJBC+/FEjFVFmJV/z5J7j8EYxOFl+nzVITpXRmAdote1gGVCJmO7p7tSvsb6ZcAsWFGeZuZLoByG7Bw4WQ3uM4AH10Dd3W5ET7SS4qv9BspGqGlJs+qGE8idTW3Hs17mGS6vF3/3wzCmWVDXUEcygqNDmYINgrw4MT/LzvRGDrh2lfoL7gKkHhCozAffOia5a1rbGfAiptAeOa3PzufoOhglfxdZ+R2Ox485a6ez0y5Nc8cjO2AR3kNVgsjna3ehrsuHmWKi+yB06C+x7gwgFqfwsbo4eIWlIb0a0s3wz dorindabassey@gmail.com", "key_options": null, "keyfile": "/home/dorinda/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dorinda", "validate_certs": true} 2020-11-16T20:38:22.815 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:38:22.816 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-11-16T20:38:23.004 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-11-16T20:38:23.058 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T20:38:23.060 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2020-11-16T20:38:23.146 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:23 +0000 (0:01:01.751) 0:10:33.916 ******* 2020-11-16T20:38:23.194 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-16T20:38:23.196 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi166.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:23.197 INFO:teuthology.task.ansible.out: 2020-11-16T20:38:23.207 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:23.218 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:23.229 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:23.230 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:23.240 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:23.251 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:23.253 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:23.387 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:38:23.389 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-11-16T20:38:23.577 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-11-16T20:38:23.588 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-16T20:38:23.590 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-11-16T20:38:23.599 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:23.601 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:23.767 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:38:23.768 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-11-16T20:38:23.902 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-16T20:38:23.904 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-11-16T20:38:23.965 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:38:23.967 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2020-11-16T20:38:24.153 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2020-11-16T20:38:24.205 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:24 +0000 (0:00:01.058) 0:10:34.974 ******* 2020-11-16T20:38:24.213 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-16T20:38:24.215 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfad 2020-11-16T20:38:24.217 INFO:teuthology.task.ansible.out:a28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.227 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.238 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.239 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.251 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.263 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.275 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.277 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.288 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.299 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.301 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.311 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.313 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.323 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.334 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.335 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.347 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.348 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.358 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.360 INFO:teuthology.task.ansible.out: 2020-11-16T20:38:24.370 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.371 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.389 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.391 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.400 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.411 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.413 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.423 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.425 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.434 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.446 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.446 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.457 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.469 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.471 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.480 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.491 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.493 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.502 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.503 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.514 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.527 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.528 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.539 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.550 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.561 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.562 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.574 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.577 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.588 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.590 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.600 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.611 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.612 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.622 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.633 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.635 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.644 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.646 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.656 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.667 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.668 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.678 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.689 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.691 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.700 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.711 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.713 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.723 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.734 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-11-16T20:38:24.736 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "7058a4a5caaffbbf4cc3cd1573412c26", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605559104.2297325-206073825345879/source", "state": "file", "uid": 0} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.777 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:24 +0000 (0:00:00.572) 0:10:35.547 ******* 2020-11-16T20:38:24.784 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.785 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomo 2020-11-16T20:38:24.787 INFO:teuthology.task.ansible.out:n@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.797 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.799 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.809 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-11-16T20:38:24.811 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => { "msg": "Host smithi166.front.sepia.ceph.com is running RedHat 8.1 (Ootpa)" } TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.844 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:24 +0000 (0:00:00.066) 0:10:35.613 ******* 2020-11-16T20:38:24.851 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.853 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.863 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.865 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.876 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.877 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-11-16T20:38:24.878 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2020-11-16T20:38:24.879 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.911 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:24 +0000 (0:00:00.067) 0:10:35.681 ******* 2020-11-16T20:38:24.918 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.919 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.921 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.921 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.932 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.943 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.944 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.976 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:24 +0000 (0:00:00.065) 0:10:35.746 ******* 2020-11-16T20:38:24.983 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.984 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.984 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.986 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.997 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:24.998 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:25.008 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:25.019 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:25.021 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:25.030 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:25.042 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:25.053 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:25.064 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:25.066 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:25.075 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:25.087 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:25.089 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:25.098 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:25.109 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:25.111 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'dorinda', 'ovpn': 'dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dorinda", "ovpn": "dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:25.258 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:25.309 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:25 +0000 (0:00:00.332) 0:10:36.079 ******* 2020-11-16T20:38:25.337 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:25.368 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:25 +0000 (0:00:00.059) 0:10:36.138 ******* 2020-11-16T20:38:25.479 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-11-16T20:38:25.481 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.302630", "end": "2020-11-16 20:38:25.458885", "rc": 0, "start": "2020-11-16 20:38:25.156255", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-11-16T20:38:25.512 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:25 +0000 (0:00:00.143) 0:10:36.281 ******* 2020-11-16T20:38:25.538 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-11-16T20:38:25.540 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:25.571 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:25 +0000 (0:00:00.059) 0:10:36.341 ******* 2020-11-16T20:38:25.598 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-11-16T20:38:25.600 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:25.630 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:25 +0000 (0:00:00.058) 0:10:36.400 ******* 2020-11-16T20:38:25.636 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:38:25.638 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-11-16T20:38:25.658 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:25.662 INFO:teuthology.task.ansible.out: 2020-11-16T20:38:25.690 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:25 +0000 (0:00:00.060) 0:10:36.460 ******* 2020-11-16T20:38:25.717 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-11-16T20:38:25.719 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:25.749 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:25 +0000 (0:00:00.058) 0:10:36.519 ******* 2020-11-16T20:38:29.801 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:38:29.803 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-11-16T20:38:29.824 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-11-16T20:38:29.825 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:29.855 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:29 +0000 (0:00:04.106) 0:10:40.625 ******* 2020-11-16T20:38:29.893 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-11-16T20:38:29.894 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2020-11-16T20:38:29.923 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:29 +0000 (0:00:00.068) 0:10:40.693 ******* 2020-11-16T20:38:29.972 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-11-16T20:38:29.973 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi166.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-16T20:38:30.004 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:30 +0000 (0:00:00.080) 0:10:40.774 ******* 2020-11-16T20:38:30.041 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-11-16T20:38:30.043 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2020-11-16T20:38:30.078 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:30 +0000 (0:00:00.073) 0:10:40.847 ******* 2020-11-16T20:38:30.117 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:38:30.119 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-11-16T20:38:30.321 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-11-16T20:38:35.424 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-11-16T20:38:35.426 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1605559115.2917767-e1qn6njh/katello-ca-consumer-latest.noarch4kykjbhp.rpm"]} 2020-11-16T20:38:35.455 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:35 +0000 (0:00:05.377) 0:10:46.225 ******* 2020-11-16T20:38:36.393 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-11-16T20:38:36.395 INFO:teuthology.task.ansible.out:fatal: [smithi166.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2020-11-16T20:38:36.424 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:36 +0000 (0:00:00.969) 0:10:47.194 ******* 2020-11-16T20:38:36.461 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-11-16T20:38:36.463 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2020-11-16T20:38:36.494 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:36 +0000 (0:00:00.069) 0:10:47.264 ******* 2020-11-16T20:38:46.592 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-11-16T20:38:46.594 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-16T20:38:46.624 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:46 +0000 (0:00:10.129) 0:10:57.393 ******* 2020-11-16T20:38:46.661 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-11-16T20:38:46.663 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2020-11-16T20:38:46.693 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:46 +0000 (0:00:00.069) 0:10:57.463 ******* 2020-11-16T20:38:46.752 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:38:46.754 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-11-16T20:38:46.952 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-11-16T20:38:47.151 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-11-16T20:38:47.362 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2020-11-16T20:38:47.554 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-11-16T20:38:47.556 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.644323", "end": "2020-11-16 20:38:47.526963", "failed_when_result": false, "rc": 0, "start": "2020-11-16 20:38:46.882640", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7.9\n7Server\n8\n8.0\n8.1\n8.2\n8.3", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7.9", "7Server", "8", "8.0", "8.1", "8.2", "8.3"]} TASK [users : Remove revoked users] ******************************************** ok: [smithi059.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2020-11-16T20:38:47.586 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:47 +0000 (0:00:00.892) 0:10:58.356 ******* 2020-11-16T20:38:51.774 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-11-16T20:38:51.785 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-11-16T20:38:51.787 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:51.816 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:51 +0000 (0:00:04.229) 0:11:02.586 ******* 2020-11-16T20:38:51.854 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-11-16T20:38:51.855 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:51.885 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:51 +0000 (0:00:00.068) 0:11:02.655 ******* 2020-11-16T20:38:51.912 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-11-16T20:38:51.914 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-16T20:38:51.944 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:51 +0000 (0:00:00.058) 0:11:02.714 ******* 2020-11-16T20:38:51.981 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-16T20:38:51.983 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:38:52.014 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:38:52 +0000 (0:00:00.070) 0:11:02.784 ******* 2020-11-16T20:38:52.135 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:38:52.137 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-11-16T20:38:52.344 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-11-16T20:38:56.551 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-11-16T20:38:56.750 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-11-16T20:39:01.043 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-11-16T20:39:01.241 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-11-16T20:39:01.439 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-11-16T20:39:01.647 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-11-16T20:39:01.845 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-11-16T20:39:02.043 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-11-16T20:39:02.250 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-11-16T20:39:02.448 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-11-16T20:39:02.649 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-11-16T20:39:02.869 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-11-16T20:39:03.068 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-11-16T20:39:03.277 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-11-16T20:39:03.475 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-11-16T20:39:04.300 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-11-16T20:39:04.302 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:12.078462", "end": "2020-11-16 20:39:04.282816", "rc": 0, "start": "2020-11-16 20:38:52.204354", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2020-11-16T20:39:04.331 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:04 +0000 (0:00:12.317) 0:11:15.101 ******* 2020-11-16T20:39:08.338 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:39:08.340 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} ok: [smithi059.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-11-16T20:39:08.340 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-11-16T20:39:08.341 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-11-16T20:39:08.363 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2020-11-16T20:39:08.394 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:08 +0000 (0:00:04.062) 0:11:19.164 ******* 2020-11-16T20:39:08.421 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-11-16T20:39:08.423 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:39:08.453 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:08 +0000 (0:00:00.059) 0:11:19.223 ******* 2020-11-16T20:39:08.491 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-11-16T20:39:08.493 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2020-11-16T20:39:08.522 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:08 +0000 (0:00:00.069) 0:11:19.292 ******* 2020-11-16T20:39:08.528 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:39:08.530 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-11-16T20:39:08.561 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-11-16T20:39:08.563 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2020-11-16T20:39:08.596 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:08 +0000 (0:00:00.073) 0:11:19.366 ******* 2020-11-16T20:39:08.716 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:39:08.718 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-11-16T20:39:08.915 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-11-16T20:39:09.123 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-11-16T20:39:09.323 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2020-11-16T20:39:09.520 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2020-11-16T20:39:09.718 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-11-16T20:39:13.078 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** changed: [smithi166.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-16T20:39:13.109 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:13 +0000 (0:00:04.512) 0:11:23.878 ******* 2020-11-16T20:39:22.029 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:39:22.031 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-11-16T20:39:22.237 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-11-16T20:39:24.955 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-11-16T20:39:24.957 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:03.546539", "end": "2020-11-16 20:39:24.934851", "rc": 0, "start": "2020-11-16 20:39:21.388312", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2020-11-16T20:39:24.987 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:24 +0000 (0:00:11.878) 0:11:35.757 ******* 2020-11-16T20:39:29.558 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-11-16T20:39:29.560 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2020-11-16T20:39:29.590 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:29 +0000 (0:00:04.603) 0:11:40.360 ******* 2020-11-16T20:39:29.794 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-11-16T20:39:29.796 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-16T20:39:29.825 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:29 +0000 (0:00:00.235) 0:11:40.595 ******* 2020-11-16T20:39:30.321 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-16T20:39:30.323 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-11-16T20:39:30.520 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi059.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-11-16T20:39:30.718 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-11-16T20:39:30.771 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-16T20:39:30.773 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-11-16T20:39:30.804 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:30 +0000 (0:00:00.978) 0:11:41.574 ******* 2020-11-16T20:39:30.915 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:39:30.917 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-11-16T20:39:31.124 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-11-16T20:39:31.280 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-16T20:39:31.282 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-11-16T20:39:31.323 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:39:31.324 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-11-16T20:39:31.531 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2020-11-16T20:39:31.729 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2020-11-16T20:39:31.731 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* ok: [smithi166.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-11-16T20:39:31.740 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T20:39:31.783 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:31 +0000 (0:00:00.978) 0:11:42.553 ******* 2020-11-16T20:39:31.815 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:31 +0000 (0:00:00.031) 0:11:42.584 ******* 2020-11-16T20:39:31.843 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-16T20:39:31.845 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:39:31.874 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:31 +0000 (0:00:00.059) 0:11:42.644 ******* 2020-11-16T20:39:31.902 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-16T20:39:31.903 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:39:31.933 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:31 +0000 (0:00:00.058) 0:11:42.703 ******* 2020-11-16T20:39:31.960 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-11-16T20:39:31.961 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:39:31.991 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:31 +0000 (0:00:00.057) 0:11:42.761 ******* 2020-11-16T20:39:32.018 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:39:32.050 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:32 +0000 (0:00:00.058) 0:11:42.819 ******* 2020-11-16T20:39:32.076 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-16T20:39:32.078 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:39:32.108 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:32 +0000 (0:00:00.058) 0:11:42.878 ******* 2020-11-16T20:39:32.135 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-11-16T20:39:32.136 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:39:32.167 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:32 +0000 (0:00:00.058) 0:11:42.937 ******* 2020-11-16T20:39:32.194 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-11-16T20:39:32.195 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:39:32.224 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:32 +0000 (0:00:00.057) 0:11:42.994 ******* 2020-11-16T20:39:32.251 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-11-16T20:39:32.252 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:39:32.282 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:32 +0000 (0:00:00.057) 0:11:43.052 ******* 2020-11-16T20:39:32.309 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-11-16T20:39:32.310 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:39:32.340 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:32 +0000 (0:00:00.058) 0:11:43.110 ******* 2020-11-16T20:39:32.348 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-11-16T20:39:32.349 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "7058a4a5caaffbbf4cc3cd1573412c26", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605559171.8067534-70752560236178/source", "state": "file", "uid": 0} 2020-11-16T20:39:32.383 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:32 +0000 (0:00:00.042) 0:11:43.152 ******* 2020-11-16T20:39:32.410 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-11-16T20:39:32.412 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => { "msg": "Host smithi059.front.sepia.ceph.com is running RedHat 8.1 (Ootpa)" } 2020-11-16T20:39:32.444 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:32 +0000 (0:00:00.061) 0:11:43.214 ******* 2020-11-16T20:39:32.482 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-11-16T20:39:32.484 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2020-11-16T20:39:32.514 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:32 +0000 (0:00:00.070) 0:11:43.284 ******* 2020-11-16T20:39:32.542 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-11-16T20:39:32.543 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:39:32.575 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:32 +0000 (0:00:00.060) 0:11:43.345 ******* 2020-11-16T20:39:33.521 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-11-16T20:39:33.524 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.988961", "end": "2020-11-16 20:39:33.500346", "rc": 0, "start": "2020-11-16 20:39:32.511385", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T20:39:33.557 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:33 +0000 (0:00:00.981) 0:11:44.327 ******* 2020-11-16T20:39:37.643 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-11-16T20:39:37.644 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.319490", "end": "2020-11-16 20:39:37.150976", "rc": 0, "start": "2020-11-16 20:39:36.831486", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-11-16T20:39:37.677 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:37 +0000 (0:00:04.120) 0:11:48.447 ******* 2020-11-16T20:39:57.721 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-11-16T20:39:57.723 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:39:57.754 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:57 +0000 (0:00:20.076) 0:12:08.523 ******* 2020-11-16T20:39:57.781 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-11-16T20:39:57.783 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:39:57.813 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:57 +0000 (0:00:00.059) 0:12:08.583 ******* 2020-11-16T20:39:57.840 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:39:57.872 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:57 +0000 (0:00:00.058) 0:12:08.641 ******* 2020-11-16T20:39:57.898 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-11-16T20:39:57.900 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:39:57.930 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:57 +0000 (0:00:00.058) 0:12:08.699 ******* 2020-11-16T20:39:57.956 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:39:57.988 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:57 +0000 (0:00:00.057) 0:12:08.757 ******* 2020-11-16T20:39:58.026 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-11-16T20:39:58.028 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2020-11-16T20:39:58.057 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:58 +0000 (0:00:00.069) 0:12:08.827 ******* 2020-11-16T20:39:58.105 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-11-16T20:39:58.107 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi059.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-16T20:39:58.137 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:58 +0000 (0:00:00.080) 0:12:08.907 ******* 2020-11-16T20:39:58.175 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-11-16T20:39:58.177 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2020-11-16T20:39:58.207 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:58 +0000 (0:00:00.069) 0:12:08.976 ******* 2020-11-16T20:39:59.208 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-11-16T20:39:59.210 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1605559199.0720842-g65tf8tp/katello-ca-consumer-latest.noarchoi7iwxrq.rpm"]} 2020-11-16T20:39:59.241 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:39:59 +0000 (0:00:01.033) 0:12:10.010 ******* 2020-11-16T20:40:00.287 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-11-16T20:40:00.289 INFO:teuthology.task.ansible.out:fatal: [smithi059.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2020-11-16T20:40:00.318 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:00 +0000 (0:00:01.077) 0:12:11.088 ******* 2020-11-16T20:40:00.356 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-11-16T20:40:00.358 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2020-11-16T20:40:00.387 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:00 +0000 (0:00:00.068) 0:12:11.157 ******* 2020-11-16T20:40:06.182 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-11-16T20:40:06.184 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: krb5-workstation", "Installed: krb5-libs-1.18.2-5.el8.x86_64", "Installed: krb5-workstation-1.18.2-5.el8.x86_64", "Installed: libkadm5-1.18.2-5.el8.x86_64", "Removed: libkadm5-1.17-18.el8.x86_64", "Removed: krb5-libs-1.17-18.el8.x86_64", "Removed: krb5-workstation-1.17-18.el8.x86_64"]} 2020-11-16T20:40:06.225 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:06 +0000 (0:00:05.837) 0:12:16.994 ******* 2020-11-16T20:40:06.255 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-11-16T20:40:06.257 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:40:06.286 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:06 +0000 (0:00:00.061) 0:12:17.056 ******* 2020-11-16T20:40:06.313 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-11-16T20:40:06.315 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:40:06.345 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:06 +0000 (0:00:00.059) 0:12:17.115 ******* 2020-11-16T20:40:06.373 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:40:06.404 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:06 +0000 (0:00:00.058) 0:12:17.174 ******* 2020-11-16T20:40:06.431 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-11-16T20:40:06.433 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:40:06.463 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:06 +0000 (0:00:00.058) 0:12:17.233 ******* 2020-11-16T20:40:06.928 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-11-16T20:40:06.930 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-11-16T20:40:06.960 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:06 +0000 (0:00:00.497) 0:12:17.730 ******* 2020-11-16T20:40:07.840 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-11-16T20:40:07.842 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-16T20:40:07.873 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:07 +0000 (0:00:00.912) 0:12:18.643 ******* 2020-11-16T20:40:07.911 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-11-16T20:40:07.913 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2020-11-16T20:40:07.943 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:07 +0000 (0:00:00.070) 0:12:18.713 ******* 2020-11-16T20:40:08.876 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-11-16T20:40:08.878 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.716746", "end": "2020-11-16 20:40:08.853260", "failed_when_result": false, "rc": 0, "start": "2020-11-16 20:40:08.136514", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7.9\n7Server\n8\n8.0\n8.1\n8.2\n8.3", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7.9", "7Server", "8", "8.0", "8.1", "8.2", "8.3"]} 2020-11-16T20:40:08.910 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:08 +0000 (0:00:00.967) 0:12:19.680 ******* 2020-11-16T20:40:08.938 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:40:08.969 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:08 +0000 (0:00:00.058) 0:12:19.738 ******* 2020-11-16T20:40:08.996 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-11-16T20:40:08.998 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:40:09.028 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:09 +0000 (0:00:00.059) 0:12:19.798 ******* 2020-11-16T20:40:09.062 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-11-16T20:40:09.064 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-16T20:40:09.094 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:09 +0000 (0:00:00.065) 0:12:19.863 ******* 2020-11-16T20:40:09.121 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-16T20:40:09.123 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:40:09.154 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:09 +0000 (0:00:00.060) 0:12:19.923 ******* 2020-11-16T20:40:13.447 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-11-16T20:40:13.449 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: smartmontools", "Installed: smartmontools-1:7.1-1.el8.x86_64", "Removed: smartmontools-1:6.6-3.el8.x86_64"]} 2020-11-16T20:40:13.480 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:13 +0000 (0:00:04.325) 0:12:24.249 ******* 2020-11-16T20:40:13.974 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-16T20:40:13.975 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-11-16T20:40:14.412 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-11-16T20:40:14.845 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-11-16T20:40:14.878 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:14 +0000 (0:00:01.397) 0:12:25.647 ******* 2020-11-16T20:40:15.073 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-11-16T20:40:15.074 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-16T20:40:15.121 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:15 +0000 (0:00:00.243) 0:12:25.890 ******* 2020-11-16T20:40:15.577 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-16T20:40:15.579 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-11-16T20:40:16.009 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-11-16T20:40:16.437 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-11-16T20:40:16.471 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:16 +0000 (0:00:01.350) 0:12:27.241 ******* 2020-11-16T20:40:16.500 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-11-16T20:40:16.502 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:40:16.535 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:16 +0000 (0:00:00.064) 0:12:27.305 ******* 2020-11-16T20:40:16.575 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-16T20:40:16.577 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-11-16T20:40:16.607 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:16 +0000 (0:00:00.072) 0:12:27.377 ******* 2020-11-16T20:40:16.803 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-11-16T20:40:16.805 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-16T20:40:16.835 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:16 +0000 (0:00:00.227) 0:12:27.605 ******* 2020-11-16T20:40:16.873 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-11-16T20:40:16.874 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-16T20:40:16.884 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-16T20:40:16.895 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-16T20:40:16.896 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-16T20:40:16.930 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:16 +0000 (0:00:00.094) 0:12:27.699 ******* 2020-11-16T20:40:22.164 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-11-16T20:40:22.166 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:12.796909", "end": "2020-11-16 20:40:22.143007", "rc": 0, "start": "2020-11-16 20:40:09.346098", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2020-11-16T20:40:22.198 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:22 +0000 (0:00:05.268) 0:12:32.967 ******* 2020-11-16T20:40:22.236 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-11-16T20:40:22.238 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2020-11-16T20:40:22.268 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:22 +0000 (0:00:00.069) 0:12:33.037 ******* 2020-11-16T20:40:22.305 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-11-16T20:40:22.307 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:40:22.337 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:22 +0000 (0:00:00.069) 0:12:33.107 ******* 2020-11-16T20:40:22.374 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-11-16T20:40:22.376 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2020-11-16T20:40:22.406 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:22 +0000 (0:00:00.068) 0:12:33.176 ******* 2020-11-16T20:40:22.443 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-11-16T20:40:22.445 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2020-11-16T20:40:22.487 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:22 +0000 (0:00:00.081) 0:12:33.257 ******* 2020-11-16T20:40:24.138 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-11-16T20:40:24.140 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load", "Installed: nagios-plugins-2.3.3-4.el8.x86_64", "Installed: nrpe-4.0.3-1.el8.x86_64", "Installed: nagios-plugins-load-2.3.3-4.el8.x86_64", "Removed: nrpe-4.0.2-2.el8.x86_64", "Removed: nagios-plugins-2.3.3-1.el8.x86_64", "Removed: nagios-plugins-load-2.3.3-1.el8.x86_64"]} 2020-11-16T20:40:24.172 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:24 +0000 (0:00:01.684) 0:12:34.942 ******* 2020-11-16T20:40:24.199 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:40:24.232 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:24 +0000 (0:00:00.060) 0:12:35.002 ******* 2020-11-16T20:40:24.713 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-11-16T20:40:24.714 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-11-16T20:40:24.745 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:24 +0000 (0:00:00.512) 0:12:35.515 ******* 2020-11-16T20:40:27.125 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-11-16T20:40:27.127 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-16T20:40:27.157 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:27 +0000 (0:00:02.412) 0:12:37.927 ******* 2020-11-16T20:40:35.258 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-16T20:40:35.260 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-11-16T20:40:35.293 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:35 +0000 (0:00:08.135) 0:12:46.063 ******* 2020-11-16T20:40:35.331 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-11-16T20:40:35.333 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-11-16T20:40:35.364 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:35 +0000 (0:00:00.071) 0:12:46.134 ******* 2020-11-16T20:40:35.580 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-11-16T20:40:35.582 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-16T20:40:35.612 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:35 +0000 (0:00:00.247) 0:12:46.382 ******* 2020-11-16T20:40:35.860 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi166.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-11-16T20:40:35.891 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:35 +0000 (0:00:00.279) 0:12:46.661 ******* 2020-11-16T20:40:35.918 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-16T20:40:35.920 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:40:35.950 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:35 +0000 (0:00:00.058) 0:12:46.719 ******* 2020-11-16T20:40:39.066 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-11-16T20:40:39.067 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:03.589515", "end": "2020-11-16 20:40:39.049141", "rc": 0, "start": "2020-11-16 20:40:35.459626", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2020-11-16T20:40:39.098 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:39 +0000 (0:00:03.148) 0:12:49.868 ******* 2020-11-16T20:40:43.416 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-11-16T20:40:43.418 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2020-11-16T20:40:43.448 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:43 +0000 (0:00:04.349) 0:12:54.217 ******* 2020-11-16T20:40:47.486 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-11-16T20:40:47.488 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "md5sum": "28732085640fd0d909d798c6d3e4021a", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605559235.9728546-202921769630725/source", "state": "file", "uid": 0} 2020-11-16T20:40:47.519 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:47 +0000 (0:00:04.071) 0:12:58.289 ******* 2020-11-16T20:40:47.692 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-11-16T20:40:47.694 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-16T20:40:47.724 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:47 +0000 (0:00:00.205) 0:12:58.494 ******* 2020-11-16T20:40:52.305 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-16T20:40:52.306 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2020-11-16 20:40:21 UTC", "ActiveEnterTimestampMonotonic": "842821869", "ActiveExitTimestamp": "Mon 2020-11-16 20:40:21 UTC", "ActiveExitTimestampMonotonic": "842795339", "ActiveState": "active", "After": "systemd-journald.socket network.target sysinit.target basic.target tmp.mount var-run.mount systemd-tmpfiles-setup.service -.mount nss-lookup.target local-fs.target time-sync.target system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-11-16 20:40:21 UTC", "AssertTimestampMonotonic": "842821205", "Before": "getty@tty1.service plymouth-quit.service multi-user.target xdm.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-11-16 20:40:21 UTC", "ConditionTimestampMonotonic": "842821205", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "C 2020-11-16T20:40:52.308 INFO:teuthology.task.ansible.out:ontrolGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "18565", "ExecMainStartTimestamp": "Mon 2020-11-16 20:40:21 UTC", "ExecMainStartTimestampMonotonic": "842821834", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2020-11-16 20:40:21 UTC", "InactiveEnterTimestampMonotonic": "842820520", "InactiveExitTimestamp": "Mon 2020-11-16 20:40:21 UTC", "InactiveExitTimestampMonotonic": "842821869", "InvocationID": "c861e2c15d8d4de5832ffae4c50fd431", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "Limi 2020-11-16T20:40:52.309 INFO:teuthology.task.ansible.out:tCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127425", "LimitNPROCSoft": "127425", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127425", "LimitSIGPENDINGSoft": "127425", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "18565", "MemoryAccounting": "yes", "MemoryCurrent": "888832", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": " 2020-11-16T20:40:52.310 INFO:teuthology.task.ansible.out:no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-11-16 20:40:21 UTC", "StateChangeTimestampMonotonic": "842821869", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-11-16 20:40:21 UTC", "WatchdogTimestampMonotonic": "842821867", "WatchdogUSec": "0"}} 2020-11-16T20:40:52.339 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:52 +0000 (0:00:04.614) 0:13:03.109 ******* 2020-11-16T20:40:52.533 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-11-16T20:40:52.535 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001766", "end": "2020-11-16 20:40:52.512940", "rc": 0, "start": "2020-11-16 20:40:52.511174", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-11-16T20:40:52.584 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:52 +0000 (0:00:00.244) 0:13:03.354 ******* 2020-11-16T20:40:56.305 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** ok: [smithi059.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-11-16T20:40:56.768 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-11-16T20:40:56.802 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:56 +0000 (0:00:04.217) 0:13:07.572 ******* 2020-11-16T20:40:58.826 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-11-16T20:40:58.828 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils", "Installed: libsemanage-2.9-3.el8.x86_64", "Installed: python3-libsemanage-2.9-3.el8.x86_64", "Removed: python3-libsemanage-2.9-2.el8.x86_64", "Removed: libsemanage-2.9-2.el8.x86_64"]} 2020-11-16T20:40:58.859 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:40:58 +0000 (0:00:02.056) 0:13:09.628 ******* 2020-11-16T20:41:01.408 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-16T20:41:01.410 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-11-16T20:41:01.905 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-11-16T20:41:01.939 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:01 +0000 (0:00:03.080) 0:13:12.709 ******* 2020-11-16T20:41:01.967 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-16T20:41:01.969 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:41:01.999 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:01 +0000 (0:00:00.059) 0:13:12.769 ******* 2020-11-16T20:41:02.027 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:41:02.058 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:02 +0000 (0:00:00.058) 0:13:12.827 ******* 2020-11-16T20:41:02.084 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-11-16T20:41:02.086 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:41:02.115 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:02 +0000 (0:00:00.057) 0:13:12.885 ******* 2020-11-16T20:41:02.143 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-11-16T20:41:02.144 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:41:02.175 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:02 +0000 (0:00:00.059) 0:13:12.944 ******* 2020-11-16T20:41:02.202 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-16T20:41:02.203 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:41:02.233 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:02 +0000 (0:00:00.058) 0:13:13.003 ******* 2020-11-16T20:41:02.260 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-11-16T20:41:02.262 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:41:02.292 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:02 +0000 (0:00:00.059) 0:13:13.062 ******* 2020-11-16T20:41:02.319 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-11-16T20:41:02.320 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:41:02.350 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:02 +0000 (0:00:00.057) 0:13:13.120 ******* 2020-11-16T20:41:02.378 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-11-16T20:41:02.380 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:41:02.409 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:02 +0000 (0:00:00.058) 0:13:13.178 ******* 2020-11-16T20:41:02.436 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-11-16T20:41:02.437 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:41:02.467 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:02 +0000 (0:00:00.058) 0:13:13.237 ******* 2020-11-16T20:41:03.524 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-11-16T20:41:03.525 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.847617", "end": "2020-11-16 20:41:03.500343", "rc": 0, "start": "2020-11-16 20:41:02.652726", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T20:41:03.556 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:03 +0000 (0:00:01.088) 0:13:14.325 ******* 2020-11-16T20:41:12.642 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-11-16T20:41:12.643 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: krb5-workstation", "Installed: krb5-libs-1.18.2-5.el8.x86_64", "Installed: krb5-workstation-1.18.2-5.el8.x86_64", "Installed: libkadm5-1.18.2-5.el8.x86_64", "Removed: libkadm5-1.17-18.el8.x86_64", "Removed: krb5-libs-1.17-18.el8.x86_64", "Removed: krb5-workstation-1.17-18.el8.x86_64"]} 2020-11-16T20:41:12.673 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:12 +0000 (0:00:09.117) 0:13:23.443 ******* 2020-11-16T20:41:16.759 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-11-16T20:41:16.760 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:41:16.790 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:16 +0000 (0:00:04.117) 0:13:27.560 ******* 2020-11-16T20:41:16.817 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-11-16T20:41:16.818 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:41:16.849 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:16 +0000 (0:00:00.058) 0:13:27.618 ******* 2020-11-16T20:41:16.875 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-11-16T20:41:16.877 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:41:16.907 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:16 +0000 (0:00:00.058) 0:13:27.677 ******* 2020-11-16T20:41:16.934 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-11-16T20:41:16.936 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:41:16.968 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:16 +0000 (0:00:00.060) 0:13:27.738 ******* 2020-11-16T20:41:17.455 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-11-16T20:41:17.457 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-11-16T20:41:17.489 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:17 +0000 (0:00:00.520) 0:13:28.259 ******* 2020-11-16T20:41:24.607 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-11-16T20:41:24.609 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: smartmontools", "Installed: smartmontools-1:7.1-1.el8.x86_64", "Removed: smartmontools-1:6.6-3.el8.x86_64"]} 2020-11-16T20:41:24.651 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:24 +0000 (0:00:07.162) 0:13:35.421 ******* 2020-11-16T20:41:25.238 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-16T20:41:25.239 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-11-16T20:41:25.761 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-11-16T20:41:26.225 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-11-16T20:41:26.259 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:26 +0000 (0:00:01.607) 0:13:37.028 ******* 2020-11-16T20:41:26.462 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-11-16T20:41:26.464 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-16T20:41:26.493 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:26 +0000 (0:00:00.234) 0:13:37.263 ******* 2020-11-16T20:41:26.980 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-16T20:41:26.981 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-11-16T20:41:27.417 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-11-16T20:41:27.863 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-11-16T20:41:27.897 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:27 +0000 (0:00:01.403) 0:13:38.666 ******* 2020-11-16T20:41:27.924 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:41:27.955 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:27 +0000 (0:00:00.058) 0:13:38.725 ******* 2020-11-16T20:41:27.992 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-16T20:41:27.994 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-11-16T20:41:28.024 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:28 +0000 (0:00:00.068) 0:13:38.794 ******* 2020-11-16T20:41:29.238 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-11-16T20:41:29.240 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-16T20:41:29.272 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:29 +0000 (0:00:01.248) 0:13:40.042 ******* 2020-11-16T20:41:29.311 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-11-16T20:41:29.313 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-16T20:41:29.322 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-16T20:41:29.333 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-16T20:41:29.335 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-16T20:41:29.366 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:29 +0000 (0:00:00.093) 0:13:40.135 ******* 2020-11-16T20:41:37.935 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-11-16T20:41:37.937 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load", "Installed: nagios-plugins-2.3.3-4.el8.x86_64", "Installed: nrpe-4.0.3-1.el8.x86_64", "Installed: nagios-plugins-load-2.3.3-4.el8.x86_64", "Removed: nrpe-4.0.2-2.el8.x86_64", "Removed: nagios-plugins-2.3.3-1.el8.x86_64", "Removed: nagios-plugins-load-2.3.3-1.el8.x86_64"]} 2020-11-16T20:41:37.967 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:37 +0000 (0:00:08.600) 0:13:48.736 ******* 2020-11-16T20:41:54.107 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-11-16T20:41:54.109 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted", "Installed: selinux-policy-targeted-3.14.3-54.el8.noarch", "Installed: selinux-policy-3.14.3-54.el8.noarch", "Removed: selinux-policy-3.14.3-41.el8_2.2.noarch", "Removed: selinux-policy-targeted-3.14.3-41.el8_2.2.noarch"]} 2020-11-16T20:41:54.141 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:54 +0000 (0:00:16.173) 0:14:04.910 ******* 2020-11-16T20:41:54.147 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-11-16T20:41:54.149 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:41:54.181 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:54 +0000 (0:00:00.040) 0:14:04.951 ******* 2020-11-16T20:41:58.249 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-11-16T20:41:58.251 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-11-16T20:41:58.283 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:41:58 +0000 (0:00:04.102) 0:14:09.053 ******* 2020-11-16T20:42:14.920 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-11-16T20:42:14.922 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-11-16T20:42:14.952 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:14 +0000 (0:00:16.669) 0:14:25.722 ******* 2020-11-16T20:42:14.990 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-11-16T20:42:14.992 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.495517", "end": "2020-11-16 20:42:14.966570", "failed_when_result": false, "rc": 0, "start": "2020-11-16 20:41:58.471053", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-11-16T20:42:15.029 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:15 +0000 (0:00:00.076) 0:14:25.798 ******* 2020-11-16T20:42:15.474 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-16T20:42:15.476 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-11-16T20:42:15.507 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:15 +0000 (0:00:00.478) 0:14:26.277 ******* 2020-11-16T20:42:15.547 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-11-16T20:42:15.549 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "md5sum": "286c682fc73965c17876891a4581da3e", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605559335.0588264-271713469183149/source", "state": "file", "uid": 0} TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ skipping: [smithi059.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2020-11-16T20:42:15.584 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:15 +0000 (0:00:00.076) 0:14:26.353 ******* 2020-11-16T20:42:15.597 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-11-16T20:42:15.636 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:15 +0000 (0:00:00.052) 0:14:26.406 ******* 2020-11-16T20:42:15.791 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-11-16T20:42:15.793 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.014998", "end": "2020-11-16 20:42:15.774520", "rc": 0, "start": "2020-11-16 20:42:15.759522", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T20:42:15.835 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:15 +0000 (0:00:00.199) 0:14:26.605 ******* 2020-11-16T20:42:15.853 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-11-16T20:42:15.855 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-16T20:42:15.889 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:15 +0000 (0:00:00.054) 0:14:26.659 ******* 2020-11-16T20:42:16.052 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-11-16T20:42:16.054 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.013252", "end": "2020-11-16 20:42:16.028552", "rc": 0, "start": "2020-11-16 20:42:16.015300", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T20:42:16.110 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:16 +0000 (0:00:00.220) 0:14:26.879 ******* 2020-11-16T20:42:16.143 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi059.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-11-16T20:42:16.182 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:16 +0000 (0:00:00.072) 0:14:26.952 ******* 2020-11-16T20:42:16.209 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-16T20:42:16.211 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:42:16.241 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:16 +0000 (0:00:00.058) 0:14:27.010 ******* 2020-11-16T20:42:16.789 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-11-16T20:42:16.791 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "md5sum": "28732085640fd0d909d798c6d3e4021a", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605559336.2622669-277467152779195/source", "state": "file", "uid": 0} 2020-11-16T20:42:16.821 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:16 +0000 (0:00:00.579) 0:14:27.590 ******* 2020-11-16T20:42:17.140 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-16T20:42:17.141 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2020-11-16 20:41:33 UTC", "ActiveEnterTimestampMonotonic": "926508826", "ActiveExitTimestamp": "Mon 2020-11-16 20:41:33 UTC", "ActiveExitTimestampMonotonic": "926484492", "ActiveState": "active", "After": "local-fs.target var-run.mount network.target systemd-tmpfiles-setup.service sysinit.target basic.target -.mount tmp.mount system.slice nss-lookup.target time-sync.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-11-16 20:41:33 UTC", "AssertTimestampMonotonic": "926507032", "Before": "multi-user.target getty@tty1.service shutdown.target xdm.service plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-11-16 20:41:33 UTC", "ConditionTimestampMonotonic": "926507031", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "C 2020-11-16T20:42:17.142 INFO:teuthology.task.ansible.out:ontrolGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "14705", "ExecMainStartTimestamp": "Mon 2020-11-16 20:41:33 UTC", "ExecMainStartTimestampMonotonic": "926508797", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2020-11-16 20:41:33 UTC", "InactiveEnterTimestampMonotonic": "926506320", "InactiveExitTimestamp": "Mon 2020-11-16 20:41:33 UTC", "InactiveExitTimestampMonotonic": "926508826", "InvocationID": "341a2242435848acbddb8acaf0345437", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "Limi 2020-11-16T20:42:17.144 INFO:teuthology.task.ansible.out:tCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127449", "LimitNPROCSoft": "127449", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127449", "LimitSIGPENDINGSoft": "127449", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "14705", "MemoryAccounting": "yes", "MemoryCurrent": "884736", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": " 2020-11-16T20:42:17.145 INFO:teuthology.task.ansible.out:no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-11-16 20:41:33 UTC", "StateChangeTimestampMonotonic": "926508826", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-11-16 20:41:33 UTC", "WatchdogTimestampMonotonic": "926508825", "WatchdogUSec": "0"}} 2020-11-16T20:42:17.173 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:17 +0000 (0:00:00.352) 0:14:27.943 ******* 2020-11-16T20:42:29.529 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-11-16T20:42:29.531 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001842", "end": "2020-11-16 20:42:29.509302", "rc": 0, "start": "2020-11-16 20:42:29.507460", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-11-16T20:42:29.561 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:29 +0000 (0:00:12.387) 0:14:40.331 ******* 2020-11-16T20:42:32.855 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-11-16T20:42:32.856 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.547249", "end": "2020-11-16 20:42:32.833465", "rc": 0, "start": "2020-11-16 20:42:16.286216", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T20:42:32.887 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:32 +0000 (0:00:03.325) 0:14:43.656 ******* 2020-11-16T20:42:36.961 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-11-16T20:42:36.963 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils", "Installed: libsemanage-2.9-3.el8.x86_64", "Installed: python3-libsemanage-2.9-3.el8.x86_64", "Removed: python3-libsemanage-2.9-2.el8.x86_64", "Removed: libsemanage-2.9-2.el8.x86_64"]} 2020-11-16T20:42:36.995 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:36 +0000 (0:00:04.107) 0:14:47.764 ******* 2020-11-16T20:42:37.159 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-11-16T20:42:37.161 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-11-16T20:42:37.192 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:37 +0000 (0:00:00.197) 0:14:47.962 ******* 2020-11-16T20:42:37.232 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-11-16T20:42:37.233 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-11-16T20:42:37.264 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:37 +0000 (0:00:00.071) 0:14:48.034 ******* 2020-11-16T20:42:37.306 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-11-16T20:42:37.308 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-16T20:42:37.344 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:37 +0000 (0:00:00.080) 0:14:48.114 ******* 2020-11-16T20:42:37.382 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-16T20:42:37.384 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone", "lvm2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2020-11-16T20:42:37.415 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:37 +0000 (0:00:00.071) 0:14:48.185 ******* 2020-11-16T20:42:41.545 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-11-16T20:42:41.547 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-16T20:42:41.577 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:41 +0000 (0:00:04.161) 0:14:52.347 ******* 2020-11-16T20:42:41.779 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-16T20:42:41.811 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:41 +0000 (0:00:00.234) 0:14:52.581 ******* 2020-11-16T20:42:42.005 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-11-16T20:42:42.007 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2020-11-16T20:42:42.039 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:42 +0000 (0:00:00.228) 0:14:52.809 ******* 2020-11-16T20:42:42.067 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-11-16T20:42:42.069 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:42:42.099 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:42 +0000 (0:00:00.059) 0:14:52.869 ******* 2020-11-16T20:42:42.127 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-11-16T20:42:42.128 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:42:42.160 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:42 +0000 (0:00:00.060) 0:14:52.929 ******* 2020-11-16T20:42:42.375 INFO:teuthology.task.ansible.out: 2020-11-16T20:42:42.377 INFO:teuthology.task.ansible.out:TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi166.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-11-16T20:42:42.407 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:42 +0000 (0:00:00.247) 0:14:53.177 ******* 2020-11-16T20:42:42.945 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-11-16T20:42:42.946 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-11-16T20:42:42.977 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:42 +0000 (0:00:00.569) 0:14:53.746 ******* 2020-11-16T20:42:43.004 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi166"}, "changed": false} 2020-11-16T20:42:43.037 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:43 +0000 (0:00:00.059) 0:14:53.806 ******* 2020-11-16T20:42:44.026 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-11-16T20:42:44.028 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi166", "ansible_hostname": "smithi166", "ansible_nodename": "smithi166"}, "changed": false, "name": "smithi166"} 2020-11-16T20:42:44.058 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:44 +0000 (0:00:01.021) 0:14:54.827 ******* 2020-11-16T20:42:44.510 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-11-16T20:42:44.513 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-11-16T20:42:44.543 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:44 +0000 (0:00:00.485) 0:14:55.313 ******* 2020-11-16T20:42:45.008 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-11-16T20:42:45.009 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-11-16T20:42:45.040 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:45 +0000 (0:00:00.496) 0:14:55.810 ******* 2020-11-16T20:42:45.688 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-11-16T20:42:45.690 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-16T20:42:45.721 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:45 +0000 (0:00:00.681) 0:14:56.491 ******* 2020-11-16T20:42:50.262 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-11-16T20:42:50.264 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-11-16T20:42:50.294 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:50 +0000 (0:00:04.572) 0:15:01.064 ******* 2020-11-16T20:42:50.491 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-16T20:42:50.493 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-16T20:42:50.523 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:50 +0000 (0:00:00.229) 0:15:01.293 ******* 2020-11-16T20:42:50.716 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-16T20:42:50.717 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-11-16T20:42:50.749 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:50 +0000 (0:00:00.225) 0:15:01.519 ******* 2020-11-16T20:42:50.966 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-16T20:42:50.969 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-16T20:42:51.000 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:50 +0000 (0:00:00.250) 0:15:01.770 ******* 2020-11-16T20:42:51.468 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-16T20:42:51.470 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-11-16T20:42:51.501 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:51 +0000 (0:00:00.501) 0:15:02.271 ******* 2020-11-16T20:42:51.984 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-16T20:42:51.986 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-11-16T20:42:52.020 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:52 +0000 (0:00:00.518) 0:15:02.789 ******* 2020-11-16T20:42:54.024 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-16T20:42:54.026 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.807227", "end": "2020-11-16 20:42:54.004620", "rc": 0, "start": "2020-11-16 20:42:52.197393", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T20:42:54.056 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:54 +0000 (0:00:02.036) 0:15:04.826 ******* 2020-11-16T20:42:58.073 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-11-16T20:42:58.075 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:42:58.105 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:42:58 +0000 (0:00:04.049) 0:15:08.875 ******* 2020-11-16T20:43:02.634 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-11-16T20:43:02.636 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-11-16T20:43:02.670 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:43:02 +0000 (0:00:04.564) 0:15:13.439 ******* 2020-11-16T20:43:02.697 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-16T20:43:02.728 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:43:02 +0000 (0:00:00.058) 0:15:13.497 ******* 2020-11-16T20:43:02.754 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-16T20:43:02.786 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:43:02 +0000 (0:00:00.058) 0:15:13.556 ******* 2020-11-16T20:43:02.813 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-11-16T20:43:02.814 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:43:02.845 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:43:02 +0000 (0:00:00.058) 0:15:13.615 ******* 2020-11-16T20:43:02.882 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-11-16T20:43:02.884 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-16T20:43:02.914 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:43:02 +0000 (0:00:00.069) 0:15:13.684 ******* 2020-11-16T20:43:02.941 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-11-16T20:43:02.942 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:43:02.972 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:43:02 +0000 (0:00:00.057) 0:15:13.742 ******* 2020-11-16T20:43:03.000 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T20:43:03.001 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:43:03.031 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:43:03 +0000 (0:00:00.059) 0:15:13.801 ******* 2020-11-16T20:43:03.058 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-11-16T20:43:03.060 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:43:03.090 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:43:03 +0000 (0:00:00.058) 0:15:13.859 ******* 2020-11-16T20:43:03.127 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:43:03.157 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:43:03 +0000 (0:00:00.067) 0:15:13.927 ******* 2020-11-16T20:43:03.365 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-11-16T20:43:03.366 INFO:teuthology.task.ansible.out:fatal: [smithi166.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006944", "end": "2020-11-16 20:43:03.349797", "msg": "non-zero return code", "rc": 1, "start": "2020-11-16 20:43:03.342853", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-11-16T20:43:03.396 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:43:03 +0000 (0:00:00.238) 0:15:14.166 ******* 2020-11-16T20:43:03.422 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-11-16T20:43:03.424 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:43:03.454 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:43:03 +0000 (0:00:00.058) 0:15:14.224 ******* 2020-11-16T20:43:09.260 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-16T20:43:09.262 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-99.module+el8.2.0+5827+8c39933c.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-11-16T20:43:09.292 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:43:09 +0000 (0:00:05.837) 0:15:20.061 ******* 2020-11-16T20:43:14.910 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-16T20:43:14.912 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-7.el8.x86_64", "Removed: boost-random-1.66.0-7.el8.x86_64"]} 2020-11-16T20:43:14.943 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:43:14 +0000 (0:00:05.651) 0:15:25.712 ******* 2020-11-16T20:43:20.397 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-11-16T20:43:20.398 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted", "Installed: selinux-policy-targeted-3.14.3-54.el8.noarch", "Installed: selinux-policy-3.14.3-54.el8.noarch", "Removed: selinux-policy-3.14.3-41.el8_2.2.noarch", "Removed: selinux-policy-targeted-3.14.3-41.el8_2.2.noarch"]} 2020-11-16T20:43:20.431 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:43:20 +0000 (0:00:05.488) 0:15:31.201 ******* 2020-11-16T20:43:20.904 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-11-16T20:43:20.906 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-11-16T20:43:20.936 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:43:20 +0000 (0:00:00.504) 0:15:31.706 ******* 2020-11-16T20:43:38.198 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-11-16T20:43:38.200 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:17.053444", "end": "2020-11-16 20:43:38.173697", "failed_when_result": false, "rc": 0, "start": "2020-11-16 20:43:21.120253", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-11-16T20:43:38.229 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:43:38 +0000 (0:00:17.293) 0:15:48.999 ******* 2020-11-16T20:44:03.067 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-11-16T20:44:03.069 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "md5sum": "286c682fc73965c17876891a4581da3e", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605559426.364638-15783180003087/source", "state": "file", "uid": 0} 2020-11-16T20:44:03.100 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:03 +0000 (0:00:24.870) 0:16:13.870 ******* 2020-11-16T20:44:03.324 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-11-16T20:44:03.326 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.017395", "end": "2020-11-16 20:44:03.300641", "rc": 0, "start": "2020-11-16 20:44:03.283246", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T20:44:03.355 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:03 +0000 (0:00:00.255) 0:16:14.125 ******* 2020-11-16T20:44:03.558 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-16T20:44:03.559 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: git-all", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: podman", "Installed: podman-docker", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: lvm2", "Installed: lvm2-libs-8:2.03.09-5.el8.x86_64", "Installed: libgcrypt-1.8.5-4.el8.x86_64", "Installed: boost-thread-1.66.0-10.el8.x86_64", "Installed: lvm2-8:2.03.09-5.el8.x86_64", "Installed: cpp-8.3.1-5.1.el8.x86_64", "Installed: python3-libdnf-0.48.0-5.el8.x86_64", "Installed: gdb-headless-8.2-12.el8.x86_64", "Installed: boost-system-1.66.0-10.el8.x86_64", "Installed: python3-librepo-1.12.0-2.el8.x86_64", "Installed: yum-4.2.23-4.el8.noarch", "Installed: libuuid-2.32.1-24.el8.x86_64", "Installed: perl-Git-2.27.0-1.el8.noarch", "Installed: podman-docker-2.0.5-5.module+el8.3.0+8221+97165c3f.noarch", "Installed: gitk-2.27.0-1.el8.noarch", "Installed: gcc-gdb-plugin-8.3.1-5.1.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Installed: device-mapper-libs-8:1.02.171-5.el8.x86_64", "Installed: python3-dnf-plugins-core-4.0.17-5.el8.noarch", "Installed: nfs-utils-1:2.3.3-35.el8.x86_64", "Installed: gitweb-2.2 2020-11-16T20:44:03.561 INFO:teuthology.task.ansible.out:7.0-1.el8.noarch", "Installed: git-email-2.27.0-1.el8.noarch", "Installed: libmodulemd-2.9.4-2.el8.x86_64", "Installed: device-mapper-event-8:1.02.171-5.el8.x86_64", "Installed: openssl-libs-1:1.1.1g-11.el8.x86_64", "Installed: lsof-4.93.2-1.el8.x86_64", "Installed: python3-hawkey-0.48.0-5.el8.x86_64", "Installed: git-core-doc-2.27.0-1.el8.noarch", "Installed: valgrind-1:3.16.0-2.el8.x86_64", "Installed: git-instaweb-2.27.0-1.el8.noarch", "Installed: git-all-2.27.0-1.el8.noarch", "Installed: git-core-2.27.0-1.el8.x86_64", "Installed: podman-2.0.5-5.module+el8.3.0+8221+97165c3f.x86_64", "Installed: dnf-4.2.23-4.el8.noarch", "Installed: perl-Git-SVN-2.27.0-1.el8.noarch", "Installed: git-2.27.0-1.el8.x86_64", "Installed: boost-chrono-1.66.0-10.el8.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: qemu-img-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Installed: gcc-8.3.1-5.1.el8.x86_64", "Installed: xfsprogs-5.0.0-4.el8.x86_64", "Installed: openssl-1:1.1.1g-11.el8.x86_64", "Installed: git-credential-libsecret-2.27.0-1.el8.x86_64", "Installed: device-mapper-8:1.02.171-5.el8.x86_64", "Installed: yum-utils-4.0.17-5.el8.noarch", "Installed: libgomp-8.3.1-5.1.el8.x86_64", "Installed: dnf-plugins-core-4.0.17-5.el8.noarch", "Installed: podman-catatonit-2.0.5-5.module+el8.3.0+8221+97165c3f.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: python3-dnf-4.2.23-4.el8.noarch", "Installed: device-mapper-event-libs-8:1.02.171-5.el8.x86_64", "Installed: git-subtree-2.27.0-1.el8.x86_64", "Installed: sysstat-11.7.3-5.el8.x86_64", "Installed: libgcc-8.3.1-5.1.el8.x86_64", "Installed: qemu-kvm-common-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Installed: gdb-8.2-12.el8.x86_64", "Installed: git-svn-2.27.0-1.el8.noarch", "Installed: git-gui-2.27.0-1.el8.noarch", "Installed: libdnf-0.48.0-5.el8.x86_64", "Installed: librepo-1.12.0-2.el8.x86_64", "Installed: seavgabios-bin-1.13.0-2.module+el8.3.0+7353+9de0a3cc.noarch", "Installed: qemu 2020-11-16T20:44:03.562 INFO:teuthology.task.ansible.out:-kvm-core-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Installed: dnf-data-4.2.23-4.el8.noarch", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Removed: sysstat-11.7.3-2.el8.x86_64", "Removed: openssl-1:1.1.1c-15.el8.x86_64", "Removed: librepo-1.11.0-2.el8.x86_64", "Removed: openssl-libs-1:1.1.1c-15.el8.x86_64", "Removed: gcc-8.3.1-5.el8.x86_64", "Removed: gcc-gdb-plugin-8.3.1-5.el8.x86_64", "Removed: gdb-8.2-11.el8.x86_64", "Removed: gdb-headless-8.2-11.el8.x86_64", "Removed: valgrind-1:3.15.0-11.el8.x86_64", "Removed: git-2.18.4-2.el8_2.x86_64", "Removed: xfsprogs-5.0.0-2.el8.x86_64", "Removed: git-core-2.18.4-2.el8_2.x86_64", "Removed: git-core-doc-2.18.4-2.el8_2.noarch", "Removed: qemu-img-15:2.12.0-99.module+el8.2.0+5827+8c39933c.x86_64", "Removed: git-gui-2.18.4-2.el8_2.noarch", "Removed: qemu-kvm-core-15:2.12.0-99.module+el8.2.0+5827+8c39933c.x86_64", "Removed: git-subtree-2.18.4-2.el8_2.x86_64", "Removed: yum-4.2.17-6.el8.noarch", "Removed: yum-utils-4.0.12-3.el8.noarch", "Removed: boost-system-1.66.0-7.el8.x86_64", "Removed: gitk-2.18.4-2.el8_2.noarch", "Removed: gitweb-2.18.4-2.el8_2.noarch", "Removed: git-email-2.18.4-2.el8_2.noarch", "Removed: git-instaweb-2.18.4-2.el8_2.x86_64", "Removed: boost-thread-1.66.0-7.el8.x86_64", "Removed: git-svn-2.18.4-2.el8_2.x86_64", "Removed: libuuid-2.32.1-22.el8.x86_64", "Removed: cpp-8.3.1-5.el8.x86_64", "Removed: git-all-2.18.4-2.el8_2.noarch", "Removed: podman-1.6.4-11.module+el8.2.0+6368+cf16aa14.x86_64", "Removed: podman-docker-1.6.4-11.module+el8.2.0+6368+cf16aa14.noarch", "Removed: libdnf-0.39.1-5.el8.x86_64", "Removed: seavgabios-bin-1.11.1-4.module+el8.1.0+4066+0f1aadab.noarch", "Removed: boost-chrono-1.66.0-7.el8.x86_64", "Removed: lsof-4.91-2.el8.x86_64", "Removed: perl-Git-2.18.4-2.el8_2.noarch", "Removed: lvm2-8:2.03.08-3.el8.x86_64", "Removed: lvm2-libs-8:2.03.08-3.el8.x86_64", "Removed: perl-Git-SVN-2.18.4-2.el8_2.noarch", "Removed: libgcc-8.3.1-5.el8.x86_64", "Removed: libgcrypt-1.8.3-4.el8.x86_64" 2020-11-16T20:44:03.564 INFO:teuthology.task.ansible.out:, "Removed: device-mapper-8:1.02.169-3.el8.x86_64", "Removed: device-mapper-event-8:1.02.169-3.el8.x86_64", "Removed: device-mapper-event-libs-8:1.02.169-3.el8.x86_64", "Removed: device-mapper-libs-8:1.02.169-3.el8.x86_64", "Removed: libgomp-8.3.1-5.el8.x86_64", "Removed: dnf-4.2.17-6.el8.noarch", "Removed: python3-dnf-4.2.17-6.el8.noarch", "Removed: python3-dnf-plugins-core-4.0.12-3.el8.noarch", "Removed: dnf-data-4.2.17-6.el8.noarch", "Removed: dnf-plugins-core-4.0.12-3.el8.noarch", "Removed: python3-hawkey-0.39.1-5.el8.x86_64", "Removed: qemu-kvm-common-15:2.12.0-99.module+el8.2.0+5827+8c39933c.x86_64", "Removed: python3-libdnf-0.39.1-5.el8.x86_64", "Removed: python3-librepo-1.11.0-2.el8.x86_64", "Removed: nfs-utils-1:2.3.3-31.el8.x86_64"]} 2020-11-16T20:44:03.593 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:03 +0000 (0:00:00.238) 0:16:14.363 ******* 2020-11-16T20:44:03.600 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-11-16T20:44:03.602 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.023073", "end": "2020-11-16 20:44:03.563807", "rc": 0, "start": "2020-11-16 20:44:03.540734", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T20:44:03.633 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:03 +0000 (0:00:00.040) 0:16:14.403 ******* 2020-11-16T20:44:06.183 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-11-16T20:44:06.185 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: dbench"]} 2020-11-16T20:44:06.216 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:06 +0000 (0:00:02.582) 0:16:16.986 ******* 2020-11-16T20:44:20.861 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-16T20:44:20.863 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-11-16T20:44:20.893 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:20 +0000 (0:00:14.676) 0:16:31.663 ******* 2020-11-16T20:44:41.079 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-11-16T20:44:41.081 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:17.122904", "end": "2020-11-16 20:44:20.939386", "rc": 0, "start": "2020-11-16 20:44:03.816482", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T20:44:41.113 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:41 +0000 (0:00:20.220) 0:16:51.883 ******* 2020-11-16T20:44:41.120 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-16T20:44:41.122 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:44:41.154 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:41 +0000 (0:00:00.041) 0:16:51.924 ******* 2020-11-16T20:44:45.408 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-11-16T20:44:45.410 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-11-16T20:44:45.441 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:45 +0000 (0:00:04.286) 0:16:56.210 ******* 2020-11-16T20:44:49.521 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-11-16T20:44:49.523 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-11-16T20:44:49.553 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:49 +0000 (0:00:04.112) 0:17:00.323 ******* 2020-11-16T20:44:49.571 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-11-16T20:44:49.572 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.service polkit.service sysinit.target dbus.socket system.slice basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ip6tables.service shutdown.target iptables.service ebtables.service ipset.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-11-16T20:44:49.573 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127425", "LimitNPROCSoft": "127425", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127425", 2020-11-16T20:44:49.575 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127425", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target dbus.socket", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-11-16T20:44:49.576 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-11-16T20:44:49.605 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:49 +0000 (0:00:00.051) 0:17:00.375 ******* 2020-11-16T20:44:49.611 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-11-16T20:44:49.613 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-16T20:44:49.645 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:49 +0000 (0:00:00.040) 0:17:00.415 ******* 2020-11-16T20:44:49.692 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-16T20:44:49.694 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone", "lvm2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2020-11-16T20:44:49.725 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:49 +0000 (0:00:00.080) 0:17:00.495 ******* 2020-11-16T20:44:49.775 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-11-16T20:44:49.777 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-16T20:44:49.817 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:49 +0000 (0:00:00.091) 0:17:00.587 ******* 2020-11-16T20:44:49.903 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-11-16T20:44:49.905 INFO:teuthology.task.ansible.out:fatal: [smithi166.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} 2020-11-16T20:44:49.907 INFO:teuthology.task.ansible.out:...ignoring 2020-11-16T20:44:49.942 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:49 +0000 (0:00:00.124) 0:17:00.712 ******* 2020-11-16T20:44:50.038 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-16T20:44:50.077 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:50 +0000 (0:00:00.134) 0:17:00.846 ******* 2020-11-16T20:44:50.284 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-11-16T20:44:50.286 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2020-11-16T20:44:50.316 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:50 +0000 (0:00:00.239) 0:17:01.086 ******* 2020-11-16T20:44:54.365 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-11-16T20:44:54.367 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-11-16T20:44:54.398 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:54 +0000 (0:00:04.081) 0:17:05.167 ******* 2020-11-16T20:44:54.404 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-11-16T20:44:54.406 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:44:54.437 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:54 +0000 (0:00:00.039) 0:17:05.207 ******* 2020-11-16T20:44:54.443 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-11-16T20:44:54.445 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:44:54.476 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:54 +0000 (0:00:00.039) 0:17:05.246 ******* 2020-11-16T20:44:54.482 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-11-16T20:44:54.484 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:44:54.516 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:54 +0000 (0:00:00.039) 0:17:05.286 ******* 2020-11-16T20:44:54.524 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-11-16T20:44:54.526 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:44:54.559 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:54 +0000 (0:00:00.042) 0:17:05.328 ******* 2020-11-16T20:44:54.587 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:44:54.618 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:54 +0000 (0:00:00.059) 0:17:05.388 ******* 2020-11-16T20:44:54.647 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-11-16T20:44:54.648 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:44:54.678 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:54 +0000 (0:00:00.059) 0:17:05.448 ******* 2020-11-16T20:44:54.705 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-11-16T20:44:54.707 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:44:54.737 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:54 +0000 (0:00:00.059) 0:17:05.507 ******* 2020-11-16T20:44:54.754 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-11-16T20:44:54.756 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-11-16T20:44:54.788 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:54 +0000 (0:00:00.050) 0:17:05.558 ******* 2020-11-16T20:44:54.795 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-11-16T20:44:54.796 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:44:54.828 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:54 +0000 (0:00:00.040) 0:17:05.598 ******* 2020-11-16T20:44:54.855 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-11-16T20:44:54.886 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:54 +0000 (0:00:00.058) 0:17:05.656 ******* 2020-11-16T20:44:54.913 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-11-16T20:44:54.914 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:44:54.946 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:54 +0000 (0:00:00.059) 0:17:05.716 ******* 2020-11-16T20:44:54.980 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:44:55.011 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:55 +0000 (0:00:00.064) 0:17:05.780 ******* 2020-11-16T20:44:55.050 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-11-16T20:44:55.051 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-16T20:44:55.081 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:55 +0000 (0:00:00.070) 0:17:05.851 ******* 2020-11-16T20:44:55.109 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-11-16T20:44:55.110 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:44:55.140 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:55 +0000 (0:00:00.058) 0:17:05.910 ******* 2020-11-16T20:44:55.167 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-11-16T20:44:55.199 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:55 +0000 (0:00:00.058) 0:17:05.969 ******* 2020-11-16T20:44:55.226 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-11-16T20:44:55.228 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:44:55.258 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:55 +0000 (0:00:00.059) 0:17:06.028 ******* 2020-11-16T20:44:55.286 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-11-16T20:44:55.287 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:44:55.317 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:55 +0000 (0:00:00.059) 0:17:06.087 ******* 2020-11-16T20:44:55.337 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-11-16T20:44:55.339 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-11-16T20:44:55.368 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:55 +0000 (0:00:00.051) 0:17:06.138 ******* 2020-11-16T20:44:55.375 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-11-16T20:44:55.377 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:44:55.409 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:55 +0000 (0:00:00.040) 0:17:06.178 ******* 2020-11-16T20:44:55.415 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-11-16T20:44:55.417 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi059"}, "changed": false} 2020-11-16T20:44:55.448 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:55 +0000 (0:00:00.039) 0:17:06.217 ******* 2020-11-16T20:44:55.454 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-16T20:44:55.456 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:44:55.488 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:55 +0000 (0:00:00.040) 0:17:06.258 ******* 2020-11-16T20:44:55.515 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-11-16T20:44:55.517 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:44:55.547 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:55 +0000 (0:00:00.058) 0:17:06.316 ******* 2020-11-16T20:44:55.574 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-16T20:44:55.576 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:44:55.605 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:55 +0000 (0:00:00.057) 0:17:06.374 ******* 2020-11-16T20:44:55.631 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-11-16T20:44:55.633 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:44:55.662 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:55 +0000 (0:00:00.057) 0:17:06.432 ******* 2020-11-16T20:44:59.689 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-11-16T20:44:59.691 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi059", "ansible_hostname": "smithi059", "ansible_nodename": "smithi059"}, "changed": false, "name": "smithi059"} 2020-11-16T20:44:59.724 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:59 +0000 (0:00:04.061) 0:17:10.493 ******* 2020-11-16T20:44:59.731 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-11-16T20:44:59.732 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:44:59.764 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:59 +0000 (0:00:00.040) 0:17:10.534 ******* 2020-11-16T20:44:59.794 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-11-16T20:44:59.796 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:44:59.831 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:59 +0000 (0:00:00.066) 0:17:10.600 ******* 2020-11-16T20:44:59.858 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-11-16T20:44:59.860 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:44:59.890 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:59 +0000 (0:00:00.059) 0:17:10.660 ******* 2020-11-16T20:44:59.922 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:44:59.953 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:44:59 +0000 (0:00:00.063) 0:17:10.723 ******* 2020-11-16T20:44:59.980 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-11-16T20:44:59.982 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:00.012 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:00 +0000 (0:00:00.059) 0:17:10.782 ******* 2020-11-16T20:45:00.039 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-11-16T20:45:00.041 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:00.071 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:00 +0000 (0:00:00.058) 0:17:10.841 ******* 2020-11-16T20:45:04.150 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-11-16T20:45:04.151 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:04.182 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:04 +0000 (0:00:04.111) 0:17:14.952 ******* 2020-11-16T20:45:04.209 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-16T20:45:04.210 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:04.241 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:04 +0000 (0:00:00.059) 0:17:15.011 ******* 2020-11-16T20:45:04.262 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-11-16T20:45:04.264 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-11-16T20:45:04.305 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:04 +0000 (0:00:00.063) 0:17:15.074 ******* 2020-11-16T20:45:04.312 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-16T20:45:04.314 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:04.352 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:04 +0000 (0:00:00.047) 0:17:15.122 ******* 2020-11-16T20:45:08.393 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:08.439 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:08 +0000 (0:00:04.086) 0:17:19.209 ******* 2020-11-16T20:45:08.467 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:08.499 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:08 +0000 (0:00:00.059) 0:17:19.269 ******* 2020-11-16T20:45:08.526 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-16T20:45:08.528 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:08.560 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:08 +0000 (0:00:00.060) 0:17:19.330 ******* 2020-11-16T20:45:08.588 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-16T20:45:08.590 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:08.624 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:08 +0000 (0:00:00.062) 0:17:19.393 ******* 2020-11-16T20:45:08.650 INFO:teuthology.task.ansible.out: 2020-11-16T20:45:08.652 INFO:teuthology.task.ansible.out:TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:08.685 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:08 +0000 (0:00:00.061) 0:17:19.455 ******* 2020-11-16T20:45:08.712 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-16T20:45:08.714 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:08.744 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:08 +0000 (0:00:00.059) 0:17:19.514 ******* 2020-11-16T20:45:12.838 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T20:45:12.840 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:12.870 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:12 +0000 (0:00:04.126) 0:17:23.640 ******* 2020-11-16T20:45:12.887 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-11-16T20:45:12.889 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-11-16T20:45:12.921 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:12 +0000 (0:00:00.050) 0:17:23.691 ******* 2020-11-16T20:45:12.929 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-16T20:45:12.930 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:12.965 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:12 +0000 (0:00:00.043) 0:17:23.735 ******* 2020-11-16T20:45:12.992 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-16T20:45:12.993 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:13.025 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:13 +0000 (0:00:00.059) 0:17:23.794 ******* 2020-11-16T20:45:13.054 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:13.096 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:13 +0000 (0:00:00.071) 0:17:23.866 ******* 2020-11-16T20:45:13.123 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-16T20:45:13.125 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:13.158 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:13 +0000 (0:00:00.061) 0:17:23.928 ******* 2020-11-16T20:45:13.185 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-16T20:45:13.187 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:13.217 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:13 +0000 (0:00:00.059) 0:17:23.987 ******* 2020-11-16T20:45:13.244 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-16T20:45:13.246 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:13.278 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:13 +0000 (0:00:00.060) 0:17:24.048 ******* 2020-11-16T20:45:13.305 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-16T20:45:13.307 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:13.338 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:13 +0000 (0:00:00.060) 0:17:24.108 ******* 2020-11-16T20:45:13.366 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-16T20:45:13.367 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:13.398 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:13 +0000 (0:00:00.059) 0:17:24.167 ******* 2020-11-16T20:45:13.425 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-16T20:45:13.426 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:13.458 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:13 +0000 (0:00:00.060) 0:17:24.228 ******* 2020-11-16T20:45:13.487 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-16T20:45:13.489 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:13.519 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:13 +0000 (0:00:00.061) 0:17:24.289 ******* 2020-11-16T20:45:13.546 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-16T20:45:13.547 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:13.577 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:13 +0000 (0:00:00.057) 0:17:24.347 ******* 2020-11-16T20:45:13.604 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-16T20:45:13.606 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:13.639 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:13 +0000 (0:00:00.062) 0:17:24.409 ******* 2020-11-16T20:45:13.646 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-11-16T20:45:13.648 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-16T20:45:13.679 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:13 +0000 (0:00:00.040) 0:17:24.449 ******* 2020-11-16T20:45:13.686 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-16T20:45:13.689 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:13.720 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:13 +0000 (0:00:00.040) 0:17:24.490 ******* 2020-11-16T20:45:13.750 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:13.790 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:13 +0000 (0:00:00.069) 0:17:24.559 ******* 2020-11-16T20:45:13.818 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-16T20:45:13.820 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:13.852 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:13 +0000 (0:00:00.062) 0:17:24.622 ******* 2020-11-16T20:45:13.879 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-16T20:45:13.881 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:13.923 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:13 +0000 (0:00:00.070) 0:17:24.693 ******* 2020-11-16T20:45:13.953 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:13.992 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:13 +0000 (0:00:00.069) 0:17:24.762 ******* 2020-11-16T20:45:14.021 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:14.058 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:14 +0000 (0:00:00.065) 0:17:24.828 ******* 2020-11-16T20:45:18.140 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-11-16T20:45:18.141 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-11-16T20:45:18.173 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:18 +0000 (0:00:04.115) 0:17:28.943 ******* 2020-11-16T20:45:18.181 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-16T20:45:18.183 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:18.216 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:18 +0000 (0:00:00.042) 0:17:28.986 ******* 2020-11-16T20:45:18.243 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-16T20:45:18.245 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:18.275 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:18 +0000 (0:00:00.058) 0:17:29.045 ******* 2020-11-16T20:45:18.304 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:18.336 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:18 +0000 (0:00:00.061) 0:17:29.106 ******* 2020-11-16T20:45:18.363 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-11-16T20:45:18.364 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:18.395 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:18 +0000 (0:00:00.058) 0:17:29.165 ******* 2020-11-16T20:45:18.402 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-16T20:45:18.404 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-16T20:45:18.435 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:18 +0000 (0:00:00.040) 0:17:29.205 ******* 2020-11-16T20:45:18.442 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-11-16T20:45:18.444 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:18.476 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:18 +0000 (0:00:00.040) 0:17:29.246 ******* 2020-11-16T20:45:22.477 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-16T20:45:22.478 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-11-16T20:45:22.511 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:22 +0000 (0:00:04.034) 0:17:33.280 ******* 2020-11-16T20:45:22.518 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-11-16T20:45:22.520 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:22.552 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:22 +0000 (0:00:00.040) 0:17:33.321 ******* 2020-11-16T20:45:22.579 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:22.611 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:22 +0000 (0:00:00.059) 0:17:33.381 ******* 2020-11-16T20:45:22.639 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-11-16T20:45:22.641 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:22.671 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:22 +0000 (0:00:00.060) 0:17:33.441 ******* 2020-11-16T20:45:22.699 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-11-16T20:45:22.701 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:22.736 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:22 +0000 (0:00:00.065) 0:17:33.506 ******* 2020-11-16T20:45:22.753 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-16T20:45:22.755 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-16T20:45:22.785 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:22 +0000 (0:00:00.048) 0:17:33.555 ******* 2020-11-16T20:45:22.792 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-11-16T20:45:22.793 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:22.825 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:22 +0000 (0:00:00.039) 0:17:33.594 ******* 2020-11-16T20:45:22.852 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-11-16T20:45:22.854 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:22.884 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:22 +0000 (0:00:00.059) 0:17:33.654 ******* 2020-11-16T20:45:22.911 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T20:45:22.913 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-16T20:45:22.944 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:22 +0000 (0:00:00.059) 0:17:33.714 ******* 2020-11-16T20:45:22.981 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-11-16T20:45:22.983 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-11-16T20:45:22.992 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-11-16T20:45:23.003 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-11-16T20:45:23.004 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-11-16T20:45:23.014 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-11-16T20:45:23.015 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-11-16T20:45:23.025 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-16T20:45:23.063 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:23 +0000 (0:00:00.119) 0:17:33.833 ******* 2020-11-16T20:45:23.257 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-11-16T20:45:23.258 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003434", "end": "2020-11-16 20:45:23.231075", "rc": 0, "start": "2020-11-16 20:45:23.227641", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-16T20:45:23.293 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:23 +0000 (0:00:00.230) 0:17:34.063 ******* 2020-11-16T20:45:23.299 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-16T20:45:23.301 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-11-16T20:45:23.335 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:23 +0000 (0:00:00.041) 0:17:34.105 ******* 2020-11-16T20:45:23.341 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-11-16T20:45:23.343 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:23.382 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:23 +0000 (0:00:00.046) 0:17:34.152 ******* 2020-11-16T20:45:23.409 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-11-16T20:45:23.411 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:23.442 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:23 +0000 (0:00:00.060) 0:17:34.212 ******* 2020-11-16T20:45:23.470 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-11-16T20:45:23.471 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:23.501 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:23 +0000 (0:00:00.058) 0:17:34.271 ******* 2020-11-16T20:45:23.530 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-11-16T20:45:23.532 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:23.567 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:23 +0000 (0:00:00.066) 0:17:34.337 ******* 2020-11-16T20:45:23.818 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-16T20:45:23.820 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-11-16T20:45:23.852 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:23 +0000 (0:00:00.284) 0:17:34.622 ******* 2020-11-16T20:45:25.876 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-16T20:45:25.878 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.809809", "end": "2020-11-16 20:45:25.848633", "rc": 0, "start": "2020-11-16 20:45:24.038824", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T20:45:25.908 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:25 +0000 (0:00:02.056) 0:17:36.678 ******* 2020-11-16T20:45:25.936 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-11-16T20:45:25.937 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:25.968 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:25 +0000 (0:00:00.060) 0:17:36.738 ******* 2020-11-16T20:45:26.127 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-11-16T20:45:26.129 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-11-16T20:45:26.166 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:26 +0000 (0:00:00.197) 0:17:36.936 ******* 2020-11-16T20:45:26.204 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-16T20:45:26.205 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930488438784, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227170029, 'block_used': 12925079, 'inode_total': 61054976, 'inode_available': 60986775, 'inode_used': 68201, 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227170029, "block_size": 4096, "block_total": 240095108, "block_used": 12925079, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986775, "inode_total": 61054976, "inode_used": 68201, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930488438784, "size_total": 983429562368, "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}} 2020-11-16T20:45:26.237 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:26 +0000 (0:00:00.071) 0:17:37.007 ******* 2020-11-16T20:45:26.431 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-11-16T20:45:26.432 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005079", "end": "2020-11-16 20:45:26.413723", "rc": 0, "start": "2020-11-16 20:45:26.408644", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T20:45:26.462 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:26 +0000 (0:00:00.224) 0:17:37.232 ******* 2020-11-16T20:45:26.500 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-11-16T20:45:26.502 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-11-16T20:45:26.502 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930488438784, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227170029, 'block_used': 12925079, 'inode_total': 61054976, 'inode_available': 60986775, 'inode_used': 68201, 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227170029, "block_size": 4096, "block_total": 240095108, "block_used": 12925079, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986775, "inode_total": 61054976, "inode_used": 68201, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930488438784, "size_total": 983429562368, "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:26.533 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:26 +0000 (0:00:00.071) 0:17:37.303 ******* 2020-11-16T20:45:26.564 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:26 +0000 (0:00:00.030) 0:17:37.334 ******* 2020-11-16T20:45:26.571 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-16T20:45:26.603 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:26 +0000 (0:00:00.038) 0:17:37.372 ******* 2020-11-16T20:45:26.610 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-16T20:45:26.643 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:26 +0000 (0:00:00.040) 0:17:37.413 ******* 2020-11-16T20:45:26.649 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-16T20:45:26.682 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:26 +0000 (0:00:00.039) 0:17:37.452 ******* 2020-11-16T20:45:26.710 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-11-16T20:45:26.712 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:26.742 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:26 +0000 (0:00:00.059) 0:17:37.512 ******* 2020-11-16T20:45:26.780 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-11-16T20:45:26.782 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-16T20:45:26.813 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:26 +0000 (0:00:00.071) 0:17:37.583 ******* 2020-11-16T20:45:26.841 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-11-16T20:45:26.842 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:26.872 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:26 +0000 (0:00:00.059) 0:17:37.642 ******* 2020-11-16T20:45:26.900 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T20:45:26.902 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:26.932 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:26 +0000 (0:00:00.059) 0:17:37.702 ******* 2020-11-16T20:45:26.960 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-11-16T20:45:26.962 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:26.992 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:26 +0000 (0:00:00.059) 0:17:37.761 ******* 2020-11-16T20:45:27.019 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:27.051 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:27 +0000 (0:00:00.059) 0:17:37.820 ******* 2020-11-16T20:45:27.267 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-11-16T20:45:27.269 INFO:teuthology.task.ansible.out:fatal: [smithi059.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007435", "end": "2020-11-16 20:45:27.252771", "msg": "non-zero return code", "rc": 1, "start": "2020-11-16 20:45:27.245336", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} 2020-11-16T20:45:27.269 INFO:teuthology.task.ansible.out:...ignoring 2020-11-16T20:45:27.299 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:27 +0000 (0:00:00.248) 0:17:38.069 ******* 2020-11-16T20:45:27.327 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:27.359 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:27 +0000 (0:00:00.059) 0:17:38.128 ******* 2020-11-16T20:45:28.041 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-16T20:45:28.043 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-3Dlcb0DM1UYBgQLKgsgU3u138QAhlBUicxJm93l5FfMSB1a0o1cVE2qEluzIKARs'], 'uuids': ['5f4b56fd-b63f-45f8-bb68-7011e0c4cd4a'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.171502", "end": "2020-11-16 20:45:28.005685", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-3Dlcb0DM1UYBgQLKgsgU3u138QAhlBUicxJm93l5FfMSB1a0o1cVE2qEluzIKARs"], "labels": [], "masters": [], "uuids": ["5f4b56fd-b63f-45f8-bb68-7011e0c4cd4a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 20:45:26.834183", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T20:45:29.304 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-tt4i8i-G82p-3IbJ-UF8m-hR0n-2TOB-4U8WXI', 'nvme-INTEL_SSDPEDMD400G4_PHFT620401AC400BGN', 'nvme-nvme.8086-50484654363230343031414334303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.074236", "end": "2020-11-16 20:45:29.279448", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-tt4i8i-G82p-3IbJ-UF8m-hR0n-2TOB-4U8WXI", "nvme-INTEL_SSDPEDMD400G4_PHFT620401AC400BGN", "nvme-nvme.8086-50484654363230343031414334303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 20:45:28.205212", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-11-16T20:45:29.305 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T20:45:30.555 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-3Dlcb0DM1UYBgQLKgsgU3u138QAhlBUiyl7Rj0432iNd0rzV0fyyEJ82Mqi36or3'], 'uuids': ['53a28620-f4e1-4c90-9c7d-418c4cbed308'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.058767", "end": "2020-11-16 20:45:30.531633", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-3Dlcb0DM1UYBgQLKgsgU3u138QAhlBUiyl7Rj0432iNd0rzV0fyyEJ82Mqi36or3"], "labels": [], "masters": [], "uuids": ["53a28620-f4e1-4c90-9c7d-418c4cbed308"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 20:45:29.472866", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T20:45:31.821 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-3Dlcb0DM1UYBgQLKgsgU3u138QAhlBUiEDbskMw54MhlEfoUnBMBrbEzK7irz5BN'], 'uuids': ['99afa5ec-f30b-4439-9114-be7b71a43ab4'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.073736", "end": "2020-11-16 20:45:31.796564", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-3Dlcb0DM1UYBgQLKgsgU3u138QAhlBUiEDbskMw54MhlEfoUnBMBrbEzK7irz5BN"], "labels": [], "masters": [], "uuids": ["99afa5ec-f30b-4439-9114-be7b71a43ab4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 20:45:30.722828", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T20:45:33.081 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-3Dlcb0DM1UYBgQLKgsgU3u138QAhlBUixa4pLHg3HM7yjUVCJDkgJXTBFfXcPSjX'], 'uuids': ['2fa42500-0e64-44d0-87c4-de38a6d98beb'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.067023", "end": "2020-11-16 20:45:33.056671", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-3Dlcb0DM1UYBgQLKgsgU3u138QAhlBUixa4pLHg3HM7yjUVCJDkgJXTBFfXcPSjX"], "labels": [], "masters": [], "uuids": ["2fa42500-0e64-44d0-87c4-de38a6d98beb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 20:45:31.989648", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T20:45:33.092 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XMNS', 'wwn-0x5000c5009293883c'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XMNS', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c5009293883c', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XMNS-part1', 'wwn-0x5000c5009293883c-part1'], 'uuids': ['0dcc33de-53c3-4ea8-baab-7ca3c59fe577'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XMNS", "wwn-0x5000c5009293883c"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XMNS-part1", "wwn-0x5000c5009293883c-part1"], "labels": [], "masters": [], "uuids": ["0dcc33de-53c3-4ea8-baab-7ca3c59fe577"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XMNS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293883c"}}, 2020-11-16T20:45:33.094 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-11-16T20:45:33.735 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-16T20:45:33.736 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-99.module+el8.2.0+5827+8c39933c.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-11-16T20:45:33.767 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:33 +0000 (0:00:06.408) 0:17:44.537 ******* 2020-11-16T20:45:41.810 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-16T20:45:41.812 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-3Dlcb0DM1UYBgQLKgsgU3u138QAhlBUixZFnoTa8bpXTfK8lLBkrjZxUMbk9dun2'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.077855", "end": "2020-11-16 20:45:34.336720", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-3Dlcb0DM1UYBgQLKgsgU3u138QAhlBUixZFnoTa8bpXTfK8lLBkrjZxUMbk9dun2"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 20:45:33.258865", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T20:45:41.855 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:41 +0000 (0:00:08.087) 0:17:52.625 ******* 2020-11-16T20:45:42.216 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-16T20:45:42.219 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-3Dlcb0DM1UYBgQLKgsgU3u138QAhlBUicxJm93l5FfMSB1a0o1cVE2qEluzIKARs'], 'uuids': ['5f4b56fd-b63f-45f8-bb68-7011e0c4cd4a'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.140275", "end": "2020-11-16 20:45:42.196800", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-3Dlcb0DM1UYBgQLKgsgU3u138QAhlBUicxJm93l5FfMSB1a0o1cVE2qEluzIKARs"], "labels": [], "masters": [], "uuids": ["5f4b56fd-b63f-45f8-bb68-7011e0c4cd4a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 20:45:42.056525", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137638 s, 838 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137638 s, 838 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T20:45:42.437 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-tt4i8i-G82p-3IbJ-UF8m-hR0n-2TOB-4U8WXI', 'nvme-INTEL_SSDPEDMD400G4_PHFT620401AC400BGN', 'nvme-nvme.8086-50484654363230343031414334303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037123", "end": "2020-11-16 20:45:42.414293", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-tt4i8i-G82p-3IbJ-UF8m-hR0n-2TOB-4U8WXI", "nvme-INTEL_SSDPEDMD400G4_PHFT620401AC400BGN", "nvme-nvme.8086-50484654363230343031414334303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 20:45:42.377170", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0345584 s, 3.3 GB/s", "std 2020-11-16T20:45:42.440 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0345584 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T20:45:42.771 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-3Dlcb0DM1UYBgQLKgsgU3u138QAhlBUiyl7Rj0432iNd0rzV0fyyEJ82Mqi36or3'], 'uuids': ['53a28620-f4e1-4c90-9c7d-418c4cbed308'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.139268", "end": "2020-11-16 20:45:42.745651", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-3Dlcb0DM1UYBgQLKgsgU3u138QAhlBUiyl7Rj0432iNd0rzV0fyyEJ82Mqi36or3"], "labels": [], "masters": [], "uuids": ["53a28620-f4e1-4c90-9c7d-418c4cbed308"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 20:45:42.606383", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136701 s, 844 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136701 s, 844 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T20:45:43.084 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-3Dlcb0DM1UYBgQLKgsgU3u138QAhlBUiEDbskMw54MhlEfoUnBMBrbEzK7irz5BN'], 'uuids': ['99afa5ec-f30b-4439-9114-be7b71a43ab4'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.141766", "end": "2020-11-16 20:45:43.066021", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-3Dlcb0DM1UYBgQLKgsgU3u138QAhlBUiEDbskMw54MhlEfoUnBMBrbEzK7irz5BN"], "labels": [], "masters": [], "uuids": ["99afa5ec-f30b-4439-9114-be7b71a43ab4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 20:45:42.924255", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139111 s, 829 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139111 s, 829 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T20:45:43.407 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-3Dlcb0DM1UYBgQLKgsgU3u138QAhlBUixa4pLHg3HM7yjUVCJDkgJXTBFfXcPSjX'], 'uuids': ['2fa42500-0e64-44d0-87c4-de38a6d98beb'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.138277", "end": "2020-11-16 20:45:43.384722", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-3Dlcb0DM1UYBgQLKgsgU3u138QAhlBUixa4pLHg3HM7yjUVCJDkgJXTBFfXcPSjX"], "labels": [], "masters": [], "uuids": ["2fa42500-0e64-44d0-87c4-de38a6d98beb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 20:45:43.246445", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135746 s, 850 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135746 s, 850 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T20:45:43.420 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XMNS', 'wwn-0x5000c5009293883c'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XMNS', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c5009293883c', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XMNS-part1', 'wwn-0x5000c5009293883c-part1'], 'uuids': ['0dcc33de-53c3-4ea8-baab-7ca3c59fe577'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XMNS", "wwn-0x5000c5009293883c"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XMNS-part1", "wwn-0x5000c5009293883c-part1"], "labels": [], "masters": [], "uuids": ["0dcc33de-53c3-4ea8-baab-7ca3c59fe577"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XMNS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293883c"}}, 2020-11-16T20:45:43.421 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-11-16T20:45:43.737 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-3Dlcb0DM1UYBgQLKgsgU3u138QAhlBUixZFnoTa8bpXTfK8lLBkrjZxUMbk9dun2'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.147671", "end": "2020-11-16 20:45:43.720165", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-3Dlcb0DM1UYBgQLKgsgU3u138QAhlBUixZFnoTa8bpXTfK8lLBkrjZxUMbk9dun2"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 20:45:43.572494", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.145051 s, 795 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.145051 s, 795 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T20:45:43.786 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:43 +0000 (0:00:01.931) 0:17:54.556 ******* 2020-11-16T20:45:44.042 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-11-16T20:45:44.044 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.053105", "end": "2020-11-16 20:45:44.010880", "rc": 0, "start": "2020-11-16 20:45:43.957775", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T20:45:44.073 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:44 +0000 (0:00:00.287) 0:17:54.843 ******* 2020-11-16T20:45:48.170 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-16T20:45:48.171 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-7.el8.x86_64", "Removed: boost-random-1.66.0-7.el8.x86_64"]} 2020-11-16T20:45:48.204 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:48 +0000 (0:00:04.130) 0:17:58.974 ******* 2020-11-16T20:45:48.417 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-11-16T20:45:48.419 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.049774", "end": "2020-11-16 20:45:48.395781", "rc": 0, "start": "2020-11-16 20:45:48.346007", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T20:45:48.450 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:48 +0000 (0:00:00.245) 0:17:59.220 ******* 2020-11-16T20:45:48.477 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-16T20:45:48.511 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:48 +0000 (0:00:00.060) 0:17:59.281 ******* 2020-11-16T20:45:48.538 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-11-16T20:45:48.539 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:48.572 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:48 +0000 (0:00:00.061) 0:17:59.342 ******* 2020-11-16T20:45:48.599 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-11-16T20:45:48.601 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:48.631 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:48 +0000 (0:00:00.058) 0:17:59.401 ******* 2020-11-16T20:45:48.659 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:48.693 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:48 +0000 (0:00:00.062) 0:17:59.463 ******* 2020-11-16T20:45:48.720 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-11-16T20:45:48.722 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:48.752 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:48 +0000 (0:00:00.058) 0:17:59.522 ******* 2020-11-16T20:45:48.944 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-11-16T20:45:48.945 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-16T20:45:48.975 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:48 +0000 (0:00:00.223) 0:17:59.745 ******* 2020-11-16T20:45:53.067 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-16T20:45:53.069 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930488438784, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227170029, 'block_used': 12925079, 'inode_total': 61054976, 'inode_available': 60986775, 'inode_used': 68201, 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227170029, "block_size": 4096, "block_total": 240095108, "block_used": 12925079, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986775, "inode_total": 61054976, "inode_used": 68201, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930488438784, "size_total": 983429562368, "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:53.100 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:53 +0000 (0:00:04.124) 0:18:03.870 ******* 2020-11-16T20:45:53.127 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-11-16T20:45:53.128 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:53.159 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:53 +0000 (0:00:00.059) 0:18:03.929 ******* 2020-11-16T20:45:53.197 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T20:45:53.198 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:53.232 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:53 +0000 (0:00:00.072) 0:18:04.002 ******* 2020-11-16T20:45:53.259 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T20:45:53.261 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:53.291 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:53 +0000 (0:00:00.058) 0:18:04.061 ******* 2020-11-16T20:45:53.328 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-11-16T20:45:53.330 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:53.361 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:53 +0000 (0:00:00.069) 0:18:04.130 ******* 2020-11-16T20:45:53.387 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-11-16T20:45:53.389 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:53.419 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:53 +0000 (0:00:00.058) 0:18:04.189 ******* 2020-11-16T20:45:53.445 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-11-16T20:45:53.447 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:45:53.477 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:53 +0000 (0:00:00.057) 0:18:04.246 ******* 2020-11-16T20:45:58.191 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-11-16T20:45:58.193 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-16T20:45:58.223 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:45:58 +0000 (0:00:04.746) 0:18:08.993 ******* 2020-11-16T20:45:58.853 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-16T20:45:58.855 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T20:46:03.234 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T20:46:03.555 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T20:46:24.019 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T20:46:24.352 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T20:46:24.388 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:24 +0000 (0:00:26.164) 0:18:35.158 ******* 2020-11-16T20:46:24.584 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-16T20:46:24.586 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-16T20:46:24.616 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:24 +0000 (0:00:00.228) 0:18:35.386 ******* 2020-11-16T20:46:24.845 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-16T20:46:24.847 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-16T20:46:25.028 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-16T20:46:25.207 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-16T20:46:25.385 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-16T20:46:25.397 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:25.430 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:25 +0000 (0:00:00.813) 0:18:36.200 ******* 2020-11-16T20:46:25.635 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-11-16T20:46:25.637 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-16T20:46:25.667 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:25 +0000 (0:00:00.237) 0:18:36.437 ******* 2020-11-16T20:46:25.694 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-11-16T20:46:25.696 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:25.729 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:25 +0000 (0:00:00.061) 0:18:36.498 ******* 2020-11-16T20:46:27.319 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-11-16T20:46:27.320 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true} 2020-11-16T20:46:27.352 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:27 +0000 (0:00:01.623) 0:18:38.122 ******* 2020-11-16T20:46:27.944 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-11-16T20:46:27.945 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-16T20:46:27.981 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:27 +0000 (0:00:00.629) 0:18:38.751 ******* 2020-11-16T20:46:28.008 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-11-16T20:46:28.010 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:28.040 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:28 +0000 (0:00:00.058) 0:18:38.809 ******* 2020-11-16T20:46:28.069 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-11-16T20:46:28.070 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:28.102 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:28 +0000 (0:00:00.061) 0:18:38.871 ******* 2020-11-16T20:46:28.129 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-11-16T20:46:28.132 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:28.161 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:28 +0000 (0:00:00.059) 0:18:38.931 ******* 2020-11-16T20:46:28.188 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-11-16T20:46:28.190 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:28.220 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:28 +0000 (0:00:00.059) 0:18:38.990 ******* 2020-11-16T20:46:28.248 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-11-16T20:46:28.249 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:28.280 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:28 +0000 (0:00:00.059) 0:18:39.050 ******* 2020-11-16T20:46:28.308 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:28.340 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:28 +0000 (0:00:00.059) 0:18:39.110 ******* 2020-11-16T20:46:28.369 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-11-16T20:46:28.370 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:28.401 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:28 +0000 (0:00:00.060) 0:18:39.171 ******* 2020-11-16T20:46:28.428 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-11-16T20:46:28.430 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:28.460 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:28 +0000 (0:00:00.058) 0:18:39.229 ******* 2020-11-16T20:46:28.486 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-11-16T20:46:28.488 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:28.519 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:28 +0000 (0:00:00.059) 0:18:39.289 ******* 2020-11-16T20:46:28.547 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:28.579 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:28 +0000 (0:00:00.059) 0:18:39.348 ******* 2020-11-16T20:46:28.606 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:28.638 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:28 +0000 (0:00:00.059) 0:18:39.408 ******* 2020-11-16T20:46:29.134 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-11-16T20:46:29.136 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-11-16T20:46:29.179 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:29 +0000 (0:00:00.540) 0:18:39.949 ******* 2020-11-16T20:46:29.484 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-16T20:46:29.485 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2020-11-16 20:26:34 UTC", "ActiveEnterTimestampMonotonic": "15936804", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "ntpd.service ntpdate.service systemd-tmpfiles-setup.service basic.target sntp.service tmp.mount system.slice systemd-journald.socket sysinit.target -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-11-16 20:26:33 UTC", "AssertTimestampMonotonic": "14882108", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-11-16 20:26:33 UTC", "ConditionTimestampMonotonic": "14882086", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target ntpd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-11-16T20:46:29.487 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2417", "ExecMainStartTimestamp": "Mon 2020-11-16 20:26:34 UTC", "ExecMainStartTimestampMonotonic": "15906787", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-11-16 20:26:33 UTC", "InactiveExitTimestampMonotonic": "14903387", "InvocationID": "aec027ce77714476856d356cdf075f4d", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-11-16T20:46:29.488 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127425", "LimitNPROCSoft": "127425", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127425", "LimitSIGPENDINGSoft": "127425", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2417", "MemoryAccounting": "yes", "MemoryCurrent": "2867200", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-11-16T20:46:29.490 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-11-16 20:26:34 UTC", "StateChangeTimestampMonotonic": "15936804", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-11-16 20:26:34 UTC", "WatchdogTimestampMonotonic": "15906831", "WatchdogUSec": "0"}} 2020-11-16T20:46:29.518 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:29 +0000 (0:00:00.339) 0:18:40.288 ******* 2020-11-16T20:46:29.545 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T20:46:29.547 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-16T20:46:29.577 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:29 +0000 (0:00:00.058) 0:18:40.347 ******* 2020-11-16T20:46:29.604 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T20:46:29.606 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-11-16T20:46:29.636 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:29 +0000 (0:00:00.059) 0:18:40.406 ******* 2020-11-16T20:46:29.662 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-11-16T20:46:29.664 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:29.694 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:29 +0000 (0:00:00.057) 0:18:40.463 ******* 2020-11-16T20:46:29.720 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-11-16T20:46:29.722 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:29.753 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:29 +0000 (0:00:00.059) 0:18:40.523 ******* 2020-11-16T20:46:29.780 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-11-16T20:46:29.782 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:29.822 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:29 +0000 (0:00:00.068) 0:18:40.592 ******* 2020-11-16T20:46:30.030 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-16T20:46:30.031 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-11-16T20:46:30.062 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:30 +0000 (0:00:00.239) 0:18:40.832 ******* 2020-11-16T20:46:30.562 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-11-16T20:46:30.593 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:30 +0000 (0:00:00.530) 0:18:41.363 ******* 2020-11-16T20:46:31.965 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-16T20:46:31.997 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:31 +0000 (0:00:01.403) 0:18:42.766 ******* 2020-11-16T20:46:32.024 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-11-16T20:46:32.025 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:32.055 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:32 +0000 (0:00:00.058) 0:18:42.825 ******* 2020-11-16T20:46:32.082 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-11-16T20:46:32.084 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-11-16T20:46:32.118 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:32 +0000 (0:00:00.062) 0:18:42.888 ******* 2020-11-16T20:46:32.302 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-11-16T20:46:32.304 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-11-16T20:46:32.334 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:32 +0000 (0:00:00.216) 0:18:43.104 ******* 2020-11-16T20:46:32.363 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-11-16T20:46:32.364 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:32.395 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:32 +0000 (0:00:00.060) 0:18:43.164 ******* 2020-11-16T20:46:32.422 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-16T20:46:32.454 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:32 +0000 (0:00:00.059) 0:18:43.224 ******* 2020-11-16T20:46:32.481 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-11-16T20:46:32.483 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:32.513 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:32 +0000 (0:00:00.059) 0:18:43.283 ******* 2020-11-16T20:46:32.707 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-11-16T20:46:32.709 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-16T20:46:32.739 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:32 +0000 (0:00:00.225) 0:18:43.509 ******* 2020-11-16T20:46:32.931 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-11-16T20:46:32.933 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-16T20:46:32.966 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:32 +0000 (0:00:00.227) 0:18:43.736 ******* 2020-11-16T20:46:32.993 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-11-16T20:46:32.995 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:33.026 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:33 +0000 (0:00:00.059) 0:18:43.795 ******* 2020-11-16T20:46:33.063 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-11-16T20:46:33.064 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-11-16T20:46:33.074 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-11-16T20:46:33.085 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-11-16T20:46:33.086 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-11-16T20:46:33.096 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-11-16T20:46:33.128 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:33 +0000 (0:00:00.102) 0:18:43.898 ******* 2020-11-16T20:46:33.165 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-11-16T20:46:33.167 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:33.177 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:33.178 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:33.189 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:33.224 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:33 +0000 (0:00:00.096) 0:18:43.994 ******* 2020-11-16T20:46:33.251 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T20:46:33.253 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:33.285 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:33 +0000 (0:00:00.060) 0:18:44.054 ******* 2020-11-16T20:46:33.312 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:33.343 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:33 +0000 (0:00:00.058) 0:18:44.113 ******* 2020-11-16T20:46:33.370 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-11-16T20:46:33.372 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:33.403 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:33 +0000 (0:00:00.059) 0:18:44.173 ******* 2020-11-16T20:46:33.437 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:33.469 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:33 +0000 (0:00:00.065) 0:18:44.238 ******* 2020-11-16T20:46:33.497 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-11-16T20:46:33.498 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:33.531 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:33 +0000 (0:00:00.062) 0:18:44.301 ******* 2020-11-16T20:46:33.559 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:33.593 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:33 +0000 (0:00:00.061) 0:18:44.363 ******* 2020-11-16T20:46:33.621 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-11-16T20:46:33.623 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:33.655 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:33 +0000 (0:00:00.062) 0:18:44.425 ******* 2020-11-16T20:46:33.682 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-16T20:46:33.684 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:33.714 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:33 +0000 (0:00:00.058) 0:18:44.484 ******* 2020-11-16T20:46:33.939 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-16T20:46:33.941 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005002", "end": "2020-11-16 20:46:33.908036", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-16 20:46:33.903034", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T20:46:34.118 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.002893", "end": "2020-11-16 20:46:34.087419", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-16 20:46:34.084526", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T20:46:34.294 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002866", "end": "2020-11-16 20:46:34.268231", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-16 20:46:34.265365", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-16T20:46:34.472 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003238", "end": "2020-11-16 20:46:34.447137", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-16 20:46:34.443899", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T20:46:34.508 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:34 +0000 (0:00:00.793) 0:18:45.278 ******* 2020-11-16T20:46:34.535 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-16T20:46:34.569 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:34 +0000 (0:00:00.061) 0:18:45.339 ******* 2020-11-16T20:46:34.766 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-11-16T20:46:34.768 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-16T20:46:34.798 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:34 +0000 (0:00:00.228) 0:18:45.567 ******* 2020-11-16T20:46:35.142 INFO:teuthology.task.ansible.out: RUNNING HANDLER [common : restart nagios-nrpe-server] ************************** 2020-11-16T20:46:35.143 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2020-11-16 20:40:21 UTC", "ActiveEnterTimestampMonotonic": "842821869", "ActiveExitTimestamp": "Mon 2020-11-16 20:40:21 UTC", "ActiveExitTimestampMonotonic": "842795339", "ActiveState": "active", "After": "systemd-journald.socket nss-lookup.target local-fs.target basic.target -.mount network.target tmp.mount system.slice var-run.mount time-sync.target sysinit.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-11-16 20:40:21 UTC", "AssertTimestampMonotonic": "842821205", "Before": "shutdown.target getty@tty1.service plymouth-quit.service multi-user.target xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-11-16 20:40:21 UTC", "ConditionTimestampMonotonic": "842821205", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": 2020-11-16T20:46:35.145 INFO:teuthology.task.ansible.out: "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "18565", "ExecMainStartTimestamp": "Mon 2020-11-16 20:40:21 UTC", "ExecMainStartTimestampMonotonic": "842821834", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2020-11-16 20:40:21 UTC", "InactiveEnterTimestampMonotonic": "842820520", "InactiveExitTimestamp": "Mon 2020-11-16 20:40:21 UTC", "InactiveExitTimestampMonotonic": "842821869", "InvocationID": "c861e2c15d8d4de5832ffae4c50fd431", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infi 2020-11-16T20:46:35.146 INFO:teuthology.task.ansible.out:nity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127425", "LimitNPROCSoft": "127425", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127425", "LimitSIGPENDINGSoft": "127425", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "18565", "MemoryAccounting": "yes", "MemoryCurrent": "888832", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "Restric 2020-11-16T20:46:35.148 INFO:teuthology.task.ansible.out:tRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-11-16 20:40:21 UTC", "StateChangeTimestampMonotonic": "842821869", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-11-16 20:40:21 UTC", "WatchdogTimestampMonotonic": "842821867", "WatchdogUSec": "0"}} 2020-11-16T20:46:39.711 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-16T20:46:39.713 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: git-all", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: podman", "Installed: podman-docker", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: lvm2", "Installed: lvm2-libs-8:2.03.09-5.el8.x86_64", "Installed: libgcrypt-1.8.5-4.el8.x86_64", "Installed: boost-thread-1.66.0-10.el8.x86_64", "Installed: lvm2-8:2.03.09-5.el8.x86_64", "Installed: cpp-8.3.1-5.1.el8.x86_64", "Installed: python3-libdnf-0.48.0-5.el8.x86_64", "Installed: gdb-headless-8.2-12.el8.x86_64", "Installed: boost-system-1.66.0-10.el8.x86_64", "Installed: python3-librepo-1.12.0-2.el8.x86_64", "Installed: yum-4.2.23-4.el8.noarch", "Installed: libuuid-2.32.1-24.el8.x86_64", "Installed: perl-Git-2.27.0-1.el8.noarch", "Installed: podman-docker-2.0.5-5.module+el8.3.0+8221+97165c3f.noarch", "Installed: gitk-2.27.0-1.el8.noarch", "Installed: gcc-gdb-plugin-8.3.1-5.1.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Installed: device-mapper-libs-8:1.02.171-5.el8.x86_64", "Installed: python3-dnf-plugins-core-4.0.17-5.el8.noarch", "Installed: nfs-utils-1:2.3.3-35.el8.x86_64", "Installed: gitweb-2.2 2020-11-16T20:46:39.714 INFO:teuthology.task.ansible.out:7.0-1.el8.noarch", "Installed: git-email-2.27.0-1.el8.noarch", "Installed: libmodulemd-2.9.4-2.el8.x86_64", "Installed: device-mapper-event-8:1.02.171-5.el8.x86_64", "Installed: openssl-libs-1:1.1.1g-11.el8.x86_64", "Installed: lsof-4.93.2-1.el8.x86_64", "Installed: python3-hawkey-0.48.0-5.el8.x86_64", "Installed: git-core-doc-2.27.0-1.el8.noarch", "Installed: valgrind-1:3.16.0-2.el8.x86_64", "Installed: git-instaweb-2.27.0-1.el8.noarch", "Installed: git-all-2.27.0-1.el8.noarch", "Installed: git-core-2.27.0-1.el8.x86_64", "Installed: podman-2.0.5-5.module+el8.3.0+8221+97165c3f.x86_64", "Installed: dnf-4.2.23-4.el8.noarch", "Installed: perl-Git-SVN-2.27.0-1.el8.noarch", "Installed: git-2.27.0-1.el8.x86_64", "Installed: boost-chrono-1.66.0-10.el8.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: qemu-img-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Installed: gcc-8.3.1-5.1.el8.x86_64", "Installed: xfsprogs-5.0.0-4.el8.x86_64", "Installed: openssl-1:1.1.1g-11.el8.x86_64", "Installed: git-credential-libsecret-2.27.0-1.el8.x86_64", "Installed: device-mapper-8:1.02.171-5.el8.x86_64", "Installed: yum-utils-4.0.17-5.el8.noarch", "Installed: libgomp-8.3.1-5.1.el8.x86_64", "Installed: dnf-plugins-core-4.0.17-5.el8.noarch", "Installed: podman-catatonit-2.0.5-5.module+el8.3.0+8221+97165c3f.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: python3-dnf-4.2.23-4.el8.noarch", "Installed: device-mapper-event-libs-8:1.02.171-5.el8.x86_64", "Installed: git-subtree-2.27.0-1.el8.x86_64", "Installed: sysstat-11.7.3-5.el8.x86_64", "Installed: libgcc-8.3.1-5.1.el8.x86_64", "Installed: qemu-kvm-common-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Installed: gdb-8.2-12.el8.x86_64", "Installed: git-svn-2.27.0-1.el8.noarch", "Installed: git-gui-2.27.0-1.el8.noarch", "Installed: libdnf-0.48.0-5.el8.x86_64", "Installed: librepo-1.12.0-2.el8.x86_64", "Installed: seavgabios-bin-1.13.0-2.module+el8.3.0+7353+9de0a3cc.noarch", "Installed: qemu 2020-11-16T20:46:39.716 INFO:teuthology.task.ansible.out:-kvm-core-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Installed: dnf-data-4.2.23-4.el8.noarch", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Removed: sysstat-11.7.3-2.el8.x86_64", "Removed: openssl-1:1.1.1c-15.el8.x86_64", "Removed: librepo-1.11.0-2.el8.x86_64", "Removed: openssl-libs-1:1.1.1c-15.el8.x86_64", "Removed: gcc-8.3.1-5.el8.x86_64", "Removed: gcc-gdb-plugin-8.3.1-5.el8.x86_64", "Removed: gdb-8.2-11.el8.x86_64", "Removed: gdb-headless-8.2-11.el8.x86_64", "Removed: valgrind-1:3.15.0-11.el8.x86_64", "Removed: git-2.18.4-2.el8_2.x86_64", "Removed: xfsprogs-5.0.0-2.el8.x86_64", "Removed: git-core-2.18.4-2.el8_2.x86_64", "Removed: git-core-doc-2.18.4-2.el8_2.noarch", "Removed: qemu-img-15:2.12.0-99.module+el8.2.0+5827+8c39933c.x86_64", "Removed: git-gui-2.18.4-2.el8_2.noarch", "Removed: qemu-kvm-core-15:2.12.0-99.module+el8.2.0+5827+8c39933c.x86_64", "Removed: git-subtree-2.18.4-2.el8_2.x86_64", "Removed: yum-4.2.17-6.el8.noarch", "Removed: yum-utils-4.0.12-3.el8.noarch", "Removed: boost-system-1.66.0-7.el8.x86_64", "Removed: gitk-2.18.4-2.el8_2.noarch", "Removed: gitweb-2.18.4-2.el8_2.noarch", "Removed: git-email-2.18.4-2.el8_2.noarch", "Removed: git-instaweb-2.18.4-2.el8_2.x86_64", "Removed: boost-thread-1.66.0-7.el8.x86_64", "Removed: git-svn-2.18.4-2.el8_2.x86_64", "Removed: libuuid-2.32.1-22.el8.x86_64", "Removed: cpp-8.3.1-5.el8.x86_64", "Removed: git-all-2.18.4-2.el8_2.noarch", "Removed: podman-1.6.4-11.module+el8.2.0+6368+cf16aa14.x86_64", "Removed: podman-docker-1.6.4-11.module+el8.2.0+6368+cf16aa14.noarch", "Removed: libdnf-0.39.1-5.el8.x86_64", "Removed: seavgabios-bin-1.11.1-4.module+el8.1.0+4066+0f1aadab.noarch", "Removed: boost-chrono-1.66.0-7.el8.x86_64", "Removed: lsof-4.91-2.el8.x86_64", "Removed: perl-Git-2.18.4-2.el8_2.noarch", "Removed: lvm2-8:2.03.08-3.el8.x86_64", "Removed: lvm2-libs-8:2.03.08-3.el8.x86_64", "Removed: perl-Git-SVN-2.18.4-2.el8_2.noarch", "Removed: libgcc-8.3.1-5.el8.x86_64", "Removed: libgcrypt-1.8.3-4.el8.x86_64" 2020-11-16T20:46:39.717 INFO:teuthology.task.ansible.out:, "Removed: device-mapper-8:1.02.169-3.el8.x86_64", "Removed: device-mapper-event-8:1.02.169-3.el8.x86_64", "Removed: device-mapper-event-libs-8:1.02.169-3.el8.x86_64", "Removed: device-mapper-libs-8:1.02.169-3.el8.x86_64", "Removed: libgomp-8.3.1-5.el8.x86_64", "Removed: dnf-4.2.17-6.el8.noarch", "Removed: python3-dnf-4.2.17-6.el8.noarch", "Removed: python3-dnf-plugins-core-4.0.12-3.el8.noarch", "Removed: dnf-data-4.2.17-6.el8.noarch", "Removed: dnf-plugins-core-4.0.12-3.el8.noarch", "Removed: python3-hawkey-0.39.1-5.el8.x86_64", "Removed: qemu-kvm-common-15:2.12.0-99.module+el8.2.0+5827+8c39933c.x86_64", "Removed: python3-libdnf-0.39.1-5.el8.x86_64", "Removed: python3-librepo-1.11.0-2.el8.x86_64", "Removed: nfs-utils-1:2.3.3-31.el8.x86_64"]} 2020-11-16T20:46:39.742 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:39 +0000 (0:00:04.944) 0:18:50.512 ******* 2020-11-16T20:46:42.533 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-11-16T20:46:42.535 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: dbench"]} 2020-11-16T20:46:42.565 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:42 +0000 (0:00:02.823) 0:18:53.335 ******* 2020-11-16T20:46:45.342 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-16T20:46:45.344 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-11-16T20:46:45.373 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:45 +0000 (0:00:02.807) 0:18:56.143 ******* 2020-11-16T20:46:49.401 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-16T20:46:49.403 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:46:49.433 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:46:49 +0000 (0:00:04.059) 0:19:00.203 ******* 2020-11-16T20:47:09.950 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-11-16T20:47:09.952 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.service dbus.socket sysinit.target polkit.service system.slice basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target ipset.service ip6tables.service iptables.service ebtables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-11-16T20:47:09.954 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127449", "LimitNPROCSoft": "127449", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127449", 2020-11-16T20:47:09.956 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127449", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "dbus.socket system.slice sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-11-16T20:47:09.957 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-11-16T20:47:09.983 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:47:09 +0000 (0:00:20.550) 0:19:20.753 ******* 2020-11-16T20:47:10.290 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-11-16T20:47:10.292 INFO:teuthology.task.ansible.out:fatal: [smithi059.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-11-16T20:47:10.322 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:47:10 +0000 (0:00:00.338) 0:19:21.091 ******* 2020-11-16T20:47:10.617 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-11-16T20:47:10.618 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-11-16T20:47:10.648 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:47:10 +0000 (0:00:00.326) 0:19:21.418 ******* 2020-11-16T20:47:10.675 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-11-16T20:47:10.677 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:47:10.706 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:47:10 +0000 (0:00:00.057) 0:19:21.476 ******* 2020-11-16T20:47:10.733 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-11-16T20:47:10.735 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:47:10.765 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:47:10 +0000 (0:00:00.058) 0:19:21.534 ******* 2020-11-16T20:47:10.791 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-11-16T20:47:10.793 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:47:10.823 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:47:10 +0000 (0:00:00.058) 0:19:21.593 ******* 2020-11-16T20:47:10.849 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-11-16T20:47:10.851 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:47:10.880 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:47:10 +0000 (0:00:00.057) 0:19:21.650 ******* 2020-11-16T20:47:10.918 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-11-16T20:47:10.920 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:47:10.949 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:47:10 +0000 (0:00:00.068) 0:19:21.719 ******* 2020-11-16T20:48:24.782 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-11-16T20:48:24.785 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:48:24.815 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:48:24 +0000 (0:01:13.866) 0:20:35.585 ******* 2020-11-16T20:48:37.221 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-11-16T20:48:37.253 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:48:37 +0000 (0:00:12.438) 0:20:48.023 ******* 2020-11-16T20:49:01.526 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-11-16T20:49:01.528 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:01.560 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:01 +0000 (0:00:24.306) 0:21:12.329 ******* 2020-11-16T20:49:01.588 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-11-16T20:49:01.590 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:01.620 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:01 +0000 (0:00:00.060) 0:21:12.390 ******* 2020-11-16T20:49:01.657 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-11-16T20:49:01.659 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-16T20:49:01.689 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:01 +0000 (0:00:00.069) 0:21:12.459 ******* 2020-11-16T20:49:05.758 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:05.789 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:05 +0000 (0:00:04.099) 0:21:16.558 ******* 2020-11-16T20:49:05.816 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-11-16T20:49:05.847 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:05 +0000 (0:00:00.058) 0:21:16.617 ******* 2020-11-16T20:49:05.874 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-11-16T20:49:05.876 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:05.906 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:05 +0000 (0:00:00.058) 0:21:16.676 ******* 2020-11-16T20:49:05.933 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-11-16T20:49:05.935 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:05.964 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:05 +0000 (0:00:00.058) 0:21:16.734 ******* 2020-11-16T20:49:05.991 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-11-16T20:49:05.992 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:06.021 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:06 +0000 (0:00:00.057) 0:21:16.791 ******* 2020-11-16T20:49:06.047 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-16T20:49:06.049 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:06.080 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:06 +0000 (0:00:00.059) 0:21:16.850 ******* 2020-11-16T20:49:06.107 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-11-16T20:49:06.108 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:06.137 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:06 +0000 (0:00:00.056) 0:21:16.907 ******* 2020-11-16T20:49:06.163 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:06.193 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:06 +0000 (0:00:00.056) 0:21:16.963 ******* 2020-11-16T20:49:06.219 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-11-16T20:49:06.221 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:06.250 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:06 +0000 (0:00:00.056) 0:21:17.020 ******* 2020-11-16T20:49:06.276 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-11-16T20:49:06.278 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:06.308 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:06 +0000 (0:00:00.057) 0:21:17.077 ******* 2020-11-16T20:49:06.334 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-11-16T20:49:06.336 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:06.365 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:06 +0000 (0:00:00.057) 0:21:17.135 ******* 2020-11-16T20:49:06.394 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-11-16T20:49:06.395 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:06.425 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:06 +0000 (0:00:00.059) 0:21:17.194 ******* 2020-11-16T20:49:06.452 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-11-16T20:49:06.454 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:06.484 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:06 +0000 (0:00:00.059) 0:21:17.254 ******* 2020-11-16T20:49:06.511 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-11-16T20:49:06.513 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:06.542 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:06 +0000 (0:00:00.058) 0:21:17.312 ******* 2020-11-16T20:49:06.569 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-11-16T20:49:06.571 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:06.601 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:06 +0000 (0:00:00.058) 0:21:17.371 ******* 2020-11-16T20:49:06.628 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:06.660 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:06 +0000 (0:00:00.058) 0:21:17.429 ******* 2020-11-16T20:49:06.687 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:06.720 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:06 +0000 (0:00:00.059) 0:21:17.489 ******* 2020-11-16T20:49:10.830 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-16T20:49:10.832 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:10.862 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:10 +0000 (0:00:04.142) 0:21:21.632 ******* 2020-11-16T20:49:14.977 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:15.011 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:15 +0000 (0:00:04.149) 0:21:25.781 ******* 2020-11-16T20:49:15.039 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:15.070 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:15 +0000 (0:00:00.058) 0:21:25.840 ******* 2020-11-16T20:49:15.097 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-16T20:49:15.098 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:15.128 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:15 +0000 (0:00:00.057) 0:21:25.898 ******* 2020-11-16T20:49:15.156 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-16T20:49:15.157 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:15.187 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:15 +0000 (0:00:00.059) 0:21:25.957 ******* 2020-11-16T20:49:15.214 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-16T20:49:15.216 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:15.249 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:15 +0000 (0:00:00.061) 0:21:26.018 ******* 2020-11-16T20:49:15.276 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-16T20:49:15.277 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:15.307 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:15 +0000 (0:00:00.058) 0:21:26.077 ******* 2020-11-16T20:49:15.334 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:15.366 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:15 +0000 (0:00:00.058) 0:21:26.135 ******* 2020-11-16T20:49:15.396 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-16T20:49:15.398 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:15.428 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:15 +0000 (0:00:00.062) 0:21:26.198 ******* 2020-11-16T20:49:15.455 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:15.486 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:15 +0000 (0:00:00.057) 0:21:26.256 ******* 2020-11-16T20:49:15.513 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-16T20:49:15.515 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:15.545 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:15 +0000 (0:00:00.058) 0:21:26.314 ******* 2020-11-16T20:49:15.572 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-16T20:49:15.573 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:15.603 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:15 +0000 (0:00:00.058) 0:21:26.373 ******* 2020-11-16T20:49:15.630 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-16T20:49:15.632 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:15.662 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:15 +0000 (0:00:00.058) 0:21:26.431 ******* 2020-11-16T20:49:15.688 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-16T20:49:15.690 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:15.719 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:15 +0000 (0:00:00.057) 0:21:26.489 ******* 2020-11-16T20:49:15.746 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-16T20:49:15.748 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:15.777 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:15 +0000 (0:00:00.058) 0:21:26.547 ******* 2020-11-16T20:49:15.804 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-16T20:49:15.806 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:15.837 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:15 +0000 (0:00:00.058) 0:21:26.606 ******* 2020-11-16T20:49:15.863 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-16T20:49:15.864 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:15.895 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:15 +0000 (0:00:00.058) 0:21:26.665 ******* 2020-11-16T20:49:15.923 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-16T20:49:15.924 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:15.956 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:15 +0000 (0:00:00.060) 0:21:26.726 ******* 2020-11-16T20:49:15.985 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-16T20:49:15.987 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:16.017 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:16 +0000 (0:00:00.060) 0:21:26.787 ******* 2020-11-16T20:49:16.045 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-16T20:49:16.046 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:16.076 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:16 +0000 (0:00:00.059) 0:21:26.846 ******* 2020-11-16T20:49:16.103 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-16T20:49:16.105 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:16.134 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:16 +0000 (0:00:00.058) 0:21:26.904 ******* 2020-11-16T20:49:16.162 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-16T20:49:16.164 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:16.194 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:16 +0000 (0:00:00.059) 0:21:26.964 ******* 2020-11-16T20:49:16.222 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-16T20:49:16.223 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:16.257 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:16 +0000 (0:00:00.062) 0:21:27.026 ******* 2020-11-16T20:49:16.284 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-16T20:49:16.286 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:16.316 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:16 +0000 (0:00:00.059) 0:21:27.086 ******* 2020-11-16T20:49:16.344 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-11-16T20:49:16.346 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:16.376 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:16 +0000 (0:00:00.059) 0:21:27.145 ******* 2020-11-16T20:49:16.404 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-11-16T20:49:16.405 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:16.435 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:16 +0000 (0:00:00.059) 0:21:27.205 ******* 2020-11-16T20:49:16.462 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-16T20:49:16.464 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:16.493 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:16 +0000 (0:00:00.058) 0:21:27.263 ******* 2020-11-16T20:49:16.521 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-16T20:49:16.522 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:16.552 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:16 +0000 (0:00:00.058) 0:21:27.322 ******* 2020-11-16T20:49:16.579 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-11-16T20:49:16.581 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:16.611 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:16 +0000 (0:00:00.059) 0:21:27.381 ******* 2020-11-16T20:49:16.638 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-11-16T20:49:16.640 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:16.670 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:16 +0000 (0:00:00.059) 0:21:27.440 ******* 2020-11-16T20:49:16.698 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-11-16T20:49:16.700 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:16.730 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:16 +0000 (0:00:00.059) 0:21:27.499 ******* 2020-11-16T20:49:16.758 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-11-16T20:49:16.760 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:16.791 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:16 +0000 (0:00:00.061) 0:21:27.561 ******* 2020-11-16T20:49:16.819 INFO:teuthology.task.ansible.out: 2020-11-16T20:49:16.820 INFO:teuthology.task.ansible.out:TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:16.854 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:16 +0000 (0:00:00.062) 0:21:27.624 ******* 2020-11-16T20:49:16.882 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-11-16T20:49:16.884 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:16.914 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:16 +0000 (0:00:00.060) 0:21:27.684 ******* 2020-11-16T20:49:16.941 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-11-16T20:49:16.943 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:16.972 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:16 +0000 (0:00:00.058) 0:21:27.742 ******* 2020-11-16T20:49:16.999 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-11-16T20:49:17.001 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:17.031 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:17 +0000 (0:00:00.058) 0:21:27.801 ******* 2020-11-16T20:49:17.058 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-11-16T20:49:17.060 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:17.089 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:17 +0000 (0:00:00.058) 0:21:27.859 ******* 2020-11-16T20:49:17.117 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T20:49:17.120 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-16T20:49:17.149 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:17 +0000 (0:00:00.059) 0:21:27.919 ******* 2020-11-16T20:49:17.197 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-11-16T20:49:17.199 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-11-16T20:49:17.208 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-11-16T20:49:17.210 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-11-16T20:49:17.220 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-11-16T20:49:17.221 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-11-16T20:49:17.231 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-11-16T20:49:17.233 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-16T20:49:17.268 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:17 +0000 (0:00:00.118) 0:21:28.038 ******* 2020-11-16T20:49:17.487 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-11-16T20:49:17.489 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003583", "end": "2020-11-16 20:49:17.459547", "rc": 0, "start": "2020-11-16 20:49:17.455964", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-16T20:49:17.522 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:17 +0000 (0:00:00.254) 0:21:28.292 ******* 2020-11-16T20:49:17.550 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-11-16T20:49:17.552 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:17.586 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:17 +0000 (0:00:00.063) 0:21:28.355 ******* 2020-11-16T20:49:17.624 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-11-16T20:49:17.626 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:17.658 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:17 +0000 (0:00:00.070) 0:21:28.426 ******* 2020-11-16T20:49:17.683 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-11-16T20:49:17.685 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:17.721 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:17 +0000 (0:00:00.064) 0:21:28.491 ******* 2020-11-16T20:49:17.748 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-11-16T20:49:17.750 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:17.782 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:17 +0000 (0:00:00.060) 0:21:28.552 ******* 2020-11-16T20:49:20.708 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-11-16T20:49:20.710 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-11-16T20:49:20.740 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:20 +0000 (0:00:02.958) 0:21:31.510 ******* 2020-11-16T20:49:20.788 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-16T20:49:20.790 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930488365056, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227170011, 'block_used': 12925097, 'inode_total': 61054976, 'inode_available': 60986771, 'inode_used': 68205, 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227170011, "block_size": 4096, "block_total": 240095108, "block_used": 12925097, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986771, "inode_total": 61054976, "inode_used": 68205, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930488365056, "size_total": 983429562368, "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}} 2020-11-16T20:49:20.820 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:20 +0000 (0:00:00.079) 0:21:31.590 ******* 2020-11-16T20:49:21.024 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-11-16T20:49:21.026 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005344", "end": "2020-11-16 20:49:21.011556", "rc": 0, "start": "2020-11-16 20:49:21.006212", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T20:49:21.058 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:21 +0000 (0:00:00.237) 0:21:31.828 ******* 2020-11-16T20:49:21.095 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-11-16T20:49:21.097 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930488365056, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227170011, 'block_used': 12925097, 'inode_total': 61054976, 'inode_available': 60986771, 'inode_used': 68205, 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227170011, "block_size": 4096, "block_total": 240095108, "block_used": 12925097, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986771, "inode_total": 61054976, "inode_used": 68205, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930488365056, "size_total": 983429562368, "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:21.127 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:21 +0000 (0:00:00.069) 0:21:31.897 ******* 2020-11-16T20:49:21.154 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-16T20:49:21.187 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:21 +0000 (0:00:00.059) 0:21:31.956 ******* 2020-11-16T20:49:22.549 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-16T20:49:22.551 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-f6t8UuLMrWHl2jXKf1afF0D30N9glxGi1cxwI7gcVbaDDajIDvped3Q4v3T445Pd'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.133778", "end": "2020-11-16 20:49:22.523299", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-f6t8UuLMrWHl2jXKf1afF0D30N9glxGi1cxwI7gcVbaDDajIDvped3Q4v3T445Pd"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 20:49:21.389521", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T20:49:23.857 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-AlDhF7-xrgW-fzmo-V5Vv-BzdX-Df3t-ivWXap', 'nvme-INTEL_SSDPEDMD400G4_CVFT5330009L400BGN', 'nvme-nvme.8086-43564654353333303030394c34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.099952", "end": "2020-11-16 20:49:23.828766", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-AlDhF7-xrgW-fzmo-V5Vv-BzdX-Df3t-ivWXap", "nvme-INTEL_SSDPEDMD400G4_CVFT5330009L400BGN", "nvme-nvme.8086-43564654353333303030394c34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 20:49:22.728814", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-11-16T20:49:23.859 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T20:49:25.105 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-f6t8UuLMrWHl2jXKf1afF0D30N9glxGieUdTryMDK2rjVojUb0jLbzef9H7tNdl3'], 'uuids': ['7535dddb-4030-4bab-a4d3-6cb39d583762'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.046661", "end": "2020-11-16 20:49:25.081430", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-f6t8UuLMrWHl2jXKf1afF0D30N9glxGieUdTryMDK2rjVojUb0jLbzef9H7tNdl3"], "labels": [], "masters": [], "uuids": ["7535dddb-4030-4bab-a4d3-6cb39d583762"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 20:49:24.034769", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T20:49:30.471 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-f6t8UuLMrWHl2jXKf1afF0D30N9glxGiAykibwWSqG6saghBQmk5bRZRh9s8yGwx'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.104875", "end": "2020-11-16 20:49:30.438768", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-f6t8UuLMrWHl2jXKf1afF0D30N9glxGiAykibwWSqG6saghBQmk5bRZRh9s8yGwx"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 20:49:29.333893", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T20:49:31.731 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-f6t8UuLMrWHl2jXKf1afF0D30N9glxGidQtVIdffrCpsrJkdMxy65VYvyUCHHpHn'], 'uuids': ['47be9cae-035c-4822-bb0b-267266be6c90'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.066648", "end": "2020-11-16 20:49:31.707278", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-f6t8UuLMrWHl2jXKf1afF0D30N9glxGidQtVIdffrCpsrJkdMxy65VYvyUCHHpHn"], "labels": [], "masters": [], "uuids": ["47be9cae-035c-4822-bb0b-267266be6c90"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 20:49:30.640630", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T20:49:31.743 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2P7', 'wwn-0x5000c500871b7b3d'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4J2P7', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871b7b3d', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2P7-part1', 'wwn-0x5000c500871b7b3d-part1'], 'uuids': ['0dcc33de-53c3-4ea8-baab-7ca3c59fe577'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2P7", "wwn-0x5000c500871b7b3d"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2P7-part1", "wwn-0x5000c500871b7b3d-part1"], "labels": [], "masters": [], "uuids": ["0dcc33de-53c3-4ea8-baab-7ca3c59fe577"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J2P7", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b7b3d"}}, 2020-11-16T20:49:31.744 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-11-16T20:49:37.020 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-f6t8UuLMrWHl2jXKf1afF0D30N9glxGiVtwXpcXBIY4NA91gMIkpWIbEATtCIWmQ'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.053018", "end": "2020-11-16 20:49:36.991014", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-f6t8UuLMrWHl2jXKf1afF0D30N9glxGiVtwXpcXBIY4NA91gMIkpWIbEATtCIWmQ"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 20:49:35.937996", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T20:49:37.059 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:37 +0000 (0:00:15.872) 0:21:47.829 ******* 2020-11-16T20:49:37.439 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-16T20:49:37.441 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-f6t8UuLMrWHl2jXKf1afF0D30N9glxGi1cxwI7gcVbaDDajIDvped3Q4v3T445Pd'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.137874", "end": "2020-11-16 20:49:37.411396", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-f6t8UuLMrWHl2jXKf1afF0D30N9glxGi1cxwI7gcVbaDDajIDvped3Q4v3T445Pd"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 20:49:37.273522", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135244 s, 853 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135244 s, 853 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T20:49:37.658 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-AlDhF7-xrgW-fzmo-V5Vv-BzdX-Df3t-ivWXap', 'nvme-INTEL_SSDPEDMD400G4_CVFT5330009L400BGN', 'nvme-nvme.8086-43564654353333303030394c34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036159", "end": "2020-11-16 20:49:37.639316", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-AlDhF7-xrgW-fzmo-V5Vv-BzdX-Df3t-ivWXap", "nvme-INTEL_SSDPEDMD400G4_CVFT5330009L400BGN", "nvme-nvme.8086-43564654353333303030394c34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 20:49:37.603157", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0334733 s, 3.4 GB/s", "std 2020-11-16T20:49:37.660 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0334733 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T20:49:38.004 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-f6t8UuLMrWHl2jXKf1afF0D30N9glxGieUdTryMDK2rjVojUb0jLbzef9H7tNdl3'], 'uuids': ['7535dddb-4030-4bab-a4d3-6cb39d583762'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.139716", "end": "2020-11-16 20:49:37.979823", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-f6t8UuLMrWHl2jXKf1afF0D30N9glxGieUdTryMDK2rjVojUb0jLbzef9H7tNdl3"], "labels": [], "masters": [], "uuids": ["7535dddb-4030-4bab-a4d3-6cb39d583762"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 20:49:37.840107", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.13711 s, 841 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.13711 s, 841 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T20:49:38.329 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-f6t8UuLMrWHl2jXKf1afF0D30N9glxGiAykibwWSqG6saghBQmk5bRZRh9s8yGwx'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.138925", "end": "2020-11-16 20:49:38.308921", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-f6t8UuLMrWHl2jXKf1afF0D30N9glxGiAykibwWSqG6saghBQmk5bRZRh9s8yGwx"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 20:49:38.169996", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136315 s, 846 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136315 s, 846 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T20:49:38.664 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-f6t8UuLMrWHl2jXKf1afF0D30N9glxGidQtVIdffrCpsrJkdMxy65VYvyUCHHpHn'], 'uuids': ['47be9cae-035c-4822-bb0b-267266be6c90'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.141630", "end": "2020-11-16 20:49:38.644624", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-f6t8UuLMrWHl2jXKf1afF0D30N9glxGidQtVIdffrCpsrJkdMxy65VYvyUCHHpHn"], "labels": [], "masters": [], "uuids": ["47be9cae-035c-4822-bb0b-267266be6c90"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 20:49:38.502994", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138849 s, 831 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138849 s, 831 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T20:49:38.677 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2P7', 'wwn-0x5000c500871b7b3d'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4J2P7', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871b7b3d', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2P7-part1', 'wwn-0x5000c500871b7b3d-part1'], 'uuids': ['0dcc33de-53c3-4ea8-baab-7ca3c59fe577'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2P7", "wwn-0x5000c500871b7b3d"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2P7-part1", "wwn-0x5000c500871b7b3d-part1"], "labels": [], "masters": [], "uuids": ["0dcc33de-53c3-4ea8-baab-7ca3c59fe577"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J2P7", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b7b3d"}}, 2020-11-16T20:49:38.678 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-11-16T20:49:43.660 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-f6t8UuLMrWHl2jXKf1afF0D30N9glxGiVtwXpcXBIY4NA91gMIkpWIbEATtCIWmQ'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.138802", "end": "2020-11-16 20:49:43.152671", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-f6t8UuLMrWHl2jXKf1afF0D30N9glxGiVtwXpcXBIY4NA91gMIkpWIbEATtCIWmQ"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 20:49:43.013869", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.13617 s, 847 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.13617 s, 847 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T20:49:43.707 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:43 +0000 (0:00:06.648) 0:21:54.477 ******* 2020-11-16T20:49:52.040 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-11-16T20:49:52.042 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.062989", "end": "2020-11-16 20:49:52.017465", "rc": 0, "start": "2020-11-16 20:49:51.954476", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T20:49:52.071 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:52 +0000 (0:00:08.363) 0:22:02.841 ******* 2020-11-16T20:49:56.395 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-11-16T20:49:56.397 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.052773", "end": "2020-11-16 20:49:56.380152", "rc": 0, "start": "2020-11-16 20:49:56.327379", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T20:49:56.428 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:56 +0000 (0:00:04.356) 0:22:07.197 ******* 2020-11-16T20:49:56.455 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-16T20:49:56.490 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:56 +0000 (0:00:00.061) 0:22:07.259 ******* 2020-11-16T20:49:56.517 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-11-16T20:49:56.519 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:56.551 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:56 +0000 (0:00:00.061) 0:22:07.321 ******* 2020-11-16T20:49:56.579 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-11-16T20:49:56.582 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:56.611 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:56 +0000 (0:00:00.059) 0:22:07.380 ******* 2020-11-16T20:49:56.639 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:56.673 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:56 +0000 (0:00:00.062) 0:22:07.443 ******* 2020-11-16T20:49:56.700 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-11-16T20:49:56.702 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:56.732 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:56 +0000 (0:00:00.058) 0:22:07.502 ******* 2020-11-16T20:49:56.939 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi059.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-16T20:49:56.971 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:56 +0000 (0:00:00.238) 0:22:07.740 ******* 2020-11-16T20:49:57.010 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi059.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930488365056, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227170011, 'block_used': 12925097, 'inode_total': 61054976, 'inode_available': 60986771, 'inode_used': 68205, 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227170011, "block_size": 4096, "block_total": 240095108, "block_used": 12925097, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986771, "inode_total": 61054976, "inode_used": 68205, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930488365056, "size_total": 983429562368, "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:57.042 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:57 +0000 (0:00:00.071) 0:22:07.812 ******* 2020-11-16T20:49:57.071 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-11-16T20:49:57.073 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:57.102 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:57 +0000 (0:00:00.060) 0:22:07.872 ******* 2020-11-16T20:49:57.130 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T20:49:57.131 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:57.162 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:57 +0000 (0:00:00.059) 0:22:07.931 ******* 2020-11-16T20:49:57.189 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T20:49:57.191 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:57.221 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:57 +0000 (0:00:00.059) 0:22:07.991 ******* 2020-11-16T20:49:57.248 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-11-16T20:49:57.250 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:57.281 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:57 +0000 (0:00:00.058) 0:22:08.049 ******* 2020-11-16T20:49:57.306 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-11-16T20:49:57.308 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:57.338 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:57 +0000 (0:00:00.058) 0:22:08.108 ******* 2020-11-16T20:49:57.376 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-11-16T20:49:57.377 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:49:57.417 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:57 +0000 (0:00:00.077) 0:22:08.185 ******* 2020-11-16T20:49:57.897 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-16T20:49:57.930 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:49:57 +0000 (0:00:00.514) 0:22:08.700 ******* 2020-11-16T20:49:58.321 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-16T20:49:58.322 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T20:49:58.686 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T20:49:59.042 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T20:50:03.495 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T20:50:03.868 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T20:50:03.901 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:03 +0000 (0:00:05.971) 0:22:14.671 ******* 2020-11-16T20:50:04.111 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-16T20:50:04.112 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-16T20:50:04.146 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:04 +0000 (0:00:00.245) 0:22:14.916 ******* 2020-11-16T20:50:04.377 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-16T20:50:04.379 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-16T20:50:04.569 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-16T20:50:04.759 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-16T20:50:04.947 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-16T20:50:04.959 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:04.993 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:04 +0000 (0:00:00.846) 0:22:15.763 ******* 2020-11-16T20:50:05.206 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-11-16T20:50:05.207 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-16T20:50:05.238 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:05 +0000 (0:00:00.244) 0:22:16.007 ******* 2020-11-16T20:50:05.264 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-11-16T20:50:05.266 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:05.296 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:05 +0000 (0:00:00.058) 0:22:16.066 ******* 2020-11-16T20:50:05.579 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-11-16T20:50:05.581 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true} 2020-11-16T20:50:05.612 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:05 +0000 (0:00:00.315) 0:22:16.381 ******* 2020-11-16T20:50:05.940 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-11-16T20:50:05.942 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-16T20:50:05.972 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:05 +0000 (0:00:00.360) 0:22:16.742 ******* 2020-11-16T20:50:05.999 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-11-16T20:50:06.000 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:06.030 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:06 +0000 (0:00:00.058) 0:22:16.800 ******* 2020-11-16T20:50:06.057 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-11-16T20:50:06.059 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:06.088 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:06 +0000 (0:00:00.058) 0:22:16.858 ******* 2020-11-16T20:50:06.116 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-11-16T20:50:06.118 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:06.147 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:06 +0000 (0:00:00.058) 0:22:16.917 ******* 2020-11-16T20:50:06.174 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-11-16T20:50:06.176 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:06.205 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:06 +0000 (0:00:00.058) 0:22:16.975 ******* 2020-11-16T20:50:06.233 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-11-16T20:50:06.234 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:06.264 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:06 +0000 (0:00:00.058) 0:22:17.033 ******* 2020-11-16T20:50:06.293 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-11-16T20:50:06.295 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:06.325 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:06 +0000 (0:00:00.060) 0:22:17.094 ******* 2020-11-16T20:50:06.353 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:06.387 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:06 +0000 (0:00:00.062) 0:22:17.157 ******* 2020-11-16T20:50:06.415 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-11-16T20:50:06.417 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:06.448 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:06 +0000 (0:00:00.060) 0:22:17.218 ******* 2020-11-16T20:50:06.475 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-11-16T20:50:06.477 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:06.508 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:06 +0000 (0:00:00.059) 0:22:17.277 ******* 2020-11-16T20:50:06.534 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-11-16T20:50:06.537 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:06.569 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:06 +0000 (0:00:00.061) 0:22:17.339 ******* 2020-11-16T20:50:10.606 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-11-16T20:50:10.608 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:10.638 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:10 +0000 (0:00:04.068) 0:22:21.408 ******* 2020-11-16T20:50:11.145 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-11-16T20:50:11.146 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-11-16T20:50:11.177 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:11 +0000 (0:00:00.538) 0:22:21.946 ******* 2020-11-16T20:50:11.496 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-16T20:50:11.497 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2020-11-16 20:26:27 UTC", "ActiveEnterTimestampMonotonic": "19845239", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "ntpd.service ntpdate.service sntp.service tmp.mount system.slice basic.target -.mount sysinit.target systemd-tmpfiles-setup.service systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-11-16 20:26:26 UTC", "AssertTimestampMonotonic": "18915153", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-11-16 20:26:26 UTC", "ConditionTimestampMonotonic": "18915101", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target ntpd.service systemd-timesyncd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-11-16T20:50:11.498 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2430", "ExecMainStartTimestamp": "Mon 2020-11-16 20:26:27 UTC", "ExecMainStartTimestampMonotonic": "19736669", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-11-16 20:26:26 UTC", "InactiveExitTimestampMonotonic": "18939590", "InvocationID": "edc1e54ad9de4546a3d5dcfb076ca032", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-11-16T20:50:11.500 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127449", "LimitNPROCSoft": "127449", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127449", "LimitSIGPENDINGSoft": "127449", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2430", "MemoryAccounting": "yes", "MemoryCurrent": "2985984", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-11-16T20:50:11.501 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-11-16 20:26:27 UTC", "StateChangeTimestampMonotonic": "19845239", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-11-16 20:26:27 UTC", "WatchdogTimestampMonotonic": "19736685", "WatchdogUSec": "0"}} 2020-11-16T20:50:11.529 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:11 +0000 (0:00:00.352) 0:22:22.299 ******* 2020-11-16T20:50:11.556 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T20:50:11.557 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-16T20:50:11.587 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:11 +0000 (0:00:00.057) 0:22:22.356 ******* 2020-11-16T20:50:11.623 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T20:50:11.624 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-11-16T20:50:11.656 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:11 +0000 (0:00:00.069) 0:22:22.425 ******* 2020-11-16T20:50:11.683 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-11-16T20:50:11.685 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:11.729 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:11 +0000 (0:00:00.073) 0:22:22.498 ******* 2020-11-16T20:50:11.756 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-11-16T20:50:11.758 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:11.788 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:11 +0000 (0:00:00.059) 0:22:22.558 ******* 2020-11-16T20:50:11.816 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-11-16T20:50:11.817 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:11.847 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:11 +0000 (0:00:00.058) 0:22:22.616 ******* 2020-11-16T20:50:12.056 INFO:teuthology.task.ansible.out: 2020-11-16T20:50:12.058 INFO:teuthology.task.ansible.out:TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-16T20:50:12.060 INFO:teuthology.task.ansible.out: ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-11-16T20:50:12.091 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:12 +0000 (0:00:00.244) 0:22:22.861 ******* 2020-11-16T20:50:12.609 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-11-16T20:50:12.610 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-11-16T20:50:12.648 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:12 +0000 (0:00:00.556) 0:22:23.418 ******* 2020-11-16T20:50:13.766 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-11-16T20:50:13.768 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-16T20:50:13.800 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:13 +0000 (0:00:01.151) 0:22:24.570 ******* 2020-11-16T20:50:13.828 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-11-16T20:50:13.830 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:13.861 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:13 +0000 (0:00:00.061) 0:22:24.631 ******* 2020-11-16T20:50:13.890 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2020-11-16T20:50:13.925 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:13 +0000 (0:00:00.063) 0:22:24.695 ******* 2020-11-16T20:50:14.125 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-11-16T20:50:14.168 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:14 +0000 (0:00:00.242) 0:22:24.937 ******* 2020-11-16T20:50:14.196 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-11-16T20:50:14.198 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:14.236 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:14 +0000 (0:00:00.068) 0:22:25.006 ******* 2020-11-16T20:50:14.265 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-11-16T20:50:14.267 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-16T20:50:14.299 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:14 +0000 (0:00:00.062) 0:22:25.068 ******* 2020-11-16T20:50:14.326 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-11-16T20:50:14.327 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:14.358 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:14 +0000 (0:00:00.059) 0:22:25.127 ******* 2020-11-16T20:50:14.566 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-11-16T20:50:14.568 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-16T20:50:14.599 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:14 +0000 (0:00:00.241) 0:22:25.369 ******* 2020-11-16T20:50:14.805 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-11-16T20:50:14.807 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-16T20:50:14.839 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:14 +0000 (0:00:00.240) 0:22:25.609 ******* 2020-11-16T20:50:14.866 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-11-16T20:50:14.868 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:14.898 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:14 +0000 (0:00:00.058) 0:22:25.668 ******* 2020-11-16T20:50:14.936 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-11-16T20:50:14.937 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-11-16T20:50:14.948 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-11-16T20:50:14.949 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2020-11-16T20:50:14.981 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:14 +0000 (0:00:00.082) 0:22:25.750 ******* 2020-11-16T20:50:15.019 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-11-16T20:50:15.020 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:15.030 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:15.032 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:15.042 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:15.080 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:15 +0000 (0:00:00.098) 0:22:25.849 ******* 2020-11-16T20:50:15.117 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T20:50:15.119 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:15.151 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:15 +0000 (0:00:00.071) 0:22:25.921 ******* 2020-11-16T20:50:15.189 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-11-16T20:50:15.191 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:15.221 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:15 +0000 (0:00:00.069) 0:22:25.991 ******* 2020-11-16T20:50:15.248 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-11-16T20:50:15.249 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:15.281 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:15 +0000 (0:00:00.059) 0:22:26.051 ******* 2020-11-16T20:50:15.307 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-11-16T20:50:15.309 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:15.344 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:15 +0000 (0:00:00.063) 0:22:26.114 ******* 2020-11-16T20:50:15.373 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-11-16T20:50:15.375 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:15.409 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:15 +0000 (0:00:00.065) 0:22:26.179 ******* 2020-11-16T20:50:15.436 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:15.469 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:15 +0000 (0:00:00.060) 0:22:26.239 ******* 2020-11-16T20:50:15.496 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-11-16T20:50:15.498 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:15.530 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:15 +0000 (0:00:00.060) 0:22:26.299 ******* 2020-11-16T20:50:15.556 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-16T20:50:15.558 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T20:50:15.587 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:15 +0000 (0:00:00.058) 0:22:26.357 ******* 2020-11-16T20:50:15.826 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-16T20:50:15.827 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005401", "end": "2020-11-16 20:50:15.793011", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-16 20:50:15.787610", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T20:50:17.021 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:01.004464", "end": "2020-11-16 20:50:16.990808", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-16 20:50:15.986344", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T20:50:17.231 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.003056", "end": "2020-11-16 20:50:17.194571", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-16 20:50:17.191515", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-16T20:50:17.408 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003464", "end": "2020-11-16 20:50:17.387937", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-16 20:50:17.384473", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T20:50:17.449 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:17 +0000 (0:00:01.861) 0:22:28.218 ******* 2020-11-16T20:50:17.476 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-16T20:50:17.507 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:17 +0000 (0:00:00.058) 0:22:28.277 ******* 2020-11-16T20:50:17.713 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-11-16T20:50:17.715 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-16T20:50:17.746 INFO:teuthology.task.ansible.out:Monday 16 November 2020 20:50:17 +0000 (0:00:00.238) 0:22:28.516 ******* 2020-11-16T20:50:18.115 INFO:teuthology.task.ansible.out: RUNNING HANDLER [common : restart nagios-nrpe-server] ************************** 2020-11-16T20:50:18.116 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2020-11-16 20:41:33 UTC", "ActiveEnterTimestampMonotonic": "926508826", "ActiveExitTimestamp": "Mon 2020-11-16 20:41:33 UTC", "ActiveExitTimestampMonotonic": "926484492", "ActiveState": "active", "After": "local-fs.target systemd-tmpfiles-setup.service systemd-journald.socket basic.target var-run.mount nss-lookup.target tmp.mount sysinit.target -.mount network.target system.slice time-sync.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-11-16 20:41:33 UTC", "AssertTimestampMonotonic": "926507032", "Before": "shutdown.target multi-user.target xdm.service plymouth-quit.service getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-11-16 20:41:33 UTC", "ConditionTimestampMonotonic": "926507031", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": 2020-11-16T20:50:18.117 INFO:teuthology.task.ansible.out: "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "14705", "ExecMainStartTimestamp": "Mon 2020-11-16 20:41:33 UTC", "ExecMainStartTimestampMonotonic": "926508797", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2020-11-16 20:41:33 UTC", "InactiveEnterTimestampMonotonic": "926506320", "InactiveExitTimestamp": "Mon 2020-11-16 20:41:33 UTC", "InactiveExitTimestampMonotonic": "926508826", "InvocationID": "341a2242435848acbddb8acaf0345437", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infi 2020-11-16T20:50:18.119 INFO:teuthology.task.ansible.out:nity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127449", "LimitNPROCSoft": "127449", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127449", "LimitSIGPENDINGSoft": "127449", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "14705", "MemoryAccounting": "yes", "MemoryCurrent": "1159168", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "Restri 2020-11-16T20:50:18.121 INFO:teuthology.task.ansible.out:ctRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-11-16 20:41:33 UTC", "StateChangeTimestampMonotonic": "926508826", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-11-16 20:41:33 UTC", "WatchdogTimestampMonotonic": "926508825", "WatchdogUSec": "0"}} 2020-11-16T20:50:18.188 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-11-16T20:50:18.194 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2020-11-16T20:50:18.199 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2020-11-16T20:50:18.201 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi059.front.sepia.ceph.com : ok=128 changed=45 unreachable=0 failed=0 skipped=162 rescued=0 ignored=4 smithi166.front.sepia.ceph.com : ok=128 changed=45 unreachable=0 failed=0 skipped=162 rescued=0 ignored=4 Monday 16 November 2020 20:50:18 +0000 (0:00:00.453) 0:22:28.970 ******* =============================================================================== users : Create all admin users with sudo access. ---------------------- 267.69s users : Update authorized_keys using the keys repo -------------------- 133.94s testnode : Check for custom repos -------------------------------------- 73.87s Gathering Facts -------------------------------------------------------- 25.52s common : nrpe - Copy SELinux type enforcement file --------------------- 24.87s testnode : Set apt preferences ----------------------------------------- 24.31s testnode : Stop and disable firewalld ---------------------------------- 20.55s common : Reboot RHEL7 to workaround systemd bug ------------------------ 20.08s ansible-managed : Create the cephlab_sudo sudoers.d file. -------------- 17.68s common : nrpe - Remove SELinux policy package -------------------------- 17.29s users : Set UID_MIN to 1001 -------------------------------------------- 16.88s common : Install nrpe package and dependencies (Ubuntu/Fedora) --------- 16.17s testnode : Zap all non-root disks -------------------------------------- 15.87s ansible-managed : Add authorized keys for the ansible user. ------------ 13.37s testnode : Remove custom repos ----------------------------------------- 12.44s common : Get SELinux status -------------------------------------------- 12.39s users : Check keys_repo HEAD sha1 -------------------------------------- 12.35s common : Install Kerberos Packages (RedHat) ----------------------------- 9.12s common : Install nrpe package and dependencies 2020-11-16T20:50:18.203 INFO:teuthology.task.ansible.out: (RHEL/CentOS) ------------ 8.60s testnode : Remove all LVM data ------------------------------------------ 8.36s 2020-11-16T20:50:18.569 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi166.front.sepia.ceph.com'), Remote(name='ubuntu@smithi059.front.sepia.ceph.com')] 2020-11-16T20:50:18.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-16T20:50:18.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T20:50:18.648 INFO:teuthology.orchestra.run.smithi166:> true 2020-11-16T20:50:18.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-16T20:50:18.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T20:50:18.884 INFO:teuthology.orchestra.run.smithi059:> true 2020-11-16T20:50:18.972 INFO:teuthology.run_tasks:Running task clock... 2020-11-16T20:50:18.983 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-11-16T20:50:18.983 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-16T20:50:18.984 INFO:teuthology.orchestra.run.smithi166:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-16T20:50:19.024 INFO:teuthology.orchestra.run.smithi166.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-11-16T20:50:19.042 INFO:teuthology.orchestra.run.smithi166.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-11-16T20:50:19.084 INFO:teuthology.orchestra.run.smithi166.stderr:sudo: ntpd: command not found 2020-11-16T20:50:19.098 INFO:teuthology.orchestra.run.smithi166.stdout:506 Cannot talk to daemon 2020-11-16T20:50:19.116 INFO:teuthology.orchestra.run.smithi166.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-11-16T20:50:19.133 INFO:teuthology.orchestra.run.smithi166.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-11-16T20:50:19.193 INFO:teuthology.orchestra.run.smithi166.stderr:bash: ntpq: command not found 2020-11-16T20:50:19.196 INFO:teuthology.orchestra.run.smithi166.stdout:210 Number of sources = 4 2020-11-16T20:50:19.196 INFO:teuthology.orchestra.run.smithi166.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-11-16T20:50:19.196 INFO:teuthology.orchestra.run.smithi166.stdout:=============================================================================== 2020-11-16T20:50:19.196 INFO:teuthology.orchestra.run.smithi166.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-16T20:50:19.196 INFO:teuthology.orchestra.run.smithi166.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-16T20:50:19.196 INFO:teuthology.orchestra.run.smithi166.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-16T20:50:19.197 INFO:teuthology.orchestra.run.smithi166.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-16T20:50:19.197 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-16T20:50:19.198 INFO:teuthology.orchestra.run.smithi059:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-16T20:50:19.243 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-11-16T20:50:19.266 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-11-16T20:50:19.318 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: ntpd: command not found 2020-11-16T20:50:19.336 INFO:teuthology.orchestra.run.smithi059.stdout:506 Cannot talk to daemon 2020-11-16T20:50:19.358 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-11-16T20:50:19.379 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-11-16T20:50:19.446 INFO:teuthology.orchestra.run.smithi059.stderr:bash: ntpq: command not found 2020-11-16T20:50:19.448 INFO:teuthology.orchestra.run.smithi059.stdout:210 Number of sources = 4 2020-11-16T20:50:19.448 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-11-16T20:50:19.448 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2020-11-16T20:50:19.449 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-16T20:50:19.449 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-16T20:50:19.449 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-16T20:50:19.449 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-16T20:50:19.450 INFO:teuthology.run_tasks:Running task install... 2020-11-16T20:50:19.458 DEBUG:teuthology.task.install:project ceph 2020-11-16T20:50:19.458 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '911cc35794d871071a8bebfb0919482263b1d18b'}} 2020-11-16T20:50:19.459 DEBUG:teuthology.task.install:config {'sha1': '911cc35794d871071a8bebfb0919482263b1d18b'} 2020-11-16T20:50:19.459 INFO:teuthology.task.install:Using flavor: basic 2020-11-16T20:50:19.470 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-11-16T20:50:19.470 INFO:teuthology.task.install:extra packages: [] 2020-11-16T20:50:19.471 INFO:teuthology.orchestra.run.smithi166:> sudo lsb_release -is 2020-11-16T20:50:19.508 INFO:teuthology.orchestra.run.smithi166.stdout:RedHatEnterprise 2020-11-16T20:50:19.509 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-16T20:50:19.510 INFO:teuthology.orchestra.run.smithi059:> sudo lsb_release -is 2020-11-16T20:50:19.510 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '911cc35794d871071a8bebfb0919482263b1d18b', 'tag': None, 'wait_for_package': False} 2020-11-16T20:50:19.511 INFO:teuthology.orchestra.run.smithi166:> sudo lsb_release -is 2020-11-16T20:50:19.551 INFO:teuthology.orchestra.run.smithi059.stdout:RedHatEnterprise 2020-11-16T20:50:19.553 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-16T20:50:19.553 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '911cc35794d871071a8bebfb0919482263b1d18b', 'tag': None, 'wait_for_package': False} 2020-11-16T20:50:19.553 INFO:teuthology.orchestra.run.smithi059:> sudo lsb_release -is 2020-11-16T20:50:19.584 INFO:teuthology.orchestra.run.smithi166.stdout:RedHatEnterprise 2020-11-16T20:50:19.585 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-16T20:50:19.586 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=911cc35794d871071a8bebfb0919482263b1d18b 2020-11-16T20:50:19.631 INFO:teuthology.orchestra.run.smithi059.stdout:RedHatEnterprise 2020-11-16T20:50:19.632 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-16T20:50:19.633 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=911cc35794d871071a8bebfb0919482263b1d18b 2020-11-16T20:50:19.761 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-kefu-testing-2020-11-16-1845/911cc35794d871071a8bebfb0919482263b1d18b/centos/8/flavors/default/ 2020-11-16T20:50:19.762 INFO:teuthology.task.install.rpm:Package version is 16.0.0-7219.g911cc357 2020-11-16T20:50:19.796 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-kefu-testing-2020-11-16-1845/911cc35794d871071a8bebfb0919482263b1d18b/centos/8/flavors/default/ 2020-11-16T20:50:19.797 INFO:teuthology.task.install.rpm:Package version is 16.0.0-7219.g911cc357 2020-11-16T20:50:19.886 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-kefu-testing-2020-11-16-1845/911cc35794d871071a8bebfb0919482263b1d18b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-kefu-testing-2020-11-16-1845/911cc35794d871071a8bebfb0919482263b1d18b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-kefu-testing-2020-11-16-1845/911cc35794d871071a8bebfb0919482263b1d18b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-11-16T20:50:19.887 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-16T20:50:19.888 INFO:teuthology.orchestra.run.smithi166:> sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-16T20:50:19.901 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-16T20:50:19.914 INFO:teuthology.orchestra.run.smithi166.stderr:1+1 records in 2020-11-16T20:50:19.914 INFO:teuthology.orchestra.run.smithi166.stderr:1+1 records out 2020-11-16T20:50:19.915 INFO:teuthology.orchestra.run.smithi166.stderr:664 bytes copied, 3.5911e-05 s, 18.5 MB/s 2020-11-16T20:50:19.915 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2020-11-16T20:50:19.916 INFO:teuthology.orchestra.run.smithi166:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/911cc35794d871071a8bebfb0919482263b1d18b/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-11-16T20:50:19.919 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-kefu-testing-2020-11-16-1845/911cc35794d871071a8bebfb0919482263b1d18b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-kefu-testing-2020-11-16-1845/911cc35794d871071a8bebfb0919482263b1d18b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-kefu-testing-2020-11-16-1845/911cc35794d871071a8bebfb0919482263b1d18b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-11-16T20:50:19.919 INFO:teuthology.orchestra.run.smithi059:> set -ex 2020-11-16T20:50:19.920 INFO:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-16T20:50:19.933 INFO:teuthology.orchestra.run.smithi059.stderr:+ sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-16T20:50:19.950 INFO:teuthology.orchestra.run.smithi059.stderr:1+1 records in 2020-11-16T20:50:19.950 INFO:teuthology.orchestra.run.smithi059.stderr:1+1 records out 2020-11-16T20:50:19.951 INFO:teuthology.orchestra.run.smithi059.stderr:664 bytes copied, 4.1447e-05 s, 16.0 MB/s 2020-11-16T20:50:19.951 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2020-11-16T20:50:19.952 INFO:teuthology.orchestra.run.smithi059:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/911cc35794d871071a8bebfb0919482263b1d18b/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-11-16T20:50:19.983 INFO:teuthology.orchestra.run.smithi166:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-11-16T20:50:20.024 INFO:teuthology.orchestra.run.smithi059:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-11-16T20:50:20.064 INFO:teuthology.orchestra.run.smithi166:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-11-16T20:50:20.113 INFO:teuthology.orchestra.run.smithi059:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-11-16T20:50:20.131 INFO:teuthology.orchestra.run.smithi166.stdout:check_obsoletes = 1 2020-11-16T20:50:20.132 INFO:teuthology.orchestra.run.smithi166:> sudo yum clean all 2020-11-16T20:50:20.143 INFO:teuthology.orchestra.run.smithi059.stdout:check_obsoletes = 1 2020-11-16T20:50:20.144 INFO:teuthology.orchestra.run.smithi059:> sudo yum clean all 2020-11-16T20:50:20.507 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:50:20.546 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:50:20.896 INFO:teuthology.orchestra.run.smithi166.stdout:113 files removed 2020-11-16T20:50:20.932 INFO:teuthology.orchestra.run.smithi059.stdout:113 files removed 2020-11-16T20:50:20.944 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install ceph-radosgw 2020-11-16T20:50:20.976 INFO:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-radosgw 2020-11-16T20:50:21.280 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:50:21.335 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:50:21.968 INFO:teuthology.orchestra.run.smithi166.stdout:ceph packages for x86_64 292 kB/s | 72 kB 00:00 2020-11-16T20:50:22.057 INFO:teuthology.orchestra.run.smithi059.stdout:ceph packages for x86_64 293 kB/s | 72 kB 00:00 2020-11-16T20:50:22.203 INFO:teuthology.orchestra.run.smithi166.stdout:ceph noarch packages 72 kB/s | 15 kB 00:00 2020-11-16T20:50:22.295 INFO:teuthology.orchestra.run.smithi059.stdout:ceph noarch packages 71 kB/s | 15 kB 00:00 2020-11-16T20:50:22.432 INFO:teuthology.orchestra.run.smithi166.stdout:ceph source packages 6.9 kB/s | 1.4 kB 00:00 2020-11-16T20:50:22.525 INFO:teuthology.orchestra.run.smithi059.stdout:ceph source packages 6.9 kB/s | 1.4 kB 00:00 2020-11-16T20:50:22.560 INFO:teuthology.orchestra.run.smithi166.stdout:Copr repo for ceph-el8 owned by ktdreyer 27 kB/s | 2.9 kB 00:00 2020-11-16T20:50:22.623 INFO:teuthology.orchestra.run.smithi059.stdout:Copr repo for ceph-el8 owned by ktdreyer 39 kB/s | 2.9 kB 00:00 2020-11-16T20:50:22.993 INFO:teuthology.orchestra.run.smithi166.stdout:Extra Packages for Enterprise Linux 20 MB/s | 8.3 MB 00:00 2020-11-16T20:50:22.997 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 24 MB/s | 8.3 MB 00:00 2020-11-16T20:50:24.652 INFO:teuthology.orchestra.run.smithi166.stdout:lab-extras 4.0 MB/s | 23 kB 00:00 2020-11-16T20:50:24.759 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 4.3 MB/s | 23 kB 00:00 2020-11-16T20:50:24.921 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 116 MB/s | 25 MB 00:00 2020-11-16T20:50:25.091 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 91 MB/s | 25 MB 00:00 2020-11-16T20:50:28.638 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 99 MB/s | 24 MB 00:00 2020-11-16T20:50:29.026 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 87 MB/s | 24 MB 00:00 2020-11-16T20:50:34.919 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:50:34.930 INFO:teuthology.orchestra.run.smithi166.stdout:==================================================================================================== 2020-11-16T20:50:34.930 INFO:teuthology.orchestra.run.smithi166.stdout: Package Arch Version Repository Size 2020-11-16T20:50:34.931 INFO:teuthology.orchestra.run.smithi166.stdout:==================================================================================================== 2020-11-16T20:50:34.931 INFO:teuthology.orchestra.run.smithi166.stdout:Installing: 2020-11-16T20:50:34.931 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-radosgw x86_64 2:16.0.0-7219.g911cc357.el8 ceph 12 M 2020-11-16T20:50:34.931 INFO:teuthology.orchestra.run.smithi166.stdout:Upgrading: 2020-11-16T20:50:34.931 INFO:teuthology.orchestra.run.smithi166.stdout: librados2 x86_64 2:16.0.0-7219.g911cc357.el8 ceph 3.7 M 2020-11-16T20:50:34.931 INFO:teuthology.orchestra.run.smithi166.stdout: librbd1 x86_64 2:16.0.0-7219.g911cc357.el8 ceph 2.4 M 2020-11-16T20:50:34.932 INFO:teuthology.orchestra.run.smithi166.stdout:Installing dependencies: 2020-11-16T20:50:34.932 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-base x86_64 2:16.0.0-7219.g911cc357.el8 ceph 5.9 M 2020-11-16T20:50:34.932 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-common x86_64 2:16.0.0-7219.g911cc357.el8 ceph 23 M 2020-11-16T20:50:34.932 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-selinux x86_64 2:16.0.0-7219.g911cc357.el8 ceph 25 k 2020-11-16T20:50:34.932 INFO:teuthology.orchestra.run.smithi166.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2020-11-16T20:50:34.932 INFO:teuthology.orchestra.run.smithi166.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-11-16T20:50:34.932 INFO:teuthology.orchestra.run.smithi166.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-11-16T20:50:34.932 INFO:teuthology.orchestra.run.smithi166.stdout: libcephfs2 x86_64 2:16.0.0-7219.g911cc357.el8 ceph 554 k 2020-11-16T20:50:34.933 INFO:teuthology.orchestra.run.smithi166.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-11-16T20:50:34.933 INFO:teuthology.orchestra.run.smithi166.stdout: librabbitmq x86_64 0.9.0-2.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2020-11-16T20:50:34.933 INFO:teuthology.orchestra.run.smithi166.stdout: libradosstriper1 x86_64 2:16.0.0-7219.g911cc357.el8 ceph 480 k 2020-11-16T20:50:34.933 INFO:teuthology.orchestra.run.smithi166.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2020-11-16T20:50:34.933 INFO:teuthology.orchestra.run.smithi166.stdout: librgw2 x86_64 2:16.0.0-7219.g911cc357.el8 ceph 3.7 M 2020-11-16T20:50:34.933 INFO:teuthology.orchestra.run.smithi166.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-11-16T20:50:34.933 INFO:teuthology.orchestra.run.smithi166.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2020-11-16T20:50:34.934 INFO:teuthology.orchestra.run.smithi166.stdout: python3-ceph-argparse x86_64 2:16.0.0-7219.g911cc357.el8 ceph 40 k 2020-11-16T20:50:34.934 INFO:teuthology.orchestra.run.smithi166.stdout: python3-ceph-common x86_64 2:16.0.0-7219.g911cc357.el8 ceph 73 k 2020-11-16T20:50:34.934 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cephfs x86_64 2:16.0.0-7219.g911cc357.el8 ceph 204 k 2020-11-16T20:50:34.934 INFO:teuthology.orchestra.run.smithi166.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2020-11-16T20:50:34.934 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rados x86_64 2:16.0.0-7219.g911cc357.el8 ceph 375 k 2020-11-16T20:50:34.934 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rbd x86_64 2:16.0.0-7219.g911cc357.el8 ceph 353 k 2020-11-16T20:50:34.934 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rgw x86_64 2:16.0.0-7219.g911cc357.el8 ceph 113 k 2020-11-16T20:50:34.935 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:50:34.935 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction Summary 2020-11-16T20:50:34.935 INFO:teuthology.orchestra.run.smithi166.stdout:==================================================================================================== 2020-11-16T20:50:34.935 INFO:teuthology.orchestra.run.smithi166.stdout:Install 22 Packages 2020-11-16T20:50:34.935 INFO:teuthology.orchestra.run.smithi166.stdout:Upgrade 2 Packages 2020-11-16T20:50:34.935 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:50:34.936 INFO:teuthology.orchestra.run.smithi166.stdout:Total download size: 54 M 2020-11-16T20:50:34.936 INFO:teuthology.orchestra.run.smithi166.stdout:Downloading Packages: 2020-11-16T20:50:35.649 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:50:35.654 INFO:teuthology.orchestra.run.smithi166.stdout:(1/24): ceph-base-16.0.0-7219.g911cc357.el8.x86 8.2 MB/s | 5.9 MB 00:00 2020-11-16T20:50:35.665 INFO:teuthology.orchestra.run.smithi059.stdout:==================================================================================================== 2020-11-16T20:50:35.665 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2020-11-16T20:50:35.665 INFO:teuthology.orchestra.run.smithi059.stdout:==================================================================================================== 2020-11-16T20:50:35.665 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2020-11-16T20:50:35.665 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw x86_64 2:16.0.0-7219.g911cc357.el8 ceph 12 M 2020-11-16T20:50:35.666 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrading: 2020-11-16T20:50:35.666 INFO:teuthology.orchestra.run.smithi059.stdout: librados2 x86_64 2:16.0.0-7219.g911cc357.el8 ceph 3.7 M 2020-11-16T20:50:35.666 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1 x86_64 2:16.0.0-7219.g911cc357.el8 ceph 2.4 M 2020-11-16T20:50:35.666 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2020-11-16T20:50:35.666 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base x86_64 2:16.0.0-7219.g911cc357.el8 ceph 5.9 M 2020-11-16T20:50:35.667 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common x86_64 2:16.0.0-7219.g911cc357.el8 ceph 23 M 2020-11-16T20:50:35.667 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux x86_64 2:16.0.0-7219.g911cc357.el8 ceph 25 k 2020-11-16T20:50:35.667 INFO:teuthology.orchestra.run.smithi059.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2020-11-16T20:50:35.667 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-11-16T20:50:35.667 INFO:teuthology.orchestra.run.smithi059.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-11-16T20:50:35.667 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2 x86_64 2:16.0.0-7219.g911cc357.el8 ceph 554 k 2020-11-16T20:50:35.667 INFO:teuthology.orchestra.run.smithi059.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-11-16T20:50:35.668 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq x86_64 0.9.0-2.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2020-11-16T20:50:35.668 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1 x86_64 2:16.0.0-7219.g911cc357.el8 ceph 480 k 2020-11-16T20:50:35.668 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2020-11-16T20:50:35.668 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2 x86_64 2:16.0.0-7219.g911cc357.el8 ceph 3.7 M 2020-11-16T20:50:35.668 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-11-16T20:50:35.668 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2020-11-16T20:50:35.668 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse x86_64 2:16.0.0-7219.g911cc357.el8 ceph 40 k 2020-11-16T20:50:35.669 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common x86_64 2:16.0.0-7219.g911cc357.el8 ceph 73 k 2020-11-16T20:50:35.669 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs x86_64 2:16.0.0-7219.g911cc357.el8 ceph 204 k 2020-11-16T20:50:35.669 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2020-11-16T20:50:35.669 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados x86_64 2:16.0.0-7219.g911cc357.el8 ceph 375 k 2020-11-16T20:50:35.669 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd x86_64 2:16.0.0-7219.g911cc357.el8 ceph 353 k 2020-11-16T20:50:35.669 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw x86_64 2:16.0.0-7219.g911cc357.el8 ceph 113 k 2020-11-16T20:50:35.669 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:50:35.669 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2020-11-16T20:50:35.670 INFO:teuthology.orchestra.run.smithi059.stdout:==================================================================================================== 2020-11-16T20:50:35.670 INFO:teuthology.orchestra.run.smithi059.stdout:Install 22 Packages 2020-11-16T20:50:35.670 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrade 2 Packages 2020-11-16T20:50:35.670 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:50:35.671 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 54 M 2020-11-16T20:50:35.671 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2020-11-16T20:50:35.697 INFO:teuthology.orchestra.run.smithi166.stdout:(2/24): ceph-selinux-16.0.0-7219.g911cc357.el8. 588 kB/s | 25 kB 00:00 2020-11-16T20:50:35.755 INFO:teuthology.orchestra.run.smithi166.stdout:(3/24): libcephfs2-16.0.0-7219.g911cc357.el8.x8 9.4 MB/s | 554 kB 00:00 2020-11-16T20:50:35.812 INFO:teuthology.orchestra.run.smithi166.stdout:(4/24): libradosstriper1-16.0.0-7219.g911cc357. 8.3 MB/s | 480 kB 00:00 2020-11-16T20:50:36.201 INFO:teuthology.orchestra.run.smithi166.stdout:(5/24): librgw2-16.0.0-7219.g911cc357.el8.x86_6 9.4 MB/s | 3.7 MB 00:00 2020-11-16T20:50:36.249 INFO:teuthology.orchestra.run.smithi166.stdout:(6/24): python3-ceph-argparse-16.0.0-7219.g911c 836 kB/s | 40 kB 00:00 2020-11-16T20:50:36.299 INFO:teuthology.orchestra.run.smithi166.stdout:(7/24): python3-ceph-common-16.0.0-7219.g911cc3 1.4 MB/s | 73 kB 00:00 2020-11-16T20:50:36.355 INFO:teuthology.orchestra.run.smithi166.stdout:(8/24): python3-cephfs-16.0.0-7219.g911cc357.el 3.6 MB/s | 204 kB 00:00 2020-11-16T20:50:36.417 INFO:teuthology.orchestra.run.smithi166.stdout:(9/24): python3-rados-16.0.0-7219.g911cc357.el8 5.8 MB/s | 375 kB 00:00 2020-11-16T20:50:36.480 INFO:teuthology.orchestra.run.smithi166.stdout:(10/24): python3-rbd-16.0.0-7219.g911cc357.el8. 5.6 MB/s | 353 kB 00:00 2020-11-16T20:50:36.533 INFO:teuthology.orchestra.run.smithi166.stdout:(11/24): python3-rgw-16.0.0-7219.g911cc357.el8. 2.1 MB/s | 113 kB 00:00 2020-11-16T20:50:36.631 INFO:teuthology.orchestra.run.smithi166.stdout:(12/24): fmt-6.2.1-1.el8.x86_64.rpm 1.2 MB/s | 116 kB 00:00 2020-11-16T20:50:36.671 INFO:teuthology.orchestra.run.smithi166.stdout:(13/24): gperftools-libs-2.7-6.el8.x86_64.rpm 7.6 MB/s | 315 kB 00:00 2020-11-16T20:50:36.702 INFO:teuthology.orchestra.run.smithi166.stdout:(14/24): ceph-radosgw-16.0.0-7219.g911cc357.el8 6.6 MB/s | 12 MB 00:01 2020-11-16T20:50:36.757 INFO:teuthology.orchestra.run.smithi166.stdout:(15/24): leveldb-1.22-1.el8.x86_64.rpm 2.1 MB/s | 181 kB 00:00 2020-11-16T20:50:36.777 INFO:teuthology.orchestra.run.smithi166.stdout:(16/24): libunwind-1.3.1-3.el8.x86_64.rpm 3.6 MB/s | 75 kB 00:00 2020-11-16T20:50:36.805 INFO:teuthology.orchestra.run.smithi166.stdout:(17/24): liboath-2.6.2-3.el8.x86_64.rpm 569 kB/s | 59 kB 00:00 2020-11-16T20:50:36.813 INFO:teuthology.orchestra.run.smithi166.stdout:(18/24): librabbitmq-0.9.0-2.el8.x86_64.rpm 1.3 MB/s | 47 kB 00:00 2020-11-16T20:50:36.973 INFO:teuthology.orchestra.run.smithi166.stdout:(19/24): ceph-common-16.0.0-7219.g911cc357.el8. 11 MB/s | 23 MB 00:02 2020-11-16T20:50:36.989 INFO:teuthology.orchestra.run.smithi166.stdout:(20/24): python3-prettytable-0.7.2-14.el8.noarc 239 kB/s | 44 kB 00:00 2020-11-16T20:50:36.998 INFO:teuthology.orchestra.run.smithi166.stdout:(21/24): librdkafka-0.11.4-1.el8.x86_64.rpm 1.9 MB/s | 353 kB 00:00 2020-11-16T20:50:37.012 INFO:teuthology.orchestra.run.smithi166.stdout:(22/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 7.2 MB/s | 259 kB 00:00 2020-11-16T20:50:37.206 INFO:teuthology.orchestra.run.smithi166.stdout:(23/24): librbd1-16.0.0-7219.g911cc357.el8.x86_ 11 MB/s | 2.4 MB 00:00 2020-11-16T20:50:37.321 INFO:teuthology.orchestra.run.smithi166.stdout:(24/24): librados2-16.0.0-7219.g911cc357.el8.x8 11 MB/s | 3.7 MB 00:00 2020-11-16T20:50:37.325 INFO:teuthology.orchestra.run.smithi166.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:50:37.325 INFO:teuthology.orchestra.run.smithi166.stdout:Total 22 MB/s | 54 MB 00:02 2020-11-16T20:50:37.329 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction check 2020-11-16T20:50:37.372 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction check succeeded. 2020-11-16T20:50:37.373 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction test 2020-11-16T20:50:37.575 INFO:teuthology.orchestra.run.smithi059.stdout:(1/24): ceph-base-16.0.0-7219.g911cc357.el8.x86 3.1 MB/s | 5.9 MB 00:01 2020-11-16T20:50:37.606 INFO:teuthology.orchestra.run.smithi059.stdout:(2/24): ceph-selinux-16.0.0-7219.g911cc357.el8. 809 kB/s | 25 kB 00:00 2020-11-16T20:50:37.670 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction test succeeded. 2020-11-16T20:50:37.674 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction 2020-11-16T20:50:37.679 INFO:teuthology.orchestra.run.smithi059.stdout:(3/24): libcephfs2-16.0.0-7219.g911cc357.el8.x8 7.4 MB/s | 554 kB 00:00 2020-11-16T20:50:37.756 INFO:teuthology.orchestra.run.smithi059.stdout:(4/24): libradosstriper1-16.0.0-7219.g911cc357. 6.1 MB/s | 480 kB 00:00 2020-11-16T20:50:38.183 INFO:teuthology.orchestra.run.smithi059.stdout:(5/24): ceph-radosgw-16.0.0-7219.g911cc357.el8. 4.7 MB/s | 12 MB 00:02 2020-11-16T20:50:38.247 INFO:teuthology.orchestra.run.smithi059.stdout:(6/24): librgw2-16.0.0-7219.g911cc357.el8.x86_6 7.5 MB/s | 3.7 MB 00:00 2020-11-16T20:50:38.247 INFO:teuthology.orchestra.run.smithi059.stdout:(7/24): python3-ceph-argparse-16.0.0-7219.g911c 618 kB/s | 40 kB 00:00 2020-11-16T20:50:38.271 INFO:teuthology.orchestra.run.smithi059.stdout:(8/24): python3-ceph-common-16.0.0-7219.g911cc3 3.0 MB/s | 73 kB 00:00 2020-11-16T20:50:38.274 INFO:teuthology.orchestra.run.smithi059.stdout:(9/24): python3-cephfs-16.0.0-7219.g911cc357.el 7.4 MB/s | 204 kB 00:00 2020-11-16T20:50:38.315 INFO:teuthology.orchestra.run.smithi059.stdout:(10/24): python3-rados-16.0.0-7219.g911cc357.el 8.3 MB/s | 375 kB 00:00 2020-11-16T20:50:38.327 INFO:teuthology.orchestra.run.smithi059.stdout:(11/24): python3-rbd-16.0.0-7219.g911cc357.el8. 6.5 MB/s | 353 kB 00:00 2020-11-16T20:50:38.359 INFO:teuthology.orchestra.run.smithi059.stdout:(12/24): python3-rgw-16.0.0-7219.g911cc357.el8. 2.5 MB/s | 113 kB 00:00 2020-11-16T20:50:38.425 INFO:teuthology.orchestra.run.smithi059.stdout:(13/24): fmt-6.2.1-1.el8.x86_64.rpm 1.2 MB/s | 116 kB 00:00 2020-11-16T20:50:38.456 INFO:teuthology.orchestra.run.smithi059.stdout:(14/24): gperftools-libs-2.7-6.el8.x86_64.rpm 3.2 MB/s | 315 kB 00:00 2020-11-16T20:50:38.464 INFO:teuthology.orchestra.run.smithi059.stdout:(15/24): leveldb-1.22-1.el8.x86_64.rpm 4.5 MB/s | 181 kB 00:00 2020-11-16T20:50:38.473 INFO:teuthology.orchestra.run.smithi059.stdout:(16/24): liboath-2.6.2-3.el8.x86_64.rpm 3.5 MB/s | 59 kB 00:00 2020-11-16T20:50:38.485 INFO:teuthology.orchestra.run.smithi059.stdout:(17/24): libunwind-1.3.1-3.el8.x86_64.rpm 3.6 MB/s | 75 kB 00:00 2020-11-16T20:50:38.519 INFO:teuthology.orchestra.run.smithi059.stdout:(18/24): librabbitmq-0.9.0-2.el8.x86_64.rpm 1.0 MB/s | 47 kB 00:00 2020-11-16T20:50:38.535 INFO:teuthology.orchestra.run.smithi059.stdout:(19/24): python3-prettytable-0.7.2-14.el8.noarc 885 kB/s | 44 kB 00:00 2020-11-16T20:50:38.561 INFO:teuthology.orchestra.run.smithi059.stdout:(20/24): librdkafka-0.11.4-1.el8.x86_64.rpm 8.4 MB/s | 353 kB 00:00 2020-11-16T20:50:38.568 INFO:teuthology.orchestra.run.smithi059.stdout:(21/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 7.8 MB/s | 259 kB 00:00 2020-11-16T20:50:38.743 INFO:teuthology.orchestra.run.smithi166.stdout: Preparing : 1/1 2020-11-16T20:50:38.763 INFO:teuthology.orchestra.run.smithi059.stdout:(22/24): ceph-common-16.0.0-7219.g911cc357.el8. 7.3 MB/s | 23 MB 00:03 2020-11-16T20:50:38.864 INFO:teuthology.orchestra.run.smithi059.stdout:(23/24): librbd1-16.0.0-7219.g911cc357.el8.x86_ 8.0 MB/s | 2.4 MB 00:00 2020-11-16T20:50:38.898 INFO:teuthology.orchestra.run.smithi059.stdout:(24/24): librados2-16.0.0-7219.g911cc357.el8.x8 11 MB/s | 3.7 MB 00:00 2020-11-16T20:50:38.901 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:50:38.902 INFO:teuthology.orchestra.run.smithi059.stdout:Total 17 MB/s | 54 MB 00:03 2020-11-16T20:50:38.906 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2020-11-16T20:50:38.921 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2020-11-16T20:50:38.954 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2020-11-16T20:50:38.955 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2020-11-16T20:50:39.134 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/26 2020-11-16T20:50:39.478 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2020-11-16T20:50:39.482 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2020-11-16T20:50:39.536 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/26 2020-11-16T20:50:39.676 INFO:teuthology.orchestra.run.smithi166.stdout: Upgrading : librados2-2:16.0.0-7219.g911cc357.el8.x86_64 3/26 2020-11-16T20:50:39.758 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: librados2-2:16.0.0-7219.g911cc357.el8.x86_64 3/26 2020-11-16T20:50:39.899 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-rados-2:16.0.0-7219.g911cc357.el8.x86_64 4/26 2020-11-16T20:50:40.086 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/26 2020-11-16T20:50:40.217 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libcephfs2-2:16.0.0-7219.g911cc357.el8.x86_64 6/26 2020-11-16T20:50:40.466 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: libcephfs2-2:16.0.0-7219.g911cc357.el8.x86_64 6/26 2020-11-16T20:50:40.618 INFO:teuthology.orchestra.run.smithi166.stdout: Upgrading : librbd1-2:16.0.0-7219.g911cc357.el8.x86_64 7/26 2020-11-16T20:50:40.656 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2020-11-16T20:50:40.717 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: librbd1-2:16.0.0-7219.g911cc357.el8.x86_64 7/26 2020-11-16T20:50:40.834 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/26 2020-11-16T20:50:40.865 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2020-11-16T20:50:40.940 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/26 2020-11-16T20:50:41.019 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/26 2020-11-16T20:50:41.396 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 9/26 2020-11-16T20:50:41.460 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/26 2020-11-16T20:50:41.576 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : librgw2-2:16.0.0-7219.g911cc357.el8.x86_64 10/26 2020-11-16T20:50:41.602 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librados2-2:16.0.0-7219.g911cc357.el8.x86_64 3/26 2020-11-16T20:50:41.638 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: librgw2-2:16.0.0-7219.g911cc357.el8.x86_64 10/26 2020-11-16T20:50:41.728 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:16.0.0-7219.g911cc357.el8.x86_64 3/26 2020-11-16T20:50:41.814 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2020-11-16T20:50:41.867 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rados-2:16.0.0-7219.g911cc357.el8.x86_64 4/26 2020-11-16T20:50:41.931 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-ceph-argparse-2:16.0.0-7219.g911cc357.el8. 12/26 2020-11-16T20:50:42.082 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/26 2020-11-16T20:50:42.096 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-cephfs-2:16.0.0-7219.g911cc357.el8.x86_64 13/26 2020-11-16T20:50:42.218 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs2-2:16.0.0-7219.g911cc357.el8.x86_64 6/26 2020-11-16T20:50:42.251 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-rgw-2:16.0.0-7219.g911cc357.el8.x86_64 14/26 2020-11-16T20:50:42.408 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-rbd-2:16.0.0-7219.g911cc357.el8.x86_64 15/26 2020-11-16T20:50:42.513 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephfs2-2:16.0.0-7219.g911cc357.el8.x86_64 6/26 2020-11-16T20:50:42.517 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libradosstriper1-2:16.0.0-7219.g911cc357.el8.x86_6 16/26 2020-11-16T20:50:42.573 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: libradosstriper1-2:16.0.0-7219.g911cc357.el8.x86_6 16/26 2020-11-16T20:50:42.719 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librbd1-2:16.0.0-7219.g911cc357.el8.x86_64 7/26 2020-11-16T20:50:42.752 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 17/26 2020-11-16T20:50:42.804 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:16.0.0-7219.g911cc357.el8.x86_64 7/26 2020-11-16T20:50:42.912 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 18/26 2020-11-16T20:50:43.002 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/26 2020-11-16T20:50:43.059 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/26 2020-11-16T20:50:43.103 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 19/26 2020-11-16T20:50:43.309 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-ceph-common-2:16.0.0-7219.g911cc357.el8.x8 20/26 2020-11-16T20:50:43.559 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 9/26 2020-11-16T20:50:43.693 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librgw2-2:16.0.0-7219.g911cc357.el8.x86_64 10/26 2020-11-16T20:50:43.799 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librgw2-2:16.0.0-7219.g911cc357.el8.x86_64 10/26 2020-11-16T20:50:43.957 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2020-11-16T20:50:44.117 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-argparse-2:16.0.0-7219.g911cc357.el8. 12/26 2020-11-16T20:50:44.257 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cephfs-2:16.0.0-7219.g911cc357.el8.x86_64 13/26 2020-11-16T20:50:44.446 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rgw-2:16.0.0-7219.g911cc357.el8.x86_64 14/26 2020-11-16T20:50:44.620 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rbd-2:16.0.0-7219.g911cc357.el8.x86_64 15/26 2020-11-16T20:50:44.735 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libradosstriper1-2:16.0.0-7219.g911cc357.el8.x86_6 16/26 2020-11-16T20:50:44.810 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libradosstriper1-2:16.0.0-7219.g911cc357.el8.x86_6 16/26 2020-11-16T20:50:45.012 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 17/26 2020-11-16T20:50:45.193 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 18/26 2020-11-16T20:50:45.410 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 19/26 2020-11-16T20:50:45.610 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-common-2:16.0.0-7219.g911cc357.el8.x8 20/26 2020-11-16T20:50:46.524 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-common-2:16.0.0-7219.g911cc357.el8.x86_64 21/26 2020-11-16T20:50:46.742 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-common-2:16.0.0-7219.g911cc357.el8.x86_64 21/26 2020-11-16T20:50:47.431 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-common-2:16.0.0-7219.g911cc357.el8.x86_64 21/26 2020-11-16T20:50:47.681 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-base-2:16.0.0-7219.g911cc357.el8.x86_64 22/26 2020-11-16T20:50:47.776 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-base-2:16.0.0-7219.g911cc357.el8.x86_64 22/26 2020-11-16T20:50:47.942 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-selinux-2:16.0.0-7219.g911cc357.el8.x86_64 23/26 2020-11-16T20:50:49.339 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:16.0.0-7219.g911cc357.el8.x86_64 21/26 2020-11-16T20:50:49.552 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-common-2:16.0.0-7219.g911cc357.el8.x86_64 21/26 2020-11-16T20:50:50.303 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:16.0.0-7219.g911cc357.el8.x86_64 21/26 2020-11-16T20:50:50.558 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-base-2:16.0.0-7219.g911cc357.el8.x86_64 22/26 2020-11-16T20:50:50.692 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-base-2:16.0.0-7219.g911cc357.el8.x86_64 22/26 2020-11-16T20:50:50.826 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-selinux-2:16.0.0-7219.g911cc357.el8.x86_64 23/26 2020-11-16T20:51:04.574 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-selinux-2:16.0.0-7219.g911cc357.el8.x86_64 23/26 2020-11-16T20:51:04.574 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /sys 2020-11-16T20:51:04.574 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /proc 2020-11-16T20:51:04.575 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /dev 2020-11-16T20:51:04.575 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /run 2020-11-16T20:51:04.575 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /mnt 2020-11-16T20:51:04.575 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /var/tmp 2020-11-16T20:51:04.575 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /home 2020-11-16T20:51:04.575 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /tmp 2020-11-16T20:51:04.575 INFO:teuthology.orchestra.run.smithi166.stdout:skipping the directory /dev 2020-11-16T20:51:04.576 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:51:05.731 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-radosgw-2:16.0.0-7219.g911cc357.el8.x86_64 24/26 2020-11-16T20:51:05.812 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-7219.g911cc357.el8.x86_64 24/26 2020-11-16T20:51:05.812 INFO:teuthology.orchestra.run.smithi166.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2020-11-16T20:51:06.008 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2020-11-16T20:51:06.008 INFO:teuthology.orchestra.run.smithi166.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2020-11-16T20:51:06.678 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2020-11-16T20:51:06.679 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-base-2:16.0.0-7219.g911cc357.el8.x86_64 1/26 2020-11-16T20:51:06.679 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-common-2:16.0.0-7219.g911cc357.el8.x86_64 2/26 2020-11-16T20:51:06.679 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-radosgw-2:16.0.0-7219.g911cc357.el8.x86_64 3/26 2020-11-16T20:51:06.679 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-selinux-2:16.0.0-7219.g911cc357.el8.x86_64 4/26 2020-11-16T20:51:06.679 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libcephfs2-2:16.0.0-7219.g911cc357.el8.x86_64 5/26 2020-11-16T20:51:06.679 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libradosstriper1-2:16.0.0-7219.g911cc357.el8.x86_6 6/26 2020-11-16T20:51:06.679 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : librgw2-2:16.0.0-7219.g911cc357.el8.x86_64 7/26 2020-11-16T20:51:06.680 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-ceph-argparse-2:16.0.0-7219.g911cc357.el8. 8/26 2020-11-16T20:51:06.680 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-ceph-common-2:16.0.0-7219.g911cc357.el8.x8 9/26 2020-11-16T20:51:06.680 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-cephfs-2:16.0.0-7219.g911cc357.el8.x86_64 10/26 2020-11-16T20:51:06.680 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-rados-2:16.0.0-7219.g911cc357.el8.x86_64 11/26 2020-11-16T20:51:06.680 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-rbd-2:16.0.0-7219.g911cc357.el8.x86_64 12/26 2020-11-16T20:51:06.680 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-rgw-2:16.0.0-7219.g911cc357.el8.x86_64 13/26 2020-11-16T20:51:06.680 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 14/26 2020-11-16T20:51:06.681 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 15/26 2020-11-16T20:51:06.681 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : leveldb-1.22-1.el8.x86_64 16/26 2020-11-16T20:51:06.681 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 17/26 2020-11-16T20:51:06.681 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 18/26 2020-11-16T20:51:06.681 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 19/26 2020-11-16T20:51:06.681 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 20/26 2020-11-16T20:51:06.681 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 21/26 2020-11-16T20:51:06.682 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 22/26 2020-11-16T20:51:06.682 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : librados2-2:16.0.0-7219.g911cc357.el8.x86_64 23/26 2020-11-16T20:51:06.682 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2020-11-16T20:51:06.682 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : librbd1-2:16.0.0-7219.g911cc357.el8.x86_64 25/26 2020-11-16T20:51:07.380 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2020-11-16T20:51:07.380 INFO:teuthology.orchestra.run.smithi166.stdout:Installed products updated. 2020-11-16T20:51:08.173 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-selinux-2:16.0.0-7219.g911cc357.el8.x86_64 23/26 2020-11-16T20:51:08.173 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /sys 2020-11-16T20:51:08.173 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /proc 2020-11-16T20:51:08.173 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /dev 2020-11-16T20:51:08.173 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /run 2020-11-16T20:51:08.174 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /mnt 2020-11-16T20:51:08.174 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /var/tmp 2020-11-16T20:51:08.174 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /home 2020-11-16T20:51:08.174 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /tmp 2020-11-16T20:51:08.174 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /dev 2020-11-16T20:51:08.174 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:51:09.415 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-radosgw-2:16.0.0-7219.g911cc357.el8.x86_64 24/26 2020-11-16T20:51:09.509 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-7219.g911cc357.el8.x86_64 24/26 2020-11-16T20:51:09.509 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2020-11-16T20:51:09.702 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:51:09.702 INFO:teuthology.orchestra.run.smithi166.stdout:Upgraded: 2020-11-16T20:51:09.702 INFO:teuthology.orchestra.run.smithi166.stdout: librados2-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:09.702 INFO:teuthology.orchestra.run.smithi166.stdout: librbd1-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:09.702 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:51:09.703 INFO:teuthology.orchestra.run.smithi166.stdout:Installed: 2020-11-16T20:51:09.703 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-base-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:09.703 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-common-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:09.703 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-radosgw-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:09.703 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-selinux-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:09.703 INFO:teuthology.orchestra.run.smithi166.stdout: fmt-6.2.1-1.el8.x86_64 2020-11-16T20:51:09.703 INFO:teuthology.orchestra.run.smithi166.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-11-16T20:51:09.704 INFO:teuthology.orchestra.run.smithi166.stdout: leveldb-1.22-1.el8.x86_64 2020-11-16T20:51:09.704 INFO:teuthology.orchestra.run.smithi166.stdout: libcephfs2-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:09.704 INFO:teuthology.orchestra.run.smithi166.stdout: liboath-2.6.2-3.el8.x86_64 2020-11-16T20:51:09.704 INFO:teuthology.orchestra.run.smithi166.stdout: librabbitmq-0.9.0-2.el8.x86_64 2020-11-16T20:51:09.704 INFO:teuthology.orchestra.run.smithi166.stdout: libradosstriper1-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:09.704 INFO:teuthology.orchestra.run.smithi166.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-11-16T20:51:09.704 INFO:teuthology.orchestra.run.smithi166.stdout: librgw2-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:09.705 INFO:teuthology.orchestra.run.smithi166.stdout: libunwind-1.3.1-3.el8.x86_64 2020-11-16T20:51:09.705 INFO:teuthology.orchestra.run.smithi166.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-11-16T20:51:09.705 INFO:teuthology.orchestra.run.smithi166.stdout: python3-ceph-argparse-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:09.705 INFO:teuthology.orchestra.run.smithi166.stdout: python3-ceph-common-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:09.705 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cephfs-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:09.705 INFO:teuthology.orchestra.run.smithi166.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-11-16T20:51:09.705 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rados-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:09.705 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rbd-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:09.706 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rgw-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:09.706 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:51:09.706 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:51:09.826 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install ceph-test 2020-11-16T20:51:10.067 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2020-11-16T20:51:10.068 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2020-11-16T20:51:10.173 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:51:10.678 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 84 kB/s | 2.4 kB 00:00 2020-11-16T20:51:10.754 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2020-11-16T20:51:10.754 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-base-2:16.0.0-7219.g911cc357.el8.x86_64 1/26 2020-11-16T20:51:10.755 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-common-2:16.0.0-7219.g911cc357.el8.x86_64 2/26 2020-11-16T20:51:10.755 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-radosgw-2:16.0.0-7219.g911cc357.el8.x86_64 3/26 2020-11-16T20:51:10.755 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-selinux-2:16.0.0-7219.g911cc357.el8.x86_64 4/26 2020-11-16T20:51:10.755 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs2-2:16.0.0-7219.g911cc357.el8.x86_64 5/26 2020-11-16T20:51:10.755 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libradosstriper1-2:16.0.0-7219.g911cc357.el8.x86_6 6/26 2020-11-16T20:51:10.755 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librgw2-2:16.0.0-7219.g911cc357.el8.x86_64 7/26 2020-11-16T20:51:10.755 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-argparse-2:16.0.0-7219.g911cc357.el8. 8/26 2020-11-16T20:51:10.756 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-common-2:16.0.0-7219.g911cc357.el8.x8 9/26 2020-11-16T20:51:10.756 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cephfs-2:16.0.0-7219.g911cc357.el8.x86_64 10/26 2020-11-16T20:51:10.756 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rados-2:16.0.0-7219.g911cc357.el8.x86_64 11/26 2020-11-16T20:51:10.756 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rbd-2:16.0.0-7219.g911cc357.el8.x86_64 12/26 2020-11-16T20:51:10.756 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rgw-2:16.0.0-7219.g911cc357.el8.x86_64 13/26 2020-11-16T20:51:10.756 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 14/26 2020-11-16T20:51:10.756 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 15/26 2020-11-16T20:51:10.757 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : leveldb-1.22-1.el8.x86_64 16/26 2020-11-16T20:51:10.757 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 17/26 2020-11-16T20:51:10.757 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 18/26 2020-11-16T20:51:10.757 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 19/26 2020-11-16T20:51:10.757 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 20/26 2020-11-16T20:51:10.757 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 21/26 2020-11-16T20:51:10.757 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 22/26 2020-11-16T20:51:10.758 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:16.0.0-7219.g911cc357.el8.x86_64 23/26 2020-11-16T20:51:10.758 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2020-11-16T20:51:10.758 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:16.0.0-7219.g911cc357.el8.x86_64 25/26 2020-11-16T20:51:10.775 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 98 kB/s | 2.8 kB 00:00 2020-11-16T20:51:11.565 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2020-11-16T20:51:11.565 INFO:teuthology.orchestra.run.smithi059.stdout:Installed products updated. 2020-11-16T20:51:12.137 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:51:12.138 INFO:teuthology.orchestra.run.smithi166.stdout:========================================================================================= 2020-11-16T20:51:12.139 INFO:teuthology.orchestra.run.smithi166.stdout: Package Arch Version Repository Size 2020-11-16T20:51:12.139 INFO:teuthology.orchestra.run.smithi166.stdout:========================================================================================= 2020-11-16T20:51:12.139 INFO:teuthology.orchestra.run.smithi166.stdout:Installing: 2020-11-16T20:51:12.139 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-test x86_64 2:16.0.0-7219.g911cc357.el8 ceph 47 M 2020-11-16T20:51:12.139 INFO:teuthology.orchestra.run.smithi166.stdout:Installing dependencies: 2020-11-16T20:51:12.139 INFO:teuthology.orchestra.run.smithi166.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2020-11-16T20:51:12.139 INFO:teuthology.orchestra.run.smithi166.stdout: libxslt x86_64 1.1.32-5.el8 rhel-8-for-x86_64-baseos-rpms 250 k 2020-11-16T20:51:12.140 INFO:teuthology.orchestra.run.smithi166.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2020-11-16T20:51:12.140 INFO:teuthology.orchestra.run.smithi166.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2020-11-16T20:51:12.140 INFO:teuthology.orchestra.run.smithi166.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-11-16T20:51:12.140 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:51:12.140 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction Summary 2020-11-16T20:51:12.140 INFO:teuthology.orchestra.run.smithi166.stdout:========================================================================================= 2020-11-16T20:51:12.140 INFO:teuthology.orchestra.run.smithi166.stdout:Install 6 Packages 2020-11-16T20:51:12.141 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:51:12.141 INFO:teuthology.orchestra.run.smithi166.stdout:Total download size: 48 M 2020-11-16T20:51:12.141 INFO:teuthology.orchestra.run.smithi166.stdout:Installed size: 173 M 2020-11-16T20:51:12.141 INFO:teuthology.orchestra.run.smithi166.stdout:Downloading Packages: 2020-11-16T20:51:12.171 INFO:teuthology.orchestra.run.smithi166.stdout:(1/6): libxslt-1.1.32-5.el8.x86_64.rpm 7.9 MB/s | 250 kB 00:00 2020-11-16T20:51:12.192 INFO:teuthology.orchestra.run.smithi166.stdout:(2/6): jq-1.5-12.el8.x86_64.rpm 7.9 MB/s | 161 kB 00:00 2020-11-16T20:51:12.206 INFO:teuthology.orchestra.run.smithi166.stdout:(3/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 1.0 MB/s | 69 kB 00:00 2020-11-16T20:51:12.215 INFO:teuthology.orchestra.run.smithi166.stdout:(4/6): socat-1.7.3.3-2.el8.x86_64.rpm 13 MB/s | 302 kB 00:00 2020-11-16T20:51:12.235 INFO:teuthology.orchestra.run.smithi166.stdout:(5/6): oniguruma-6.8.2-2.el8.x86_64.rpm 6.3 MB/s | 187 kB 00:00 2020-11-16T20:51:13.909 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:51:13.909 INFO:teuthology.orchestra.run.smithi059.stdout:Upgraded: 2020-11-16T20:51:13.909 INFO:teuthology.orchestra.run.smithi059.stdout: librados2-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:13.909 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:13.910 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:51:13.910 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2020-11-16T20:51:13.910 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:13.910 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:13.910 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:13.910 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:13.911 INFO:teuthology.orchestra.run.smithi059.stdout: fmt-6.2.1-1.el8.x86_64 2020-11-16T20:51:13.911 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-11-16T20:51:13.911 INFO:teuthology.orchestra.run.smithi059.stdout: leveldb-1.22-1.el8.x86_64 2020-11-16T20:51:13.911 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:13.911 INFO:teuthology.orchestra.run.smithi059.stdout: liboath-2.6.2-3.el8.x86_64 2020-11-16T20:51:13.911 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq-0.9.0-2.el8.x86_64 2020-11-16T20:51:13.911 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:13.912 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-11-16T20:51:13.912 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:13.912 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind-1.3.1-3.el8.x86_64 2020-11-16T20:51:13.912 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-11-16T20:51:13.912 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:13.912 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:13.913 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:13.913 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-11-16T20:51:13.913 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:13.913 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:13.913 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:13.913 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:51:13.914 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:51:14.067 INFO:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-test 2020-11-16T20:51:14.332 INFO:teuthology.orchestra.run.smithi166.stdout:(6/6): ceph-test-16.0.0-7219.g911cc357.el8.x86_ 21 MB/s | 47 MB 00:02 2020-11-16T20:51:14.334 INFO:teuthology.orchestra.run.smithi166.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:51:14.334 INFO:teuthology.orchestra.run.smithi166.stdout:Total 22 MB/s | 48 MB 00:02 2020-11-16T20:51:14.339 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction check 2020-11-16T20:51:14.361 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction check succeeded. 2020-11-16T20:51:14.362 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction test 2020-11-16T20:51:14.440 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:51:14.615 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction test succeeded. 2020-11-16T20:51:14.618 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction 2020-11-16T20:51:15.015 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 63 kB/s | 2.4 kB 00:00 2020-11-16T20:51:15.071 INFO:teuthology.orchestra.run.smithi166.stdout: Preparing : 1/1 2020-11-16T20:51:15.126 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 76 kB/s | 2.8 kB 00:00 2020-11-16T20:51:15.196 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 1/6 2020-11-16T20:51:15.284 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 1/6 2020-11-16T20:51:15.458 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : jq-1.5-12.el8.x86_64 2/6 2020-11-16T20:51:15.671 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 3/6 2020-11-16T20:51:15.877 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 4/6 2020-11-16T20:51:16.628 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:51:16.629 INFO:teuthology.orchestra.run.smithi059.stdout:========================================================================================= 2020-11-16T20:51:16.629 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2020-11-16T20:51:16.630 INFO:teuthology.orchestra.run.smithi059.stdout:========================================================================================= 2020-11-16T20:51:16.630 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2020-11-16T20:51:16.630 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test x86_64 2:16.0.0-7219.g911cc357.el8 ceph 47 M 2020-11-16T20:51:16.630 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2020-11-16T20:51:16.630 INFO:teuthology.orchestra.run.smithi059.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2020-11-16T20:51:16.630 INFO:teuthology.orchestra.run.smithi059.stdout: libxslt x86_64 1.1.32-5.el8 rhel-8-for-x86_64-baseos-rpms 250 k 2020-11-16T20:51:16.630 INFO:teuthology.orchestra.run.smithi059.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2020-11-16T20:51:16.631 INFO:teuthology.orchestra.run.smithi059.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2020-11-16T20:51:16.631 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-11-16T20:51:16.631 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:51:16.631 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2020-11-16T20:51:16.631 INFO:teuthology.orchestra.run.smithi059.stdout:========================================================================================= 2020-11-16T20:51:16.631 INFO:teuthology.orchestra.run.smithi059.stdout:Install 6 Packages 2020-11-16T20:51:16.631 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:51:16.632 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 48 M 2020-11-16T20:51:16.632 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 173 M 2020-11-16T20:51:16.632 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2020-11-16T20:51:16.677 INFO:teuthology.orchestra.run.smithi059.stdout:(1/6): libxslt-1.1.32-5.el8.x86_64.rpm 5.5 MB/s | 250 kB 00:00 2020-11-16T20:51:16.703 INFO:teuthology.orchestra.run.smithi059.stdout:(2/6): jq-1.5-12.el8.x86_64.rpm 6.0 MB/s | 161 kB 00:00 2020-11-16T20:51:16.712 INFO:teuthology.orchestra.run.smithi059.stdout:(3/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 858 kB/s | 69 kB 00:00 2020-11-16T20:51:16.732 INFO:teuthology.orchestra.run.smithi059.stdout:(4/6): socat-1.7.3.3-2.el8.x86_64.rpm 10 MB/s | 302 kB 00:00 2020-11-16T20:51:16.757 INFO:teuthology.orchestra.run.smithi059.stdout:(5/6): oniguruma-6.8.2-2.el8.x86_64.rpm 4.1 MB/s | 187 kB 00:00 2020-11-16T20:51:18.844 INFO:teuthology.orchestra.run.smithi059.stdout:(6/6): ceph-test-16.0.0-7219.g911cc357.el8.x86_ 21 MB/s | 47 MB 00:02 2020-11-16T20:51:18.846 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:51:18.846 INFO:teuthology.orchestra.run.smithi059.stdout:Total 22 MB/s | 48 MB 00:02 2020-11-16T20:51:18.851 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2020-11-16T20:51:18.876 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2020-11-16T20:51:18.876 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2020-11-16T20:51:19.144 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2020-11-16T20:51:19.148 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2020-11-16T20:51:19.616 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2020-11-16T20:51:19.788 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 1/6 2020-11-16T20:51:19.884 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 1/6 2020-11-16T20:51:20.103 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : jq-1.5-12.el8.x86_64 2/6 2020-11-16T20:51:20.152 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 5/6 2020-11-16T20:51:20.323 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 3/6 2020-11-16T20:51:20.542 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 4/6 2020-11-16T20:51:20.893 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-test-2:16.0.0-7219.g911cc357.el8.x86_64 6/6 2020-11-16T20:51:21.125 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-test-2:16.0.0-7219.g911cc357.el8.x86_64 6/6 2020-11-16T20:51:21.125 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-test-2:16.0.0-7219.g911cc357.el8.x86_64 1/6 2020-11-16T20:51:21.126 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2020-11-16T20:51:21.126 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 3/6 2020-11-16T20:51:21.126 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : jq-1.5-12.el8.x86_64 4/6 2020-11-16T20:51:21.126 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 5/6 2020-11-16T20:51:21.432 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 6/6 2020-11-16T20:51:21.433 INFO:teuthology.orchestra.run.smithi166.stdout:Installed products updated. 2020-11-16T20:51:23.726 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:51:23.726 INFO:teuthology.orchestra.run.smithi166.stdout:Installed: 2020-11-16T20:51:23.726 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-test-2:16.0.0-7219.g911cc357.el8.x86_64 jq-1.5-12.el8.x86_64 2020-11-16T20:51:23.727 INFO:teuthology.orchestra.run.smithi166.stdout: libxslt-1.1.32-5.el8.x86_64 oniguruma-6.8.2-2.el8.x86_64 2020-11-16T20:51:23.727 INFO:teuthology.orchestra.run.smithi166.stdout: socat-1.7.3.3-2.el8.x86_64 xmlstarlet-1.6.1-11.el8.x86_64 2020-11-16T20:51:23.727 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:51:23.727 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:51:23.827 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install ceph 2020-11-16T20:51:24.167 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:51:24.679 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 77 kB/s | 2.4 kB 00:00 2020-11-16T20:51:24.780 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 88 kB/s | 2.8 kB 00:00 2020-11-16T20:51:25.014 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 5/6 2020-11-16T20:51:25.278 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-test-2:16.0.0-7219.g911cc357.el8.x86_64 6/6 2020-11-16T20:51:25.506 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-test-2:16.0.0-7219.g911cc357.el8.x86_64 6/6 2020-11-16T20:51:25.506 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-test-2:16.0.0-7219.g911cc357.el8.x86_64 1/6 2020-11-16T20:51:25.506 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2020-11-16T20:51:25.506 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 3/6 2020-11-16T20:51:25.507 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : jq-1.5-12.el8.x86_64 4/6 2020-11-16T20:51:25.507 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 5/6 2020-11-16T20:51:25.827 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 6/6 2020-11-16T20:51:25.827 INFO:teuthology.orchestra.run.smithi059.stdout:Installed products updated. 2020-11-16T20:51:26.150 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:51:26.153 INFO:teuthology.orchestra.run.smithi166.stdout:======================================================================================================= 2020-11-16T20:51:26.154 INFO:teuthology.orchestra.run.smithi166.stdout: Package Arch Version Repository Size 2020-11-16T20:51:26.154 INFO:teuthology.orchestra.run.smithi166.stdout:======================================================================================================= 2020-11-16T20:51:26.154 INFO:teuthology.orchestra.run.smithi166.stdout:Installing: 2020-11-16T20:51:26.154 INFO:teuthology.orchestra.run.smithi166.stdout: ceph x86_64 2:16.0.0-7219.g911cc357.el8 ceph 6.4 k 2020-11-16T20:51:26.154 INFO:teuthology.orchestra.run.smithi166.stdout:Installing dependencies: 2020-11-16T20:51:26.154 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mds x86_64 2:16.0.0-7219.g911cc357.el8 ceph 2.1 M 2020-11-16T20:51:26.155 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr x86_64 2:16.0.0-7219.g911cc357.el8 ceph 1.5 M 2020-11-16T20:51:26.155 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-modules-core noarch 2:16.0.0-7219.g911cc357.el8 ceph-noarch 198 k 2020-11-16T20:51:26.155 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mon x86_64 2:16.0.0-7219.g911cc357.el8 ceph 4.9 M 2020-11-16T20:51:26.155 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-osd x86_64 2:16.0.0-7219.g911cc357.el8 ceph 18 M 2020-11-16T20:51:26.155 INFO:teuthology.orchestra.run.smithi166.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2020-11-16T20:51:26.155 INFO:teuthology.orchestra.run.smithi166.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2020-11-16T20:51:26.155 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cheroot noarch 8.2.1-1.el8 epel 145 k 2020-11-16T20:51:26.156 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2020-11-16T20:51:26.156 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2020-11-16T20:51:26.156 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2020-11-16T20:51:26.156 INFO:teuthology.orchestra.run.smithi166.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2020-11-16T20:51:26.156 INFO:teuthology.orchestra.run.smithi166.stdout: python3-lxml x86_64 4.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2020-11-16T20:51:26.156 INFO:teuthology.orchestra.run.smithi166.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2020-11-16T20:51:26.156 INFO:teuthology.orchestra.run.smithi166.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2020-11-16T20:51:26.157 INFO:teuthology.orchestra.run.smithi166.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2020-11-16T20:51:26.157 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2020-11-16T20:51:26.157 INFO:teuthology.orchestra.run.smithi166.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2020-11-16T20:51:26.157 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2020-11-16T20:51:26.157 INFO:teuthology.orchestra.run.smithi166.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2020-11-16T20:51:26.157 INFO:teuthology.orchestra.run.smithi166.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2020-11-16T20:51:26.157 INFO:teuthology.orchestra.run.smithi166.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2020-11-16T20:51:26.158 INFO:teuthology.orchestra.run.smithi166.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2020-11-16T20:51:26.158 INFO:teuthology.orchestra.run.smithi166.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2020-11-16T20:51:26.158 INFO:teuthology.orchestra.run.smithi166.stdout: python3-webencodings noarch 0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-16T20:51:26.158 INFO:teuthology.orchestra.run.smithi166.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2020-11-16T20:51:26.158 INFO:teuthology.orchestra.run.smithi166.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2020-11-16T20:51:26.158 INFO:teuthology.orchestra.run.smithi166.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2020-11-16T20:51:26.158 INFO:teuthology.orchestra.run.smithi166.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2020-11-16T20:51:26.159 INFO:teuthology.orchestra.run.smithi166.stdout:Installing weak dependencies: 2020-11-16T20:51:26.159 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2020-11-16T20:51:26.159 INFO:teuthology.orchestra.run.smithi166.stdout: python3-html5lib noarch 1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2020-11-16T20:51:26.159 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:51:26.159 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction Summary 2020-11-16T20:51:26.159 INFO:teuthology.orchestra.run.smithi166.stdout:======================================================================================================= 2020-11-16T20:51:26.159 INFO:teuthology.orchestra.run.smithi166.stdout:Install 32 Packages 2020-11-16T20:51:26.159 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:51:26.160 INFO:teuthology.orchestra.run.smithi166.stdout:Total download size: 31 M 2020-11-16T20:51:26.160 INFO:teuthology.orchestra.run.smithi166.stdout:Installed size: 99 M 2020-11-16T20:51:26.160 INFO:teuthology.orchestra.run.smithi166.stdout:Downloading Packages: 2020-11-16T20:51:26.260 INFO:teuthology.orchestra.run.smithi166.stdout:(1/32): ceph-16.0.0-7219.g911cc357.el8.x86_64.r 63 kB/s | 6.4 kB 00:00 2020-11-16T20:51:26.468 INFO:teuthology.orchestra.run.smithi166.stdout:(2/32): ceph-mgr-16.0.0-7219.g911cc357.el8.x86_ 4.9 MB/s | 1.5 MB 00:00 2020-11-16T20:51:26.504 INFO:teuthology.orchestra.run.smithi166.stdout:(3/32): ceph-mds-16.0.0-7219.g911cc357.el8.x86_ 6.2 MB/s | 2.1 MB 00:00 2020-11-16T20:51:26.563 INFO:teuthology.orchestra.run.smithi166.stdout:(4/32): ceph-mgr-modules-core-16.0.0-7219.g911c 3.3 MB/s | 198 kB 00:00 2020-11-16T20:51:26.641 INFO:teuthology.orchestra.run.smithi166.stdout:(5/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm 559 kB/s | 44 kB 00:00 2020-11-16T20:51:26.699 INFO:teuthology.orchestra.run.smithi166.stdout:(6/32): python3-beautifulsoup4-4.6.3-2.el8.1.no 3.1 MB/s | 185 kB 00:00 2020-11-16T20:51:26.721 INFO:teuthology.orchestra.run.smithi166.stdout:(7/32): python3-cheroot-8.2.1-1.el8.noarch.rpm 6.7 MB/s | 145 kB 00:00 2020-11-16T20:51:26.761 INFO:teuthology.orchestra.run.smithi166.stdout:(8/32): python3-cherrypy-18.4.0-1.el8.noarch.rp 9.5 MB/s | 384 kB 00:00 2020-11-16T20:51:26.780 INFO:teuthology.orchestra.run.smithi166.stdout:(9/32): python3-cssselect-0.9.2-10.el8.noarch.r 2.0 MB/s | 40 kB 00:00 2020-11-16T20:51:26.794 INFO:teuthology.orchestra.run.smithi166.stdout:(10/32): ceph-mon-16.0.0-7219.g911cc357.el8.x86 9.3 MB/s | 4.9 MB 00:00 2020-11-16T20:51:26.800 INFO:teuthology.orchestra.run.smithi166.stdout:(11/32): python3-jaraco-6.2-6.el8.noarch.rpm 569 kB/s | 11 kB 00:00 2020-11-16T20:51:26.820 INFO:teuthology.orchestra.run.smithi166.stdout:(12/32): python3-logutils-0.3.5-11.el8.noarch.r 2.4 MB/s | 49 kB 00:00 2020-11-16T20:51:26.840 INFO:teuthology.orchestra.run.smithi166.stdout:(13/32): python3-more-itertools-7.2.0-3.el8.noa 2.9 MB/s | 59 kB 00:00 2020-11-16T20:51:26.842 INFO:teuthology.orchestra.run.smithi166.stdout:(14/32): python3-jaraco-functools-2.0-4.el8.noa 366 kB/s | 18 kB 00:00 2020-11-16T20:51:26.858 INFO:teuthology.orchestra.run.smithi166.stdout:(15/32): python3-portend-2.6-1.el8.noarch.rpm 962 kB/s | 16 kB 00:00 2020-11-16T20:51:26.862 INFO:teuthology.orchestra.run.smithi166.stdout:(16/32): python3-pecan-1.3.2-9.el8.noarch.rpm 13 MB/s | 283 kB 00:00 2020-11-16T20:51:26.875 INFO:teuthology.orchestra.run.smithi166.stdout:(17/32): python3-simplegeneric-0.8.1-17.el8.noa 1.1 MB/s | 19 kB 00:00 2020-11-16T20:51:26.882 INFO:teuthology.orchestra.run.smithi166.stdout:(18/32): python3-singledispatch-3.4.0.3-18.el8. 1.2 MB/s | 24 kB 00:00 2020-11-16T20:51:26.891 INFO:teuthology.orchestra.run.smithi166.stdout:(19/32): python3-tempora-1.14.1-5.el8.noarch.rp 1.7 MB/s | 29 kB 00:00 2020-11-16T20:51:26.902 INFO:teuthology.orchestra.run.smithi166.stdout:(20/32): python3-trustme-0.6.0-4.el8.noarch.rpm 1.4 MB/s | 27 kB 00:00 2020-11-16T20:51:26.924 INFO:teuthology.orchestra.run.smithi166.stdout:(21/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 11 MB/s | 251 kB 00:00 2020-11-16T20:51:26.940 INFO:teuthology.orchestra.run.smithi166.stdout:(22/32): python3-waitress-1.2.1-2.el8.1.noarch. 4.8 MB/s | 241 kB 00:00 2020-11-16T20:51:26.944 INFO:teuthology.orchestra.run.smithi166.stdout:(23/32): python3-webtest-2.0.33-1.el8.noarch.rp 4.1 MB/s | 85 kB 00:00 2020-11-16T20:51:26.960 INFO:teuthology.orchestra.run.smithi166.stdout:(24/32): python3-zc-lockfile-2.0-2.el8.noarch.r 1.1 MB/s | 23 kB 00:00 2020-11-16T20:51:26.980 INFO:teuthology.orchestra.run.smithi166.stdout:(25/32): python3-webencodings-0.5.1-6.el8.noarc 765 kB/s | 27 kB 00:00 2020-11-16T20:51:27.007 INFO:teuthology.orchestra.run.smithi166.stdout:(26/32): python3-lxml-4.2.3-1.el8.x86_64.rpm 32 MB/s | 1.5 MB 00:00 2020-11-16T20:51:27.015 INFO:teuthology.orchestra.run.smithi166.stdout:(27/32): python3-werkzeug-0.12.2-4.el8.noarch.r 13 MB/s | 457 kB 00:00 2020-11-16T20:51:27.033 INFO:teuthology.orchestra.run.smithi166.stdout:(28/32): python3-mako-1.0.6-13.el8.noarch.rpm 6.0 MB/s | 157 kB 00:00 2020-11-16T20:51:27.043 INFO:teuthology.orchestra.run.smithi166.stdout:(29/32): python3-html5lib-0.999999999-6.el8.noa 7.5 MB/s | 214 kB 00:00 2020-11-16T20:51:27.061 INFO:teuthology.orchestra.run.smithi166.stdout:(30/32): python3-pytz-2017.2-9.el8.noarch.rpm 1.9 MB/s | 54 kB 00:00 2020-11-16T20:51:27.068 INFO:teuthology.orchestra.run.smithi166.stdout:(31/32): python3-markupsafe-0.23-19.el8.x86_64. 1.6 MB/s | 39 kB 00:00 2020-11-16T20:51:27.325 INFO:teuthology.orchestra.run.smithi166.stdout:(32/32): ceph-osd-16.0.0-7219.g911cc357.el8.x86 21 MB/s | 18 MB 00:00 2020-11-16T20:51:27.329 INFO:teuthology.orchestra.run.smithi166.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:51:27.329 INFO:teuthology.orchestra.run.smithi166.stdout:Total 26 MB/s | 31 MB 00:01 2020-11-16T20:51:27.335 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction check 2020-11-16T20:51:27.373 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction check succeeded. 2020-11-16T20:51:27.374 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction test 2020-11-16T20:51:27.610 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction test succeeded. 2020-11-16T20:51:27.613 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction 2020-11-16T20:51:28.272 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:51:28.273 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2020-11-16T20:51:28.273 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test-2:16.0.0-7219.g911cc357.el8.x86_64 jq-1.5-12.el8.x86_64 2020-11-16T20:51:28.273 INFO:teuthology.orchestra.run.smithi059.stdout: libxslt-1.1.32-5.el8.x86_64 oniguruma-6.8.2-2.el8.x86_64 2020-11-16T20:51:28.273 INFO:teuthology.orchestra.run.smithi059.stdout: socat-1.7.3.3-2.el8.x86_64 xmlstarlet-1.6.1-11.el8.x86_64 2020-11-16T20:51:28.273 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:51:28.274 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:51:28.395 INFO:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph 2020-11-16T20:51:28.744 INFO:teuthology.orchestra.run.smithi166.stdout: Preparing : 1/1 2020-11-16T20:51:28.760 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:51:28.997 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2020-11-16T20:51:29.174 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2020-11-16T20:51:29.331 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 63 kB/s | 2.4 kB 00:00 2020-11-16T20:51:29.377 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 3/32 2020-11-16T20:51:29.440 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 76 kB/s | 2.8 kB 00:00 2020-11-16T20:51:29.623 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 4/32 2020-11-16T20:51:29.841 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 5/32 2020-11-16T20:51:30.056 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 6/32 2020-11-16T20:51:30.258 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 7/32 2020-11-16T20:51:30.419 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 8/32 2020-11-16T20:51:30.642 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 9/32 2020-11-16T20:51:30.844 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 10/32 2020-11-16T20:51:30.980 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:51:30.984 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================================= 2020-11-16T20:51:30.984 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2020-11-16T20:51:30.984 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================================= 2020-11-16T20:51:30.985 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2020-11-16T20:51:30.985 INFO:teuthology.orchestra.run.smithi059.stdout: ceph x86_64 2:16.0.0-7219.g911cc357.el8 ceph 6.4 k 2020-11-16T20:51:30.985 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2020-11-16T20:51:30.985 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds x86_64 2:16.0.0-7219.g911cc357.el8 ceph 2.1 M 2020-11-16T20:51:30.985 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr x86_64 2:16.0.0-7219.g911cc357.el8 ceph 1.5 M 2020-11-16T20:51:30.985 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core noarch 2:16.0.0-7219.g911cc357.el8 ceph-noarch 198 k 2020-11-16T20:51:30.985 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon x86_64 2:16.0.0-7219.g911cc357.el8 ceph 4.9 M 2020-11-16T20:51:30.986 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd x86_64 2:16.0.0-7219.g911cc357.el8 ceph 18 M 2020-11-16T20:51:30.986 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2020-11-16T20:51:30.986 INFO:teuthology.orchestra.run.smithi059.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2020-11-16T20:51:30.986 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot noarch 8.2.1-1.el8 epel 145 k 2020-11-16T20:51:30.986 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2020-11-16T20:51:30.986 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2020-11-16T20:51:30.986 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2020-11-16T20:51:30.987 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2020-11-16T20:51:30.987 INFO:teuthology.orchestra.run.smithi059.stdout: python3-lxml x86_64 4.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2020-11-16T20:51:30.987 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2020-11-16T20:51:30.987 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2020-11-16T20:51:30.987 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2020-11-16T20:51:30.987 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2020-11-16T20:51:30.987 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2020-11-16T20:51:30.988 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2020-11-16T20:51:30.988 INFO:teuthology.orchestra.run.smithi059.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2020-11-16T20:51:30.988 INFO:teuthology.orchestra.run.smithi059.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2020-11-16T20:51:30.988 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2020-11-16T20:51:30.988 INFO:teuthology.orchestra.run.smithi059.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2020-11-16T20:51:30.988 INFO:teuthology.orchestra.run.smithi059.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2020-11-16T20:51:30.988 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webencodings noarch 0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-16T20:51:30.989 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2020-11-16T20:51:30.989 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2020-11-16T20:51:30.989 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2020-11-16T20:51:30.989 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2020-11-16T20:51:30.989 INFO:teuthology.orchestra.run.smithi059.stdout:Installing weak dependencies: 2020-11-16T20:51:30.989 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2020-11-16T20:51:30.989 INFO:teuthology.orchestra.run.smithi059.stdout: python3-html5lib noarch 1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2020-11-16T20:51:30.989 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:51:30.990 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2020-11-16T20:51:30.990 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================================= 2020-11-16T20:51:30.990 INFO:teuthology.orchestra.run.smithi059.stdout:Install 32 Packages 2020-11-16T20:51:30.990 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:51:30.991 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 31 M 2020-11-16T20:51:30.991 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 99 M 2020-11-16T20:51:30.991 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2020-11-16T20:51:31.001 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 11/32 2020-11-16T20:51:31.091 INFO:teuthology.orchestra.run.smithi059.stdout:(1/32): ceph-16.0.0-7219.g911cc357.el8.x86_64.r 64 kB/s | 6.4 kB 00:00 2020-11-16T20:51:31.182 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 12/32 2020-11-16T20:51:31.331 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 13/32 2020-11-16T20:51:31.338 INFO:teuthology.orchestra.run.smithi059.stdout:(2/32): ceph-mds-16.0.0-7219.g911cc357.el8.x86_ 6.1 MB/s | 2.1 MB 00:00 2020-11-16T20:51:31.344 INFO:teuthology.orchestra.run.smithi059.stdout:(3/32): ceph-mgr-16.0.0-7219.g911cc357.el8.x86_ 4.3 MB/s | 1.5 MB 00:00 2020-11-16T20:51:31.410 INFO:teuthology.orchestra.run.smithi059.stdout:(4/32): ceph-mgr-modules-core-16.0.0-7219.g911c 2.9 MB/s | 198 kB 00:00 2020-11-16T20:51:31.489 INFO:teuthology.orchestra.run.smithi059.stdout:(5/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm 558 kB/s | 44 kB 00:00 2020-11-16T20:51:31.505 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 14/32 2020-11-16T20:51:31.547 INFO:teuthology.orchestra.run.smithi059.stdout:(6/32): python3-beautifulsoup4-4.6.3-2.el8.1.no 3.1 MB/s | 185 kB 00:00 2020-11-16T20:51:31.573 INFO:teuthology.orchestra.run.smithi059.stdout:(7/32): ceph-mon-16.0.0-7219.g911cc357.el8.x86_ 10 MB/s | 4.9 MB 00:00 2020-11-16T20:51:31.575 INFO:teuthology.orchestra.run.smithi059.stdout:(8/32): python3-cheroot-8.2.1-1.el8.noarch.rpm 5.1 MB/s | 145 kB 00:00 2020-11-16T20:51:31.595 INFO:teuthology.orchestra.run.smithi059.stdout:(9/32): python3-cssselect-0.9.2-10.el8.noarch.r 2.0 MB/s | 40 kB 00:00 2020-11-16T20:51:31.615 INFO:teuthology.orchestra.run.smithi059.stdout:(10/32): python3-jaraco-6.2-6.el8.noarch.rpm 565 kB/s | 11 kB 00:00 2020-11-16T20:51:31.634 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 15/32 2020-11-16T20:51:31.635 INFO:teuthology.orchestra.run.smithi059.stdout:(11/32): python3-jaraco-functools-2.0-4.el8.noa 900 kB/s | 18 kB 00:00 2020-11-16T20:51:31.654 INFO:teuthology.orchestra.run.smithi059.stdout:(12/32): python3-logutils-0.3.5-11.el8.noarch.r 2.4 MB/s | 49 kB 00:00 2020-11-16T20:51:31.674 INFO:teuthology.orchestra.run.smithi059.stdout:(13/32): python3-more-itertools-7.2.0-3.el8.noa 2.9 MB/s | 59 kB 00:00 2020-11-16T20:51:31.686 INFO:teuthology.orchestra.run.smithi059.stdout:(14/32): python3-cherrypy-18.4.0-1.el8.noarch.r 3.3 MB/s | 384 kB 00:00 2020-11-16T20:51:31.696 INFO:teuthology.orchestra.run.smithi059.stdout:(15/32): python3-pecan-1.3.2-9.el8.noarch.rpm 13 MB/s | 283 kB 00:00 2020-11-16T20:51:31.702 INFO:teuthology.orchestra.run.smithi059.stdout:(16/32): python3-portend-2.6-1.el8.noarch.rpm 964 kB/s | 16 kB 00:00 2020-11-16T20:51:31.716 INFO:teuthology.orchestra.run.smithi059.stdout:(17/32): python3-simplegeneric-0.8.1-17.el8.noa 957 kB/s | 19 kB 00:00 2020-11-16T20:51:31.719 INFO:teuthology.orchestra.run.smithi059.stdout:(18/32): python3-singledispatch-3.4.0.3-18.el8. 1.4 MB/s | 24 kB 00:00 2020-11-16T20:51:31.735 INFO:teuthology.orchestra.run.smithi059.stdout:(19/32): python3-trustme-0.6.0-4.el8.noarch.rpm 1.6 MB/s | 27 kB 00:00 2020-11-16T20:51:31.736 INFO:teuthology.orchestra.run.smithi059.stdout:(20/32): python3-tempora-1.14.1-5.el8.noarch.rp 1.4 MB/s | 29 kB 00:00 2020-11-16T20:51:31.754 INFO:teuthology.orchestra.run.smithi059.stdout:(21/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 14 MB/s | 251 kB 00:00 2020-11-16T20:51:31.757 INFO:teuthology.orchestra.run.smithi059.stdout:(22/32): python3-waitress-1.2.1-2.el8.1.noarch. 11 MB/s | 241 kB 00:00 2020-11-16T20:51:31.771 INFO:teuthology.orchestra.run.smithi059.stdout:(23/32): python3-webtest-2.0.33-1.el8.noarch.rp 5.0 MB/s | 85 kB 00:00 2020-11-16T20:51:31.783 INFO:teuthology.orchestra.run.smithi059.stdout:(24/32): python3-zc-lockfile-2.0-2.el8.noarch.r 895 kB/s | 23 kB 00:00 2020-11-16T20:51:31.824 INFO:teuthology.orchestra.run.smithi059.stdout:(25/32): python3-webencodings-0.5.1-6.el8.noarc 508 kB/s | 27 kB 00:00 2020-11-16T20:51:31.853 INFO:teuthology.orchestra.run.smithi059.stdout:(26/32): python3-lxml-4.2.3-1.el8.x86_64.rpm 22 MB/s | 1.5 MB 00:00 2020-11-16T20:51:31.863 INFO:teuthology.orchestra.run.smithi059.stdout:(27/32): python3-werkzeug-0.12.2-4.el8.noarch.r 11 MB/s | 457 kB 00:00 2020-11-16T20:51:31.880 INFO:teuthology.orchestra.run.smithi059.stdout:(28/32): python3-mako-1.0.6-13.el8.noarch.rpm 5.7 MB/s | 157 kB 00:00 2020-11-16T20:51:31.891 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 16/32 2020-11-16T20:51:31.897 INFO:teuthology.orchestra.run.smithi059.stdout:(29/32): python3-html5lib-0.999999999-6.el8.noa 6.2 MB/s | 214 kB 00:00 2020-11-16T20:51:31.914 INFO:teuthology.orchestra.run.smithi059.stdout:(30/32): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2020-11-16T20:51:31.929 INFO:teuthology.orchestra.run.smithi059.stdout:(31/32): python3-markupsafe-0.23-19.el8.x86_64. 1.2 MB/s | 39 kB 00:00 2020-11-16T20:51:32.074 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 17/32 2020-11-16T20:51:32.191 INFO:teuthology.orchestra.run.smithi059.stdout:(32/32): ceph-osd-16.0.0-7219.g911cc357.el8.x86 21 MB/s | 18 MB 00:00 2020-11-16T20:51:32.194 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:51:32.194 INFO:teuthology.orchestra.run.smithi059.stdout:Total 26 MB/s | 31 MB 00:01 2020-11-16T20:51:32.202 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2020-11-16T20:51:32.242 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 18/32 2020-11-16T20:51:32.244 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2020-11-16T20:51:32.245 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2020-11-16T20:51:32.504 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2020-11-16T20:51:32.508 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2020-11-16T20:51:32.529 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-portend-2.6-1.el8.noarch 19/32 2020-11-16T20:51:32.731 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 20/32 2020-11-16T20:51:33.133 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 21/32 2020-11-16T20:51:33.372 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 22/32 2020-11-16T20:51:33.621 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 23/32 2020-11-16T20:51:33.738 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2020-11-16T20:51:33.973 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 24/32 2020-11-16T20:51:33.978 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2020-11-16T20:51:34.202 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2020-11-16T20:51:34.255 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 25/32 2020-11-16T20:51:34.444 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 3/32 2020-11-16T20:51:34.569 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 26/32 2020-11-16T20:51:34.694 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 4/32 2020-11-16T20:51:34.927 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-7219.g911cc357.el8. 27/32 2020-11-16T20:51:34.934 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 5/32 2020-11-16T20:51:35.073 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-mgr-2:16.0.0-7219.g911cc357.el8.x86_64 28/32 2020-11-16T20:51:35.116 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 6/32 2020-11-16T20:51:35.383 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 7/32 2020-11-16T20:51:35.621 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 8/32 2020-11-16T20:51:35.836 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 9/32 2020-11-16T20:51:36.030 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 10/32 2020-11-16T20:51:36.211 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 11/32 2020-11-16T20:51:36.341 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 12/32 2020-11-16T20:51:36.526 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-mgr-2:16.0.0-7219.g911cc357.el8.x86_64 28/32 2020-11-16T20:51:36.551 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 13/32 2020-11-16T20:51:36.673 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-osd-2:16.0.0-7219.g911cc357.el8.x86_64 29/32 2020-11-16T20:51:36.740 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 14/32 2020-11-16T20:51:36.878 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 15/32 2020-11-16T20:51:37.099 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-osd-2:16.0.0-7219.g911cc357.el8.x86_64 29/32 2020-11-16T20:51:37.140 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 16/32 2020-11-16T20:51:37.386 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 17/32 2020-11-16T20:51:37.423 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-mon-2:16.0.0-7219.g911cc357.el8.x86_64 30/32 2020-11-16T20:51:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 18/32 2020-11-16T20:51:37.618 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-mon-2:16.0.0-7219.g911cc357.el8.x86_64 30/32 2020-11-16T20:51:37.760 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-mds-2:16.0.0-7219.g911cc357.el8.x86_64 31/32 2020-11-16T20:51:37.780 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-mds-2:16.0.0-7219.g911cc357.el8.x86_64 31/32 2020-11-16T20:51:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-portend-2.6-1.el8.noarch 19/32 2020-11-16T20:51:37.916 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-2:16.0.0-7219.g911cc357.el8.x86_64 32/32 2020-11-16T20:51:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 20/32 2020-11-16T20:51:38.240 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-2:16.0.0-7219.g911cc357.el8.x86_64 32/32 2020-11-16T20:51:38.240 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-2:16.0.0-7219.g911cc357.el8.x86_64 1/32 2020-11-16T20:51:38.240 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-mds-2:16.0.0-7219.g911cc357.el8.x86_64 2/32 2020-11-16T20:51:38.240 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-mgr-2:16.0.0-7219.g911cc357.el8.x86_64 3/32 2020-11-16T20:51:38.241 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-mon-2:16.0.0-7219.g911cc357.el8.x86_64 4/32 2020-11-16T20:51:38.241 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-osd-2:16.0.0-7219.g911cc357.el8.x86_64 5/32 2020-11-16T20:51:38.241 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-7219.g911cc357.el8. 6/32 2020-11-16T20:51:38.241 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 7/32 2020-11-16T20:51:38.241 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 8/32 2020-11-16T20:51:38.241 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 9/32 2020-11-16T20:51:38.241 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 10/32 2020-11-16T20:51:38.242 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 11/32 2020-11-16T20:51:38.242 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 12/32 2020-11-16T20:51:38.242 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 13/32 2020-11-16T20:51:38.242 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 14/32 2020-11-16T20:51:38.242 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 15/32 2020-11-16T20:51:38.242 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 16/32 2020-11-16T20:51:38.242 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-portend-2.6-1.el8.noarch 17/32 2020-11-16T20:51:38.243 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 18/32 2020-11-16T20:51:38.243 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 19/32 2020-11-16T20:51:38.243 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 20/32 2020-11-16T20:51:38.243 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 21/32 2020-11-16T20:51:38.243 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 22/32 2020-11-16T20:51:38.243 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 23/32 2020-11-16T20:51:38.243 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 24/32 2020-11-16T20:51:38.244 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 25/32 2020-11-16T20:51:38.244 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 26/32 2020-11-16T20:51:38.244 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 27/32 2020-11-16T20:51:38.244 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 28/32 2020-11-16T20:51:38.244 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 29/32 2020-11-16T20:51:38.244 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 30/32 2020-11-16T20:51:38.244 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 31/32 2020-11-16T20:51:38.452 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 21/32 2020-11-16T20:51:38.694 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 22/32 2020-11-16T20:51:38.948 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 32/32 2020-11-16T20:51:38.948 INFO:teuthology.orchestra.run.smithi166.stdout:Installed products updated. 2020-11-16T20:51:38.949 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 23/32 2020-11-16T20:51:39.302 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 24/32 2020-11-16T20:51:39.547 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 25/32 2020-11-16T20:51:39.870 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 26/32 2020-11-16T20:51:40.255 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-7219.g911cc357.el8. 27/32 2020-11-16T20:51:40.426 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-2:16.0.0-7219.g911cc357.el8.x86_64 28/32 2020-11-16T20:51:41.254 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:51:41.254 INFO:teuthology.orchestra.run.smithi166.stdout:Installed: 2020-11-16T20:51:41.254 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:41.255 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mds-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:41.255 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:41.255 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-modules-core-2:16.0.0-7219.g911cc357.el8.noarch 2020-11-16T20:51:41.255 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mon-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:41.255 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-osd-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:41.255 INFO:teuthology.orchestra.run.smithi166.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-11-16T20:51:41.255 INFO:teuthology.orchestra.run.smithi166.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-11-16T20:51:41.256 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-11-16T20:51:41.256 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-11-16T20:51:41.256 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-11-16T20:51:41.256 INFO:teuthology.orchestra.run.smithi166.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-11-16T20:51:41.256 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jaraco-6.2-6.el8.noarch 2020-11-16T20:51:41.256 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-11-16T20:51:41.256 INFO:teuthology.orchestra.run.smithi166.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-11-16T20:51:41.257 INFO:teuthology.orchestra.run.smithi166.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-11-16T20:51:41.257 INFO:teuthology.orchestra.run.smithi166.stdout: python3-mako-1.0.6-13.el8.noarch 2020-11-16T20:51:41.257 INFO:teuthology.orchestra.run.smithi166.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-11-16T20:51:41.257 INFO:teuthology.orchestra.run.smithi166.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-11-16T20:51:41.257 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-11-16T20:51:41.257 INFO:teuthology.orchestra.run.smithi166.stdout: python3-portend-2.6-1.el8.noarch 2020-11-16T20:51:41.257 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pytz-2017.2-9.el8.noarch 2020-11-16T20:51:41.258 INFO:teuthology.orchestra.run.smithi166.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-11-16T20:51:41.258 INFO:teuthology.orchestra.run.smithi166.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-11-16T20:51:41.258 INFO:teuthology.orchestra.run.smithi166.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-11-16T20:51:41.258 INFO:teuthology.orchestra.run.smithi166.stdout: python3-trustme-0.6.0-4.el8.noarch 2020-11-16T20:51:41.258 INFO:teuthology.orchestra.run.smithi166.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-11-16T20:51:41.258 INFO:teuthology.orchestra.run.smithi166.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-11-16T20:51:41.258 INFO:teuthology.orchestra.run.smithi166.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-11-16T20:51:41.258 INFO:teuthology.orchestra.run.smithi166.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-11-16T20:51:41.259 INFO:teuthology.orchestra.run.smithi166.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-11-16T20:51:41.259 INFO:teuthology.orchestra.run.smithi166.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-11-16T20:51:41.259 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:51:41.259 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:51:41.363 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install ceph-base 2020-11-16T20:51:41.717 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:51:41.970 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-2:16.0.0-7219.g911cc357.el8.x86_64 28/32 2020-11-16T20:51:42.160 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-osd-2:16.0.0-7219.g911cc357.el8.x86_64 29/32 2020-11-16T20:51:42.254 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 85 kB/s | 2.4 kB 00:00 2020-11-16T20:51:42.352 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 98 kB/s | 2.8 kB 00:00 2020-11-16T20:51:42.611 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-osd-2:16.0.0-7219.g911cc357.el8.x86_64 29/32 2020-11-16T20:51:43.035 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mon-2:16.0.0-7219.g911cc357.el8.x86_64 30/32 2020-11-16T20:51:43.240 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mon-2:16.0.0-7219.g911cc357.el8.x86_64 30/32 2020-11-16T20:51:43.394 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mds-2:16.0.0-7219.g911cc357.el8.x86_64 31/32 2020-11-16T20:51:43.413 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mds-2:16.0.0-7219.g911cc357.el8.x86_64 31/32 2020-11-16T20:51:43.459 INFO:teuthology.orchestra.run.smithi166.stdout:Package ceph-base-2:16.0.0-7219.g911cc357.el8.x86_64 is already installed. 2020-11-16T20:51:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-2:16.0.0-7219.g911cc357.el8.x86_64 32/32 2020-11-16T20:51:43.760 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:51:43.761 INFO:teuthology.orchestra.run.smithi166.stdout:Nothing to do. 2020-11-16T20:51:43.761 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:51:43.848 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install cephadm 2020-11-16T20:51:43.942 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-2:16.0.0-7219.g911cc357.el8.x86_64 32/32 2020-11-16T20:51:43.943 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-2:16.0.0-7219.g911cc357.el8.x86_64 1/32 2020-11-16T20:51:43.943 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mds-2:16.0.0-7219.g911cc357.el8.x86_64 2/32 2020-11-16T20:51:43.943 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-2:16.0.0-7219.g911cc357.el8.x86_64 3/32 2020-11-16T20:51:43.943 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mon-2:16.0.0-7219.g911cc357.el8.x86_64 4/32 2020-11-16T20:51:43.943 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-osd-2:16.0.0-7219.g911cc357.el8.x86_64 5/32 2020-11-16T20:51:43.943 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-7219.g911cc357.el8. 6/32 2020-11-16T20:51:43.943 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 7/32 2020-11-16T20:51:43.944 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 8/32 2020-11-16T20:51:43.944 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 9/32 2020-11-16T20:51:43.944 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 10/32 2020-11-16T20:51:43.944 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 11/32 2020-11-16T20:51:43.944 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 12/32 2020-11-16T20:51:43.944 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 13/32 2020-11-16T20:51:43.944 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 14/32 2020-11-16T20:51:43.945 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 15/32 2020-11-16T20:51:43.945 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 16/32 2020-11-16T20:51:43.945 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-portend-2.6-1.el8.noarch 17/32 2020-11-16T20:51:43.945 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 18/32 2020-11-16T20:51:43.945 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 19/32 2020-11-16T20:51:43.945 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 20/32 2020-11-16T20:51:43.945 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 21/32 2020-11-16T20:51:43.946 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 22/32 2020-11-16T20:51:43.946 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 23/32 2020-11-16T20:51:43.946 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 24/32 2020-11-16T20:51:43.946 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 25/32 2020-11-16T20:51:43.946 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 26/32 2020-11-16T20:51:43.946 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 27/32 2020-11-16T20:51:43.947 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 28/32 2020-11-16T20:51:43.947 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 29/32 2020-11-16T20:51:43.947 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 30/32 2020-11-16T20:51:43.947 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 31/32 2020-11-16T20:51:44.196 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:51:44.637 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 32/32 2020-11-16T20:51:44.638 INFO:teuthology.orchestra.run.smithi059.stdout:Installed products updated. 2020-11-16T20:51:44.705 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 84 kB/s | 2.4 kB 00:00 2020-11-16T20:51:44.806 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 92 kB/s | 2.8 kB 00:00 2020-11-16T20:51:46.187 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:51:46.188 INFO:teuthology.orchestra.run.smithi166.stdout:================================================================================ 2020-11-16T20:51:46.188 INFO:teuthology.orchestra.run.smithi166.stdout: Package Architecture Version Repository Size 2020-11-16T20:51:46.189 INFO:teuthology.orchestra.run.smithi166.stdout:================================================================================ 2020-11-16T20:51:46.189 INFO:teuthology.orchestra.run.smithi166.stdout:Installing: 2020-11-16T20:51:46.189 INFO:teuthology.orchestra.run.smithi166.stdout: cephadm x86_64 2:16.0.0-7219.g911cc357.el8 ceph 57 k 2020-11-16T20:51:46.189 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:51:46.189 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction Summary 2020-11-16T20:51:46.189 INFO:teuthology.orchestra.run.smithi166.stdout:================================================================================ 2020-11-16T20:51:46.190 INFO:teuthology.orchestra.run.smithi166.stdout:Install 1 Package 2020-11-16T20:51:46.190 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:51:46.190 INFO:teuthology.orchestra.run.smithi166.stdout:Total download size: 57 k 2020-11-16T20:51:46.190 INFO:teuthology.orchestra.run.smithi166.stdout:Installed size: 218 k 2020-11-16T20:51:46.190 INFO:teuthology.orchestra.run.smithi166.stdout:Downloading Packages: 2020-11-16T20:51:46.336 INFO:teuthology.orchestra.run.smithi166.stdout:cephadm-16.0.0-7219.g911cc357.el8.x86_64.rpm 391 kB/s | 57 kB 00:00 2020-11-16T20:51:46.336 INFO:teuthology.orchestra.run.smithi166.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:51:46.337 INFO:teuthology.orchestra.run.smithi166.stdout:Total 388 kB/s | 57 kB 00:00 2020-11-16T20:51:46.337 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction check 2020-11-16T20:51:46.344 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction check succeeded. 2020-11-16T20:51:46.344 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction test 2020-11-16T20:51:46.345 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction test succeeded. 2020-11-16T20:51:46.349 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction 2020-11-16T20:51:46.396 INFO:teuthology.orchestra.run.smithi166.stdout: Preparing : 1/1 2020-11-16T20:51:47.016 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:51:47.016 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2020-11-16T20:51:47.017 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:47.017 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:47.017 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:47.017 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core-2:16.0.0-7219.g911cc357.el8.noarch 2020-11-16T20:51:47.017 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:47.017 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:47.017 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-11-16T20:51:47.018 INFO:teuthology.orchestra.run.smithi059.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-11-16T20:51:47.018 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-11-16T20:51:47.018 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-11-16T20:51:47.018 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-11-16T20:51:47.018 INFO:teuthology.orchestra.run.smithi059.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-11-16T20:51:47.018 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-6.2-6.el8.noarch 2020-11-16T20:51:47.018 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-11-16T20:51:47.019 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-11-16T20:51:47.019 INFO:teuthology.orchestra.run.smithi059.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-11-16T20:51:47.019 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako-1.0.6-13.el8.noarch 2020-11-16T20:51:47.019 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-11-16T20:51:47.019 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-11-16T20:51:47.019 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-11-16T20:51:47.019 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend-2.6-1.el8.noarch 2020-11-16T20:51:47.020 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz-2017.2-9.el8.noarch 2020-11-16T20:51:47.020 INFO:teuthology.orchestra.run.smithi059.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-11-16T20:51:47.020 INFO:teuthology.orchestra.run.smithi059.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-11-16T20:51:47.020 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-11-16T20:51:47.020 INFO:teuthology.orchestra.run.smithi059.stdout: python3-trustme-0.6.0-4.el8.noarch 2020-11-16T20:51:47.020 INFO:teuthology.orchestra.run.smithi059.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-11-16T20:51:47.020 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-11-16T20:51:47.021 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-11-16T20:51:47.021 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-11-16T20:51:47.021 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-11-16T20:51:47.021 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-11-16T20:51:47.021 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:51:47.021 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:51:47.150 INFO:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-base 2020-11-16T20:51:47.530 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:51:48.138 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 kB/s | 2.4 kB 00:00 2020-11-16T20:51:48.249 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 75 kB/s | 2.8 kB 00:00 2020-11-16T20:51:48.604 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: cephadm-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:51:48.767 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : cephadm-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:51:48.944 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: cephadm-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:51:49.188 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : cephadm-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:51:49.189 INFO:teuthology.orchestra.run.smithi166.stdout:Installed products updated. 2020-11-16T20:51:49.410 INFO:teuthology.orchestra.run.smithi059.stdout:Package ceph-base-2:16.0.0-7219.g911cc357.el8.x86_64 is already installed. 2020-11-16T20:51:49.732 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:51:49.733 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2020-11-16T20:51:49.733 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:51:49.819 INFO:teuthology.orchestra.run.smithi059:> sudo yum -y install cephadm 2020-11-16T20:51:50.193 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:51:50.781 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 kB/s | 2.4 kB 00:00 2020-11-16T20:51:50.893 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 75 kB/s | 2.8 kB 00:00 2020-11-16T20:51:51.525 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:51:51.526 INFO:teuthology.orchestra.run.smithi166.stdout:Installed: 2020-11-16T20:51:51.526 INFO:teuthology.orchestra.run.smithi166.stdout: cephadm-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:51.526 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:51:51.526 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:51:51.618 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install ceph-immutable-object-cache 2020-11-16T20:51:51.980 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:51:52.373 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:51:52.374 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2020-11-16T20:51:52.374 INFO:teuthology.orchestra.run.smithi059.stdout: Package Architecture Version Repository Size 2020-11-16T20:51:52.374 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2020-11-16T20:51:52.374 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2020-11-16T20:51:52.374 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm x86_64 2:16.0.0-7219.g911cc357.el8 ceph 57 k 2020-11-16T20:51:52.375 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:51:52.375 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2020-11-16T20:51:52.375 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2020-11-16T20:51:52.375 INFO:teuthology.orchestra.run.smithi059.stdout:Install 1 Package 2020-11-16T20:51:52.375 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:51:52.375 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 57 k 2020-11-16T20:51:52.375 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 218 k 2020-11-16T20:51:52.376 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2020-11-16T20:51:52.507 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 85 kB/s | 2.4 kB 00:00 2020-11-16T20:51:52.521 INFO:teuthology.orchestra.run.smithi059.stdout:cephadm-16.0.0-7219.g911cc357.el8.x86_64.rpm 393 kB/s | 57 kB 00:00 2020-11-16T20:51:52.521 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:51:52.522 INFO:teuthology.orchestra.run.smithi059.stdout:Total 389 kB/s | 57 kB 00:00 2020-11-16T20:51:52.522 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2020-11-16T20:51:52.529 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2020-11-16T20:51:52.530 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2020-11-16T20:51:52.531 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2020-11-16T20:51:52.535 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2020-11-16T20:51:52.593 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2020-11-16T20:51:52.605 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 97 kB/s | 2.8 kB 00:00 2020-11-16T20:51:54.018 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:51:54.019 INFO:teuthology.orchestra.run.smithi166.stdout:================================================================================ 2020-11-16T20:51:54.019 INFO:teuthology.orchestra.run.smithi166.stdout: Package Arch Version Repo Size 2020-11-16T20:51:54.019 INFO:teuthology.orchestra.run.smithi166.stdout:================================================================================ 2020-11-16T20:51:54.019 INFO:teuthology.orchestra.run.smithi166.stdout:Installing: 2020-11-16T20:51:54.020 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-immutable-object-cache x86_64 2:16.0.0-7219.g911cc357.el8 ceph 201 k 2020-11-16T20:51:54.020 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:51:54.020 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction Summary 2020-11-16T20:51:54.020 INFO:teuthology.orchestra.run.smithi166.stdout:================================================================================ 2020-11-16T20:51:54.020 INFO:teuthology.orchestra.run.smithi166.stdout:Install 1 Package 2020-11-16T20:51:54.020 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:51:54.020 INFO:teuthology.orchestra.run.smithi166.stdout:Total download size: 201 k 2020-11-16T20:51:54.021 INFO:teuthology.orchestra.run.smithi166.stdout:Installed size: 584 k 2020-11-16T20:51:54.021 INFO:teuthology.orchestra.run.smithi166.stdout:Downloading Packages: 2020-11-16T20:51:54.190 INFO:teuthology.orchestra.run.smithi166.stdout:ceph-immutable-object-cache-16.0.0-7219.g911cc3 1.2 MB/s | 201 kB 00:00 2020-11-16T20:51:54.191 INFO:teuthology.orchestra.run.smithi166.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:51:54.192 INFO:teuthology.orchestra.run.smithi166.stdout:Total 1.1 MB/s | 201 kB 00:00 2020-11-16T20:51:54.192 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction check 2020-11-16T20:51:54.203 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction check succeeded. 2020-11-16T20:51:54.204 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction test 2020-11-16T20:51:54.254 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction test succeeded. 2020-11-16T20:51:54.257 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction 2020-11-16T20:51:54.491 INFO:teuthology.orchestra.run.smithi166.stdout: Preparing : 1/1 2020-11-16T20:51:54.674 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-7219.g911cc357. 1/1 2020-11-16T20:51:55.006 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-7219.g911cc357. 1/1 2020-11-16T20:51:55.225 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-7219.g911cc357. 1/1 2020-11-16T20:51:55.226 INFO:teuthology.orchestra.run.smithi166.stdout:Installed products updated. 2020-11-16T20:51:55.809 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephadm-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:51:55.953 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephadm-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:51:56.134 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephadm-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:51:56.373 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephadm-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:51:56.373 INFO:teuthology.orchestra.run.smithi059.stdout:Installed products updated. 2020-11-16T20:51:57.543 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:51:57.543 INFO:teuthology.orchestra.run.smithi166.stdout:Installed: 2020-11-16T20:51:57.543 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-immutable-object-cache-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:57.544 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:51:57.544 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:51:57.642 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install ceph-mgr 2020-11-16T20:51:57.994 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:51:58.536 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 82 kB/s | 2.4 kB 00:00 2020-11-16T20:51:58.637 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 97 kB/s | 2.8 kB 00:00 2020-11-16T20:51:58.757 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:51:58.757 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2020-11-16T20:51:58.757 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:51:58.757 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:51:58.757 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:51:58.858 INFO:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-immutable-object-cache 2020-11-16T20:51:59.244 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:51:59.807 INFO:teuthology.orchestra.run.smithi166.stdout:Package ceph-mgr-2:16.0.0-7219.g911cc357.el8.x86_64 is already installed. 2020-11-16T20:51:59.841 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 63 kB/s | 2.4 kB 00:00 2020-11-16T20:51:59.956 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 72 kB/s | 2.8 kB 00:00 2020-11-16T20:52:00.107 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:52:00.108 INFO:teuthology.orchestra.run.smithi166.stdout:Nothing to do. 2020-11-16T20:52:00.108 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:52:00.200 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install ceph-mgr-dashboard 2020-11-16T20:52:00.548 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:52:01.061 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 85 kB/s | 2.4 kB 00:00 2020-11-16T20:52:01.160 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 98 kB/s | 2.8 kB 00:00 2020-11-16T20:52:01.462 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:52:01.463 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2020-11-16T20:52:01.463 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repo Size 2020-11-16T20:52:01.463 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2020-11-16T20:52:01.463 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2020-11-16T20:52:01.464 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache x86_64 2:16.0.0-7219.g911cc357.el8 ceph 201 k 2020-11-16T20:52:01.464 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:01.464 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2020-11-16T20:52:01.464 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2020-11-16T20:52:01.464 INFO:teuthology.orchestra.run.smithi059.stdout:Install 1 Package 2020-11-16T20:52:01.464 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:01.465 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 201 k 2020-11-16T20:52:01.465 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 584 k 2020-11-16T20:52:01.465 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2020-11-16T20:52:01.656 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-immutable-object-cache-16.0.0-7219.g911cc3 1.0 MB/s | 201 kB 00:00 2020-11-16T20:52:01.656 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:52:01.657 INFO:teuthology.orchestra.run.smithi059.stdout:Total 1.0 MB/s | 201 kB 00:00 2020-11-16T20:52:01.657 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2020-11-16T20:52:01.670 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2020-11-16T20:52:01.670 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2020-11-16T20:52:01.724 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2020-11-16T20:52:01.728 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2020-11-16T20:52:01.851 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2020-11-16T20:52:02.049 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-7219.g911cc357. 1/1 2020-11-16T20:52:02.391 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-7219.g911cc357. 1/1 2020-11-16T20:52:02.535 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:52:02.536 INFO:teuthology.orchestra.run.smithi166.stdout:=================================================================================================== 2020-11-16T20:52:02.536 INFO:teuthology.orchestra.run.smithi166.stdout: Package Arch Version Repository Size 2020-11-16T20:52:02.537 INFO:teuthology.orchestra.run.smithi166.stdout:=================================================================================================== 2020-11-16T20:52:02.537 INFO:teuthology.orchestra.run.smithi166.stdout:Installing: 2020-11-16T20:52:02.537 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-dashboard noarch 2:16.0.0-7219.g911cc357.el8 ceph-noarch 3.2 M 2020-11-16T20:52:02.537 INFO:teuthology.orchestra.run.smithi166.stdout:Installing dependencies: 2020-11-16T20:52:02.537 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-grafana-dashboards noarch 2:16.0.0-7219.g911cc357.el8 ceph-noarch 24 k 2020-11-16T20:52:02.537 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-prometheus-alerts noarch 2:16.0.0-7219.g911cc357.el8 ceph-noarch 8.8 k 2020-11-16T20:52:02.538 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-16T20:52:02.538 INFO:teuthology.orchestra.run.smithi166.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2020-11-16T20:52:02.538 INFO:teuthology.orchestra.run.smithi166.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2020-11-16T20:52:06.734 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:06.734 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction Summary 2020-11-16T20:52:06.734 INFO:teuthology.orchestra.run.smithi166.stdout:=================================================================================================== 2020-11-16T20:52:06.735 INFO:teuthology.orchestra.run.smithi166.stdout:Install 6 Packages 2020-11-16T20:52:06.735 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:06.738 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-7219.g911cc357. 1/1 2020-11-16T20:52:06.738 INFO:teuthology.orchestra.run.smithi059.stdout:Installed products updated. 2020-11-16T20:52:06.738 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:06.738 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2020-11-16T20:52:06.738 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:52:06.739 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:06.739 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:52:06.739 INFO:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-mgr 2020-11-16T20:52:06.740 INFO:teuthology.orchestra.run.smithi166.stdout:Total download size: 3.5 M 2020-11-16T20:52:06.740 INFO:teuthology.orchestra.run.smithi166.stdout:Installed size: 14 M 2020-11-16T20:52:06.740 INFO:teuthology.orchestra.run.smithi166.stdout:Downloading Packages: 2020-11-16T20:52:06.740 INFO:teuthology.orchestra.run.smithi166.stdout:(1/6): ceph-prometheus-alerts-16.0.0-7219.g911c 81 kB/s | 8.8 kB 00:00 2020-11-16T20:52:06.740 INFO:teuthology.orchestra.run.smithi166.stdout:(2/6): ceph-grafana-dashboards-16.0.0-7219.g911 196 kB/s | 24 kB 00:00 2020-11-16T20:52:06.740 INFO:teuthology.orchestra.run.smithi166.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 563 kB/s | 34 kB 00:00 2020-11-16T20:52:06.741 INFO:teuthology.orchestra.run.smithi166.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.4 MB/s | 43 kB 00:00 2020-11-16T20:52:06.741 INFO:teuthology.orchestra.run.smithi166.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 2.0 MB/s | 196 kB 00:00 2020-11-16T20:52:06.741 INFO:teuthology.orchestra.run.smithi166.stdout:(6/6): ceph-mgr-dashboard-16.0.0-7219.g911cc357 6.1 MB/s | 3.2 MB 00:00 2020-11-16T20:52:06.741 INFO:teuthology.orchestra.run.smithi166.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:52:06.741 INFO:teuthology.orchestra.run.smithi166.stdout:Total 6.6 MB/s | 3.5 MB 00:00 2020-11-16T20:52:06.741 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction check 2020-11-16T20:52:06.741 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction check succeeded. 2020-11-16T20:52:06.742 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction test 2020-11-16T20:52:06.742 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction test succeeded. 2020-11-16T20:52:06.742 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction 2020-11-16T20:52:06.742 INFO:teuthology.orchestra.run.smithi166.stdout: Preparing : 1/1 2020-11-16T20:52:06.742 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 1/6 2020-11-16T20:52:06.742 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 2/6 2020-11-16T20:52:06.743 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 3/6 2020-11-16T20:52:06.743 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-7219.g911cc357.el8.n 4/6 2020-11-16T20:52:06.743 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-7219.g911cc357.el8. 5/6 2020-11-16T20:52:06.743 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-7219.g911cc357.el8.noarc 6/6 2020-11-16T20:52:06.743 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-7219.g911cc357.el8.noarc 6/6 2020-11-16T20:52:06.743 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-7219.g911cc357.el8. 1/6 2020-11-16T20:52:06.743 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-7219.g911cc357.el8.noarc 2/6 2020-11-16T20:52:06.744 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-7219.g911cc357.el8.n 3/6 2020-11-16T20:52:06.744 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/6 2020-11-16T20:52:06.744 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/6 2020-11-16T20:52:06.744 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 6/6 2020-11-16T20:52:06.744 INFO:teuthology.orchestra.run.smithi166.stdout:Installed products updated. 2020-11-16T20:52:07.139 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:52:07.774 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 63 kB/s | 2.4 kB 00:00 2020-11-16T20:52:07.886 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 74 kB/s | 2.8 kB 00:00 2020-11-16T20:52:08.381 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:08.382 INFO:teuthology.orchestra.run.smithi166.stdout:Installed: 2020-11-16T20:52:08.382 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-grafana-dashboards-2:16.0.0-7219.g911cc357.el8.noarch 2020-11-16T20:52:08.383 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-dashboard-2:16.0.0-7219.g911cc357.el8.noarch 2020-11-16T20:52:08.383 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-prometheus-alerts-2:16.0.0-7219.g911cc357.el8.noarch 2020-11-16T20:52:08.383 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-11-16T20:52:08.383 INFO:teuthology.orchestra.run.smithi166.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-11-16T20:52:08.384 INFO:teuthology.orchestra.run.smithi166.stdout: python3-routes-2.4.1-12.el8.noarch 2020-11-16T20:52:08.384 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:08.384 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:52:08.486 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install ceph-mgr-diskprediction-local 2020-11-16T20:52:08.840 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:52:09.016 INFO:teuthology.orchestra.run.smithi059.stdout:Package ceph-mgr-2:16.0.0-7219.g911cc357.el8.x86_64 is already installed. 2020-11-16T20:52:09.338 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:52:09.339 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2020-11-16T20:52:09.339 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:52:09.365 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 80 kB/s | 2.4 kB 00:00 2020-11-16T20:52:09.429 INFO:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-mgr-dashboard 2020-11-16T20:52:09.465 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 92 kB/s | 2.8 kB 00:00 2020-11-16T20:52:09.805 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:52:10.399 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 57 kB/s | 2.4 kB 00:00 2020-11-16T20:52:10.511 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 73 kB/s | 2.8 kB 00:00 2020-11-16T20:52:10.869 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:52:10.870 INFO:teuthology.orchestra.run.smithi166.stdout:====================================================================================================================== 2020-11-16T20:52:10.870 INFO:teuthology.orchestra.run.smithi166.stdout: Package Arch Version Repository Size 2020-11-16T20:52:10.870 INFO:teuthology.orchestra.run.smithi166.stdout:====================================================================================================================== 2020-11-16T20:52:10.871 INFO:teuthology.orchestra.run.smithi166.stdout:Installing: 2020-11-16T20:52:10.871 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-diskprediction-local noarch 2:16.0.0-7219.g911cc357.el8 ceph-noarch 8.6 M 2020-11-16T20:52:10.871 INFO:teuthology.orchestra.run.smithi166.stdout:Installing dependencies: 2020-11-16T20:52:10.871 INFO:teuthology.orchestra.run.smithi166.stdout: libgfortran x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2020-11-16T20:52:10.871 INFO:teuthology.orchestra.run.smithi166.stdout: libquadmath x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2020-11-16T20:52:10.871 INFO:teuthology.orchestra.run.smithi166.stdout: openblas x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2020-11-16T20:52:10.871 INFO:teuthology.orchestra.run.smithi166.stdout: openblas-threads x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2020-11-16T20:52:10.872 INFO:teuthology.orchestra.run.smithi166.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2020-11-16T20:52:10.872 INFO:teuthology.orchestra.run.smithi166.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2020-11-16T20:52:10.872 INFO:teuthology.orchestra.run.smithi166.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2020-11-16T20:52:10.872 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:10.872 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction Summary 2020-11-16T20:52:10.872 INFO:teuthology.orchestra.run.smithi166.stdout:====================================================================================================================== 2020-11-16T20:52:10.872 INFO:teuthology.orchestra.run.smithi166.stdout:Install 8 Packages 2020-11-16T20:52:10.873 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:10.873 INFO:teuthology.orchestra.run.smithi166.stdout:Total download size: 37 M 2020-11-16T20:52:10.873 INFO:teuthology.orchestra.run.smithi166.stdout:Installed size: 196 M 2020-11-16T20:52:10.874 INFO:teuthology.orchestra.run.smithi166.stdout:Downloading Packages: 2020-11-16T20:52:10.916 INFO:teuthology.orchestra.run.smithi166.stdout:(1/8): libquadmath-8.3.1-5.1.el8.x86_64.rpm 3.8 MB/s | 169 kB 00:00 2020-11-16T20:52:10.927 INFO:teuthology.orchestra.run.smithi166.stdout:(2/8): libgfortran-8.3.1-5.1.el8.x86_64.rpm 11 MB/s | 639 kB 00:00 2020-11-16T20:52:10.953 INFO:teuthology.orchestra.run.smithi166.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 10 MB/s | 225 kB 00:00 2020-11-16T20:52:11.005 INFO:teuthology.orchestra.run.smithi166.stdout:(4/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 72 MB/s | 3.7 MB 00:00 2020-11-16T20:52:11.100 INFO:teuthology.orchestra.run.smithi166.stdout:(5/8): python3-scipy-1.0.0-20.module+el8.1.0+33 79 MB/s | 15 MB 00:00 2020-11-16T20:52:11.129 INFO:teuthology.orchestra.run.smithi166.stdout:(6/8): openblas-threads-0.3.3-5.el8.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2020-11-16T20:52:11.153 INFO:teuthology.orchestra.run.smithi166.stdout:(7/8): openblas-0.3.3-5.el8.x86_64.rpm 81 MB/s | 4.3 MB 00:00 2020-11-16T20:52:11.751 INFO:teuthology.orchestra.run.smithi166.stdout:(8/8): ceph-mgr-diskprediction-local-16.0.0-721 9.8 MB/s | 8.6 MB 00:00 2020-11-16T20:52:11.753 INFO:teuthology.orchestra.run.smithi166.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:52:11.753 INFO:teuthology.orchestra.run.smithi166.stdout:Total 41 MB/s | 37 MB 00:00 2020-11-16T20:52:11.762 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction check 2020-11-16T20:52:11.780 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction check succeeded. 2020-11-16T20:52:11.780 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction test 2020-11-16T20:52:11.963 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:52:11.964 INFO:teuthology.orchestra.run.smithi059.stdout:=================================================================================================== 2020-11-16T20:52:11.964 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2020-11-16T20:52:11.965 INFO:teuthology.orchestra.run.smithi059.stdout:=================================================================================================== 2020-11-16T20:52:11.965 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2020-11-16T20:52:11.965 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard noarch 2:16.0.0-7219.g911cc357.el8 ceph-noarch 3.2 M 2020-11-16T20:52:11.965 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2020-11-16T20:52:11.965 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards noarch 2:16.0.0-7219.g911cc357.el8 ceph-noarch 24 k 2020-11-16T20:52:11.965 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts noarch 2:16.0.0-7219.g911cc357.el8 ceph-noarch 8.8 k 2020-11-16T20:52:11.966 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-16T20:52:11.966 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2020-11-16T20:52:11.966 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2020-11-16T20:52:11.966 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:11.966 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2020-11-16T20:52:11.966 INFO:teuthology.orchestra.run.smithi059.stdout:=================================================================================================== 2020-11-16T20:52:11.966 INFO:teuthology.orchestra.run.smithi059.stdout:Install 6 Packages 2020-11-16T20:52:11.967 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:11.967 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 3.5 M 2020-11-16T20:52:11.967 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 14 M 2020-11-16T20:52:11.967 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2020-11-16T20:52:12.077 INFO:teuthology.orchestra.run.smithi059.stdout:(1/6): ceph-prometheus-alerts-16.0.0-7219.g911c 80 kB/s | 8.8 kB 00:00 2020-11-16T20:52:12.084 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction test succeeded. 2020-11-16T20:52:12.087 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction 2020-11-16T20:52:12.090 INFO:teuthology.orchestra.run.smithi059.stdout:(2/6): ceph-grafana-dashboards-16.0.0-7219.g911 194 kB/s | 24 kB 00:00 2020-11-16T20:52:12.127 INFO:teuthology.orchestra.run.smithi059.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 674 kB/s | 34 kB 00:00 2020-11-16T20:52:12.165 INFO:teuthology.orchestra.run.smithi059.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.1 MB/s | 43 kB 00:00 2020-11-16T20:52:12.171 INFO:teuthology.orchestra.run.smithi059.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 2.4 MB/s | 196 kB 00:00 2020-11-16T20:52:12.490 INFO:teuthology.orchestra.run.smithi059.stdout:(6/6): ceph-mgr-dashboard-16.0.0-7219.g911cc357 6.1 MB/s | 3.2 MB 00:00 2020-11-16T20:52:12.492 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:52:12.492 INFO:teuthology.orchestra.run.smithi059.stdout:Total 6.6 MB/s | 3.5 MB 00:00 2020-11-16T20:52:12.494 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2020-11-16T20:52:12.503 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2020-11-16T20:52:12.503 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2020-11-16T20:52:12.606 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2020-11-16T20:52:12.609 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2020-11-16T20:52:12.630 INFO:teuthology.orchestra.run.smithi166.stdout: Preparing : 1/1 2020-11-16T20:52:12.796 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 1/8 2020-11-16T20:52:12.907 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2020-11-16T20:52:12.923 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 1/8 2020-11-16T20:52:13.063 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 2/8 2020-11-16T20:52:13.118 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 1/6 2020-11-16T20:52:13.369 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 2/6 2020-11-16T20:52:13.567 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 3/6 2020-11-16T20:52:13.571 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 2/8 2020-11-16T20:52:13.664 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-7219.g911cc357.el8.n 4/6 2020-11-16T20:52:13.696 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 3/8 2020-11-16T20:52:14.202 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 3/8 2020-11-16T20:52:14.346 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : openblas-0.3.3-5.el8.x86_64 4/8 2020-11-16T20:52:14.834 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-7219.g911cc357.el8. 5/6 2020-11-16T20:52:15.105 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-7219.g911cc357.el8.noarc 6/6 2020-11-16T20:52:15.106 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 4/8 2020-11-16T20:52:15.348 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-7219.g911cc357.el8.noarc 6/6 2020-11-16T20:52:15.349 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-7219.g911cc357.el8. 1/6 2020-11-16T20:52:15.349 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-7219.g911cc357.el8.noarc 2/6 2020-11-16T20:52:15.349 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-7219.g911cc357.el8.n 3/6 2020-11-16T20:52:15.349 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/6 2020-11-16T20:52:15.349 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/6 2020-11-16T20:52:15.422 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2020-11-16T20:52:15.621 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-11-16T20:52:15.634 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 6/6 2020-11-16T20:52:15.635 INFO:teuthology.orchestra.run.smithi059.stdout:Installed products updated. 2020-11-16T20:52:17.649 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-11-16T20:52:18.542 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:18.542 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2020-11-16T20:52:18.543 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards-2:16.0.0-7219.g911cc357.el8.noarch 2020-11-16T20:52:18.543 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard-2:16.0.0-7219.g911cc357.el8.noarch 2020-11-16T20:52:18.543 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts-2:16.0.0-7219.g911cc357.el8.noarch 2020-11-16T20:52:18.543 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-11-16T20:52:18.543 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-11-16T20:52:18.543 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes-2.4.1-12.el8.noarch 2020-11-16T20:52:18.543 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:18.544 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:52:18.646 INFO:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-mgr-diskprediction-local 2020-11-16T20:52:19.008 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 7/8 2020-11-16T20:52:19.027 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:52:19.153 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-7219.g911cc35 8/8 2020-11-16T20:52:19.399 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-7219.g911cc35 8/8 2020-11-16T20:52:19.399 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-7219.g911cc35 1/8 2020-11-16T20:52:19.399 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 2/8 2020-11-16T20:52:19.400 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 3/8 2020-11-16T20:52:19.400 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 4/8 2020-11-16T20:52:19.400 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2020-11-16T20:52:19.400 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 6/8 2020-11-16T20:52:19.400 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 7/8 2020-11-16T20:52:19.670 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 8/8 2020-11-16T20:52:19.671 INFO:teuthology.orchestra.run.smithi166.stdout:Installed products updated. 2020-11-16T20:52:19.885 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 63 kB/s | 2.4 kB 00:00 2020-11-16T20:52:19.995 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 76 kB/s | 2.8 kB 00:00 2020-11-16T20:52:21.455 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:52:21.457 INFO:teuthology.orchestra.run.smithi059.stdout:====================================================================================================================== 2020-11-16T20:52:21.457 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2020-11-16T20:52:21.457 INFO:teuthology.orchestra.run.smithi059.stdout:====================================================================================================================== 2020-11-16T20:52:21.457 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2020-11-16T20:52:21.457 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local noarch 2:16.0.0-7219.g911cc357.el8 ceph-noarch 8.6 M 2020-11-16T20:52:21.457 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2020-11-16T20:52:21.458 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2020-11-16T20:52:21.458 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2020-11-16T20:52:21.458 INFO:teuthology.orchestra.run.smithi059.stdout: openblas x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2020-11-16T20:52:21.458 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-threads x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2020-11-16T20:52:21.458 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2020-11-16T20:52:21.458 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2020-11-16T20:52:21.458 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2020-11-16T20:52:21.459 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:21.459 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2020-11-16T20:52:21.459 INFO:teuthology.orchestra.run.smithi059.stdout:====================================================================================================================== 2020-11-16T20:52:21.459 INFO:teuthology.orchestra.run.smithi059.stdout:Install 8 Packages 2020-11-16T20:52:21.459 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:21.460 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 37 M 2020-11-16T20:52:21.460 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 196 M 2020-11-16T20:52:21.460 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2020-11-16T20:52:21.516 INFO:teuthology.orchestra.run.smithi059.stdout:(1/8): libquadmath-8.3.1-5.1.el8.x86_64.rpm 2.9 MB/s | 169 kB 00:00 2020-11-16T20:52:21.531 INFO:teuthology.orchestra.run.smithi059.stdout:(2/8): libgfortran-8.3.1-5.1.el8.x86_64.rpm 8.6 MB/s | 639 kB 00:00 2020-11-16T20:52:21.568 INFO:teuthology.orchestra.run.smithi059.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 7.3 MB/s | 225 kB 00:00 2020-11-16T20:52:21.631 INFO:teuthology.orchestra.run.smithi059.stdout:(4/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 60 MB/s | 3.7 MB 00:00 2020-11-16T20:52:21.789 INFO:teuthology.orchestra.run.smithi059.stdout:(5/8): python3-scipy-1.0.0-20.module+el8.1.0+33 53 MB/s | 15 MB 00:00 2020-11-16T20:52:21.813 INFO:teuthology.orchestra.run.smithi059.stdout:(6/8): openblas-threads-0.3.3-5.el8.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2020-11-16T20:52:21.865 INFO:teuthology.orchestra.run.smithi059.stdout:(7/8): openblas-0.3.3-5.el8.x86_64.rpm 57 MB/s | 4.3 MB 00:00 2020-11-16T20:52:21.958 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:21.958 INFO:teuthology.orchestra.run.smithi166.stdout:Installed: 2020-11-16T20:52:21.958 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-diskprediction-local-2:16.0.0-7219.g911cc357.el8.noarch 2020-11-16T20:52:21.959 INFO:teuthology.orchestra.run.smithi166.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2020-11-16T20:52:21.959 INFO:teuthology.orchestra.run.smithi166.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2020-11-16T20:52:21.959 INFO:teuthology.orchestra.run.smithi166.stdout: openblas-0.3.3-5.el8.x86_64 2020-11-16T20:52:21.959 INFO:teuthology.orchestra.run.smithi166.stdout: openblas-threads-0.3.3-5.el8.x86_64 2020-11-16T20:52:21.959 INFO:teuthology.orchestra.run.smithi166.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-11-16T20:52:21.959 INFO:teuthology.orchestra.run.smithi166.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-11-16T20:52:21.960 INFO:teuthology.orchestra.run.smithi166.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2020-11-16T20:52:21.960 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:21.960 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:52:22.071 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install ceph-mgr-rook 2020-11-16T20:52:22.201 INFO:teuthology.orchestra.run.smithi059.stdout:(8/8): ceph-mgr-diskprediction-local-16.0.0-721 12 MB/s | 8.6 MB 00:00 2020-11-16T20:52:22.203 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:52:22.203 INFO:teuthology.orchestra.run.smithi059.stdout:Total 49 MB/s | 37 MB 00:00 2020-11-16T20:52:22.213 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2020-11-16T20:52:22.233 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2020-11-16T20:52:22.234 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2020-11-16T20:52:22.425 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:52:22.552 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2020-11-16T20:52:22.555 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2020-11-16T20:52:22.940 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 82 kB/s | 2.4 kB 00:00 2020-11-16T20:52:23.040 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 94 kB/s | 2.8 kB 00:00 2020-11-16T20:52:23.144 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2020-11-16T20:52:23.297 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 1/8 2020-11-16T20:52:23.439 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 1/8 2020-11-16T20:52:23.588 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 2/8 2020-11-16T20:52:24.149 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 2/8 2020-11-16T20:52:24.321 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 3/8 2020-11-16T20:52:24.414 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:52:24.416 INFO:teuthology.orchestra.run.smithi166.stdout:======================================================================================================== 2020-11-16T20:52:24.417 INFO:teuthology.orchestra.run.smithi166.stdout: Package Arch Version Repository Size 2020-11-16T20:52:24.417 INFO:teuthology.orchestra.run.smithi166.stdout:======================================================================================================== 2020-11-16T20:52:24.417 INFO:teuthology.orchestra.run.smithi166.stdout:Installing: 2020-11-16T20:52:24.417 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-rook noarch 2:16.0.0-7219.g911cc357.el8 ceph-noarch 27 k 2020-11-16T20:52:24.417 INFO:teuthology.orchestra.run.smithi166.stdout:Installing dependencies: 2020-11-16T20:52:24.417 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-11-16T20:52:24.417 INFO:teuthology.orchestra.run.smithi166.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-11-16T20:52:24.418 INFO:teuthology.orchestra.run.smithi166.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-11-16T20:52:24.418 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-16T20:52:24.418 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2020-11-16T20:52:24.418 INFO:teuthology.orchestra.run.smithi166.stdout: python3-kubernetes noarch 11.0.0-2.el8 epel 1.2 M 2020-11-16T20:52:24.418 INFO:teuthology.orchestra.run.smithi166.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2020-11-16T20:52:24.418 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2020-11-16T20:52:24.419 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2020-11-16T20:52:24.419 INFO:teuthology.orchestra.run.smithi166.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-16T20:52:24.419 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rsa noarch 3.4.2-15.el8 epel 73 k 2020-11-16T20:52:24.419 INFO:teuthology.orchestra.run.smithi166.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-11-16T20:52:24.419 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:24.419 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction Summary 2020-11-16T20:52:24.419 INFO:teuthology.orchestra.run.smithi166.stdout:======================================================================================================== 2020-11-16T20:52:24.420 INFO:teuthology.orchestra.run.smithi166.stdout:Install 13 Packages 2020-11-16T20:52:24.420 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:24.420 INFO:teuthology.orchestra.run.smithi166.stdout:Total download size: 1.9 M 2020-11-16T20:52:24.420 INFO:teuthology.orchestra.run.smithi166.stdout:Installed size: 24 M 2020-11-16T20:52:24.421 INFO:teuthology.orchestra.run.smithi166.stdout:Downloading Packages: 2020-11-16T20:52:24.480 INFO:teuthology.orchestra.run.smithi166.stdout:(1/13): python3-cachetools-3.1.1-4.el8.noarch.r 539 kB/s | 33 kB 00:00 2020-11-16T20:52:24.489 INFO:teuthology.orchestra.run.smithi166.stdout:(2/13): python3-certifi-2018.10.15-7.el8.noarch 234 kB/s | 16 kB 00:00 2020-11-16T20:52:24.513 INFO:teuthology.orchestra.run.smithi166.stdout:(3/13): python3-google-auth-1.1.1-10.el8.noarch 2.4 MB/s | 81 kB 00:00 2020-11-16T20:52:24.530 INFO:teuthology.orchestra.run.smithi166.stdout:(4/13): python3-rsa-3.4.2-15.el8.noarch.rpm 4.3 MB/s | 73 kB 00:00 2020-11-16T20:52:24.543 INFO:teuthology.orchestra.run.smithi166.stdout:(5/13): ceph-mgr-rook-16.0.0-7219.g911cc357.el8 219 kB/s | 27 kB 00:00 2020-11-16T20:52:24.546 INFO:teuthology.orchestra.run.smithi166.stdout:(6/13): python3-websocket-client-0.56.0-5.el8.n 3.6 MB/s | 61 kB 00:00 2020-11-16T20:52:24.582 INFO:teuthology.orchestra.run.smithi166.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 1.1 MB/s | 43 kB 00:00 2020-11-16T20:52:24.590 INFO:teuthology.orchestra.run.smithi166.stdout:(8/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 3.5 MB/s | 155 kB 00:00 2020-11-16T20:52:24.602 INFO:teuthology.orchestra.run.smithi166.stdout:(9/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 1.3 MB/s | 27 kB 00:00 2020-11-16T20:52:24.613 INFO:teuthology.orchestra.run.smithi166.stdout:(10/13): python3-jsonpointer-1.10-11.el8.noarch 882 kB/s | 20 kB 00:00 2020-11-16T20:52:24.626 INFO:teuthology.orchestra.run.smithi166.stdout:(11/13): python3-kubernetes-11.0.0-2.el8.noarch 8.5 MB/s | 1.2 MB 00:00 2020-11-16T20:52:24.627 INFO:teuthology.orchestra.run.smithi166.stdout:(12/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 5.9 MB/s | 126 kB 00:00 2020-11-16T20:52:24.639 INFO:teuthology.orchestra.run.smithi166.stdout:(13/13): python3-pyasn1-modules-0.3.7-6.el8.noa 4.1 MB/s | 110 kB 00:00 2020-11-16T20:52:24.640 INFO:teuthology.orchestra.run.smithi166.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:52:24.640 INFO:teuthology.orchestra.run.smithi166.stdout:Total 8.6 MB/s | 1.9 MB 00:00 2020-11-16T20:52:24.645 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction check 2020-11-16T20:52:24.659 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction check succeeded. 2020-11-16T20:52:24.659 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction test 2020-11-16T20:52:24.726 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction test succeeded. 2020-11-16T20:52:24.729 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction 2020-11-16T20:52:24.842 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 3/8 2020-11-16T20:52:24.997 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-0.3.3-5.el8.x86_64 4/8 2020-11-16T20:52:25.218 INFO:teuthology.orchestra.run.smithi166.stdout: Preparing : 1/1 2020-11-16T20:52:25.454 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2020-11-16T20:52:25.635 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-rsa-3.4.2-15.el8.noarch 2/13 2020-11-16T20:52:25.827 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/13 2020-11-16T20:52:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 4/8 2020-11-16T20:52:26.027 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 4/13 2020-11-16T20:52:26.181 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2020-11-16T20:52:26.231 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 5/13 2020-11-16T20:52:26.371 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-11-16T20:52:26.452 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2020-11-16T20:52:26.691 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2020-11-16T20:52:26.869 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 8/13 2020-11-16T20:52:27.060 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 9/13 2020-11-16T20:52:27.285 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 10/13 2020-11-16T20:52:28.461 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 11/13 2020-11-16T20:52:28.571 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-11-16T20:52:28.695 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 12/13 2020-11-16T20:52:28.881 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-mgr-rook-2:16.0.0-7219.g911cc357.el8.noarch 13/13 2020-11-16T20:52:29.100 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-7219.g911cc357.el8.noarch 13/13 2020-11-16T20:52:29.100 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-mgr-rook-2:16.0.0-7219.g911cc357.el8.noarch 1/13 2020-11-16T20:52:29.101 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/13 2020-11-16T20:52:29.101 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/13 2020-11-16T20:52:29.101 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/13 2020-11-16T20:52:29.101 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 5/13 2020-11-16T20:52:29.101 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 6/13 2020-11-16T20:52:29.101 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/13 2020-11-16T20:52:29.101 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 8/13 2020-11-16T20:52:29.102 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 9/13 2020-11-16T20:52:29.102 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 10/13 2020-11-16T20:52:29.102 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 11/13 2020-11-16T20:52:29.102 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 12/13 2020-11-16T20:52:29.418 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 13/13 2020-11-16T20:52:29.419 INFO:teuthology.orchestra.run.smithi166.stdout:Installed products updated. 2020-11-16T20:52:29.975 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 7/8 2020-11-16T20:52:30.162 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-7219.g911cc35 8/8 2020-11-16T20:52:30.419 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-7219.g911cc35 8/8 2020-11-16T20:52:30.420 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-7219.g911cc35 1/8 2020-11-16T20:52:30.420 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 2/8 2020-11-16T20:52:30.420 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 3/8 2020-11-16T20:52:30.420 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 4/8 2020-11-16T20:52:30.420 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2020-11-16T20:52:30.420 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 6/8 2020-11-16T20:52:30.421 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 7/8 2020-11-16T20:52:30.719 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 8/8 2020-11-16T20:52:30.719 INFO:teuthology.orchestra.run.smithi059.stdout:Installed products updated. 2020-11-16T20:52:31.690 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:31.690 INFO:teuthology.orchestra.run.smithi166.stdout:Installed: 2020-11-16T20:52:31.690 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-rook-2:16.0.0-7219.g911cc357.el8.noarch 2020-11-16T20:52:31.690 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-11-16T20:52:31.691 INFO:teuthology.orchestra.run.smithi166.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-11-16T20:52:31.691 INFO:teuthology.orchestra.run.smithi166.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-11-16T20:52:31.691 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-11-16T20:52:31.691 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-11-16T20:52:31.691 INFO:teuthology.orchestra.run.smithi166.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-11-16T20:52:31.691 INFO:teuthology.orchestra.run.smithi166.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-11-16T20:52:31.691 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-11-16T20:52:31.692 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-11-16T20:52:31.692 INFO:teuthology.orchestra.run.smithi166.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-11-16T20:52:31.692 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rsa-3.4.2-15.el8.noarch 2020-11-16T20:52:31.692 INFO:teuthology.orchestra.run.smithi166.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-11-16T20:52:31.692 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:31.692 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:52:31.812 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install ceph-mgr-cephadm 2020-11-16T20:52:32.170 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:52:32.702 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 82 kB/s | 2.4 kB 00:00 2020-11-16T20:52:32.800 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 96 kB/s | 2.8 kB 00:00 2020-11-16T20:52:33.066 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:33.066 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2020-11-16T20:52:33.066 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local-2:16.0.0-7219.g911cc357.el8.noarch 2020-11-16T20:52:33.067 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2020-11-16T20:52:33.067 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2020-11-16T20:52:33.067 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-0.3.3-5.el8.x86_64 2020-11-16T20:52:33.067 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-threads-0.3.3-5.el8.x86_64 2020-11-16T20:52:33.067 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-11-16T20:52:33.067 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-11-16T20:52:33.067 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2020-11-16T20:52:33.068 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:33.068 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:52:33.175 INFO:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-mgr-rook 2020-11-16T20:52:33.559 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:52:34.160 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:52:34.161 INFO:teuthology.orchestra.run.smithi166.stdout:=============================================================================================== 2020-11-16T20:52:34.161 INFO:teuthology.orchestra.run.smithi166.stdout: Package Arch Version Repository Size 2020-11-16T20:52:34.162 INFO:teuthology.orchestra.run.smithi166.stdout:=============================================================================================== 2020-11-16T20:52:34.162 INFO:teuthology.orchestra.run.smithi166.stdout:Installing: 2020-11-16T20:52:34.162 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-cephadm noarch 2:16.0.0-7219.g911cc357.el8 ceph-noarch 66 k 2020-11-16T20:52:34.162 INFO:teuthology.orchestra.run.smithi166.stdout:Installing dependencies: 2020-11-16T20:52:34.162 INFO:teuthology.orchestra.run.smithi166.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2020-11-16T20:52:34.162 INFO:teuthology.orchestra.run.smithi166.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2020-11-16T20:52:34.162 INFO:teuthology.orchestra.run.smithi166.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2020-11-16T20:52:34.163 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2020-11-16T20:52:34.163 INFO:teuthology.orchestra.run.smithi166.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2020-11-16T20:52:34.163 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:34.163 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction Summary 2020-11-16T20:52:34.163 INFO:teuthology.orchestra.run.smithi166.stdout:=============================================================================================== 2020-11-16T20:52:34.163 INFO:teuthology.orchestra.run.smithi166.stdout:Install 6 Packages 2020-11-16T20:52:34.163 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:34.164 INFO:teuthology.orchestra.run.smithi166.stdout:Total download size: 5.8 M 2020-11-16T20:52:34.164 INFO:teuthology.orchestra.run.smithi166.stdout:Installed size: 24 M 2020-11-16T20:52:34.164 INFO:teuthology.orchestra.run.smithi166.stdout:Downloading Packages: 2020-11-16T20:52:34.195 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 57 kB/s | 2.4 kB 00:00 2020-11-16T20:52:34.213 INFO:teuthology.orchestra.run.smithi166.stdout:(1/6): python3-apipkg-1.5-6.el8.noarch.rpm 430 kB/s | 21 kB 00:00 2020-11-16T20:52:34.245 INFO:teuthology.orchestra.run.smithi166.stdout:(2/6): python3-remoto-1.1.4-4.el8.noarch.rpm 1.5 MB/s | 48 kB 00:00 2020-11-16T20:52:34.263 INFO:teuthology.orchestra.run.smithi166.stdout:(3/6): python3-execnet-1.7.1-1.el8.noarch.rpm 3.5 MB/s | 355 kB 00:00 2020-11-16T20:52:34.283 INFO:teuthology.orchestra.run.smithi166.stdout:(4/6): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 14 MB/s | 538 kB 00:00 2020-11-16T20:52:34.307 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 73 kB/s | 2.8 kB 00:00 2020-11-16T20:52:34.310 INFO:teuthology.orchestra.run.smithi166.stdout:(5/6): ceph-mgr-cephadm-16.0.0-7219.g911cc357.e 450 kB/s | 66 kB 00:00 2020-11-16T20:52:34.324 INFO:teuthology.orchestra.run.smithi166.stdout:(6/6): python3-babel-2.5.1-5.el8.noarch.rpm 79 MB/s | 4.8 MB 00:00 2020-11-16T20:52:34.325 INFO:teuthology.orchestra.run.smithi166.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:52:34.326 INFO:teuthology.orchestra.run.smithi166.stdout:Total 36 MB/s | 5.8 MB 00:00 2020-11-16T20:52:34.328 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction check 2020-11-16T20:52:34.337 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction check succeeded. 2020-11-16T20:52:34.337 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction test 2020-11-16T20:52:34.410 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction test succeeded. 2020-11-16T20:52:34.413 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction 2020-11-16T20:52:35.526 INFO:teuthology.orchestra.run.smithi166.stdout: Preparing : 1/1 2020-11-16T20:52:35.779 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:52:35.781 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================================== 2020-11-16T20:52:35.781 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2020-11-16T20:52:35.782 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================================== 2020-11-16T20:52:35.782 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2020-11-16T20:52:35.782 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook noarch 2:16.0.0-7219.g911cc357.el8 ceph-noarch 27 k 2020-11-16T20:52:35.782 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2020-11-16T20:52:35.782 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-11-16T20:52:35.782 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-11-16T20:52:35.783 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-11-16T20:52:35.783 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-16T20:52:35.783 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2020-11-16T20:52:35.783 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes noarch 11.0.0-2.el8 epel 1.2 M 2020-11-16T20:52:35.783 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2020-11-16T20:52:35.783 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2020-11-16T20:52:35.783 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2020-11-16T20:52:35.784 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-16T20:52:35.784 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa noarch 3.4.2-15.el8 epel 73 k 2020-11-16T20:52:35.784 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-11-16T20:52:35.784 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:35.784 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2020-11-16T20:52:35.784 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================================== 2020-11-16T20:52:35.784 INFO:teuthology.orchestra.run.smithi059.stdout:Install 13 Packages 2020-11-16T20:52:35.785 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:35.785 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 1.9 M 2020-11-16T20:52:35.785 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 24 M 2020-11-16T20:52:35.786 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2020-11-16T20:52:35.834 INFO:teuthology.orchestra.run.smithi059.stdout:(1/13): python3-cachetools-3.1.1-4.el8.noarch.r 670 kB/s | 33 kB 00:00 2020-11-16T20:52:35.844 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 1/6 2020-11-16T20:52:35.866 INFO:teuthology.orchestra.run.smithi059.stdout:(2/13): python3-google-auth-1.1.1-10.el8.noarch 2.5 MB/s | 81 kB 00:00 2020-11-16T20:52:35.908 INFO:teuthology.orchestra.run.smithi059.stdout:(3/13): ceph-mgr-rook-16.0.0-7219.g911cc357.el8 220 kB/s | 27 kB 00:00 2020-11-16T20:52:35.950 INFO:teuthology.orchestra.run.smithi059.stdout:(4/13): python3-kubernetes-11.0.0-2.el8.noarch. 14 MB/s | 1.2 MB 00:00 2020-11-16T20:52:35.967 INFO:teuthology.orchestra.run.smithi059.stdout:(5/13): python3-websocket-client-0.56.0-5.el8.n 3.6 MB/s | 61 kB 00:00 2020-11-16T20:52:36.004 INFO:teuthology.orchestra.run.smithi059.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 1.1 MB/s | 43 kB 00:00 2020-11-16T20:52:36.030 INFO:teuthology.orchestra.run.smithi059.stdout:(7/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 5.8 MB/s | 155 kB 00:00 2020-11-16T20:52:36.034 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 2/6 2020-11-16T20:52:36.055 INFO:teuthology.orchestra.run.smithi059.stdout:(8/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 1.1 MB/s | 27 kB 00:00 2020-11-16T20:52:36.079 INFO:teuthology.orchestra.run.smithi059.stdout:(9/13): python3-jsonpointer-1.10-11.el8.noarch. 834 kB/s | 20 kB 00:00 2020-11-16T20:52:36.101 INFO:teuthology.orchestra.run.smithi059.stdout:(10/13): python3-certifi-2018.10.15-7.el8.noarc 51 kB/s | 16 kB 00:00 2020-11-16T20:52:36.113 INFO:teuthology.orchestra.run.smithi059.stdout:(11/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.6 MB/s | 126 kB 00:00 2020-11-16T20:52:36.139 INFO:teuthology.orchestra.run.smithi059.stdout:(12/13): python3-pyasn1-modules-0.3.7-6.el8.noa 2.8 MB/s | 110 kB 00:00 2020-11-16T20:52:36.268 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 3/6 2020-11-16T20:52:36.526 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 4/6 2020-11-16T20:52:36.688 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 5/6 2020-11-16T20:52:36.730 INFO:teuthology.orchestra.run.smithi059.stdout:(13/13): python3-rsa-3.4.2-15.el8.noarch.rpm 89 kB/s | 73 kB 00:00 2020-11-16T20:52:36.732 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:52:36.732 INFO:teuthology.orchestra.run.smithi059.stdout:Total 2.0 MB/s | 1.9 MB 00:00 2020-11-16T20:52:36.738 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2020-11-16T20:52:36.755 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2020-11-16T20:52:36.755 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2020-11-16T20:52:36.829 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2020-11-16T20:52:36.832 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2020-11-16T20:52:37.026 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-7219.g911cc357.el8.noarch 6/6 2020-11-16T20:52:37.271 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-7219.g911cc357.el8.noarch 6/6 2020-11-16T20:52:37.271 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-7219.g911cc357.el8.noarch 1/6 2020-11-16T20:52:37.271 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 2/6 2020-11-16T20:52:37.271 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 3/6 2020-11-16T20:52:37.271 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 4/6 2020-11-16T20:52:37.271 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 5/6 2020-11-16T20:52:37.343 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2020-11-16T20:52:37.537 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 6/6 2020-11-16T20:52:37.538 INFO:teuthology.orchestra.run.smithi166.stdout:Installed products updated. 2020-11-16T20:52:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2020-11-16T20:52:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rsa-3.4.2-15.el8.noarch 2/13 2020-11-16T20:52:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/13 2020-11-16T20:52:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 4/13 2020-11-16T20:52:38.396 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 5/13 2020-11-16T20:52:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2020-11-16T20:52:38.801 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2020-11-16T20:52:39.003 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 8/13 2020-11-16T20:52:39.213 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 9/13 2020-11-16T20:52:39.417 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 10/13 2020-11-16T20:52:39.822 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:39.823 INFO:teuthology.orchestra.run.smithi166.stdout:Installed: 2020-11-16T20:52:39.823 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-cephadm-2:16.0.0-7219.g911cc357.el8.noarch 2020-11-16T20:52:39.823 INFO:teuthology.orchestra.run.smithi166.stdout: python3-apipkg-1.5-6.el8.noarch 2020-11-16T20:52:39.823 INFO:teuthology.orchestra.run.smithi166.stdout: python3-babel-2.5.1-5.el8.noarch 2020-11-16T20:52:39.823 INFO:teuthology.orchestra.run.smithi166.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-11-16T20:52:39.823 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-11-16T20:52:39.823 INFO:teuthology.orchestra.run.smithi166.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-11-16T20:52:39.824 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:39.824 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:52:39.922 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install ceph-fuse 2020-11-16T20:52:40.281 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:52:40.639 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 11/13 2020-11-16T20:52:40.818 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 83 kB/s | 2.4 kB 00:00 2020-11-16T20:52:40.917 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 98 kB/s | 2.8 kB 00:00 2020-11-16T20:52:40.929 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 12/13 2020-11-16T20:52:41.076 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-rook-2:16.0.0-7219.g911cc357.el8.noarch 13/13 2020-11-16T20:52:41.339 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-7219.g911cc357.el8.noarch 13/13 2020-11-16T20:52:41.340 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-rook-2:16.0.0-7219.g911cc357.el8.noarch 1/13 2020-11-16T20:52:41.340 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/13 2020-11-16T20:52:41.340 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/13 2020-11-16T20:52:41.340 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/13 2020-11-16T20:52:41.340 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 5/13 2020-11-16T20:52:41.340 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 6/13 2020-11-16T20:52:41.341 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/13 2020-11-16T20:52:41.341 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 8/13 2020-11-16T20:52:41.341 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 9/13 2020-11-16T20:52:41.341 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 10/13 2020-11-16T20:52:41.341 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 11/13 2020-11-16T20:52:41.341 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 12/13 2020-11-16T20:52:41.722 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 13/13 2020-11-16T20:52:41.723 INFO:teuthology.orchestra.run.smithi059.stdout:Installed products updated. 2020-11-16T20:52:42.295 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:52:42.295 INFO:teuthology.orchestra.run.smithi166.stdout:======================================================================================= 2020-11-16T20:52:42.296 INFO:teuthology.orchestra.run.smithi166.stdout: Package Arch Version Repository Size 2020-11-16T20:52:42.296 INFO:teuthology.orchestra.run.smithi166.stdout:======================================================================================= 2020-11-16T20:52:42.296 INFO:teuthology.orchestra.run.smithi166.stdout:Installing: 2020-11-16T20:52:42.296 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-fuse x86_64 2:16.0.0-7219.g911cc357.el8 ceph 624 k 2020-11-16T20:52:42.296 INFO:teuthology.orchestra.run.smithi166.stdout:Installing dependencies: 2020-11-16T20:52:42.296 INFO:teuthology.orchestra.run.smithi166.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2020-11-16T20:52:42.296 INFO:teuthology.orchestra.run.smithi166.stdout: fuse-common x86_64 3.2.1-12.el8 rhel-8-for-x86_64-baseos-rpms 21 k 2020-11-16T20:52:42.297 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:42.297 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction Summary 2020-11-16T20:52:42.297 INFO:teuthology.orchestra.run.smithi166.stdout:======================================================================================= 2020-11-16T20:52:42.297 INFO:teuthology.orchestra.run.smithi166.stdout:Install 3 Packages 2020-11-16T20:52:42.297 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:42.298 INFO:teuthology.orchestra.run.smithi166.stdout:Total download size: 728 k 2020-11-16T20:52:42.298 INFO:teuthology.orchestra.run.smithi166.stdout:Installed size: 1.9 M 2020-11-16T20:52:42.298 INFO:teuthology.orchestra.run.smithi166.stdout:Downloading Packages: 2020-11-16T20:52:42.340 INFO:teuthology.orchestra.run.smithi166.stdout:(1/3): fuse-2.9.7-12.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2020-11-16T20:52:42.343 INFO:teuthology.orchestra.run.smithi166.stdout:(2/3): fuse-common-3.2.1-12.el8.x86_64.rpm 461 kB/s | 21 kB 00:00 2020-11-16T20:52:42.515 INFO:teuthology.orchestra.run.smithi166.stdout:(3/3): ceph-fuse-16.0.0-7219.g911cc357.el8.x86_ 2.8 MB/s | 624 kB 00:00 2020-11-16T20:52:42.516 INFO:teuthology.orchestra.run.smithi166.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:52:42.516 INFO:teuthology.orchestra.run.smithi166.stdout:Total 3.2 MB/s | 728 kB 00:00 2020-11-16T20:52:42.518 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction check 2020-11-16T20:52:42.539 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction check succeeded. 2020-11-16T20:52:42.539 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction test 2020-11-16T20:52:42.607 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction test succeeded. 2020-11-16T20:52:42.610 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction 2020-11-16T20:52:42.818 INFO:teuthology.orchestra.run.smithi166.stdout: Preparing : 1/1 2020-11-16T20:52:42.818 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 1/3 2020-11-16T20:52:42.818 INFO:teuthology.orchestra.run.smithi166.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-11-16T20:52:42.819 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:43.134 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : fuse-2.9.7-12.el8.x86_64 2/3 2020-11-16T20:52:43.307 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : ceph-fuse-2:16.0.0-7219.g911cc357.el8.x86_64 3/3 2020-11-16T20:52:43.635 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: ceph-fuse-2:16.0.0-7219.g911cc357.el8.x86_64 3/3 2020-11-16T20:52:43.636 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : ceph-fuse-2:16.0.0-7219.g911cc357.el8.x86_64 1/3 2020-11-16T20:52:43.636 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/3 2020-11-16T20:52:43.892 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 3/3 2020-11-16T20:52:43.893 INFO:teuthology.orchestra.run.smithi166.stdout:Installed products updated. 2020-11-16T20:52:44.153 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:44.153 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2020-11-16T20:52:44.153 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook-2:16.0.0-7219.g911cc357.el8.noarch 2020-11-16T20:52:44.154 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-11-16T20:52:44.154 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-11-16T20:52:44.154 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-11-16T20:52:44.154 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-11-16T20:52:44.154 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-11-16T20:52:44.154 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-11-16T20:52:44.155 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-11-16T20:52:44.155 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-11-16T20:52:44.155 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-11-16T20:52:44.155 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-11-16T20:52:44.155 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa-3.4.2-15.el8.noarch 2020-11-16T20:52:44.155 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-11-16T20:52:44.155 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:44.156 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:52:44.251 INFO:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-mgr-cephadm 2020-11-16T20:52:44.637 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:52:45.221 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 65 kB/s | 2.4 kB 00:00 2020-11-16T20:52:45.331 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 78 kB/s | 2.8 kB 00:00 2020-11-16T20:52:46.228 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:46.228 INFO:teuthology.orchestra.run.smithi166.stdout:Installed: 2020-11-16T20:52:46.228 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-fuse-2:16.0.0-7219.g911cc357.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2020-11-16T20:52:46.228 INFO:teuthology.orchestra.run.smithi166.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-11-16T20:52:46.228 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:46.229 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:52:46.338 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install librados-devel 2020-11-16T20:52:46.701 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:52:46.791 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:52:46.792 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================================== 2020-11-16T20:52:46.792 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2020-11-16T20:52:46.793 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================================== 2020-11-16T20:52:46.793 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2020-11-16T20:52:46.793 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm noarch 2:16.0.0-7219.g911cc357.el8 ceph-noarch 66 k 2020-11-16T20:52:46.793 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2020-11-16T20:52:46.793 INFO:teuthology.orchestra.run.smithi059.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2020-11-16T20:52:46.793 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2020-11-16T20:52:46.794 INFO:teuthology.orchestra.run.smithi059.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2020-11-16T20:52:46.794 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2020-11-16T20:52:46.794 INFO:teuthology.orchestra.run.smithi059.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2020-11-16T20:52:46.794 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:46.794 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2020-11-16T20:52:46.794 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================================== 2020-11-16T20:52:46.794 INFO:teuthology.orchestra.run.smithi059.stdout:Install 6 Packages 2020-11-16T20:52:46.795 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:46.795 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 5.8 M 2020-11-16T20:52:46.795 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 24 M 2020-11-16T20:52:46.795 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2020-11-16T20:52:46.854 INFO:teuthology.orchestra.run.smithi059.stdout:(1/6): python3-apipkg-1.5-6.el8.noarch.rpm 358 kB/s | 21 kB 00:00 2020-11-16T20:52:46.893 INFO:teuthology.orchestra.run.smithi059.stdout:(2/6): python3-remoto-1.1.4-4.el8.noarch.rpm 1.2 MB/s | 48 kB 00:00 2020-11-16T20:52:46.916 INFO:teuthology.orchestra.run.smithi059.stdout:(3/6): python3-execnet-1.7.1-1.el8.noarch.rpm 2.9 MB/s | 355 kB 00:00 2020-11-16T20:52:46.937 INFO:teuthology.orchestra.run.smithi059.stdout:(4/6): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 12 MB/s | 538 kB 00:00 2020-11-16T20:52:46.944 INFO:teuthology.orchestra.run.smithi059.stdout:(5/6): ceph-mgr-cephadm-16.0.0-7219.g911cc357.e 442 kB/s | 66 kB 00:00 2020-11-16T20:52:46.986 INFO:teuthology.orchestra.run.smithi059.stdout:(6/6): python3-babel-2.5.1-5.el8.noarch.rpm 69 MB/s | 4.8 MB 00:00 2020-11-16T20:52:46.987 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:52:46.988 INFO:teuthology.orchestra.run.smithi059.stdout:Total 30 MB/s | 5.8 MB 00:00 2020-11-16T20:52:46.991 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2020-11-16T20:52:47.000 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2020-11-16T20:52:47.000 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2020-11-16T20:52:47.079 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2020-11-16T20:52:47.082 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2020-11-16T20:52:47.272 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 81 kB/s | 2.4 kB 00:00 2020-11-16T20:52:47.370 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 97 kB/s | 2.8 kB 00:00 2020-11-16T20:52:48.257 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2020-11-16T20:52:48.615 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 1/6 2020-11-16T20:52:48.834 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 2/6 2020-11-16T20:52:49.050 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 3/6 2020-11-16T20:52:49.262 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 4/6 2020-11-16T20:52:49.481 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 5/6 2020-11-16T20:52:49.591 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:52:49.592 INFO:teuthology.orchestra.run.smithi166.stdout:================================================================================ 2020-11-16T20:52:49.592 INFO:teuthology.orchestra.run.smithi166.stdout: Package Arch Version Repo Size 2020-11-16T20:52:49.592 INFO:teuthology.orchestra.run.smithi166.stdout:================================================================================ 2020-11-16T20:52:49.592 INFO:teuthology.orchestra.run.smithi166.stdout:Installing: 2020-11-16T20:52:49.592 INFO:teuthology.orchestra.run.smithi166.stdout: librados-devel x86_64 2:16.0.0-7219.g911cc357.el8 ceph 131 k 2020-11-16T20:52:49.592 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:49.592 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction Summary 2020-11-16T20:52:49.593 INFO:teuthology.orchestra.run.smithi166.stdout:================================================================================ 2020-11-16T20:52:49.593 INFO:teuthology.orchestra.run.smithi166.stdout:Install 1 Package 2020-11-16T20:52:49.593 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:49.593 INFO:teuthology.orchestra.run.smithi166.stdout:Total download size: 131 k 2020-11-16T20:52:49.594 INFO:teuthology.orchestra.run.smithi166.stdout:Installed size: 430 k 2020-11-16T20:52:49.594 INFO:teuthology.orchestra.run.smithi166.stdout:Downloading Packages: 2020-11-16T20:52:49.651 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-7219.g911cc357.el8.noarch 6/6 2020-11-16T20:52:49.762 INFO:teuthology.orchestra.run.smithi166.stdout:librados-devel-16.0.0-7219.g911cc357.el8.x86_64 775 kB/s | 131 kB 00:00 2020-11-16T20:52:49.762 INFO:teuthology.orchestra.run.smithi166.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:52:49.763 INFO:teuthology.orchestra.run.smithi166.stdout:Total 769 kB/s | 131 kB 00:00 2020-11-16T20:52:49.763 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction check 2020-11-16T20:52:49.769 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction check succeeded. 2020-11-16T20:52:49.769 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction test 2020-11-16T20:52:49.821 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction test succeeded. 2020-11-16T20:52:49.825 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction 2020-11-16T20:52:49.890 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-7219.g911cc357.el8.noarch 6/6 2020-11-16T20:52:49.890 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-7219.g911cc357.el8.noarch 1/6 2020-11-16T20:52:49.891 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 2/6 2020-11-16T20:52:49.891 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 3/6 2020-11-16T20:52:49.891 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 4/6 2020-11-16T20:52:49.891 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 5/6 2020-11-16T20:52:49.935 INFO:teuthology.orchestra.run.smithi166.stdout: Preparing : 1/1 2020-11-16T20:52:50.122 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : librados-devel-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:52:50.197 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 6/6 2020-11-16T20:52:50.197 INFO:teuthology.orchestra.run.smithi059.stdout:Installed products updated. 2020-11-16T20:52:50.369 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: librados-devel-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:52:50.615 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : librados-devel-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:52:50.616 INFO:teuthology.orchestra.run.smithi166.stdout:Installed products updated. 2020-11-16T20:52:52.624 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:52.624 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2020-11-16T20:52:52.624 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm-2:16.0.0-7219.g911cc357.el8.noarch 2020-11-16T20:52:52.624 INFO:teuthology.orchestra.run.smithi059.stdout: python3-apipkg-1.5-6.el8.noarch 2020-11-16T20:52:52.624 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel-2.5.1-5.el8.noarch 2020-11-16T20:52:52.625 INFO:teuthology.orchestra.run.smithi059.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-11-16T20:52:52.625 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-11-16T20:52:52.625 INFO:teuthology.orchestra.run.smithi059.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-11-16T20:52:52.625 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:52.625 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:52:52.720 INFO:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-fuse 2020-11-16T20:52:52.966 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:52.966 INFO:teuthology.orchestra.run.smithi166.stdout:Installed: 2020-11-16T20:52:52.966 INFO:teuthology.orchestra.run.smithi166.stdout: librados-devel-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:52:52.967 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:52.967 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:52:53.063 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install libcephfs2 2020-11-16T20:52:53.108 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:52:53.424 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:52:53.719 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 54 kB/s | 2.4 kB 00:00 2020-11-16T20:52:53.836 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 65 kB/s | 2.8 kB 00:00 2020-11-16T20:52:53.984 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 84 kB/s | 2.4 kB 00:00 2020-11-16T20:52:54.090 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 77 kB/s | 2.8 kB 00:00 2020-11-16T20:52:55.149 INFO:teuthology.orchestra.run.smithi166.stdout:Package libcephfs2-2:16.0.0-7219.g911cc357.el8.x86_64 is already installed. 2020-11-16T20:52:55.301 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:52:55.301 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================= 2020-11-16T20:52:55.302 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2020-11-16T20:52:55.302 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================= 2020-11-16T20:52:55.302 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2020-11-16T20:52:55.302 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse x86_64 2:16.0.0-7219.g911cc357.el8 ceph 624 k 2020-11-16T20:52:55.302 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2020-11-16T20:52:55.302 INFO:teuthology.orchestra.run.smithi059.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2020-11-16T20:52:55.303 INFO:teuthology.orchestra.run.smithi059.stdout: fuse-common x86_64 3.2.1-12.el8 rhel-8-for-x86_64-baseos-rpms 21 k 2020-11-16T20:52:55.303 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:55.303 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2020-11-16T20:52:55.303 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================= 2020-11-16T20:52:55.303 INFO:teuthology.orchestra.run.smithi059.stdout:Install 3 Packages 2020-11-16T20:52:55.303 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:55.304 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 728 k 2020-11-16T20:52:55.304 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 1.9 M 2020-11-16T20:52:55.304 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2020-11-16T20:52:55.360 INFO:teuthology.orchestra.run.smithi059.stdout:(1/3): fuse-2.9.7-12.el8.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2020-11-16T20:52:55.366 INFO:teuthology.orchestra.run.smithi059.stdout:(2/3): fuse-common-3.2.1-12.el8.x86_64.rpm 335 kB/s | 21 kB 00:00 2020-11-16T20:52:55.449 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:52:55.450 INFO:teuthology.orchestra.run.smithi166.stdout:Nothing to do. 2020-11-16T20:52:55.451 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:52:55.531 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install libcephfs-devel 2020-11-16T20:52:55.533 INFO:teuthology.orchestra.run.smithi059.stdout:(3/3): ceph-fuse-16.0.0-7219.g911cc357.el8.x86_ 2.6 MB/s | 624 kB 00:00 2020-11-16T20:52:55.534 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:52:55.534 INFO:teuthology.orchestra.run.smithi059.stdout:Total 3.1 MB/s | 728 kB 00:00 2020-11-16T20:52:55.537 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2020-11-16T20:52:55.559 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2020-11-16T20:52:55.560 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2020-11-16T20:52:55.634 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2020-11-16T20:52:55.638 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2020-11-16T20:52:55.845 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2020-11-16T20:52:55.845 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 1/3 2020-11-16T20:52:55.845 INFO:teuthology.orchestra.run.smithi059.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-11-16T20:52:55.846 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:55.891 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:52:56.322 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fuse-2.9.7-12.el8.x86_64 2/3 2020-11-16T20:52:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-fuse-2:16.0.0-7219.g911cc357.el8.x86_64 3/3 2020-11-16T20:52:56.466 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 80 kB/s | 2.4 kB 00:00 2020-11-16T20:52:56.567 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 97 kB/s | 2.8 kB 00:00 2020-11-16T20:52:56.824 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-fuse-2:16.0.0-7219.g911cc357.el8.x86_64 3/3 2020-11-16T20:52:56.824 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-fuse-2:16.0.0-7219.g911cc357.el8.x86_64 1/3 2020-11-16T20:52:56.824 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/3 2020-11-16T20:52:57.149 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 3/3 2020-11-16T20:52:57.149 INFO:teuthology.orchestra.run.smithi059.stdout:Installed products updated. 2020-11-16T20:52:57.937 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:52:57.938 INFO:teuthology.orchestra.run.smithi166.stdout:================================================================================ 2020-11-16T20:52:57.938 INFO:teuthology.orchestra.run.smithi166.stdout: Package Arch Version Repo Size 2020-11-16T20:52:57.939 INFO:teuthology.orchestra.run.smithi166.stdout:================================================================================ 2020-11-16T20:52:57.939 INFO:teuthology.orchestra.run.smithi166.stdout:Installing: 2020-11-16T20:52:57.939 INFO:teuthology.orchestra.run.smithi166.stdout: libcephfs-devel x86_64 2:16.0.0-7219.g911cc357.el8 ceph 24 k 2020-11-16T20:52:57.939 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:57.939 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction Summary 2020-11-16T20:52:57.939 INFO:teuthology.orchestra.run.smithi166.stdout:================================================================================ 2020-11-16T20:52:57.940 INFO:teuthology.orchestra.run.smithi166.stdout:Install 1 Package 2020-11-16T20:52:57.940 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:52:57.940 INFO:teuthology.orchestra.run.smithi166.stdout:Total download size: 24 k 2020-11-16T20:52:57.940 INFO:teuthology.orchestra.run.smithi166.stdout:Installed size: 87 k 2020-11-16T20:52:57.940 INFO:teuthology.orchestra.run.smithi166.stdout:Downloading Packages: 2020-11-16T20:52:58.063 INFO:teuthology.orchestra.run.smithi166.stdout:libcephfs-devel-16.0.0-7219.g911cc357.el8.x86_6 191 kB/s | 24 kB 00:00 2020-11-16T20:52:58.063 INFO:teuthology.orchestra.run.smithi166.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:52:58.064 INFO:teuthology.orchestra.run.smithi166.stdout:Total 189 kB/s | 24 kB 00:00 2020-11-16T20:52:58.064 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction check 2020-11-16T20:52:58.068 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction check succeeded. 2020-11-16T20:52:58.068 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction test 2020-11-16T20:52:58.070 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction test succeeded. 2020-11-16T20:52:58.073 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction 2020-11-16T20:52:58.157 INFO:teuthology.orchestra.run.smithi166.stdout: Preparing : 1/1 2020-11-16T20:52:58.271 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : libcephfs-devel-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:52:58.480 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: libcephfs-devel-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:52:58.707 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : libcephfs-devel-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:52:58.708 INFO:teuthology.orchestra.run.smithi166.stdout:Installed products updated. 2020-11-16T20:52:59.676 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:59.676 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2020-11-16T20:52:59.676 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse-2:16.0.0-7219.g911cc357.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2020-11-16T20:52:59.677 INFO:teuthology.orchestra.run.smithi059.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-11-16T20:52:59.677 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:52:59.677 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:53:00.261 INFO:teuthology.orchestra.run.smithi059:> sudo yum -y install librados-devel 2020-11-16T20:53:00.656 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:53:01.017 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:53:01.017 INFO:teuthology.orchestra.run.smithi166.stdout:Installed: 2020-11-16T20:53:01.018 INFO:teuthology.orchestra.run.smithi166.stdout: libcephfs-devel-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:53:01.018 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:53:01.018 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:53:01.115 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install librados2 2020-11-16T20:53:01.248 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 kB/s | 2.4 kB 00:00 2020-11-16T20:53:01.361 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 75 kB/s | 2.8 kB 00:00 2020-11-16T20:53:01.475 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:53:01.994 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 84 kB/s | 2.4 kB 00:00 2020-11-16T20:53:02.093 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 95 kB/s | 2.8 kB 00:00 2020-11-16T20:53:02.877 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:53:02.878 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2020-11-16T20:53:02.878 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repo Size 2020-11-16T20:53:02.878 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2020-11-16T20:53:02.878 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2020-11-16T20:53:02.879 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel x86_64 2:16.0.0-7219.g911cc357.el8 ceph 131 k 2020-11-16T20:53:02.879 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:53:02.879 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2020-11-16T20:53:02.879 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2020-11-16T20:53:02.879 INFO:teuthology.orchestra.run.smithi059.stdout:Install 1 Package 2020-11-16T20:53:02.879 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:53:02.879 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 131 k 2020-11-16T20:53:02.880 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 430 k 2020-11-16T20:53:02.880 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2020-11-16T20:53:03.050 INFO:teuthology.orchestra.run.smithi059.stdout:librados-devel-16.0.0-7219.g911cc357.el8.x86_64 765 kB/s | 131 kB 00:00 2020-11-16T20:53:03.051 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:53:03.051 INFO:teuthology.orchestra.run.smithi059.stdout:Total 759 kB/s | 131 kB 00:00 2020-11-16T20:53:03.051 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2020-11-16T20:53:03.058 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2020-11-16T20:53:03.058 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2020-11-16T20:53:03.115 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2020-11-16T20:53:03.118 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2020-11-16T20:53:03.156 INFO:teuthology.orchestra.run.smithi166.stdout:Package librados2-2:16.0.0-7219.g911cc357.el8.x86_64 is already installed. 2020-11-16T20:53:03.238 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2020-11-16T20:53:03.406 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librados-devel-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:53:03.460 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:53:03.461 INFO:teuthology.orchestra.run.smithi166.stdout:Nothing to do. 2020-11-16T20:53:03.461 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:53:03.553 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install librbd1 2020-11-16T20:53:03.669 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados-devel-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:53:03.914 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:53:03.956 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados-devel-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:53:03.956 INFO:teuthology.orchestra.run.smithi059.stdout:Installed products updated. 2020-11-16T20:53:04.526 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 76 kB/s | 2.4 kB 00:00 2020-11-16T20:53:04.627 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 90 kB/s | 2.8 kB 00:00 2020-11-16T20:53:05.998 INFO:teuthology.orchestra.run.smithi166.stdout:Package librbd1-2:16.0.0-7219.g911cc357.el8.x86_64 is already installed. 2020-11-16T20:53:06.299 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:53:06.300 INFO:teuthology.orchestra.run.smithi166.stdout:Nothing to do. 2020-11-16T20:53:06.301 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:53:06.381 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:53:06.382 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2020-11-16T20:53:06.382 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:53:06.382 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:53:06.382 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:53:06.391 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install python3-rados 2020-11-16T20:53:06.481 INFO:teuthology.orchestra.run.smithi059:> sudo yum -y install libcephfs2 2020-11-16T20:53:06.751 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:53:06.870 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:53:07.313 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 82 kB/s | 2.4 kB 00:00 2020-11-16T20:53:07.412 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 94 kB/s | 2.8 kB 00:00 2020-11-16T20:53:07.452 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 65 kB/s | 2.4 kB 00:00 2020-11-16T20:53:07.565 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 78 kB/s | 2.8 kB 00:00 2020-11-16T20:53:08.472 INFO:teuthology.orchestra.run.smithi166.stdout:Package python3-rados-2:16.0.0-7219.g911cc357.el8.x86_64 is already installed. 2020-11-16T20:53:08.716 INFO:teuthology.orchestra.run.smithi059.stdout:Package libcephfs2-2:16.0.0-7219.g911cc357.el8.x86_64 is already installed. 2020-11-16T20:53:08.776 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:53:08.778 INFO:teuthology.orchestra.run.smithi166.stdout:Nothing to do. 2020-11-16T20:53:08.778 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:53:08.875 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install python3-rgw 2020-11-16T20:53:09.029 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:53:09.030 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2020-11-16T20:53:09.030 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:53:09.130 INFO:teuthology.orchestra.run.smithi059:> sudo yum -y install libcephfs-devel 2020-11-16T20:53:09.234 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:53:09.518 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:53:09.799 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 83 kB/s | 2.4 kB 00:00 2020-11-16T20:53:09.899 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 96 kB/s | 2.8 kB 00:00 2020-11-16T20:53:10.114 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 kB/s | 2.4 kB 00:00 2020-11-16T20:53:10.225 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 75 kB/s | 2.8 kB 00:00 2020-11-16T20:53:10.964 INFO:teuthology.orchestra.run.smithi166.stdout:Package python3-rgw-2:16.0.0-7219.g911cc357.el8.x86_64 is already installed. 2020-11-16T20:53:11.261 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:53:11.262 INFO:teuthology.orchestra.run.smithi166.stdout:Nothing to do. 2020-11-16T20:53:11.262 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:53:11.357 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install python3-cephfs 2020-11-16T20:53:11.718 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:53:11.723 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:53:11.724 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2020-11-16T20:53:11.724 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repo Size 2020-11-16T20:53:11.724 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2020-11-16T20:53:11.724 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2020-11-16T20:53:11.724 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel x86_64 2:16.0.0-7219.g911cc357.el8 ceph 24 k 2020-11-16T20:53:11.725 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:53:11.725 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2020-11-16T20:53:11.725 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2020-11-16T20:53:11.725 INFO:teuthology.orchestra.run.smithi059.stdout:Install 1 Package 2020-11-16T20:53:11.725 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:53:11.725 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 24 k 2020-11-16T20:53:11.725 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 87 k 2020-11-16T20:53:11.726 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2020-11-16T20:53:11.849 INFO:teuthology.orchestra.run.smithi059.stdout:libcephfs-devel-16.0.0-7219.g911cc357.el8.x86_6 191 kB/s | 24 kB 00:00 2020-11-16T20:53:11.849 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:53:11.850 INFO:teuthology.orchestra.run.smithi059.stdout:Total 189 kB/s | 24 kB 00:00 2020-11-16T20:53:11.851 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2020-11-16T20:53:11.854 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2020-11-16T20:53:11.854 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2020-11-16T20:53:11.856 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2020-11-16T20:53:11.859 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2020-11-16T20:53:11.921 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2020-11-16T20:53:12.097 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs-devel-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:53:12.265 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 82 kB/s | 2.4 kB 00:00 2020-11-16T20:53:12.323 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephfs-devel-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:53:12.364 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 97 kB/s | 2.8 kB 00:00 2020-11-16T20:53:12.595 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs-devel-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:53:12.595 INFO:teuthology.orchestra.run.smithi059.stdout:Installed products updated. 2020-11-16T20:53:13.430 INFO:teuthology.orchestra.run.smithi166.stdout:Package python3-cephfs-2:16.0.0-7219.g911cc357.el8.x86_64 is already installed. 2020-11-16T20:53:13.733 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:53:13.735 INFO:teuthology.orchestra.run.smithi166.stdout:Nothing to do. 2020-11-16T20:53:13.735 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:53:13.831 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install python3-rbd 2020-11-16T20:53:14.190 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:53:14.830 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 83 kB/s | 2.4 kB 00:00 2020-11-16T20:53:14.930 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 94 kB/s | 2.8 kB 00:00 2020-11-16T20:53:15.026 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:53:15.026 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2020-11-16T20:53:15.027 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:53:15.027 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:53:15.027 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:53:15.206 INFO:teuthology.orchestra.run.smithi059:> sudo yum -y install librados2 2020-11-16T20:53:15.594 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:53:15.996 INFO:teuthology.orchestra.run.smithi166.stdout:Package python3-rbd-2:16.0.0-7219.g911cc357.el8.x86_64 is already installed. 2020-11-16T20:53:16.217 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 60 kB/s | 2.4 kB 00:00 2020-11-16T20:53:16.296 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:53:16.297 INFO:teuthology.orchestra.run.smithi166.stdout:Nothing to do. 2020-11-16T20:53:16.297 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:53:16.334 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 69 kB/s | 2.8 kB 00:00 2020-11-16T20:53:16.387 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install rbd-fuse 2020-11-16T20:53:16.745 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:53:17.264 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 85 kB/s | 2.4 kB 00:00 2020-11-16T20:53:17.362 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 96 kB/s | 2.8 kB 00:00 2020-11-16T20:53:17.523 INFO:teuthology.orchestra.run.smithi059.stdout:Package librados2-2:16.0.0-7219.g911cc357.el8.x86_64 is already installed. 2020-11-16T20:53:17.846 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:53:17.847 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2020-11-16T20:53:17.847 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:53:17.946 INFO:teuthology.orchestra.run.smithi059:> sudo yum -y install librbd1 2020-11-16T20:53:18.334 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:53:18.738 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:53:18.739 INFO:teuthology.orchestra.run.smithi166.stdout:================================================================================ 2020-11-16T20:53:18.739 INFO:teuthology.orchestra.run.smithi166.stdout: Package Architecture Version Repository Size 2020-11-16T20:53:18.739 INFO:teuthology.orchestra.run.smithi166.stdout:================================================================================ 2020-11-16T20:53:18.739 INFO:teuthology.orchestra.run.smithi166.stdout:Installing: 2020-11-16T20:53:18.739 INFO:teuthology.orchestra.run.smithi166.stdout: rbd-fuse x86_64 2:16.0.0-7219.g911cc357.el8 ceph 87 k 2020-11-16T20:53:18.739 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:53:18.740 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction Summary 2020-11-16T20:53:18.740 INFO:teuthology.orchestra.run.smithi166.stdout:================================================================================ 2020-11-16T20:53:18.740 INFO:teuthology.orchestra.run.smithi166.stdout:Install 1 Package 2020-11-16T20:53:18.740 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:53:18.740 INFO:teuthology.orchestra.run.smithi166.stdout:Total download size: 87 k 2020-11-16T20:53:18.740 INFO:teuthology.orchestra.run.smithi166.stdout:Installed size: 236 k 2020-11-16T20:53:18.741 INFO:teuthology.orchestra.run.smithi166.stdout:Downloading Packages: 2020-11-16T20:53:18.886 INFO:teuthology.orchestra.run.smithi166.stdout:rbd-fuse-16.0.0-7219.g911cc357.el8.x86_64.rpm 591 kB/s | 87 kB 00:00 2020-11-16T20:53:18.887 INFO:teuthology.orchestra.run.smithi166.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:53:18.888 INFO:teuthology.orchestra.run.smithi166.stdout:Total 585 kB/s | 87 kB 00:00 2020-11-16T20:53:18.888 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction check 2020-11-16T20:53:18.898 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction check succeeded. 2020-11-16T20:53:18.898 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction test 2020-11-16T20:53:18.946 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 60 kB/s | 2.4 kB 00:00 2020-11-16T20:53:18.951 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction test succeeded. 2020-11-16T20:53:18.954 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction 2020-11-16T20:53:19.059 INFO:teuthology.orchestra.run.smithi166.stdout: Preparing : 1/1 2020-11-16T20:53:19.062 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 68 kB/s | 2.8 kB 00:00 2020-11-16T20:53:19.184 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : rbd-fuse-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:53:19.424 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: rbd-fuse-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:53:19.652 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : rbd-fuse-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:53:19.652 INFO:teuthology.orchestra.run.smithi166.stdout:Installed products updated. 2020-11-16T20:53:20.440 INFO:teuthology.orchestra.run.smithi059.stdout:Package librbd1-2:16.0.0-7219.g911cc357.el8.x86_64 is already installed. 2020-11-16T20:53:20.757 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:53:20.759 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2020-11-16T20:53:20.759 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:53:20.865 INFO:teuthology.orchestra.run.smithi059:> sudo yum -y install python3-rados 2020-11-16T20:53:21.254 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:53:21.884 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 63 kB/s | 2.4 kB 00:00 2020-11-16T20:53:21.997 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 76 kB/s | 2.8 kB 00:00 2020-11-16T20:53:22.013 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:53:22.013 INFO:teuthology.orchestra.run.smithi166.stdout:Installed: 2020-11-16T20:53:22.013 INFO:teuthology.orchestra.run.smithi166.stdout: rbd-fuse-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:53:22.013 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:53:22.013 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:53:22.113 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install rbd-mirror 2020-11-16T20:53:22.474 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:53:23.009 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 81 kB/s | 2.4 kB 00:00 2020-11-16T20:53:23.106 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 99 kB/s | 2.8 kB 00:00 2020-11-16T20:53:23.164 INFO:teuthology.orchestra.run.smithi059.stdout:Package python3-rados-2:16.0.0-7219.g911cc357.el8.x86_64 is already installed. 2020-11-16T20:53:23.476 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:53:23.477 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2020-11-16T20:53:23.477 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:53:23.576 INFO:teuthology.orchestra.run.smithi059:> sudo yum -y install python3-rgw 2020-11-16T20:53:23.964 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:53:24.493 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:53:24.494 INFO:teuthology.orchestra.run.smithi166.stdout:================================================================================ 2020-11-16T20:53:24.494 INFO:teuthology.orchestra.run.smithi166.stdout: Package Arch Version Repo Size 2020-11-16T20:53:24.494 INFO:teuthology.orchestra.run.smithi166.stdout:================================================================================ 2020-11-16T20:53:24.494 INFO:teuthology.orchestra.run.smithi166.stdout:Installing: 2020-11-16T20:53:24.494 INFO:teuthology.orchestra.run.smithi166.stdout: rbd-mirror x86_64 2:16.0.0-7219.g911cc357.el8 ceph 3.1 M 2020-11-16T20:53:24.494 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:53:24.495 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction Summary 2020-11-16T20:53:24.495 INFO:teuthology.orchestra.run.smithi166.stdout:================================================================================ 2020-11-16T20:53:24.495 INFO:teuthology.orchestra.run.smithi166.stdout:Install 1 Package 2020-11-16T20:53:24.495 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:53:24.495 INFO:teuthology.orchestra.run.smithi166.stdout:Total download size: 3.1 M 2020-11-16T20:53:24.495 INFO:teuthology.orchestra.run.smithi166.stdout:Installed size: 11 M 2020-11-16T20:53:24.495 INFO:teuthology.orchestra.run.smithi166.stdout:Downloading Packages: 2020-11-16T20:53:24.554 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 kB/s | 2.4 kB 00:00 2020-11-16T20:53:24.667 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 74 kB/s | 2.8 kB 00:00 2020-11-16T20:53:24.856 INFO:teuthology.orchestra.run.smithi166.stdout:rbd-mirror-16.0.0-7219.g911cc357.el8.x86_64.rpm 8.7 MB/s | 3.1 MB 00:00 2020-11-16T20:53:24.857 INFO:teuthology.orchestra.run.smithi166.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:53:24.858 INFO:teuthology.orchestra.run.smithi166.stdout:Total 8.7 MB/s | 3.1 MB 00:00 2020-11-16T20:53:24.858 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction check 2020-11-16T20:53:24.870 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction check succeeded. 2020-11-16T20:53:24.870 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction test 2020-11-16T20:53:24.936 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction test succeeded. 2020-11-16T20:53:24.939 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction 2020-11-16T20:53:25.318 INFO:teuthology.orchestra.run.smithi166.stdout: Preparing : 1/1 2020-11-16T20:53:25.477 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : rbd-mirror-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:53:25.852 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: rbd-mirror-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:53:25.989 INFO:teuthology.orchestra.run.smithi059.stdout:Package python3-rgw-2:16.0.0-7219.g911cc357.el8.x86_64 is already installed. 2020-11-16T20:53:26.107 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : rbd-mirror-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:53:26.107 INFO:teuthology.orchestra.run.smithi166.stdout:Installed products updated. 2020-11-16T20:53:26.303 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:53:26.304 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2020-11-16T20:53:26.305 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:53:26.398 INFO:teuthology.orchestra.run.smithi059:> sudo yum -y install python3-cephfs 2020-11-16T20:53:26.786 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:53:27.398 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 59 kB/s | 2.4 kB 00:00 2020-11-16T20:53:27.509 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 76 kB/s | 2.8 kB 00:00 2020-11-16T20:53:28.370 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:53:28.370 INFO:teuthology.orchestra.run.smithi166.stdout:Installed: 2020-11-16T20:53:28.370 INFO:teuthology.orchestra.run.smithi166.stdout: rbd-mirror-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:53:28.371 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:53:28.371 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:53:28.469 INFO:teuthology.orchestra.run.smithi166:> sudo yum -y install rbd-nbd 2020-11-16T20:53:28.697 INFO:teuthology.orchestra.run.smithi059.stdout:Package python3-cephfs-2:16.0.0-7219.g911cc357.el8.x86_64 is already installed. 2020-11-16T20:53:28.832 INFO:teuthology.orchestra.run.smithi166.stdout:Updating Subscription Management repositories. 2020-11-16T20:53:29.011 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:53:29.012 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2020-11-16T20:53:29.013 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:53:29.110 INFO:teuthology.orchestra.run.smithi059:> sudo yum -y install python3-rbd 2020-11-16T20:53:29.407 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 82 kB/s | 2.4 kB 00:00 2020-11-16T20:53:29.501 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:53:29.523 INFO:teuthology.orchestra.run.smithi166.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 98 kB/s | 2.8 kB 00:00 2020-11-16T20:53:30.328 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 65 kB/s | 2.4 kB 00:00 2020-11-16T20:53:30.437 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 75 kB/s | 2.8 kB 00:00 2020-11-16T20:53:30.919 INFO:teuthology.orchestra.run.smithi166.stdout:Dependencies resolved. 2020-11-16T20:53:30.920 INFO:teuthology.orchestra.run.smithi166.stdout:================================================================================ 2020-11-16T20:53:30.920 INFO:teuthology.orchestra.run.smithi166.stdout: Package Architecture Version Repository Size 2020-11-16T20:53:30.920 INFO:teuthology.orchestra.run.smithi166.stdout:================================================================================ 2020-11-16T20:53:30.920 INFO:teuthology.orchestra.run.smithi166.stdout:Installing: 2020-11-16T20:53:30.920 INFO:teuthology.orchestra.run.smithi166.stdout: rbd-nbd x86_64 2:16.0.0-7219.g911cc357.el8 ceph 168 k 2020-11-16T20:53:30.921 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:53:30.921 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction Summary 2020-11-16T20:53:30.921 INFO:teuthology.orchestra.run.smithi166.stdout:================================================================================ 2020-11-16T20:53:30.921 INFO:teuthology.orchestra.run.smithi166.stdout:Install 1 Package 2020-11-16T20:53:30.921 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:53:30.921 INFO:teuthology.orchestra.run.smithi166.stdout:Total download size: 168 k 2020-11-16T20:53:30.921 INFO:teuthology.orchestra.run.smithi166.stdout:Installed size: 503 k 2020-11-16T20:53:30.922 INFO:teuthology.orchestra.run.smithi166.stdout:Downloading Packages: 2020-11-16T20:53:31.091 INFO:teuthology.orchestra.run.smithi166.stdout:rbd-nbd-16.0.0-7219.g911cc357.el8.x86_64.rpm 989 kB/s | 168 kB 00:00 2020-11-16T20:53:31.092 INFO:teuthology.orchestra.run.smithi166.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:53:31.092 INFO:teuthology.orchestra.run.smithi166.stdout:Total 981 kB/s | 168 kB 00:00 2020-11-16T20:53:31.092 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction check 2020-11-16T20:53:31.104 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction check succeeded. 2020-11-16T20:53:31.104 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction test 2020-11-16T20:53:31.157 INFO:teuthology.orchestra.run.smithi166.stdout:Transaction test succeeded. 2020-11-16T20:53:31.160 INFO:teuthology.orchestra.run.smithi166.stdout:Running transaction 2020-11-16T20:53:31.292 INFO:teuthology.orchestra.run.smithi166.stdout: Preparing : 1/1 2020-11-16T20:53:31.424 INFO:teuthology.orchestra.run.smithi166.stdout: Installing : rbd-nbd-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:53:31.605 INFO:teuthology.orchestra.run.smithi059.stdout:Package python3-rbd-2:16.0.0-7219.g911cc357.el8.x86_64 is already installed. 2020-11-16T20:53:31.672 INFO:teuthology.orchestra.run.smithi166.stdout: Running scriptlet: rbd-nbd-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:53:31.919 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:53:31.920 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2020-11-16T20:53:31.921 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:53:31.963 INFO:teuthology.orchestra.run.smithi166.stdout: Verifying : rbd-nbd-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:53:31.963 INFO:teuthology.orchestra.run.smithi166.stdout:Installed products updated. 2020-11-16T20:53:32.013 INFO:teuthology.orchestra.run.smithi059:> sudo yum -y install rbd-fuse 2020-11-16T20:53:32.401 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:53:32.998 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 kB/s | 2.4 kB 00:00 2020-11-16T20:53:33.109 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 77 kB/s | 2.8 kB 00:00 2020-11-16T20:53:34.330 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:53:34.330 INFO:teuthology.orchestra.run.smithi166.stdout:Installed: 2020-11-16T20:53:34.330 INFO:teuthology.orchestra.run.smithi166.stdout: rbd-nbd-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:53:34.330 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:53:34.330 INFO:teuthology.orchestra.run.smithi166.stdout:Complete! 2020-11-16T20:53:34.447 DEBUG:teuthology.parallel:result is None 2020-11-16T20:53:34.583 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:53:34.584 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2020-11-16T20:53:34.584 INFO:teuthology.orchestra.run.smithi059.stdout: Package Architecture Version Repository Size 2020-11-16T20:53:34.584 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2020-11-16T20:53:34.585 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2020-11-16T20:53:34.585 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse x86_64 2:16.0.0-7219.g911cc357.el8 ceph 87 k 2020-11-16T20:53:34.585 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:53:34.585 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2020-11-16T20:53:34.585 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2020-11-16T20:53:34.585 INFO:teuthology.orchestra.run.smithi059.stdout:Install 1 Package 2020-11-16T20:53:34.585 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:53:34.586 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 87 k 2020-11-16T20:53:34.586 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 236 k 2020-11-16T20:53:34.586 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2020-11-16T20:53:34.732 INFO:teuthology.orchestra.run.smithi059.stdout:rbd-fuse-16.0.0-7219.g911cc357.el8.x86_64.rpm 590 kB/s | 87 kB 00:00 2020-11-16T20:53:34.734 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:53:34.734 INFO:teuthology.orchestra.run.smithi059.stdout:Total 584 kB/s | 87 kB 00:00 2020-11-16T20:53:34.734 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2020-11-16T20:53:34.745 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2020-11-16T20:53:34.746 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2020-11-16T20:53:34.803 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2020-11-16T20:53:34.806 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2020-11-16T20:53:34.920 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2020-11-16T20:53:35.093 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-fuse-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:53:35.342 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-fuse-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:53:35.604 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-fuse-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:53:35.604 INFO:teuthology.orchestra.run.smithi059.stdout:Installed products updated. 2020-11-16T20:53:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:53:38.034 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2020-11-16T20:53:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:53:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:53:38.035 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:53:38.131 INFO:teuthology.orchestra.run.smithi059:> sudo yum -y install rbd-mirror 2020-11-16T20:53:38.518 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:53:39.119 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 58 kB/s | 2.4 kB 00:00 2020-11-16T20:53:39.227 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 77 kB/s | 2.8 kB 00:00 2020-11-16T20:53:40.686 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:53:40.687 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2020-11-16T20:53:40.687 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repo Size 2020-11-16T20:53:40.687 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2020-11-16T20:53:40.687 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2020-11-16T20:53:40.687 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror x86_64 2:16.0.0-7219.g911cc357.el8 ceph 3.1 M 2020-11-16T20:53:40.688 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:53:40.688 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2020-11-16T20:53:40.688 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2020-11-16T20:53:40.688 INFO:teuthology.orchestra.run.smithi059.stdout:Install 1 Package 2020-11-16T20:53:40.688 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:53:40.688 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 3.1 M 2020-11-16T20:53:40.688 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 11 M 2020-11-16T20:53:40.689 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2020-11-16T20:53:46.456 INFO:teuthology.orchestra.run.smithi059.stdout:rbd-mirror-16.0.0-7219.g911cc357.el8.x86_64.rpm 558 kB/s | 3.1 MB 00:05 2020-11-16T20:53:46.458 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:53:46.458 INFO:teuthology.orchestra.run.smithi059.stdout:Total 558 kB/s | 3.1 MB 00:05 2020-11-16T20:53:46.459 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2020-11-16T20:53:46.474 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2020-11-16T20:53:46.474 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2020-11-16T20:53:46.549 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2020-11-16T20:53:46.552 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2020-11-16T20:53:46.963 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2020-11-16T20:53:47.094 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-mirror-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:53:47.462 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-mirror-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:53:47.721 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-mirror-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:53:47.722 INFO:teuthology.orchestra.run.smithi059.stdout:Installed products updated. 2020-11-16T20:53:50.164 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:53:50.164 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2020-11-16T20:53:50.164 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:53:50.165 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:53:50.165 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:53:50.298 INFO:teuthology.orchestra.run.smithi059:> sudo yum -y install rbd-nbd 2020-11-16T20:53:50.689 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2020-11-16T20:53:51.304 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 65 kB/s | 2.4 kB 00:00 2020-11-16T20:53:51.438 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 78 kB/s | 2.8 kB 00:00 2020-11-16T20:53:52.926 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2020-11-16T20:53:52.927 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2020-11-16T20:53:52.928 INFO:teuthology.orchestra.run.smithi059.stdout: Package Architecture Version Repository Size 2020-11-16T20:53:52.928 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2020-11-16T20:53:52.928 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2020-11-16T20:53:52.928 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd x86_64 2:16.0.0-7219.g911cc357.el8 ceph 168 k 2020-11-16T20:53:52.928 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:53:52.928 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2020-11-16T20:53:52.928 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2020-11-16T20:53:52.929 INFO:teuthology.orchestra.run.smithi059.stdout:Install 1 Package 2020-11-16T20:53:52.929 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:53:52.929 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 168 k 2020-11-16T20:53:52.929 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 503 k 2020-11-16T20:53:52.929 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2020-11-16T20:53:53.511 INFO:teuthology.orchestra.run.smithi059.stdout:rbd-nbd-16.0.0-7219.g911cc357.el8.x86_64.rpm 289 kB/s | 168 kB 00:00 2020-11-16T20:53:53.512 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2020-11-16T20:53:53.513 INFO:teuthology.orchestra.run.smithi059.stdout:Total 288 kB/s | 168 kB 00:00 2020-11-16T20:53:53.513 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2020-11-16T20:53:53.527 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2020-11-16T20:53:53.527 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2020-11-16T20:53:53.587 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2020-11-16T20:53:53.591 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2020-11-16T20:53:53.709 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2020-11-16T20:53:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-nbd-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:53:54.090 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-nbd-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:53:54.331 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-nbd-2:16.0.0-7219.g911cc357.el8.x86_64 1/1 2020-11-16T20:53:54.332 INFO:teuthology.orchestra.run.smithi059.stdout:Installed products updated. 2020-11-16T20:53:56.816 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:53:56.816 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2020-11-16T20:53:56.816 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd-2:16.0.0-7219.g911cc357.el8.x86_64 2020-11-16T20:53:56.817 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:53:56.817 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2020-11-16T20:53:56.974 DEBUG:teuthology.parallel:result is None 2020-11-16T20:53:56.975 INFO:teuthology.orchestra.run.smithi166:> sudo lsb_release -is 2020-11-16T20:53:57.018 INFO:teuthology.orchestra.run.smithi166.stdout:RedHatEnterprise 2020-11-16T20:53:57.019 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-16T20:53:57.020 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=911cc35794d871071a8bebfb0919482263b1d18b 2020-11-16T20:53:57.192 INFO:teuthology.orchestra.run.smithi166:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-11-16T20:53:57.213 INFO:teuthology.orchestra.run.smithi166.stdout:16.0.0-7219.g911cc357.el8 2020-11-16T20:53:57.214 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-7219.g911cc357.el8 2020-11-16T20:53:57.214 INFO:teuthology.task.install:The correct ceph version 16.0.0-7219.g911cc357 is installed. 2020-11-16T20:53:57.215 INFO:teuthology.orchestra.run.smithi059:> sudo lsb_release -is 2020-11-16T20:53:57.260 INFO:teuthology.orchestra.run.smithi059.stdout:RedHatEnterprise 2020-11-16T20:53:57.261 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-16T20:53:57.262 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=911cc35794d871071a8bebfb0919482263b1d18b 2020-11-16T20:53:57.427 INFO:teuthology.orchestra.run.smithi059:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-11-16T20:53:57.448 INFO:teuthology.orchestra.run.smithi059.stdout:16.0.0-7219.g911cc357.el8 2020-11-16T20:53:57.449 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-7219.g911cc357.el8 2020-11-16T20:53:57.449 INFO:teuthology.task.install:The correct ceph version 16.0.0-7219.g911cc357 is installed. 2020-11-16T20:53:57.450 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-11-16T20:53:57.450 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-16T20:53:57.450 INFO:teuthology.orchestra.run.smithi166:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-16T20:53:57.466 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-16T20:53:57.482 INFO:teuthology.orchestra.run.smithi166.stderr:24+1 records in 2020-11-16T20:53:57.482 INFO:teuthology.orchestra.run.smithi166.stderr:24+1 records out 2020-11-16T20:53:57.482 INFO:teuthology.orchestra.run.smithi166.stderr:12667 bytes (13 kB, 12 KiB) copied, 8.0265e-05 s, 158 MB/s 2020-11-16T20:53:57.483 INFO:teuthology.orchestra.run.smithi059:> set -ex 2020-11-16T20:53:57.483 INFO:teuthology.orchestra.run.smithi059:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-16T20:53:57.504 INFO:teuthology.orchestra.run.smithi059.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-16T20:53:57.523 INFO:teuthology.orchestra.run.smithi059.stderr:24+1 records in 2020-11-16T20:53:57.523 INFO:teuthology.orchestra.run.smithi059.stderr:24+1 records out 2020-11-16T20:53:57.523 INFO:teuthology.orchestra.run.smithi059.stderr:12667 bytes (13 kB, 12 KiB) copied, 8.7242e-05 s, 145 MB/s 2020-11-16T20:53:57.524 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-11-16T20:53:57.525 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-16T20:53:57.525 INFO:teuthology.orchestra.run.smithi166:> sudo dd of=/usr/bin/daemon-helper 2020-11-16T20:53:57.540 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-16T20:53:57.555 INFO:teuthology.orchestra.run.smithi166.stderr:5+1 records in 2020-11-16T20:53:57.555 INFO:teuthology.orchestra.run.smithi166.stderr:5+1 records out 2020-11-16T20:53:57.555 INFO:teuthology.orchestra.run.smithi166.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 4.4865e-05 s, 68.2 MB/s 2020-11-16T20:53:57.556 INFO:teuthology.orchestra.run.smithi166:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-16T20:53:57.624 INFO:teuthology.orchestra.run.smithi059:> set -ex 2020-11-16T20:53:57.625 INFO:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/daemon-helper 2020-11-16T20:53:57.639 INFO:teuthology.orchestra.run.smithi059.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-16T20:53:57.657 INFO:teuthology.orchestra.run.smithi059.stderr:5+1 records in 2020-11-16T20:53:57.657 INFO:teuthology.orchestra.run.smithi059.stderr:5+1 records out 2020-11-16T20:53:57.658 INFO:teuthology.orchestra.run.smithi059.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 4.5422e-05 s, 67.3 MB/s 2020-11-16T20:53:57.658 INFO:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-16T20:53:57.732 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-11-16T20:53:57.732 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-16T20:53:57.732 INFO:teuthology.orchestra.run.smithi166:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-16T20:53:57.746 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-16T20:53:57.760 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-16T20:53:57.760 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-16T20:53:57.761 INFO:teuthology.orchestra.run.smithi166.stderr:299 bytes copied, 3.1383e-05 s, 9.5 MB/s 2020-11-16T20:53:57.761 INFO:teuthology.orchestra.run.smithi166:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-16T20:53:57.830 INFO:teuthology.orchestra.run.smithi059:> set -ex 2020-11-16T20:53:57.831 INFO:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-16T20:53:57.845 INFO:teuthology.orchestra.run.smithi059.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-16T20:53:57.862 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records in 2020-11-16T20:53:57.863 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records out 2020-11-16T20:53:57.863 INFO:teuthology.orchestra.run.smithi059.stderr:299 bytes copied, 3.472e-05 s, 8.6 MB/s 2020-11-16T20:53:57.864 INFO:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-16T20:53:57.937 INFO:teuthology.run_tasks:Running task ceph... 2020-11-16T20:53:57.995 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-11-16T20:53:57.996 INFO:teuthology.orchestra.run.smithi059:> sudo chmod 777 /var/log/ceph 2020-11-16T20:53:57.998 INFO:teuthology.orchestra.run.smithi166:> sudo chmod 777 /var/log/ceph 2020-11-16T20:53:58.028 INFO:tasks.ceph:Disabling ceph logrotate... 2020-11-16T20:53:58.029 INFO:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-16T20:53:58.071 INFO:teuthology.orchestra.run.smithi166:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-16T20:53:58.100 INFO:tasks.ceph:Creating extra log directories... 2020-11-16T20:53:58.101 INFO:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-16T20:53:58.143 INFO:teuthology.orchestra.run.smithi166:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-16T20:53:58.219 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-11-16T20:53:58.219 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd map cache size': 1, 'osd max backfills': 6, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub during recovery': False, 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'Health detail', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'osd_map_cache_size', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'must scrub before tier agent can activate'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2020-11-16T20:53:58.220 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/kchai-2020-11-16_12:11:03-rados-wip-kefu-testing-2020-11-16-1845-distro-basic-smithi/5631152', 'branch': 'wip-kefu-testing-2020-11-16-1845', 'description': 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-snaps}', 'email': 'tchaikov@gmail.com', 'first_in_suite': False, 'job_id': '5631152', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'kchai-2020-11-16_12:11:03-rados-wip-kefu-testing-2020-11-16-1845-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 30}}], 'os_type': 'rhel', 'os_version': '8.1', 'overrides': {'admin_socket': {'branch': 'wip-kefu-testing-2020-11-16-1845'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd map cache size': 1, 'osd max backfills': 6, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub during recovery': False, 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'Health detail', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'osd_map_cache_size', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'must scrub before tier agent can activate'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'Health detail'], 'sha1': '911cc35794d871071a8bebfb0919482263b1d18b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'sha1': '911cc35794d871071a8bebfb0919482263b1d18b'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5, 'min_in': 4}, 'workunit': {'branch': 'wip-kefu-testing-2020-11-16-1845', 'sha1': '911cc35794d871071a8bebfb0919482263b1d18b'}}, 'owner': 'scheduled_kchai@teuthology', 'priority': 90, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': '911cc35794d871071a8bebfb0919482263b1d18b', 'sleep_before_teardown': 0, 'suite': 'rados', 'suite_branch': 'wip-kefu-testing-2020-11-16-1845', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-11-16-1845/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': '911cc35794d871071a8bebfb0919482263b1d18b', 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd map cache size': 1, 'osd max backfills': 6, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub during recovery': False, 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'Health detail', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'osd_map_cache_size', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'must scrub before tier agent can activate'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'Health detail'], 'sha1': '911cc35794d871071a8bebfb0919482263b1d18b', 'cluster': 'ceph'}}, {'exec': {'mon.a': ['while ! ceph balancer status ; do sleep 1 ; done', 'ceph balancer mode crush-compat', 'ceph balancer on']}}, {'thrashosds': {'chance_pgnum_grow': 0.25, 'chance_pgnum_shrink': 0.25, 'chance_pgpnum_fix': 0.25, 'chance_test_map_discontinuity': 2, 'timeout': 1800}}, {'exec': {'client.0': ['sudo ceph osd pool create base 4', 'sudo ceph osd pool application enable base rados', 'sudo ceph osd pool create cache 4', 'sudo ceph osd tier add base cache', 'sudo ceph osd tier cache-mode cache writeback', 'sudo ceph osd tier set-overlay base cache', 'sudo ceph osd pool set cache hit_set_type bloom', 'sudo ceph osd pool set cache hit_set_count 8', 'sudo ceph osd pool set cache hit_set_period 3600', 'sudo ceph osd pool set cache target_max_objects 250', 'sudo ceph osd pool set cache min_read_recency_for_promote 2']}}, {'rados': {'clients': ['client.0'], 'objects': 500, 'op_weights': {'cache_evict': 50, 'cache_flush': 50, 'cache_try_flush': 50, 'copy_from': 50, 'delete': 50, 'read': 100, 'rollback': 50, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000, 'pools': ['base']}}], 'teuthology_branch': 'master', 'timestamp': '2020-11-16_12:11:03', 'tube': 'smithi', 'user': 'kchai', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.24830', 'targets': {'smithi166.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7rsdvpmPqd/Tz9L2Z/yVrBQhzTkGcmA0W3mACgkX87AVXdW+nrqKUaKE8udM4q9V4UU+vbQs4/GaiRn0HM8OuCBNwGwRTGf1h8pCiyG6U5/Z0EQp1WwDvcos2lJ1XeFP6HOvq91fj0YXVK53Efa1xcGfsjO9ye3UkveBwwRZBo43oiGSq5Xylse7DmVPQUxrh+R4i9Qm41XJBpeOe/J2mgflDE0sUaBSjl1tbcgyMXxN2NCAx6MMAjty15H5JUHIrnJW2nOYO7DhyW3ANFpSY/7pflo5FRmb6VIo57EC58dtXei5T92s5OuqmeALlg3fs9CbEro6GOFsDALn6xMyI9swq4rX2fcPUnzEiXGMYoWnSUFf0xRomPcnFANZAzC7Jp3j6eP13ELD6wxpTixqW6Q4uLcx2MDlUzagG4K0TX1nTunqwjfm3+zJEy/Hpquvz7kc/tzsqZxgV/VOudlVpy3OVAgYDyp2RorCm8Crvj7CDcFBr3YtvYDxvySGDnnc=', 'smithi059.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7oYQS82ySk4tgG7akExLTadov0NdJDs8VdUSoi2a/KBr0CsjPWCEj5dIjgEpyhPnMA7MLzrGBMAVPAwJac4wtx1dtS7Pd+SjxM6jnxHkoo4n9DUK4KhrUmQxuWwNCAlntkG2qZ9FD+gV7F4ZK+BJAwR/xFIyXDCuWXj5c+c7SkaXQAlLerEV6zb38i4pakfXlWdDaUD4I7J4d2R2hSRRnd1HFD2Yxt0wSd8prGps3wuYgFkpFpU4KGjOFI4xi8xqfqwKJubmPtBE5ap4c9d7MHwSLg9wteGUUrlrtBHHV43CM2/+uKjU+4/x7jWHJjrbmZ4V3zsrjLSAGMC+J5c+LvvRA0/YEbXDc+wCmc23JjgXIS8ak0NAYO1sdBSQzcv2oc75pZ2N514vmTWxOjqb9QS2brHGtadZSe644MlQubhUGIa8ar66jZLVjtpsEmQCEOkEZT9kCmHVjIYUrSmxhwUTO2a/JDK90aOAexTCgfzBfaDZs2lT5miyXDl0uSFM='}} 2020-11-16T20:53:58.221 INFO:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-16T20:53:58.223 INFO:teuthology.orchestra.run.smithi166:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-16T20:53:58.238 INFO:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/run/ceph 2020-11-16T20:53:58.278 INFO:teuthology.orchestra.run.smithi166:> sudo install -d -m0777 -- /var/run/ceph 2020-11-16T20:53:58.308 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-16T20:53:58.309 INFO:teuthology.orchestra.run.smithi166:> dd if=/scratch_devs of=/dev/stdout 2020-11-16T20:53:58.359 INFO:teuthology.orchestra.run.smithi166.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-16T20:53:58.360 INFO:teuthology.orchestra.run.smithi166.stdout:/dev/vg_nvme/lv_1 2020-11-16T20:53:58.361 INFO:teuthology.orchestra.run.smithi166.stdout:/dev/vg_nvme/lv_2 2020-11-16T20:53:58.361 INFO:teuthology.orchestra.run.smithi166.stdout:/dev/vg_nvme/lv_3 2020-11-16T20:53:58.361 INFO:teuthology.orchestra.run.smithi166.stdout:/dev/vg_nvme/lv_4 2020-11-16T20:53:58.361 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-16T20:53:58.361 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-16T20:53:58.361 INFO:teuthology.orchestra.run.smithi166.stderr:72 bytes copied, 4.0829e-05 s, 1.8 MB/s 2020-11-16T20:53:58.362 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-16T20:53:58.362 INFO:teuthology.orchestra.run.smithi166:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-16T20:53:58.414 INFO:teuthology.orchestra.run.smithi166.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-16T20:53:58.415 INFO:teuthology.orchestra.run.smithi166.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-16T20:53:58.415 INFO:teuthology.orchestra.run.smithi166.stdout:Device: 6h/6d Inode: 111167 Links: 1 2020-11-16T20:53:58.415 INFO:teuthology.orchestra.run.smithi166.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-16T20:53:58.415 INFO:teuthology.orchestra.run.smithi166.stdout:Context: system_u:object_r:device_t:s0 2020-11-16T20:53:58.415 INFO:teuthology.orchestra.run.smithi166.stdout:Access: 2020-11-16 20:53:25.654371410 +0000 2020-11-16T20:53:58.415 INFO:teuthology.orchestra.run.smithi166.stdout:Modify: 2020-11-16 20:45:58.819329910 +0000 2020-11-16T20:53:58.415 INFO:teuthology.orchestra.run.smithi166.stdout:Change: 2020-11-16 20:45:58.819329910 +0000 2020-11-16T20:53:58.416 INFO:teuthology.orchestra.run.smithi166.stdout: Birth: - 2020-11-16T20:53:58.428 INFO:teuthology.orchestra.run.smithi166.stderr:1+0 records in 2020-11-16T20:53:58.428 INFO:teuthology.orchestra.run.smithi166.stderr:1+0 records out 2020-11-16T20:53:58.428 INFO:teuthology.orchestra.run.smithi166.stderr:512 bytes copied, 0.000245647 s, 2.1 MB/s 2020-11-16T20:53:58.431 INFO:teuthology.orchestra.run.smithi166:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-16T20:53:58.485 INFO:teuthology.orchestra.run.smithi166.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-16T20:53:58.485 INFO:teuthology.orchestra.run.smithi166.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-16T20:53:58.486 INFO:teuthology.orchestra.run.smithi166.stdout:Device: 6h/6d Inode: 115061 Links: 1 2020-11-16T20:53:58.486 INFO:teuthology.orchestra.run.smithi166.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-16T20:53:58.486 INFO:teuthology.orchestra.run.smithi166.stdout:Context: system_u:object_r:device_t:s0 2020-11-16T20:53:58.486 INFO:teuthology.orchestra.run.smithi166.stdout:Access: 2020-11-16 20:53:25.654371410 +0000 2020-11-16T20:53:58.486 INFO:teuthology.orchestra.run.smithi166.stdout:Modify: 2020-11-16 20:46:03.208241832 +0000 2020-11-16T20:53:58.486 INFO:teuthology.orchestra.run.smithi166.stdout:Change: 2020-11-16 20:46:03.208241832 +0000 2020-11-16T20:53:58.486 INFO:teuthology.orchestra.run.smithi166.stdout: Birth: - 2020-11-16T20:53:58.499 INFO:teuthology.orchestra.run.smithi166.stderr:1+0 records in 2020-11-16T20:53:58.499 INFO:teuthology.orchestra.run.smithi166.stderr:1+0 records out 2020-11-16T20:53:58.499 INFO:teuthology.orchestra.run.smithi166.stderr:512 bytes copied, 0.000220292 s, 2.3 MB/s 2020-11-16T20:53:58.501 INFO:teuthology.orchestra.run.smithi166:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-16T20:53:58.555 INFO:teuthology.orchestra.run.smithi166.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-16T20:53:58.555 INFO:teuthology.orchestra.run.smithi166.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-16T20:53:58.555 INFO:teuthology.orchestra.run.smithi166.stdout:Device: 6h/6d Inode: 115963 Links: 1 2020-11-16T20:53:58.556 INFO:teuthology.orchestra.run.smithi166.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-16T20:53:58.556 INFO:teuthology.orchestra.run.smithi166.stdout:Context: system_u:object_r:device_t:s0 2020-11-16T20:53:58.556 INFO:teuthology.orchestra.run.smithi166.stdout:Access: 2020-11-16 20:53:25.654371410 +0000 2020-11-16T20:53:58.556 INFO:teuthology.orchestra.run.smithi166.stdout:Modify: 2020-11-16 20:46:03.528235411 +0000 2020-11-16T20:53:58.556 INFO:teuthology.orchestra.run.smithi166.stdout:Change: 2020-11-16 20:46:03.528235411 +0000 2020-11-16T20:53:58.556 INFO:teuthology.orchestra.run.smithi166.stdout: Birth: - 2020-11-16T20:53:58.568 INFO:teuthology.orchestra.run.smithi166.stderr:1+0 records in 2020-11-16T20:53:58.568 INFO:teuthology.orchestra.run.smithi166.stderr:1+0 records out 2020-11-16T20:53:58.568 INFO:teuthology.orchestra.run.smithi166.stderr:512 bytes copied, 0.000197641 s, 2.6 MB/s 2020-11-16T20:53:58.571 INFO:teuthology.orchestra.run.smithi166:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-16T20:53:58.624 INFO:teuthology.orchestra.run.smithi166.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-16T20:53:58.624 INFO:teuthology.orchestra.run.smithi166.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-16T20:53:58.624 INFO:teuthology.orchestra.run.smithi166.stdout:Device: 6h/6d Inode: 114133 Links: 1 2020-11-16T20:53:58.624 INFO:teuthology.orchestra.run.smithi166.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-16T20:53:58.624 INFO:teuthology.orchestra.run.smithi166.stdout:Context: system_u:object_r:device_t:s0 2020-11-16T20:53:58.625 INFO:teuthology.orchestra.run.smithi166.stdout:Access: 2020-11-16 20:53:25.654371410 +0000 2020-11-16T20:53:58.625 INFO:teuthology.orchestra.run.smithi166.stdout:Modify: 2020-11-16 20:46:23.994824681 +0000 2020-11-16T20:53:58.625 INFO:teuthology.orchestra.run.smithi166.stdout:Change: 2020-11-16 20:46:23.994824681 +0000 2020-11-16T20:53:58.625 INFO:teuthology.orchestra.run.smithi166.stdout: Birth: - 2020-11-16T20:53:58.637 INFO:teuthology.orchestra.run.smithi166.stderr:1+0 records in 2020-11-16T20:53:58.637 INFO:teuthology.orchestra.run.smithi166.stderr:1+0 records out 2020-11-16T20:53:58.637 INFO:teuthology.orchestra.run.smithi166.stderr:512 bytes copied, 0.000213585 s, 2.4 MB/s 2020-11-16T20:53:58.639 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-11-16T20:53:58.640 INFO:teuthology.orchestra.run.smithi059:> set -ex 2020-11-16T20:53:58.640 INFO:teuthology.orchestra.run.smithi059:> dd if=/scratch_devs of=/dev/stdout 2020-11-16T20:53:58.654 INFO:teuthology.orchestra.run.smithi059.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-16T20:53:58.655 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/vg_nvme/lv_1 2020-11-16T20:53:58.656 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/vg_nvme/lv_2 2020-11-16T20:53:58.656 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/vg_nvme/lv_3 2020-11-16T20:53:58.656 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/vg_nvme/lv_4 2020-11-16T20:53:58.656 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records in 2020-11-16T20:53:58.656 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records out 2020-11-16T20:53:58.657 INFO:teuthology.orchestra.run.smithi059.stderr:72 bytes copied, 3.857e-05 s, 1.9 MB/s 2020-11-16T20:53:58.657 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-16T20:53:58.657 INFO:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-16T20:53:58.711 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-16T20:53:58.712 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-16T20:53:58.712 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 141173 Links: 1 2020-11-16T20:53:58.712 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-16T20:53:58.712 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2020-11-16T20:53:58.712 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2020-11-16 20:53:47.267630149 +0000 2020-11-16T20:53:58.712 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2020-11-16 20:49:58.290156824 +0000 2020-11-16T20:53:58.712 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2020-11-16 20:49:58.290156824 +0000 2020-11-16T20:53:58.713 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2020-11-16T20:53:58.729 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2020-11-16T20:53:58.729 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2020-11-16T20:53:58.729 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000245413 s, 2.1 MB/s 2020-11-16T20:53:58.732 INFO:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-16T20:53:58.787 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-16T20:53:58.788 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-16T20:53:58.788 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 141220 Links: 1 2020-11-16T20:53:58.788 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-16T20:53:58.788 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2020-11-16T20:53:58.789 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2020-11-16 20:53:47.267630149 +0000 2020-11-16T20:53:58.789 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2020-11-16 20:49:58.663151649 +0000 2020-11-16T20:53:58.789 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2020-11-16 20:49:58.663151649 +0000 2020-11-16T20:53:58.789 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2020-11-16T20:53:58.805 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2020-11-16T20:53:58.805 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2020-11-16T20:53:58.805 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000200765 s, 2.6 MB/s 2020-11-16T20:53:58.807 INFO:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-16T20:53:58.863 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-16T20:54:03.155 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-16T20:54:03.156 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 145880 Links: 1 2020-11-16T20:54:03.156 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-16T20:54:03.156 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2020-11-16T20:54:03.156 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2020-11-16 20:53:47.267630149 +0000 2020-11-16T20:54:03.156 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2020-11-16 20:49:59.022146668 +0000 2020-11-16T20:54:03.156 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2020-11-16 20:49:59.022146668 +0000 2020-11-16T20:54:03.157 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2020-11-16T20:54:03.158 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2020-11-16T20:54:03.158 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2020-11-16T20:54:03.158 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000214486 s, 2.4 MB/s 2020-11-16T20:54:03.158 INFO:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-16T20:54:03.215 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-16T20:54:03.216 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-16T20:54:03.216 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 146564 Links: 1 2020-11-16T20:54:03.216 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-16T20:54:03.216 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2020-11-16T20:54:03.216 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2020-11-16 20:53:47.267630149 +0000 2020-11-16T20:54:03.216 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2020-11-16 20:50:03.471084959 +0000 2020-11-16T20:54:03.217 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2020-11-16 20:50:03.471084959 +0000 2020-11-16T20:54:03.217 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2020-11-16T20:54:03.235 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2020-11-16T20:54:03.235 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2020-11-16T20:54:03.235 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000249863 s, 2.0 MB/s 2020-11-16T20:54:03.238 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-11-16T20:54:03.239 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi166.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2020-11-16T20:54:03.239 INFO:tasks.ceph:Generating config... 2020-11-16T20:54:03.240 INFO:tasks.ceph:[osd] debug monc = 20 2020-11-16T20:54:03.240 INFO:tasks.ceph:[osd] bdev async discard = True 2020-11-16T20:54:03.241 INFO:tasks.ceph:[osd] bdev enable discard = True 2020-11-16T20:54:03.241 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2020-11-16T20:54:03.241 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-11-16T20:54:03.241 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-11-16T20:54:03.241 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-11-16T20:54:03.242 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-11-16T20:54:03.242 INFO:tasks.ceph:[osd] debug filestore = 20 2020-11-16T20:54:03.242 INFO:tasks.ceph:[osd] debug journal = 20 2020-11-16T20:54:03.242 INFO:tasks.ceph:[osd] debug ms = 20 2020-11-16T20:54:03.242 INFO:tasks.ceph:[osd] debug osd = 25 2020-11-16T20:54:03.243 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-11-16T20:54:03.243 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-11-16T20:54:03.243 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-11-16T20:54:03.243 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-11-16T20:54:03.244 INFO:tasks.ceph:[osd] osd backoff on peering = True 2020-11-16T20:54:03.244 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2020-11-16T20:54:03.244 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2020-11-16T20:54:03.244 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-11-16T20:54:03.245 INFO:tasks.ceph:[osd] osd heartbeat use min delay socket = True 2020-11-16T20:54:03.245 INFO:tasks.ceph:[osd] osd map cache size = 1 2020-11-16T20:54:03.245 INFO:tasks.ceph:[osd] osd max backfills = 6 2020-11-16T20:54:03.245 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2020-11-16T20:54:03.245 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-11-16T20:54:03.246 INFO:tasks.ceph:[osd] osd op queue = debug_random 2020-11-16T20:54:03.246 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2020-11-16T20:54:03.246 INFO:tasks.ceph:[osd] osd scrub during recovery = False 2020-11-16T20:54:03.246 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2020-11-16T20:54:03.247 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2020-11-16T20:54:03.247 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2020-11-16T20:54:03.247 INFO:tasks.ceph:[osd] osd_max_pg_log_entries = 3000 2020-11-16T20:54:03.247 INFO:tasks.ceph:[osd] osd_min_pg_log_entries = 3000 2020-11-16T20:54:03.247 INFO:tasks.ceph:[global] mon client directed command retry = 5 2020-11-16T20:54:03.248 INFO:tasks.ceph:[global] mon election default strategy = 3 2020-11-16T20:54:03.248 INFO:tasks.ceph:[global] ms bind msgr1 = False 2020-11-16T20:54:03.248 INFO:tasks.ceph:[global] ms bind msgr2 = True 2020-11-16T20:54:03.248 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2020-11-16T20:54:03.249 INFO:tasks.ceph:[global] ms type = async 2020-11-16T20:54:03.249 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 2 2020-11-16T20:54:03.249 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 1 2020-11-16T20:54:03.249 INFO:tasks.ceph:[global] osd_pg_log_trim_min = 0 2020-11-16T20:54:03.249 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2020-11-16T20:54:03.250 INFO:tasks.ceph:[global] osd_pool_default_size = 3 2020-11-16T20:54:03.250 INFO:tasks.ceph:[global] osd_recovery_max_active = 10 2020-11-16T20:54:03.250 INFO:tasks.ceph:[global] osd_recovery_max_single_start = 10 2020-11-16T20:54:03.250 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-11-16T20:54:03.250 INFO:tasks.ceph:[mgr] debug ms = 1 2020-11-16T20:54:03.251 INFO:tasks.ceph:[mon] debug mon = 20 2020-11-16T20:54:03.251 INFO:tasks.ceph:[mon] debug ms = 1 2020-11-16T20:54:03.251 INFO:tasks.ceph:[mon] debug paxos = 20 2020-11-16T20:54:03.251 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2020-11-16T20:54:03.251 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2020-11-16T20:54:03.252 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2020-11-16T20:54:03.252 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2020-11-16T20:54:03.252 INFO:tasks.ceph:[mon] paxos service trim min = 10 2020-11-16T20:54:03.252 INFO:tasks.ceph:Setting up mon.a... 2020-11-16T20:54:03.253 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-11-16T20:54:03.314 INFO:teuthology.orchestra.run.smithi166.stdout:creating /etc/ceph/ceph.keyring 2020-11-16T20:54:03.316 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-11-16T20:54:03.361 INFO:teuthology.orchestra.run.smithi166:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-16T20:54:07.652 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.166'), ('mon.c', '[v2:172.21.15.166:3301,v1:172.21.15.166:6790]'), ('mon.b', '172.21.15.59')] 2020-11-16T20:54:07.653 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.166,[v2:172.21.15.166:3301,v1:172.21.15.166:6790],172.21.15.59', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd map cache size': 1, 'osd max backfills': 6, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub during recovery': False, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2020-11-16T20:54:07.654 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-16T20:54:07.654 INFO:teuthology.orchestra.run.smithi166:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2020-11-16T20:54:07.707 INFO:teuthology.orchestra.run.smithi166.stderr:+ dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2020-11-16T20:54:07.708 INFO:teuthology.orchestra.run.smithi166.stderr:7+1 records in 2020-11-16T20:54:07.709 INFO:teuthology.orchestra.run.smithi166.stderr:7+1 records out 2020-11-16T20:54:07.709 INFO:teuthology.orchestra.run.smithi166.stderr:3960 bytes (4.0 kB, 3.9 KiB) copied, 4.7394e-05 s, 83.6 MB/s 2020-11-16T20:54:07.709 INFO:teuthology.orchestra.run.smithi166:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.166 --addv c '[v2:172.21.15.166:3301,v1:172.21.15.166:6790]' --add b 172.21.15.59 --print /home/ubuntu/cephtest/ceph.monmap 2020-11-16T20:54:07.791 INFO:teuthology.orchestra.run.smithi166.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-11-16T20:54:07.792 INFO:teuthology.orchestra.run.smithi166.stdout:monmaptool: generated fsid a14fd848-4cfe-4cd9-9140-5b3c4b4e904d 2020-11-16T20:54:07.792 INFO:teuthology.orchestra.run.smithi166.stdout:epoch 0 2020-11-16T20:54:07.792 INFO:teuthology.orchestra.run.smithi166.stdout:fsid a14fd848-4cfe-4cd9-9140-5b3c4b4e904d 2020-11-16T20:54:07.792 INFO:teuthology.orchestra.run.smithi166.stdout:last_changed 2020-11-16T20:54:07.796582+0000 2020-11-16T20:54:07.792 INFO:teuthology.orchestra.run.smithi166.stdout:created 2020-11-16T20:54:07.796582+0000 2020-11-16T20:54:07.793 INFO:teuthology.orchestra.run.smithi166.stdout:min_mon_release 0 (unknown) 2020-11-16T20:54:07.793 INFO:teuthology.orchestra.run.smithi166.stdout:election_strategy: 3 2020-11-16T20:54:07.793 INFO:teuthology.orchestra.run.smithi166.stdout:0: [v2:172.21.15.166:3300/0,v1:172.21.15.166:6789/0] mon.a 2020-11-16T20:54:07.793 INFO:teuthology.orchestra.run.smithi166.stdout:1: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.b 2020-11-16T20:54:07.793 INFO:teuthology.orchestra.run.smithi166.stdout:2: [v2:172.21.15.166:3301/0,v1:172.21.15.166:6790/0] mon.c 2020-11-16T20:54:07.793 INFO:teuthology.orchestra.run.smithi166.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-11-16T20:54:07.795 INFO:teuthology.orchestra.run.smithi166:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2020-11-16T20:54:07.849 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a14fd848-4cfe-4cd9-9140-5b3c4b4e904d... 2020-11-16T20:54:07.850 INFO:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-16T20:54:07.854 INFO:teuthology.orchestra.run.smithi166:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-16T20:54:07.923 INFO:teuthology.orchestra.run.smithi059.stdout:[global] 2020-11-16T20:54:07.923 INFO:teuthology.orchestra.run.smithi059.stdout: chdir = "" 2020-11-16T20:54:07.923 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-16T20:54:07.924 INFO:teuthology.orchestra.run.smithi059.stdout: auth supported = cephx 2020-11-16T20:54:07.924 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.924 INFO:teuthology.orchestra.run.smithi059.stdout: filestore xattr use omap = true 2020-11-16T20:54:07.924 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.924 INFO:teuthology.orchestra.run.smithi059.stdout: mon clock drift allowed = 1.000 2020-11-16T20:54:07.924 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.924 INFO:teuthology.orchestra.run.smithi059.stdout: osd crush chooseleaf type = 0 2020-11-16T20:54:07.925 INFO:teuthology.orchestra.run.smithi059.stdout: auth debug = true 2020-11-16T20:54:07.925 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.925 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on old message = true 2020-11-16T20:54:07.925 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on bug = true 2020-11-16T20:54:07.925 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.925 INFO:teuthology.orchestra.run.smithi059.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-16T20:54:07.925 INFO:teuthology.orchestra.run.smithi059.stdout: mon pg warn max object skew = 0 2020-11-16T20:54:07.926 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.926 INFO:teuthology.orchestra.run.smithi059.stdout: # disable pg_autoscaler by default for new pools 2020-11-16T20:54:07.926 INFO:teuthology.orchestra.run.smithi059.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-16T20:54:07.926 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.926 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default size = 2 2020-11-16T20:54:07.926 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.926 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow primary affinity = true 2020-11-16T20:54:07.927 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow pg remap = true 2020-11-16T20:54:07.927 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on legacy crush tunables = false 2020-11-16T20:54:07.927 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on crush straw calc version zero = false 2020-11-16T20:54:07.927 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on no sortbitwise = false 2020-11-16T20:54:07.927 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on osd down out interval zero = false 2020-11-16T20:54:07.927 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on too few osds = false 2020-11-16T20:54:07.927 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-16T20:54:07.928 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-16T20:54:07.928 INFO:teuthology.orchestra.run.smithi059.stdout: mon_allow_pool_size_one = true 2020-11-16T20:54:07.928 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.928 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-16T20:54:07.928 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.928 INFO:teuthology.orchestra.run.smithi059.stdout: osd default data pool replay window = 5 2020-11-16T20:54:07.928 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.929 INFO:teuthology.orchestra.run.smithi059.stdout: mon allow pool delete = true 2020-11-16T20:54:07.929 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.929 INFO:teuthology.orchestra.run.smithi059.stdout: mon cluster log file level = debug 2020-11-16T20:54:07.929 INFO:teuthology.orchestra.run.smithi059.stdout: debug asserts on shutdown = true 2020-11-16T20:54:07.929 INFO:teuthology.orchestra.run.smithi059.stdout: mon health detail to clog = false 2020-11-16T20:54:07.929 INFO:teuthology.orchestra.run.smithi059.stdout: mon host = "172.21.15.166,[v2:172.21.15.166:3301,v1:172.21.15.166:6790],172.21.15.59" 2020-11-16T20:54:07.929 INFO:teuthology.orchestra.run.smithi059.stdout: mon client directed command retry = 5 2020-11-16T20:54:07.930 INFO:teuthology.orchestra.run.smithi059.stdout: mon election default strategy = 3 2020-11-16T20:54:07.930 INFO:teuthology.orchestra.run.smithi059.stdout: ms bind msgr1 = False 2020-11-16T20:54:07.930 INFO:teuthology.orchestra.run.smithi059.stdout: ms bind msgr2 = True 2020-11-16T20:54:07.930 INFO:teuthology.orchestra.run.smithi059.stdout: ms inject socket failures = 5000 2020-11-16T20:54:07.930 INFO:teuthology.orchestra.run.smithi059.stdout: ms type = async 2020-11-16T20:54:07.930 INFO:teuthology.orchestra.run.smithi059.stdout: osd_max_pg_log_entries = 2 2020-11-16T20:54:07.930 INFO:teuthology.orchestra.run.smithi059.stdout: osd_min_pg_log_entries = 1 2020-11-16T20:54:07.930 INFO:teuthology.orchestra.run.smithi059.stdout: osd_pg_log_trim_min = 0 2020-11-16T20:54:07.931 INFO:teuthology.orchestra.run.smithi059.stdout: osd_pool_default_min_size = 2 2020-11-16T20:54:07.931 INFO:teuthology.orchestra.run.smithi059.stdout: osd_pool_default_size = 3 2020-11-16T20:54:07.931 INFO:teuthology.orchestra.run.smithi059.stdout: osd_recovery_max_active = 10 2020-11-16T20:54:07.931 INFO:teuthology.orchestra.run.smithi059.stdout: osd_recovery_max_single_start = 10 2020-11-16T20:54:07.931 INFO:teuthology.orchestra.run.smithi059.stdout: fsid = a14fd848-4cfe-4cd9-9140-5b3c4b4e904d 2020-11-16T20:54:07.931 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.931 INFO:teuthology.orchestra.run.smithi059.stdout:[osd] 2020-11-16T20:54:07.932 INFO:teuthology.orchestra.run.smithi059.stdout: osd journal size = 100 2020-11-16T20:54:07.932 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.932 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub load threshold = 5.0 2020-11-16T20:54:07.932 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub max interval = 120 2020-11-16T20:54:07.932 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.932 INFO:teuthology.orchestra.run.smithi059.stdout: osd recover clone overlap = true 2020-11-16T20:54:07.932 INFO:teuthology.orchestra.run.smithi059.stdout: osd recovery max chunk = 1048576 2020-11-16T20:54:07.933 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.933 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug shutdown = true 2020-11-16T20:54:07.933 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug op order = true 2020-11-16T20:54:07.933 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug verify stray on activate = true 2020-11-16T20:54:07.933 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.933 INFO:teuthology.orchestra.run.smithi059.stdout: osd open classes on start = true 2020-11-16T20:54:07.933 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug pg log writeout = true 2020-11-16T20:54:07.934 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.934 INFO:teuthology.orchestra.run.smithi059.stdout: osd deep scrub update digest min age = 30 2020-11-16T20:54:07.934 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.934 INFO:teuthology.orchestra.run.smithi059.stdout: osd map max advance = 10 2020-11-16T20:54:07.934 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.934 INFO:teuthology.orchestra.run.smithi059.stdout: journal zero on create = true 2020-11-16T20:54:07.934 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.935 INFO:teuthology.orchestra.run.smithi059.stdout: filestore ondisk finisher threads = 3 2020-11-16T20:54:07.935 INFO:teuthology.orchestra.run.smithi059.stdout: filestore apply finisher threads = 3 2020-11-16T20:54:07.935 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.935 INFO:teuthology.orchestra.run.smithi059.stdout: bdev debug aio = true 2020-11-16T20:54:07.935 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug misdirected ops = true 2020-11-16T20:54:07.935 INFO:teuthology.orchestra.run.smithi059.stdout: debug monc = 20 2020-11-16T20:54:07.935 INFO:teuthology.orchestra.run.smithi059.stdout: bdev async discard = True 2020-11-16T20:54:07.936 INFO:teuthology.orchestra.run.smithi059.stdout: bdev enable discard = True 2020-11-16T20:54:07.936 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore allocator = bitmap 2020-11-16T20:54:07.936 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore block size = 96636764160 2020-11-16T20:54:07.936 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore fsck on mount = True 2020-11-16T20:54:07.936 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluefs = 20 2020-11-16T20:54:07.936 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluestore = 20 2020-11-16T20:54:07.936 INFO:teuthology.orchestra.run.smithi059.stdout: debug filestore = 20 2020-11-16T20:54:07.937 INFO:teuthology.orchestra.run.smithi059.stdout: debug journal = 20 2020-11-16T20:54:07.937 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 20 2020-11-16T20:54:07.937 INFO:teuthology.orchestra.run.smithi059.stdout: debug osd = 25 2020-11-16T20:54:07.937 INFO:teuthology.orchestra.run.smithi059.stdout: debug rocksdb = 10 2020-11-16T20:54:07.937 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd backfillfull_ratio = 0.85 2020-11-16T20:54:07.937 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd full ratio = 0.9 2020-11-16T20:54:07.937 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd nearfull ratio = 0.8 2020-11-16T20:54:07.937 INFO:teuthology.orchestra.run.smithi059.stdout: osd backoff on peering = True 2020-11-16T20:54:07.938 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug verify cached snaps = True 2020-11-16T20:54:07.938 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug verify missing on start = True 2020-11-16T20:54:07.938 INFO:teuthology.orchestra.run.smithi059.stdout: osd failsafe full ratio = 0.95 2020-11-16T20:54:07.938 INFO:teuthology.orchestra.run.smithi059.stdout: osd heartbeat use min delay socket = True 2020-11-16T20:54:07.938 INFO:teuthology.orchestra.run.smithi059.stdout: osd map cache size = 1 2020-11-16T20:54:07.938 INFO:teuthology.orchestra.run.smithi059.stdout: osd max backfills = 6 2020-11-16T20:54:07.938 INFO:teuthology.orchestra.run.smithi059.stdout: osd max markdown count = 1000 2020-11-16T20:54:07.939 INFO:teuthology.orchestra.run.smithi059.stdout: osd objectstore = bluestore 2020-11-16T20:54:07.939 INFO:teuthology.orchestra.run.smithi059.stdout: osd op queue = debug_random 2020-11-16T20:54:07.939 INFO:teuthology.orchestra.run.smithi059.stdout: osd op queue cut off = debug_random 2020-11-16T20:54:07.939 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub during recovery = False 2020-11-16T20:54:07.939 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub min interval = 60 2020-11-16T20:54:07.939 INFO:teuthology.orchestra.run.smithi059.stdout: osd shutdown pgref assert = True 2020-11-16T20:54:07.939 INFO:teuthology.orchestra.run.smithi059.stdout: osd_max_pg_log_entries = 3000 2020-11-16T20:54:07.940 INFO:teuthology.orchestra.run.smithi059.stdout: osd_min_pg_log_entries = 3000 2020-11-16T20:54:07.940 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.940 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr] 2020-11-16T20:54:07.940 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2020-11-16T20:54:07.940 INFO:teuthology.orchestra.run.smithi059.stdout: debug mgr = 20 2020-11-16T20:54:07.940 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2020-11-16T20:54:07.940 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2020-11-16T20:54:07.940 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2020-11-16T20:54:07.941 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2020-11-16T20:54:07.941 INFO:teuthology.orchestra.run.smithi059.stdout: mgr/telemetry/nag = false 2020-11-16T20:54:07.941 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.941 INFO:teuthology.orchestra.run.smithi059.stdout:[mon] 2020-11-16T20:54:07.941 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2020-11-16T20:54:07.941 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2020-11-16T20:54:07.941 INFO:teuthology.orchestra.run.smithi059.stdout: debug paxos = 20 2020-11-16T20:54:07.942 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2020-11-16T20:54:07.942 INFO:teuthology.orchestra.run.smithi059.stdout: mon data avail warn = 5 2020-11-16T20:54:07.942 INFO:teuthology.orchestra.run.smithi059.stdout: mon mgr mkfs grace = 240 2020-11-16T20:54:07.942 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2020-11-16T20:54:07.942 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd reporter subtree level = osd 2020-11-16T20:54:07.942 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd prime pg temp = true 2020-11-16T20:54:07.942 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2020-11-16T20:54:07.943 INFO:teuthology.orchestra.run.smithi059.stdout: mon min osdmap epochs = 50 2020-11-16T20:54:07.943 INFO:teuthology.orchestra.run.smithi059.stdout: mon osdmap full prune interval = 2 2020-11-16T20:54:07.943 INFO:teuthology.orchestra.run.smithi059.stdout: mon osdmap full prune min = 15 2020-11-16T20:54:07.943 INFO:teuthology.orchestra.run.smithi059.stdout: mon osdmap full prune txsize = 2 2020-11-16T20:54:07.943 INFO:teuthology.orchestra.run.smithi059.stdout: paxos service trim min = 10 2020-11-16T20:54:07.943 INFO:teuthology.orchestra.run.smithi059.stdout: 2020-11-16T20:54:07.943 INFO:teuthology.orchestra.run.smithi059.stdout:[client] 2020-11-16T20:54:07.943 INFO:teuthology.orchestra.run.smithi059.stdout: rgw cache enabled = true 2020-11-16T20:54:07.944 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable ops log = true 2020-11-16T20:54:07.944 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable usage log = true 2020-11-16T20:54:07.944 INFO:teuthology.orchestra.run.smithi059.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-16T20:54:07.944 INFO:teuthology.orchestra.run.smithi059.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-16T20:54:07.944 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.a] 2020-11-16T20:54:07.944 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.c] 2020-11-16T20:54:07.944 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.b] 2020-11-16T20:54:07.945 INFO:teuthology.orchestra.run.smithi166.stdout:[global] 2020-11-16T20:54:07.946 INFO:teuthology.orchestra.run.smithi166.stdout: chdir = "" 2020-11-16T20:54:07.946 INFO:teuthology.orchestra.run.smithi166.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-16T20:54:07.946 INFO:teuthology.orchestra.run.smithi166.stdout: auth supported = cephx 2020-11-16T20:54:07.946 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.946 INFO:teuthology.orchestra.run.smithi166.stdout: filestore xattr use omap = true 2020-11-16T20:54:07.946 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.947 INFO:teuthology.orchestra.run.smithi166.stdout: mon clock drift allowed = 1.000 2020-11-16T20:54:07.947 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.947 INFO:teuthology.orchestra.run.smithi166.stdout: osd crush chooseleaf type = 0 2020-11-16T20:54:07.947 INFO:teuthology.orchestra.run.smithi166.stdout: auth debug = true 2020-11-16T20:54:07.947 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.947 INFO:teuthology.orchestra.run.smithi166.stdout: ms die on old message = true 2020-11-16T20:54:07.947 INFO:teuthology.orchestra.run.smithi166.stdout: ms die on bug = true 2020-11-16T20:54:07.948 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.948 INFO:teuthology.orchestra.run.smithi166.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-16T20:54:07.948 INFO:teuthology.orchestra.run.smithi166.stdout: mon pg warn max object skew = 0 2020-11-16T20:54:07.948 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.948 INFO:teuthology.orchestra.run.smithi166.stdout: # disable pg_autoscaler by default for new pools 2020-11-16T20:54:07.948 INFO:teuthology.orchestra.run.smithi166.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-16T20:54:07.948 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.949 INFO:teuthology.orchestra.run.smithi166.stdout: osd pool default size = 2 2020-11-16T20:54:07.949 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.949 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd allow primary affinity = true 2020-11-16T20:54:07.949 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd allow pg remap = true 2020-11-16T20:54:07.949 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on legacy crush tunables = false 2020-11-16T20:54:07.949 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on crush straw calc version zero = false 2020-11-16T20:54:07.949 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on no sortbitwise = false 2020-11-16T20:54:07.949 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on osd down out interval zero = false 2020-11-16T20:54:07.950 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on too few osds = false 2020-11-16T20:54:07.950 INFO:teuthology.orchestra.run.smithi166.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-16T20:54:07.950 INFO:teuthology.orchestra.run.smithi166.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-16T20:54:07.950 INFO:teuthology.orchestra.run.smithi166.stdout: mon_allow_pool_size_one = true 2020-11-16T20:54:07.950 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.950 INFO:teuthology.orchestra.run.smithi166.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-16T20:54:07.950 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.951 INFO:teuthology.orchestra.run.smithi166.stdout: osd default data pool replay window = 5 2020-11-16T20:54:07.951 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.951 INFO:teuthology.orchestra.run.smithi166.stdout: mon allow pool delete = true 2020-11-16T20:54:07.951 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.951 INFO:teuthology.orchestra.run.smithi166.stdout: mon cluster log file level = debug 2020-11-16T20:54:07.951 INFO:teuthology.orchestra.run.smithi166.stdout: debug asserts on shutdown = true 2020-11-16T20:54:07.951 INFO:teuthology.orchestra.run.smithi166.stdout: mon health detail to clog = false 2020-11-16T20:54:07.952 INFO:teuthology.orchestra.run.smithi166.stdout: mon host = "172.21.15.166,[v2:172.21.15.166:3301,v1:172.21.15.166:6790],172.21.15.59" 2020-11-16T20:54:07.952 INFO:teuthology.orchestra.run.smithi166.stdout: mon client directed command retry = 5 2020-11-16T20:54:07.952 INFO:teuthology.orchestra.run.smithi166.stdout: mon election default strategy = 3 2020-11-16T20:54:07.952 INFO:teuthology.orchestra.run.smithi166.stdout: ms bind msgr1 = False 2020-11-16T20:54:07.952 INFO:teuthology.orchestra.run.smithi166.stdout: ms bind msgr2 = True 2020-11-16T20:54:07.952 INFO:teuthology.orchestra.run.smithi166.stdout: ms inject socket failures = 5000 2020-11-16T20:54:07.952 INFO:teuthology.orchestra.run.smithi166.stdout: ms type = async 2020-11-16T20:54:07.952 INFO:teuthology.orchestra.run.smithi166.stdout: osd_max_pg_log_entries = 2 2020-11-16T20:54:07.953 INFO:teuthology.orchestra.run.smithi166.stdout: osd_min_pg_log_entries = 1 2020-11-16T20:54:07.953 INFO:teuthology.orchestra.run.smithi166.stdout: osd_pg_log_trim_min = 0 2020-11-16T20:54:07.953 INFO:teuthology.orchestra.run.smithi166.stdout: osd_pool_default_min_size = 2 2020-11-16T20:54:07.953 INFO:teuthology.orchestra.run.smithi166.stdout: osd_pool_default_size = 3 2020-11-16T20:54:07.953 INFO:teuthology.orchestra.run.smithi166.stdout: osd_recovery_max_active = 10 2020-11-16T20:54:07.953 INFO:teuthology.orchestra.run.smithi166.stdout: osd_recovery_max_single_start = 10 2020-11-16T20:54:07.953 INFO:teuthology.orchestra.run.smithi166.stdout: fsid = a14fd848-4cfe-4cd9-9140-5b3c4b4e904d 2020-11-16T20:54:07.954 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.954 INFO:teuthology.orchestra.run.smithi166.stdout:[osd] 2020-11-16T20:54:07.954 INFO:teuthology.orchestra.run.smithi166.stdout: osd journal size = 100 2020-11-16T20:54:07.954 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.954 INFO:teuthology.orchestra.run.smithi166.stdout: osd scrub load threshold = 5.0 2020-11-16T20:54:07.954 INFO:teuthology.orchestra.run.smithi166.stdout: osd scrub max interval = 120 2020-11-16T20:54:07.954 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.955 INFO:teuthology.orchestra.run.smithi166.stdout: osd recover clone overlap = true 2020-11-16T20:54:07.955 INFO:teuthology.orchestra.run.smithi166.stdout: osd recovery max chunk = 1048576 2020-11-16T20:54:07.955 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.955 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug shutdown = true 2020-11-16T20:54:07.955 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug op order = true 2020-11-16T20:54:07.955 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug verify stray on activate = true 2020-11-16T20:54:07.955 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.955 INFO:teuthology.orchestra.run.smithi166.stdout: osd open classes on start = true 2020-11-16T20:54:07.956 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug pg log writeout = true 2020-11-16T20:54:07.956 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.956 INFO:teuthology.orchestra.run.smithi166.stdout: osd deep scrub update digest min age = 30 2020-11-16T20:54:07.956 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.956 INFO:teuthology.orchestra.run.smithi166.stdout: osd map max advance = 10 2020-11-16T20:54:07.956 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.956 INFO:teuthology.orchestra.run.smithi166.stdout: journal zero on create = true 2020-11-16T20:54:07.957 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.957 INFO:teuthology.orchestra.run.smithi166.stdout: filestore ondisk finisher threads = 3 2020-11-16T20:54:07.957 INFO:teuthology.orchestra.run.smithi166.stdout: filestore apply finisher threads = 3 2020-11-16T20:54:07.957 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.957 INFO:teuthology.orchestra.run.smithi166.stdout: bdev debug aio = true 2020-11-16T20:54:07.957 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug misdirected ops = true 2020-11-16T20:54:07.957 INFO:teuthology.orchestra.run.smithi166.stdout: debug monc = 20 2020-11-16T20:54:07.957 INFO:teuthology.orchestra.run.smithi166.stdout: bdev async discard = True 2020-11-16T20:54:07.958 INFO:teuthology.orchestra.run.smithi166.stdout: bdev enable discard = True 2020-11-16T20:54:07.958 INFO:teuthology.orchestra.run.smithi166.stdout: bluestore allocator = bitmap 2020-11-16T20:54:07.958 INFO:teuthology.orchestra.run.smithi166.stdout: bluestore block size = 96636764160 2020-11-16T20:54:07.958 INFO:teuthology.orchestra.run.smithi166.stdout: bluestore fsck on mount = True 2020-11-16T20:54:07.958 INFO:teuthology.orchestra.run.smithi166.stdout: debug bluefs = 20 2020-11-16T20:54:07.958 INFO:teuthology.orchestra.run.smithi166.stdout: debug bluestore = 20 2020-11-16T20:54:07.958 INFO:teuthology.orchestra.run.smithi166.stdout: debug filestore = 20 2020-11-16T20:54:07.959 INFO:teuthology.orchestra.run.smithi166.stdout: debug journal = 20 2020-11-16T20:54:07.959 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 20 2020-11-16T20:54:07.959 INFO:teuthology.orchestra.run.smithi166.stdout: debug osd = 25 2020-11-16T20:54:07.959 INFO:teuthology.orchestra.run.smithi166.stdout: debug rocksdb = 10 2020-11-16T20:54:07.959 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd backfillfull_ratio = 0.85 2020-11-16T20:54:07.959 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd full ratio = 0.9 2020-11-16T20:54:07.959 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd nearfull ratio = 0.8 2020-11-16T20:54:07.959 INFO:teuthology.orchestra.run.smithi166.stdout: osd backoff on peering = True 2020-11-16T20:54:07.960 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug verify cached snaps = True 2020-11-16T20:54:07.960 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug verify missing on start = True 2020-11-16T20:54:07.960 INFO:teuthology.orchestra.run.smithi166.stdout: osd failsafe full ratio = 0.95 2020-11-16T20:54:07.960 INFO:teuthology.orchestra.run.smithi166.stdout: osd heartbeat use min delay socket = True 2020-11-16T20:54:07.960 INFO:teuthology.orchestra.run.smithi166.stdout: osd map cache size = 1 2020-11-16T20:54:07.960 INFO:teuthology.orchestra.run.smithi166.stdout: osd max backfills = 6 2020-11-16T20:54:07.960 INFO:teuthology.orchestra.run.smithi166.stdout: osd max markdown count = 1000 2020-11-16T20:54:07.961 INFO:teuthology.orchestra.run.smithi166.stdout: osd objectstore = bluestore 2020-11-16T20:54:07.961 INFO:teuthology.orchestra.run.smithi166.stdout: osd op queue = debug_random 2020-11-16T20:54:07.961 INFO:teuthology.orchestra.run.smithi166.stdout: osd op queue cut off = debug_random 2020-11-16T20:54:07.961 INFO:teuthology.orchestra.run.smithi166.stdout: osd scrub during recovery = False 2020-11-16T20:54:07.961 INFO:teuthology.orchestra.run.smithi166.stdout: osd scrub min interval = 60 2020-11-16T20:54:07.961 INFO:teuthology.orchestra.run.smithi166.stdout: osd shutdown pgref assert = True 2020-11-16T20:54:07.961 INFO:teuthology.orchestra.run.smithi166.stdout: osd_max_pg_log_entries = 3000 2020-11-16T20:54:07.962 INFO:teuthology.orchestra.run.smithi166.stdout: osd_min_pg_log_entries = 3000 2020-11-16T20:54:07.962 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.962 INFO:teuthology.orchestra.run.smithi166.stdout:[mgr] 2020-11-16T20:54:07.962 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2020-11-16T20:54:07.962 INFO:teuthology.orchestra.run.smithi166.stdout: debug mgr = 20 2020-11-16T20:54:07.962 INFO:teuthology.orchestra.run.smithi166.stdout: debug mon = 20 2020-11-16T20:54:07.962 INFO:teuthology.orchestra.run.smithi166.stdout: debug auth = 20 2020-11-16T20:54:07.962 INFO:teuthology.orchestra.run.smithi166.stdout: mon reweight min pgs per osd = 4 2020-11-16T20:54:07.963 INFO:teuthology.orchestra.run.smithi166.stdout: mon reweight min bytes per osd = 10 2020-11-16T20:54:07.963 INFO:teuthology.orchestra.run.smithi166.stdout: mgr/telemetry/nag = false 2020-11-16T20:54:07.963 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.963 INFO:teuthology.orchestra.run.smithi166.stdout:[mon] 2020-11-16T20:54:07.963 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2020-11-16T20:54:07.963 INFO:teuthology.orchestra.run.smithi166.stdout: debug mon = 20 2020-11-16T20:54:07.963 INFO:teuthology.orchestra.run.smithi166.stdout: debug paxos = 20 2020-11-16T20:54:07.964 INFO:teuthology.orchestra.run.smithi166.stdout: debug auth = 20 2020-11-16T20:54:07.964 INFO:teuthology.orchestra.run.smithi166.stdout: mon data avail warn = 5 2020-11-16T20:54:07.964 INFO:teuthology.orchestra.run.smithi166.stdout: mon mgr mkfs grace = 240 2020-11-16T20:54:07.964 INFO:teuthology.orchestra.run.smithi166.stdout: mon reweight min pgs per osd = 4 2020-11-16T20:54:07.964 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd reporter subtree level = osd 2020-11-16T20:54:07.964 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd prime pg temp = true 2020-11-16T20:54:07.964 INFO:teuthology.orchestra.run.smithi166.stdout: mon reweight min bytes per osd = 10 2020-11-16T20:54:07.965 INFO:teuthology.orchestra.run.smithi166.stdout: mon min osdmap epochs = 50 2020-11-16T20:54:07.965 INFO:teuthology.orchestra.run.smithi166.stdout: mon osdmap full prune interval = 2 2020-11-16T20:54:07.965 INFO:teuthology.orchestra.run.smithi166.stdout: mon osdmap full prune min = 15 2020-11-16T20:54:07.965 INFO:teuthology.orchestra.run.smithi166.stdout: mon osdmap full prune txsize = 2 2020-11-16T20:54:07.965 INFO:teuthology.orchestra.run.smithi166.stdout: paxos service trim min = 10 2020-11-16T20:54:07.965 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:07.965 INFO:teuthology.orchestra.run.smithi166.stdout:[client] 2020-11-16T20:54:07.965 INFO:teuthology.orchestra.run.smithi166.stdout: rgw cache enabled = true 2020-11-16T20:54:07.966 INFO:teuthology.orchestra.run.smithi166.stdout: rgw enable ops log = true 2020-11-16T20:54:07.966 INFO:teuthology.orchestra.run.smithi166.stdout: rgw enable usage log = true 2020-11-16T20:54:07.966 INFO:teuthology.orchestra.run.smithi166.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-16T20:54:07.966 INFO:teuthology.orchestra.run.smithi166.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-16T20:54:07.966 INFO:teuthology.orchestra.run.smithi166.stdout:[mon.a] 2020-11-16T20:54:07.966 INFO:teuthology.orchestra.run.smithi166.stdout:[mon.c] 2020-11-16T20:54:07.966 INFO:teuthology.orchestra.run.smithi166.stdout:[mon.b] 2020-11-16T20:54:07.967 INFO:tasks.ceph:Creating admin key on mon.a... 2020-11-16T20:54:07.968 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-11-16T20:54:08.020 INFO:tasks.ceph:Copying monmap to all nodes... 2020-11-16T20:54:08.021 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-16T20:54:08.021 INFO:teuthology.orchestra.run.smithi166:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2020-11-16T20:54:08.033 INFO:teuthology.orchestra.run.smithi166.stderr:+ dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2020-11-16T20:54:08.034 INFO:teuthology.orchestra.run.smithi166.stdout:[mon.] 2020-11-16T20:54:08.035 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQDr5rJf7bO0FRAAMEH00dFfwEq/BXmoV3T6oQ== 2020-11-16T20:54:08.035 INFO:teuthology.orchestra.run.smithi166.stdout:[client.admin] 2020-11-16T20:54:08.035 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQDw5rJfHlNnARAAfTQLsFvlC5RI3oZEUDo93g== 2020-11-16T20:54:08.035 INFO:teuthology.orchestra.run.smithi166.stdout: caps mds = "allow *" 2020-11-16T20:54:08.035 INFO:teuthology.orchestra.run.smithi166.stdout: caps mgr = "allow *" 2020-11-16T20:54:08.035 INFO:teuthology.orchestra.run.smithi166.stdout: caps mon = "allow *" 2020-11-16T20:54:08.036 INFO:teuthology.orchestra.run.smithi166.stdout: caps osd = "allow *" 2020-11-16T20:54:08.036 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-16T20:54:08.036 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-16T20:54:08.036 INFO:teuthology.orchestra.run.smithi166.stderr:206 bytes copied, 4.1591e-05 s, 5.0 MB/s 2020-11-16T20:54:08.036 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-16T20:54:08.037 INFO:teuthology.orchestra.run.smithi166:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2020-11-16T20:54:08.087 INFO:teuthology.orchestra.run.smithi166.stderr:+ dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2020-11-16T20:54:08.088 INFO:teuthology.orchestra.run.smithi166.stdout: ��O�HL�Lّ@[ set -ex 2020-11-16T20:54:08.089 INFO:teuthology.orchestra.run.smithi166:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-16T20:54:08.089 INFO:teuthology.orchestra.run.smithi166:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-16T20:54:08.141 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-16T20:54:08.154 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-16T20:54:08.154 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-16T20:54:08.154 INFO:teuthology.orchestra.run.smithi166.stderr:206 bytes copied, 5.35e-05 s, 3.9 MB/s 2020-11-16T20:54:08.154 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-16T20:54:08.168 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-16T20:54:08.168 INFO:teuthology.orchestra.run.smithi166:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-16T20:54:08.221 INFO:teuthology.orchestra.run.smithi166.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-16T20:54:08.222 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-16T20:54:08.222 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-16T20:54:08.222 INFO:teuthology.orchestra.run.smithi166.stderr:409 bytes copied, 4.3137e-05 s, 9.5 MB/s 2020-11-16T20:54:08.223 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi059.front.sepia.ceph.com 2020-11-16T20:54:08.223 INFO:teuthology.orchestra.run.smithi059:> set -ex 2020-11-16T20:54:08.223 INFO:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-16T20:54:08.223 INFO:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-16T20:54:08.238 INFO:teuthology.orchestra.run.smithi059.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-16T20:54:08.256 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records in 2020-11-16T20:54:08.256 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records out 2020-11-16T20:54:08.256 INFO:teuthology.orchestra.run.smithi059.stderr:206 bytes copied, 3.5986e-05 s, 5.7 MB/s 2020-11-16T20:54:08.257 INFO:teuthology.orchestra.run.smithi059.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-16T20:54:08.275 INFO:teuthology.orchestra.run.smithi059:> set -ex 2020-11-16T20:54:08.275 INFO:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-16T20:54:08.329 INFO:teuthology.orchestra.run.smithi059.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-16T20:54:08.330 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records in 2020-11-16T20:54:08.330 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records out 2020-11-16T20:54:08.331 INFO:teuthology.orchestra.run.smithi059.stderr:409 bytes copied, 3.5259e-05 s, 11.6 MB/s 2020-11-16T20:54:08.331 INFO:tasks.ceph:Setting up mon nodes... 2020-11-16T20:54:08.331 INFO:tasks.ceph:Setting up mgr nodes... 2020-11-16T20:54:08.331 INFO:teuthology.orchestra.run.smithi166:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-11-16T20:54:08.384 INFO:teuthology.orchestra.run.smithi166.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-11-16T20:54:08.386 INFO:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-11-16T20:54:08.460 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-11-16T20:54:08.462 INFO:tasks.ceph:Setting up mds nodes... 2020-11-16T20:54:08.462 INFO:tasks.ceph_client:Setting up client nodes... 2020-11-16T20:54:08.463 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-11-16T20:54:08.502 INFO:teuthology.orchestra.run.smithi166.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-11-16T20:54:08.518 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2020-11-16T20:54:08.563 INFO:teuthology.orchestra.run.smithi059.stdout:creating /etc/ceph/ceph.client.1.keyring 2020-11-16T20:54:08.583 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-11-16T20:54:08.583 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi166.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2020-11-16T20:54:08.583 INFO:teuthology.orchestra.run.smithi166:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-11-16T20:54:08.610 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-11-16T20:54:08.610 INFO:tasks.ceph:role: osd.0 2020-11-16T20:54:08.610 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi166.front.sepia.ceph.com 2020-11-16T20:54:08.611 INFO:teuthology.orchestra.run.smithi166:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-16T20:54:08.684 INFO:teuthology.orchestra.run.smithi166.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-16T20:54:08.684 INFO:teuthology.orchestra.run.smithi166.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-16T20:54:08.684 INFO:teuthology.orchestra.run.smithi166.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-16T20:54:08.685 INFO:teuthology.orchestra.run.smithi166.stdout: = reflink=1 2020-11-16T20:54:08.685 INFO:teuthology.orchestra.run.smithi166.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-16T20:54:08.685 INFO:teuthology.orchestra.run.smithi166.stdout: = sunit=0 swidth=0 blks 2020-11-16T20:54:08.685 INFO:teuthology.orchestra.run.smithi166.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-16T20:54:08.685 INFO:teuthology.orchestra.run.smithi166.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-16T20:54:08.685 INFO:teuthology.orchestra.run.smithi166.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-16T20:54:08.685 INFO:teuthology.orchestra.run.smithi166.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-16T20:54:09.052 INFO:teuthology.orchestra.run.smithi166.stdout:Discarding blocks...Done. 2020-11-16T20:54:09.053 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi166.front.sepia.ceph.com -o noatime 2020-11-16T20:54:09.054 INFO:teuthology.orchestra.run.smithi166:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2020-11-16T20:54:09.180 INFO:teuthology.orchestra.run.smithi166:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-11-16T20:54:09.211 INFO:teuthology.orchestra.run.smithi166:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-11-16T20:54:09.277 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-11-16T20:54:09.278 INFO:tasks.ceph:role: osd.1 2020-11-16T20:54:09.278 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi166.front.sepia.ceph.com 2020-11-16T20:54:09.278 INFO:teuthology.orchestra.run.smithi166:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-16T20:54:09.351 INFO:teuthology.orchestra.run.smithi166.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-16T20:54:09.351 INFO:teuthology.orchestra.run.smithi166.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-16T20:54:09.352 INFO:teuthology.orchestra.run.smithi166.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-16T20:54:09.352 INFO:teuthology.orchestra.run.smithi166.stdout: = reflink=1 2020-11-16T20:54:09.352 INFO:teuthology.orchestra.run.smithi166.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-16T20:54:09.352 INFO:teuthology.orchestra.run.smithi166.stdout: = sunit=0 swidth=0 blks 2020-11-16T20:54:09.352 INFO:teuthology.orchestra.run.smithi166.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-16T20:54:09.352 INFO:teuthology.orchestra.run.smithi166.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-16T20:54:09.352 INFO:teuthology.orchestra.run.smithi166.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-16T20:54:09.353 INFO:teuthology.orchestra.run.smithi166.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-16T20:54:09.711 INFO:teuthology.orchestra.run.smithi166.stdout:Discarding blocks...Done. 2020-11-16T20:54:09.713 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi166.front.sepia.ceph.com -o noatime 2020-11-16T20:54:09.713 INFO:teuthology.orchestra.run.smithi166:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2020-11-16T20:54:09.799 INFO:teuthology.orchestra.run.smithi166:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-11-16T20:54:09.830 INFO:teuthology.orchestra.run.smithi166:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-11-16T20:54:09.897 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-11-16T20:54:09.897 INFO:tasks.ceph:role: osd.2 2020-11-16T20:54:09.897 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi166.front.sepia.ceph.com 2020-11-16T20:54:09.898 INFO:teuthology.orchestra.run.smithi166:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-16T20:54:09.971 INFO:teuthology.orchestra.run.smithi166.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-16T20:54:09.972 INFO:teuthology.orchestra.run.smithi166.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-16T20:54:09.972 INFO:teuthology.orchestra.run.smithi166.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-16T20:54:09.972 INFO:teuthology.orchestra.run.smithi166.stdout: = reflink=1 2020-11-16T20:54:09.972 INFO:teuthology.orchestra.run.smithi166.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-16T20:54:09.972 INFO:teuthology.orchestra.run.smithi166.stdout: = sunit=0 swidth=0 blks 2020-11-16T20:54:09.972 INFO:teuthology.orchestra.run.smithi166.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-16T20:54:09.972 INFO:teuthology.orchestra.run.smithi166.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-16T20:54:09.973 INFO:teuthology.orchestra.run.smithi166.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-16T20:54:09.973 INFO:teuthology.orchestra.run.smithi166.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-16T20:54:10.338 INFO:teuthology.orchestra.run.smithi166.stdout:Discarding blocks...Done. 2020-11-16T20:54:10.340 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi166.front.sepia.ceph.com -o noatime 2020-11-16T20:54:10.340 INFO:teuthology.orchestra.run.smithi166:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2020-11-16T20:54:10.432 INFO:teuthology.orchestra.run.smithi166:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-11-16T20:54:10.462 INFO:teuthology.orchestra.run.smithi166:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-11-16T20:54:10.528 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-11-16T20:54:10.529 INFO:tasks.ceph:role: osd.3 2020-11-16T20:54:10.529 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi166.front.sepia.ceph.com 2020-11-16T20:54:10.529 INFO:teuthology.orchestra.run.smithi166:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-16T20:54:10.602 INFO:teuthology.orchestra.run.smithi166.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-16T20:54:10.602 INFO:teuthology.orchestra.run.smithi166.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-16T20:54:10.603 INFO:teuthology.orchestra.run.smithi166.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-16T20:54:10.603 INFO:teuthology.orchestra.run.smithi166.stdout: = reflink=1 2020-11-16T20:54:10.603 INFO:teuthology.orchestra.run.smithi166.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-16T20:54:10.603 INFO:teuthology.orchestra.run.smithi166.stdout: = sunit=0 swidth=0 blks 2020-11-16T20:54:10.603 INFO:teuthology.orchestra.run.smithi166.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-16T20:54:10.603 INFO:teuthology.orchestra.run.smithi166.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-16T20:54:10.603 INFO:teuthology.orchestra.run.smithi166.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-16T20:54:10.604 INFO:teuthology.orchestra.run.smithi166.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-16T20:54:10.978 INFO:teuthology.orchestra.run.smithi166.stdout:Discarding blocks...Done. 2020-11-16T20:54:10.979 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi166.front.sepia.ceph.com -o noatime 2020-11-16T20:54:10.980 INFO:teuthology.orchestra.run.smithi166:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2020-11-16T20:54:11.073 INFO:teuthology.orchestra.run.smithi166:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-11-16T20:54:11.104 INFO:teuthology.orchestra.run.smithi166:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-16T20:54:11.188 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-16T20:54:11.192+0000 7fc07b25fec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-11-16T20:54:11.189 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-16T20:54:11.193+0000 7fc07b25fec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-11-16T20:54:11.189 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-16T20:54:11.193+0000 7fc07b25fec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-11-16T20:54:11.189 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-16T20:54:11.193+0000 7fc07b25fec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-11-16T20:54:11.190 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-16T20:54:11.193+0000 7fc07b25fec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-11-16T20:54:11.196 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-16T20:54:11.199+0000 7fc07b25fec0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-11-16T20:54:14.033 INFO:teuthology.orchestra.run.smithi166:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-11-16T20:54:14.066 INFO:teuthology.orchestra.run.smithi166:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-16T20:54:14.154 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-16T20:54:14.157+0000 7f2257459ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-11-16T20:54:14.154 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-16T20:54:14.157+0000 7f2257459ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-11-16T20:54:14.154 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-16T20:54:14.157+0000 7f2257459ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-11-16T20:54:14.154 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-16T20:54:14.157+0000 7f2257459ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-11-16T20:54:14.155 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-16T20:54:14.157+0000 7f2257459ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-11-16T20:54:14.155 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-16T20:54:14.158+0000 7f2257459ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-11-16T20:54:16.997 INFO:teuthology.orchestra.run.smithi166:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-11-16T20:54:17.028 INFO:teuthology.orchestra.run.smithi166:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-16T20:54:17.116 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-16T20:54:17.120+0000 7f51bf671ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-11-16T20:54:17.117 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-16T20:54:17.120+0000 7f51bf671ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-11-16T20:54:17.117 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-16T20:54:17.120+0000 7f51bf671ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-11-16T20:54:17.117 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-16T20:54:17.120+0000 7f51bf671ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-11-16T20:54:17.118 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-16T20:54:17.120+0000 7f51bf671ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-11-16T20:54:17.118 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-16T20:54:17.121+0000 7f51bf671ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-11-16T20:54:19.966 INFO:teuthology.orchestra.run.smithi166:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-11-16T20:54:19.997 INFO:teuthology.orchestra.run.smithi166:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-16T20:54:20.085 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-16T20:54:20.089+0000 7f1cb483eec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-11-16T20:54:20.085 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-16T20:54:20.090+0000 7f1cb483eec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-11-16T20:54:20.085 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-16T20:54:20.090+0000 7f1cb483eec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-11-16T20:54:20.086 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-16T20:54:20.090+0000 7f1cb483eec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-11-16T20:54:20.086 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-16T20:54:20.090+0000 7f1cb483eec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-11-16T20:54:20.086 INFO:teuthology.orchestra.run.smithi166.stderr:2020-11-16T20:54:20.090+0000 7f1cb483eec0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-11-16T20:54:22.932 INFO:teuthology.orchestra.run.smithi166:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-11-16T20:54:22.962 INFO:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-11-16T20:54:22.998 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-11-16T20:54:22.999 INFO:tasks.ceph:role: osd.4 2020-11-16T20:54:22.999 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com 2020-11-16T20:54:22.999 INFO:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-16T20:54:23.080 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-16T20:54:23.081 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-16T20:54:23.081 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-16T20:54:23.081 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 2020-11-16T20:54:23.081 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-16T20:54:23.081 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2020-11-16T20:54:23.082 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-16T20:54:23.082 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-16T20:54:23.082 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-16T20:54:23.082 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-16T20:54:23.442 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2020-11-16T20:54:23.444 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2020-11-16T20:54:23.444 INFO:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2020-11-16T20:54:23.590 INFO:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-11-16T20:54:23.628 INFO:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-11-16T20:54:23.700 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-11-16T20:54:23.701 INFO:tasks.ceph:role: osd.5 2020-11-16T20:54:23.701 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com 2020-11-16T20:54:23.701 INFO:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-16T20:54:23.781 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-16T20:54:23.781 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-16T20:54:23.782 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-16T20:54:23.782 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 2020-11-16T20:54:23.782 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-16T20:54:23.782 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2020-11-16T20:54:23.782 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-16T20:54:23.782 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-16T20:54:23.782 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-16T20:54:23.783 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-16T20:54:24.133 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2020-11-16T20:54:24.135 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2020-11-16T20:54:24.135 INFO:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2020-11-16T20:54:24.227 INFO:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-11-16T20:54:24.263 INFO:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-11-16T20:54:24.336 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-11-16T20:54:24.336 INFO:tasks.ceph:role: osd.6 2020-11-16T20:54:24.336 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com 2020-11-16T20:54:24.337 INFO:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-16T20:54:24.415 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-16T20:54:24.415 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-16T20:54:24.415 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-16T20:54:24.415 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 2020-11-16T20:54:24.415 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-16T20:54:24.416 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2020-11-16T20:54:24.416 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-16T20:54:24.416 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-16T20:54:24.416 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-16T20:54:24.416 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-16T20:54:24.783 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2020-11-16T20:54:24.785 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2020-11-16T20:54:24.785 INFO:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2020-11-16T20:54:24.898 INFO:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-11-16T20:54:24.934 INFO:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-11-16T20:54:25.005 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-11-16T20:54:25.006 INFO:tasks.ceph:role: osd.7 2020-11-16T20:54:25.006 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com 2020-11-16T20:54:25.006 INFO:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-16T20:54:25.085 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-16T20:54:25.085 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-16T20:54:25.085 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-16T20:54:25.086 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 2020-11-16T20:54:25.086 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-16T20:54:25.086 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2020-11-16T20:54:25.086 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-16T20:54:25.086 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-16T20:54:25.086 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-16T20:54:25.086 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-16T20:54:25.468 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2020-11-16T20:54:25.470 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2020-11-16T20:54:25.471 INFO:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2020-11-16T20:54:25.623 INFO:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-11-16T20:54:25.660 INFO:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-16T20:54:25.752 INFO:teuthology.orchestra.run.smithi059.stderr:2020-11-16T20:54:25.756+0000 7f0c31a3dec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-11-16T20:54:25.754 INFO:teuthology.orchestra.run.smithi059.stderr:2020-11-16T20:54:25.759+0000 7f0c31a3dec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-11-16T20:54:25.755 INFO:teuthology.orchestra.run.smithi059.stderr:2020-11-16T20:54:25.759+0000 7f0c31a3dec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-11-16T20:54:25.755 INFO:teuthology.orchestra.run.smithi059.stderr:2020-11-16T20:54:25.759+0000 7f0c31a3dec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-11-16T20:54:25.755 INFO:teuthology.orchestra.run.smithi059.stderr:2020-11-16T20:54:25.759+0000 7f0c31a3dec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-11-16T20:54:25.761 INFO:teuthology.orchestra.run.smithi059.stderr:2020-11-16T20:54:25.766+0000 7f0c31a3dec0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2020-11-16T20:54:28.611 INFO:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-11-16T20:54:28.649 INFO:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-16T20:54:28.742 INFO:teuthology.orchestra.run.smithi059.stderr:2020-11-16T20:54:28.745+0000 7f7501e7bec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-11-16T20:54:28.742 INFO:teuthology.orchestra.run.smithi059.stderr:2020-11-16T20:54:28.746+0000 7f7501e7bec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-11-16T20:54:28.742 INFO:teuthology.orchestra.run.smithi059.stderr:2020-11-16T20:54:28.746+0000 7f7501e7bec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-11-16T20:54:28.742 INFO:teuthology.orchestra.run.smithi059.stderr:2020-11-16T20:54:28.746+0000 7f7501e7bec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-11-16T20:54:28.743 INFO:teuthology.orchestra.run.smithi059.stderr:2020-11-16T20:54:28.746+0000 7f7501e7bec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-11-16T20:54:28.743 INFO:teuthology.orchestra.run.smithi059.stderr:2020-11-16T20:54:28.746+0000 7f7501e7bec0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2020-11-16T20:54:31.583 INFO:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-11-16T20:54:31.619 INFO:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-16T20:54:31.711 INFO:teuthology.orchestra.run.smithi059.stderr:2020-11-16T20:54:31.716+0000 7f7439d9fec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-11-16T20:54:31.712 INFO:teuthology.orchestra.run.smithi059.stderr:2020-11-16T20:54:31.716+0000 7f7439d9fec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-11-16T20:54:31.713 INFO:teuthology.orchestra.run.smithi059.stderr:2020-11-16T20:54:31.716+0000 7f7439d9fec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-11-16T20:54:31.713 INFO:teuthology.orchestra.run.smithi059.stderr:2020-11-16T20:54:31.716+0000 7f7439d9fec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-11-16T20:54:31.713 INFO:teuthology.orchestra.run.smithi059.stderr:2020-11-16T20:54:31.716+0000 7f7439d9fec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-11-16T20:54:31.713 INFO:teuthology.orchestra.run.smithi059.stderr:2020-11-16T20:54:31.716+0000 7f7439d9fec0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2020-11-16T20:54:34.559 INFO:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-11-16T20:54:34.595 INFO:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-16T20:54:34.690 INFO:teuthology.orchestra.run.smithi059.stderr:2020-11-16T20:54:34.693+0000 7f3bb4819ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-11-16T20:54:34.691 INFO:teuthology.orchestra.run.smithi059.stderr:2020-11-16T20:54:34.693+0000 7f3bb4819ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-11-16T20:54:34.691 INFO:teuthology.orchestra.run.smithi059.stderr:2020-11-16T20:54:34.693+0000 7f3bb4819ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-11-16T20:54:34.691 INFO:teuthology.orchestra.run.smithi059.stderr:2020-11-16T20:54:34.693+0000 7f3bb4819ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-11-16T20:54:34.691 INFO:teuthology.orchestra.run.smithi059.stderr:2020-11-16T20:54:34.693+0000 7f3bb4819ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-11-16T20:54:34.691 INFO:teuthology.orchestra.run.smithi059.stderr:2020-11-16T20:54:34.694+0000 7f3bb4819ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2020-11-16T20:54:37.542 INFO:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-11-16T20:54:37.578 INFO:tasks.ceph:Reading keys from all nodes... 2020-11-16T20:54:37.578 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-16T20:54:37.578 INFO:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2020-11-16T20:54:37.594 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2020-11-16T20:54:37.609 INFO:teuthology.orchestra.run.smithi166.stdout:[mgr.y] 2020-11-16T20:54:37.609 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQDw5rJfhGI6FxAAoQ0sDQGYJ28X12udMZj0Ig== 2020-11-16T20:54:37.609 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-16T20:54:37.610 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-16T20:54:37.610 INFO:teuthology.orchestra.run.smithi166.stderr:56 bytes copied, 4.3696e-05 s, 1.3 MB/s 2020-11-16T20:54:37.611 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-16T20:54:37.611 INFO:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2020-11-16T20:54:37.665 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2020-11-16T20:54:37.679 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.0] 2020-11-16T20:54:37.679 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQDz5rJfDAGJCxAAQUzsmOl4lDt4AjEOEyCVMg== 2020-11-16T20:54:37.680 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-16T20:54:37.680 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-16T20:54:37.680 INFO:teuthology.orchestra.run.smithi166.stderr:56 bytes copied, 6.5712e-05 s, 852 kB/s 2020-11-16T20:54:37.681 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-16T20:54:37.681 INFO:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2020-11-16T20:54:37.735 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2020-11-16T20:54:37.749 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.1] 2020-11-16T20:54:37.749 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQD25rJfDCF5CRAAoXRKxgjLzfarHLdg79rS2A== 2020-11-16T20:54:37.750 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-16T20:54:37.750 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-16T20:54:37.750 INFO:teuthology.orchestra.run.smithi166.stderr:56 bytes copied, 3.3586e-05 s, 1.7 MB/s 2020-11-16T20:54:37.751 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-16T20:54:37.751 INFO:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2020-11-16T20:54:37.805 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2020-11-16T20:54:37.819 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.2] 2020-11-16T20:54:37.819 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQD55rJfRyVBBxAAmouMDyokQomTs17Om5axyw== 2020-11-16T20:54:37.819 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-16T20:54:37.819 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-16T20:54:37.819 INFO:teuthology.orchestra.run.smithi166.stderr:56 bytes copied, 4.7919e-05 s, 1.2 MB/s 2020-11-16T20:54:37.820 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-16T20:54:37.821 INFO:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2020-11-16T20:54:37.873 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2020-11-16T20:54:37.886 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.3] 2020-11-16T20:54:37.886 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQD85rJfA9VeBRAAahAM/prhL5H6BJEYE+rx6g== 2020-11-16T20:54:37.887 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-16T20:54:37.887 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-16T20:54:37.887 INFO:teuthology.orchestra.run.smithi166.stderr:56 bytes copied, 3.2829e-05 s, 1.7 MB/s 2020-11-16T20:54:37.888 INFO:teuthology.orchestra.run.smithi059:> set -ex 2020-11-16T20:54:37.888 INFO:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2020-11-16T20:54:37.904 INFO:teuthology.orchestra.run.smithi059.stderr:+ sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2020-11-16T20:54:37.923 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.x] 2020-11-16T20:54:37.923 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDw5rJflB+2GxAAET2YX1AI6pYtfpR25qzhjg== 2020-11-16T20:54:37.923 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records in 2020-11-16T20:54:37.923 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records out 2020-11-16T20:54:37.924 INFO:teuthology.orchestra.run.smithi059.stderr:56 bytes copied, 4.621e-05 s, 1.2 MB/s 2020-11-16T20:54:37.924 INFO:teuthology.orchestra.run.smithi059:> set -ex 2020-11-16T20:54:37.925 INFO:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2020-11-16T20:54:37.980 INFO:teuthology.orchestra.run.smithi059.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2020-11-16T20:54:37.997 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.4] 2020-11-16T20:54:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQAB57JflV4hLRAAgGeEmPQSLbguBy2B1vk0dg== 2020-11-16T20:54:37.998 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records in 2020-11-16T20:54:37.998 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records out 2020-11-16T20:54:37.998 INFO:teuthology.orchestra.run.smithi059.stderr:56 bytes copied, 4.7454e-05 s, 1.2 MB/s 2020-11-16T20:54:37.999 INFO:teuthology.orchestra.run.smithi059:> set -ex 2020-11-16T20:54:38.000 INFO:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2020-11-16T20:54:38.054 INFO:teuthology.orchestra.run.smithi059.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2020-11-16T20:54:38.071 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.5] 2020-11-16T20:54:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQAE57JfBM2BLBAAi8tpQd421q1Yji5iCV9jOA== 2020-11-16T20:54:38.072 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records in 2020-11-16T20:54:38.072 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records out 2020-11-16T20:54:38.072 INFO:teuthology.orchestra.run.smithi059.stderr:56 bytes copied, 4.4824e-05 s, 1.2 MB/s 2020-11-16T20:54:38.073 INFO:teuthology.orchestra.run.smithi059:> set -ex 2020-11-16T20:54:38.073 INFO:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2020-11-16T20:54:38.126 INFO:teuthology.orchestra.run.smithi059.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2020-11-16T20:54:38.143 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.6] 2020-11-16T20:54:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQAH57Jf0uu6KhAAP6HmhWURPqfekKKPhuldjQ== 2020-11-16T20:54:38.144 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records in 2020-11-16T20:54:38.144 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records out 2020-11-16T20:54:38.144 INFO:teuthology.orchestra.run.smithi059.stderr:56 bytes copied, 3.3817e-05 s, 1.7 MB/s 2020-11-16T20:54:38.145 INFO:teuthology.orchestra.run.smithi059:> set -ex 2020-11-16T20:54:38.145 INFO:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2020-11-16T20:54:38.198 INFO:teuthology.orchestra.run.smithi059.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2020-11-16T20:54:38.215 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.7] 2020-11-16T20:54:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQAK57JfQV9vKRAANdjDe4ymGUIBvPt0+EhZZw== 2020-11-16T20:54:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records in 2020-11-16T20:54:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records out 2020-11-16T20:54:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:56 bytes copied, 3.3704e-05 s, 1.7 MB/s 2020-11-16T20:54:38.217 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-16T20:54:38.217 INFO:teuthology.orchestra.run.smithi166:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2020-11-16T20:54:38.231 INFO:teuthology.orchestra.run.smithi166.stderr:+ dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2020-11-16T20:54:38.232 INFO:teuthology.orchestra.run.smithi166.stdout:[client.0] 2020-11-16T20:54:38.232 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQDw5rJf3w5GHhAAjNyTfHmpm7Hsr8VghZomqQ== 2020-11-16T20:54:38.232 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-16T20:54:38.232 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-16T20:54:38.232 INFO:teuthology.orchestra.run.smithi166.stderr:59 bytes copied, 3.0313e-05 s, 1.9 MB/s 2020-11-16T20:54:38.233 INFO:teuthology.orchestra.run.smithi059:> set -ex 2020-11-16T20:54:38.233 INFO:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2020-11-16T20:54:38.270 INFO:teuthology.orchestra.run.smithi059.stderr:+ dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2020-11-16T20:54:38.271 INFO:teuthology.orchestra.run.smithi059.stdout:[client.1] 2020-11-16T20:54:38.271 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDw5rJfG6vlIRAAEBS4bBjuVCbFC5dLdCiTQQ== 2020-11-16T20:54:38.271 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records in 2020-11-16T20:54:38.271 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records out 2020-11-16T20:54:38.271 INFO:teuthology.orchestra.run.smithi059.stderr:59 bytes copied, 3.3386e-05 s, 1.8 MB/s 2020-11-16T20:54:38.272 INFO:tasks.ceph:Adding keys to all mons... 2020-11-16T20:54:38.272 INFO:teuthology.orchestra.run.smithi059:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-16T20:54:38.313 INFO:teuthology.orchestra.run.smithi166:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-16T20:54:38.339 INFO:teuthology.orchestra.run.smithi166.stdout:[mgr.y] 2020-11-16T20:54:38.339 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQDw5rJfhGI6FxAAoQ0sDQGYJ28X12udMZj0Ig== 2020-11-16T20:54:38.340 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.0] 2020-11-16T20:54:38.340 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQDz5rJfDAGJCxAAQUzsmOl4lDt4AjEOEyCVMg== 2020-11-16T20:54:38.340 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.1] 2020-11-16T20:54:38.340 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQD25rJfDCF5CRAAoXRKxgjLzfarHLdg79rS2A== 2020-11-16T20:54:38.340 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.2] 2020-11-16T20:54:38.340 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQD55rJfRyVBBxAAmouMDyokQomTs17Om5axyw== 2020-11-16T20:54:38.341 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.3] 2020-11-16T20:54:38.341 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQD85rJfA9VeBRAAahAM/prhL5H6BJEYE+rx6g== 2020-11-16T20:54:38.341 INFO:teuthology.orchestra.run.smithi166.stdout:[mgr.x] 2020-11-16T20:54:38.341 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQDw5rJflB+2GxAAET2YX1AI6pYtfpR25qzhjg== 2020-11-16T20:54:38.341 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.4] 2020-11-16T20:54:38.341 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQAB57JflV4hLRAAgGeEmPQSLbguBy2B1vk0dg== 2020-11-16T20:54:38.341 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.5] 2020-11-16T20:54:38.342 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQAE57JfBM2BLBAAi8tpQd421q1Yji5iCV9jOA== 2020-11-16T20:54:38.342 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.6] 2020-11-16T20:54:38.342 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQAH57Jf0uu6KhAAP6HmhWURPqfekKKPhuldjQ== 2020-11-16T20:54:38.342 INFO:teuthology.orchestra.run.smithi166.stdout:[osd.7] 2020-11-16T20:54:38.342 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQAK57JfQV9vKRAANdjDe4ymGUIBvPt0+EhZZw== 2020-11-16T20:54:38.342 INFO:teuthology.orchestra.run.smithi166.stdout:[client.0] 2020-11-16T20:54:38.342 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQDw5rJf3w5GHhAAjNyTfHmpm7Hsr8VghZomqQ== 2020-11-16T20:54:38.343 INFO:teuthology.orchestra.run.smithi166.stdout:[client.1] 2020-11-16T20:54:38.343 INFO:teuthology.orchestra.run.smithi166.stdout: key = AQDw5rJfG6vlIRAAEBS4bBjuVCbFC5dLdCiTQQ== 2020-11-16T20:54:38.344 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.y] 2020-11-16T20:54:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDw5rJfhGI6FxAAoQ0sDQGYJ28X12udMZj0Ig== 2020-11-16T20:54:38.344 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.0] 2020-11-16T20:54:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDz5rJfDAGJCxAAQUzsmOl4lDt4AjEOEyCVMg== 2020-11-16T20:54:38.344 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.1] 2020-11-16T20:54:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQD25rJfDCF5CRAAoXRKxgjLzfarHLdg79rS2A== 2020-11-16T20:54:38.345 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.2] 2020-11-16T20:54:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQD55rJfRyVBBxAAmouMDyokQomTs17Om5axyw== 2020-11-16T20:54:38.345 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.3] 2020-11-16T20:54:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQD85rJfA9VeBRAAahAM/prhL5H6BJEYE+rx6g== 2020-11-16T20:54:38.345 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.x] 2020-11-16T20:54:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDw5rJflB+2GxAAET2YX1AI6pYtfpR25qzhjg== 2020-11-16T20:54:38.345 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.4] 2020-11-16T20:54:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQAB57JflV4hLRAAgGeEmPQSLbguBy2B1vk0dg== 2020-11-16T20:54:38.346 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.5] 2020-11-16T20:54:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQAE57JfBM2BLBAAi8tpQd421q1Yji5iCV9jOA== 2020-11-16T20:54:38.346 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.6] 2020-11-16T20:54:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQAH57Jf0uu6KhAAP6HmhWURPqfekKKPhuldjQ== 2020-11-16T20:54:38.346 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.7] 2020-11-16T20:54:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQAK57JfQV9vKRAANdjDe4ymGUIBvPt0+EhZZw== 2020-11-16T20:54:38.347 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2020-11-16T20:54:38.347 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDw5rJf3w5GHhAAjNyTfHmpm7Hsr8VghZomqQ== 2020-11-16T20:54:38.347 INFO:teuthology.orchestra.run.smithi059.stdout:[client.1] 2020-11-16T20:54:38.347 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDw5rJfG6vlIRAAEBS4bBjuVCbFC5dLdCiTQQ== 2020-11-16T20:54:38.347 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-16T20:54:38.386 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-16T20:54:38.437 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-16T20:54:38.439 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-16T20:54:38.489 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-16T20:54:38.492 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-16T20:54:38.542 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-16T20:54:38.543 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-16T20:54:38.593 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-16T20:54:38.595 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-16T20:54:38.645 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-16T20:54:38.647 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-16T20:54:38.697 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-16T20:54:38.699 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-16T20:54:38.749 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-16T20:54:38.751 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-16T20:54:38.801 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-16T20:54:38.803 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-16T20:54:38.854 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-16T20:54:38.856 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-16T20:54:38.906 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-16T20:54:38.908 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-16T20:54:38.961 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-16T20:54:38.963 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-16T20:54:39.016 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-11-16T20:54:39.016 INFO:teuthology.orchestra.run.smithi166:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-11-16T20:54:39.042 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-16T20:54:39.136 INFO:teuthology.orchestra.run.smithi166:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-11-16T20:54:39.163 INFO:teuthology.orchestra.run.smithi166:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-11-16T20:54:39.229 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-16T20:54:39.322 INFO:teuthology.orchestra.run.smithi166:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-11-16T20:54:39.349 INFO:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-11-16T20:54:39.380 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-16T20:54:39.478 INFO:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-11-16T20:54:39.508 INFO:teuthology.orchestra.run.smithi059:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-16T20:54:39.551 INFO:teuthology.orchestra.run.smithi166:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-16T20:54:39.564 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-11-16T20:54:39.565 INFO:tasks.ceph.mon.a:Restarting daemon 2020-11-16T20:54:39.565 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-11-16T20:54:39.606 INFO:tasks.ceph.mon.a:Started 2020-11-16T20:54:39.606 INFO:tasks.ceph.mon.c:Restarting daemon 2020-11-16T20:54:39.606 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-11-16T20:54:39.608 INFO:tasks.ceph.mon.c:Started 2020-11-16T20:54:39.608 INFO:tasks.ceph.mon.b:Restarting daemon 2020-11-16T20:54:39.609 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-11-16T20:54:39.610 INFO:tasks.ceph.mon.b:Started 2020-11-16T20:54:39.611 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-11-16T20:54:39.611 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-11-16T20:54:39.611 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-11-16T20:54:39.614 INFO:tasks.ceph.mgr.y:Started 2020-11-16T20:54:39.614 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-11-16T20:54:39.614 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-11-16T20:54:39.616 INFO:tasks.ceph.mgr.x:Started 2020-11-16T20:54:39.616 INFO:tasks.ceph:Setting crush tunables to default 2020-11-16T20:54:39.617 INFO:teuthology.orchestra.run.smithi166:> sudo ceph --cluster ceph osd crush tunables default 2020-11-16T20:54:45.060 INFO:teuthology.orchestra.run.smithi166.stderr:adjusted tunables profile to default 2020-11-16T20:54:45.070 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-11-16T20:54:45.071 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-16T20:54:45.071 INFO:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2020-11-16T20:54:45.084 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2020-11-16T20:54:45.097 INFO:teuthology.orchestra.run.smithi166.stdout:35950122-efbd-420e-b07a-f5730f26df17 2020-11-16T20:54:45.098 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-16T20:54:45.098 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-16T20:54:45.098 INFO:teuthology.orchestra.run.smithi166.stderr:37 bytes copied, 3.1189e-05 s, 1.2 MB/s 2020-11-16T20:54:45.099 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-16T20:54:45.099 INFO:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2020-11-16T20:54:45.152 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2020-11-16T20:54:45.165 INFO:teuthology.orchestra.run.smithi166.stdout:f768a1ff-3e8a-4131-a6ed-10f93b3ca900 2020-11-16T20:54:45.165 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-16T20:54:45.165 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-16T20:54:45.165 INFO:teuthology.orchestra.run.smithi166.stderr:37 bytes copied, 4.6606e-05 s, 794 kB/s 2020-11-16T20:54:45.166 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-16T20:54:45.166 INFO:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2020-11-16T20:54:45.218 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2020-11-16T20:54:45.231 INFO:teuthology.orchestra.run.smithi166.stdout:88734179-84a6-4a9b-8af0-692805815875 2020-11-16T20:54:45.232 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-16T20:54:45.232 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-16T20:54:45.232 INFO:teuthology.orchestra.run.smithi166.stderr:37 bytes copied, 4.6203e-05 s, 801 kB/s 2020-11-16T20:54:45.233 INFO:teuthology.orchestra.run.smithi166:> set -ex 2020-11-16T20:54:45.233 INFO:teuthology.orchestra.run.smithi166:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2020-11-16T20:54:45.286 INFO:teuthology.orchestra.run.smithi166.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2020-11-16T20:54:45.298 INFO:teuthology.orchestra.run.smithi166.stdout:319e54e8-3f03-4388-8de6-678d148e25d4 2020-11-16T20:54:45.298 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records in 2020-11-16T20:54:45.299 INFO:teuthology.orchestra.run.smithi166.stderr:0+1 records out 2020-11-16T20:54:45.299 INFO:teuthology.orchestra.run.smithi166.stderr:37 bytes copied, 3.0469e-05 s, 1.2 MB/s 2020-11-16T20:54:45.299 INFO:teuthology.orchestra.run.smithi059:> set -ex 2020-11-16T20:54:45.300 INFO:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2020-11-16T20:54:45.314 INFO:teuthology.orchestra.run.smithi059.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2020-11-16T20:54:45.331 INFO:teuthology.orchestra.run.smithi059.stdout:3edbb68e-e030-4379-891e-2412f1235ffb 2020-11-16T20:54:45.332 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records in 2020-11-16T20:54:45.332 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records out 2020-11-16T20:54:45.332 INFO:teuthology.orchestra.run.smithi059.stderr:37 bytes copied, 3.6187e-05 s, 1.0 MB/s 2020-11-16T20:54:45.333 INFO:teuthology.orchestra.run.smithi059:> set -ex 2020-11-16T20:54:45.333 INFO:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2020-11-16T20:54:45.386 INFO:teuthology.orchestra.run.smithi059.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2020-11-16T20:54:45.403 INFO:teuthology.orchestra.run.smithi059.stdout:44fbf5ac-4484-48a8-a846-1f5c01a6ec2c 2020-11-16T20:54:45.403 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records in 2020-11-16T20:54:45.404 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records out 2020-11-16T20:54:45.404 INFO:teuthology.orchestra.run.smithi059.stderr:37 bytes copied, 3.492e-05 s, 1.1 MB/s 2020-11-16T20:54:45.404 INFO:teuthology.orchestra.run.smithi059:> set -ex 2020-11-16T20:54:45.405 INFO:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2020-11-16T20:54:45.458 INFO:teuthology.orchestra.run.smithi059.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2020-11-16T20:54:45.475 INFO:teuthology.orchestra.run.smithi059.stdout:f93b82df-f537-4601-8247-388bf100b5b5 2020-11-16T20:54:45.475 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records in 2020-11-16T20:54:45.475 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records out 2020-11-16T20:54:45.475 INFO:teuthology.orchestra.run.smithi059.stderr:37 bytes copied, 4.3355e-05 s, 853 kB/s 2020-11-16T20:54:45.476 INFO:teuthology.orchestra.run.smithi059:> set -ex 2020-11-16T20:54:45.476 INFO:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2020-11-16T20:54:45.529 INFO:teuthology.orchestra.run.smithi059.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2020-11-16T20:54:45.546 INFO:teuthology.orchestra.run.smithi059.stdout:e5485c88-d267-4a6a-b9b6-15d869d28f28 2020-11-16T20:54:45.546 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records in 2020-11-16T20:54:45.546 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records out 2020-11-16T20:54:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:37 bytes copied, 3.6306e-05 s, 1.0 MB/s 2020-11-16T20:54:45.547 INFO:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 35950122-efbd-420e-b07a-f5730f26df17 0 2020-11-16T20:54:45.818 INFO:teuthology.orchestra.run.smithi059.stdout:0 2020-11-16T20:54:45.830 INFO:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new f768a1ff-3e8a-4131-a6ed-10f93b3ca900 1 2020-11-16T20:54:46.065 INFO:teuthology.orchestra.run.smithi059.stdout:1 2020-11-16T20:54:46.077 INFO:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 88734179-84a6-4a9b-8af0-692805815875 2 2020-11-16T20:54:46.311 INFO:teuthology.orchestra.run.smithi059.stdout:2 2020-11-16T20:54:46.323 INFO:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 319e54e8-3f03-4388-8de6-678d148e25d4 3 2020-11-16T20:54:46.606 INFO:teuthology.orchestra.run.smithi059.stdout:3 2020-11-16T20:54:46.618 INFO:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 3edbb68e-e030-4379-891e-2412f1235ffb 4 2020-11-16T20:54:46.869 INFO:teuthology.orchestra.run.smithi059.stdout:4 2020-11-16T20:54:46.880 INFO:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 44fbf5ac-4484-48a8-a846-1f5c01a6ec2c 5 2020-11-16T20:54:47.119 INFO:teuthology.orchestra.run.smithi059.stdout:5 2020-11-16T20:54:47.131 INFO:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new f93b82df-f537-4601-8247-388bf100b5b5 6 2020-11-16T20:54:47.367 INFO:teuthology.orchestra.run.smithi059.stdout:6 2020-11-16T20:54:47.379 INFO:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new e5485c88-d267-4a6a-b9b6-15d869d28f28 7 2020-11-16T20:54:47.613 INFO:teuthology.orchestra.run.smithi059.stdout:7 2020-11-16T20:54:47.625 INFO:tasks.ceph.osd.0:Restarting daemon 2020-11-16T20:54:47.625 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-11-16T20:54:47.628 INFO:tasks.ceph.osd.0:Started 2020-11-16T20:54:47.628 INFO:tasks.ceph.osd.1:Restarting daemon 2020-11-16T20:54:47.628 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-11-16T20:54:47.630 INFO:tasks.ceph.osd.1:Started 2020-11-16T20:54:47.630 INFO:tasks.ceph.osd.2:Restarting daemon 2020-11-16T20:54:47.630 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-11-16T20:54:47.632 INFO:tasks.ceph.osd.2:Started 2020-11-16T20:54:47.632 INFO:tasks.ceph.osd.3:Restarting daemon 2020-11-16T20:54:47.633 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-11-16T20:54:47.634 INFO:tasks.ceph.osd.3:Started 2020-11-16T20:54:47.635 INFO:tasks.ceph.osd.4:Restarting daemon 2020-11-16T20:54:47.635 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-11-16T20:54:47.637 INFO:tasks.ceph.osd.4:Started 2020-11-16T20:54:47.637 INFO:tasks.ceph.osd.5:Restarting daemon 2020-11-16T20:54:47.637 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-11-16T20:54:47.639 INFO:tasks.ceph.osd.5:Started 2020-11-16T20:54:47.639 INFO:tasks.ceph.osd.6:Restarting daemon 2020-11-16T20:54:47.640 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-11-16T20:54:47.641 INFO:tasks.ceph.osd.6:Started 2020-11-16T20:54:47.642 INFO:tasks.ceph.osd.7:Restarting daemon 2020-11-16T20:54:47.642 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-11-16T20:54:47.644 INFO:tasks.ceph.osd.7:Started 2020-11-16T20:54:47.644 INFO:tasks.ceph:Waiting for OSDs to come up 2020-11-16T20:54:48.230 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:54:48.233+0000 7ff3f0b28ec0 -1 Falling back to public interface 2020-11-16T20:54:48.231 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:54:48.233+0000 7f0125b6dec0 -1 Falling back to public interface 2020-11-16T20:54:48.231 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:54:48.233+0000 7f011fb7f700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2020-11-16T20:54:48.247 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:54:48.250+0000 7f37a9bd8ec0 -1 Falling back to public interface 2020-11-16T20:54:48.251 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:54:48.255+0000 7f86ad5ffec0 -1 Falling back to public interface 2020-11-16T20:54:48.253 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:54:48.256+0000 7f185f870ec0 -1 Falling back to public interface 2020-11-16T20:54:48.254 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:54:48.257+0000 7f1da20d3ec0 -1 Falling back to public interface 2020-11-16T20:54:48.272 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:54:48.275+0000 7fa1aa659ec0 -1 Falling back to public interface 2020-11-16T20:54:48.273 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:54:48.276+0000 7fa70e5daec0 -1 Falling back to public interface 2020-11-16T20:54:52.495 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:54:49.555+0000 7ff3f0b28ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-11-16T20:54:52.496 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:54:51.085+0000 7ff3e7333700 -1 osd.0 0 waiting for initial osdmap 2020-11-16T20:54:52.496 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:54:49.560+0000 7f0125b6dec0 -1 osd.2 0 log_to_monitors {default=true} 2020-11-16T20:54:52.496 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:54:51.086+0000 7f011c378700 -1 osd.2 0 waiting for initial osdmap 2020-11-16T20:54:52.496 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:54:49.589+0000 7f1da20d3ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-11-16T20:54:52.496 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:54:51.085+0000 7f1d988de700 -1 osd.3 0 waiting for initial osdmap 2020-11-16T20:54:52.497 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:54:49.589+0000 7f86ad5ffec0 -1 osd.1 0 log_to_monitors {default=true} 2020-11-16T20:54:52.497 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:54:51.087+0000 7f86a3e0a700 -1 osd.1 0 waiting for initial osdmap 2020-11-16T20:54:52.497 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:54:49.571+0000 7f37a9bd8ec0 -1 osd.6 0 log_to_monitors {default=true} 2020-11-16T20:54:52.497 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:54:51.087+0000 7f37a03e3700 -1 osd.6 0 waiting for initial osdmap 2020-11-16T20:54:52.497 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:54:49.592+0000 7f185f870ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-11-16T20:54:52.497 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:54:51.087+0000 7f185787e700 -1 osd.4 0 waiting for initial osdmap 2020-11-16T20:54:52.498 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:54:49.605+0000 7fa70e5daec0 -1 osd.7 0 log_to_monitors {default=true} 2020-11-16T20:54:52.498 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:54:51.091+0000 7fa704de5700 -1 osd.7 0 waiting for initial osdmap 2020-11-16T20:54:52.498 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:54:49.616+0000 7fa1aa659ec0 -1 osd.5 0 log_to_monitors {default=true} 2020-11-16T20:54:52.498 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:54:51.087+0000 7fa1a2667700 -1 osd.5 0 waiting for initial osdmap 2020-11-16T20:54:52.596 INFO:teuthology.orchestra.run.smithi166:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-11-16T20:54:52.889 INFO:teuthology.misc.health.smithi166.stdout: 2020-11-16T20:54:52.889 INFO:teuthology.misc.health.smithi166.stdout:{"epoch":13,"fsid":"a14fd848-4cfe-4cd9-9140-5b3c4b4e904d","created":"2020-11-16T20:54:44.938121+0000","modified":"2020-11-16T20:54:52.080163+0000","last_up_change":"2020-11-16T20:54:52.080163+0000","last_in_change":"2020-11-16T20:54:52.080163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-16T20:54:49.109999+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"35950122-efbd-420e-b07a-f5730f26df17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6800","nonce":35293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6802","nonce":35293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6806","nonce":35293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6804","nonce":35293}]},"public_addr":"172.21.15.166:6800/35293","cluster_addr":"172.21.15.166:6802/35293","heartbeat_back_addr":"172.21.15.166:6806/35293","heartbeat_front_addr":"172.21.15.166:6804/35293","state":["exists","up"]},{"osd":1,"uuid":"f768a1ff-3e8a-4131-a6ed-10f93b3ca900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6808","nonce":35323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6809","nonce":35323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6811","nonce":35323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6810","nonce":35323}]},"public_addr":"172.21.15.166:6808/35323","cluster_addr":"172.21.15.166:6809/35323","heartbeat_back_addr":"172.21.15.166:6811/35323","heartbeat_front_addr":"172.21.15.166:6810/35323","state":["exists","up"]},{"osd":2,"uuid":"88734179-84a6-4a9b-8af0-692805815875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6801","nonce":35294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6803","nonce":35294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6807","nonce":35294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6805","nonce":35294}]},"public_addr":"172.21.15.166:6801/35294","cluster_addr":"172.21.15.166:6803/35294","heartbeat_back_addr":"172.21.15.166:6807/35294","heartbeat_front_addr":"172.21.15.166:6805/35294","state":["exists","up"]},{"osd":3,"uuid":"319e54e8-3f03-4388-8de6-678d148e25d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6812","nonce":35324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6813","nonce":35324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6815","nonce":35324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6814","nonce":35324}]},"public_addr":"172.21.15.166:6812/35324","cluster_addr":"172.21.15.166:6813/35324","heartbeat_back_addr":"172.21.15.166:6815/35324","heartbeat_front_addr":"172.21.15.166:6814/35324","state":["exists","up"]},{"osd":4,"uuid":"3edbb68e-e030-4379-891e-2412f1235ffb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":31586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":31586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6807","nonce":31586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":31586}]},"public_addr":"172.21.15.59:6804/31586","cluster_addr":"172.21.15.59:6805/31586","heartbeat_back_addr":"172.21.15.59:6807/31586","heartbeat_front_addr":"172.21.15.59:6806/31586","state":["exists","up"]},{"osd":5,"uuid":"44fbf5ac-4484-48a8-a846-1f5c01a6ec2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":31610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":31610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":31610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":31610}]},"public_addr":"172.21.15.59:6808/31610","cluster_addr":"172.21.15.59:6810/31610","heartbeat_back_addr":"172.21.15.59:6813/31610","heartbeat_front_addr":"172.21.15.59:6812/31610","state":["exists","up"]},{"osd":6,"uuid":"f93b82df-f537-4601-8247-388bf100b5b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":31587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6801","nonce":31587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6803","nonce":31587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":31587}]},"public_addr":"172.21.15.59:6800/31587","cluster_addr":"172.21.15.59:6801/31587","heartbeat_back_addr":"172.21.15.59:6803/31587","heartbeat_front_addr":"172.21.15.59:6802/31587","state":["exists","up"]},{"osd":7,"uuid":"e5485c88-d267-4a6a-b9b6-15d869d28f28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":31617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":31617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":31617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":31617}]},"public_addr":"172.21.15.59:6809/31617","cluster_addr":"172.21.15.59:6811/31617","heartbeat_back_addr":"172.21.15.59:6815/31617","heartbeat_front_addr":"172.21.15.59:6814/31617","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-16T20:54:52.900 DEBUG:teuthology.misc:8 of 8 OSDs are up 2020-11-16T20:54:52.901 INFO:tasks.ceph:Creating RBD pool 2020-11-16T20:54:52.901 INFO:teuthology.orchestra.run.smithi166:> sudo ceph --cluster ceph osd pool create rbd 8 2020-11-16T20:54:54.109 INFO:teuthology.orchestra.run.smithi166.stderr:pool 'rbd' created 2020-11-16T20:54:54.121 INFO:teuthology.orchestra.run.smithi166:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-11-16T20:54:55.111 INFO:teuthology.orchestra.run.smithi166.stderr:enabled application 'rbd' on pool 'rbd' 2020-11-16T20:54:55.123 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-11-16T20:54:55.124 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-16T20:54:55.125 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-11-16T20:54:55.421 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:55.421 INFO:teuthology.orchestra.run.smithi166.stdout:{"epoch":16,"fsid":"a14fd848-4cfe-4cd9-9140-5b3c4b4e904d","created":"2020-11-16T20:54:44.938121+0000","modified":"2020-11-16T20:54:55.104675+0000","last_up_change":"2020-11-16T20:54:52.080163+0000","last_in_change":"2020-11-16T20:54:52.080163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-16T20:54:49.109999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-16T20:54:53.253680+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"35950122-efbd-420e-b07a-f5730f26df17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6800","nonce":35293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6802","nonce":35293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6806","nonce":35293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6804","nonce":35293}]},"public_addr":"172.21.15.166:6800/35293","cluster_addr":"172.21.15.166:6802/35293","heartbeat_back_addr":"172.21.15.166:6806/35293","heartbeat_front_addr":"172.21.15.166:6804/35293","state":["exists","up"]},{"osd":1,"uuid":"f768a1ff-3e8a-4131-a6ed-10f93b3ca900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6808","nonce":35323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6809","nonce":35323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6811","nonce":35323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6810","nonce":35323}]},"public_addr":"172.21.15.166:6808/35323","cluster_addr":"172.21.15.166:6809/35323","heartbeat_back_addr":"172.21.15.166:6811/35323","heartbeat_front_addr":"172.21.15.166:6810/35323","state":["exists","up"]},{"osd":2,"uuid":"88734179-84a6-4a9b-8af0-692805815875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6801","nonce":35294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6803","nonce":35294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6807","nonce":35294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6805","nonce":35294}]},"public_addr":"172.21.15.166:6801/35294","cluster_addr":"172.21.15.166:6803/35294","heartbeat_back_addr":"172.21.15.166:6807/35294","heartbeat_front_addr":"172.21.15.166:6805/35294","state":["exists","up"]},{"osd":3,"uuid":"319e54e8-3f03-4388-8de6-678d148e25d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6812","nonce":35324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6813","nonce":35324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6815","nonce":35324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6814","nonce":35324}]},"public_addr":"172.21.15.166:6812/35324","cluster_addr":"172.21.15.166:6813/35324","heartbeat_back_addr":"172.21.15.166:6815/35324","heartbeat_front_addr":"172.21.15.166:6814/35324","state":["exists","up"]},{"osd":4,"uuid":"3edbb68e-e030-4379-891e-2412f1235ffb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":31586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":31586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6807","nonce":31586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":31586}]},"public_addr":"172.21.15.59:6804/31586","cluster_addr":"172.21.15.59:6805/31586","heartbeat_back_addr":"172.21.15.59:6807/31586","heartbeat_front_addr":"172.21.15.59:6806/31586","state":["exists","up"]},{"osd":5,"uuid":"44fbf5ac-4484-48a8-a846-1f5c01a6ec2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":31610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":31610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":31610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":31610}]},"public_addr":"172.21.15.59:6808/31610","cluster_addr":"172.21.15.59:6810/31610","heartbeat_back_addr":"172.21.15.59:6813/31610","heartbeat_front_addr":"172.21.15.59:6812/31610","state":["exists","up"]},{"osd":6,"uuid":"f93b82df-f537-4601-8247-388bf100b5b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":31587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6801","nonce":31587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6803","nonce":31587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":31587}]},"public_addr":"172.21.15.59:6800/31587","cluster_addr":"172.21.15.59:6801/31587","heartbeat_back_addr":"172.21.15.59:6803/31587","heartbeat_front_addr":"172.21.15.59:6802/31587","state":["exists","up"]},{"osd":7,"uuid":"e5485c88-d267-4a6a-b9b6-15d869d28f28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":31617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":31617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":31617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":31617}]},"public_addr":"172.21.15.59:6809/31617","cluster_addr":"172.21.15.59:6811/31617","heartbeat_back_addr":"172.21.15.59:6815/31617","heartbeat_front_addr":"172.21.15.59:6814/31617","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T20:54:50.575155+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T20:54:50.545883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T20:54:50.515736+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T20:54:50.606343+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T20:54:50.636697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T20:54:50.608316+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T20:54:50.537074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T20:54:50.579714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-16T20:54:55.433 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-16T20:54:49.109999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-16T20:54:53.253680+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-11-16T20:54:55.433 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-16T20:54:55.728 INFO:teuthology.orchestra.run.smithi166.stdout:pg_num: 1 2020-11-16T20:54:55.741 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-16T20:54:56.034 INFO:teuthology.orchestra.run.smithi166.stdout:pg_num: 8 2020-11-16T20:54:56.046 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-11-16T20:54:56.046 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-11-16T20:54:56.047 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2020-11-16T20:54:56.383 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:54:56.394 INFO:teuthology.orchestra.run.smithi166.stdout:{"epoch":5,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":31040}]},"active_addr":"172.21.15.59:6816/31040","active_change":"2020-11-16T20:54:49.065737+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[{"gid":4109,"name":"y","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":2773183201}]},{"addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":1179787522}]},{"addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":963367495}]}]}} 2020-11-16T20:55:00.661 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-11-16T20:55:00.661 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-11-16T20:55:00.662 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-16T20:55:00.966 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:55:00.966 INFO:teuthology.orchestra.run.smithi166.stdout:{"epoch":17,"fsid":"a14fd848-4cfe-4cd9-9140-5b3c4b4e904d","created":"2020-11-16T20:54:44.938121+0000","modified":"2020-11-16T20:54:56.107868+0000","last_up_change":"2020-11-16T20:54:52.080163+0000","last_in_change":"2020-11-16T20:54:52.080163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-16T20:54:49.109999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-16T20:54:53.253680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"35950122-efbd-420e-b07a-f5730f26df17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6800","nonce":35293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6802","nonce":35293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6806","nonce":35293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6804","nonce":35293}]},"public_addr":"172.21.15.166:6800/35293","cluster_addr":"172.21.15.166:6802/35293","heartbeat_back_addr":"172.21.15.166:6806/35293","heartbeat_front_addr":"172.21.15.166:6804/35293","state":["exists","up"]},{"osd":1,"uuid":"f768a1ff-3e8a-4131-a6ed-10f93b3ca900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6808","nonce":35323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6809","nonce":35323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6811","nonce":35323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6810","nonce":35323}]},"public_addr":"172.21.15.166:6808/35323","cluster_addr":"172.21.15.166:6809/35323","heartbeat_back_addr":"172.21.15.166:6811/35323","heartbeat_front_addr":"172.21.15.166:6810/35323","state":["exists","up"]},{"osd":2,"uuid":"88734179-84a6-4a9b-8af0-692805815875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6801","nonce":35294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6803","nonce":35294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6807","nonce":35294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6805","nonce":35294}]},"public_addr":"172.21.15.166:6801/35294","cluster_addr":"172.21.15.166:6803/35294","heartbeat_back_addr":"172.21.15.166:6807/35294","heartbeat_front_addr":"172.21.15.166:6805/35294","state":["exists","up"]},{"osd":3,"uuid":"319e54e8-3f03-4388-8de6-678d148e25d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6812","nonce":35324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6813","nonce":35324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6815","nonce":35324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6814","nonce":35324}]},"public_addr":"172.21.15.166:6812/35324","cluster_addr":"172.21.15.166:6813/35324","heartbeat_back_addr":"172.21.15.166:6815/35324","heartbeat_front_addr":"172.21.15.166:6814/35324","state":["exists","up"]},{"osd":4,"uuid":"3edbb68e-e030-4379-891e-2412f1235ffb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":31586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":31586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6807","nonce":31586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":31586}]},"public_addr":"172.21.15.59:6804/31586","cluster_addr":"172.21.15.59:6805/31586","heartbeat_back_addr":"172.21.15.59:6807/31586","heartbeat_front_addr":"172.21.15.59:6806/31586","state":["exists","up"]},{"osd":5,"uuid":"44fbf5ac-4484-48a8-a846-1f5c01a6ec2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":31610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":31610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":31610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":31610}]},"public_addr":"172.21.15.59:6808/31610","cluster_addr":"172.21.15.59:6810/31610","heartbeat_back_addr":"172.21.15.59:6813/31610","heartbeat_front_addr":"172.21.15.59:6812/31610","state":["exists","up"]},{"osd":6,"uuid":"f93b82df-f537-4601-8247-388bf100b5b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":31587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6801","nonce":31587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6803","nonce":31587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":31587}]},"public_addr":"172.21.15.59:6800/31587","cluster_addr":"172.21.15.59:6801/31587","heartbeat_back_addr":"172.21.15.59:6803/31587","heartbeat_front_addr":"172.21.15.59:6802/31587","state":["exists","up"]},{"osd":7,"uuid":"e5485c88-d267-4a6a-b9b6-15d869d28f28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":31617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":31617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":31617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":31617}]},"public_addr":"172.21.15.59:6809/31617","cluster_addr":"172.21.15.59:6811/31617","heartbeat_back_addr":"172.21.15.59:6815/31617","heartbeat_front_addr":"172.21.15.59:6814/31617","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T20:54:50.575155+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T20:54:50.545883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T20:54:50.515736+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T20:54:50.606343+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T20:54:50.636697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T20:54:50.608316+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T20:54:50.537074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T20:54:50.579714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-16T20:55:05.207 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-11-16T20:55:05.208 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-16T20:55:05.510 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:55:05.511 INFO:teuthology.orchestra.run.smithi166.stdout:{"epoch":17,"fsid":"a14fd848-4cfe-4cd9-9140-5b3c4b4e904d","created":"2020-11-16T20:54:44.938121+0000","modified":"2020-11-16T20:54:56.107868+0000","last_up_change":"2020-11-16T20:54:52.080163+0000","last_in_change":"2020-11-16T20:54:52.080163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-16T20:54:49.109999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-16T20:54:53.253680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"35950122-efbd-420e-b07a-f5730f26df17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6800","nonce":35293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6802","nonce":35293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6806","nonce":35293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6804","nonce":35293}]},"public_addr":"172.21.15.166:6800/35293","cluster_addr":"172.21.15.166:6802/35293","heartbeat_back_addr":"172.21.15.166:6806/35293","heartbeat_front_addr":"172.21.15.166:6804/35293","state":["exists","up"]},{"osd":1,"uuid":"f768a1ff-3e8a-4131-a6ed-10f93b3ca900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6808","nonce":35323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6809","nonce":35323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6811","nonce":35323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6810","nonce":35323}]},"public_addr":"172.21.15.166:6808/35323","cluster_addr":"172.21.15.166:6809/35323","heartbeat_back_addr":"172.21.15.166:6811/35323","heartbeat_front_addr":"172.21.15.166:6810/35323","state":["exists","up"]},{"osd":2,"uuid":"88734179-84a6-4a9b-8af0-692805815875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6801","nonce":35294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6803","nonce":35294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6807","nonce":35294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6805","nonce":35294}]},"public_addr":"172.21.15.166:6801/35294","cluster_addr":"172.21.15.166:6803/35294","heartbeat_back_addr":"172.21.15.166:6807/35294","heartbeat_front_addr":"172.21.15.166:6805/35294","state":["exists","up"]},{"osd":3,"uuid":"319e54e8-3f03-4388-8de6-678d148e25d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6812","nonce":35324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6813","nonce":35324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6815","nonce":35324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.166:6814","nonce":35324}]},"public_addr":"172.21.15.166:6812/35324","cluster_addr":"172.21.15.166:6813/35324","heartbeat_back_addr":"172.21.15.166:6815/35324","heartbeat_front_addr":"172.21.15.166:6814/35324","state":["exists","up"]},{"osd":4,"uuid":"3edbb68e-e030-4379-891e-2412f1235ffb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":31586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":31586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6807","nonce":31586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":31586}]},"public_addr":"172.21.15.59:6804/31586","cluster_addr":"172.21.15.59:6805/31586","heartbeat_back_addr":"172.21.15.59:6807/31586","heartbeat_front_addr":"172.21.15.59:6806/31586","state":["exists","up"]},{"osd":5,"uuid":"44fbf5ac-4484-48a8-a846-1f5c01a6ec2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":31610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":31610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":31610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":31610}]},"public_addr":"172.21.15.59:6808/31610","cluster_addr":"172.21.15.59:6810/31610","heartbeat_back_addr":"172.21.15.59:6813/31610","heartbeat_front_addr":"172.21.15.59:6812/31610","state":["exists","up"]},{"osd":6,"uuid":"f93b82df-f537-4601-8247-388bf100b5b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":31587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6801","nonce":31587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6803","nonce":31587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":31587}]},"public_addr":"172.21.15.59:6800/31587","cluster_addr":"172.21.15.59:6801/31587","heartbeat_back_addr":"172.21.15.59:6803/31587","heartbeat_front_addr":"172.21.15.59:6802/31587","state":["exists","up"]},{"osd":7,"uuid":"e5485c88-d267-4a6a-b9b6-15d869d28f28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":31617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":31617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":31617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":31617}]},"public_addr":"172.21.15.59:6809/31617","cluster_addr":"172.21.15.59:6811/31617","heartbeat_back_addr":"172.21.15.59:6815/31617","heartbeat_front_addr":"172.21.15.59:6814/31617","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T20:54:50.575155+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T20:54:50.545883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T20:54:50.515736+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T20:54:50.606343+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T20:54:50.636697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T20:54:50.608316+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T20:54:50.537074+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T20:54:50.579714+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-16T20:55:05.523 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2020-11-16T20:55:05.673 INFO:teuthology.orchestra.run.smithi166.stdout:55834574852 2020-11-16T20:55:05.674 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2020-11-16T20:55:05.827 INFO:teuthology.orchestra.run.smithi166.stdout:55834574852 2020-11-16T20:55:05.828 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2020-11-16T20:55:05.981 INFO:teuthology.orchestra.run.smithi166.stdout:55834574852 2020-11-16T20:55:05.982 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2020-11-16T20:55:06.134 INFO:teuthology.orchestra.run.smithi166.stdout:55834574853 2020-11-16T20:55:06.135 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2020-11-16T20:55:06.287 INFO:teuthology.orchestra.run.smithi166.stdout:55834574852 2020-11-16T20:55:06.288 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2020-11-16T20:55:06.440 INFO:teuthology.orchestra.run.smithi166.stdout:55834574853 2020-11-16T20:55:06.440 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2020-11-16T20:55:06.593 INFO:teuthology.orchestra.run.smithi166.stdout:55834574852 2020-11-16T20:55:06.593 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2020-11-16T20:55:06.746 INFO:teuthology.orchestra.run.smithi166.stdout:55834574852 2020-11-16T20:55:06.746 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-11-16T20:55:07.038 INFO:teuthology.orchestra.run.smithi166.stdout:55834574851 2020-11-16T20:55:07.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2020-11-16T20:55:08.051 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-11-16T20:55:08.353 INFO:teuthology.orchestra.run.smithi166.stdout:55834574852 2020-11-16T20:55:08.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2020-11-16T20:55:08.366 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2020-11-16T20:55:08.656 INFO:teuthology.orchestra.run.smithi166.stdout:55834574852 2020-11-16T20:55:08.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.1 2020-11-16T20:55:08.668 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2020-11-16T20:55:08.960 INFO:teuthology.orchestra.run.smithi166.stdout:55834574852 2020-11-16T20:55:08.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2020-11-16T20:55:08.972 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2020-11-16T20:55:09.263 INFO:teuthology.orchestra.run.smithi166.stdout:55834574853 2020-11-16T20:55:09.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2020-11-16T20:55:09.276 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2020-11-16T20:55:09.566 INFO:teuthology.orchestra.run.smithi166.stdout:55834574852 2020-11-16T20:55:09.579 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.4 2020-11-16T20:55:09.579 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2020-11-16T20:55:09.872 INFO:teuthology.orchestra.run.smithi166.stdout:55834574854 2020-11-16T20:55:09.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.5 2020-11-16T20:55:09.885 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2020-11-16T20:55:10.176 INFO:teuthology.orchestra.run.smithi166.stdout:55834574853 2020-11-16T20:55:10.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.6 2020-11-16T20:55:10.188 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2020-11-16T20:55:10.478 INFO:teuthology.orchestra.run.smithi166.stdout:55834574853 2020-11-16T20:55:10.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.7 2020-11-16T20:55:10.490 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-11-16T20:55:10.491 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-16T20:55:10.778 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:55:10.780 INFO:teuthology.orchestra.run.smithi166.stderr:dumped all 2020-11-16T20:55:10.790 INFO:teuthology.orchestra.run.smithi166.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2020-11-16T20:55:09.073994+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":39552,"kb_used_data":1152,"kb_used_omap":0,"kb_used_meta":38336,"kb_avail":754935168,"statfs":{"total":773094113280,"available":773053612032,"internally_reserved":0,"allocated":1179648,"data_stored":382000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39256064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002431"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"10","reported_epoch":"16","state":"active+clean","last_fresh":"2020-11-16T20:54:55.120692+0000","last_change":"2020-11-16T20:54:55.119464+0000","last_active":"2020-11-16T20:54:55.120692+0000","last_peered":"2020-11-16T20:54:55.120692+0000","last_clean":"2020-11-16T20:54:55.120692+0000","last_became_active":"2020-11-16T20:54:55.118917+0000","last_became_peered":"2020-11-16T20:54:55.118917+0000","last_unstale":"2020-11-16T20:54:55.120692+0000","last_undegraded":"2020-11-16T20:54:55.120692+0000","last_fullsized":"2020-11-16T20:54:55.120692+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"10","reported_epoch":"16","state":"active+clean","last_fresh":"2020-11-16T20:54:55.579731+0000","last_change":"2020-11-16T20:54:55.579264+0000","last_active":"2020-11-16T20:54:55.579731+0000","last_peered":"2020-11-16T20:54:55.579731+0000","last_clean":"2020-11-16T20:54:55.579731+0000","last_became_active":"2020-11-16T20:54:55.578907+0000","last_became_peered":"2020-11-16T20:54:55.578907+0000","last_unstale":"2020-11-16T20:54:55.579731+0000","last_undegraded":"2020-11-16T20:54:55.579731+0000","last_fullsized":"2020-11-16T20:54:55.579731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"10","reported_epoch":"16","state":"active+clean","last_fresh":"2020-11-16T20:54:55.580034+0000","last_change":"2020-11-16T20:54:55.579361+0000","last_active":"2020-11-16T20:54:55.580034+0000","last_peered":"2020-11-16T20:54:55.580034+0000","last_clean":"2020-11-16T20:54:55.580034+0000","last_became_active":"2020-11-16T20:54:55.578864+0000","last_became_peered":"2020-11-16T20:54:55.578864+0000","last_unstale":"2020-11-16T20:54:55.580034+0000","last_undegraded":"2020-11-16T20:54:55.580034+0000","last_fullsized":"2020-11-16T20:54:55.580034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"10","reported_epoch":"16","state":"active+clean","last_fresh":"2020-11-16T20:54:55.363062+0000","last_change":"2020-11-16T20:54:55.362453+0000","last_active":"2020-11-16T20:54:55.363062+0000","last_peered":"2020-11-16T20:54:55.363062+0000","last_clean":"2020-11-16T20:54:55.363062+0000","last_became_active":"2020-11-16T20:54:55.362030+0000","last_became_peered":"2020-11-16T20:54:55.362030+0000","last_unstale":"2020-11-16T20:54:55.363062+0000","last_undegraded":"2020-11-16T20:54:55.363062+0000","last_fullsized":"2020-11-16T20:54:55.363062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2020-11-16T20:54:55.112612+0000","last_change":"2020-11-16T20:54:53.112612+0000","last_active":"2020-11-16T20:54:55.112612+0000","last_peered":"2020-11-16T20:54:55.112612+0000","last_clean":"2020-11-16T20:54:55.112612+0000","last_became_active":"2020-11-16T20:54:53.112038+0000","last_became_peered":"2020-11-16T20:54:53.112038+0000","last_unstale":"2020-11-16T20:54:55.112612+0000","last_undegraded":"2020-11-16T20:54:55.112612+0000","last_fullsized":"2020-11-16T20:54:55.112612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:50.068882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:50.068882+0000","last_clean_scrub_stamp":"2020-11-16T20:54:50.068882+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"10","reported_epoch":"16","state":"active+clean","last_fresh":"2020-11-16T20:54:55.121243+0000","last_change":"2020-11-16T20:54:55.120010+0000","last_active":"2020-11-16T20:54:55.121243+0000","last_peered":"2020-11-16T20:54:55.121243+0000","last_clean":"2020-11-16T20:54:55.121243+0000","last_became_active":"2020-11-16T20:54:55.118978+0000","last_became_peered":"2020-11-16T20:54:55.118978+0000","last_unstale":"2020-11-16T20:54:55.121243+0000","last_undegraded":"2020-11-16T20:54:55.121243+0000","last_fullsized":"2020-11-16T20:54:55.121243+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"10","reported_epoch":"16","state":"active+clean","last_fresh":"2020-11-16T20:54:55.363521+0000","last_change":"2020-11-16T20:54:55.362510+0000","last_active":"2020-11-16T20:54:55.363521+0000","last_peered":"2020-11-16T20:54:55.363521+0000","last_clean":"2020-11-16T20:54:55.363521+0000","last_became_active":"2020-11-16T20:54:55.362052+0000","last_became_peered":"2020-11-16T20:54:55.362052+0000","last_unstale":"2020-11-16T20:54:55.363521+0000","last_undegraded":"2020-11-16T20:54:55.363521+0000","last_fullsized":"2020-11-16T20:54:55.363521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"10","reported_epoch":"16","state":"active+clean","last_fresh":"2020-11-16T20:54:55.121289+0000","last_change":"2020-11-16T20:54:55.120346+0000","last_active":"2020-11-16T20:54:55.121289+0000","last_peered":"2020-11-16T20:54:55.121289+0000","last_clean":"2020-11-16T20:54:55.121289+0000","last_became_active":"2020-11-16T20:54:55.119771+0000","last_became_peered":"2020-11-16T20:54:55.119771+0000","last_unstale":"2020-11-16T20:54:55.121289+0000","last_undegraded":"2020-11-16T20:54:55.121289+0000","last_fullsized":"2020-11-16T20:54:55.121289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"10","reported_epoch":"16","state":"active+clean","last_fresh":"2020-11-16T20:54:55.364248+0000","last_change":"2020-11-16T20:54:55.362484+0000","last_active":"2020-11-16T20:54:55.364248+0000","last_peered":"2020-11-16T20:54:55.364248+0000","last_clean":"2020-11-16T20:54:55.364248+0000","last_became_active":"2020-11-16T20:54:55.362005+0000","last_became_peered":"2020-11-16T20:54:55.362005+0000","last_unstale":"2020-11-16T20:54:55.364248+0000","last_undegraded":"2020-11-16T20:54:55.364248+0000","last_fullsized":"2020-11-16T20:54:55.364248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4952,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366888,"statfs":{"total":96636764160,"available":96631693312,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4952,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366888,"statfs":{"total":96636764160,"available":96631693312,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5229999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4952,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366888,"statfs":{"total":96636764160,"available":96631693312,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4952,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366888,"statfs":{"total":96636764160,"available":96631693312,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4952,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366888,"statfs":{"total":96636764160,"available":96631693312,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4888,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366952,"statfs":{"total":96636764160,"available":96631758848,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4952,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366888,"statfs":{"total":96636764160,"available":96631693312,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4952,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366888,"statfs":{"total":96636764160,"available":96631693312,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4930000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]}]}]}} 2020-11-16T20:55:10.792 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-16T20:55:11.079 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:55:11.080 INFO:teuthology.orchestra.run.smithi166.stderr:dumped all 2020-11-16T20:55:11.091 INFO:teuthology.orchestra.run.smithi166.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2020-11-16T20:55:11.074546+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":39552,"kb_used_data":1152,"kb_used_omap":0,"kb_used_meta":38336,"kb_avail":754935168,"statfs":{"total":773094113280,"available":773053612032,"internally_reserved":0,"allocated":1179648,"data_stored":382000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39256064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002984"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"10","reported_epoch":"16","state":"active+clean","last_fresh":"2020-11-16T20:54:55.120692+0000","last_change":"2020-11-16T20:54:55.119464+0000","last_active":"2020-11-16T20:54:55.120692+0000","last_peered":"2020-11-16T20:54:55.120692+0000","last_clean":"2020-11-16T20:54:55.120692+0000","last_became_active":"2020-11-16T20:54:55.118917+0000","last_became_peered":"2020-11-16T20:54:55.118917+0000","last_unstale":"2020-11-16T20:54:55.120692+0000","last_undegraded":"2020-11-16T20:54:55.120692+0000","last_fullsized":"2020-11-16T20:54:55.120692+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"10","reported_epoch":"16","state":"active+clean","last_fresh":"2020-11-16T20:54:55.579731+0000","last_change":"2020-11-16T20:54:55.579264+0000","last_active":"2020-11-16T20:54:55.579731+0000","last_peered":"2020-11-16T20:54:55.579731+0000","last_clean":"2020-11-16T20:54:55.579731+0000","last_became_active":"2020-11-16T20:54:55.578907+0000","last_became_peered":"2020-11-16T20:54:55.578907+0000","last_unstale":"2020-11-16T20:54:55.579731+0000","last_undegraded":"2020-11-16T20:54:55.579731+0000","last_fullsized":"2020-11-16T20:54:55.579731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"10","reported_epoch":"16","state":"active+clean","last_fresh":"2020-11-16T20:54:55.580034+0000","last_change":"2020-11-16T20:54:55.579361+0000","last_active":"2020-11-16T20:54:55.580034+0000","last_peered":"2020-11-16T20:54:55.580034+0000","last_clean":"2020-11-16T20:54:55.580034+0000","last_became_active":"2020-11-16T20:54:55.578864+0000","last_became_peered":"2020-11-16T20:54:55.578864+0000","last_unstale":"2020-11-16T20:54:55.580034+0000","last_undegraded":"2020-11-16T20:54:55.580034+0000","last_fullsized":"2020-11-16T20:54:55.580034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"10","reported_epoch":"16","state":"active+clean","last_fresh":"2020-11-16T20:54:55.363062+0000","last_change":"2020-11-16T20:54:55.362453+0000","last_active":"2020-11-16T20:54:55.363062+0000","last_peered":"2020-11-16T20:54:55.363062+0000","last_clean":"2020-11-16T20:54:55.363062+0000","last_became_active":"2020-11-16T20:54:55.362030+0000","last_became_peered":"2020-11-16T20:54:55.362030+0000","last_unstale":"2020-11-16T20:54:55.363062+0000","last_undegraded":"2020-11-16T20:54:55.363062+0000","last_fullsized":"2020-11-16T20:54:55.363062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2020-11-16T20:54:55.112612+0000","last_change":"2020-11-16T20:54:53.112612+0000","last_active":"2020-11-16T20:54:55.112612+0000","last_peered":"2020-11-16T20:54:55.112612+0000","last_clean":"2020-11-16T20:54:55.112612+0000","last_became_active":"2020-11-16T20:54:53.112038+0000","last_became_peered":"2020-11-16T20:54:53.112038+0000","last_unstale":"2020-11-16T20:54:55.112612+0000","last_undegraded":"2020-11-16T20:54:55.112612+0000","last_fullsized":"2020-11-16T20:54:55.112612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:50.068882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:50.068882+0000","last_clean_scrub_stamp":"2020-11-16T20:54:50.068882+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"10","reported_epoch":"16","state":"active+clean","last_fresh":"2020-11-16T20:54:55.121243+0000","last_change":"2020-11-16T20:54:55.120010+0000","last_active":"2020-11-16T20:54:55.121243+0000","last_peered":"2020-11-16T20:54:55.121243+0000","last_clean":"2020-11-16T20:54:55.121243+0000","last_became_active":"2020-11-16T20:54:55.118978+0000","last_became_peered":"2020-11-16T20:54:55.118978+0000","last_unstale":"2020-11-16T20:54:55.121243+0000","last_undegraded":"2020-11-16T20:54:55.121243+0000","last_fullsized":"2020-11-16T20:54:55.121243+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"10","reported_epoch":"16","state":"active+clean","last_fresh":"2020-11-16T20:54:55.363521+0000","last_change":"2020-11-16T20:54:55.362510+0000","last_active":"2020-11-16T20:54:55.363521+0000","last_peered":"2020-11-16T20:54:55.363521+0000","last_clean":"2020-11-16T20:54:55.363521+0000","last_became_active":"2020-11-16T20:54:55.362052+0000","last_became_peered":"2020-11-16T20:54:55.362052+0000","last_unstale":"2020-11-16T20:54:55.363521+0000","last_undegraded":"2020-11-16T20:54:55.363521+0000","last_fullsized":"2020-11-16T20:54:55.363521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"10","reported_epoch":"16","state":"active+clean","last_fresh":"2020-11-16T20:54:55.121289+0000","last_change":"2020-11-16T20:54:55.120346+0000","last_active":"2020-11-16T20:54:55.121289+0000","last_peered":"2020-11-16T20:54:55.121289+0000","last_clean":"2020-11-16T20:54:55.121289+0000","last_became_active":"2020-11-16T20:54:55.119771+0000","last_became_peered":"2020-11-16T20:54:55.119771+0000","last_unstale":"2020-11-16T20:54:55.121289+0000","last_undegraded":"2020-11-16T20:54:55.121289+0000","last_fullsized":"2020-11-16T20:54:55.121289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"10","reported_epoch":"16","state":"active+clean","last_fresh":"2020-11-16T20:54:55.364248+0000","last_change":"2020-11-16T20:54:55.362484+0000","last_active":"2020-11-16T20:54:55.364248+0000","last_peered":"2020-11-16T20:54:55.364248+0000","last_clean":"2020-11-16T20:54:55.364248+0000","last_became_active":"2020-11-16T20:54:55.362005+0000","last_became_peered":"2020-11-16T20:54:55.362005+0000","last_unstale":"2020-11-16T20:54:55.364248+0000","last_undegraded":"2020-11-16T20:54:55.364248+0000","last_fullsized":"2020-11-16T20:54:55.364248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4952,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366888,"statfs":{"total":96636764160,"available":96631693312,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4952,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366888,"statfs":{"total":96636764160,"available":96631693312,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5229999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4952,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366888,"statfs":{"total":96636764160,"available":96631693312,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4952,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366888,"statfs":{"total":96636764160,"available":96631693312,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4952,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366888,"statfs":{"total":96636764160,"available":96631693312,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4888,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366952,"statfs":{"total":96636764160,"available":96631758848,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4952,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366888,"statfs":{"total":96636764160,"available":96631693312,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4952,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366888,"statfs":{"total":96636764160,"available":96631693312,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4930000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]}]}]}} 2020-11-16T20:55:11.092 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-11-16T20:55:11.092 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-11-16T20:55:11.093 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-11-16T20:55:11.093 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-11-16T20:55:11.452 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:55:11.464 INFO:teuthology.orchestra.run.smithi166.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-11-16T20:55:11.464 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-11-16T20:55:11.465 INFO:teuthology.run_tasks:Running task exec... 2020-11-16T20:55:15.707 INFO:teuthology.task.exec:Executing custom commands... 2020-11-16T20:55:15.708 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi166.front.sepia.ceph.com 2020-11-16T20:55:15.708 INFO:teuthology.orchestra.run.smithi166:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'while ! ceph balancer status ; do sleep 1 ; done' 2020-11-16T20:55:16.015 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:16.015 INFO:teuthology.orchestra.run.smithi166.stdout: "active": true, 2020-11-16T20:55:16.015 INFO:teuthology.orchestra.run.smithi166.stdout: "last_optimize_duration": "0:00:00.000381", 2020-11-16T20:55:16.015 INFO:teuthology.orchestra.run.smithi166.stdout: "last_optimize_started": "Mon Nov 16 20:54:49 2020", 2020-11-16T20:55:16.015 INFO:teuthology.orchestra.run.smithi166.stdout: "mode": "upmap", 2020-11-16T20:55:16.016 INFO:teuthology.orchestra.run.smithi166.stdout: "optimize_result": "No pools available", 2020-11-16T20:55:16.016 INFO:teuthology.orchestra.run.smithi166.stdout: "plans": [] 2020-11-16T20:55:16.016 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:16.027 INFO:teuthology.orchestra.run.smithi166:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph balancer mode crush-compat' 2020-11-16T20:55:16.779 INFO:teuthology.orchestra.run.smithi166:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph balancer on' 2020-11-16T20:55:17.086 INFO:teuthology.run_tasks:Running task thrashosds... 2020-11-16T20:55:21.340 INFO:tasks.thrashosds:config is {'chance_pgnum_grow': 0.25, 'chance_pgnum_shrink': 0.25, 'chance_pgpnum_fix': 0.25, 'chance_test_map_discontinuity': 2, 'timeout': 1800, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2020-11-16T20:55:21.340 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-kefu-testing-2020-11-16-1845'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd map cache size': 1, 'osd max backfills': 6, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub during recovery': False, 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'Health detail', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'osd_map_cache_size', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'must scrub before tier agent can activate'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'Health detail'], 'sha1': '911cc35794d871071a8bebfb0919482263b1d18b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'sha1': '911cc35794d871071a8bebfb0919482263b1d18b'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5, 'min_in': 4}, 'workunit': {'branch': 'wip-kefu-testing-2020-11-16-1845', 'sha1': '911cc35794d871071a8bebfb0919482263b1d18b'}} 2020-11-16T20:55:21.341 INFO:tasks.thrashosds:config is {'chance_pgnum_grow': 0.25, 'chance_pgnum_shrink': 0.25, 'chance_pgpnum_fix': 0.25, 'chance_test_map_discontinuity': 2, 'timeout': 1800, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5, 'min_in': 4} 2020-11-16T20:55:21.341 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2020-11-16T20:55:21.662 INFO:tasks.thrashosds:Beginning thrashosds... 2020-11-16T20:55:21.662 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-11-16T20:55:21.663 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-16T20:55:21.950 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:55:21.952 INFO:teuthology.orchestra.run.smithi166.stderr:dumped all 2020-11-16T20:55:21.962 INFO:teuthology.orchestra.run.smithi166.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2020-11-16T20:55:21.076750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":39576,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":38336,"kb_avail":754935144,"statfs":{"total":773094113280,"available":773053587456,"internally_reserved":0,"allocated":1204224,"data_stored":393278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39256064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002204"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"11","reported_epoch":"17","state":"active+clean","last_fresh":"2020-11-16T20:54:58.162932+0000","last_change":"2020-11-16T20:54:55.119464+0000","last_active":"2020-11-16T20:54:58.162932+0000","last_peered":"2020-11-16T20:54:58.162932+0000","last_clean":"2020-11-16T20:54:58.162932+0000","last_became_active":"2020-11-16T20:54:55.118917+0000","last_became_peered":"2020-11-16T20:54:55.118917+0000","last_unstale":"2020-11-16T20:54:58.162932+0000","last_undegraded":"2020-11-16T20:54:58.162932+0000","last_fullsized":"2020-11-16T20:54:58.162932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"11","reported_epoch":"17","state":"active+clean","last_fresh":"2020-11-16T20:54:57.194621+0000","last_change":"2020-11-16T20:54:55.579264+0000","last_active":"2020-11-16T20:54:57.194621+0000","last_peered":"2020-11-16T20:54:57.194621+0000","last_clean":"2020-11-16T20:54:57.194621+0000","last_became_active":"2020-11-16T20:54:55.578907+0000","last_became_peered":"2020-11-16T20:54:55.578907+0000","last_unstale":"2020-11-16T20:54:57.194621+0000","last_undegraded":"2020-11-16T20:54:57.194621+0000","last_fullsized":"2020-11-16T20:54:57.194621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"11","reported_epoch":"17","state":"active+clean","last_fresh":"2020-11-16T20:54:56.113534+0000","last_change":"2020-11-16T20:54:55.579361+0000","last_active":"2020-11-16T20:54:56.113534+0000","last_peered":"2020-11-16T20:54:56.113534+0000","last_clean":"2020-11-16T20:54:56.113534+0000","last_became_active":"2020-11-16T20:54:55.578864+0000","last_became_peered":"2020-11-16T20:54:55.578864+0000","last_unstale":"2020-11-16T20:54:56.113534+0000","last_undegraded":"2020-11-16T20:54:56.113534+0000","last_fullsized":"2020-11-16T20:54:56.113534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"11","reported_epoch":"17","state":"active+clean","last_fresh":"2020-11-16T20:54:56.113474+0000","last_change":"2020-11-16T20:54:55.362453+0000","last_active":"2020-11-16T20:54:56.113474+0000","last_peered":"2020-11-16T20:54:56.113474+0000","last_clean":"2020-11-16T20:54:56.113474+0000","last_became_active":"2020-11-16T20:54:55.362030+0000","last_became_peered":"2020-11-16T20:54:55.362030+0000","last_unstale":"2020-11-16T20:54:56.113474+0000","last_undegraded":"2020-11-16T20:54:56.113474+0000","last_fullsized":"2020-11-16T20:54:56.113474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-11-16T20:54:56.113456+0000","last_change":"2020-11-16T20:54:53.112612+0000","last_active":"2020-11-16T20:54:56.113456+0000","last_peered":"2020-11-16T20:54:56.113456+0000","last_clean":"2020-11-16T20:54:56.113456+0000","last_became_active":"2020-11-16T20:54:53.112038+0000","last_became_peered":"2020-11-16T20:54:53.112038+0000","last_unstale":"2020-11-16T20:54:56.113456+0000","last_undegraded":"2020-11-16T20:54:56.113456+0000","last_fullsized":"2020-11-16T20:54:56.113456+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:50.068882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:50.068882+0000","last_clean_scrub_stamp":"2020-11-16T20:54:50.068882+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"11","reported_epoch":"17","state":"active+clean","last_fresh":"2020-11-16T20:54:56.112424+0000","last_change":"2020-11-16T20:54:55.120010+0000","last_active":"2020-11-16T20:54:56.112424+0000","last_peered":"2020-11-16T20:54:56.112424+0000","last_clean":"2020-11-16T20:54:56.112424+0000","last_became_active":"2020-11-16T20:54:55.118978+0000","last_became_peered":"2020-11-16T20:54:55.118978+0000","last_unstale":"2020-11-16T20:54:56.112424+0000","last_undegraded":"2020-11-16T20:54:56.112424+0000","last_fullsized":"2020-11-16T20:54:56.112424+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"11","reported_epoch":"17","state":"active+clean","last_fresh":"2020-11-16T20:54:57.766004+0000","last_change":"2020-11-16T20:54:55.362510+0000","last_active":"2020-11-16T20:54:57.766004+0000","last_peered":"2020-11-16T20:54:57.766004+0000","last_clean":"2020-11-16T20:54:57.766004+0000","last_became_active":"2020-11-16T20:54:55.362052+0000","last_became_peered":"2020-11-16T20:54:55.362052+0000","last_unstale":"2020-11-16T20:54:57.766004+0000","last_undegraded":"2020-11-16T20:54:57.766004+0000","last_fullsized":"2020-11-16T20:54:57.766004+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"11","reported_epoch":"17","state":"active+clean","last_fresh":"2020-11-16T20:54:56.112378+0000","last_change":"2020-11-16T20:54:55.120346+0000","last_active":"2020-11-16T20:54:56.112378+0000","last_peered":"2020-11-16T20:54:56.112378+0000","last_clean":"2020-11-16T20:54:56.112378+0000","last_became_active":"2020-11-16T20:54:55.119771+0000","last_became_peered":"2020-11-16T20:54:55.119771+0000","last_unstale":"2020-11-16T20:54:56.112378+0000","last_undegraded":"2020-11-16T20:54:56.112378+0000","last_fullsized":"2020-11-16T20:54:56.112378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"11","reported_epoch":"17","state":"active+clean","last_fresh":"2020-11-16T20:54:57.194618+0000","last_change":"2020-11-16T20:54:55.362484+0000","last_active":"2020-11-16T20:54:57.194618+0000","last_peered":"2020-11-16T20:54:57.194618+0000","last_clean":"2020-11-16T20:54:57.194618+0000","last_became_active":"2020-11-16T20:54:55.362005+0000","last_became_peered":"2020-11-16T20:54:55.362005+0000","last_unstale":"2020-11-16T20:54:57.194618+0000","last_undegraded":"2020-11-16T20:54:57.194618+0000","last_fullsized":"2020-11-16T20:54:57.194618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4952,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366888,"statfs":{"total":96636764160,"available":96631693312,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4952,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366888,"statfs":{"total":96636764160,"available":96631693312,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3939999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4952,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366888,"statfs":{"total":96636764160,"available":96631693312,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.601}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4964,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366876,"statfs":{"total":96636764160,"available":96631681024,"internally_reserved":0,"allocated":159744,"data_stored":53389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4059999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4630000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4952,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366888,"statfs":{"total":96636764160,"available":96631693312,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4888,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366952,"statfs":{"total":96636764160,"available":96631758848,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.647}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.415}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4952,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366888,"statfs":{"total":96636764160,"available":96631693312,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.603}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4964,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366876,"statfs":{"total":96636764160,"available":96631681024,"internally_reserved":0,"allocated":159744,"data_stored":53389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5780000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4630000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6799999999999999}]}]}]}} 2020-11-16T20:55:21.963 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-16T20:55:22.257 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:55:22.259 INFO:teuthology.orchestra.run.smithi166.stderr:dumped all 2020-11-16T20:55:22.269 INFO:teuthology.orchestra.run.smithi166.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2020-11-16T20:55:21.076750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":39576,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":38336,"kb_avail":754935144,"statfs":{"total":773094113280,"available":773053587456,"internally_reserved":0,"allocated":1204224,"data_stored":393278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39256064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002204"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"11","reported_epoch":"17","state":"active+clean","last_fresh":"2020-11-16T20:54:58.162932+0000","last_change":"2020-11-16T20:54:55.119464+0000","last_active":"2020-11-16T20:54:58.162932+0000","last_peered":"2020-11-16T20:54:58.162932+0000","last_clean":"2020-11-16T20:54:58.162932+0000","last_became_active":"2020-11-16T20:54:55.118917+0000","last_became_peered":"2020-11-16T20:54:55.118917+0000","last_unstale":"2020-11-16T20:54:58.162932+0000","last_undegraded":"2020-11-16T20:54:58.162932+0000","last_fullsized":"2020-11-16T20:54:58.162932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"11","reported_epoch":"17","state":"active+clean","last_fresh":"2020-11-16T20:54:57.194621+0000","last_change":"2020-11-16T20:54:55.579264+0000","last_active":"2020-11-16T20:54:57.194621+0000","last_peered":"2020-11-16T20:54:57.194621+0000","last_clean":"2020-11-16T20:54:57.194621+0000","last_became_active":"2020-11-16T20:54:55.578907+0000","last_became_peered":"2020-11-16T20:54:55.578907+0000","last_unstale":"2020-11-16T20:54:57.194621+0000","last_undegraded":"2020-11-16T20:54:57.194621+0000","last_fullsized":"2020-11-16T20:54:57.194621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"11","reported_epoch":"17","state":"active+clean","last_fresh":"2020-11-16T20:54:56.113534+0000","last_change":"2020-11-16T20:54:55.579361+0000","last_active":"2020-11-16T20:54:56.113534+0000","last_peered":"2020-11-16T20:54:56.113534+0000","last_clean":"2020-11-16T20:54:56.113534+0000","last_became_active":"2020-11-16T20:54:55.578864+0000","last_became_peered":"2020-11-16T20:54:55.578864+0000","last_unstale":"2020-11-16T20:54:56.113534+0000","last_undegraded":"2020-11-16T20:54:56.113534+0000","last_fullsized":"2020-11-16T20:54:56.113534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"11","reported_epoch":"17","state":"active+clean","last_fresh":"2020-11-16T20:54:56.113474+0000","last_change":"2020-11-16T20:54:55.362453+0000","last_active":"2020-11-16T20:54:56.113474+0000","last_peered":"2020-11-16T20:54:56.113474+0000","last_clean":"2020-11-16T20:54:56.113474+0000","last_became_active":"2020-11-16T20:54:55.362030+0000","last_became_peered":"2020-11-16T20:54:55.362030+0000","last_unstale":"2020-11-16T20:54:56.113474+0000","last_undegraded":"2020-11-16T20:54:56.113474+0000","last_fullsized":"2020-11-16T20:54:56.113474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-11-16T20:54:56.113456+0000","last_change":"2020-11-16T20:54:53.112612+0000","last_active":"2020-11-16T20:54:56.113456+0000","last_peered":"2020-11-16T20:54:56.113456+0000","last_clean":"2020-11-16T20:54:56.113456+0000","last_became_active":"2020-11-16T20:54:53.112038+0000","last_became_peered":"2020-11-16T20:54:53.112038+0000","last_unstale":"2020-11-16T20:54:56.113456+0000","last_undegraded":"2020-11-16T20:54:56.113456+0000","last_fullsized":"2020-11-16T20:54:56.113456+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:50.068882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:50.068882+0000","last_clean_scrub_stamp":"2020-11-16T20:54:50.068882+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"11","reported_epoch":"17","state":"active+clean","last_fresh":"2020-11-16T20:54:56.112424+0000","last_change":"2020-11-16T20:54:55.120010+0000","last_active":"2020-11-16T20:54:56.112424+0000","last_peered":"2020-11-16T20:54:56.112424+0000","last_clean":"2020-11-16T20:54:56.112424+0000","last_became_active":"2020-11-16T20:54:55.118978+0000","last_became_peered":"2020-11-16T20:54:55.118978+0000","last_unstale":"2020-11-16T20:54:56.112424+0000","last_undegraded":"2020-11-16T20:54:56.112424+0000","last_fullsized":"2020-11-16T20:54:56.112424+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"11","reported_epoch":"17","state":"active+clean","last_fresh":"2020-11-16T20:54:57.766004+0000","last_change":"2020-11-16T20:54:55.362510+0000","last_active":"2020-11-16T20:54:57.766004+0000","last_peered":"2020-11-16T20:54:57.766004+0000","last_clean":"2020-11-16T20:54:57.766004+0000","last_became_active":"2020-11-16T20:54:55.362052+0000","last_became_peered":"2020-11-16T20:54:55.362052+0000","last_unstale":"2020-11-16T20:54:57.766004+0000","last_undegraded":"2020-11-16T20:54:57.766004+0000","last_fullsized":"2020-11-16T20:54:57.766004+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"11","reported_epoch":"17","state":"active+clean","last_fresh":"2020-11-16T20:54:56.112378+0000","last_change":"2020-11-16T20:54:55.120346+0000","last_active":"2020-11-16T20:54:56.112378+0000","last_peered":"2020-11-16T20:54:56.112378+0000","last_clean":"2020-11-16T20:54:56.112378+0000","last_became_active":"2020-11-16T20:54:55.119771+0000","last_became_peered":"2020-11-16T20:54:55.119771+0000","last_unstale":"2020-11-16T20:54:56.112378+0000","last_undegraded":"2020-11-16T20:54:56.112378+0000","last_fullsized":"2020-11-16T20:54:56.112378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"11","reported_epoch":"17","state":"active+clean","last_fresh":"2020-11-16T20:54:57.194618+0000","last_change":"2020-11-16T20:54:55.362484+0000","last_active":"2020-11-16T20:54:57.194618+0000","last_peered":"2020-11-16T20:54:57.194618+0000","last_clean":"2020-11-16T20:54:57.194618+0000","last_became_active":"2020-11-16T20:54:55.362005+0000","last_became_peered":"2020-11-16T20:54:55.362005+0000","last_unstale":"2020-11-16T20:54:57.194618+0000","last_undegraded":"2020-11-16T20:54:57.194618+0000","last_fullsized":"2020-11-16T20:54:57.194618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4952,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366888,"statfs":{"total":96636764160,"available":96631693312,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4952,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366888,"statfs":{"total":96636764160,"available":96631693312,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3939999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4952,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366888,"statfs":{"total":96636764160,"available":96631693312,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.601}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4964,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366876,"statfs":{"total":96636764160,"available":96631681024,"internally_reserved":0,"allocated":159744,"data_stored":53389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4059999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4630000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4952,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366888,"statfs":{"total":96636764160,"available":96631693312,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4888,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366952,"statfs":{"total":96636764160,"available":96631758848,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.647}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.415}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4952,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366888,"statfs":{"total":96636764160,"available":96631693312,"internally_reserved":0,"allocated":147456,"data_stored":47750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.603}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4964,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366876,"statfs":{"total":96636764160,"available":96631681024,"internally_reserved":0,"allocated":159744,"data_stored":53389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5780000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4630000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6799999999999999}]}]}]}} 2020-11-16T20:55:22.271 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-11-16T20:55:22.271 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2020-11-16T20:55:22.560 INFO:teuthology.orchestra.run.smithi166.stdout:epoch 18 2020-11-16T20:55:22.560 INFO:teuthology.orchestra.run.smithi166.stdout:fsid a14fd848-4cfe-4cd9-9140-5b3c4b4e904d 2020-11-16T20:55:22.560 INFO:teuthology.orchestra.run.smithi166.stdout:created 2020-11-16T20:54:44.938121+0000 2020-11-16T20:55:22.561 INFO:teuthology.orchestra.run.smithi166.stdout:modified 2020-11-16T20:55:16.755509+0000 2020-11-16T20:55:22.561 INFO:teuthology.orchestra.run.smithi166.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2020-11-16T20:55:22.561 INFO:teuthology.orchestra.run.smithi166.stdout:crush_version 5 2020-11-16T20:55:22.561 INFO:teuthology.orchestra.run.smithi166.stdout:full_ratio 0.95 2020-11-16T20:55:22.561 INFO:teuthology.orchestra.run.smithi166.stdout:backfillfull_ratio 0.9 2020-11-16T20:55:22.561 INFO:teuthology.orchestra.run.smithi166.stdout:nearfull_ratio 0.85 2020-11-16T20:55:22.561 INFO:teuthology.orchestra.run.smithi166.stdout:require_min_compat_client luminous 2020-11-16T20:55:22.562 INFO:teuthology.orchestra.run.smithi166.stdout:min_compat_client jewel 2020-11-16T20:55:22.562 INFO:teuthology.orchestra.run.smithi166.stdout:require_osd_release pacific 2020-11-16T20:55:22.562 INFO:teuthology.orchestra.run.smithi166.stdout:stretch_mode_enabled false 2020-11-16T20:55:22.562 INFO:teuthology.orchestra.run.smithi166.stdout:pool 1 'device_health_metrics' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 15 flags hashpspool stripe_width 0 pg_num_min 1 application mgr_devicehealth 2020-11-16T20:55:22.562 INFO:teuthology.orchestra.run.smithi166.stdout:pool 2 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 application rbd 2020-11-16T20:55:22.562 INFO:teuthology.orchestra.run.smithi166.stdout:max_osd 8 2020-11-16T20:55:22.562 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) v2:172.21.15.166:6800/35293 v2:172.21.15.166:6802/35293 exists,up 35950122-efbd-420e-b07a-f5730f26df17 2020-11-16T20:55:22.563 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1 up in weight 1 up_from 13 up_thru 15 down_at 0 last_clean_interval [0,0) v2:172.21.15.166:6808/35323 v2:172.21.15.166:6809/35323 exists,up f768a1ff-3e8a-4131-a6ed-10f93b3ca900 2020-11-16T20:55:22.563 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2 up in weight 1 up_from 13 up_thru 15 down_at 0 last_clean_interval [0,0) v2:172.21.15.166:6801/35294 v2:172.21.15.166:6803/35294 exists,up 88734179-84a6-4a9b-8af0-692805815875 2020-11-16T20:55:22.563 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) v2:172.21.15.166:6812/35324 v2:172.21.15.166:6813/35324 exists,up 319e54e8-3f03-4388-8de6-678d148e25d4 2020-11-16T20:55:22.563 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) v2:172.21.15.59:6804/31586 v2:172.21.15.59:6805/31586 exists,up 3edbb68e-e030-4379-891e-2412f1235ffb 2020-11-16T20:55:22.563 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5 up in weight 1 up_from 13 up_thru 15 down_at 0 last_clean_interval [0,0) v2:172.21.15.59:6808/31610 v2:172.21.15.59:6810/31610 exists,up 44fbf5ac-4484-48a8-a846-1f5c01a6ec2c 2020-11-16T20:55:22.563 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6 up in weight 1 up_from 13 up_thru 15 down_at 0 last_clean_interval [0,0) v2:172.21.15.59:6800/31587 v2:172.21.15.59:6801/31587 exists,up f93b82df-f537-4601-8247-388bf100b5b5 2020-11-16T20:55:22.563 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7 up in weight 1 up_from 13 up_thru 15 down_at 0 last_clean_interval [0,0) v2:172.21.15.59:6809/31617 v2:172.21.15.59:6811/31617 exists,up e5485c88-d267-4a6a-b9b6-15d869d28f28 2020-11-16T20:55:22.572 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) v2:172.21.15.166:6800/35293 v2:172.21.15.166:6802/35293 exists,up 35950122-efbd-420e-b07a-f5730f26df17', 'osd.1 up in weight 1 up_from 13 up_thru 15 down_at 0 last_clean_interval [0,0) v2:172.21.15.166:6808/35323 v2:172.21.15.166:6809/35323 exists,up f768a1ff-3e8a-4131-a6ed-10f93b3ca900', 'osd.2 up in weight 1 up_from 13 up_thru 15 down_at 0 last_clean_interval [0,0) v2:172.21.15.166:6801/35294 v2:172.21.15.166:6803/35294 exists,up 88734179-84a6-4a9b-8af0-692805815875', 'osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) v2:172.21.15.166:6812/35324 v2:172.21.15.166:6813/35324 exists,up 319e54e8-3f03-4388-8de6-678d148e25d4', 'osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) v2:172.21.15.59:6804/31586 v2:172.21.15.59:6805/31586 exists,up 3edbb68e-e030-4379-891e-2412f1235ffb', 'osd.5 up in weight 1 up_from 13 up_thru 15 down_at 0 last_clean_interval [0,0) v2:172.21.15.59:6808/31610 v2:172.21.15.59:6810/31610 exists,up 44fbf5ac-4484-48a8-a846-1f5c01a6ec2c', 'osd.6 up in weight 1 up_from 13 up_thru 15 down_at 0 last_clean_interval [0,0) v2:172.21.15.59:6800/31587 v2:172.21.15.59:6801/31587 exists,up f93b82df-f537-4601-8247-388bf100b5b5', 'osd.7 up in weight 1 up_from 13 up_thru 15 down_at 0 last_clean_interval [0,0) v2:172.21.15.59:6809/31617 v2:172.21.15.59:6811/31617 exists,up e5485c88-d267-4a6a-b9b6-15d869d28f28'] 2020-11-16T20:55:22.573 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2020-11-16T20:55:22.692 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:22.693 INFO:teuthology.orchestra.run.smithi166.stdout: "name": "mon.a", 2020-11-16T20:55:22.693 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster": "ceph", 2020-11-16T20:55:22.693 INFO:teuthology.orchestra.run.smithi166.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2020-11-16T20:55:22.693 INFO:teuthology.orchestra.run.smithi166.stdout: "admin_socket_mode": "", 2020-11-16T20:55:22.693 INFO:teuthology.orchestra.run.smithi166.stdout: "auth_client_required": "cephx, none", 2020-11-16T20:55:22.693 INFO:teuthology.orchestra.run.smithi166.stdout: "auth_cluster_required": "cephx", 2020-11-16T20:55:22.693 INFO:teuthology.orchestra.run.smithi166.stdout: "auth_debug": "true", 2020-11-16T20:55:22.694 INFO:teuthology.orchestra.run.smithi166.stdout: "auth_mon_ticket_ttl": "43200.000000", 2020-11-16T20:55:22.694 INFO:teuthology.orchestra.run.smithi166.stdout: "auth_service_required": "cephx", 2020-11-16T20:55:22.694 INFO:teuthology.orchestra.run.smithi166.stdout: "auth_service_ticket_ttl": "3600.000000", 2020-11-16T20:55:22.694 INFO:teuthology.orchestra.run.smithi166.stdout: "auth_supported": "cephx", 2020-11-16T20:55:22.694 INFO:teuthology.orchestra.run.smithi166.stdout: "bdev_aio": "true", 2020-11-16T20:55:22.694 INFO:teuthology.orchestra.run.smithi166.stdout: "bdev_aio_max_queue_depth": "1024", 2020-11-16T20:55:22.694 INFO:teuthology.orchestra.run.smithi166.stdout: "bdev_aio_poll_ms": "250", 2020-11-16T20:55:22.695 INFO:teuthology.orchestra.run.smithi166.stdout: "bdev_aio_reap_max": "16", 2020-11-16T20:55:22.695 INFO:teuthology.orchestra.run.smithi166.stdout: "bdev_async_discard": "false", 2020-11-16T20:55:22.695 INFO:teuthology.orchestra.run.smithi166.stdout: "bdev_block_size": "4096", 2020-11-16T20:55:22.695 INFO:teuthology.orchestra.run.smithi166.stdout: "bdev_debug_aio": "false", 2020-11-16T20:55:22.695 INFO:teuthology.orchestra.run.smithi166.stdout: "bdev_debug_aio_log_age": "5.000000", 2020-11-16T20:55:22.695 INFO:teuthology.orchestra.run.smithi166.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2020-11-16T20:55:22.695 INFO:teuthology.orchestra.run.smithi166.stdout: "bdev_debug_inflight_ios": "false", 2020-11-16T20:55:22.696 INFO:teuthology.orchestra.run.smithi166.stdout: "bdev_enable_discard": "false", 2020-11-16T20:55:22.696 INFO:teuthology.orchestra.run.smithi166.stdout: "bdev_flock_retry": "3", 2020-11-16T20:55:22.696 INFO:teuthology.orchestra.run.smithi166.stdout: "bdev_flock_retry_interval": "0.100000", 2020-11-16T20:55:22.696 INFO:teuthology.orchestra.run.smithi166.stdout: "bdev_inject_crash": "0", 2020-11-16T20:55:22.696 INFO:teuthology.orchestra.run.smithi166.stdout: "bdev_inject_crash_flush_delay": "2", 2020-11-16T20:55:22.696 INFO:teuthology.orchestra.run.smithi166.stdout: "bdev_ioring": "false", 2020-11-16T20:55:22.696 INFO:teuthology.orchestra.run.smithi166.stdout: "bdev_nvme_unbind_from_kernel": "false", 2020-11-16T20:55:22.696 INFO:teuthology.orchestra.run.smithi166.stdout: "bdev_type": "", 2020-11-16T20:55:22.697 INFO:teuthology.orchestra.run.smithi166.stdout: "bluefs_alloc_size": "1048576", 2020-11-16T20:55:22.697 INFO:teuthology.orchestra.run.smithi166.stdout: "bluefs_allocator": "hybrid", 2020-11-16T20:55:22.697 INFO:teuthology.orchestra.run.smithi166.stdout: "bluefs_buffered_io": "false", 2020-11-16T20:55:22.697 INFO:teuthology.orchestra.run.smithi166.stdout: "bluefs_compact_log_sync": "false", 2020-11-16T20:55:22.697 INFO:teuthology.orchestra.run.smithi166.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2020-11-16T20:55:22.697 INFO:teuthology.orchestra.run.smithi166.stdout: "bluefs_log_compact_min_size": "16777216", 2020-11-16T20:55:22.697 INFO:teuthology.orchestra.run.smithi166.stdout: "bluefs_log_replay_check_allocations": "true", 2020-11-16T20:55:22.698 INFO:teuthology.orchestra.run.smithi166.stdout: "bluefs_max_log_runway": "4194304", 2020-11-16T20:55:22.698 INFO:teuthology.orchestra.run.smithi166.stdout: "bluefs_max_prefetch": "1048576", 2020-11-16T20:55:22.698 INFO:teuthology.orchestra.run.smithi166.stdout: "bluefs_min_flush_size": "524288", 2020-11-16T20:55:22.698 INFO:teuthology.orchestra.run.smithi166.stdout: "bluefs_min_log_runway": "1048576", 2020-11-16T20:55:22.698 INFO:teuthology.orchestra.run.smithi166.stdout: "bluefs_replay_recovery": "false", 2020-11-16T20:55:22.698 INFO:teuthology.orchestra.run.smithi166.stdout: "bluefs_replay_recovery_disable_compact": "false", 2020-11-16T20:55:22.698 INFO:teuthology.orchestra.run.smithi166.stdout: "bluefs_shared_alloc_size": "65536", 2020-11-16T20:55:22.698 INFO:teuthology.orchestra.run.smithi166.stdout: "bluefs_sync_write": "false", 2020-11-16T20:55:22.699 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2020-11-16T20:55:22.699 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2020-11-16T20:55:22.699 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2020-11-16T20:55:22.699 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_allocator": "hybrid", 2020-11-16T20:55:22.699 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2020-11-16T20:55:22.699 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2020-11-16T20:55:22.699 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2020-11-16T20:55:22.700 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_bitmapallocator_span_size": "1024", 2020-11-16T20:55:22.700 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_blobid_prealloc": "10240", 2020-11-16T20:55:22.700 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_block_create": "true", 2020-11-16T20:55:22.700 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_block_db_create": "false", 2020-11-16T20:55:22.700 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_block_db_path": "", 2020-11-16T20:55:22.700 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_block_db_size": "0", 2020-11-16T20:55:22.700 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_block_path": "", 2020-11-16T20:55:22.700 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_block_preallocate_file": "false", 2020-11-16T20:55:22.701 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_block_size": "107374182400", 2020-11-16T20:55:22.701 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_block_wal_create": "false", 2020-11-16T20:55:22.701 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_block_wal_path": "", 2020-11-16T20:55:22.701 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_block_wal_size": "100663296", 2020-11-16T20:55:22.701 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_bluefs": "true", 2020-11-16T20:55:22.701 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2020-11-16T20:55:22.701 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_bluefs_env_mirror": "false", 2020-11-16T20:55:22.702 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_cache_autotune": "true", 2020-11-16T20:55:22.702 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_cache_autotune_interval": "5.000000", 2020-11-16T20:55:22.702 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_cache_kv_ratio": "0.400000", 2020-11-16T20:55:22.702 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_cache_meta_ratio": "0.400000", 2020-11-16T20:55:22.702 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_cache_size": "0", 2020-11-16T20:55:22.702 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_cache_size_hdd": "1073741824", 2020-11-16T20:55:22.702 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_cache_size_ssd": "3221225472", 2020-11-16T20:55:22.703 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_cache_trim_interval": "0.050000", 2020-11-16T20:55:22.703 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_cache_trim_max_skip_pinned": "64", 2020-11-16T20:55:22.703 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_cache_type": "2q", 2020-11-16T20:55:22.703 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_clone_cow": "true", 2020-11-16T20:55:22.703 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_compression_algorithm": "snappy", 2020-11-16T20:55:22.703 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_compression_max_blob_size": "0", 2020-11-16T20:55:22.703 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2020-11-16T20:55:22.703 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2020-11-16T20:55:22.704 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_compression_min_blob_size": "0", 2020-11-16T20:55:22.704 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2020-11-16T20:55:22.704 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_compression_min_blob_size_ssd": "8192", 2020-11-16T20:55:22.704 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_compression_mode": "none", 2020-11-16T20:55:22.704 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_compression_required_ratio": "0.875000", 2020-11-16T20:55:22.704 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_csum_type": "crc32c", 2020-11-16T20:55:22.704 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_debug_enforce_settings": "default", 2020-11-16T20:55:22.705 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_debug_freelist": "false", 2020-11-16T20:55:22.705 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_debug_fsck_abort": "false", 2020-11-16T20:55:22.705 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_debug_inject_bug21040": "false", 2020-11-16T20:55:22.705 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2020-11-16T20:55:22.705 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_debug_inject_read_err": "false", 2020-11-16T20:55:22.705 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_debug_no_reuse_blocks": "false", 2020-11-16T20:55:22.705 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_debug_omit_block_device_write": "false", 2020-11-16T20:55:22.705 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_debug_omit_kv_commit": "false", 2020-11-16T20:55:22.706 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2020-11-16T20:55:22.706 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_debug_prefill": "0.000000", 2020-11-16T20:55:22.706 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_debug_prefragment_max": "1048576", 2020-11-16T20:55:22.706 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_debug_random_read_err": "0.000000", 2020-11-16T20:55:22.706 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2020-11-16T20:55:22.706 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_debug_small_allocations": "0", 2020-11-16T20:55:22.706 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2020-11-16T20:55:22.707 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_default_buffered_read": "true", 2020-11-16T20:55:22.707 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_default_buffered_write": "false", 2020-11-16T20:55:22.707 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_deferred_batch_ops": "0", 2020-11-16T20:55:22.707 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2020-11-16T20:55:22.707 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2020-11-16T20:55:22.707 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2020-11-16T20:55:22.707 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_extent_map_shard_max_size": "1200", 2020-11-16T20:55:22.707 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_extent_map_shard_min_size": "150", 2020-11-16T20:55:22.708 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_extent_map_shard_target_size": "500", 2020-11-16T20:55:22.708 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2020-11-16T20:55:22.708 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_freelist_blocks_per_key": "128", 2020-11-16T20:55:22.708 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2020-11-16T20:55:22.708 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2020-11-16T20:55:22.708 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_fsck_on_mkfs": "true", 2020-11-16T20:55:22.708 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2020-11-16T20:55:22.709 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_fsck_on_mount": "false", 2020-11-16T20:55:22.709 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_fsck_on_mount_deep": "false", 2020-11-16T20:55:22.709 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_fsck_on_umount": "false", 2020-11-16T20:55:22.709 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_fsck_on_umount_deep": "false", 2020-11-16T20:55:22.709 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_fsck_quick_fix_on_mount": "true", 2020-11-16T20:55:22.709 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_fsck_quick_fix_threads": "2", 2020-11-16T20:55:22.709 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2020-11-16T20:55:22.709 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_gc_enable_blob_threshold": "0", 2020-11-16T20:55:22.710 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_gc_enable_total_threshold": "0", 2020-11-16T20:55:22.710 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2020-11-16T20:55:22.710 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_ignore_data_csum": "false", 2020-11-16T20:55:22.710 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_kvbackend": "rocksdb", 2020-11-16T20:55:22.710 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_log_collection_list_age": "60.000000", 2020-11-16T20:55:22.710 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2020-11-16T20:55:22.710 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_log_op_age": "5.000000", 2020-11-16T20:55:22.711 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_max_alloc_size": "0", 2020-11-16T20:55:22.711 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_max_blob_size": "0", 2020-11-16T20:55:22.711 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_max_blob_size_hdd": "65536", 2020-11-16T20:55:22.711 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_max_blob_size_ssd": "65536", 2020-11-16T20:55:22.711 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_max_defer_interval": "3.000000", 2020-11-16T20:55:22.711 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_max_deferred_txc": "32", 2020-11-16T20:55:22.711 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_min_alloc_size": "0", 2020-11-16T20:55:22.711 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_min_alloc_size_hdd": "4096", 2020-11-16T20:55:22.712 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_min_alloc_size_ssd": "4096", 2020-11-16T20:55:22.712 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_nid_prealloc": "1024", 2020-11-16T20:55:22.712 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_prefer_deferred_size": "0", 2020-11-16T20:55:22.712 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2020-11-16T20:55:22.712 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2020-11-16T20:55:22.712 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_retry_disk_reads": "3", 2020-11-16T20:55:22.712 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_rocksdb_cf": "true", 2020-11-16T20:55:22.713 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_rocksdb_cfs": "m(3) O(3,0-13) L", 2020-11-16T20:55:22.713 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_rocksdb_options": "compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2,max_total_wal_size=1073741824", 2020-11-16T20:55:22.713 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_spdk_coremask": "0x1", 2020-11-16T20:55:22.713 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_spdk_io_sleep": "5", 2020-11-16T20:55:22.713 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_spdk_max_io_completion": "0", 2020-11-16T20:55:22.713 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_spdk_mem": "512", 2020-11-16T20:55:22.713 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_sync_submit_transaction": "false", 2020-11-16T20:55:22.713 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_throttle_bytes": "67108864", 2020-11-16T20:55:22.714 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_throttle_cost_per_io": "0", 2020-11-16T20:55:22.714 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2020-11-16T20:55:22.714 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2020-11-16T20:55:22.714 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2020-11-16T20:55:22.714 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_throttle_trace_rate": "0.000000", 2020-11-16T20:55:22.714 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_tracing": "false", 2020-11-16T20:55:22.714 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2020-11-16T20:55:22.715 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_volume_selection_reserved": "0", 2020-11-16T20:55:22.715 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2020-11-16T20:55:22.715 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2020-11-16T20:55:22.715 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_warn_on_legacy_statfs": "true", 2020-11-16T20:55:22.715 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2020-11-16T20:55:22.715 INFO:teuthology.orchestra.run.smithi166.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2020-11-16T20:55:22.715 INFO:teuthology.orchestra.run.smithi166.stdout: "cephadm_path": "/usr/sbin/cephadm", 2020-11-16T20:55:22.715 INFO:teuthology.orchestra.run.smithi166.stdout: "cephfs_mirror_directory_choose_policy": "random", 2020-11-16T20:55:22.716 INFO:teuthology.orchestra.run.smithi166.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2020-11-16T20:55:22.716 INFO:teuthology.orchestra.run.smithi166.stdout: "cephfs_mirror_mirror_action_update_interval": "2", 2020-11-16T20:55:22.716 INFO:teuthology.orchestra.run.smithi166.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2020-11-16T20:55:22.716 INFO:teuthology.orchestra.run.smithi166.stdout: "cephx_cluster_require_signatures": "false", 2020-11-16T20:55:22.716 INFO:teuthology.orchestra.run.smithi166.stdout: "cephx_cluster_require_version": "1", 2020-11-16T20:55:22.716 INFO:teuthology.orchestra.run.smithi166.stdout: "cephx_require_signatures": "false", 2020-11-16T20:55:22.716 INFO:teuthology.orchestra.run.smithi166.stdout: "cephx_require_version": "1", 2020-11-16T20:55:22.717 INFO:teuthology.orchestra.run.smithi166.stdout: "cephx_service_require_signatures": "false", 2020-11-16T20:55:22.717 INFO:teuthology.orchestra.run.smithi166.stdout: "cephx_service_require_version": "1", 2020-11-16T20:55:22.717 INFO:teuthology.orchestra.run.smithi166.stdout: "cephx_sign_messages": "true", 2020-11-16T20:55:22.717 INFO:teuthology.orchestra.run.smithi166.stdout: "chdir": "", 2020-11-16T20:55:22.717 INFO:teuthology.orchestra.run.smithi166.stdout: "client_acl_type": "", 2020-11-16T20:55:22.717 INFO:teuthology.orchestra.run.smithi166.stdout: "client_asio_thread_count": "2", 2020-11-16T20:55:22.717 INFO:teuthology.orchestra.run.smithi166.stdout: "client_cache_mid": "0.750000", 2020-11-16T20:55:22.717 INFO:teuthology.orchestra.run.smithi166.stdout: "client_cache_size": "16384", 2020-11-16T20:55:22.718 INFO:teuthology.orchestra.run.smithi166.stdout: "client_caps_release_delay": "5", 2020-11-16T20:55:22.718 INFO:teuthology.orchestra.run.smithi166.stdout: "client_check_pool_perm": "true", 2020-11-16T20:55:22.718 INFO:teuthology.orchestra.run.smithi166.stdout: "client_debug_force_sync_read": "false", 2020-11-16T20:55:22.718 INFO:teuthology.orchestra.run.smithi166.stdout: "client_debug_getattr_caps": "false", 2020-11-16T20:55:22.718 INFO:teuthology.orchestra.run.smithi166.stdout: "client_debug_inject_tick_delay": "0", 2020-11-16T20:55:22.718 INFO:teuthology.orchestra.run.smithi166.stdout: "client_die_on_failed_dentry_invalidate": "true", 2020-11-16T20:55:22.718 INFO:teuthology.orchestra.run.smithi166.stdout: "client_die_on_failed_remount": "false", 2020-11-16T20:55:22.719 INFO:teuthology.orchestra.run.smithi166.stdout: "client_dirsize_rbytes": "true", 2020-11-16T20:55:22.719 INFO:teuthology.orchestra.run.smithi166.stdout: "client_force_lazyio": "false", 2020-11-16T20:55:22.719 INFO:teuthology.orchestra.run.smithi166.stdout: "client_fs": "", 2020-11-16T20:55:22.719 INFO:teuthology.orchestra.run.smithi166.stdout: "client_inject_fixed_oldest_tid": "false", 2020-11-16T20:55:22.719 INFO:teuthology.orchestra.run.smithi166.stdout: "client_inject_release_failure": "false", 2020-11-16T20:55:22.719 INFO:teuthology.orchestra.run.smithi166.stdout: "client_max_inline_size": "4096", 2020-11-16T20:55:22.719 INFO:teuthology.orchestra.run.smithi166.stdout: "client_mds_namespace": "", 2020-11-16T20:55:22.720 INFO:teuthology.orchestra.run.smithi166.stdout: "client_metadata": "", 2020-11-16T20:55:22.720 INFO:teuthology.orchestra.run.smithi166.stdout: "client_mount_gid": "-1", 2020-11-16T20:55:22.720 INFO:teuthology.orchestra.run.smithi166.stdout: "client_mount_timeout": "300.000000", 2020-11-16T20:55:22.720 INFO:teuthology.orchestra.run.smithi166.stdout: "client_mount_uid": "-1", 2020-11-16T20:55:22.720 INFO:teuthology.orchestra.run.smithi166.stdout: "client_mountpoint": "/", 2020-11-16T20:55:22.720 INFO:teuthology.orchestra.run.smithi166.stdout: "client_notify_timeout": "10", 2020-11-16T20:55:22.720 INFO:teuthology.orchestra.run.smithi166.stdout: "client_oc": "true", 2020-11-16T20:55:22.721 INFO:teuthology.orchestra.run.smithi166.stdout: "client_oc_max_dirty": "104857600", 2020-11-16T20:55:22.721 INFO:teuthology.orchestra.run.smithi166.stdout: "client_oc_max_dirty_age": "5.000000", 2020-11-16T20:55:22.721 INFO:teuthology.orchestra.run.smithi166.stdout: "client_oc_max_objects": "1000", 2020-11-16T20:55:22.721 INFO:teuthology.orchestra.run.smithi166.stdout: "client_oc_size": "209715200", 2020-11-16T20:55:22.721 INFO:teuthology.orchestra.run.smithi166.stdout: "client_oc_target_dirty": "8388608", 2020-11-16T20:55:22.721 INFO:teuthology.orchestra.run.smithi166.stdout: "client_permissions": "true", 2020-11-16T20:55:22.721 INFO:teuthology.orchestra.run.smithi166.stdout: "client_quota_df": "true", 2020-11-16T20:55:22.722 INFO:teuthology.orchestra.run.smithi166.stdout: "client_readahead_max_bytes": "0", 2020-11-16T20:55:22.722 INFO:teuthology.orchestra.run.smithi166.stdout: "client_readahead_max_periods": "4", 2020-11-16T20:55:22.722 INFO:teuthology.orchestra.run.smithi166.stdout: "client_readahead_min": "131072", 2020-11-16T20:55:22.722 INFO:teuthology.orchestra.run.smithi166.stdout: "client_reconnect_stale": "false", 2020-11-16T20:55:22.722 INFO:teuthology.orchestra.run.smithi166.stdout: "client_shutdown_timeout": "30", 2020-11-16T20:55:22.722 INFO:teuthology.orchestra.run.smithi166.stdout: "client_snapdir": ".snap", 2020-11-16T20:55:22.722 INFO:teuthology.orchestra.run.smithi166.stdout: "client_tick_interval": "1", 2020-11-16T20:55:22.723 INFO:teuthology.orchestra.run.smithi166.stdout: "client_trace": "", 2020-11-16T20:55:22.723 INFO:teuthology.orchestra.run.smithi166.stdout: "client_try_dentry_invalidate": "false", 2020-11-16T20:55:22.723 INFO:teuthology.orchestra.run.smithi166.stdout: "client_use_faked_inos": "false", 2020-11-16T20:55:22.723 INFO:teuthology.orchestra.run.smithi166.stdout: "client_use_random_mds": "false", 2020-11-16T20:55:22.723 INFO:teuthology.orchestra.run.smithi166.stdout: "clog_to_graylog": "false", 2020-11-16T20:55:22.723 INFO:teuthology.orchestra.run.smithi166.stdout: "clog_to_graylog_host": "127.0.0.1", 2020-11-16T20:55:22.723 INFO:teuthology.orchestra.run.smithi166.stdout: "clog_to_graylog_port": "12201", 2020-11-16T20:55:22.724 INFO:teuthology.orchestra.run.smithi166.stdout: "clog_to_monitors": "default=true", 2020-11-16T20:55:22.724 INFO:teuthology.orchestra.run.smithi166.stdout: "clog_to_syslog": "false", 2020-11-16T20:55:22.724 INFO:teuthology.orchestra.run.smithi166.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2020-11-16T20:55:22.724 INFO:teuthology.orchestra.run.smithi166.stdout: "clog_to_syslog_level": "info", 2020-11-16T20:55:22.724 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "-", 2020-11-16T20:55:22.724 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_network": "", 2020-11-16T20:55:22.724 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_network_interface": "", 2020-11-16T20:55:22.724 INFO:teuthology.orchestra.run.smithi166.stdout: "compressor_zlib_isal": "false", 2020-11-16T20:55:22.725 INFO:teuthology.orchestra.run.smithi166.stdout: "compressor_zlib_level": "5", 2020-11-16T20:55:22.725 INFO:teuthology.orchestra.run.smithi166.stdout: "compressor_zlib_winsize": "-15", 2020-11-16T20:55:22.725 INFO:teuthology.orchestra.run.smithi166.stdout: "compressor_zstd_level": "1", 2020-11-16T20:55:22.725 INFO:teuthology.orchestra.run.smithi166.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2020-11-16T20:55:22.725 INFO:teuthology.orchestra.run.smithi166.stdout: "crash_dir": "/var/lib/ceph/crash", 2020-11-16T20:55:22.725 INFO:teuthology.orchestra.run.smithi166.stdout: "crimson_osd_obc_lru_size": "10", 2020-11-16T20:55:22.725 INFO:teuthology.orchestra.run.smithi166.stdout: "crimson_osd_scheduler_concurrency": "0", 2020-11-16T20:55:22.726 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_location": "", 2020-11-16T20:55:22.726 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_location_hook": "", 2020-11-16T20:55:22.726 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_location_hook_timeout": "10", 2020-11-16T20:55:22.726 INFO:teuthology.orchestra.run.smithi166.stdout: "daemonize": "false", 2020-11-16T20:55:22.726 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_allow_any_pool_priority": "false", 2020-11-16T20:55:22.726 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_asok": "1/5", 2020-11-16T20:55:22.726 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_asok_assert_abort": "false", 2020-11-16T20:55:22.727 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_asserts_on_shutdown": "true", 2020-11-16T20:55:22.727 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_auth": "20/20", 2020-11-16T20:55:22.727 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_bdev": "1/3", 2020-11-16T20:55:22.727 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_bluefs": "1/5", 2020-11-16T20:55:22.727 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_bluestore": "1/5", 2020-11-16T20:55:22.727 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_buffer": "0/1", 2020-11-16T20:55:22.728 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_cephfs_mirror": "20/20", 2020-11-16T20:55:22.728 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_civetweb": "1/10", 2020-11-16T20:55:22.728 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_client": "0/5", 2020-11-16T20:55:22.728 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_compressor": "1/5", 2020-11-16T20:55:22.728 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_context": "0/1", 2020-11-16T20:55:22.728 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_crush": "1/1", 2020-11-16T20:55:22.728 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_crypto": "1/5", 2020-11-16T20:55:22.728 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_deliberately_leak_memory": "false", 2020-11-16T20:55:22.729 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_disable_randomized_ping": "false", 2020-11-16T20:55:22.729 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_dpdk": "1/5", 2020-11-16T20:55:22.729 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_eventtrace": "1/5", 2020-11-16T20:55:22.729 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_filer": "0/1", 2020-11-16T20:55:22.729 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_filestore": "1/3", 2020-11-16T20:55:22.729 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_finisher": "1/1", 2020-11-16T20:55:22.729 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_fuse": "1/5", 2020-11-16T20:55:22.730 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_heartbeat_testing_span": "0", 2020-11-16T20:55:22.730 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_heartbeatmap": "1/5", 2020-11-16T20:55:22.730 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_immutable_obj_cache": "0/5", 2020-11-16T20:55:22.730 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_javaclient": "1/5", 2020-11-16T20:55:22.730 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_journal": "1/3", 2020-11-16T20:55:22.730 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_journaler": "0/5", 2020-11-16T20:55:22.730 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_kstore": "1/5", 2020-11-16T20:55:22.731 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_leveldb": "4/5", 2020-11-16T20:55:22.731 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_lockdep": "0/1", 2020-11-16T20:55:22.731 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_mds": "1/5", 2020-11-16T20:55:22.731 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_mds_balancer": "1/5", 2020-11-16T20:55:22.731 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_mds_locker": "1/5", 2020-11-16T20:55:22.731 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_mds_log": "1/5", 2020-11-16T20:55:22.731 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_mds_log_expire": "1/5", 2020-11-16T20:55:22.731 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_mds_migrator": "1/5", 2020-11-16T20:55:22.732 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_memdb": "4/5", 2020-11-16T20:55:22.732 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_mgr": "1/5", 2020-11-16T20:55:22.732 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_mgrc": "1/5", 2020-11-16T20:55:22.732 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_mon": "20/20", 2020-11-16T20:55:22.732 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_monc": "0/10", 2020-11-16T20:55:22.732 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_ms": "1/1", 2020-11-16T20:55:22.732 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_none": "0/5", 2020-11-16T20:55:22.733 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_objclass": "0/5", 2020-11-16T20:55:22.733 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_objectcacher": "0/5", 2020-11-16T20:55:22.733 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_objecter": "0/1", 2020-11-16T20:55:22.733 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_optracker": "0/5", 2020-11-16T20:55:22.733 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_osd": "1/5", 2020-11-16T20:55:22.733 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_paxos": "20/20", 2020-11-16T20:55:22.733 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_perfcounter": "1/5", 2020-11-16T20:55:22.733 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_prioritycache": "1/5", 2020-11-16T20:55:22.734 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_rados": "0/5", 2020-11-16T20:55:22.734 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_rbd": "0/5", 2020-11-16T20:55:22.734 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_rbd_mirror": "0/5", 2020-11-16T20:55:22.734 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_rbd_pwl": "0/5", 2020-11-16T20:55:22.734 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_rbd_replay": "0/5", 2020-11-16T20:55:22.734 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_refs": "0/0", 2020-11-16T20:55:22.734 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_reserver": "1/1", 2020-11-16T20:55:22.735 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_rgw": "1/5", 2020-11-16T20:55:22.735 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_rgw_sync": "1/5", 2020-11-16T20:55:22.735 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_rocksdb": "4/5", 2020-11-16T20:55:22.735 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_striper": "0/1", 2020-11-16T20:55:22.735 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_test": "0/5", 2020-11-16T20:55:22.735 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_throttle": "1/1", 2020-11-16T20:55:22.735 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_timer": "0/1", 2020-11-16T20:55:22.735 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_tp": "0/5", 2020-11-16T20:55:22.736 INFO:teuthology.orchestra.run.smithi166.stdout: "debug_version_for_testing": "", 2020-11-16T20:55:22.736 INFO:teuthology.orchestra.run.smithi166.stdout: "device_failure_prediction_mode": "none", 2020-11-16T20:55:22.736 INFO:teuthology.orchestra.run.smithi166.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2020-11-16T20:55:22.736 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2020-11-16T20:55:22.736 INFO:teuthology.orchestra.run.smithi166.stdout: "err_to_graylog": "false", 2020-11-16T20:55:22.736 INFO:teuthology.orchestra.run.smithi166.stdout: "err_to_stderr": "true", 2020-11-16T20:55:22.736 INFO:teuthology.orchestra.run.smithi166.stdout: "err_to_syslog": "false", 2020-11-16T20:55:22.737 INFO:teuthology.orchestra.run.smithi166.stdout: "event_tracing": "false", 2020-11-16T20:55:22.737 INFO:teuthology.orchestra.run.smithi166.stdout: "fake_statfs_for_testing": "0", 2020-11-16T20:55:22.737 INFO:teuthology.orchestra.run.smithi166.stdout: "fatal_signal_handlers": "true", 2020-11-16T20:55:22.737 INFO:teuthology.orchestra.run.smithi166.stdout: "filer_max_purge_ops": "10", 2020-11-16T20:55:22.737 INFO:teuthology.orchestra.run.smithi166.stdout: "filer_max_truncate_ops": "128", 2020-11-16T20:55:22.737 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_apply_finisher_threads": "1", 2020-11-16T20:55:22.737 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_blackhole": "false", 2020-11-16T20:55:22.737 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_btrfs_clone_range": "true", 2020-11-16T20:55:22.738 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_btrfs_snap": "true", 2020-11-16T20:55:22.738 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_caller_concurrency": "10", 2020-11-16T20:55:22.738 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_collect_device_partition_information": "true", 2020-11-16T20:55:22.738 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_commit_timeout": "600.000000", 2020-11-16T20:55:22.738 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_debug_inject_read_err": "false", 2020-11-16T20:55:22.738 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_debug_omap_check": "false", 2020-11-16T20:55:22.738 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_debug_random_read_err": "0.000000", 2020-11-16T20:55:22.739 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_debug_verify_split": "false", 2020-11-16T20:55:22.739 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_dump_file": "", 2020-11-16T20:55:22.739 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2020-11-16T20:55:22.739 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_expected_throughput_ops": "200.000000", 2020-11-16T20:55:22.739 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_fadvise": "true", 2020-11-16T20:55:22.739 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_fail_eio": "true", 2020-11-16T20:55:22.739 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_fd_cache_shards": "16", 2020-11-16T20:55:22.739 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_fd_cache_size": "128", 2020-11-16T20:55:22.740 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_fiemap": "false", 2020-11-16T20:55:22.740 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_fiemap_threshold": "4096", 2020-11-16T20:55:22.740 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_fsync_flushes_journal_data": "false", 2020-11-16T20:55:22.740 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_index_retry_probability": "0.000000", 2020-11-16T20:55:22.740 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_inject_stall": "0", 2020-11-16T20:55:22.740 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_journal_parallel": "false", 2020-11-16T20:55:22.740 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_journal_trailing": "false", 2020-11-16T20:55:22.740 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_journal_writeahead": "false", 2020-11-16T20:55:22.741 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_kill_at": "0", 2020-11-16T20:55:22.741 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_max_alloc_hint_size": "1048576", 2020-11-16T20:55:22.741 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_max_inline_xattr_size": "0", 2020-11-16T20:55:22.741 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2020-11-16T20:55:22.741 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_max_inline_xattr_size_other": "512", 2020-11-16T20:55:22.741 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2020-11-16T20:55:22.741 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_max_inline_xattrs": "0", 2020-11-16T20:55:22.742 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2020-11-16T20:55:22.742 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_max_inline_xattrs_other": "2", 2020-11-16T20:55:22.742 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_max_inline_xattrs_xfs": "10", 2020-11-16T20:55:22.742 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_max_sync_interval": "5.000000", 2020-11-16T20:55:22.742 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_max_xattr_value_size": "0", 2020-11-16T20:55:22.742 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2020-11-16T20:55:22.742 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_max_xattr_value_size_other": "1024", 2020-11-16T20:55:22.742 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2020-11-16T20:55:22.743 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_merge_threshold": "-10", 2020-11-16T20:55:22.743 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_min_sync_interval": "0.010000", 2020-11-16T20:55:22.743 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_odsync_write": "false", 2020-11-16T20:55:22.743 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_omap_backend": "rocksdb", 2020-11-16T20:55:22.743 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_omap_backend_path": "", 2020-11-16T20:55:22.743 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_omap_header_cache_size": "1024", 2020-11-16T20:55:22.743 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_ondisk_finisher_threads": "1", 2020-11-16T20:55:22.744 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_op_thread_suicide_timeout": "180", 2020-11-16T20:55:22.744 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_op_thread_timeout": "60", 2020-11-16T20:55:22.744 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_op_threads": "2", 2020-11-16T20:55:22.744 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_punch_hole": "false", 2020-11-16T20:55:22.744 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2020-11-16T20:55:22.744 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2020-11-16T20:55:22.744 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2020-11-16T20:55:22.744 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_queue_high_threshhold": "0.900000", 2020-11-16T20:55:22.745 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_queue_low_threshhold": "0.300000", 2020-11-16T20:55:22.745 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_queue_max_bytes": "104857600", 2020-11-16T20:55:22.745 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2020-11-16T20:55:22.745 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2020-11-16T20:55:22.745 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2020-11-16T20:55:22.745 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_queue_max_ops": "50", 2020-11-16T20:55:22.745 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2020-11-16T20:55:22.746 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_seek_data_hole": "false", 2020-11-16T20:55:22.746 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_sloppy_crc": "false", 2020-11-16T20:55:22.746 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_sloppy_crc_block_size": "65536", 2020-11-16T20:55:22.746 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_splice": "false", 2020-11-16T20:55:22.746 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_split_multiple": "2", 2020-11-16T20:55:22.746 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_split_rand_factor": "20", 2020-11-16T20:55:22.746 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_update_to": "1000", 2020-11-16T20:55:22.747 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2020-11-16T20:55:22.747 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2020-11-16T20:55:22.747 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2020-11-16T20:55:22.747 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2020-11-16T20:55:22.747 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2020-11-16T20:55:22.747 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2020-11-16T20:55:22.747 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_wbthrottle_enable": "true", 2020-11-16T20:55:22.747 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2020-11-16T20:55:22.748 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2020-11-16T20:55:22.748 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2020-11-16T20:55:22.748 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2020-11-16T20:55:22.748 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2020-11-16T20:55:22.748 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2020-11-16T20:55:22.748 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_xfs_extsize": "false", 2020-11-16T20:55:22.748 INFO:teuthology.orchestra.run.smithi166.stdout: "filestore_zfs_snap": "false", 2020-11-16T20:55:22.749 INFO:teuthology.orchestra.run.smithi166.stdout: "fio_dir": "/tmp/fio", 2020-11-16T20:55:22.749 INFO:teuthology.orchestra.run.smithi166.stdout: "fsid": "a14fd848-4cfe-4cd9-9140-5b3c4b4e904d", 2020-11-16T20:55:22.749 INFO:teuthology.orchestra.run.smithi166.stdout: "fuse_allow_other": "true", 2020-11-16T20:55:22.749 INFO:teuthology.orchestra.run.smithi166.stdout: "fuse_atomic_o_trunc": "true", 2020-11-16T20:55:22.749 INFO:teuthology.orchestra.run.smithi166.stdout: "fuse_big_writes": "true", 2020-11-16T20:55:22.749 INFO:teuthology.orchestra.run.smithi166.stdout: "fuse_debug": "false", 2020-11-16T20:55:22.749 INFO:teuthology.orchestra.run.smithi166.stdout: "fuse_default_permissions": "false", 2020-11-16T20:55:22.749 INFO:teuthology.orchestra.run.smithi166.stdout: "fuse_disable_pagecache": "false", 2020-11-16T20:55:22.750 INFO:teuthology.orchestra.run.smithi166.stdout: "fuse_max_write": "0", 2020-11-16T20:55:22.750 INFO:teuthology.orchestra.run.smithi166.stdout: "fuse_multithreaded": "true", 2020-11-16T20:55:22.750 INFO:teuthology.orchestra.run.smithi166.stdout: "fuse_require_active_mds": "true", 2020-11-16T20:55:22.750 INFO:teuthology.orchestra.run.smithi166.stdout: "fuse_set_user_groups": "true", 2020-11-16T20:55:22.750 INFO:teuthology.orchestra.run.smithi166.stdout: "fuse_splice_move": "true", 2020-11-16T20:55:22.750 INFO:teuthology.orchestra.run.smithi166.stdout: "fuse_splice_read": "true", 2020-11-16T20:55:22.750 INFO:teuthology.orchestra.run.smithi166.stdout: "fuse_splice_write": "true", 2020-11-16T20:55:22.751 INFO:teuthology.orchestra.run.smithi166.stdout: "fuse_syncfs_on_mksnap": "true", 2020-11-16T20:55:22.751 INFO:teuthology.orchestra.run.smithi166.stdout: "fuse_use_invalidate_cb": "true", 2020-11-16T20:55:22.751 INFO:teuthology.orchestra.run.smithi166.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2020-11-16T20:55:22.751 INFO:teuthology.orchestra.run.smithi166.stdout: "gss_target_name": "ceph", 2020-11-16T20:55:22.751 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_file": "", 2020-11-16T20:55:22.751 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_inject_failure": "0", 2020-11-16T20:55:22.751 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_interval": "5", 2020-11-16T20:55:22.752 INFO:teuthology.orchestra.run.smithi166.stdout: "host": "", 2020-11-16T20:55:22.752 INFO:teuthology.orchestra.run.smithi166.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2020-11-16T20:55:22.752 INFO:teuthology.orchestra.run.smithi166.stdout: "immutable_object_cache_max_inflight_ops": "128", 2020-11-16T20:55:22.752 INFO:teuthology.orchestra.run.smithi166.stdout: "immutable_object_cache_max_size": "1073741824", 2020-11-16T20:55:22.752 INFO:teuthology.orchestra.run.smithi166.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2020-11-16T20:55:22.752 INFO:teuthology.orchestra.run.smithi166.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2020-11-16T20:55:22.752 INFO:teuthology.orchestra.run.smithi166.stdout: "immutable_object_cache_watermark": "0.100000", 2020-11-16T20:55:22.752 INFO:teuthology.orchestra.run.smithi166.stdout: "inject_early_sigterm": "false", 2020-11-16T20:55:22.753 INFO:teuthology.orchestra.run.smithi166.stdout: "journal_aio": "true", 2020-11-16T20:55:22.753 INFO:teuthology.orchestra.run.smithi166.stdout: "journal_align_min_size": "65536", 2020-11-16T20:55:22.753 INFO:teuthology.orchestra.run.smithi166.stdout: "journal_block_align": "true", 2020-11-16T20:55:22.753 INFO:teuthology.orchestra.run.smithi166.stdout: "journal_block_size": "4096", 2020-11-16T20:55:22.753 INFO:teuthology.orchestra.run.smithi166.stdout: "journal_dio": "true", 2020-11-16T20:55:22.753 INFO:teuthology.orchestra.run.smithi166.stdout: "journal_discard": "false", 2020-11-16T20:55:22.753 INFO:teuthology.orchestra.run.smithi166.stdout: "journal_force_aio": "false", 2020-11-16T20:55:22.754 INFO:teuthology.orchestra.run.smithi166.stdout: "journal_ignore_corruption": "false", 2020-11-16T20:55:22.754 INFO:teuthology.orchestra.run.smithi166.stdout: "journal_max_write_bytes": "10485760", 2020-11-16T20:55:22.754 INFO:teuthology.orchestra.run.smithi166.stdout: "journal_max_write_entries": "100", 2020-11-16T20:55:22.754 INFO:teuthology.orchestra.run.smithi166.stdout: "journal_replay_from": "0", 2020-11-16T20:55:22.754 INFO:teuthology.orchestra.run.smithi166.stdout: "journal_throttle_high_multiple": "0.000000", 2020-11-16T20:55:22.754 INFO:teuthology.orchestra.run.smithi166.stdout: "journal_throttle_high_threshhold": "0.900000", 2020-11-16T20:55:22.754 INFO:teuthology.orchestra.run.smithi166.stdout: "journal_throttle_low_threshhold": "0.600000", 2020-11-16T20:55:22.754 INFO:teuthology.orchestra.run.smithi166.stdout: "journal_throttle_max_multiple": "0.000000", 2020-11-16T20:55:22.755 INFO:teuthology.orchestra.run.smithi166.stdout: "journal_write_header_frequency": "0", 2020-11-16T20:55:22.755 INFO:teuthology.orchestra.run.smithi166.stdout: "journal_zero_on_create": "false", 2020-11-16T20:55:22.755 INFO:teuthology.orchestra.run.smithi166.stdout: "journaler_prefetch_periods": "10", 2020-11-16T20:55:22.755 INFO:teuthology.orchestra.run.smithi166.stdout: "journaler_prezero_periods": "5", 2020-11-16T20:55:22.755 INFO:teuthology.orchestra.run.smithi166.stdout: "journaler_write_head_interval": "15", 2020-11-16T20:55:22.755 INFO:teuthology.orchestra.run.smithi166.stdout: "key": "", 2020-11-16T20:55:22.755 INFO:teuthology.orchestra.run.smithi166.stdout: "keyfile": "", 2020-11-16T20:55:22.756 INFO:teuthology.orchestra.run.smithi166.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2020-11-16T20:55:22.756 INFO:teuthology.orchestra.run.smithi166.stdout: "kstore_backend": "rocksdb", 2020-11-16T20:55:22.756 INFO:teuthology.orchestra.run.smithi166.stdout: "kstore_default_stripe_size": "65536", 2020-11-16T20:55:22.756 INFO:teuthology.orchestra.run.smithi166.stdout: "kstore_fsck_on_mount": "false", 2020-11-16T20:55:22.756 INFO:teuthology.orchestra.run.smithi166.stdout: "kstore_fsck_on_mount_deep": "true", 2020-11-16T20:55:22.756 INFO:teuthology.orchestra.run.smithi166.stdout: "kstore_max_bytes": "67108864", 2020-11-16T20:55:22.756 INFO:teuthology.orchestra.run.smithi166.stdout: "kstore_max_ops": "512", 2020-11-16T20:55:22.756 INFO:teuthology.orchestra.run.smithi166.stdout: "kstore_nid_prealloc": "1024", 2020-11-16T20:55:22.757 INFO:teuthology.orchestra.run.smithi166.stdout: "kstore_onode_map_size": "1024", 2020-11-16T20:55:22.757 INFO:teuthology.orchestra.run.smithi166.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2020-11-16T20:55:22.757 INFO:teuthology.orchestra.run.smithi166.stdout: "kstore_sync_submit_transaction": "false", 2020-11-16T20:55:22.757 INFO:teuthology.orchestra.run.smithi166.stdout: "kstore_sync_transaction": "false", 2020-11-16T20:55:22.757 INFO:teuthology.orchestra.run.smithi166.stdout: "leveldb_block_size": "65536", 2020-11-16T20:55:22.757 INFO:teuthology.orchestra.run.smithi166.stdout: "leveldb_bloom_size": "0", 2020-11-16T20:55:22.757 INFO:teuthology.orchestra.run.smithi166.stdout: "leveldb_cache_size": "536870912", 2020-11-16T20:55:22.758 INFO:teuthology.orchestra.run.smithi166.stdout: "leveldb_compact_on_mount": "false", 2020-11-16T20:55:22.758 INFO:teuthology.orchestra.run.smithi166.stdout: "leveldb_compression": "false", 2020-11-16T20:55:22.758 INFO:teuthology.orchestra.run.smithi166.stdout: "leveldb_log": "", 2020-11-16T20:55:22.758 INFO:teuthology.orchestra.run.smithi166.stdout: "leveldb_log_to_ceph_log": "true", 2020-11-16T20:55:22.758 INFO:teuthology.orchestra.run.smithi166.stdout: "leveldb_max_open_files": "0", 2020-11-16T20:55:22.758 INFO:teuthology.orchestra.run.smithi166.stdout: "leveldb_paranoid": "false", 2020-11-16T20:55:22.758 INFO:teuthology.orchestra.run.smithi166.stdout: "leveldb_write_buffer_size": "33554432", 2020-11-16T20:55:22.758 INFO:teuthology.orchestra.run.smithi166.stdout: "librados_thread_count": "2", 2020-11-16T20:55:22.759 INFO:teuthology.orchestra.run.smithi166.stdout: "lockdep": "false", 2020-11-16T20:55:22.759 INFO:teuthology.orchestra.run.smithi166.stdout: "lockdep_force_backtrace": "false", 2020-11-16T20:55:22.759 INFO:teuthology.orchestra.run.smithi166.stdout: "log_coarse_timestamps": "true", 2020-11-16T20:55:22.759 INFO:teuthology.orchestra.run.smithi166.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2020-11-16T20:55:22.759 INFO:teuthology.orchestra.run.smithi166.stdout: "log_flush_on_exit": "false", 2020-11-16T20:55:22.759 INFO:teuthology.orchestra.run.smithi166.stdout: "log_graylog_host": "127.0.0.1", 2020-11-16T20:55:22.759 INFO:teuthology.orchestra.run.smithi166.stdout: "log_graylog_port": "12201", 2020-11-16T20:55:22.760 INFO:teuthology.orchestra.run.smithi166.stdout: "log_max_new": "1000", 2020-11-16T20:55:22.760 INFO:teuthology.orchestra.run.smithi166.stdout: "log_max_recent": "10000", 2020-11-16T20:55:22.760 INFO:teuthology.orchestra.run.smithi166.stdout: "log_stderr_prefix": "", 2020-11-16T20:55:22.760 INFO:teuthology.orchestra.run.smithi166.stdout: "log_stop_at_utilization": "0.970000", 2020-11-16T20:55:22.760 INFO:teuthology.orchestra.run.smithi166.stdout: "log_to_file": "true", 2020-11-16T20:55:22.760 INFO:teuthology.orchestra.run.smithi166.stdout: "log_to_graylog": "false", 2020-11-16T20:55:22.760 INFO:teuthology.orchestra.run.smithi166.stdout: "log_to_stderr": "false", 2020-11-16T20:55:22.760 INFO:teuthology.orchestra.run.smithi166.stdout: "log_to_syslog": "false", 2020-11-16T20:55:22.761 INFO:teuthology.orchestra.run.smithi166.stdout: "max_rotating_auth_attempts": "10", 2020-11-16T20:55:22.761 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_action_on_write_error": "1", 2020-11-16T20:55:22.761 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_asio_thread_count": "2", 2020-11-16T20:55:22.761 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_export_pin": "true", 2020-11-16T20:55:22.761 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_fragment_dirs": "true", 2020-11-16T20:55:22.761 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2020-11-16T20:55:22.761 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_fragment_interval": "5", 2020-11-16T20:55:22.762 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_fragment_size_max": "100000", 2020-11-16T20:55:22.762 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_idle_threshold": "0.000000", 2020-11-16T20:55:22.762 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_interval": "10", 2020-11-16T20:55:22.762 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_max": "-1", 2020-11-16T20:55:22.762 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_max_until": "-1", 2020-11-16T20:55:22.762 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_merge_size": "50", 2020-11-16T20:55:22.762 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_midchunk": "0.300000", 2020-11-16T20:55:22.762 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_min_rebalance": "0.100000", 2020-11-16T20:55:22.763 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_min_start": "0.200000", 2020-11-16T20:55:22.763 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_minchunk": "0.001000", 2020-11-16T20:55:22.763 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_mode": "0", 2020-11-16T20:55:22.763 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_need_max": "1.200000", 2020-11-16T20:55:22.763 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_need_min": "0.800000", 2020-11-16T20:55:22.763 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_replicate_threshold": "8000.000000", 2020-11-16T20:55:22.763 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_sample_interval": "3.000000", 2020-11-16T20:55:22.764 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_split_bits": "3", 2020-11-16T20:55:22.764 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_split_rd": "25000.000000", 2020-11-16T20:55:22.764 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_split_size": "10000", 2020-11-16T20:55:22.764 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_split_wr": "10000.000000", 2020-11-16T20:55:22.764 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_target_decay": "10.000000", 2020-11-16T20:55:22.764 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2020-11-16T20:55:22.764 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_beacon_grace": "15.000000", 2020-11-16T20:55:22.764 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_beacon_interval": "4.000000", 2020-11-16T20:55:22.765 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_cache_memory_limit": "4294967296", 2020-11-16T20:55:22.765 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_cache_mid": "0.700000", 2020-11-16T20:55:22.765 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_cache_release_free_interval": "10", 2020-11-16T20:55:22.765 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_cache_reservation": "0.050000", 2020-11-16T20:55:22.765 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_cache_trim_decay_rate": "1.000000", 2020-11-16T20:55:22.765 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_cache_trim_interval": "1", 2020-11-16T20:55:22.765 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_cache_trim_threshold": "65536", 2020-11-16T20:55:22.766 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2020-11-16T20:55:22.766 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2020-11-16T20:55:22.766 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_client_delegate_inos_pct": "50", 2020-11-16T20:55:22.766 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_client_prealloc_inos": "1000", 2020-11-16T20:55:22.766 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2020-11-16T20:55:22.766 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_damage_table_max_entries": "10000", 2020-11-16T20:55:22.766 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2020-11-16T20:55:22.766 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_debug_auth_pins": "false", 2020-11-16T20:55:22.767 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_debug_frag": "false", 2020-11-16T20:55:22.767 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_debug_scatterstat": "false", 2020-11-16T20:55:22.767 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_debug_subtrees": "false", 2020-11-16T20:55:22.767 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_decay_halflife": "5.000000", 2020-11-16T20:55:22.767 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_default_dir_hash": "2", 2020-11-16T20:55:22.767 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_defer_session_stale": "true", 2020-11-16T20:55:22.767 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_deny_all_reconnect": "false", 2020-11-16T20:55:22.768 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_dir_keys_per_op": "16384", 2020-11-16T20:55:22.768 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_dir_max_commit_size": "10", 2020-11-16T20:55:22.768 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_dirstat_min_interval": "1.000000", 2020-11-16T20:55:22.768 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_dump_cache_after_rejoin": "false", 2020-11-16T20:55:22.768 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_dump_cache_on_map": "false", 2020-11-16T20:55:22.768 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_dump_cache_threshold_file": "0", 2020-11-16T20:55:22.768 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2020-11-16T20:55:22.768 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_early_reply": "true", 2020-11-16T20:55:22.769 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_enable_op_tracker": "true", 2020-11-16T20:55:22.769 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_enforce_unique_name": "true", 2020-11-16T20:55:22.769 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_export_ephemeral_distributed": "true", 2020-11-16T20:55:22.769 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2020-11-16T20:55:22.769 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_export_ephemeral_random": "true", 2020-11-16T20:55:22.769 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_export_ephemeral_random_max": "0.010000", 2020-11-16T20:55:22.769 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_forward_all_requests_to_auth": "false", 2020-11-16T20:55:22.770 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_freeze_tree_timeout": "30.000000", 2020-11-16T20:55:22.770 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2020-11-16T20:55:22.770 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_health_cache_threshold": "1.500000", 2020-11-16T20:55:22.770 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_health_summarize_threshold": "10", 2020-11-16T20:55:22.770 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_heartbeat_grace": "15.000000", 2020-11-16T20:55:22.770 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_inject_migrator_session_race": "false", 2020-11-16T20:55:22.770 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2020-11-16T20:55:22.770 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_join_fs": "", 2020-11-16T20:55:22.771 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_journal_format": "1", 2020-11-16T20:55:22.771 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_kill_create_at": "0", 2020-11-16T20:55:22.771 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_kill_export_at": "0", 2020-11-16T20:55:22.771 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_kill_import_at": "0", 2020-11-16T20:55:22.771 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_kill_journal_at": "0", 2020-11-16T20:55:22.771 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_kill_journal_expire_at": "0", 2020-11-16T20:55:22.771 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_kill_journal_replay_at": "0", 2020-11-16T20:55:22.772 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_kill_link_at": "0", 2020-11-16T20:55:22.772 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_kill_mdstable_at": "0", 2020-11-16T20:55:22.772 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_kill_openc_at": "0", 2020-11-16T20:55:22.772 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_kill_rename_at": "0", 2020-11-16T20:55:22.772 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_log_events_per_segment": "1024", 2020-11-16T20:55:22.772 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_log_max_events": "-1", 2020-11-16T20:55:22.772 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_log_max_segments": "128", 2020-11-16T20:55:22.772 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_log_pause": "false", 2020-11-16T20:55:22.773 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_log_segment_size": "0", 2020-11-16T20:55:22.773 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_log_skip_corrupt_events": "false", 2020-11-16T20:55:22.773 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_log_warn_factor": "2.000000", 2020-11-16T20:55:22.773 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_max_caps_per_client": "1048576", 2020-11-16T20:55:22.773 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_max_completed_flushes": "100000", 2020-11-16T20:55:22.773 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_max_completed_requests": "100000", 2020-11-16T20:55:22.773 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_max_export_size": "20971520", 2020-11-16T20:55:22.774 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_max_file_recover": "32", 2020-11-16T20:55:22.774 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_max_purge_files": "64", 2020-11-16T20:55:22.774 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_max_purge_ops": "8192", 2020-11-16T20:55:22.774 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2020-11-16T20:55:22.774 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_max_retries_on_remount_failure": "5", 2020-11-16T20:55:22.774 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_max_scrub_ops_in_progress": "5", 2020-11-16T20:55:22.774 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_max_snaps_per_dir": "100", 2020-11-16T20:55:22.774 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_max_xattr_pairs_size": "65536", 2020-11-16T20:55:22.775 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_metrics_update_interval": "2", 2020-11-16T20:55:22.775 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_min_caps_per_client": "100", 2020-11-16T20:55:22.775 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_min_caps_working_set": "10000", 2020-11-16T20:55:22.775 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_mon_shutdown_timeout": "5.000000", 2020-11-16T20:55:22.775 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_numa_node": "-1", 2020-11-16T20:55:22.775 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_oft_prefetch_dirfrags": "true", 2020-11-16T20:55:22.775 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_op_complaint_time": "30.000000", 2020-11-16T20:55:22.776 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_op_history_duration": "600", 2020-11-16T20:55:22.776 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_op_history_size": "20", 2020-11-16T20:55:22.776 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_op_log_threshold": "5", 2020-11-16T20:55:22.776 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_ping_grace": "15", 2020-11-16T20:55:22.776 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_ping_interval": "5", 2020-11-16T20:55:22.776 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2020-11-16T20:55:22.776 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_recall_global_max_decay_threshold": "65536", 2020-11-16T20:55:22.776 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_recall_max_caps": "5000", 2020-11-16T20:55:22.777 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_recall_max_decay_rate": "2.500000", 2020-11-16T20:55:22.777 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_recall_max_decay_threshold": "16384", 2020-11-16T20:55:22.777 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_recall_warning_decay_rate": "60.000000", 2020-11-16T20:55:22.777 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_recall_warning_threshold": "32768", 2020-11-16T20:55:22.777 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_reconnect_timeout": "45.000000", 2020-11-16T20:55:22.777 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_replay_interval": "1.000000", 2020-11-16T20:55:22.777 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_replay_unsafe_with_closed_session": "false", 2020-11-16T20:55:22.778 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_request_load_average_decay_rate": "60.000000", 2020-11-16T20:55:22.778 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_root_ino_gid": "0", 2020-11-16T20:55:22.778 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_root_ino_uid": "0", 2020-11-16T20:55:22.778 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_scatter_nudge_interval": "5.000000", 2020-11-16T20:55:22.778 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_session_blocklist_on_evict": "true", 2020-11-16T20:55:22.778 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_session_blocklist_on_timeout": "true", 2020-11-16T20:55:22.778 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2020-11-16T20:55:22.779 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_session_cache_liveness_magnitude": "10", 2020-11-16T20:55:22.779 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_session_cap_acquisition_decay_rate": "10.000000", 2020-11-16T20:55:22.779 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_session_cap_acquisition_throttle": "500000", 2020-11-16T20:55:22.779 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2020-11-16T20:55:22.779 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_sessionmap_keys_per_op": "1024", 2020-11-16T20:55:22.779 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_shutdown_check": "0", 2020-11-16T20:55:22.779 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_skip_ino": "0", 2020-11-16T20:55:22.779 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_snap_max_uid": "4294967294", 2020-11-16T20:55:22.780 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_snap_min_uid": "0", 2020-11-16T20:55:22.780 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_snap_rstat": "false", 2020-11-16T20:55:22.780 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_task_status_update_interval": "2.000000", 2020-11-16T20:55:22.780 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_thrash_exports": "0", 2020-11-16T20:55:22.780 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_thrash_fragments": "0", 2020-11-16T20:55:22.780 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_tick_interval": "5.000000", 2020-11-16T20:55:22.780 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_verify_backtrace": "1", 2020-11-16T20:55:22.781 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_verify_scatter": "false", 2020-11-16T20:55:22.781 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_wipe_ino_prealloc": "false", 2020-11-16T20:55:22.781 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_wipe_sessions": "false", 2020-11-16T20:55:22.781 INFO:teuthology.orchestra.run.smithi166.stdout: "mempool_debug": "false", 2020-11-16T20:55:22.781 INFO:teuthology.orchestra.run.smithi166.stdout: "memstore_debug_omit_block_device_write": "false", 2020-11-16T20:55:22.781 INFO:teuthology.orchestra.run.smithi166.stdout: "memstore_device_bytes": "1073741824", 2020-11-16T20:55:22.781 INFO:teuthology.orchestra.run.smithi166.stdout: "memstore_page_set": "false", 2020-11-16T20:55:22.781 INFO:teuthology.orchestra.run.smithi166.stdout: "memstore_page_size": "65536", 2020-11-16T20:55:22.782 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_client_bytes": "134217728", 2020-11-16T20:55:22.782 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_client_messages": "512", 2020-11-16T20:55:22.782 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2020-11-16T20:55:22.782 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_connect_retry_interval": "1.000000", 2020-11-16T20:55:22.782 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2020-11-16T20:55:22.782 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2020-11-16T20:55:22.782 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_disabled_modules": "", 2020-11-16T20:55:22.783 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_initial_modules": "restful iostat", 2020-11-16T20:55:22.783 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_mds_bytes": "134217728", 2020-11-16T20:55:22.783 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_mds_messages": "128", 2020-11-16T20:55:22.783 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2020-11-16T20:55:22.783 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_mon_bytes": "134217728", 2020-11-16T20:55:22.783 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_mon_messages": "128", 2020-11-16T20:55:22.783 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_osd_bytes": "536870912", 2020-11-16T20:55:22.783 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_osd_messages": "8192", 2020-11-16T20:55:22.784 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_service_beacon_grace": "60.000000", 2020-11-16T20:55:22.784 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_stats_period": "5", 2020-11-16T20:55:22.784 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_stats_threshold": "5", 2020-11-16T20:55:22.784 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_tick_period": "2", 2020-11-16T20:55:22.784 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_accept_timeout_factor": "2.000000", 2020-11-16T20:55:22.784 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_allow_pool_delete": "true", 2020-11-16T20:55:22.784 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_allow_pool_size_one": "true", 2020-11-16T20:55:22.784 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_auth_validate_all_caps": "true", 2020-11-16T20:55:22.785 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2020-11-16T20:55:22.785 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2020-11-16T20:55:22.785 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_client_bytes": "104857600", 2020-11-16T20:55:22.785 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_client_directed_command_retry": "5", 2020-11-16T20:55:22.785 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_client_hunt_interval": "3.000000", 2020-11-16T20:55:22.785 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2020-11-16T20:55:22.785 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2020-11-16T20:55:22.786 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2020-11-16T20:55:22.786 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_client_hunt_parallel": "3", 2020-11-16T20:55:22.786 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_client_log_interval": "1.000000", 2020-11-16T20:55:22.786 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_client_max_log_entries_per_message": "1000", 2020-11-16T20:55:22.786 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_client_ping_interval": "10.000000", 2020-11-16T20:55:22.786 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_client_ping_timeout": "30.000000", 2020-11-16T20:55:22.786 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_clock_drift_allowed": "1.000000", 2020-11-16T20:55:22.787 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2020-11-16T20:55:22.787 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2020-11-16T20:55:22.787 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_cluster_log_file_level": "debug", 2020-11-16T20:55:22.787 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_cluster_log_to_file": "true", 2020-11-16T20:55:22.787 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_cluster_log_to_graylog": "false", 2020-11-16T20:55:22.787 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2020-11-16T20:55:22.787 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_cluster_log_to_graylog_port": "12201", 2020-11-16T20:55:22.787 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_cluster_log_to_stderr": "false", 2020-11-16T20:55:22.788 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_cluster_log_to_syslog": "default=false", 2020-11-16T20:55:22.788 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2020-11-16T20:55:22.788 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_cluster_log_to_syslog_level": "info", 2020-11-16T20:55:22.788 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_compact_on_bootstrap": "false", 2020-11-16T20:55:22.788 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_compact_on_start": "false", 2020-11-16T20:55:22.788 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_compact_on_trim": "true", 2020-11-16T20:55:22.788 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_con_tracker_persist_interval": "10", 2020-11-16T20:55:22.789 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_con_tracker_score_halflife": "43200", 2020-11-16T20:55:22.789 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_config_key_max_entry_size": "65536", 2020-11-16T20:55:22.789 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_cpu_threads": "4", 2020-11-16T20:55:22.789 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_crush_min_required_version": "hammer", 2020-11-16T20:55:22.789 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_daemon_bytes": "419430400", 2020-11-16T20:55:22.789 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2020-11-16T20:55:22.789 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_data_avail_crit": "5", 2020-11-16T20:55:22.789 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_data_avail_warn": "5", 2020-11-16T20:55:22.790 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_data_size_warn": "16106127360", 2020-11-16T20:55:22.790 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_debug_block_osdmap_trim": "false", 2020-11-16T20:55:22.790 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_debug_deprecated_as_obsolete": "false", 2020-11-16T20:55:22.790 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_debug_dump_json": "false", 2020-11-16T20:55:22.790 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2020-11-16T20:55:22.790 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_debug_dump_transactions": "false", 2020-11-16T20:55:22.790 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_debug_extra_checks": "false", 2020-11-16T20:55:22.791 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_debug_no_initial_persistent_features": "false", 2020-11-16T20:55:22.791 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2020-11-16T20:55:22.791 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_debug_no_require_octopus": "false", 2020-11-16T20:55:22.791 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_debug_no_require_pacific": "false", 2020-11-16T20:55:22.791 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2020-11-16T20:55:22.791 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_delta_reset_interval": "10.000000", 2020-11-16T20:55:22.791 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_dns_srv_name": "ceph-mon", 2020-11-16T20:55:22.791 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_election_default_strategy": "3", 2020-11-16T20:55:22.792 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_election_timeout": "5.000000", 2020-11-16T20:55:22.792 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2020-11-16T20:55:22.792 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_elector_ping_divisor": "2", 2020-11-16T20:55:22.792 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_elector_ping_timeout": "2.000000", 2020-11-16T20:55:22.792 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_enable_op_tracker": "true", 2020-11-16T20:55:22.792 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_fake_pool_delete": "false", 2020-11-16T20:55:22.792 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_force_quorum_join": "false", 2020-11-16T20:55:22.793 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_globalid_prealloc": "10000", 2020-11-16T20:55:22.793 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_health_detail_to_clog": "false", 2020-11-16T20:55:22.793 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_health_log_update_period": "5", 2020-11-16T20:55:22.793 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_health_max_detail": "50", 2020-11-16T20:55:22.793 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_health_to_clog": "true", 2020-11-16T20:55:22.793 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_health_to_clog_interval": "600", 2020-11-16T20:55:22.793 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2020-11-16T20:55:22.793 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_host": "172.21.15.166,[v2:172.21.15.166:3301,v1:172.21.15.166:6790],172.21.15.59", 2020-11-16T20:55:22.794 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_host_override": "", 2020-11-16T20:55:22.794 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_initial_members": "", 2020-11-16T20:55:22.794 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2020-11-16T20:55:22.794 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2020-11-16T20:55:22.794 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_inject_transaction_delay_max": "10.000000", 2020-11-16T20:55:22.794 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2020-11-16T20:55:22.794 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_keyvaluedb": "rocksdb", 2020-11-16T20:55:22.795 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_lease": "5.000000", 2020-11-16T20:55:22.795 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2020-11-16T20:55:22.795 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_lease_renew_interval_factor": "0.600000", 2020-11-16T20:55:22.795 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_log_max_summary": "50", 2020-11-16T20:55:22.795 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_max_log_entries_per_event": "4096", 2020-11-16T20:55:22.795 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_max_log_epochs": "500", 2020-11-16T20:55:22.795 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_max_mdsmap_epochs": "500", 2020-11-16T20:55:22.795 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_max_mgrmap_epochs": "500", 2020-11-16T20:55:22.796 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_max_osd": "10000", 2020-11-16T20:55:22.796 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_max_pg_per_osd": "10000", 2020-11-16T20:55:22.796 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_max_pool_pg_num": "65536", 2020-11-16T20:55:22.796 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_max_snap_prune_per_epoch": "100", 2020-11-16T20:55:22.796 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_mds_blocklist_interval": "86400.000000", 2020-11-16T20:55:22.796 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_mds_force_trim_to": "0", 2020-11-16T20:55:22.796 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_mds_skip_sanity": "false", 2020-11-16T20:55:22.797 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_memory_autotune": "true", 2020-11-16T20:55:22.797 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_memory_target": "2147483648", 2020-11-16T20:55:22.797 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_mgr_beacon_grace": "30", 2020-11-16T20:55:22.797 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2020-11-16T20:55:22.797 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_mgr_digest_period": "5", 2020-11-16T20:55:22.797 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_mgr_inactive_grace": "60", 2020-11-16T20:55:22.797 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_mgr_mkfs_grace": "240", 2020-11-16T20:55:22.797 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2020-11-16T20:55:22.798 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_min_osdmap_epochs": "50", 2020-11-16T20:55:22.798 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_op_complaint_time": "30", 2020-11-16T20:55:22.798 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_op_history_duration": "600", 2020-11-16T20:55:22.798 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_op_history_size": "20", 2020-11-16T20:55:22.798 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_op_history_slow_op_size": "20", 2020-11-16T20:55:22.798 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_op_history_slow_op_threshold": "10", 2020-11-16T20:55:22.798 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_op_log_threshold": "5", 2020-11-16T20:55:22.799 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_adjust_down_out_interval": "true", 2020-11-16T20:55:22.799 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2020-11-16T20:55:22.799 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2020-11-16T20:55:22.799 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_auto_mark_in": "false", 2020-11-16T20:55:22.799 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_auto_mark_new_in": "true", 2020-11-16T20:55:22.799 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2020-11-16T20:55:22.799 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2020-11-16T20:55:22.799 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_cache_size": "500", 2020-11-16T20:55:22.800 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_cache_size_min": "134217728", 2020-11-16T20:55:22.800 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_crush_smoke_test": "true", 2020-11-16T20:55:22.800 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_destroyed_out_interval": "600", 2020-11-16T20:55:22.800 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_down_out_interval": "600", 2020-11-16T20:55:22.800 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_down_out_subtree_limit": "rack", 2020-11-16T20:55:22.800 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2020-11-16T20:55:22.800 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_force_trim_to": "0", 2020-11-16T20:55:22.801 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_full_ratio": "0.950000", 2020-11-16T20:55:22.801 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2020-11-16T20:55:22.801 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_laggy_halflife": "3600", 2020-11-16T20:55:22.801 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_laggy_max_interval": "300", 2020-11-16T20:55:22.801 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_laggy_weight": "0.300000", 2020-11-16T20:55:22.801 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2020-11-16T20:55:22.801 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_max_creating_pgs": "1024", 2020-11-16T20:55:22.801 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_max_initial_pgs": "1024", 2020-11-16T20:55:22.802 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_min_down_reporters": "2", 2020-11-16T20:55:22.802 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_min_in_ratio": "0.750000", 2020-11-16T20:55:22.802 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_min_up_ratio": "0.300000", 2020-11-16T20:55:22.802 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_nearfull_ratio": "0.850000", 2020-11-16T20:55:22.802 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_prime_pg_temp": "true", 2020-11-16T20:55:22.802 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2020-11-16T20:55:22.802 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2020-11-16T20:55:22.803 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_report_timeout": "900", 2020-11-16T20:55:22.803 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_reporter_subtree_level": "osd", 2020-11-16T20:55:22.803 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2020-11-16T20:55:22.803 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_warn_num_repaired": "10", 2020-11-16T20:55:22.803 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osd_warn_op_age": "32.000000", 2020-11-16T20:55:22.803 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osdmap_full_prune_enabled": "true", 2020-11-16T20:55:22.803 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osdmap_full_prune_interval": "2", 2020-11-16T20:55:22.803 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osdmap_full_prune_min": "15", 2020-11-16T20:55:22.804 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_osdmap_full_prune_txsize": "2", 2020-11-16T20:55:22.804 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2020-11-16T20:55:22.804 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_pg_stuck_threshold": "60", 2020-11-16T20:55:22.804 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2020-11-16T20:55:22.804 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_pg_warn_min_objects": "10000", 2020-11-16T20:55:22.804 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_pg_warn_min_per_osd": "0", 2020-11-16T20:55:22.804 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_pg_warn_min_pool_objects": "1000", 2020-11-16T20:55:22.805 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_pool_quota_crit_threshold": "0", 2020-11-16T20:55:22.805 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_pool_quota_warn_threshold": "0", 2020-11-16T20:55:22.805 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_probe_timeout": "2.000000", 2020-11-16T20:55:22.805 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_reweight_max_change": "0.050000", 2020-11-16T20:55:22.805 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_reweight_max_osds": "4", 2020-11-16T20:55:22.805 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_reweight_min_bytes_per_osd": "10", 2020-11-16T20:55:22.805 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_reweight_min_pgs_per_osd": "4", 2020-11-16T20:55:22.805 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2020-11-16T20:55:22.806 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2020-11-16T20:55:22.806 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2020-11-16T20:55:22.806 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_scrub_interval": "86400", 2020-11-16T20:55:22.806 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_scrub_max_keys": "100", 2020-11-16T20:55:22.806 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_scrub_timeout": "300", 2020-11-16T20:55:22.806 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_session_timeout": "300", 2020-11-16T20:55:22.806 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_smart_report_timeout": "5", 2020-11-16T20:55:22.807 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_stat_smooth_intervals": "6", 2020-11-16T20:55:22.807 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2020-11-16T20:55:22.807 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_stretch_pool_min_size": "2", 2020-11-16T20:55:22.807 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_stretch_pool_size": "4", 2020-11-16T20:55:22.807 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2020-11-16T20:55:22.807 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_subscribe_interval": "86400.000000", 2020-11-16T20:55:22.807 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_sync_debug": "false", 2020-11-16T20:55:22.807 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_sync_max_payload_keys": "2000", 2020-11-16T20:55:22.808 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_sync_max_payload_size": "1048576", 2020-11-16T20:55:22.808 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_sync_provider_kill_at": "0", 2020-11-16T20:55:22.808 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_sync_requester_kill_at": "0", 2020-11-16T20:55:22.808 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_sync_timeout": "60.000000", 2020-11-16T20:55:22.808 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_target_pg_per_osd": "100", 2020-11-16T20:55:22.808 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_tick_interval": "5", 2020-11-16T20:55:22.808 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_timecheck_interval": "300.000000", 2020-11-16T20:55:22.809 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_timecheck_skew_interval": "30.000000", 2020-11-16T20:55:22.809 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_warn_older_version_delay": "604800.000000", 2020-11-16T20:55:22.809 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2020-11-16T20:55:22.809 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2020-11-16T20:55:22.809 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2020-11-16T20:55:22.809 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2020-11-16T20:55:22.809 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_warn_on_misplaced": "false", 2020-11-16T20:55:22.810 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2020-11-16T20:55:22.810 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_warn_on_older_version": "true", 2020-11-16T20:55:22.810 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2020-11-16T20:55:22.810 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_warn_on_pool_no_app": "true", 2020-11-16T20:55:22.810 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_warn_on_pool_no_redundancy": "false", 2020-11-16T20:55:22.810 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2020-11-16T20:55:22.810 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2020-11-16T20:55:22.810 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2020-11-16T20:55:22.811 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_warn_on_too_few_osds": "false", 2020-11-16T20:55:22.811 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2020-11-16T20:55:22.811 INFO:teuthology.orchestra.run.smithi166.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2020-11-16T20:55:22.811 INFO:teuthology.orchestra.run.smithi166.stdout: "monmap": "", 2020-11-16T20:55:22.811 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_async_max_op_threads": "5", 2020-11-16T20:55:22.811 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_async_op_threads": "3", 2020-11-16T20:55:22.811 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_async_rdma_buffer_size": "131072", 2020-11-16T20:55:22.812 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_async_rdma_cm": "false", 2020-11-16T20:55:22.812 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_async_rdma_device_name": "", 2020-11-16T20:55:22.812 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_async_rdma_dscp": "96", 2020-11-16T20:55:22.812 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_async_rdma_enable_hugepage": "false", 2020-11-16T20:55:22.812 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_async_rdma_gid_idx": "0", 2020-11-16T20:55:22.812 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_async_rdma_local_gid": "", 2020-11-16T20:55:22.812 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_async_rdma_polling_us": "1000", 2020-11-16T20:55:22.812 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_async_rdma_port_num": "1", 2020-11-16T20:55:22.813 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_async_rdma_receive_buffers": "32768", 2020-11-16T20:55:22.813 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_async_rdma_receive_queue_len": "4096", 2020-11-16T20:55:22.813 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_async_rdma_roce_ver": "1", 2020-11-16T20:55:22.813 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_async_rdma_send_buffers": "1024", 2020-11-16T20:55:22.813 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_async_rdma_sl": "3", 2020-11-16T20:55:22.813 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_async_rdma_support_srq": "true", 2020-11-16T20:55:22.813 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_async_rdma_type": "ib", 2020-11-16T20:55:22.813 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_bind_before_connect": "false", 2020-11-16T20:55:22.814 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_bind_ipv4": "true", 2020-11-16T20:55:22.814 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_bind_ipv6": "false", 2020-11-16T20:55:22.814 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_bind_msgr1": "false", 2020-11-16T20:55:22.814 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_bind_msgr2": "true", 2020-11-16T20:55:22.814 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_bind_port_max": "7300", 2020-11-16T20:55:22.814 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_bind_port_min": "6800", 2020-11-16T20:55:22.814 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_bind_prefer_ipv4": "false", 2020-11-16T20:55:22.815 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_bind_retry_count": "3", 2020-11-16T20:55:22.815 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_bind_retry_delay": "5", 2020-11-16T20:55:22.815 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_blackhole_client": "false", 2020-11-16T20:55:22.815 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_blackhole_mds": "false", 2020-11-16T20:55:22.815 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_blackhole_mgr": "false", 2020-11-16T20:55:22.815 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_blackhole_mon": "false", 2020-11-16T20:55:22.815 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_blackhole_osd": "false", 2020-11-16T20:55:22.816 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_client_mode": "crc secure", 2020-11-16T20:55:22.816 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_cluster_mode": "crc secure", 2020-11-16T20:55:22.816 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_cluster_type": "", 2020-11-16T20:55:22.816 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_connection_idle_timeout": "900", 2020-11-16T20:55:22.816 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_connection_ready_timeout": "10", 2020-11-16T20:55:22.816 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_crc_data": "true", 2020-11-16T20:55:22.816 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_crc_header": "true", 2020-11-16T20:55:22.816 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_die_on_bad_msg": "false", 2020-11-16T20:55:22.817 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_die_on_bug": "true", 2020-11-16T20:55:22.817 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_die_on_old_message": "true", 2020-11-16T20:55:22.817 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_die_on_skipped_message": "false", 2020-11-16T20:55:22.817 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_die_on_unhandled_msg": "false", 2020-11-16T20:55:22.817 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_dispatch_throttle_bytes": "104857600", 2020-11-16T20:55:22.817 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_dpdk_coremask": "0xF", 2020-11-16T20:55:22.817 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_dpdk_debug_allow_loopback": "false", 2020-11-16T20:55:22.817 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2020-11-16T20:55:22.818 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_dpdk_host_ipv4_addr": "", 2020-11-16T20:55:22.818 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_dpdk_hugepages": "", 2020-11-16T20:55:22.818 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_dpdk_hw_flow_control": "true", 2020-11-16T20:55:22.818 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2020-11-16T20:55:22.818 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_dpdk_lro": "true", 2020-11-16T20:55:22.818 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_dpdk_memory_channel": "4", 2020-11-16T20:55:22.818 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2020-11-16T20:55:22.819 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_dpdk_pmd": "", 2020-11-16T20:55:22.819 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_dpdk_port_id": "0", 2020-11-16T20:55:22.819 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2020-11-16T20:55:22.819 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_dump_corrupt_message_level": "1", 2020-11-16T20:55:22.819 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_dump_on_send": "false", 2020-11-16T20:55:22.819 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_initial_backoff": "0.200000", 2020-11-16T20:55:22.819 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_inject_delay_max": "1.000000", 2020-11-16T20:55:22.820 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_inject_delay_msg_type": "", 2020-11-16T20:55:22.820 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_inject_delay_probability": "0.000000", 2020-11-16T20:55:22.820 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_inject_delay_type": "", 2020-11-16T20:55:22.820 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_inject_internal_delays": "0.000000", 2020-11-16T20:55:22.820 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_inject_socket_failures": "5000", 2020-11-16T20:55:22.820 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_learn_addr_from_peer": "true", 2020-11-16T20:55:22.820 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_max_accept_failures": "4", 2020-11-16T20:55:22.820 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_max_backoff": "15.000000", 2020-11-16T20:55:22.821 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_mon_client_mode": "secure crc", 2020-11-16T20:55:22.821 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_mon_cluster_mode": "secure crc", 2020-11-16T20:55:22.821 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_mon_service_mode": "secure crc", 2020-11-16T20:55:22.821 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2020-11-16T20:55:22.821 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_pq_min_cost": "65536", 2020-11-16T20:55:22.821 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_public_type": "", 2020-11-16T20:55:22.821 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_service_mode": "crc secure", 2020-11-16T20:55:22.822 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_tcp_listen_backlog": "512", 2020-11-16T20:55:22.822 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_tcp_nodelay": "true", 2020-11-16T20:55:22.822 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_tcp_prefetch_max_size": "4096", 2020-11-16T20:55:22.822 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_tcp_rcvbuf": "0", 2020-11-16T20:55:22.822 INFO:teuthology.orchestra.run.smithi166.stdout: "ms_type": "async", 2020-11-16T20:55:22.822 INFO:teuthology.orchestra.run.smithi166.stdout: "no_config_file": "false", 2020-11-16T20:55:22.822 INFO:teuthology.orchestra.run.smithi166.stdout: "objecter_completion_locks_per_session": "32", 2020-11-16T20:55:22.823 INFO:teuthology.orchestra.run.smithi166.stdout: "objecter_debug_inject_relock_delay": "false", 2020-11-16T20:55:22.823 INFO:teuthology.orchestra.run.smithi166.stdout: "objecter_inflight_op_bytes": "104857600", 2020-11-16T20:55:22.823 INFO:teuthology.orchestra.run.smithi166.stdout: "objecter_inflight_ops": "1024", 2020-11-16T20:55:22.823 INFO:teuthology.orchestra.run.smithi166.stdout: "objecter_inject_no_watch_ping": "false", 2020-11-16T20:55:22.823 INFO:teuthology.orchestra.run.smithi166.stdout: "objecter_retry_writes_after_first_reply": "false", 2020-11-16T20:55:22.823 INFO:teuthology.orchestra.run.smithi166.stdout: "objecter_tick_interval": "5.000000", 2020-11-16T20:55:22.823 INFO:teuthology.orchestra.run.smithi166.stdout: "objecter_timeout": "10.000000", 2020-11-16T20:55:22.823 INFO:teuthology.orchestra.run.smithi166.stdout: "objectstore_blackhole": "false", 2020-11-16T20:55:22.824 INFO:teuthology.orchestra.run.smithi166.stdout: "openssl_engine_opts": "", 2020-11-16T20:55:22.824 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_agent_delay_time": "5.000000", 2020-11-16T20:55:22.824 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_agent_hist_halflife": "1000", 2020-11-16T20:55:22.824 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_agent_max_low_ops": "2", 2020-11-16T20:55:22.824 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_agent_max_ops": "4", 2020-11-16T20:55:22.824 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_agent_min_evict_effort": "0.100000", 2020-11-16T20:55:22.824 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_agent_quantize_effort": "0.100000", 2020-11-16T20:55:22.824 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_agent_slop": "0.020000", 2020-11-16T20:55:22.825 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_allow_recovery_below_min_size": "true", 2020-11-16T20:55:22.825 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_asio_thread_count": "2", 2020-11-16T20:55:22.825 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_async_recovery_min_cost": "100", 2020-11-16T20:55:22.825 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_auto_mark_unfound_lost": "false", 2020-11-16T20:55:22.825 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_backfill_retry_interval": "30.000000", 2020-11-16T20:55:22.825 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_backfill_scan_max": "512", 2020-11-16T20:55:22.825 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_backfill_scan_min": "64", 2020-11-16T20:55:22.826 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_backoff_on_degraded": "false", 2020-11-16T20:55:22.826 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_backoff_on_peering": "false", 2020-11-16T20:55:22.826 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_backoff_on_unfound": "true", 2020-11-16T20:55:22.826 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_beacon_report_interval": "300", 2020-11-16T20:55:22.826 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_bench_duration": "30", 2020-11-16T20:55:22.826 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_bench_large_size_max_throughput": "104857600", 2020-11-16T20:55:22.826 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_bench_max_block_size": "67108864", 2020-11-16T20:55:22.826 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_bench_small_size_max_iops": "100", 2020-11-16T20:55:22.827 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_blkin_trace_all": "false", 2020-11-16T20:55:22.827 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2020-11-16T20:55:22.827 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2020-11-16T20:55:22.827 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_check_for_log_corruption": "false", 2020-11-16T20:55:22.827 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_check_max_object_name_len_on_startup": "true", 2020-11-16T20:55:22.827 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2020-11-16T20:55:22.827 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2020-11-16T20:55:22.828 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2020-11-16T20:55:22.828 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_class_update_on_start": "true", 2020-11-16T20:55:22.828 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_client_message_cap": "0", 2020-11-16T20:55:22.828 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_client_message_size_cap": "524288000", 2020-11-16T20:55:22.828 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_client_op_priority": "63", 2020-11-16T20:55:22.828 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_client_watch_timeout": "30", 2020-11-16T20:55:22.828 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_command_max_records": "256", 2020-11-16T20:55:22.828 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_command_thread_suicide_timeout": "900", 2020-11-16T20:55:22.829 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_command_thread_timeout": "600", 2020-11-16T20:55:22.829 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_compact_on_start": "false", 2020-11-16T20:55:22.829 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_copyfrom_max_chunk": "8388608", 2020-11-16T20:55:22.829 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_crush_chooseleaf_type": "0", 2020-11-16T20:55:22.829 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_crush_initial_weight": "-1.000000", 2020-11-16T20:55:22.829 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_crush_update_on_start": "true", 2020-11-16T20:55:22.829 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_crush_update_weight_set": "true", 2020-11-16T20:55:22.830 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2020-11-16T20:55:22.830 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2020-11-16T20:55:22.830 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2020-11-16T20:55:22.830 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_debug_drop_ping_duration": "0", 2020-11-16T20:55:22.830 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_debug_drop_ping_probability": "0.000000", 2020-11-16T20:55:22.830 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_debug_feed_pullee": "-1", 2020-11-16T20:55:22.830 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_debug_inject_copyfrom_error": "false", 2020-11-16T20:55:22.831 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2020-11-16T20:55:22.831 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2020-11-16T20:55:22.831 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_debug_misdirected_ops": "false", 2020-11-16T20:55:22.831 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_debug_no_acting_change": "false", 2020-11-16T20:55:22.831 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_debug_no_purge_strays": "false", 2020-11-16T20:55:22.831 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_debug_op_order": "false", 2020-11-16T20:55:22.831 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_debug_pg_log_writeout": "false", 2020-11-16T20:55:22.831 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_debug_pretend_recovery_active": "false", 2020-11-16T20:55:22.832 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_debug_random_push_read_error": "0.000000", 2020-11-16T20:55:22.832 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2020-11-16T20:55:22.832 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_debug_shutdown": "false", 2020-11-16T20:55:22.832 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2020-11-16T20:55:22.832 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2020-11-16T20:55:22.832 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_debug_verify_cached_snaps": "false", 2020-11-16T20:55:22.832 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_debug_verify_missing_on_start": "false", 2020-11-16T20:55:22.832 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_debug_verify_snaps": "false", 2020-11-16T20:55:22.833 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_debug_verify_stray_on_activate": "false", 2020-11-16T20:55:22.833 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_deep_scrub_interval": "604800.000000", 2020-11-16T20:55:22.833 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_deep_scrub_keys": "1024", 2020-11-16T20:55:22.833 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2020-11-16T20:55:22.833 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2020-11-16T20:55:22.833 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2020-11-16T20:55:22.833 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_deep_scrub_stride": "524288", 2020-11-16T20:55:22.834 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2020-11-16T20:55:22.834 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_default_data_pool_replay_window": "5", 2020-11-16T20:55:22.834 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_default_notify_timeout": "30", 2020-11-16T20:55:22.834 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_delete_sleep": "0.000000", 2020-11-16T20:55:22.834 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_delete_sleep_hdd": "5.000000", 2020-11-16T20:55:22.834 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_delete_sleep_hybrid": "2.000000", 2020-11-16T20:55:22.834 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_delete_sleep_ssd": "0.000000", 2020-11-16T20:55:22.834 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_discard_disconnected_ops": "true", 2020-11-16T20:55:22.835 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_enable_op_tracker": "true", 2020-11-16T20:55:22.835 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_erasure_code_plugins": "jerasure lrc isa", 2020-11-16T20:55:22.835 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_failsafe_full_ratio": "0.970000", 2020-11-16T20:55:22.835 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_fast_fail_on_connection_refused": "true", 2020-11-16T20:55:22.836 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_fast_info": "true", 2020-11-16T20:55:22.836 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_fast_shutdown": "true", 2020-11-16T20:55:22.836 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_find_best_info_ignore_history_les": "false", 2020-11-16T20:55:22.836 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_force_auth_primary_missing_objects": "100", 2020-11-16T20:55:22.836 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2020-11-16T20:55:22.836 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_function_tracing": "false", 2020-11-16T20:55:22.836 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_heartbeat_grace": "20", 2020-11-16T20:55:22.837 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_heartbeat_interval": "6", 2020-11-16T20:55:22.837 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2020-11-16T20:55:22.837 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_heartbeat_min_peers": "10", 2020-11-16T20:55:22.837 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_heartbeat_min_size": "2000", 2020-11-16T20:55:22.837 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_heartbeat_stale": "600", 2020-11-16T20:55:22.837 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2020-11-16T20:55:22.837 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_hit_set_max_size": "100000", 2020-11-16T20:55:22.838 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_hit_set_min_size": "1000", 2020-11-16T20:55:22.838 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_hit_set_namespace": ".ceph-internal", 2020-11-16T20:55:22.838 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_ignore_stale_divergent_priors": "false", 2020-11-16T20:55:22.838 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2020-11-16T20:55:22.838 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_inject_failure_on_pg_removal": "false", 2020-11-16T20:55:22.838 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2020-11-16T20:55:22.838 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_journal_flush_on_shutdown": "true", 2020-11-16T20:55:22.839 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_journal_size": "5120", 2020-11-16T20:55:22.839 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_kill_backfill_at": "0", 2020-11-16T20:55:22.839 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_loop_before_reset_tphandle": "64", 2020-11-16T20:55:22.839 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_map_cache_size": "50", 2020-11-16T20:55:22.839 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_map_dedup": "true", 2020-11-16T20:55:22.839 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_map_message_max": "40", 2020-11-16T20:55:22.839 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_map_message_max_bytes": "10485760", 2020-11-16T20:55:22.839 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_map_share_max_epochs": "40", 2020-11-16T20:55:22.840 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_max_attr_name_len": "100", 2020-11-16T20:55:22.840 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_max_attr_size": "0", 2020-11-16T20:55:22.840 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_max_backfills": "1", 2020-11-16T20:55:22.840 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_max_markdown_count": "5", 2020-11-16T20:55:22.840 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_max_markdown_period": "600", 2020-11-16T20:55:22.840 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_max_object_name_len": "2048", 2020-11-16T20:55:22.840 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_max_object_namespace_len": "256", 2020-11-16T20:55:22.841 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_max_object_size": "134217728", 2020-11-16T20:55:22.841 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2020-11-16T20:55:22.841 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_max_omap_entries_per_request": "1024", 2020-11-16T20:55:22.841 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_max_pg_blocked_by": "16", 2020-11-16T20:55:22.841 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_max_pg_log_entries": "2", 2020-11-16T20:55:22.841 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2020-11-16T20:55:22.841 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_max_pgls": "1024", 2020-11-16T20:55:22.841 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_max_push_cost": "8388608", 2020-11-16T20:55:22.842 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_max_push_objects": "10", 2020-11-16T20:55:22.842 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_max_scrubs": "1", 2020-11-16T20:55:22.842 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2020-11-16T20:55:22.842 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_max_trimming_pgs": "2", 2020-11-16T20:55:22.842 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_max_write_op_reply_len": "32", 2020-11-16T20:55:22.842 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_max_write_size": "90", 2020-11-16T20:55:22.842 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2020-11-16T20:55:22.843 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_mclock_scheduler_background_best_effort_lim": "999999", 2020-11-16T20:55:22.843 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_mclock_scheduler_background_best_effort_res": "1", 2020-11-16T20:55:22.843 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2020-11-16T20:55:22.843 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_mclock_scheduler_background_recovery_lim": "999999", 2020-11-16T20:55:22.843 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_mclock_scheduler_background_recovery_res": "1", 2020-11-16T20:55:22.843 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2020-11-16T20:55:22.843 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_mclock_scheduler_client_lim": "999999", 2020-11-16T20:55:22.843 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_mclock_scheduler_client_res": "1", 2020-11-16T20:55:22.844 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_mclock_scheduler_client_wgt": "1", 2020-11-16T20:55:22.844 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_memory_base": "805306368", 2020-11-16T20:55:22.844 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_memory_cache_min": "134217728", 2020-11-16T20:55:22.844 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_memory_cache_resize_interval": "1.000000", 2020-11-16T20:55:22.844 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_memory_expected_fragmentation": "0.150000", 2020-11-16T20:55:22.844 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_memory_target": "4294967296", 2020-11-16T20:55:22.844 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2020-11-16T20:55:22.845 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_min_pg_log_entries": "1", 2020-11-16T20:55:22.845 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_min_recovery_priority": "0", 2020-11-16T20:55:22.845 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_mon_ack_timeout": "30.000000", 2020-11-16T20:55:22.845 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_mon_heartbeat_interval": "30", 2020-11-16T20:55:22.845 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2020-11-16T20:55:22.845 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_mon_report_interval": "5", 2020-11-16T20:55:22.845 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_mon_report_max_in_flight": "2", 2020-11-16T20:55:22.845 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_mon_shutdown_timeout": "5.000000", 2020-11-16T20:55:22.846 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_num_cache_shards": "32", 2020-11-16T20:55:22.846 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_num_op_tracker_shard": "32", 2020-11-16T20:55:22.846 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_numa_auto_affinity": "true", 2020-11-16T20:55:22.846 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_numa_node": "-1", 2020-11-16T20:55:22.846 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_numa_prefer_iface": "true", 2020-11-16T20:55:22.846 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_object_clean_region_max_num_intervals": "10", 2020-11-16T20:55:22.846 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_objecter_finishers": "1", 2020-11-16T20:55:22.847 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_objectstore": "bluestore", 2020-11-16T20:55:22.847 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_objectstore_fuse": "false", 2020-11-16T20:55:22.847 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_objectstore_tracing": "false", 2020-11-16T20:55:22.847 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_op_complaint_time": "30.000000", 2020-11-16T20:55:22.847 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_op_history_duration": "600", 2020-11-16T20:55:22.847 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_op_history_size": "20", 2020-11-16T20:55:22.847 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_op_history_slow_op_size": "20", 2020-11-16T20:55:22.847 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2020-11-16T20:55:22.848 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_op_log_threshold": "5", 2020-11-16T20:55:22.848 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_op_num_shards": "0", 2020-11-16T20:55:22.848 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_op_num_shards_hdd": "5", 2020-11-16T20:55:22.848 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_op_num_shards_ssd": "8", 2020-11-16T20:55:22.848 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_op_num_threads_per_shard": "0", 2020-11-16T20:55:22.848 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2020-11-16T20:55:22.848 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2020-11-16T20:55:22.849 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2020-11-16T20:55:22.849 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_op_pq_min_cost": "65536", 2020-11-16T20:55:22.849 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_op_queue": "wpq", 2020-11-16T20:55:22.849 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_op_queue_cut_off": "high", 2020-11-16T20:55:22.849 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_op_thread_suicide_timeout": "150", 2020-11-16T20:55:22.849 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_op_thread_timeout": "15", 2020-11-16T20:55:22.849 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_open_classes_on_start": "true", 2020-11-16T20:55:22.849 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_os_flags": "0", 2020-11-16T20:55:22.850 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_peering_op_priority": "255", 2020-11-16T20:55:22.850 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pg_delete_cost": "1048576", 2020-11-16T20:55:22.850 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pg_delete_priority": "5", 2020-11-16T20:55:22.850 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2020-11-16T20:55:22.850 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2020-11-16T20:55:22.850 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pg_log_dups_tracked": "3000", 2020-11-16T20:55:22.850 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pg_log_trim_max": "10000", 2020-11-16T20:55:22.851 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pg_log_trim_min": "0", 2020-11-16T20:55:22.851 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2020-11-16T20:55:22.851 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pg_object_context_cache_count": "64", 2020-11-16T20:55:22.851 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pg_stat_report_interval_max": "500", 2020-11-16T20:55:22.851 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2020-11-16T20:55:22.851 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pool_default_cache_min_evict_age": "0", 2020-11-16T20:55:22.851 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pool_default_cache_min_flush_age": "0", 2020-11-16T20:55:22.851 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2020-11-16T20:55:22.852 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2020-11-16T20:55:22.852 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2020-11-16T20:55:22.852 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pool_default_crush_rule": "-1", 2020-11-16T20:55:22.852 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pool_default_ec_fast_read": "false", 2020-11-16T20:55:22.852 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd", 2020-11-16T20:55:22.852 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pool_default_flag_hashpspool": "true", 2020-11-16T20:55:22.852 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pool_default_flag_nodelete": "false", 2020-11-16T20:55:22.853 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pool_default_flag_nopgchange": "false", 2020-11-16T20:55:22.853 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pool_default_flag_nosizechange": "false", 2020-11-16T20:55:22.853 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pool_default_flags": "0", 2020-11-16T20:55:22.853 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2020-11-16T20:55:22.853 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pool_default_min_size": "2", 2020-11-16T20:55:22.853 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2020-11-16T20:55:22.853 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pool_default_pg_num": "32", 2020-11-16T20:55:22.853 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pool_default_pgp_num": "0", 2020-11-16T20:55:22.854 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2020-11-16T20:55:22.854 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pool_default_size": "3", 2020-11-16T20:55:22.854 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pool_default_type": "replicated", 2020-11-16T20:55:22.854 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2020-11-16T20:55:22.854 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_pool_use_gmt_hitset": "true", 2020-11-16T20:55:22.854 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_push_per_object_cost": "1000", 2020-11-16T20:55:22.854 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_read_ec_check_for_errors": "false", 2020-11-16T20:55:22.855 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_recover_clone_overlap": "true", 2020-11-16T20:55:22.855 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_recover_clone_overlap_limit": "10", 2020-11-16T20:55:22.855 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_recovery_cost": "20971520", 2020-11-16T20:55:22.855 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_recovery_delay_start": "0.000000", 2020-11-16T20:55:22.855 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_recovery_max_active": "10", 2020-11-16T20:55:22.855 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_recovery_max_active_hdd": "3", 2020-11-16T20:55:22.855 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_recovery_max_active_ssd": "10", 2020-11-16T20:55:22.856 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_recovery_max_chunk": "8388608", 2020-11-16T20:55:22.856 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2020-11-16T20:55:22.856 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_recovery_max_single_start": "10", 2020-11-16T20:55:22.856 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_recovery_op_priority": "3", 2020-11-16T20:55:22.856 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_recovery_op_warn_multiple": "16", 2020-11-16T20:55:22.856 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_recovery_priority": "5", 2020-11-16T20:55:22.856 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_recovery_retry_interval": "30.000000", 2020-11-16T20:55:22.856 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_recovery_sleep": "0.000000", 2020-11-16T20:55:22.857 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_recovery_sleep_hdd": "0.100000", 2020-11-16T20:55:22.857 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2020-11-16T20:55:22.857 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_recovery_sleep_ssd": "0.000000", 2020-11-16T20:55:22.857 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_repair_during_recovery": "false", 2020-11-16T20:55:22.857 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_requested_scrub_priority": "120", 2020-11-16T20:55:22.857 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_rollback_to_cluster_snap": "", 2020-11-16T20:55:22.857 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_scrub_auto_repair": "false", 2020-11-16T20:55:22.857 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_scrub_auto_repair_num_errors": "5", 2020-11-16T20:55:22.858 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_scrub_backoff_ratio": "0.660000", 2020-11-16T20:55:22.858 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_scrub_begin_hour": "0", 2020-11-16T20:55:22.858 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_scrub_begin_week_day": "0", 2020-11-16T20:55:22.858 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_scrub_chunk_max": "25", 2020-11-16T20:55:22.858 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_scrub_chunk_min": "5", 2020-11-16T20:55:22.858 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_scrub_cost": "52428800", 2020-11-16T20:55:22.858 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_scrub_during_recovery": "false", 2020-11-16T20:55:22.859 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_scrub_end_hour": "0", 2020-11-16T20:55:22.859 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_scrub_end_week_day": "0", 2020-11-16T20:55:22.859 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_scrub_extended_sleep": "0.000000", 2020-11-16T20:55:22.859 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2020-11-16T20:55:22.859 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_scrub_invalid_stats": "true", 2020-11-16T20:55:22.859 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_scrub_load_threshold": "0.500000", 2020-11-16T20:55:22.859 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_scrub_max_interval": "604800.000000", 2020-11-16T20:55:22.859 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_scrub_max_preemptions": "5", 2020-11-16T20:55:22.860 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_scrub_min_interval": "86400.000000", 2020-11-16T20:55:22.860 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_scrub_priority": "5", 2020-11-16T20:55:22.860 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_scrub_sleep": "0.000000", 2020-11-16T20:55:22.860 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_shutdown_pgref_assert": "false", 2020-11-16T20:55:22.860 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_skip_data_digest": "false", 2020-11-16T20:55:22.860 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_smart_report_timeout": "5", 2020-11-16T20:55:22.860 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_snap_trim_cost": "1048576", 2020-11-16T20:55:22.861 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_snap_trim_priority": "5", 2020-11-16T20:55:22.861 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_snap_trim_sleep": "0.000000", 2020-11-16T20:55:22.861 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2020-11-16T20:55:22.861 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2020-11-16T20:55:22.861 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2020-11-16T20:55:22.861 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_stats_ack_timeout_decay": "0.900000", 2020-11-16T20:55:22.861 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_stats_ack_timeout_factor": "2.000000", 2020-11-16T20:55:22.861 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2020-11-16T20:55:22.862 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_target_transaction_size": "30", 2020-11-16T20:55:22.862 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_tier_default_cache_hit_set_count": "4", 2020-11-16T20:55:22.862 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2020-11-16T20:55:22.862 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2020-11-16T20:55:22.862 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2020-11-16T20:55:22.862 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2020-11-16T20:55:22.862 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2020-11-16T20:55:22.863 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2020-11-16T20:55:22.863 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_tier_default_cache_mode": "writeback", 2020-11-16T20:55:22.863 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2020-11-16T20:55:22.863 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_tier_promote_max_objects_sec": "25", 2020-11-16T20:55:22.863 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_tracing": "false", 2020-11-16T20:55:22.863 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_use_stale_snap": "false", 2020-11-16T20:55:22.863 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2020-11-16T20:55:22.863 INFO:teuthology.orchestra.run.smithi166.stdout: "osdc_blkin_trace_all": "false", 2020-11-16T20:55:22.864 INFO:teuthology.orchestra.run.smithi166.stdout: "paxos_kill_at": "0", 2020-11-16T20:55:22.864 INFO:teuthology.orchestra.run.smithi166.stdout: "paxos_max_join_drift": "10", 2020-11-16T20:55:22.864 INFO:teuthology.orchestra.run.smithi166.stdout: "paxos_min": "500", 2020-11-16T20:55:22.864 INFO:teuthology.orchestra.run.smithi166.stdout: "paxos_min_wait": "0.050000", 2020-11-16T20:55:22.864 INFO:teuthology.orchestra.run.smithi166.stdout: "paxos_propose_interval": "1.000000", 2020-11-16T20:55:22.864 INFO:teuthology.orchestra.run.smithi166.stdout: "paxos_service_trim_max": "500", 2020-11-16T20:55:22.864 INFO:teuthology.orchestra.run.smithi166.stdout: "paxos_service_trim_min": "10", 2020-11-16T20:55:22.865 INFO:teuthology.orchestra.run.smithi166.stdout: "paxos_stash_full_interval": "25", 2020-11-16T20:55:22.865 INFO:teuthology.orchestra.run.smithi166.stdout: "paxos_trim_max": "500", 2020-11-16T20:55:22.865 INFO:teuthology.orchestra.run.smithi166.stdout: "paxos_trim_min": "250", 2020-11-16T20:55:22.865 INFO:teuthology.orchestra.run.smithi166.stdout: "perf": "true", 2020-11-16T20:55:22.865 INFO:teuthology.orchestra.run.smithi166.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2020-11-16T20:55:22.865 INFO:teuthology.orchestra.run.smithi166.stdout: "plugin_crypto_accelerator": "crypto_isal", 2020-11-16T20:55:22.865 INFO:teuthology.orchestra.run.smithi166.stdout: "plugin_dir": "/usr/lib64/ceph", 2020-11-16T20:55:22.865 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "-", 2020-11-16T20:55:22.866 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrv": "", 2020-11-16T20:55:22.866 INFO:teuthology.orchestra.run.smithi166.stdout: "public_bind_addr": "-", 2020-11-16T20:55:22.866 INFO:teuthology.orchestra.run.smithi166.stdout: "public_network": "", 2020-11-16T20:55:22.866 INFO:teuthology.orchestra.run.smithi166.stdout: "public_network_interface": "", 2020-11-16T20:55:22.866 INFO:teuthology.orchestra.run.smithi166.stdout: "qat_compressor_enabled": "false", 2020-11-16T20:55:22.866 INFO:teuthology.orchestra.run.smithi166.stdout: "rados_mon_op_timeout": "0", 2020-11-16T20:55:22.866 INFO:teuthology.orchestra.run.smithi166.stdout: "rados_osd_op_timeout": "0", 2020-11-16T20:55:22.867 INFO:teuthology.orchestra.run.smithi166.stdout: "rados_tracing": "false", 2020-11-16T20:55:22.867 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_atime_update_interval": "60", 2020-11-16T20:55:22.867 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2020-11-16T20:55:22.867 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_balance_parent_reads": "false", 2020-11-16T20:55:22.867 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_balance_snap_reads": "false", 2020-11-16T20:55:22.867 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_blkin_trace_all": "false", 2020-11-16T20:55:22.867 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_blocklist_expire_seconds": "0", 2020-11-16T20:55:22.867 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_blocklist_on_break_lock": "true", 2020-11-16T20:55:22.868 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_cache": "true", 2020-11-16T20:55:22.868 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_cache_block_writes_upfront": "false", 2020-11-16T20:55:22.868 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_cache_max_dirty": "25165824", 2020-11-16T20:55:22.868 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_cache_max_dirty_age": "1.000000", 2020-11-16T20:55:22.868 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_cache_max_dirty_object": "0", 2020-11-16T20:55:22.868 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_cache_policy": "writearound", 2020-11-16T20:55:22.868 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_cache_size": "33554432", 2020-11-16T20:55:22.869 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_cache_target_dirty": "16777216", 2020-11-16T20:55:22.869 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_cache_writethrough_until_flush": "true", 2020-11-16T20:55:22.869 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_clone_copy_on_read": "false", 2020-11-16T20:55:22.869 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_compression_hint": "none", 2020-11-16T20:55:22.869 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_concurrent_management_ops": "10", 2020-11-16T20:55:22.869 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_config_pool_override_update_timestamp": "0", 2020-11-16T20:55:22.869 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_default_clone_format": "auto", 2020-11-16T20:55:22.869 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_default_data_pool": "", 2020-11-16T20:55:22.870 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_default_features": "61", 2020-11-16T20:55:22.870 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_default_format": "2", 2020-11-16T20:55:22.870 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_default_map_options": "", 2020-11-16T20:55:22.870 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_default_order": "22", 2020-11-16T20:55:22.870 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_default_pool": "rbd", 2020-11-16T20:55:22.870 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2020-11-16T20:55:22.870 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_default_stripe_count": "0", 2020-11-16T20:55:22.871 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_default_stripe_unit": "0", 2020-11-16T20:55:22.871 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_disable_zero_copy_writes": "true", 2020-11-16T20:55:22.871 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_discard_granularity_bytes": "65536", 2020-11-16T20:55:22.871 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_discard_on_zeroed_write_same": "true", 2020-11-16T20:55:22.871 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_enable_alloc_hint": "true", 2020-11-16T20:55:22.871 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2020-11-16T20:55:22.871 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_io_scheduler": "simple", 2020-11-16T20:55:22.871 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2020-11-16T20:55:22.872 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_journal_commit_age": "5.000000", 2020-11-16T20:55:22.872 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2020-11-16T20:55:22.872 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_journal_max_payload_bytes": "16384", 2020-11-16T20:55:22.872 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_journal_object_flush_age": "0.000000", 2020-11-16T20:55:22.872 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_journal_object_flush_bytes": "1048576", 2020-11-16T20:55:22.872 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_journal_object_flush_interval": "0", 2020-11-16T20:55:22.872 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2020-11-16T20:55:22.873 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2020-11-16T20:55:22.873 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_journal_order": "24", 2020-11-16T20:55:22.873 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_journal_pool": "", 2020-11-16T20:55:22.873 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_journal_splay_width": "4", 2020-11-16T20:55:22.873 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_localize_parent_reads": "false", 2020-11-16T20:55:22.873 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_localize_snap_reads": "false", 2020-11-16T20:55:22.873 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2020-11-16T20:55:22.873 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2020-11-16T20:55:22.874 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2020-11-16T20:55:22.874 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2020-11-16T20:55:22.874 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2020-11-16T20:55:22.874 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2020-11-16T20:55:22.874 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirror_image_policy_type": "simple", 2020-11-16T20:55:22.874 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2020-11-16T20:55:22.874 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirror_image_state_check_interval": "30", 2020-11-16T20:55:22.875 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2020-11-16T20:55:22.875 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2020-11-16T20:55:22.875 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2020-11-16T20:55:22.875 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2020-11-16T20:55:22.875 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2020-11-16T20:55:22.875 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirror_memory_autotune": "true", 2020-11-16T20:55:22.875 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirror_memory_base": "805306368", 2020-11-16T20:55:22.875 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2020-11-16T20:55:22.876 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirror_memory_cache_min": "134217728", 2020-11-16T20:55:22.876 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2020-11-16T20:55:22.876 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2020-11-16T20:55:22.876 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirror_memory_target": "4294967296", 2020-11-16T20:55:22.876 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirror_perf_stats_prio": "5", 2020-11-16T20:55:22.876 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2020-11-16T20:55:22.876 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2020-11-16T20:55:22.876 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirroring_delete_delay": "0", 2020-11-16T20:55:22.877 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirroring_max_mirroring_snapshots": "3", 2020-11-16T20:55:22.877 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirroring_replay_delay": "0", 2020-11-16T20:55:22.877 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2020-11-16T20:55:22.877 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2020-11-16T20:55:22.877 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_move_to_trash_on_remove": "false", 2020-11-16T20:55:22.877 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2020-11-16T20:55:22.877 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_mtime_update_interval": "60", 2020-11-16T20:55:22.878 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_non_blocking_aio": "true", 2020-11-16T20:55:22.878 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_op_thread_timeout": "60", 2020-11-16T20:55:22.878 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_op_threads": "1", 2020-11-16T20:55:22.878 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_parent_cache_enabled": "false", 2020-11-16T20:55:22.878 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_plugins": "", 2020-11-16T20:55:22.878 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_qos_bps_burst": "0", 2020-11-16T20:55:22.878 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_qos_bps_burst_seconds": "1", 2020-11-16T20:55:22.879 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_qos_bps_limit": "0", 2020-11-16T20:55:22.879 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_qos_iops_burst": "0", 2020-11-16T20:55:22.879 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_qos_iops_burst_seconds": "1", 2020-11-16T20:55:22.879 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_qos_iops_limit": "0", 2020-11-16T20:55:22.879 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_qos_read_bps_burst": "0", 2020-11-16T20:55:22.879 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2020-11-16T20:55:22.879 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_qos_read_bps_limit": "0", 2020-11-16T20:55:22.879 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_qos_read_iops_burst": "0", 2020-11-16T20:55:22.880 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2020-11-16T20:55:22.880 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_qos_read_iops_limit": "0", 2020-11-16T20:55:22.880 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_qos_schedule_tick_min": "50", 2020-11-16T20:55:22.880 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_qos_write_bps_burst": "0", 2020-11-16T20:55:22.880 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2020-11-16T20:55:22.880 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_qos_write_bps_limit": "0", 2020-11-16T20:55:22.880 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_qos_write_iops_burst": "0", 2020-11-16T20:55:22.880 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2020-11-16T20:55:22.881 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_qos_write_iops_limit": "0", 2020-11-16T20:55:22.881 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_quiesce_notification_attempts": "10", 2020-11-16T20:55:22.881 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_read_from_replica_policy": "default", 2020-11-16T20:55:22.881 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2020-11-16T20:55:22.881 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_readahead_max_bytes": "524288", 2020-11-16T20:55:22.881 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_readahead_trigger_requests": "10", 2020-11-16T20:55:22.881 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_request_timed_out_seconds": "30", 2020-11-16T20:55:22.882 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_rwl_enabled": "false", 2020-11-16T20:55:22.882 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_rwl_log_periodic_stats": "false", 2020-11-16T20:55:22.882 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_rwl_path": "/tmp", 2020-11-16T20:55:22.882 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_rwl_size": "1073741824", 2020-11-16T20:55:22.882 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_skip_partial_discard": "true", 2020-11-16T20:55:22.882 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2020-11-16T20:55:22.882 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_tracing": "false", 2020-11-16T20:55:22.883 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_validate_names": "true", 2020-11-16T20:55:22.883 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd_validate_pool": "true", 2020-11-16T20:55:22.883 INFO:teuthology.orchestra.run.smithi166.stdout: "restapi_base_url": "", 2020-11-16T20:55:22.883 INFO:teuthology.orchestra.run.smithi166.stdout: "restapi_log_level": "", 2020-11-16T20:55:22.883 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_acl_grants_max_num": "100", 2020-11-16T20:55:22.883 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_admin_entry": "admin", 2020-11-16T20:55:22.883 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_barbican_url": "", 2020-11-16T20:55:22.883 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2020-11-16T20:55:22.884 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_bucket_default_quota_max_size": "-1", 2020-11-16T20:55:22.884 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_bucket_index_max_aio": "128", 2020-11-16T20:55:22.884 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_bucket_quota_cache_size": "10000", 2020-11-16T20:55:22.884 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_bucket_quota_soft_threshold": "0.950000", 2020-11-16T20:55:22.884 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_bucket_quota_ttl": "600", 2020-11-16T20:55:22.884 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_cache_enabled": "true", 2020-11-16T20:55:22.884 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_cache_expiry_interval": "900", 2020-11-16T20:55:22.885 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_cache_lru_size": "10000", 2020-11-16T20:55:22.885 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_content_length_compat": "false", 2020-11-16T20:55:22.885 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_copy_obj_progress": "true", 2020-11-16T20:55:22.885 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2020-11-16T20:55:22.885 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_cors_rules_max_num": "100", 2020-11-16T20:55:22.885 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_cross_domain_policy": "", 2020-11-16T20:55:22.885 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_crypt_default_encryption_key": "", 2020-11-16T20:55:22.886 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_crypt_require_ssl": "true", 2020-11-16T20:55:22.886 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2020-11-16T20:55:22.886 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2020-11-16T20:55:22.886 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_crypt_suppress_logs": "true", 2020-11-16T20:55:22.886 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_crypt_vault_addr": "", 2020-11-16T20:55:22.886 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_crypt_vault_auth": "token", 2020-11-16T20:55:22.886 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_crypt_vault_namespace": "", 2020-11-16T20:55:22.886 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_crypt_vault_prefix": "", 2020-11-16T20:55:22.887 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_crypt_vault_secret_engine": "transit", 2020-11-16T20:55:22.887 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_crypt_vault_token_file": "", 2020-11-16T20:55:22.887 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_curl_low_speed_limit": "1024", 2020-11-16T20:55:22.887 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_curl_low_speed_time": "300", 2020-11-16T20:55:22.887 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_curl_wait_timeout_ms": "1000", 2020-11-16T20:55:22.887 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2020-11-16T20:55:22.887 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_data_log_backing": "auto", 2020-11-16T20:55:22.888 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_data_log_changes_size": "1000", 2020-11-16T20:55:22.888 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_data_log_num_shards": "128", 2020-11-16T20:55:22.888 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_data_log_obj_prefix": "data_log", 2020-11-16T20:55:22.888 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_data_log_window": "30", 2020-11-16T20:55:22.888 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_data_notify_interval_msec": "200", 2020-11-16T20:55:22.888 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_default_realm_info_oid": "default.realm", 2020-11-16T20:55:22.888 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_default_region_info_oid": "default.region", 2020-11-16T20:55:22.888 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_default_zone_info_oid": "default.zone", 2020-11-16T20:55:22.889 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2020-11-16T20:55:22.889 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_defer_to_bucket_acls": "", 2020-11-16T20:55:22.889 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_delete_multi_obj_max_num": "1000", 2020-11-16T20:55:22.889 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_dmclock_admin_lim": "0.000000", 2020-11-16T20:55:22.889 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_dmclock_admin_res": "100.000000", 2020-11-16T20:55:22.889 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2020-11-16T20:55:22.889 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_dmclock_auth_lim": "0.000000", 2020-11-16T20:55:22.889 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_dmclock_auth_res": "200.000000", 2020-11-16T20:55:22.890 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2020-11-16T20:55:22.890 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_dmclock_data_lim": "0.000000", 2020-11-16T20:55:22.890 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_dmclock_data_res": "500.000000", 2020-11-16T20:55:22.890 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_dmclock_data_wgt": "500.000000", 2020-11-16T20:55:22.890 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2020-11-16T20:55:22.890 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_dmclock_metadata_res": "500.000000", 2020-11-16T20:55:22.890 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2020-11-16T20:55:22.891 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_dns_name": "", 2020-11-16T20:55:22.891 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_dns_s3website_name": "", 2020-11-16T20:55:22.891 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_dynamic_resharding": "true", 2020-11-16T20:55:22.891 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, pubsub", 2020-11-16T20:55:22.891 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_enable_gc_threads": "true", 2020-11-16T20:55:22.891 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_enable_lc_threads": "true", 2020-11-16T20:55:22.891 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_enable_ops_log": "false", 2020-11-16T20:55:22.891 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_enable_quota_threads": "true", 2020-11-16T20:55:22.892 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_enable_static_website": "false", 2020-11-16T20:55:22.892 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_enable_usage_log": "false", 2020-11-16T20:55:22.892 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_enforce_swift_acls": "true", 2020-11-16T20:55:22.892 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_exit_timeout_secs": "120", 2020-11-16T20:55:22.892 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_expose_bucket": "false", 2020-11-16T20:55:22.892 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_extended_http_attrs": "", 2020-11-16T20:55:22.892 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_fcgi_socket_backlog": "1024", 2020-11-16T20:55:22.893 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2020-11-16T20:55:22.893 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_frontends": "beast port=7480", 2020-11-16T20:55:22.893 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_gc_max_concurrent_io": "10", 2020-11-16T20:55:22.893 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_gc_max_deferred": "50", 2020-11-16T20:55:22.893 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2020-11-16T20:55:22.893 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_gc_max_objs": "32", 2020-11-16T20:55:22.893 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_gc_max_queue_size": "134213632", 2020-11-16T20:55:22.893 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_gc_max_trim_chunk": "16", 2020-11-16T20:55:22.894 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_gc_obj_min_wait": "7200", 2020-11-16T20:55:22.894 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_gc_processor_max_time": "3600", 2020-11-16T20:55:22.894 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_gc_processor_period": "3600", 2020-11-16T20:55:22.894 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_get_obj_max_req_size": "4194304", 2020-11-16T20:55:22.894 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_get_obj_window_size": "16777216", 2020-11-16T20:55:22.894 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_healthcheck_disabling_path": "", 2020-11-16T20:55:22.894 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_host": "", 2020-11-16T20:55:22.895 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_ignore_get_invalid_range": "false", 2020-11-16T20:55:22.895 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_init_timeout": "300", 2020-11-16T20:55:22.895 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2020-11-16T20:55:22.895 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_keystone_accepted_admin_roles": "", 2020-11-16T20:55:22.895 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2020-11-16T20:55:22.895 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_keystone_admin_domain": "", 2020-11-16T20:55:22.895 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_keystone_admin_password": "", 2020-11-16T20:55:22.895 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_keystone_admin_password_path": "", 2020-11-16T20:55:22.896 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_keystone_admin_project": "", 2020-11-16T20:55:22.896 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_keystone_admin_tenant": "", 2020-11-16T20:55:22.896 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_keystone_admin_token": "", 2020-11-16T20:55:22.896 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_keystone_admin_token_path": "", 2020-11-16T20:55:22.896 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_keystone_admin_user": "", 2020-11-16T20:55:22.896 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_keystone_api_version": "2", 2020-11-16T20:55:22.896 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_keystone_barbican_domain": "", 2020-11-16T20:55:22.896 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_keystone_barbican_password": "", 2020-11-16T20:55:22.897 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_keystone_barbican_project": "", 2020-11-16T20:55:22.897 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_keystone_barbican_tenant": "", 2020-11-16T20:55:22.897 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_keystone_barbican_user": "", 2020-11-16T20:55:22.897 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_keystone_implicit_tenants": "false", 2020-11-16T20:55:22.897 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_keystone_token_cache_size": "10000", 2020-11-16T20:55:22.897 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_keystone_url": "", 2020-11-16T20:55:22.897 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_keystone_verify_ssl": "true", 2020-11-16T20:55:22.898 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_lc_debug_interval": "-1", 2020-11-16T20:55:22.898 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_lc_lock_max_time": "90", 2020-11-16T20:55:22.898 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_lc_max_objs": "32", 2020-11-16T20:55:22.898 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_lc_max_rules": "1000", 2020-11-16T20:55:22.898 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_lc_max_worker": "3", 2020-11-16T20:55:22.898 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_lc_max_wp_worker": "3", 2020-11-16T20:55:22.898 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_lc_thread_delay": "0", 2020-11-16T20:55:22.899 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2020-11-16T20:55:22.899 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_ldap_dnattr": "uid", 2020-11-16T20:55:22.899 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2020-11-16T20:55:22.899 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_ldap_searchfilter": "", 2020-11-16T20:55:22.899 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2020-11-16T20:55:22.899 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_ldap_uri": "ldaps://", 2020-11-16T20:55:22.899 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2020-11-16T20:55:22.899 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_list_bucket_min_readahead": "1000", 2020-11-16T20:55:22.900 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_list_buckets_max_chunk": "1000", 2020-11-16T20:55:22.900 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_log_http_headers": "", 2020-11-16T20:55:22.900 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_log_nonexistent_bucket": "false", 2020-11-16T20:55:22.900 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2020-11-16T20:55:22.900 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_log_object_name_utc": "false", 2020-11-16T20:55:22.900 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_max_attr_name_len": "0", 2020-11-16T20:55:22.900 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_max_attr_size": "0", 2020-11-16T20:55:22.901 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_max_attrs_num_in_req": "0", 2020-11-16T20:55:22.901 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_max_chunk_size": "4194304", 2020-11-16T20:55:22.901 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_max_concurrent_requests": "1024", 2020-11-16T20:55:22.901 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_max_dynamic_shards": "1999", 2020-11-16T20:55:22.901 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_max_listing_results": "1000", 2020-11-16T20:55:22.901 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_max_notify_retries": "3", 2020-11-16T20:55:22.901 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_max_objs_per_shard": "100000", 2020-11-16T20:55:22.901 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_max_put_param_size": "1048576", 2020-11-16T20:55:22.902 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_max_put_size": "5368709120", 2020-11-16T20:55:22.902 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_max_slo_entries": "1000", 2020-11-16T20:55:22.902 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_md_log_max_shards": "64", 2020-11-16T20:55:22.902 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_md_notify_interval_msec": "200", 2020-11-16T20:55:22.902 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_mime_types_file": "/etc/mime.types", 2020-11-16T20:55:22.902 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_mp_lock_max_time": "600", 2020-11-16T20:55:22.902 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_multipart_min_part_size": "5242880", 2020-11-16T20:55:22.903 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_multipart_part_upload_limit": "10000", 2020-11-16T20:55:22.903 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_nfs_fhcache_partitions": "3", 2020-11-16T20:55:22.903 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_nfs_fhcache_size": "2017", 2020-11-16T20:55:22.903 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2020-11-16T20:55:22.903 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_nfs_lru_lanes": "5", 2020-11-16T20:55:22.903 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_nfs_max_gc": "300", 2020-11-16T20:55:22.903 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_nfs_namespace_expire_secs": "300", 2020-11-16T20:55:22.904 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_nfs_run_gc_threads": "false", 2020-11-16T20:55:22.904 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_nfs_run_lc_threads": "false", 2020-11-16T20:55:22.904 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_nfs_run_quota_threads": "false", 2020-11-16T20:55:22.904 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_nfs_run_sync_thread": "false", 2020-11-16T20:55:22.904 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_nfs_s3_fast_attrs": "false", 2020-11-16T20:55:22.904 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_nfs_write_completion_interval_s": "10", 2020-11-16T20:55:22.904 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_num_async_rados_threads": "32", 2020-11-16T20:55:22.904 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_num_control_oids": "8", 2020-11-16T20:55:22.905 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_num_rados_handles": "1", 2020-11-16T20:55:22.905 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_numa_node": "-1", 2020-11-16T20:55:22.905 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_obj_stripe_size": "4194304", 2020-11-16T20:55:22.905 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_obj_tombstone_cache_size": "1000", 2020-11-16T20:55:22.905 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_objexp_chunk_size": "100", 2020-11-16T20:55:22.905 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_objexp_gc_interval": "600", 2020-11-16T20:55:22.906 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_objexp_hints_num_shards": "127", 2020-11-16T20:55:22.906 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_olh_pending_timeout_sec": "3600", 2020-11-16T20:55:22.906 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_op_thread_suicide_timeout": "0", 2020-11-16T20:55:22.906 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_op_thread_timeout": "600", 2020-11-16T20:55:22.906 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_op_tracing": "false", 2020-11-16T20:55:22.906 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_opa_token": "", 2020-11-16T20:55:22.906 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_opa_url": "", 2020-11-16T20:55:22.906 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_opa_verify_ssl": "true", 2020-11-16T20:55:22.907 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_ops_log_data_backlog": "5242880", 2020-11-16T20:55:22.907 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_ops_log_rados": "true", 2020-11-16T20:55:22.907 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_ops_log_socket_path": "", 2020-11-16T20:55:22.907 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_override_bucket_index_max_shards": "0", 2020-11-16T20:55:22.907 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2020-11-16T20:55:22.907 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_period_push_interval": "2.000000", 2020-11-16T20:55:22.907 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_period_push_interval_max": "30.000000", 2020-11-16T20:55:22.908 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_period_root_pool": ".rgw.root", 2020-11-16T20:55:22.908 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_port": "", 2020-11-16T20:55:22.908 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_print_continue": "true", 2020-11-16T20:55:22.908 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_print_prohibited_content_length": "false", 2020-11-16T20:55:22.908 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_put_obj_max_window_size": "67108864", 2020-11-16T20:55:22.908 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_put_obj_min_window_size": "16777216", 2020-11-16T20:55:22.908 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2020-11-16T20:55:22.908 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_rados_pool_pg_num_min": "8", 2020-11-16T20:55:22.909 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_rados_pool_recovery_priority": "5", 2020-11-16T20:55:22.909 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_rados_tracing": "false", 2020-11-16T20:55:22.909 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_realm": "", 2020-11-16T20:55:22.909 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_realm_root_pool": ".rgw.root", 2020-11-16T20:55:22.909 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_region": "", 2020-11-16T20:55:22.909 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_region_root_pool": ".rgw.root", 2020-11-16T20:55:22.909 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_relaxed_region_enforcement": "false", 2020-11-16T20:55:22.910 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_relaxed_s3_bucket_names": "false", 2020-11-16T20:55:22.910 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2020-11-16T20:55:22.910 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_request_uri": "", 2020-11-16T20:55:22.910 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_reshard_batch_size": "64", 2020-11-16T20:55:22.910 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_reshard_bucket_lock_duration": "360", 2020-11-16T20:55:22.910 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_reshard_max_aio": "128", 2020-11-16T20:55:22.910 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_reshard_num_logs": "16", 2020-11-16T20:55:22.910 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_reshard_thread_interval": "600", 2020-11-16T20:55:22.911 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_resolve_cname": "false", 2020-11-16T20:55:22.911 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_rest_getusage_op_compat": "false", 2020-11-16T20:55:22.911 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_run_sync_thread": "true", 2020-11-16T20:55:22.911 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_s3_auth_order": "sts, external, local", 2020-11-16T20:55:22.911 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_s3_auth_use_keystone": "false", 2020-11-16T20:55:22.911 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_s3_auth_use_ldap": "false", 2020-11-16T20:55:22.911 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_s3_auth_use_rados": "true", 2020-11-16T20:55:22.912 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_s3_auth_use_sts": "false", 2020-11-16T20:55:22.912 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_s3_success_create_obj_status": "0", 2020-11-16T20:55:22.912 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_safe_max_objects_per_shard": "102400", 2020-11-16T20:55:22.912 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_scheduler_type": "throttler", 2020-11-16T20:55:22.912 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_script_uri": "", 2020-11-16T20:55:22.912 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_service_provider_name": "", 2020-11-16T20:55:22.912 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_shard_warning_threshold": "90.000000", 2020-11-16T20:55:22.912 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_socket_path": "", 2020-11-16T20:55:22.913 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_sts_client_id": "", 2020-11-16T20:55:22.913 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_sts_client_secret": "", 2020-11-16T20:55:22.913 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_sts_entry": "sts", 2020-11-16T20:55:22.913 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_sts_key": "sts", 2020-11-16T20:55:22.913 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_sts_max_session_duration": "43200", 2020-11-16T20:55:22.913 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_sts_min_session_duration": "900", 2020-11-16T20:55:22.913 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_sts_token_introspection_url": "", 2020-11-16T20:55:22.914 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_swift_account_in_url": "false", 2020-11-16T20:55:22.914 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_swift_auth_entry": "auth", 2020-11-16T20:55:22.914 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_swift_auth_url": "", 2020-11-16T20:55:22.914 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_swift_custom_header": "", 2020-11-16T20:55:22.914 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_swift_enforce_content_length": "false", 2020-11-16T20:55:22.914 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_swift_need_stats": "true", 2020-11-16T20:55:22.914 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_swift_tenant_name": "", 2020-11-16T20:55:22.914 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_swift_token_expiration": "86400", 2020-11-16T20:55:22.915 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_swift_url": "", 2020-11-16T20:55:22.915 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_swift_url_prefix": "swift", 2020-11-16T20:55:22.915 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_swift_versioning_enabled": "false", 2020-11-16T20:55:22.915 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2020-11-16T20:55:22.915 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_sync_lease_period": "120", 2020-11-16T20:55:22.915 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2020-11-16T20:55:22.915 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_sync_log_trim_interval": "1200", 2020-11-16T20:55:22.915 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_sync_log_trim_max_buckets": "16", 2020-11-16T20:55:22.916 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2020-11-16T20:55:22.916 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2020-11-16T20:55:22.916 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_sync_obj_etag_verify": "false", 2020-11-16T20:55:22.916 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_sync_trace_history_size": "4096", 2020-11-16T20:55:22.916 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_sync_trace_per_node_log_size": "32", 2020-11-16T20:55:22.916 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2020-11-16T20:55:22.916 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_thread_pool_size": "512", 2020-11-16T20:55:22.917 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_torrent_comment": "", 2020-11-16T20:55:22.917 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_torrent_createby": "", 2020-11-16T20:55:22.917 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_torrent_encoding": "", 2020-11-16T20:55:22.917 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_torrent_flag": "false", 2020-11-16T20:55:22.917 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_torrent_origin": "", 2020-11-16T20:55:22.917 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_torrent_sha_unit": "524288", 2020-11-16T20:55:22.917 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_torrent_tracker": "", 2020-11-16T20:55:22.917 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_trust_forwarded_https": "false", 2020-11-16T20:55:22.918 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_usage_log_flush_threshold": "1024", 2020-11-16T20:55:22.918 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_usage_log_tick_interval": "30", 2020-11-16T20:55:22.918 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_usage_max_shards": "32", 2020-11-16T20:55:22.918 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_usage_max_user_shards": "1", 2020-11-16T20:55:22.918 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_use_opa_authz": "false", 2020-11-16T20:55:22.918 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_user_default_quota_max_objects": "-1", 2020-11-16T20:55:22.918 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_user_default_quota_max_size": "-1", 2020-11-16T20:55:22.919 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_user_max_buckets": "1000", 2020-11-16T20:55:22.919 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2020-11-16T20:55:22.919 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_user_quota_sync_idle_users": "false", 2020-11-16T20:55:22.919 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_user_quota_sync_interval": "86400", 2020-11-16T20:55:22.919 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_user_quota_sync_wait_time": "86400", 2020-11-16T20:55:22.919 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_user_unique_email": "true", 2020-11-16T20:55:22.919 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_verify_ssl": "true", 2020-11-16T20:55:22.919 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_website_routing_rules_max_num": "50", 2020-11-16T20:55:22.920 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_zone": "", 2020-11-16T20:55:22.920 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_zone_root_pool": ".rgw.root", 2020-11-16T20:55:22.920 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_zonegroup": "", 2020-11-16T20:55:22.920 INFO:teuthology.orchestra.run.smithi166.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2020-11-16T20:55:22.920 INFO:teuthology.orchestra.run.smithi166.stdout: "rocksdb_block_size": "4096", 2020-11-16T20:55:22.920 INFO:teuthology.orchestra.run.smithi166.stdout: "rocksdb_bloom_bits_per_key": "20", 2020-11-16T20:55:22.920 INFO:teuthology.orchestra.run.smithi166.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2020-11-16T20:55:22.920 INFO:teuthology.orchestra.run.smithi166.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "true", 2020-11-16T20:55:22.921 INFO:teuthology.orchestra.run.smithi166.stdout: "rocksdb_cache_row_ratio": "0.000000", 2020-11-16T20:55:22.921 INFO:teuthology.orchestra.run.smithi166.stdout: "rocksdb_cache_shard_bits": "4", 2020-11-16T20:55:22.921 INFO:teuthology.orchestra.run.smithi166.stdout: "rocksdb_cache_size": "536870912", 2020-11-16T20:55:22.921 INFO:teuthology.orchestra.run.smithi166.stdout: "rocksdb_cache_type": "binned_lru", 2020-11-16T20:55:22.921 INFO:teuthology.orchestra.run.smithi166.stdout: "rocksdb_collect_compaction_stats": "false", 2020-11-16T20:55:22.921 INFO:teuthology.orchestra.run.smithi166.stdout: "rocksdb_collect_extended_stats": "false", 2020-11-16T20:55:22.921 INFO:teuthology.orchestra.run.smithi166.stdout: "rocksdb_collect_memory_stats": "false", 2020-11-16T20:55:22.922 INFO:teuthology.orchestra.run.smithi166.stdout: "rocksdb_delete_range_threshold": "1048576", 2020-11-16T20:55:22.922 INFO:teuthology.orchestra.run.smithi166.stdout: "rocksdb_index_type": "binary_search", 2020-11-16T20:55:22.922 INFO:teuthology.orchestra.run.smithi166.stdout: "rocksdb_log_to_ceph_log": "true", 2020-11-16T20:55:22.922 INFO:teuthology.orchestra.run.smithi166.stdout: "rocksdb_metadata_block_size": "4096", 2020-11-16T20:55:22.922 INFO:teuthology.orchestra.run.smithi166.stdout: "rocksdb_partition_filters": "false", 2020-11-16T20:55:22.922 INFO:teuthology.orchestra.run.smithi166.stdout: "rocksdb_perf": "false", 2020-11-16T20:55:22.922 INFO:teuthology.orchestra.run.smithi166.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2020-11-16T20:55:22.922 INFO:teuthology.orchestra.run.smithi166.stdout: "rotating_keys_bootstrap_timeout": "30", 2020-11-16T20:55:22.923 INFO:teuthology.orchestra.run.smithi166.stdout: "rotating_keys_renewal_timeout": "10", 2020-11-16T20:55:22.923 INFO:teuthology.orchestra.run.smithi166.stdout: "run_dir": "/var/run/ceph", 2020-11-16T20:55:22.923 INFO:teuthology.orchestra.run.smithi166.stdout: "setgroup": "", 2020-11-16T20:55:22.923 INFO:teuthology.orchestra.run.smithi166.stdout: "setuser": "", 2020-11-16T20:55:22.923 INFO:teuthology.orchestra.run.smithi166.stdout: "setuser_match_path": "", 2020-11-16T20:55:22.923 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_misplaced_ratio": "0.050000", 2020-11-16T20:55:22.923 INFO:teuthology.orchestra.run.smithi166.stdout: "thp": "false", 2020-11-16T20:55:22.924 INFO:teuthology.orchestra.run.smithi166.stdout: "threadpool_default_timeout": "60", 2020-11-16T20:55:22.924 INFO:teuthology.orchestra.run.smithi166.stdout: "threadpool_empty_queue_max_wait": "2", 2020-11-16T20:55:22.924 INFO:teuthology.orchestra.run.smithi166.stdout: "throttler_perf_counter": "true" 2020-11-16T20:55:22.924 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:22.926 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2020-11-16T20:55:23.059 INFO:teuthology.orchestra.run.smithi166.stdout:mon.b: {} 2020-11-16T20:55:23.069 INFO:teuthology.orchestra.run.smithi166.stdout:mon.a: {} 2020-11-16T20:55:23.079 INFO:teuthology.orchestra.run.smithi166.stdout:mon.c: {} 2020-11-16T20:55:23.080 INFO:teuthology.orchestra.run.smithi166.stderr:mon.b: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2020-11-16T20:55:23.080 INFO:teuthology.orchestra.run.smithi166.stderr:mon.a: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2020-11-16T20:55:23.080 INFO:teuthology.orchestra.run.smithi166.stderr:mon.c: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2020-11-16T20:55:23.090 INFO:teuthology.orchestra.run.smithi059:> type ceph-objectstore-tool 2020-11-16T20:55:23.107 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2020-11-16T20:55:23.107 INFO:teuthology.orchestra.run.smithi166:> type ceph-objectstore-tool 2020-11-16T20:55:23.121 INFO:teuthology.orchestra.run.smithi166.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2020-11-16T20:55:23.121 INFO:teuthology.run_tasks:Running task exec... 2020-11-16T20:55:23.131 INFO:teuthology.task.exec:Executing custom commands... 2020-11-16T20:55:23.131 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi166.front.sepia.ceph.com 2020-11-16T20:55:23.131 INFO:teuthology.orchestra.run.smithi166:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool create base 4' 2020-11-16T20:55:23.132 INFO:tasks.thrashosds.thrasher:starting do_thrash 2020-11-16T20:55:23.132 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:55:23.132 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:55:23.132 INFO:tasks.thrashosds.thrasher:inject_pause on 2 2020-11-16T20:55:23.132 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2020-11-16T20:55:23.133 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2020-11-16T20:55:23.133 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2020-11-16T20:55:23.133 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2020-11-16T20:55:23.134 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2020-11-16T20:55:23.134 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:55:23.134 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2020-11-16T20:55:23.135 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:55:23.135 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2020-11-16T20:55:23.135 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2020-11-16T20:55:23.149 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:55:23.153+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:55:23.236 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:55:23.240+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:55:23.303 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:23.303 INFO:teuthology.orchestra.run.smithi166.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2020-11-16T20:55:23.303 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:23.309 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:23.309 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:55:23.310 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:55:23.310 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:23.321 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:55:23.336 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:55:23.341+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:55:23.371 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:55:23.401 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:55:23.603 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:55:23.603 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:55:23.603 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:55:23.604 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:55:23.604 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:55:23.604 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:55:23.604 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:23.605 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:23.605 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:55:23.606 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:55:23.606 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:55:23.606 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:55:23.607 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:55:23.607 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:55:23.607 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:55:23.607 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:55:23.607 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:55:23.608 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:55:23.606+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:55:23.702 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:55:23.706+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:55:23.768 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:23.769 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:23.778 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:55:23.791 INFO:teuthology.orchestra.run.smithi166.stderr:noscrub is set 2020-11-16T20:55:23.791 INFO:teuthology.orchestra.run.smithi166.stderr:pool 'base' created 2020-11-16T20:55:23.802 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:55:23.807+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:55:23.811 INFO:teuthology.orchestra.run.smithi166:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool application enable base rados' 2020-11-16T20:55:23.903 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:23.908+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:23.925 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:23.925 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:23.935 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:55:24.018 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:24.023+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:24.106 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:55:24.110+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:55:28.359 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:55:28.360 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2020-11-16T20:55:28.360 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:55:28.360 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:55:28.360 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2020-11-16T20:55:28.361 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 1.0 2020-11-16T20:55:28.362 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:28.363 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:28.363 INFO:teuthology.orchestra.run.smithi166.stderr:enabled application 'rados' on pool 'base' 2020-11-16T20:55:28.363 INFO:teuthology.orchestra.run.smithi166:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool create cache 4' 2020-11-16T20:55:28.364 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:55:28.364+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:55:28.364 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:55:28.460 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:55:28.465+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:55:28.561 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:55:28.565+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:55:28.562 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:28.562 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:28.574 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:55:28.613 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:55:28.635 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:55:28.658 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:55:28.662 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:55:28.666+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:55:28.679 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:55:28.700 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:55:28.721 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:55:28.761 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:55:28.763 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:55:28.767+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:55:28.794 INFO:teuthology.orchestra.run.smithi166.stdout:moved 0 / 39 (0%) 2020-11-16T20:55:28.795 INFO:teuthology.orchestra.run.smithi166.stdout:avg 4.875 2020-11-16T20:55:28.795 INFO:teuthology.orchestra.run.smithi166.stdout:stddev 1.53603 -> 1.53603 (expected baseline 2.06534) 2020-11-16T20:55:28.795 INFO:teuthology.orchestra.run.smithi166.stdout:min osd.3 with 3 -> 3 pgs (0.615385 -> 0.615385 * mean) 2020-11-16T20:55:28.795 INFO:teuthology.orchestra.run.smithi166.stdout:max osd.0 with 7 -> 7 pgs (1.4359 -> 1.4359 * mean) 2020-11-16T20:55:28.795 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:55:28.795 INFO:teuthology.orchestra.run.smithi166.stdout:oload 110 2020-11-16T20:55:28.795 INFO:teuthology.orchestra.run.smithi166.stdout:max_change 1 2020-11-16T20:55:28.796 INFO:teuthology.orchestra.run.smithi166.stdout:max_change_osds 4 2020-11-16T20:55:28.796 INFO:teuthology.orchestra.run.smithi166.stdout:average_utilization 0.0001 2020-11-16T20:55:28.796 INFO:teuthology.orchestra.run.smithi166.stdout:overload_utilization 0.0001 2020-11-16T20:55:28.797 INFO:teuthology.orchestra.run.smithi166.stderr:no change 2020-11-16T20:55:28.797 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:28.797 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:55:28.797 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:55:28.798 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:28.800 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:55:28.802 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:55:28.803 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:55:28.803 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:55:28.803 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:55:28.803 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:55:28.803 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:55:28.803 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:55:28.804 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:55:28.811 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:55:28.816 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2020-11-16T20:55:28.817 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 1.0 2020-11-16T20:55:28.864 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:55:28.868+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:55:28.965 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:55:28.969+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:55:28.987 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:28.987 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:55:28.987 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:55:28.988 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:55:28.988 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:28.998 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:55:29.065 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:55:29.070+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:55:29.127 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:29.127 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:55:29.127 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:55:29.127 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [] 2020-11-16T20:55:29.127 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:29.136 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:55:29.161 INFO:teuthology.orchestra.run.smithi166.stdout:moved 0 / 39 (0%) 2020-11-16T20:55:29.161 INFO:teuthology.orchestra.run.smithi166.stdout:avg 4.875 2020-11-16T20:55:29.162 INFO:teuthology.orchestra.run.smithi166.stdout:stddev 1.53603 -> 1.53603 (expected baseline 2.06534) 2020-11-16T20:55:29.162 INFO:teuthology.orchestra.run.smithi166.stdout:min osd.3 with 3 -> 3 pgs (0.615385 -> 0.615385 * mean) 2020-11-16T20:55:29.162 INFO:teuthology.orchestra.run.smithi166.stdout:max osd.0 with 7 -> 7 pgs (1.4359 -> 1.4359 * mean) 2020-11-16T20:55:29.162 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:55:29.162 INFO:teuthology.orchestra.run.smithi166.stdout:oload 1000 2020-11-16T20:55:29.162 INFO:teuthology.orchestra.run.smithi166.stdout:max_change 1 2020-11-16T20:55:29.163 INFO:teuthology.orchestra.run.smithi166.stdout:max_change_osds 4 2020-11-16T20:55:29.163 INFO:teuthology.orchestra.run.smithi166.stdout:average_utilization 0.0001 2020-11-16T20:55:29.163 INFO:teuthology.orchestra.run.smithi166.stdout:overload_utilization 0.0005 2020-11-16T20:55:29.164 INFO:teuthology.orchestra.run.smithi166.stderr:no change 2020-11-16T20:55:29.166 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:55:29.170+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:55:29.174 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2020-11-16T20:55:29.175 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 0.05 2020-11-16T20:55:29.267 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:29.270+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:29.268 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:29.269 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:55:29.269 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:55:29.269 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:29.279 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:55:29.368 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:55:29.372+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:55:29.450 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:29.451 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:55:29.451 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:55:29.451 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:55:29.451 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:29.460 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:55:29.468 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:55:29.473+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:55:29.520 INFO:teuthology.orchestra.run.smithi166.stdout:moved 0 / 39 (0%) 2020-11-16T20:55:29.521 INFO:teuthology.orchestra.run.smithi166.stdout:avg 4.875 2020-11-16T20:55:29.521 INFO:teuthology.orchestra.run.smithi166.stdout:stddev 1.53603 -> 1.53603 (expected baseline 2.06534) 2020-11-16T20:55:29.521 INFO:teuthology.orchestra.run.smithi166.stdout:min osd.3 with 3 -> 3 pgs (0.615385 -> 0.615385 * mean) 2020-11-16T20:55:29.521 INFO:teuthology.orchestra.run.smithi166.stdout:max osd.0 with 7 -> 7 pgs (1.4359 -> 1.4359 * mean) 2020-11-16T20:55:29.521 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:55:29.521 INFO:teuthology.orchestra.run.smithi166.stdout:oload 110 2020-11-16T20:55:29.521 INFO:teuthology.orchestra.run.smithi166.stdout:max_change 0.05 2020-11-16T20:55:29.522 INFO:teuthology.orchestra.run.smithi166.stdout:max_change_osds 4 2020-11-16T20:55:29.522 INFO:teuthology.orchestra.run.smithi166.stdout:average_utilization 0.0001 2020-11-16T20:55:29.522 INFO:teuthology.orchestra.run.smithi166.stdout:overload_utilization 0.0001 2020-11-16T20:55:29.523 INFO:teuthology.orchestra.run.smithi166.stderr:no change 2020-11-16T20:55:29.533 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2020-11-16T20:55:29.534 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 1.0 2020-11-16T20:55:29.577 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:55:29.581+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:55:29.592 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:29.592 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:55:29.592 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:55:29.592 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [] 2020-11-16T20:55:29.593 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:29.603 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:55:29.669 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:55:29.673+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:55:29.753 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:55:29.753 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:55:29.753 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:55:29.753 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:55:29.762 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:55:29.770 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:55:29.774+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:55:33.999 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:55:34.001 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:55:34.003+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:55:34.001 INFO:teuthology.orchestra.run.smithi166.stderr:pool 'cache' created 2020-11-16T20:55:34.002 INFO:teuthology.orchestra.run.smithi166.stderr:nodeep-scrub is set 2020-11-16T20:55:34.002 INFO:teuthology.orchestra.run.smithi166.stdout:moved 0 / 51 (0%) 2020-11-16T20:55:34.002 INFO:teuthology.orchestra.run.smithi166.stdout:avg 6.375 2020-11-16T20:55:34.002 INFO:teuthology.orchestra.run.smithi166.stdout:stddev 1.72753 -> 1.72753 (expected baseline 2.36181) 2020-11-16T20:55:34.003 INFO:teuthology.orchestra.run.smithi166.stdout:min osd.2 with 4 -> 4 pgs (0.627451 -> 0.627451 * mean) 2020-11-16T20:55:34.003 INFO:teuthology.orchestra.run.smithi166.stdout:max osd.0 with 9 -> 9 pgs (1.41176 -> 1.41176 * mean) 2020-11-16T20:55:34.003 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:55:34.003 INFO:teuthology.orchestra.run.smithi166.stdout:oload 110 2020-11-16T20:55:34.003 INFO:teuthology.orchestra.run.smithi166.stdout:max_change 1 2020-11-16T20:55:34.003 INFO:teuthology.orchestra.run.smithi166.stdout:max_change_osds 4 2020-11-16T20:55:34.003 INFO:teuthology.orchestra.run.smithi166.stdout:average_utilization 0.0001 2020-11-16T20:55:34.004 INFO:teuthology.orchestra.run.smithi166.stdout:overload_utilization 0.0001 2020-11-16T20:55:34.004 INFO:teuthology.orchestra.run.smithi166.stderr:no change 2020-11-16T20:55:34.004 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2020-11-16T20:55:34.004 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 0.05 2020-11-16T20:55:34.005 INFO:teuthology.orchestra.run.smithi166:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier add base cache' 2020-11-16T20:55:34.100 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:55:34.104+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:55:34.148 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:55:34.148 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:55:34.148 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:55:34.149 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:55:34.149 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:55:34.157 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:55:34.209 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:55:34.229 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:55:34.240 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:55:34.245+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:55:34.248 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:55:34.303 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:55:34.307+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:55:34.333 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:55:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:55:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:55:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [] 2020-11-16T20:55:38.547 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:55:38.548 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2020-11-16T20:55:38.550 INFO:teuthology.orchestra.run.smithi166.stdout:moved 0 / 51 (0%) 2020-11-16T20:55:38.551 INFO:teuthology.orchestra.run.smithi166.stdout:avg 6.375 2020-11-16T20:55:38.551 INFO:teuthology.orchestra.run.smithi166.stdout:stddev 1.72753 -> 1.72753 (expected baseline 2.36181) 2020-11-16T20:55:38.551 INFO:teuthology.orchestra.run.smithi166.stdout:min osd.2 with 4 -> 4 pgs (0.627451 -> 0.627451 * mean) 2020-11-16T20:55:38.551 INFO:teuthology.orchestra.run.smithi166.stdout:max osd.0 with 9 -> 9 pgs (1.41176 -> 1.41176 * mean) 2020-11-16T20:55:38.551 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:55:38.551 INFO:teuthology.orchestra.run.smithi166.stdout:oload 110 2020-11-16T20:55:38.551 INFO:teuthology.orchestra.run.smithi166.stdout:max_change 0.05 2020-11-16T20:55:38.552 INFO:teuthology.orchestra.run.smithi166.stdout:max_change_osds 4 2020-11-16T20:55:38.552 INFO:teuthology.orchestra.run.smithi166.stdout:average_utilization 0.0001 2020-11-16T20:55:38.552 INFO:teuthology.orchestra.run.smithi166.stdout:overload_utilization 0.0001 2020-11-16T20:55:38.552 INFO:teuthology.orchestra.run.smithi166.stderr:no change 2020-11-16T20:55:38.552 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:55:38.552 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:55:38.553 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:55:38.553 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:55:38.553 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:55:38.553 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:55:38.553 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:55:38.553 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:55:38.553 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:55:38.554 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:55:38.554 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:55:38.554 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:55:38.554 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:55:38.554 INFO:teuthology.orchestra.run.smithi166.stderr:pool 'cache' is now (or already was) a tier of 'base' 2020-11-16T20:55:38.555 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:38.552+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:38.555 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:55:38.556 INFO:teuthology.orchestra.run.smithi166:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier cache-mode cache writeback' 2020-11-16T20:55:38.649 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:55:38.653+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:55:38.740 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:38.740 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:38.750 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:55:38.750 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:55:38.754+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:55:38.851 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:55:38.855+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:55:38.925 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:38.925 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:38.934 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:55:38.952 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:55:38.956+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:55:39.053 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:55:39.057+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:55:39.110 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:39.111 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:39.121 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:55:39.153 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:39.158+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:39.254 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:55:39.258+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:55:39.296 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:39.296 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:39.305 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:55:39.355 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:55:39.360+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:55:39.440 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:39.440 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:39.449 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:55:39.489 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:55:39.494+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:55:39.558 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:39.562+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:39.625 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:39.625 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:39.634 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:55:39.659 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:55:39.663+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:55:39.759 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:55:39.763+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:55:39.769 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:39.769 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:39.779 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:55:39.849 INFO:teuthology.orchestra.run.smithi166.stderr:noscrub is unset 2020-11-16T20:55:39.849 INFO:teuthology.orchestra.run.smithi166.stderr:set cache-mode for pool 'cache' to writeback 2020-11-16T20:55:39.860 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:55:39.864+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:55:39.863 INFO:teuthology.orchestra.run.smithi166:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier set-overlay base cache' 2020-11-16T20:55:39.916 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:39.916 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:39.925 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:55:39.960 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:39.964+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:40.061 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:40.065+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:40.100 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:40.101 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:40.110 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:55:40.162 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:55:40.166+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:55:40.238 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:40.238 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:40.248 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:55:40.263 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:55:40.268+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:55:40.364 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:55:40.368+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:55:40.414 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:40.414 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:40.424 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:55:40.465 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:40.469+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:40.555 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:55:40.591 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:40.592 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:40.592 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:55:40.596+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:55:40.602 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:55:40.667 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:55:40.672+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:55:40.701 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:55:40.721 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:55:40.741 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:55:40.761 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:55:40.768 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:55:40.772+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:55:40.773 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:40.774 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:55:40.774 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:55:40.774 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:40.782 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:55:40.783 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:55:40.802 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:55:40.824 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:55:40.845 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:55:40.847 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:55:40.847 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:55:40.847 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:55:40.847 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:55:40.847 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:55:40.848 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:55:40.848 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:55:40.848 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:55:40.851 INFO:teuthology.orchestra.run.smithi166.stderr:overlay for 'base' is now (or already was) 'cache' 2020-11-16T20:55:40.863 INFO:teuthology.orchestra.run.smithi166:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_type bloom' 2020-11-16T20:55:40.869 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:55:40.874+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:55:40.936 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:40.936 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:55:40.936 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:55:40.937 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:55:40.937 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:40.947 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:55:40.988 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:55:40.992+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:55:41.070 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:55:41.074+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:55:41.119 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:41.120 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:55:41.120 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:55:41.120 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [] 2020-11-16T20:55:41.120 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:41.129 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:55:41.171 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:55:41.175+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:55:41.272 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:55:41.277+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:55:41.295 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:41.295 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:55:41.295 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:55:41.295 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:41.305 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:55:41.373 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:55:41.377+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:55:41.431 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:41.431 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:55:41.431 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:55:41.432 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:55:41.432 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:41.440 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:55:41.481 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:55:41.485+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:55:41.575 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:55:41.580+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:55:41.605 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:41.606 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:55:41.606 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:55:41.606 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [] 2020-11-16T20:55:41.606 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:41.615 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:55:41.677 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:55:41.681+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:55:41.741 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:41.741 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:55:41.742 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:55:41.742 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:41.750 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:55:41.794 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:55:41.798+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:55:41.860 INFO:teuthology.orchestra.run.smithi166.stderr:set pool 4 hit_set_type to bloom 2020-11-16T20:55:41.863 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2020-11-16T20:55:41.875 INFO:teuthology.orchestra.run.smithi166:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_count 8' 2020-11-16T20:55:41.879 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:55:41.884+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:55:41.886 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:41.886 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:55:41.886 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:55:41.887 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:55:41.887 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:41.898 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:55:41.983 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:55:41.987+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:55:42.080 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:55:42.084+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:55:42.081 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:42.082 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:55:42.082 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:55:42.082 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [] 2020-11-16T20:55:42.082 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:42.091 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:55:42.181 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:55:42.185+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:55:42.242 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:55:42.242 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:55:42.243 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:55:42.243 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:55:42.252 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:55:42.283 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:42.286+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:42.383 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:55:42.387+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:55:46.611 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:55:46.611 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:55:46.611 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:55:46.612 INFO:tasks.thrashosds.thrasher:Growing pool rbd 2020-11-16T20:55:46.613 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-16T20:55:46.614 INFO:teuthology.orchestra.run.smithi166.stderr:set pool 4 hit_set_count to 8 2020-11-16T20:55:46.615 INFO:teuthology.orchestra.run.smithi166.stderr:nodeep-scrub is unset 2020-11-16T20:55:46.615 INFO:teuthology.orchestra.run.smithi166:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_period 3600' 2020-11-16T20:55:46.616 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:55:46.616 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:55:46.616 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:55:46.616 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:55:46.617 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:55:46.617 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:55:46.614+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:55:46.617 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:55:46.712 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:46.716+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:46.803 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:55:46.803 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:55:46.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:55:46.804 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [] 2020-11-16T20:55:46.804 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:55:46.813 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:55:46.816+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:55:46.813 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:55:46.817 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:55:46.838 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:55:46.858 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:55:46.879 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:55:46.900 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:55:46.914 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:55:46.917+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:55:46.920 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:55:46.941 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:55:46.961 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:55:46.962 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:55:46.962 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:55:46.962 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:55:46.962 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:55:46.962 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:55:46.963 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:55:46.963 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:55:46.963 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:55:46.991 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:46.991 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:46.992 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:55:46.993 INFO:teuthology.orchestra.run.smithi166.stderr:dumped all 2020-11-16T20:55:47.000 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:55:47.004 INFO:teuthology.orchestra.run.smithi166.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2020-11-16T20:55:45.081938+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41176,"kb_used_data":2136,"kb_used_omap":0,"kb_used_meta":38976,"kb_avail":754933544,"statfs":{"total":773094113280,"available":773051949056,"internally_reserved":0,"allocated":2187264,"data_stored":832984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39911424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.232967"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":"20","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-16T20:55:40.122842+0000","last_change":"2020-11-16T20:54:55.362484+0000","last_active":"2020-11-16T20:55:40.122842+0000","last_peered":"2020-11-16T20:55:40.122842+0000","last_clean":"2020-11-16T20:55:40.122842+0000","last_became_active":"2020-11-16T20:54:55.362005+0000","last_became_peered":"2020-11-16T20:54:55.362005+0000","last_unstale":"2020-11-16T20:55:40.122842+0000","last_undegraded":"2020-11-16T20:55:40.122842+0000","last_fullsized":"2020-11-16T20:55:40.122842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"13","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-16T20:55:40.122745+0000","last_change":"2020-11-16T20:55:30.829098+0000","last_active":"2020-11-16T20:55:40.122745+0000","last_peered":"2020-11-16T20:55:40.122745+0000","last_clean":"2020-11-16T20:55:40.122745+0000","last_became_active":"2020-11-16T20:55:30.828637+0000","last_became_peered":"2020-11-16T20:55:30.828637+0000","last_unstale":"2020-11-16T20:55:40.122745+0000","last_undegraded":"2020-11-16T20:55:40.122745+0000","last_fullsized":"2020-11-16T20:55:40.122745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"22","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-16T20:55:42.132129+0000","last_change":"2020-11-16T20:54:55.120346+0000","last_active":"2020-11-16T20:55:42.132129+0000","last_peered":"2020-11-16T20:55:42.132129+0000","last_clean":"2020-11-16T20:55:42.132129+0000","last_became_active":"2020-11-16T20:54:55.119771+0000","last_became_peered":"2020-11-16T20:54:55.119771+0000","last_unstale":"2020-11-16T20:55:42.132129+0000","last_undegraded":"2020-11-16T20:55:42.132129+0000","last_fullsized":"2020-11-16T20:55:42.132129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-16T20:55:39.850476+0000","last_change":"2020-11-16T20:55:25.104497+0000","last_active":"2020-11-16T20:55:39.850476+0000","last_peered":"2020-11-16T20:55:39.850476+0000","last_clean":"2020-11-16T20:55:39.850476+0000","last_became_active":"2020-11-16T20:55:25.103851+0000","last_became_peered":"2020-11-16T20:55:25.103851+0000","last_unstale":"2020-11-16T20:55:39.850476+0000","last_undegraded":"2020-11-16T20:55:39.850476+0000","last_fullsized":"2020-11-16T20:55:39.850476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"21","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-16T20:55:41.385012+0000","last_change":"2020-11-16T20:54:55.362510+0000","last_active":"2020-11-16T20:55:41.385012+0000","last_peered":"2020-11-16T20:55:41.385012+0000","last_clean":"2020-11-16T20:55:41.385012+0000","last_became_active":"2020-11-16T20:54:55.362052+0000","last_became_peered":"2020-11-16T20:54:55.362052+0000","last_unstale":"2020-11-16T20:55:41.385012+0000","last_undegraded":"2020-11-16T20:55:41.385012+0000","last_fullsized":"2020-11-16T20:55:41.385012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-16T20:55:40.122664+0000","last_change":"2020-11-16T20:55:25.104413+0000","last_active":"2020-11-16T20:55:40.122664+0000","last_peered":"2020-11-16T20:55:40.122664+0000","last_clean":"2020-11-16T20:55:40.122664+0000","last_became_active":"2020-11-16T20:55:25.103928+0000","last_became_peered":"2020-11-16T20:55:25.103928+0000","last_unstale":"2020-11-16T20:55:40.122664+0000","last_undegraded":"2020-11-16T20:55:40.122664+0000","last_fullsized":"2020-11-16T20:55:40.122664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"22","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-16T20:55:42.132184+0000","last_change":"2020-11-16T20:54:55.120010+0000","last_active":"2020-11-16T20:55:42.132184+0000","last_peered":"2020-11-16T20:55:42.132184+0000","last_clean":"2020-11-16T20:55:42.132184+0000","last_became_active":"2020-11-16T20:54:55.118978+0000","last_became_peered":"2020-11-16T20:54:55.118978+0000","last_unstale":"2020-11-16T20:55:42.132184+0000","last_undegraded":"2020-11-16T20:55:42.132184+0000","last_fullsized":"2020-11-16T20:55:42.132184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-16T20:55:39.848825+0000","last_change":"2020-11-16T20:54:53.112612+0000","last_active":"2020-11-16T20:55:39.848825+0000","last_peered":"2020-11-16T20:55:39.848825+0000","last_clean":"2020-11-16T20:55:39.848825+0000","last_became_active":"2020-11-16T20:54:53.112038+0000","last_became_peered":"2020-11-16T20:54:53.112038+0000","last_unstale":"2020-11-16T20:55:39.848825+0000","last_undegraded":"2020-11-16T20:55:39.848825+0000","last_fullsized":"2020-11-16T20:55:39.848825+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:50.068882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:50.068882+0000","last_clean_scrub_stamp":"2020-11-16T20:54:50.068882+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"17","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-16T20:55:41.304323+0000","last_change":"2020-11-16T20:55:25.106625+0000","last_active":"2020-11-16T20:55:41.304323+0000","last_peered":"2020-11-16T20:55:41.304323+0000","last_clean":"2020-11-16T20:55:41.304323+0000","last_became_active":"2020-11-16T20:55:25.106302+0000","last_became_peered":"2020-11-16T20:55:25.106302+0000","last_unstale":"2020-11-16T20:55:41.304323+0000","last_undegraded":"2020-11-16T20:55:41.304323+0000","last_fullsized":"2020-11-16T20:55:41.304323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"20","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-16T20:55:39.848886+0000","last_change":"2020-11-16T20:54:55.362453+0000","last_active":"2020-11-16T20:55:39.848886+0000","last_peered":"2020-11-16T20:55:39.848886+0000","last_clean":"2020-11-16T20:55:39.848886+0000","last_became_active":"2020-11-16T20:54:55.362030+0000","last_became_peered":"2020-11-16T20:54:55.362030+0000","last_unstale":"2020-11-16T20:55:39.848886+0000","last_undegraded":"2020-11-16T20:55:39.848886+0000","last_fullsized":"2020-11-16T20:55:39.848886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-16T20:55:41.860381+0000","last_change":"2020-11-16T20:55:24.803143+0000","last_active":"2020-11-16T20:55:41.860381+0000","last_peered":"2020-11-16T20:55:41.860381+0000","last_clean":"2020-11-16T20:55:41.860381+0000","last_became_active":"2020-11-16T20:55:24.802649+0000","last_became_peered":"2020-11-16T20:55:24.802649+0000","last_unstale":"2020-11-16T20:55:41.860381+0000","last_undegraded":"2020-11-16T20:55:41.860381+0000","last_fullsized":"2020-11-16T20:55:41.860381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-16T20:55:41.860789+0000","last_change":"2020-11-16T20:55:30.830279+0000","last_active":"2020-11-16T20:55:41.860789+0000","last_peered":"2020-11-16T20:55:41.860789+0000","last_clean":"2020-11-16T20:55:41.860789+0000","last_became_active":"2020-11-16T20:55:30.829833+0000","last_became_peered":"2020-11-16T20:55:30.829833+0000","last_unstale":"2020-11-16T20:55:41.860789+0000","last_undegraded":"2020-11-16T20:55:41.860789+0000","last_fullsized":"2020-11-16T20:55:41.860789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"20","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-16T20:55:39.848852+0000","last_change":"2020-11-16T20:54:55.579361+0000","last_active":"2020-11-16T20:55:39.848852+0000","last_peered":"2020-11-16T20:55:39.848852+0000","last_clean":"2020-11-16T20:55:39.848852+0000","last_became_active":"2020-11-16T20:54:55.578864+0000","last_became_peered":"2020-11-16T20:54:55.578864+0000","last_unstale":"2020-11-16T20:55:39.848852+0000","last_undegraded":"2020-11-16T20:55:39.848852+0000","last_fullsized":"2020-11-16T20:55:39.848852+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"20","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-16T20:55:40.122749+0000","last_change":"2020-11-16T20:54:55.579264+0000","last_active":"2020-11-16T20:55:40.122749+0000","last_peered":"2020-11-16T20:55:40.122749+0000","last_clean":"2020-11-16T20:55:40.122749+0000","last_became_active":"2020-11-16T20:54:55.578907+0000","last_became_peered":"2020-11-16T20:54:55.578907+0000","last_unstale":"2020-11-16T20:55:40.122749+0000","last_undegraded":"2020-11-16T20:55:40.122749+0000","last_fullsized":"2020-11-16T20:55:40.122749+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-16T20:55:41.304338+0000","last_change":"2020-11-16T20:55:30.827982+0000","last_active":"2020-11-16T20:55:41.304338+0000","last_peered":"2020-11-16T20:55:41.304338+0000","last_clean":"2020-11-16T20:55:41.304338+0000","last_became_active":"2020-11-16T20:55:30.827526+0000","last_became_peered":"2020-11-16T20:55:30.827526+0000","last_unstale":"2020-11-16T20:55:41.304338+0000","last_undegraded":"2020-11-16T20:55:41.304338+0000","last_fullsized":"2020-11-16T20:55:41.304338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"20","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-16T20:55:40.123003+0000","last_change":"2020-11-16T20:54:55.119464+0000","last_active":"2020-11-16T20:55:40.123003+0000","last_peered":"2020-11-16T20:55:40.123003+0000","last_clean":"2020-11-16T20:55:40.123003+0000","last_became_active":"2020-11-16T20:54:55.118917+0000","last_became_peered":"2020-11-16T20:54:55.118917+0000","last_unstale":"2020-11-16T20:55:40.123003+0000","last_undegraded":"2020-11-16T20:55:40.123003+0000","last_fullsized":"2020-11-16T20:55:40.123003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"13","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-16T20:55:39.850465+0000","last_change":"2020-11-16T20:55:31.121139+0000","last_active":"2020-11-16T20:55:39.850465+0000","last_peered":"2020-11-16T20:55:39.850465+0000","last_clean":"2020-11-16T20:55:39.850465+0000","last_became_active":"2020-11-16T20:55:31.120583+0000","last_became_peered":"2020-11-16T20:55:31.120583+0000","last_unstale":"2020-11-16T20:55:39.850465+0000","last_undegraded":"2020-11-16T20:55:39.850465+0000","last_fullsized":"2020-11-16T20:55:39.850465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":7},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5136,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366704,"statfs":{"total":96636764160,"available":96631504896,"internally_reserved":0,"allocated":270336,"data_stored":102760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]}]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5136,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366704,"statfs":{"total":96636764160,"available":96631504896,"internally_reserved":0,"allocated":270336,"data_stored":102760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5136,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366704,"statfs":{"total":96636764160,"available":96631504896,"internally_reserved":0,"allocated":270336,"data_stored":102760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5224,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366616,"statfs":{"total":96636764160,"available":96631414784,"internally_reserved":0,"allocated":294912,"data_stored":113960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5124,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366716,"statfs":{"total":96636764160,"available":96631517184,"internally_reserved":0,"allocated":258048,"data_stored":96864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5136,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366704,"statfs":{"total":96636764160,"available":96631504896,"internally_reserved":0,"allocated":270336,"data_stored":102760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5136,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366704,"statfs":{"total":96636764160,"available":96631504896,"internally_reserved":0,"allocated":270336,"data_stored":102760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3779999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5148,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366692,"statfs":{"total":96636764160,"available":96631492608,"internally_reserved":0,"allocated":282624,"data_stored":108360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7929999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.516}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5529999999999999}]}]}]}} 2020-11-16T20:55:47.005 INFO:tasks.ceph.ceph_manager.ceph:increase pool size by 10 2020-11-16T20:55:47.006 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set rbd pg_num 18 2020-11-16T20:55:47.045 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:55:47.049+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:55:47.115 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:47.119+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:47.176 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:47.177 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:47.186 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:55:47.215 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:55:47.219+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:55:47.316 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:55:47.319+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:55:47.321 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:47.321 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:47.331 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:55:47.417 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:55:47.421+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:55:47.507 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:47.507 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:47.516 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:55:47.518 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:55:47.522+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:55:47.619 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:55:47.622+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:55:47.652 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:47.652 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:47.662 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:55:47.744 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:55:47.748+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:55:47.820 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:55:47.824+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:55:47.836 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:47.836 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:47.845 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:55:47.882 INFO:teuthology.orchestra.run.smithi166.stderr:set pool 4 hit_set_period to 3600 2020-11-16T20:55:47.882 INFO:teuthology.orchestra.run.smithi166.stderr:set pool 2 pg_num to 18 2020-11-16T20:55:47.894 INFO:teuthology.orchestra.run.smithi166:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache target_max_objects 250' 2020-11-16T20:55:47.928 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:55:47.932+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:55:48.021 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:48.021 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:48.022 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:55:48.025+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:55:48.030 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:55:48.122 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:55:48.126+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:55:48.204 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:48.204 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:48.213 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:55:48.256 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:55:48.260+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:55:48.325 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:55:48.329+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:55:48.348 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:48.348 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:48.357 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:55:48.426 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:55:48.430+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:55:48.483 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:48.483 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:48.493 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:55:48.536 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:48.540+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:48.618 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2020-11-16T20:55:48.619 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:48.619 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:48.628 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:55:48.628 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:48.632+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:48.729 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:55:48.733+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:55:48.799 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:48.800 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:48.809 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:55:48.850 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:55:48.854+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:55:48.882 INFO:teuthology.orchestra.run.smithi166.stderr:set pool 4 target_max_objects to 250 2020-11-16T20:55:48.894 INFO:teuthology.orchestra.run.smithi166:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache min_read_recency_for_promote 2' 2020-11-16T20:55:48.931 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:55:48.935+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:55:48.973 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:55:48.988 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:48.988 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:49.002 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:55:49.032 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:55:49.036+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:55:49.133 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:55:49.137+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:55:49.158 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:55:49.178 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:55:49.198 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:55:49.204 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:49.205 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:55:49.205 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:55:49.205 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:55:49.205 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:49.214 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:55:49.218 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:55:49.234 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:49.238+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:49.240 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:55:49.260 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:55:49.281 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:55:49.302 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:55:49.303 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:55:49.303 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:55:49.304 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:55:49.304 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:55:49.304 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:55:49.304 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:55:49.304 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:55:49.304 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:55:49.336 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:55:49.340+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:55:49.345 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:49.346 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:55:49.346 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:55:49.346 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [] 2020-11-16T20:55:49.346 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:49.355 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:55:49.436 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:55:49.440+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:55:49.521 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:49.521 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:55:49.521 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:55:49.521 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:49.530 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:55:49.574 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:55:49.578+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:55:49.638 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:55:49.642+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:55:49.656 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:49.657 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:55:49.657 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:55:49.657 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:55:49.657 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:49.666 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:55:49.749 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:49.753+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:49.832 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:49.832 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:55:49.832 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:55:49.832 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [] 2020-11-16T20:55:49.832 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:49.839 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:55:49.843+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:55:49.841 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:55:49.900 INFO:teuthology.orchestra.run.smithi166.stderr:set pool 4 min_read_recency_for_promote to 2 2020-11-16T20:55:49.900 INFO:teuthology.orchestra.run.smithi166.stderr:noscrub is set 2020-11-16T20:55:49.908 INFO:teuthology.run_tasks:Running task rados... 2020-11-16T20:55:49.919 INFO:tasks.rados:Beginning rados... 2020-11-16T20:55:49.920 DEBUG:teuthology.run_tasks:Unwinding manager rados 2020-11-16T20:55:49.963 INFO:tasks.rados:joining rados 2020-11-16T20:55:49.963 INFO:tasks.rados:clients are ['client.0', 'client.1'] 2020-11-16T20:55:49.964 INFO:tasks.rados:starting run 0 out of 1 2020-11-16T20:55:49.964 INFO:teuthology.orchestra.run.smithi166:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op copy_from 50 --op cache_flush 50 --op cache_try_flush 50 --op cache_evict 50 --op write_excl 50 --pool base 2020-11-16T20:55:49.965 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:55:49.969+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:55:49.987 INFO:tasks.rados.rados.0.smithi166.stdout:adding op weight read -> 100 2020-11-16T20:55:49.988 INFO:tasks.rados.rados.0.smithi166.stdout:adding op weight write -> 50 2020-11-16T20:55:49.988 INFO:tasks.rados.rados.0.smithi166.stdout:adding op weight delete -> 50 2020-11-16T20:55:49.988 INFO:tasks.rados.rados.0.smithi166.stdout:adding op weight snap_create -> 50 2020-11-16T20:55:49.988 INFO:tasks.rados.rados.0.smithi166.stdout:adding op weight snap_remove -> 50 2020-11-16T20:55:49.988 INFO:tasks.rados.rados.0.smithi166.stdout:adding op weight rollback -> 50 2020-11-16T20:55:49.988 INFO:tasks.rados.rados.0.smithi166.stdout:adding op weight copy_from -> 50 2020-11-16T20:55:49.989 INFO:tasks.rados.rados.0.smithi166.stdout:adding op weight cache_flush -> 50 2020-11-16T20:55:49.989 INFO:tasks.rados.rados.0.smithi166.stdout:adding op weight cache_try_flush -> 50 2020-11-16T20:55:49.989 INFO:tasks.rados.rados.0.smithi166.stdout:adding op weight cache_evict -> 50 2020-11-16T20:55:49.989 INFO:tasks.rados.rados.0.smithi166.stdout:adding op weight write_excl -> 50 2020-11-16T20:55:49.989 INFO:tasks.rados.rados.0.smithi166.stdout:ceph version 16.0.0-7219-g911cc357 (911cc35794d871071a8bebfb0919482263b1d18b) pacific (dev) 2020-11-16T20:55:49.989 INFO:tasks.rados.rados.0.smithi166.stdout:Configuration: 2020-11-16T20:55:49.989 INFO:tasks.rados.rados.0.smithi166.stdout: Number of operations: 4000 2020-11-16T20:55:49.989 INFO:tasks.rados.rados.0.smithi166.stdout: Number of objects: 500 2020-11-16T20:55:49.990 INFO:tasks.rados.rados.0.smithi166.stdout: Max in flight operations: 16 2020-11-16T20:55:49.990 INFO:tasks.rados.rados.0.smithi166.stdout: Object size (in bytes): 4000000 2020-11-16T20:55:49.990 INFO:tasks.rados.rados.0.smithi166.stdout: Write stride min: 400000 2020-11-16T20:55:49.990 INFO:tasks.rados.rados.0.smithi166.stdout: Write stride max: 800000 2020-11-16T20:55:50.025 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:50.025 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:55:50.025 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:55:50.025 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:50.034 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:55:50.076 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:55:50.080+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:55:50.167 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:55:50.171+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:55:50.201 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:50.201 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:55:50.201 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:55:50.201 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:55:50.201 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:50.210 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:55:50.268 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:55:50.272+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:55:50.369 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:55:50.373+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:55:50.375 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:50.375 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:55:50.376 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:55:50.376 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [] 2020-11-16T20:55:50.376 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:50.385 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:55:50.470 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:55:50.474+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:55:50.533 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:55:50.533 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:55:50.533 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:55:50.533 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:55:50.543 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:55:50.570 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:55:50.575+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:55:50.671 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:55:50.674+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:55:50.677 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:55:50.677 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:55:50.677 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:55:50.678 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:55:50.678 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:55:50.687 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:55:50.771 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:55:50.775+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:55:50.861 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:55:50.861 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:55:50.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:55:50.862 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [] 2020-11-16T20:55:50.862 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:55:50.870 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:55:50.890 INFO:tasks.rados.rados.0.smithi166.stdout:1: write initial oid 1 2020-11-16T20:55:50.890 INFO:tasks.rados.rados.0.smithi166.stdout:1: seq_num 0 ranges {416807=475249,1542129=474678} 2020-11-16T20:55:50.896 INFO:tasks.rados.rados.0.smithi166.stdout:1: writing smithi16641208-1 from 416807 to 892056 tid 1 2020-11-16T20:55:50.903 INFO:tasks.rados.rados.0.smithi166.stdout:1: writing smithi16641208-1 from 1542129 to 2016807 tid 2 2020-11-16T20:55:50.903 INFO:tasks.rados.rados.0.smithi166.stdout:2: write initial oid 2 2020-11-16T20:55:50.903 INFO:tasks.rados.rados.0.smithi166.stdout:2: seq_num 1 ranges {416807=475249,1542129=474678} 2020-11-16T20:55:50.908 INFO:tasks.rados.rados.0.smithi166.stdout:2: writing smithi16641208-2 from 416807 to 892056 tid 1 2020-11-16T20:55:50.911 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:55:50.915+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:55:50.915 INFO:tasks.rados.rados.0.smithi166.stdout:2: writing smithi16641208-2 from 1542129 to 2016807 tid 2 2020-11-16T20:55:50.915 INFO:tasks.rados.rados.0.smithi166.stdout:3: write initial oid 3 2020-11-16T20:55:50.915 INFO:tasks.rados.rados.0.smithi166.stdout:3: seq_num 2 ranges {433614=550498,1600611=433003} 2020-11-16T20:55:50.921 INFO:tasks.rados.rados.0.smithi166.stdout:3: writing smithi16641208-3 from 433614 to 984112 tid 1 2020-11-16T20:55:50.927 INFO:tasks.rados.rados.0.smithi166.stdout:3: writing smithi16641208-3 from 1600611 to 2033614 tid 2 2020-11-16T20:55:50.927 INFO:tasks.rados.rados.0.smithi166.stdout:4: write initial oid 4 2020-11-16T20:55:50.927 INFO:tasks.rados.rados.0.smithi166.stdout:4: seq_num 3 ranges {450421=625747,1659093=391328} 2020-11-16T20:55:50.933 INFO:tasks.rados.rados.0.smithi166.stdout:4: writing smithi16641208-4 from 450421 to 1076168 tid 1 2020-11-16T20:55:50.939 INFO:tasks.rados.rados.0.smithi166.stdout:4: writing smithi16641208-4 from 1659093 to 2050421 tid 2 2020-11-16T20:55:50.939 INFO:tasks.rados.rados.0.smithi166.stdout:5: write initial oid 5 2020-11-16T20:55:50.940 INFO:tasks.rados.rados.0.smithi166.stdout:1: finishing write tid 1 to smithi16641208-1 2020-11-16T20:55:50.940 INFO:tasks.rados.rados.0.smithi166.stdout:5: seq_num 4 ranges {467228=700996,1717575=349653} 2020-11-16T20:55:50.946 INFO:tasks.rados.rados.0.smithi166.stdout:5: writing smithi16641208-5 from 467228 to 1168224 tid 1 2020-11-16T20:55:50.952 INFO:tasks.rados.rados.0.smithi166.stdout:5: writing smithi16641208-5 from 1717575 to 2067228 tid 2 2020-11-16T20:55:50.952 INFO:tasks.rados.rados.0.smithi166.stdout:6: write initial oid 6 2020-11-16T20:55:50.952 INFO:tasks.rados.rados.0.smithi166.stdout:6: seq_num 5 ranges {484035=776245,2059704=24331} 2020-11-16T20:55:50.959 INFO:tasks.rados.rados.0.smithi166.stdout:6: writing smithi16641208-6 from 484035 to 1260280 tid 1 2020-11-16T20:55:50.964 INFO:tasks.rados.rados.0.smithi166.stdout:6: writing smithi16641208-6 from 2059704 to 2084035 tid 2 2020-11-16T20:55:50.964 INFO:tasks.rados.rados.0.smithi166.stdout:7: write initial oid 7 2020-11-16T20:55:50.964 INFO:tasks.rados.rados.0.smithi166.stdout:7: seq_num 6 ranges {500842=451494,1718186=382656} 2020-11-16T20:55:50.969 INFO:tasks.rados.rados.0.smithi166.stdout:7: writing smithi16641208-7 from 500842 to 952336 tid 1 2020-11-16T20:55:50.973 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:55:50.977+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:55:50.976 INFO:tasks.rados.rados.0.smithi166.stdout:7: writing smithi16641208-7 from 1718186 to 2100842 tid 2 2020-11-16T20:55:50.976 INFO:tasks.rados.rados.0.smithi166.stdout:8: write initial oid 8 2020-11-16T20:55:50.976 INFO:tasks.rados.rados.0.smithi166.stdout:8: seq_num 7 ranges {517649=526743,1776668=340981} 2020-11-16T20:55:50.982 INFO:tasks.rados.rados.0.smithi166.stdout:8: writing smithi16641208-8 from 517649 to 1044392 tid 1 2020-11-16T20:55:50.989 INFO:tasks.rados.rados.0.smithi166.stdout:8: writing smithi16641208-8 from 1776668 to 2117649 tid 2 2020-11-16T20:55:50.989 INFO:tasks.rados.rados.0.smithi166.stdout:9: write initial oid 9 2020-11-16T20:55:50.989 INFO:tasks.rados.rados.0.smithi166.stdout:9: seq_num 8 ranges {534456=718345,1951503=182953} 2020-11-16T20:55:50.995 INFO:tasks.rados.rados.0.smithi166.stdout:9: writing smithi16641208-9 from 534456 to 1252801 tid 1 2020-11-16T20:55:51.001 INFO:tasks.rados.rados.0.smithi166.stdout:9: writing smithi16641208-9 from 1951503 to 2134456 tid 2 2020-11-16T20:55:51.001 INFO:tasks.rados.rados.0.smithi166.stdout:10: write initial oid 10 2020-11-16T20:55:51.001 INFO:tasks.rados.rados.0.smithi166.stdout:10: seq_num 9 ranges {551263=793594,1893632=257631} 2020-11-16T20:55:51.008 INFO:tasks.rados.rados.0.smithi166.stdout:10: writing smithi16641208-10 from 551263 to 1344857 tid 1 2020-11-16T20:55:51.012 INFO:tasks.rados.rados.0.smithi166.stdout:10: writing smithi16641208-10 from 1893632 to 2151263 tid 2 2020-11-16T20:55:51.013 INFO:tasks.rados.rados.0.smithi166.stdout:11: write initial oid 11 2020-11-16T20:55:51.013 INFO:tasks.rados.rados.0.smithi166.stdout:11: seq_num 10 ranges {568070=468843,1552114=615956} 2020-11-16T20:55:51.018 INFO:tasks.rados.rados.0.smithi166.stdout:11: writing smithi16641208-11 from 568070 to 1036913 tid 1 2020-11-16T20:55:51.025 INFO:tasks.rados.rados.0.smithi166.stdout:11: writing smithi16641208-11 from 1552114 to 2168070 tid 2 2020-11-16T20:55:51.025 INFO:tasks.rados.rados.0.smithi166.stdout:12: write initial oid 12 2020-11-16T20:55:51.025 INFO:tasks.rados.rados.0.smithi166.stdout:12: seq_num 11 ranges {584877=544092,1610596=562003} 2020-11-16T20:55:51.031 INFO:tasks.rados.rados.0.smithi166.stdout:12: writing smithi16641208-12 from 584877 to 1128969 tid 1 2020-11-16T20:55:51.037 INFO:tasks.rados.rados.0.smithi166.stdout:12: writing smithi16641208-12 from 1610596 to 2172599 tid 2 2020-11-16T20:55:51.038 INFO:tasks.rados.rados.0.smithi166.stdout:13: write initial oid 13 2020-11-16T20:55:51.038 INFO:tasks.rados.rados.0.smithi166.stdout:2: finishing write tid 1 to smithi16641208-2 2020-11-16T20:55:51.038 INFO:tasks.rados.rados.0.smithi166.stdout:13: seq_num 12 ranges {601684=619341,1669078=532606} 2020-11-16T20:55:51.044 INFO:tasks.rados.rados.0.smithi166.stdout:13: writing smithi16641208-13 from 601684 to 1221025 tid 1 2020-11-16T20:55:51.050 INFO:tasks.rados.rados.0.smithi166.stdout:13: writing smithi16641208-13 from 1669078 to 2201684 tid 2 2020-11-16T20:55:51.050 INFO:tasks.rados.rados.0.smithi166.stdout:14: write initial oid 14 2020-11-16T20:55:51.051 INFO:tasks.rados.rados.0.smithi166.stdout:1: finishing write tid 2 to smithi16641208-1 2020-11-16T20:55:51.051 INFO:tasks.rados.rados.0.smithi166.stdout:1: finishing write tid 3 to smithi16641208-1 2020-11-16T20:55:51.051 INFO:tasks.rados.rados.0.smithi166.stdout:1: finishing write tid 4 to smithi16641208-1 2020-11-16T20:55:51.051 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 1 v 3 (ObjNum 0 snap 0 seq_num 0) dirty exists 2020-11-16T20:55:51.051 INFO:tasks.rados.rados.0.smithi166.stdout:1: left oid 1 (ObjNum 0 snap 0 seq_num 0) 2020-11-16T20:55:51.051 INFO:tasks.rados.rados.0.smithi166.stdout:2: finishing write tid 2 to smithi16641208-2 2020-11-16T20:55:51.051 INFO:tasks.rados.rados.0.smithi166.stdout:14: seq_num 13 ranges {618491=694590,2011207=207284} 2020-11-16T20:55:51.057 INFO:tasks.rados.rados.0.smithi166.stdout:14: writing smithi16641208-14 from 618491 to 1313081 tid 1 2020-11-16T20:55:51.062 INFO:tasks.rados.rados.0.smithi166.stdout:14: writing smithi16641208-14 from 2011207 to 2218491 tid 2 2020-11-16T20:55:51.063 INFO:tasks.rados.rados.0.smithi166.stdout:1: done (13 left) 2020-11-16T20:55:51.063 INFO:tasks.rados.rados.0.smithi166.stdout:15: write initial oid 15 2020-11-16T20:55:51.063 INFO:tasks.rados.rados.0.smithi166.stdout:15: seq_num 14 ranges {635298=769839,2069689=165609} 2020-11-16T20:55:51.070 INFO:tasks.rados.rados.0.smithi166.stdout:15: writing smithi16641208-15 from 635298 to 1405137 tid 1 2020-11-16T20:55:51.073 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:51.077+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:51.075 INFO:tasks.rados.rados.0.smithi166.stdout:15: writing smithi16641208-15 from 2069689 to 2235298 tid 2 2020-11-16T20:55:51.076 INFO:tasks.rados.rados.0.smithi166.stdout:16: write initial oid 16 2020-11-16T20:55:51.076 INFO:tasks.rados.rados.0.smithi166.stdout:16: seq_num 15 ranges {652105=445088,1728171=452988} 2020-11-16T20:55:51.080 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:55:51.081 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:55:51.081 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:55:51.081 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:55:51.081 INFO:tasks.rados.rados.0.smithi166.stdout:16: writing smithi16641208-16 from 652105 to 1097193 tid 1 2020-11-16T20:55:51.088 INFO:tasks.rados.rados.0.smithi166.stdout:16: writing smithi16641208-16 from 1728171 to 2181159 tid 2 2020-11-16T20:55:51.088 INFO:tasks.rados.rados.0.smithi166.stdout:17: write initial oid 17 2020-11-16T20:55:51.088 INFO:tasks.rados.rados.0.smithi166.stdout:17: seq_num 16 ranges {668912=636690,1903006=365906} 2020-11-16T20:55:51.093 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:55:51.095 INFO:tasks.rados.rados.0.smithi166.stdout:17: writing smithi16641208-17 from 668912 to 1305602 tid 1 2020-11-16T20:55:51.101 INFO:tasks.rados.rados.0.smithi166.stdout:17: writing smithi16641208-17 from 1903006 to 2268912 tid 2 2020-11-16T20:55:51.101 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:51.101 INFO:tasks.rados.rados.0.smithi166.stdout:2: finishing write tid 3 to smithi16641208-2 2020-11-16T20:55:51.101 INFO:tasks.rados.rados.0.smithi166.stdout:2: finishing write tid 4 to smithi16641208-2 2020-11-16T20:55:51.101 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 2 v 3 (ObjNum 1 snap 0 seq_num 1) dirty exists 2020-11-16T20:55:51.102 INFO:tasks.rados.rados.0.smithi166.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2020-11-16T20:55:51.102 INFO:tasks.rados.rados.0.smithi166.stdout:3: finishing write tid 1 to smithi16641208-3 2020-11-16T20:55:51.102 INFO:tasks.rados.rados.0.smithi166.stdout:2: done (15 left) 2020-11-16T20:55:51.102 INFO:tasks.rados.rados.0.smithi166.stdout:18: write initial oid 18 2020-11-16T20:55:51.102 INFO:tasks.rados.rados.0.smithi166.stdout:18: seq_num 17 ranges {685719=711939,1845135=440584} 2020-11-16T20:55:51.109 INFO:tasks.rados.rados.0.smithi166.stdout:18: writing smithi16641208-18 from 685719 to 1397658 tid 1 2020-11-16T20:55:51.114 INFO:tasks.rados.rados.0.smithi166.stdout:18: writing smithi16641208-18 from 1845135 to 2285719 tid 2 2020-11-16T20:55:51.114 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:51.114 INFO:tasks.rados.rados.0.smithi166.stdout:4: finishing write tid 1 to smithi16641208-4 2020-11-16T20:55:51.115 INFO:tasks.rados.rados.0.smithi166.stdout:3: finishing write tid 2 to smithi16641208-3 2020-11-16T20:55:51.115 INFO:tasks.rados.rados.0.smithi166.stdout:3: finishing write tid 3 to smithi16641208-3 2020-11-16T20:55:51.115 INFO:tasks.rados.rados.0.smithi166.stdout:3: finishing write tid 4 to smithi16641208-3 2020-11-16T20:55:51.115 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 3 v 6 (ObjNum 2 snap 0 seq_num 2) dirty exists 2020-11-16T20:55:51.115 INFO:tasks.rados.rados.0.smithi166.stdout:3: left oid 3 (ObjNum 2 snap 0 seq_num 2) 2020-11-16T20:55:51.115 INFO:tasks.rados.rados.0.smithi166.stdout:4: finishing write tid 2 to smithi16641208-4 2020-11-16T20:55:51.115 INFO:tasks.rados.rados.0.smithi166.stdout:4: finishing write tid 3 to smithi16641208-4 2020-11-16T20:55:51.116 INFO:tasks.rados.rados.0.smithi166.stdout:4: finishing write tid 4 to smithi16641208-4 2020-11-16T20:55:51.116 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 4 v 3 (ObjNum 3 snap 0 seq_num 3) dirty exists 2020-11-16T20:55:51.116 INFO:tasks.rados.rados.0.smithi166.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2020-11-16T20:55:51.116 INFO:tasks.rados.rados.0.smithi166.stdout:5: finishing write tid 1 to smithi16641208-5 2020-11-16T20:55:51.116 INFO:tasks.rados.rados.0.smithi166.stdout:6: finishing write tid 1 to smithi16641208-6 2020-11-16T20:55:51.116 INFO:tasks.rados.rados.0.smithi166.stdout:5: finishing write tid 2 to smithi16641208-5 2020-11-16T20:55:51.116 INFO:tasks.rados.rados.0.smithi166.stdout:5: finishing write tid 3 to smithi16641208-5 2020-11-16T20:55:51.116 INFO:tasks.rados.rados.0.smithi166.stdout:5: finishing write tid 4 to smithi16641208-5 2020-11-16T20:55:51.117 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 5 v 3 (ObjNum 4 snap 0 seq_num 4) dirty exists 2020-11-16T20:55:51.117 INFO:tasks.rados.rados.0.smithi166.stdout:5: left oid 5 (ObjNum 4 snap 0 seq_num 4) 2020-11-16T20:55:51.117 INFO:tasks.rados.rados.0.smithi166.stdout:7: finishing write tid 1 to smithi16641208-7 2020-11-16T20:55:51.117 INFO:tasks.rados.rados.0.smithi166.stdout:6: finishing write tid 2 to smithi16641208-6 2020-11-16T20:55:51.117 INFO:tasks.rados.rados.0.smithi166.stdout:6: finishing write tid 3 to smithi16641208-6 2020-11-16T20:55:51.117 INFO:tasks.rados.rados.0.smithi166.stdout:8: finishing write tid 1 to smithi16641208-8 2020-11-16T20:55:51.117 INFO:tasks.rados.rados.0.smithi166.stdout:3: done (15 left) 2020-11-16T20:55:51.118 INFO:tasks.rados.rados.0.smithi166.stdout:4: done (14 left) 2020-11-16T20:55:51.118 INFO:tasks.rados.rados.0.smithi166.stdout:5: done (13 left) 2020-11-16T20:55:51.118 INFO:tasks.rados.rados.0.smithi166.stdout:19: write initial oid 19 2020-11-16T20:55:51.118 INFO:tasks.rados.rados.0.smithi166.stdout:19: seq_num 18 ranges {702526=787188,1903617=398909} 2020-11-16T20:55:51.123 INFO:tasks.rados.rados.0.smithi166.stdout:19: writing smithi16641208-19 from 702526 to 1489714 tid 1 2020-11-16T20:55:51.128 INFO:tasks.rados.rados.0.smithi166.stdout:19: writing smithi16641208-19 from 1903617 to 2302526 tid 2 2020-11-16T20:55:51.128 INFO:tasks.rados.rados.0.smithi166.stdout:20: write initial oid 20 2020-11-16T20:55:51.128 INFO:tasks.rados.rados.0.smithi166.stdout:20: seq_num 19 ranges {719333=462437,1962099=357234} 2020-11-16T20:55:51.135 INFO:tasks.rados.rados.0.smithi166.stdout:20: writing smithi16641208-20 from 719333 to 1181770 tid 1 2020-11-16T20:55:51.141 INFO:tasks.rados.rados.0.smithi166.stdout:20: writing smithi16641208-20 from 1962099 to 2319333 tid 2 2020-11-16T20:55:51.142 INFO:tasks.rados.rados.0.smithi166.stdout:21: write initial oid 21 2020-11-16T20:55:51.142 INFO:tasks.rados.rados.0.smithi166.stdout:21: seq_num 20 ranges {736140=537686,2020581=315559} 2020-11-16T20:55:51.148 INFO:tasks.rados.rados.0.smithi166.stdout:21: writing smithi16641208-21 from 736140 to 1273826 tid 1 2020-11-16T20:55:51.154 INFO:tasks.rados.rados.0.smithi166.stdout:21: writing smithi16641208-21 from 2020581 to 2336140 tid 2 2020-11-16T20:55:51.155 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:51.155 INFO:tasks.rados.rados.0.smithi166.stdout:6: finishing write tid 4 to smithi16641208-6 2020-11-16T20:55:51.155 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 6 v 6 (ObjNum 5 snap 0 seq_num 5) dirty exists 2020-11-16T20:55:51.155 INFO:tasks.rados.rados.0.smithi166.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2020-11-16T20:55:51.155 INFO:tasks.rados.rados.0.smithi166.stdout:6: done (15 left) 2020-11-16T20:55:51.155 INFO:tasks.rados.rados.0.smithi166.stdout:22: write initial oid 22 2020-11-16T20:55:51.156 INFO:tasks.rados.rados.0.smithi166.stdout:22: seq_num 21 ranges {752947=612935,1962710=390237} 2020-11-16T20:55:51.162 INFO:tasks.rados.rados.0.smithi166.stdout:22: writing smithi16641208-22 from 752947 to 1365882 tid 1 2020-11-16T20:55:51.168 INFO:tasks.rados.rados.0.smithi166.stdout:22: writing smithi16641208-22 from 1962710 to 2352947 tid 2 2020-11-16T20:55:51.168 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:51.168 INFO:tasks.rados.rados.0.smithi166.stdout:7: finishing write tid 2 to smithi16641208-7 2020-11-16T20:55:51.168 INFO:tasks.rados.rados.0.smithi166.stdout:7: finishing write tid 3 to smithi16641208-7 2020-11-16T20:55:51.169 INFO:tasks.rados.rados.0.smithi166.stdout:7: finishing write tid 4 to smithi16641208-7 2020-11-16T20:55:51.169 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 7 v 9 (ObjNum 6 snap 0 seq_num 6) dirty exists 2020-11-16T20:55:51.169 INFO:tasks.rados.rados.0.smithi166.stdout:7: left oid 7 (ObjNum 6 snap 0 seq_num 6) 2020-11-16T20:55:51.169 INFO:tasks.rados.rados.0.smithi166.stdout:8: finishing write tid 2 to smithi16641208-8 2020-11-16T20:55:51.169 INFO:tasks.rados.rados.0.smithi166.stdout:8: finishing write tid 3 to smithi16641208-8 2020-11-16T20:55:51.169 INFO:tasks.rados.rados.0.smithi166.stdout:8: finishing write tid 4 to smithi16641208-8 2020-11-16T20:55:51.169 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 8 v 6 (ObjNum 7 snap 0 seq_num 7) dirty exists 2020-11-16T20:55:51.170 INFO:tasks.rados.rados.0.smithi166.stdout:8: left oid 8 (ObjNum 7 snap 0 seq_num 7) 2020-11-16T20:55:51.170 INFO:tasks.rados.rados.0.smithi166.stdout:9: finishing write tid 1 to smithi16641208-9 2020-11-16T20:55:51.170 INFO:tasks.rados.rados.0.smithi166.stdout:9: finishing write tid 2 to smithi16641208-9 2020-11-16T20:55:51.170 INFO:tasks.rados.rados.0.smithi166.stdout:9: finishing write tid 3 to smithi16641208-9 2020-11-16T20:55:51.170 INFO:tasks.rados.rados.0.smithi166.stdout:10: finishing write tid 1 to smithi16641208-10 2020-11-16T20:55:51.170 INFO:tasks.rados.rados.0.smithi166.stdout:9: finishing write tid 4 to smithi16641208-9 2020-11-16T20:55:51.170 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 9 v 6 (ObjNum 8 snap 0 seq_num 8) dirty exists 2020-11-16T20:55:51.171 INFO:tasks.rados.rados.0.smithi166.stdout:9: left oid 9 (ObjNum 8 snap 0 seq_num 8) 2020-11-16T20:55:51.171 INFO:tasks.rados.rados.0.smithi166.stdout:11: finishing write tid 1 to smithi16641208-11 2020-11-16T20:55:51.171 INFO:tasks.rados.rados.0.smithi166.stdout:10: finishing write tid 2 to smithi16641208-10 2020-11-16T20:55:51.171 INFO:tasks.rados.rados.0.smithi166.stdout:10: finishing write tid 3 to smithi16641208-10 2020-11-16T20:55:51.171 INFO:tasks.rados.rados.0.smithi166.stdout:10: finishing write tid 4 to smithi16641208-10 2020-11-16T20:55:51.171 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 10 v 12 (ObjNum 9 snap 0 seq_num 9) dirty exists 2020-11-16T20:55:51.171 INFO:tasks.rados.rados.0.smithi166.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2020-11-16T20:55:51.172 INFO:tasks.rados.rados.0.smithi166.stdout:11: finishing write tid 2 to smithi16641208-11 2020-11-16T20:55:51.172 INFO:tasks.rados.rados.0.smithi166.stdout:12: finishing write tid 1 to smithi16641208-12 2020-11-16T20:55:51.172 INFO:tasks.rados.rados.0.smithi166.stdout:11: finishing write tid 3 to smithi16641208-11 2020-11-16T20:55:51.172 INFO:tasks.rados.rados.0.smithi166.stdout:11: finishing write tid 4 to smithi16641208-11 2020-11-16T20:55:51.172 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 11 v 15 (ObjNum 10 snap 0 seq_num 10) dirty exists 2020-11-16T20:55:51.172 INFO:tasks.rados.rados.0.smithi166.stdout:11: left oid 11 (ObjNum 10 snap 0 seq_num 10) 2020-11-16T20:55:51.172 INFO:tasks.rados.rados.0.smithi166.stdout:12: finishing write tid 2 to smithi16641208-12 2020-11-16T20:55:51.172 INFO:tasks.rados.rados.0.smithi166.stdout:12: finishing write tid 3 to smithi16641208-12 2020-11-16T20:55:51.173 INFO:tasks.rados.rados.0.smithi166.stdout:7: done (15 left) 2020-11-16T20:55:51.173 INFO:tasks.rados.rados.0.smithi166.stdout:8: done (14 left) 2020-11-16T20:55:51.173 INFO:tasks.rados.rados.0.smithi166.stdout:9: done (13 left) 2020-11-16T20:55:51.173 INFO:tasks.rados.rados.0.smithi166.stdout:10: done (12 left) 2020-11-16T20:55:51.173 INFO:tasks.rados.rados.0.smithi166.stdout:11: done (11 left) 2020-11-16T20:55:51.173 INFO:tasks.rados.rados.0.smithi166.stdout:23: write initial oid 23 2020-11-16T20:55:51.173 INFO:tasks.rados.rados.0.smithi166.stdout:23: seq_num 22 ranges {769754=688184,2021192=348562} 2020-11-16T20:55:51.175 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:55:51.179+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:55:51.176 INFO:tasks.rados.rados.0.smithi166.stdout:23: writing smithi16641208-23 from 769754 to 1457938 tid 1 2020-11-16T20:55:51.181 INFO:tasks.rados.rados.0.smithi166.stdout:23: writing smithi16641208-23 from 2021192 to 2369754 tid 2 2020-11-16T20:55:51.181 INFO:tasks.rados.rados.0.smithi166.stdout:24: write initial oid 24 2020-11-16T20:55:51.181 INFO:tasks.rados.rados.0.smithi166.stdout:24: seq_num 23 ranges {786561=479786,1796027=467664} 2020-11-16T20:55:51.188 INFO:tasks.rados.rados.0.smithi166.stdout:24: writing smithi16641208-24 from 786561 to 1266347 tid 1 2020-11-16T20:55:51.194 INFO:tasks.rados.rados.0.smithi166.stdout:24: writing smithi16641208-24 from 1796027 to 2263691 tid 2 2020-11-16T20:55:51.194 INFO:tasks.rados.rados.0.smithi166.stdout:25: write initial oid 25 2020-11-16T20:55:51.194 INFO:tasks.rados.rados.0.smithi166.stdout:25: seq_num 24 ranges {403368=555035,1454509=727675} 2020-11-16T20:55:51.199 INFO:tasks.rados.rados.0.smithi166.stdout:25: writing smithi16641208-25 from 403368 to 958403 tid 1 2020-11-16T20:55:51.206 INFO:tasks.rados.rados.0.smithi166.stdout:25: writing smithi16641208-25 from 1454509 to 2182184 tid 2 2020-11-16T20:55:51.207 INFO:tasks.rados.rados.0.smithi166.stdout:26: write initial oid 26 2020-11-16T20:55:51.207 INFO:tasks.rados.rados.0.smithi166.stdout:12: finishing write tid 4 to smithi16641208-12 2020-11-16T20:55:51.207 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 12 v 9 (ObjNum 11 snap 0 seq_num 11) dirty exists 2020-11-16T20:55:51.207 INFO:tasks.rados.rados.0.smithi166.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2020-11-16T20:55:51.207 INFO:tasks.rados.rados.0.smithi166.stdout:13: finishing write tid 1 to smithi16641208-13 2020-11-16T20:55:51.207 INFO:tasks.rados.rados.0.smithi166.stdout:13: finishing write tid 2 to smithi16641208-13 2020-11-16T20:55:51.208 INFO:tasks.rados.rados.0.smithi166.stdout:26: seq_num 25 ranges {420175=630284,1796638=471333} 2020-11-16T20:55:51.212 INFO:tasks.rados.rados.0.smithi166.stdout:26: writing smithi16641208-26 from 420175 to 1050459 tid 1 2020-11-16T20:55:51.220 INFO:tasks.rados.rados.0.smithi166.stdout:26: writing smithi16641208-26 from 1796638 to 2267971 tid 2 2020-11-16T20:55:51.220 INFO:tasks.rados.rados.0.smithi166.stdout:12: done (14 left) 2020-11-16T20:55:51.220 INFO:tasks.rados.rados.0.smithi166.stdout:27: write initial oid 27 2020-11-16T20:55:51.220 INFO:tasks.rados.rados.0.smithi166.stdout:27: seq_num 26 ranges {436982=705533,1855120=581862} 2020-11-16T20:55:51.226 INFO:tasks.rados.rados.0.smithi166.stdout:27: writing smithi16641208-27 from 436982 to 1142515 tid 1 2020-11-16T20:55:51.233 INFO:tasks.rados.rados.0.smithi166.stdout:27: writing smithi16641208-27 from 1855120 to 2436982 tid 2 2020-11-16T20:55:51.234 INFO:tasks.rados.rados.0.smithi166.stdout:28: write initial oid 28 2020-11-16T20:55:51.234 INFO:tasks.rados.rados.0.smithi166.stdout:28: seq_num 27 ranges {453789=780782,1913602=475002} 2020-11-16T20:55:51.240 INFO:tasks.rados.rados.0.smithi166.stdout:28: writing smithi16641208-28 from 453789 to 1234571 tid 1 2020-11-16T20:55:51.247 INFO:tasks.rados.rados.0.smithi166.stdout:28: writing smithi16641208-28 from 1913602 to 2388604 tid 2 2020-11-16T20:55:51.247 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:51.247 INFO:tasks.rados.rados.0.smithi166.stdout:13: finishing write tid 3 to smithi16641208-13 2020-11-16T20:55:51.248 INFO:tasks.rados.rados.0.smithi166.stdout:13: finishing write tid 4 to smithi16641208-13 2020-11-16T20:55:51.248 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 13 v 9 (ObjNum 12 snap 0 seq_num 12) dirty exists 2020-11-16T20:55:51.248 INFO:tasks.rados.rados.0.smithi166.stdout:13: left oid 13 (ObjNum 12 snap 0 seq_num 12) 2020-11-16T20:55:51.248 INFO:tasks.rados.rados.0.smithi166.stdout:14: finishing write tid 1 to smithi16641208-14 2020-11-16T20:55:51.248 INFO:tasks.rados.rados.0.smithi166.stdout:14: finishing write tid 2 to smithi16641208-14 2020-11-16T20:55:51.248 INFO:tasks.rados.rados.0.smithi166.stdout:14: finishing write tid 3 to smithi16641208-14 2020-11-16T20:55:51.248 INFO:tasks.rados.rados.0.smithi166.stdout:13: done (15 left) 2020-11-16T20:55:51.249 INFO:tasks.rados.rados.0.smithi166.stdout:29: write initial oid 29 2020-11-16T20:55:51.249 INFO:tasks.rados.rados.0.smithi166.stdout:29: seq_num 28 ranges {470596=456031,1572084=618660} 2020-11-16T20:55:51.252 INFO:tasks.rados.rados.0.smithi166.stdout:29: writing smithi16641208-29 from 470596 to 926627 tid 1 2020-11-16T20:55:51.255 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:55:51.255 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:55:51.256 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:55:51.256 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:55:51.256 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:55:51.259 INFO:tasks.rados.rados.0.smithi166.stdout:29: writing smithi16641208-29 from 1572084 to 2190744 tid 2 2020-11-16T20:55:51.259 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:51.260 INFO:tasks.rados.rados.0.smithi166.stdout:14: finishing write tid 4 to smithi16641208-14 2020-11-16T20:55:51.260 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 14 v 9 (ObjNum 13 snap 0 seq_num 13) dirty exists 2020-11-16T20:55:51.260 INFO:tasks.rados.rados.0.smithi166.stdout:14: left oid 14 (ObjNum 13 snap 0 seq_num 13) 2020-11-16T20:55:51.260 INFO:tasks.rados.rados.0.smithi166.stdout:14: done (15 left) 2020-11-16T20:55:51.260 INFO:tasks.rados.rados.0.smithi166.stdout:30: write initial oid 30 2020-11-16T20:55:51.260 INFO:tasks.rados.rados.0.smithi166.stdout:30: seq_num 29 ranges {487403=531280,1514213=478671} 2020-11-16T20:55:51.265 INFO:tasks.rados.rados.0.smithi166.stdout:30: writing smithi16641208-30 from 487403 to 1018683 tid 1 2020-11-16T20:55:51.268 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:55:51.270 INFO:tasks.rados.rados.0.smithi166.stdout:30: writing smithi16641208-30 from 1514213 to 1992884 tid 2 2020-11-16T20:55:51.271 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:51.271 INFO:tasks.rados.rados.0.smithi166.stdout:15: finishing write tid 1 to smithi16641208-15 2020-11-16T20:55:51.271 INFO:tasks.rados.rados.0.smithi166.stdout:15: finishing write tid 2 to smithi16641208-15 2020-11-16T20:55:51.271 INFO:tasks.rados.rados.0.smithi166.stdout:15: finishing write tid 3 to smithi16641208-15 2020-11-16T20:55:51.271 INFO:tasks.rados.rados.0.smithi166.stdout:16: finishing write tid 1 to smithi16641208-16 2020-11-16T20:55:51.271 INFO:tasks.rados.rados.0.smithi166.stdout:15: finishing write tid 4 to smithi16641208-15 2020-11-16T20:55:51.271 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 15 v 12 (ObjNum 14 snap 0 seq_num 14) dirty exists 2020-11-16T20:55:51.272 INFO:tasks.rados.rados.0.smithi166.stdout:15: left oid 15 (ObjNum 14 snap 0 seq_num 14) 2020-11-16T20:55:51.272 INFO:tasks.rados.rados.0.smithi166.stdout:17: finishing write tid 1 to smithi16641208-17 2020-11-16T20:55:51.272 INFO:tasks.rados.rados.0.smithi166.stdout:16: finishing write tid 2 to smithi16641208-16 2020-11-16T20:55:51.272 INFO:tasks.rados.rados.0.smithi166.stdout:15: done (15 left) 2020-11-16T20:55:51.272 INFO:tasks.rados.rados.0.smithi166.stdout:31: write initial oid 31 2020-11-16T20:55:51.272 INFO:tasks.rados.rados.0.smithi166.stdout:31: seq_num 30 ranges {504210=606529,1572695=622329} 2020-11-16T20:55:51.276 INFO:tasks.rados.rados.0.smithi166.stdout:31: writing smithi16641208-31 from 504210 to 1110739 tid 1 2020-11-16T20:55:51.283 INFO:tasks.rados.rados.0.smithi166.stdout:31: writing smithi16641208-31 from 1572695 to 2195024 tid 2 2020-11-16T20:55:51.283 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:51.284 INFO:tasks.rados.rados.0.smithi166.stdout:16: finishing write tid 3 to smithi16641208-16 2020-11-16T20:55:51.284 INFO:tasks.rados.rados.0.smithi166.stdout:16: finishing write tid 4 to smithi16641208-16 2020-11-16T20:55:51.284 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 16 v 15 (ObjNum 15 snap 0 seq_num 15) dirty exists 2020-11-16T20:55:51.284 INFO:tasks.rados.rados.0.smithi166.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2020-11-16T20:55:51.284 INFO:tasks.rados.rados.0.smithi166.stdout:17: finishing write tid 2 to smithi16641208-17 2020-11-16T20:55:51.284 INFO:tasks.rados.rados.0.smithi166.stdout:17: finishing write tid 3 to smithi16641208-17 2020-11-16T20:55:51.285 INFO:tasks.rados.rados.0.smithi166.stdout:17: finishing write tid 4 to smithi16641208-17 2020-11-16T20:55:51.285 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 17 v 12 (ObjNum 16 snap 0 seq_num 16) dirty exists 2020-11-16T20:55:51.285 INFO:tasks.rados.rados.0.smithi166.stdout:17: left oid 17 (ObjNum 16 snap 0 seq_num 16) 2020-11-16T20:55:51.285 INFO:tasks.rados.rados.0.smithi166.stdout:18: finishing write tid 1 to smithi16641208-18 2020-11-16T20:55:51.285 INFO:tasks.rados.rados.0.smithi166.stdout:18: finishing write tid 2 to smithi16641208-18 2020-11-16T20:55:51.285 INFO:tasks.rados.rados.0.smithi166.stdout:18: finishing write tid 3 to smithi16641208-18 2020-11-16T20:55:51.285 INFO:tasks.rados.rados.0.smithi166.stdout:18: finishing write tid 4 to smithi16641208-18 2020-11-16T20:55:51.285 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 18 v 15 (ObjNum 17 snap 0 seq_num 17) dirty exists 2020-11-16T20:55:51.286 INFO:tasks.rados.rados.0.smithi166.stdout:18: left oid 18 (ObjNum 17 snap 0 seq_num 17) 2020-11-16T20:55:51.286 INFO:tasks.rados.rados.0.smithi166.stdout:19: finishing write tid 1 to smithi16641208-19 2020-11-16T20:55:51.286 INFO:tasks.rados.rados.0.smithi166.stdout:19: finishing write tid 2 to smithi16641208-19 2020-11-16T20:55:51.286 INFO:tasks.rados.rados.0.smithi166.stdout:19: finishing write tid 3 to smithi16641208-19 2020-11-16T20:55:51.286 INFO:tasks.rados.rados.0.smithi166.stdout:19: finishing write tid 4 to smithi16641208-19 2020-11-16T20:55:51.286 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 19 v 12 (ObjNum 18 snap 0 seq_num 18) dirty exists 2020-11-16T20:55:51.286 INFO:tasks.rados.rados.0.smithi166.stdout:19: left oid 19 (ObjNum 18 snap 0 seq_num 18) 2020-11-16T20:55:51.287 INFO:tasks.rados.rados.0.smithi166.stdout:20: finishing write tid 1 to smithi16641208-20 2020-11-16T20:55:51.287 INFO:tasks.rados.rados.0.smithi166.stdout:20: finishing write tid 2 to smithi16641208-20 2020-11-16T20:55:51.287 INFO:tasks.rados.rados.0.smithi166.stdout:21: finishing write tid 1 to smithi16641208-21 2020-11-16T20:55:51.287 INFO:tasks.rados.rados.0.smithi166.stdout:20: finishing write tid 3 to smithi16641208-20 2020-11-16T20:55:51.287 INFO:tasks.rados.rados.0.smithi166.stdout:16: done (15 left) 2020-11-16T20:55:51.287 INFO:tasks.rados.rados.0.smithi166.stdout:17: done (14 left) 2020-11-16T20:55:51.287 INFO:tasks.rados.rados.0.smithi166.stdout:18: done (13 left) 2020-11-16T20:55:51.288 INFO:tasks.rados.rados.0.smithi166.stdout:19: done (12 left) 2020-11-16T20:55:51.288 INFO:tasks.rados.rados.0.smithi166.stdout:32: write initial oid 32 2020-11-16T20:55:51.288 INFO:tasks.rados.rados.0.smithi166.stdout:32: seq_num 31 ranges {521017=798131,1747530=482340} 2020-11-16T20:55:51.290 INFO:tasks.rados.rados.0.smithi166.stdout:32: writing smithi16641208-32 from 521017 to 1319148 tid 1 2020-11-16T20:55:51.296 INFO:tasks.rados.rados.0.smithi166.stdout:32: writing smithi16641208-32 from 1747530 to 2229870 tid 2 2020-11-16T20:55:51.296 INFO:tasks.rados.rados.0.smithi166.stdout:33: write initial oid 33 2020-11-16T20:55:51.296 INFO:tasks.rados.rados.0.smithi166.stdout:20: finishing write tid 4 to smithi16641208-20 2020-11-16T20:55:51.297 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 20 v 15 (ObjNum 19 snap 0 seq_num 19) dirty exists 2020-11-16T20:55:51.297 INFO:tasks.rados.rados.0.smithi166.stdout:20: left oid 20 (ObjNum 19 snap 0 seq_num 19) 2020-11-16T20:55:51.297 INFO:tasks.rados.rados.0.smithi166.stdout:21: finishing write tid 2 to smithi16641208-21 2020-11-16T20:55:51.297 INFO:tasks.rados.rados.0.smithi166.stdout:21: finishing write tid 3 to smithi16641208-21 2020-11-16T20:55:51.297 INFO:tasks.rados.rados.0.smithi166.stdout:22: finishing write tid 1 to smithi16641208-22 2020-11-16T20:55:51.297 INFO:tasks.rados.rados.0.smithi166.stdout:21: finishing write tid 4 to smithi16641208-21 2020-11-16T20:55:51.297 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 21 v 18 (ObjNum 20 snap 0 seq_num 20) dirty exists 2020-11-16T20:55:51.298 INFO:tasks.rados.rados.0.smithi166.stdout:21: left oid 21 (ObjNum 20 snap 0 seq_num 20) 2020-11-16T20:55:51.298 INFO:tasks.rados.rados.0.smithi166.stdout:22: finishing write tid 2 to smithi16641208-22 2020-11-16T20:55:51.298 INFO:tasks.rados.rados.0.smithi166.stdout:22: finishing write tid 3 to smithi16641208-22 2020-11-16T20:55:51.298 INFO:tasks.rados.rados.0.smithi166.stdout:23: finishing write tid 1 to smithi16641208-23 2020-11-16T20:55:51.298 INFO:tasks.rados.rados.0.smithi166.stdout:22: finishing write tid 4 to smithi16641208-22 2020-11-16T20:55:51.298 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 22 v 21 (ObjNum 21 snap 0 seq_num 21) dirty exists 2020-11-16T20:55:51.298 INFO:tasks.rados.rados.0.smithi166.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2020-11-16T20:55:51.299 INFO:tasks.rados.rados.0.smithi166.stdout:23: finishing write tid 2 to smithi16641208-23 2020-11-16T20:55:51.299 INFO:tasks.rados.rados.0.smithi166.stdout:23: finishing write tid 3 to smithi16641208-23 2020-11-16T20:55:51.299 INFO:tasks.rados.rados.0.smithi166.stdout:23: finishing write tid 4 to smithi16641208-23 2020-11-16T20:55:51.299 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 23 v 18 (ObjNum 22 snap 0 seq_num 22) dirty exists 2020-11-16T20:55:51.299 INFO:tasks.rados.rados.0.smithi166.stdout:23: left oid 23 (ObjNum 22 snap 0 seq_num 22) 2020-11-16T20:55:51.299 INFO:tasks.rados.rados.0.smithi166.stdout:24: finishing write tid 1 to smithi16641208-24 2020-11-16T20:55:51.299 INFO:tasks.rados.rados.0.smithi166.stdout:24: finishing write tid 2 to smithi16641208-24 2020-11-16T20:55:51.299 INFO:tasks.rados.rados.0.smithi166.stdout:24: finishing write tid 3 to smithi16641208-24 2020-11-16T20:55:51.300 INFO:tasks.rados.rados.0.smithi166.stdout:24: finishing write tid 4 to smithi16641208-24 2020-11-16T20:55:51.300 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 24 v 18 (ObjNum 23 snap 0 seq_num 23) dirty exists 2020-11-16T20:55:51.300 INFO:tasks.rados.rados.0.smithi166.stdout:24: left oid 24 (ObjNum 23 snap 0 seq_num 23) 2020-11-16T20:55:51.300 INFO:tasks.rados.rados.0.smithi166.stdout:33: seq_num 32 ranges {537824=473380,1806012=625998} 2020-11-16T20:55:51.301 INFO:tasks.rados.rados.0.smithi166.stdout:33: writing smithi16641208-33 from 537824 to 1011204 tid 1 2020-11-16T20:55:51.309 INFO:tasks.rados.rados.0.smithi166.stdout:33: writing smithi16641208-33 from 1806012 to 2432010 tid 2 2020-11-16T20:55:51.309 INFO:tasks.rados.rados.0.smithi166.stdout:20: done (13 left) 2020-11-16T20:55:51.310 INFO:tasks.rados.rados.0.smithi166.stdout:21: done (12 left) 2020-11-16T20:55:51.310 INFO:tasks.rados.rados.0.smithi166.stdout:22: done (11 left) 2020-11-16T20:55:51.310 INFO:tasks.rados.rados.0.smithi166.stdout:23: done (10 left) 2020-11-16T20:55:51.310 INFO:tasks.rados.rados.0.smithi166.stdout:24: done (9 left) 2020-11-16T20:55:51.310 INFO:tasks.rados.rados.0.smithi166.stdout:34: write initial oid 34 2020-11-16T20:55:51.310 INFO:tasks.rados.rados.0.smithi166.stdout:34: seq_num 33 ranges {554631=548629,1748141=486009} 2020-11-16T20:55:51.311 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:55:51.313+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:55:51.314 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:55:51.316 INFO:tasks.rados.rados.0.smithi166.stdout:34: writing smithi16641208-34 from 554631 to 1103260 tid 1 2020-11-16T20:55:51.322 INFO:tasks.rados.rados.0.smithi166.stdout:34: writing smithi16641208-34 from 1748141 to 2234150 tid 2 2020-11-16T20:55:51.322 INFO:tasks.rados.rados.0.smithi166.stdout:35: write initial oid 35 2020-11-16T20:55:51.323 INFO:tasks.rados.rados.0.smithi166.stdout:35: seq_num 34 ranges {571438=623878,1806623=629667} 2020-11-16T20:55:51.329 INFO:tasks.rados.rados.0.smithi166.stdout:35: writing smithi16641208-35 from 571438 to 1195316 tid 1 2020-11-16T20:55:51.336 INFO:tasks.rados.rados.0.smithi166.stdout:35: writing smithi16641208-35 from 1806623 to 2436290 tid 2 2020-11-16T20:55:51.336 INFO:tasks.rados.rados.0.smithi166.stdout:36: write initial oid 36 2020-11-16T20:55:51.336 INFO:tasks.rados.rados.0.smithi166.stdout:36: seq_num 35 ranges {588245=699127,1865105=489678} 2020-11-16T20:55:51.343 INFO:tasks.rados.rados.0.smithi166.stdout:36: writing smithi16641208-36 from 588245 to 1287372 tid 1 2020-11-16T20:55:51.349 INFO:tasks.rados.rados.0.smithi166.stdout:36: writing smithi16641208-36 from 1865105 to 2354783 tid 2 2020-11-16T20:55:51.350 INFO:tasks.rados.rados.0.smithi166.stdout:37: write initial oid 37 2020-11-16T20:55:51.350 INFO:tasks.rados.rados.0.smithi166.stdout:37: seq_num 36 ranges {605052=774376,1923587=633336} 2020-11-16T20:55:51.357 INFO:tasks.rados.rados.0.smithi166.stdout:37: writing smithi16641208-37 from 605052 to 1379428 tid 1 2020-11-16T20:55:51.364 INFO:tasks.rados.rados.0.smithi166.stdout:37: writing smithi16641208-37 from 1923587 to 2556923 tid 2 2020-11-16T20:55:51.364 INFO:tasks.rados.rados.0.smithi166.stdout:38: write initial oid 38 2020-11-16T20:55:51.364 INFO:tasks.rados.rados.0.smithi166.stdout:25: finishing write tid 1 to smithi16641208-25 2020-11-16T20:55:51.364 INFO:tasks.rados.rados.0.smithi166.stdout:38: seq_num 37 ranges {621859=449625,1865716=756143} 2020-11-16T20:55:51.370 INFO:tasks.rados.rados.0.smithi166.stdout:38: writing smithi16641208-38 from 621859 to 1071484 tid 1 2020-11-16T20:55:51.377 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:55:51.381+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:55:51.379 INFO:tasks.rados.rados.0.smithi166.stdout:38: writing smithi16641208-38 from 1865716 to 2621859 tid 2 2020-11-16T20:55:51.379 INFO:tasks.rados.rados.0.smithi166.stdout:39: write initial oid 39 2020-11-16T20:55:51.379 INFO:tasks.rados.rados.0.smithi166.stdout:39: seq_num 38 ranges {638666=524874,1924198=637005} 2020-11-16T20:55:51.385 INFO:tasks.rados.rados.0.smithi166.stdout:39: writing smithi16641208-39 from 638666 to 1163540 tid 1 2020-11-16T20:55:51.394 INFO:tasks.rados.rados.0.smithi166.stdout:39: writing smithi16641208-39 from 1924198 to 2561203 tid 2 2020-11-16T20:55:51.394 INFO:tasks.rados.rados.0.smithi166.stdout:40: write initial oid 40 2020-11-16T20:55:51.394 INFO:tasks.rados.rados.0.smithi166.stdout:40: seq_num 39 ranges {655473=716476,2099033=556440} 2020-11-16T20:55:51.401 INFO:tasks.rados.rados.0.smithi166.stdout:40: writing smithi16641208-40 from 655473 to 1371949 tid 1 2020-11-16T20:55:51.409 INFO:tasks.rados.rados.0.smithi166.stdout:40: writing smithi16641208-40 from 2099033 to 2655473 tid 2 2020-11-16T20:55:51.409 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:51.409 INFO:tasks.rados.rados.0.smithi166.stdout:25: finishing write tid 2 to smithi16641208-25 2020-11-16T20:55:51.409 INFO:tasks.rados.rados.0.smithi166.stdout:25: finishing write tid 3 to smithi16641208-25 2020-11-16T20:55:51.409 INFO:tasks.rados.rados.0.smithi166.stdout:25: finishing write tid 4 to smithi16641208-25 2020-11-16T20:55:51.410 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 25 v 21 (ObjNum 24 snap 0 seq_num 24) dirty exists 2020-11-16T20:55:51.410 INFO:tasks.rados.rados.0.smithi166.stdout:25: left oid 25 (ObjNum 24 snap 0 seq_num 24) 2020-11-16T20:55:51.410 INFO:tasks.rados.rados.0.smithi166.stdout:26: finishing write tid 1 to smithi16641208-26 2020-11-16T20:55:51.410 INFO:tasks.rados.rados.0.smithi166.stdout:26: finishing write tid 2 to smithi16641208-26 2020-11-16T20:55:51.410 INFO:tasks.rados.rados.0.smithi166.stdout:26: finishing write tid 3 to smithi16641208-26 2020-11-16T20:55:51.410 INFO:tasks.rados.rados.0.smithi166.stdout:25: done (15 left) 2020-11-16T20:55:51.411 INFO:tasks.rados.rados.0.smithi166.stdout:41: write initial oid 41 2020-11-16T20:55:51.411 INFO:tasks.rados.rados.0.smithi166.stdout:41: seq_num 40 ranges {672280=791725,2157515=514765} 2020-11-16T20:55:51.417 INFO:tasks.rados.rados.0.smithi166.stdout:41: writing smithi16641208-41 from 672280 to 1464005 tid 1 2020-11-16T20:55:51.424 INFO:tasks.rados.rados.0.smithi166.stdout:41: writing smithi16641208-41 from 2157515 to 2672280 tid 2 2020-11-16T20:55:51.424 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:51.424 INFO:tasks.rados.rados.0.smithi166.stdout:26: finishing write tid 4 to smithi16641208-26 2020-11-16T20:55:51.424 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 26 v 24 (ObjNum 25 snap 0 seq_num 25) dirty exists 2020-11-16T20:55:51.424 INFO:tasks.rados.rados.0.smithi166.stdout:26: left oid 26 (ObjNum 25 snap 0 seq_num 25) 2020-11-16T20:55:51.424 INFO:tasks.rados.rados.0.smithi166.stdout:26: done (15 left) 2020-11-16T20:55:51.425 INFO:tasks.rados.rados.0.smithi166.stdout:42: write initial oid 42 2020-11-16T20:55:51.425 INFO:tasks.rados.rados.0.smithi166.stdout:42: seq_num 41 ranges {689087=466974,1699644=784332} 2020-11-16T20:55:51.430 INFO:tasks.rados.rados.0.smithi166.stdout:42: writing smithi16641208-42 from 689087 to 1156061 tid 1 2020-11-16T20:55:51.438 INFO:tasks.rados.rados.0.smithi166.stdout:42: writing smithi16641208-42 from 1699644 to 2483976 tid 2 2020-11-16T20:55:51.438 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:51.438 INFO:tasks.rados.rados.0.smithi166.stdout:27: finishing write tid 1 to smithi16641208-27 2020-11-16T20:55:51.439 INFO:tasks.rados.rados.0.smithi166.stdout:27: finishing write tid 2 to smithi16641208-27 2020-11-16T20:55:51.439 INFO:tasks.rados.rados.0.smithi166.stdout:27: finishing write tid 3 to smithi16641208-27 2020-11-16T20:55:51.439 INFO:tasks.rados.rados.0.smithi166.stdout:27: finishing write tid 4 to smithi16641208-27 2020-11-16T20:55:51.439 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 27 v 24 (ObjNum 26 snap 0 seq_num 26) dirty exists 2020-11-16T20:55:51.439 INFO:tasks.rados.rados.0.smithi166.stdout:27: left oid 27 (ObjNum 26 snap 0 seq_num 26) 2020-11-16T20:55:51.439 INFO:tasks.rados.rados.0.smithi166.stdout:28: finishing write tid 1 to smithi16641208-28 2020-11-16T20:55:51.440 INFO:tasks.rados.rados.0.smithi166.stdout:28: finishing write tid 2 to smithi16641208-28 2020-11-16T20:55:51.440 INFO:tasks.rados.rados.0.smithi166.stdout:28: finishing write tid 3 to smithi16641208-28 2020-11-16T20:55:51.440 INFO:tasks.rados.rados.0.smithi166.stdout:28: finishing write tid 4 to smithi16641208-28 2020-11-16T20:55:51.440 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 28 v 21 (ObjNum 27 snap 0 seq_num 27) dirty exists 2020-11-16T20:55:51.440 INFO:tasks.rados.rados.0.smithi166.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2020-11-16T20:55:51.440 INFO:tasks.rados.rados.0.smithi166.stdout:27: done (15 left) 2020-11-16T20:55:51.440 INFO:tasks.rados.rados.0.smithi166.stdout:28: done (14 left) 2020-11-16T20:55:51.440 INFO:tasks.rados.rados.0.smithi166.stdout:43: write initial oid 43 2020-11-16T20:55:51.441 INFO:tasks.rados.rados.0.smithi166.stdout:43: seq_num 42 ranges {705894=542223,1758126=644343} 2020-11-16T20:55:51.445 INFO:tasks.rados.rados.0.smithi166.stdout:43: writing smithi16641208-43 from 705894 to 1248117 tid 1 2020-11-16T20:55:51.451 INFO:tasks.rados.rados.0.smithi166.stdout:43: writing smithi16641208-43 from 1758126 to 2402469 tid 2 2020-11-16T20:55:51.452 INFO:tasks.rados.rados.0.smithi166.stdout:44: write initial oid 44 2020-11-16T20:55:51.452 INFO:tasks.rados.rados.0.smithi166.stdout:44: seq_num 43 ranges {722701=617472,1816608=788001} 2020-11-16T20:55:51.459 INFO:tasks.rados.rados.0.smithi166.stdout:44: writing smithi16641208-44 from 722701 to 1340173 tid 1 2020-11-16T20:55:51.464 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:55:51.464 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:55:51.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:55:51.464 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:55:51.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.464 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:9 3.2 e33/19 3:5ad6a7de:::smithi16641208-3:head v 33'2, mlcod=0'0)", 2020-11-16T20:55:51.465 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:50.930648+0000", 2020-11-16T20:55:51.465 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.536649076, 2020-11-16T20:55:51.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073756270000000001, 2020-11-16T20:55:51.465 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:55:51.465 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:51.465 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:55:51.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:55:51.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.930648+0000", 2020-11-16T20:55:51.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:55:51.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:55:51.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.930648+0000", 2020-11-16T20:55:51.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0013085880000000001 2020-11-16T20:55:51.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:55:51.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.931957+0000", 2020-11-16T20:55:51.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7170000000000008e-06 2020-11-16T20:55:51.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.468 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:55:51.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.931964+0000", 2020-11-16T20:55:51.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1423999999999999e-05 2020-11-16T20:55:51.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.468 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:55:51.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.931976+0000", 2020-11-16T20:55:51.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3169999999999998e-06 2020-11-16T20:55:51.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:55:51.469 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.931982+0000", 2020-11-16T20:55:51.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7749000000000001e-05 2020-11-16T20:55:51.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:55:51.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.932020+0000", 2020-11-16T20:55:51.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5728000000000002e-05 2020-11-16T20:55:51.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:55:51.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.932046+0000", 2020-11-16T20:55:51.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059250600000000002 2020-11-16T20:55:51.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:55:51.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.937971+0000", 2020-11-16T20:55:51.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3044000000000002e-05 2020-11-16T20:55:51.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.472 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.472 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:55:51.472 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.938024+0000", 2020-11-16T20:55:51.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073756270000000001 2020-11-16T20:55:51.472 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.472 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:55:51.472 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.473 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.473 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:1 4.3 e33/22 4:d8946fd6:::smithi16641208-5:head v 33'1, mlcod=0'0)", 2020-11-16T20:55:51.473 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:50.965831+0000", 2020-11-16T20:55:51.473 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.50146562699999997, 2020-11-16T20:55:51.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0094273399999999993, 2020-11-16T20:55:51.473 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:55:51.473 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:51.474 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:55:51.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:55:51.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.965831+0000", 2020-11-16T20:55:51.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:55:51.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:55:51.475 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.965831+0000", 2020-11-16T20:55:51.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0033738330000000001 2020-11-16T20:55:51.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.475 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:55:51.475 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.969205+0000", 2020-11-16T20:55:51.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0068000000000001e-05 2020-11-16T20:55:51.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:55:51.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.969215+0000", 2020-11-16T20:55:51.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5415000000000001e-05 2020-11-16T20:55:51.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:55:51.477 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.969231+0000", 2020-11-16T20:55:51.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8053000000000001e-05 2020-11-16T20:55:51.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.477 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:55:51.477 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.969249+0000", 2020-11-16T20:55:51.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9971e-05 2020-11-16T20:55:51.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.478 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:55:51.478 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.969299+0000", 2020-11-16T20:55:51.478 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3357e-05 2020-11-16T20:55:51.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.478 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:55:51.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.969322+0000", 2020-11-16T20:55:51.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058904999999999999 2020-11-16T20:55:51.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:55:51.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.975213+0000", 2020-11-16T20:55:51.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6143000000000002e-05 2020-11-16T20:55:51.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:55:51.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.975259+0000", 2020-11-16T20:55:51.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0094273399999999993 2020-11-16T20:55:51.480 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.480 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:55:51.480 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.481 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:18 4.3 e33/22 4:d8946fd6:::smithi16641208-5:head v 33'2, mlcod=0'0)", 2020-11-16T20:55:51.481 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:50.969290+0000", 2020-11-16T20:55:51.481 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.49800674499999997, 2020-11-16T20:55:51.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076057970000000001, 2020-11-16T20:55:51.481 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:55:51.481 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:51.482 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:55:51.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.482 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:55:51.482 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.969290+0000", 2020-11-16T20:55:51.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:55:51.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.483 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:55:51.483 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.969290+0000", 2020-11-16T20:55:51.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00057066799999999998 2020-11-16T20:55:51.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.483 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:55:51.483 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.969861+0000", 2020-11-16T20:55:51.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4330000000000004e-06 2020-11-16T20:55:51.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:55:51.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.969869+0000", 2020-11-16T20:55:51.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2257e-05 2020-11-16T20:55:51.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:55:51.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.969882+0000", 2020-11-16T20:55:51.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2020-11-16T20:55:51.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:55:51.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.969888+0000", 2020-11-16T20:55:51.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00054032400000000001 2020-11-16T20:55:51.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:55:51.486 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.970428+0000", 2020-11-16T20:55:51.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5651999999999999e-05 2020-11-16T20:55:51.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.487 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:55:51.487 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.970444+0000", 2020-11-16T20:55:51.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0063824830000000004 2020-11-16T20:55:51.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.487 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:55:51.487 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.976826+0000", 2020-11-16T20:55:51.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9847999999999999e-05 2020-11-16T20:55:51.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:55:51.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.976896+0000", 2020-11-16T20:55:51.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076057970000000001 2020-11-16T20:55:51.488 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.488 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:55:51.489 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.489 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:4 4.3 e33/22 4:fc3a32b3:::smithi16641208-6:head v 33'4, mlcod=33'2)", 2020-11-16T20:55:51.489 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:50.981019+0000", 2020-11-16T20:55:51.489 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.48627786899999997, 2020-11-16T20:55:51.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010849854000000001, 2020-11-16T20:55:51.490 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:55:51.490 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:51.490 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:55:51.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:55:51.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.981019+0000", 2020-11-16T20:55:51.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:55:51.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.491 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:55:51.491 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.981019+0000", 2020-11-16T20:55:51.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0021937990000000002 2020-11-16T20:55:51.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.491 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:55:51.492 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983213+0000", 2020-11-16T20:55:51.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6639999999999998e-06 2020-11-16T20:55:51.492 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.492 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.492 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:55:51.492 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983221+0000", 2020-11-16T20:55:51.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5099999999999998e-06 2020-11-16T20:55:51.492 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:55:51.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983229+0000", 2020-11-16T20:55:51.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2709999999999992e-06 2020-11-16T20:55:51.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:55:51.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983237+0000", 2020-11-16T20:55:51.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2280000000000001e-05 2020-11-16T20:55:51.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:55:51.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983290+0000", 2020-11-16T20:55:51.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8694000000000001e-05 2020-11-16T20:55:51.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.495 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:55:51.495 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983308+0000", 2020-11-16T20:55:51.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084920670000000007 2020-11-16T20:55:51.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.495 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:55:51.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.991800+0000", 2020-11-16T20:55:51.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8569e-05 2020-11-16T20:55:51.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.496 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:55:51.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.991869+0000", 2020-11-16T20:55:51.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010849854000000001 2020-11-16T20:55:51.496 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.497 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:55:51.497 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.497 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:22 4.3 e33/22 4:fc3a32b3:::smithi16641208-6:head v 33'5, mlcod=33'2)", 2020-11-16T20:55:51.497 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:50.983264+0000", 2020-11-16T20:55:51.497 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.484032935, 2020-11-16T20:55:51.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089543179999999993, 2020-11-16T20:55:51.498 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:55:51.498 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:51.498 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:55:51.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:55:51.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983264+0000", 2020-11-16T20:55:51.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:55:51.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:55:51.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983264+0000", 2020-11-16T20:55:51.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5098999999999995e-05 2020-11-16T20:55:51.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:55:51.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983329+0000", 2020-11-16T20:55:51.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5549999999999999e-06 2020-11-16T20:55:51.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:55:51.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983336+0000", 2020-11-16T20:55:51.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1819e-05 2020-11-16T20:55:51.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:55:51.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983348+0000", 2020-11-16T20:55:51.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2269999999999998e-06 2020-11-16T20:55:51.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:55:51.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983354+0000", 2020-11-16T20:55:51.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014605250000000001 2020-11-16T20:55:51.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:55:51.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.984814+0000", 2020-11-16T20:55:51.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5131999999999999e-05 2020-11-16T20:55:51.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:55:51.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.984839+0000", 2020-11-16T20:55:51.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073236600000000001 2020-11-16T20:55:51.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:55:51.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.992163+0000", 2020-11-16T20:55:51.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5300999999999998e-05 2020-11-16T20:55:51.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:55:51.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.992218+0000", 2020-11-16T20:55:51.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089543179999999993 2020-11-16T20:55:51.505 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.505 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:55:51.505 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.505 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:23 4.3 e33/22 4:fc3a32b3:::smithi16641208-6:head v 33'6, mlcod=33'2)", 2020-11-16T20:55:51.505 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:50.983389+0000", 2020-11-16T20:55:51.506 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.483908275, 2020-11-16T20:55:51.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088732259999999997, 2020-11-16T20:55:51.506 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:55:51.506 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:51.506 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:55:51.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:55:51.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983389+0000", 2020-11-16T20:55:51.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:55:51.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:55:51.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983389+0000", 2020-11-16T20:55:51.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1211999999999997e-05 2020-11-16T20:55:51.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.508 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:55:51.508 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983440+0000", 2020-11-16T20:55:51.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7460000000000003e-06 2020-11-16T20:55:51.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.508 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:55:51.508 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983447+0000", 2020-11-16T20:55:51.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7119999999999995e-06 2020-11-16T20:55:51.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:55:51.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983456+0000", 2020-11-16T20:55:51.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.172e-06 2020-11-16T20:55:51.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:55:51.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983461+0000", 2020-11-16T20:55:51.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001656376 2020-11-16T20:55:51.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:55:51.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.985117+0000", 2020-11-16T20:55:51.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5082000000000001e-05 2020-11-16T20:55:51.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:55:51.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.985142+0000", 2020-11-16T20:55:51.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070797400000000002 2020-11-16T20:55:51.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.512 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:55:51.512 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.992222+0000", 2020-11-16T20:55:51.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0185999999999998e-05 2020-11-16T20:55:51.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.512 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:55:51.513 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.992262+0000", 2020-11-16T20:55:51.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088732259999999997 2020-11-16T20:55:51.513 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.513 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:55:51.513 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.513 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:7 4.3 e33/22 4:f5e0b2f3:::smithi16641208-7:head v 33'7, mlcod=33'2)", 2020-11-16T20:55:51.514 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:50.986079+0000", 2020-11-16T20:55:51.514 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.48121840500000002, 2020-11-16T20:55:51.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088869959999999994, 2020-11-16T20:55:51.514 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:55:51.514 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:51.514 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:55:51.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:55:51.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.986079+0000", 2020-11-16T20:55:51.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:55:51.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:55:51.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.986079+0000", 2020-11-16T20:55:51.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001616808 2020-11-16T20:55:51.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:55:51.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.987695+0000", 2020-11-16T20:55:51.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4549999999999995e-06 2020-11-16T20:55:51.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.517 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:55:51.517 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.987704+0000", 2020-11-16T20:55:51.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1396999999999999e-05 2020-11-16T20:55:51.517 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.517 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:55:51.517 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.987715+0000", 2020-11-16T20:55:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9719999999999997e-06 2020-11-16T20:55:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:55:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.987721+0000", 2020-11-16T20:55:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9149000000000001e-05 2020-11-16T20:55:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:55:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.987760+0000", 2020-11-16T20:55:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4229e-05 2020-11-16T20:55:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:55:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.987775+0000", 2020-11-16T20:55:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0071548369999999998 2020-11-16T20:55:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:55:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.994930+0000", 2020-11-16T20:55:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6149000000000002e-05 2020-11-16T20:55:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:55:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.994966+0000", 2020-11-16T20:55:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088869959999999994 2020-11-16T20:55:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:55:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:26 4.3 e33/22 4:f5e0b2f3:::smithi16641208-7:head v 33'8, mlcod=33'2)", 2020-11-16T20:55:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:50.987757+0000", 2020-11-16T20:55:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.47953994599999999, 2020-11-16T20:55:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072319560000000003, 2020-11-16T20:55:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:55:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:55:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:55:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.987757+0000", 2020-11-16T20:55:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:55:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:55:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.987757+0000", 2020-11-16T20:55:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00053032199999999995 2020-11-16T20:55:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:55:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.988287+0000", 2020-11-16T20:55:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3180000000000007e-06 2020-11-16T20:55:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:55:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.988296+0000", 2020-11-16T20:55:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1572e-05 2020-11-16T20:55:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:55:51.526 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.988307+0000", 2020-11-16T20:55:51.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3039999999999999e-06 2020-11-16T20:55:51.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.526 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:55:51.526 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.988315+0000", 2020-11-16T20:55:51.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00042473199999999998 2020-11-16T20:55:51.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:55:51.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.988739+0000", 2020-11-16T20:55:51.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5791000000000001e-05 2020-11-16T20:55:51.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:55:51.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.988765+0000", 2020-11-16T20:55:51.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062030490000000004 2020-11-16T20:55:51.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:55:51.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.994968+0000", 2020-11-16T20:55:51.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0868000000000001e-05 2020-11-16T20:55:51.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:55:51.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.994989+0000", 2020-11-16T20:55:51.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072319560000000003 2020-11-16T20:55:51.529 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.529 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:55:51.530 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.530 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:14 4.3 e33/22 4:e109c45f:::smithi16641208-11:head v 33'13, mlcod=33'8)", 2020-11-16T20:55:51.530 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.033310+0000", 2020-11-16T20:55:51.530 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.43398736799999998, 2020-11-16T20:55:51.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0080962550000000001, 2020-11-16T20:55:51.531 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:55:51.531 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:51.531 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:55:51.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:55:51.531 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.033310+0000", 2020-11-16T20:55:51.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:55:51.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:55:51.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.033310+0000", 2020-11-16T20:55:51.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0018174720000000001 2020-11-16T20:55:51.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:55:51.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.035127+0000", 2020-11-16T20:55:51.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6359999999999997e-06 2020-11-16T20:55:51.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:55:51.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.035134+0000", 2020-11-16T20:55:51.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.807e-06 2020-11-16T20:55:51.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:55:51.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.035142+0000", 2020-11-16T20:55:51.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8099999999999997e-06 2020-11-16T20:55:51.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:55:51.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.035146+0000", 2020-11-16T20:55:51.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2882999999999997e-05 2020-11-16T20:55:51.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.535 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:55:51.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.035179+0000", 2020-11-16T20:55:51.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4396000000000001e-05 2020-11-16T20:55:51.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:55:51.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.035194+0000", 2020-11-16T20:55:51.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061568350000000003 2020-11-16T20:55:51.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:55:51.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.041351+0000", 2020-11-16T20:55:51.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5415999999999999e-05 2020-11-16T20:55:51.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:55:51.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.041406+0000", 2020-11-16T20:55:51.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0080962550000000001 2020-11-16T20:55:51.537 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.538 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:55:51.538 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.538 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:42 4.3 e33/22 4:e109c45f:::smithi16641208-11:head v 33'14, mlcod=33'8)", 2020-11-16T20:55:51.538 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.035169+0000", 2020-11-16T20:55:51.538 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.432128336, 2020-11-16T20:55:51.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0071645880000000004, 2020-11-16T20:55:51.539 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:55:51.539 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:51.539 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:55:51.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:55:51.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.035169+0000", 2020-11-16T20:55:51.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:55:51.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:55:51.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.035169+0000", 2020-11-16T20:55:51.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000950351 2020-11-16T20:55:51.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:55:51.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.036119+0000", 2020-11-16T20:55:51.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2809999999999999e-06 2020-11-16T20:55:51.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:55:51.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.036124+0000", 2020-11-16T20:55:51.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1089e-05 2020-11-16T20:55:51.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:55:51.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.036155+0000", 2020-11-16T20:55:51.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6489999999999996e-06 2020-11-16T20:55:51.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.543 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:55:51.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.036161+0000", 2020-11-16T20:55:51.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000301654 2020-11-16T20:55:51.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:55:51.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.036463+0000", 2020-11-16T20:55:51.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4263e-05 2020-11-16T20:55:51.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:55:51.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.036477+0000", 2020-11-16T20:55:51.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0057991819999999999 2020-11-16T20:55:51.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.545 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:55:51.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.042276+0000", 2020-11-16T20:55:51.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7119e-05 2020-11-16T20:55:51.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:55:51.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.042333+0000", 2020-11-16T20:55:51.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0071645880000000004 2020-11-16T20:55:51.546 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.546 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:55:51.546 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.547 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:11 4.1 e33/22 4:a1eef07d:::smithi16641208-13:head v 33'7, mlcod=33'5)", 2020-11-16T20:55:51.547 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.058195+0000", 2020-11-16T20:55:51.547 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.409102366, 2020-11-16T20:55:51.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0081484539999999994, 2020-11-16T20:55:51.547 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:55:51.548 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:51.548 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:55:51.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.548 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:55:51.548 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.058195+0000", 2020-11-16T20:55:51.548 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:55:51.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.549 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:55:51.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.058195+0000", 2020-11-16T20:55:51.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00045999799999999998 2020-11-16T20:55:51.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.549 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:55:51.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.058655+0000", 2020-11-16T20:55:51.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1739000000000001e-05 2020-11-16T20:55:51.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:55:51.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.058666+0000", 2020-11-16T20:55:51.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3341e-05 2020-11-16T20:55:51.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:55:51.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.058680+0000", 2020-11-16T20:55:51.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2900000000000008e-06 2020-11-16T20:55:51.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:55:51.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.058689+0000", 2020-11-16T20:55:51.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6174999999999996e-05 2020-11-16T20:55:51.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.552 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:55:51.552 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.058755+0000", 2020-11-16T20:55:51.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6069000000000003e-05 2020-11-16T20:55:51.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:55:51.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.058791+0000", 2020-11-16T20:55:51.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074886969999999999 2020-11-16T20:55:51.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:55:51.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.066280+0000", 2020-11-16T20:55:51.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3145000000000006e-05 2020-11-16T20:55:51.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:55:51.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.066343+0000", 2020-11-16T20:55:51.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0081484539999999994 2020-11-16T20:55:51.554 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.554 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:55:51.555 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.555 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:14 4.1 e33/22 4:a4a335f7:::smithi16641208-15:head v 33'10, mlcod=33'8)", 2020-11-16T20:55:51.555 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.086841+0000", 2020-11-16T20:55:51.555 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.38045655299999998, 2020-11-16T20:55:51.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0080234069999999998, 2020-11-16T20:55:51.556 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:55:51.556 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:51.556 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:55:51.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.556 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:55:51.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.086841+0000", 2020-11-16T20:55:51.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:55:51.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:55:51.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.086841+0000", 2020-11-16T20:55:51.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00042177499999999999 2020-11-16T20:55:51.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:55:51.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.087262+0000", 2020-11-16T20:55:51.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5550000000000008e-06 2020-11-16T20:55:51.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:55:51.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.087272+0000", 2020-11-16T20:55:51.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3229e-05 2020-11-16T20:55:51.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:55:51.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.087285+0000", 2020-11-16T20:55:51.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1609999999999992e-06 2020-11-16T20:55:51.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:55:51.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.087294+0000", 2020-11-16T20:55:51.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2646999999999996e-05 2020-11-16T20:55:51.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.560 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:55:51.560 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.087387+0000", 2020-11-16T20:55:51.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6108e-05 2020-11-16T20:55:51.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:55:51.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.087433+0000", 2020-11-16T20:55:51.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073698069999999999 2020-11-16T20:55:51.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:55:51.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.094803+0000", 2020-11-16T20:55:51.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1124999999999995e-05 2020-11-16T20:55:51.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:55:51.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.094864+0000", 2020-11-16T20:55:51.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0080234069999999998 2020-11-16T20:55:51.562 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.563 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:55:51.563 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.563 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:58 4.1 e33/22 4:a4a335f7:::smithi16641208-15:head v 33'11, mlcod=33'8)", 2020-11-16T20:55:51.563 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.088837+0000", 2020-11-16T20:55:51.563 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.37845976999999997, 2020-11-16T20:55:51.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085889569999999995, 2020-11-16T20:55:51.564 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:55:51.564 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:51.564 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:55:51.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:55:51.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.088837+0000", 2020-11-16T20:55:51.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:55:51.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:55:51.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.088837+0000", 2020-11-16T20:55:51.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2695000000000006e-05 2020-11-16T20:55:51.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:55:51.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.088930+0000", 2020-11-16T20:55:51.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.679e-06 2020-11-16T20:55:51.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:55:51.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.088940+0000", 2020-11-16T20:55:51.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2918999999999999e-05 2020-11-16T20:55:51.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:55:51.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.088953+0000", 2020-11-16T20:55:51.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3930000000000002e-06 2020-11-16T20:55:51.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:55:51.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.088960+0000", 2020-11-16T20:55:51.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4357000000000002e-05 2020-11-16T20:55:51.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:55:51.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.089014+0000", 2020-11-16T20:55:51.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4742000000000001e-05 2020-11-16T20:55:51.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:55:51.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.089039+0000", 2020-11-16T20:55:51.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0083315200000000002 2020-11-16T20:55:51.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:55:51.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.097371+0000", 2020-11-16T20:55:51.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5652000000000002e-05 2020-11-16T20:55:51.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:55:51.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.097426+0000", 2020-11-16T20:55:51.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085889569999999995 2020-11-16T20:55:51.570 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.571 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:55:51.571 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.571 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:59 4.1 e33/22 4:a4a335f7:::smithi16641208-15:head v 33'12, mlcod=33'8)", 2020-11-16T20:55:51.571 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.089692+0000", 2020-11-16T20:55:51.571 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.37760485399999999, 2020-11-16T20:55:51.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0077754829999999997, 2020-11-16T20:55:51.572 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:55:51.572 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:51.572 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:55:51.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:55:51.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.089692+0000", 2020-11-16T20:55:51.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:55:51.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:55:51.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.089692+0000", 2020-11-16T20:55:51.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8881000000000003e-05 2020-11-16T20:55:51.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:55:51.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.089731+0000", 2020-11-16T20:55:51.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5050000000000004e-06 2020-11-16T20:55:51.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:55:51.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.089738+0000", 2020-11-16T20:55:51.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.645e-06 2020-11-16T20:55:51.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:55:51.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.089747+0000", 2020-11-16T20:55:51.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8510000000000004e-06 2020-11-16T20:55:51.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:55:51.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.089753+0000", 2020-11-16T20:55:51.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029523499999999997 2020-11-16T20:55:51.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:55:51.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.090048+0000", 2020-11-16T20:55:51.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8706e-05 2020-11-16T20:55:51.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:55:51.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.090067+0000", 2020-11-16T20:55:51.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073632740000000004 2020-11-16T20:55:51.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:55:51.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.097430+0000", 2020-11-16T20:55:51.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7385999999999997e-05 2020-11-16T20:55:51.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:55:51.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.097468+0000", 2020-11-16T20:55:51.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0077754829999999997 2020-11-16T20:55:51.579 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.579 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:55:51.579 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.579 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:114 4.3 e33/22 4:d81363a7:::smithi16641208-29:head v 33'17, mlcod=33'14)", 2020-11-16T20:55:51.579 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.267332+0000", 2020-11-16T20:55:51.580 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.19996523199999999, 2020-11-16T20:55:51.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0087253720000000003, 2020-11-16T20:55:51.580 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:55:51.580 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:51.580 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:55:51.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:55:51.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.267332+0000", 2020-11-16T20:55:51.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:55:51.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:55:51.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.267332+0000", 2020-11-16T20:55:51.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00094179400000000003 2020-11-16T20:55:51.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:55:51.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.268274+0000", 2020-11-16T20:55:51.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7739999999999999e-06 2020-11-16T20:55:51.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:55:51.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.268283+0000", 2020-11-16T20:55:51.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4943000000000001e-05 2020-11-16T20:55:51.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:55:51.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.268298+0000", 2020-11-16T20:55:51.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8889999999999997e-06 2020-11-16T20:55:51.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:55:51.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.268308+0000", 2020-11-16T20:55:51.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000218247 2020-11-16T20:55:51.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:55:51.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.268526+0000", 2020-11-16T20:55:51.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7167e-05 2020-11-16T20:55:51.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:55:51.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.268544+0000", 2020-11-16T20:55:51.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074727450000000003 2020-11-16T20:55:51.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:55:51.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.276016+0000", 2020-11-16T20:55:51.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0812999999999997e-05 2020-11-16T20:55:51.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:55:51.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.276057+0000", 2020-11-16T20:55:51.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0087253720000000003 2020-11-16T20:55:51.587 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.587 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:55:51.587 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.587 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:115 4.3 e33/22 4:d81363a7:::smithi16641208-29:head v 33'18, mlcod=33'14)", 2020-11-16T20:55:51.587 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.268350+0000", 2020-11-16T20:55:51.588 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.19894736900000001, 2020-11-16T20:55:51.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0077486889999999996, 2020-11-16T20:55:51.588 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:55:51.588 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:51.588 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:55:51.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:55:51.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.268350+0000", 2020-11-16T20:55:51.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:55:51.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:55:51.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.268350+0000", 2020-11-16T20:55:51.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7515999999999997e-05 2020-11-16T20:55:51.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:55:51.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.268397+0000", 2020-11-16T20:55:51.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9959999999999996e-06 2020-11-16T20:55:51.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:55:51.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.268404+0000", 2020-11-16T20:55:51.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1909999999999999e-05 2020-11-16T20:55:51.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:55:51.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.268416+0000", 2020-11-16T20:55:51.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7660000000000004e-06 2020-11-16T20:55:51.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:55:51.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.268422+0000", 2020-11-16T20:55:51.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00079790500000000001 2020-11-16T20:55:51.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:55:51.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.269220+0000", 2020-11-16T20:55:51.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2705999999999999e-05 2020-11-16T20:55:51.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:55:51.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.269242+0000", 2020-11-16T20:55:51.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0068195440000000003 2020-11-16T20:55:51.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:55:51.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.276062+0000", 2020-11-16T20:55:51.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6346000000000001e-05 2020-11-16T20:55:51.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:55:51.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.276098+0000", 2020-11-16T20:55:51.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0077486889999999996 2020-11-16T20:55:51.595 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.595 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:55:51.595 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.595 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:32 4.1 e33/22 4:b565f7d2:::smithi16641208-35:head v 33'25, mlcod=33'23)", 2020-11-16T20:55:51.596 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.343421+0000", 2020-11-16T20:55:51.596 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.123876527, 2020-11-16T20:55:51.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0093430960000000004, 2020-11-16T20:55:51.596 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:55:51.596 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:51.596 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:55:51.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:55:51.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.343421+0000", 2020-11-16T20:55:51.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:55:51.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:55:51.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.343421+0000", 2020-11-16T20:55:51.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030690200000000001 2020-11-16T20:55:51.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:55:51.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.343727+0000", 2020-11-16T20:55:51.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0356e-05 2020-11-16T20:55:51.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:55:51.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.343738+0000", 2020-11-16T20:55:51.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6294e-05 2020-11-16T20:55:51.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:55:51.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.343754+0000", 2020-11-16T20:55:51.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3569999999999998e-06 2020-11-16T20:55:51.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:55:51.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.343762+0000", 2020-11-16T20:55:51.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5431000000000004e-05 2020-11-16T20:55:51.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:55:51.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.343828+0000", 2020-11-16T20:55:51.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3006000000000002e-05 2020-11-16T20:55:51.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:55:51.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.343861+0000", 2020-11-16T20:55:51.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088372769999999993 2020-11-16T20:55:51.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:55:51.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.352698+0000", 2020-11-16T20:55:51.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5473000000000001e-05 2020-11-16T20:55:51.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:55:51.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.352764+0000", 2020-11-16T20:55:51.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0093430960000000004 2020-11-16T20:55:51.603 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.603 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:55:51.603 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.604 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:138 4.1 e33/22 4:b565f7d2:::smithi16641208-35:head v 33'26, mlcod=33'23)", 2020-11-16T20:55:51.604 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.345112+0000", 2020-11-16T20:55:51.604 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.122184733, 2020-11-16T20:55:51.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085676109999999993, 2020-11-16T20:55:51.604 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:55:51.604 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:51.604 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:55:51.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:55:51.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.345112+0000", 2020-11-16T20:55:51.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:55:51.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:55:51.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.345112+0000", 2020-11-16T20:55:51.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000197278 2020-11-16T20:55:51.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:55:51.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.345310+0000", 2020-11-16T20:55:51.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4060000000000002e-06 2020-11-16T20:55:51.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:55:51.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.345316+0000", 2020-11-16T20:55:51.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7919999999999993e-06 2020-11-16T20:55:51.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:55:51.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.345324+0000", 2020-11-16T20:55:51.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3969999999999999e-06 2020-11-16T20:55:51.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:55:51.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.345330+0000", 2020-11-16T20:55:51.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1074000000000005e-05 2020-11-16T20:55:51.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:55:51.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.345391+0000", 2020-11-16T20:55:51.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4046e-05 2020-11-16T20:55:51.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:55:51.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.345415+0000", 2020-11-16T20:55:51.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082229859999999998 2020-11-16T20:55:51.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:55:51.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.353638+0000", 2020-11-16T20:55:51.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1631999999999997e-05 2020-11-16T20:55:51.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:55:51.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.353680+0000", 2020-11-16T20:55:51.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085676109999999993 2020-11-16T20:55:51.611 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.611 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:55:51.611 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.612 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:139 4.1 e33/22 4:b565f7d2:::smithi16641208-35:head v 33'27, mlcod=33'23)", 2020-11-16T20:55:51.612 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.346480+0000", 2020-11-16T20:55:51.612 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.120817124, 2020-11-16T20:55:51.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072477380000000001, 2020-11-16T20:55:51.612 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:55:51.612 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:51.613 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:55:51.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:55:51.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.346480+0000", 2020-11-16T20:55:51.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:55:51.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:55:51.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.346480+0000", 2020-11-16T20:55:51.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6482e-05 2020-11-16T20:55:51.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:55:51.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.346526+0000", 2020-11-16T20:55:51.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2430000000000005e-06 2020-11-16T20:55:51.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:55:51.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.346535+0000", 2020-11-16T20:55:51.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4059999999999999e-05 2020-11-16T20:55:51.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:55:51.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.346549+0000", 2020-11-16T20:55:51.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0939999999999996e-06 2020-11-16T20:55:51.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:55:51.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.346555+0000", 2020-11-16T20:55:51.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0701999999999998e-05 2020-11-16T20:55:51.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:55:51.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.346596+0000", 2020-11-16T20:55:51.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8263000000000001e-05 2020-11-16T20:55:51.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:55:51.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.346614+0000", 2020-11-16T20:55:51.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070693830000000003 2020-11-16T20:55:51.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:55:51.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.353683+0000", 2020-11-16T20:55:51.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4511000000000001e-05 2020-11-16T20:55:51.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:55:51.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.353728+0000", 2020-11-16T20:55:51.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072477380000000001 2020-11-16T20:55:51.619 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.619 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:55:51.620 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.620 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:146 4.3 e33/22 4:d79d68cf:::smithi16641208-37:head v 33'26, mlcod=33'23)", 2020-11-16T20:55:51.620 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.374979+0000", 2020-11-16T20:55:51.620 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.092317824000000007, 2020-11-16T20:55:51.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007612911, 2020-11-16T20:55:51.620 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:55:51.621 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:51.621 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:55:51.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:55:51.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.374979+0000", 2020-11-16T20:55:51.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:55:51.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:55:51.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.374979+0000", 2020-11-16T20:55:51.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00075155000000000003 2020-11-16T20:55:51.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:55:51.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.375731+0000", 2020-11-16T20:55:51.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1151999999999999e-05 2020-11-16T20:55:51.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:55:51.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.375742+0000", 2020-11-16T20:55:51.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.288e-05 2020-11-16T20:55:51.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:55:51.624 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.375755+0000", 2020-11-16T20:55:51.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9489999999999996e-06 2020-11-16T20:55:51.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:55:51.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.375763+0000", 2020-11-16T20:55:51.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026216500000000002 2020-11-16T20:55:51.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.625 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:55:51.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.376025+0000", 2020-11-16T20:55:51.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6557999999999999e-05 2020-11-16T20:55:51.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:55:51.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.376051+0000", 2020-11-16T20:55:51.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006482977 2020-11-16T20:55:51.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:55:51.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.382534+0000", 2020-11-16T20:55:51.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7679999999999997e-05 2020-11-16T20:55:51.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:55:51.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:55:51.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:55:51.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.382592+0000", 2020-11-16T20:55:51.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007612911 2020-11-16T20:55:51.627 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.628 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:55:51.628 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.628 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:55:51.628 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:55:51.628 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:55:51.635 INFO:tasks.rados.rados.0.smithi166.stdout:44: writing smithi16641208-44 from 1816608 to 2604609 tid 2 2020-11-16T20:55:51.635 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:51.635 INFO:tasks.rados.rados.0.smithi166.stdout:29: finishing write tid 1 to smithi16641208-29 2020-11-16T20:55:51.635 INFO:tasks.rados.rados.0.smithi166.stdout:29: finishing write tid 2 to smithi16641208-29 2020-11-16T20:55:51.635 INFO:tasks.rados.rados.0.smithi166.stdout:29: finishing write tid 3 to smithi16641208-29 2020-11-16T20:55:51.635 INFO:tasks.rados.rados.0.smithi166.stdout:29: finishing write tid 4 to smithi16641208-29 2020-11-16T20:55:51.636 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 29 v 18 (ObjNum 28 snap 0 seq_num 28) dirty exists 2020-11-16T20:55:51.636 INFO:tasks.rados.rados.0.smithi166.stdout:29: left oid 29 (ObjNum 28 snap 0 seq_num 28) 2020-11-16T20:55:51.636 INFO:tasks.rados.rados.0.smithi166.stdout:30: finishing write tid 1 to smithi16641208-30 2020-11-16T20:55:51.636 INFO:tasks.rados.rados.0.smithi166.stdout:30: finishing write tid 2 to smithi16641208-30 2020-11-16T20:55:51.636 INFO:tasks.rados.rados.0.smithi166.stdout:30: finishing write tid 3 to smithi16641208-30 2020-11-16T20:55:51.636 INFO:tasks.rados.rados.0.smithi166.stdout:30: finishing write tid 4 to smithi16641208-30 2020-11-16T20:55:51.636 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 30 v 21 (ObjNum 29 snap 0 seq_num 29) dirty exists 2020-11-16T20:55:51.637 INFO:tasks.rados.rados.0.smithi166.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2020-11-16T20:55:51.637 INFO:tasks.rados.rados.0.smithi166.stdout:31: finishing write tid 1 to smithi16641208-31 2020-11-16T20:55:51.637 INFO:tasks.rados.rados.0.smithi166.stdout:31: finishing write tid 2 to smithi16641208-31 2020-11-16T20:55:51.637 INFO:tasks.rados.rados.0.smithi166.stdout:31: finishing write tid 3 to smithi16641208-31 2020-11-16T20:55:51.637 INFO:tasks.rados.rados.0.smithi166.stdout:32: finishing write tid 1 to smithi16641208-32 2020-11-16T20:55:51.637 INFO:tasks.rados.rados.0.smithi166.stdout:31: finishing write tid 4 to smithi16641208-31 2020-11-16T20:55:51.637 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 31 v 24 (ObjNum 30 snap 0 seq_num 30) dirty exists 2020-11-16T20:55:51.637 INFO:tasks.rados.rados.0.smithi166.stdout:31: left oid 31 (ObjNum 30 snap 0 seq_num 30) 2020-11-16T20:55:51.638 INFO:tasks.rados.rados.0.smithi166.stdout:29: done (15 left) 2020-11-16T20:55:51.638 INFO:tasks.rados.rados.0.smithi166.stdout:30: done (14 left) 2020-11-16T20:55:51.638 INFO:tasks.rados.rados.0.smithi166.stdout:31: done (13 left) 2020-11-16T20:55:51.638 INFO:tasks.rados.rados.0.smithi166.stdout:45: write initial oid 45 2020-11-16T20:55:51.638 INFO:tasks.rados.rados.0.smithi166.stdout:45: seq_num 44 ranges {739508=692721,1875090=648012} 2020-11-16T20:55:51.638 INFO:tasks.rados.rados.0.smithi166.stdout:45: writing smithi16641208-45 from 739508 to 1432229 tid 1 2020-11-16T20:55:51.638 INFO:tasks.rados.rados.0.smithi166.stdout:45: writing smithi16641208-45 from 1875090 to 2523102 tid 2 2020-11-16T20:55:51.639 INFO:tasks.rados.rados.0.smithi166.stdout:46: write initial oid 46 2020-11-16T20:55:51.639 INFO:tasks.rados.rados.0.smithi166.stdout:46: seq_num 45 ranges {756315=767970,1933572=791670} 2020-11-16T20:55:51.639 INFO:tasks.rados.rados.0.smithi166.stdout:46: writing smithi16641208-46 from 756315 to 1524285 tid 1 2020-11-16T20:55:51.639 INFO:tasks.rados.rados.0.smithi166.stdout:46: writing smithi16641208-46 from 1933572 to 2725242 tid 2 2020-11-16T20:55:51.639 INFO:tasks.rados.rados.0.smithi166.stdout:47: write initial oid 47 2020-11-16T20:55:51.639 INFO:tasks.rados.rados.0.smithi166.stdout:47: seq_num 46 ranges {773122=559572,1992054=651681} 2020-11-16T20:55:51.640 INFO:tasks.rados.rados.0.smithi166.stdout:47: writing smithi16641208-47 from 773122 to 1332694 tid 1 2020-11-16T20:55:51.640 INFO:tasks.rados.rados.0.smithi166.stdout:47: writing smithi16641208-47 from 1992054 to 2643735 tid 2 2020-11-16T20:55:51.640 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:51.640 INFO:tasks.rados.rados.0.smithi166.stdout:32: finishing write tid 2 to smithi16641208-32 2020-11-16T20:55:51.640 INFO:tasks.rados.rados.0.smithi166.stdout:32: finishing write tid 3 to smithi16641208-32 2020-11-16T20:55:51.640 INFO:tasks.rados.rados.0.smithi166.stdout:33: finishing write tid 1 to smithi16641208-33 2020-11-16T20:55:51.640 INFO:tasks.rados.rados.0.smithi166.stdout:32: finishing write tid 4 to smithi16641208-32 2020-11-16T20:55:51.641 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 32 v 24 (ObjNum 31 snap 0 seq_num 31) dirty exists 2020-11-16T20:55:51.641 INFO:tasks.rados.rados.0.smithi166.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2020-11-16T20:55:51.641 INFO:tasks.rados.rados.0.smithi166.stdout:33: finishing write tid 2 to smithi16641208-33 2020-11-16T20:55:51.641 INFO:tasks.rados.rados.0.smithi166.stdout:33: finishing write tid 3 to smithi16641208-33 2020-11-16T20:55:51.641 INFO:tasks.rados.rados.0.smithi166.stdout:33: finishing write tid 4 to smithi16641208-33 2020-11-16T20:55:51.641 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 33 v 27 (ObjNum 32 snap 0 seq_num 32) dirty exists 2020-11-16T20:55:51.641 INFO:tasks.rados.rados.0.smithi166.stdout:33: left oid 33 (ObjNum 32 snap 0 seq_num 32) 2020-11-16T20:55:51.642 INFO:tasks.rados.rados.0.smithi166.stdout:34: finishing write tid 1 to smithi16641208-34 2020-11-16T20:55:51.642 INFO:tasks.rados.rados.0.smithi166.stdout:32: done (15 left) 2020-11-16T20:55:51.642 INFO:tasks.rados.rados.0.smithi166.stdout:33: done (14 left) 2020-11-16T20:55:51.642 INFO:tasks.rados.rados.0.smithi166.stdout:48: write initial oid 48 2020-11-16T20:55:51.642 INFO:tasks.rados.rados.0.smithi166.stdout:48: seq_num 47 ranges {789929=634821,2050536=739393} 2020-11-16T20:55:51.642 INFO:tasks.rados.rados.0.smithi166.stdout:48: writing smithi16641208-48 from 789929 to 1424750 tid 1 2020-11-16T20:55:51.642 INFO:tasks.rados.rados.0.smithi166.stdout:48: writing smithi16641208-48 from 2050536 to 2789929 tid 2 2020-11-16T20:55:51.643 INFO:tasks.rados.rados.0.smithi166.stdout:49: write initial oid 49 2020-11-16T20:55:51.643 INFO:tasks.rados.rados.0.smithi166.stdout:49: seq_num 48 ranges {406736=710070,1709018=655350} 2020-11-16T20:55:51.643 INFO:tasks.rados.rados.0.smithi166.stdout:49: writing smithi16641208-49 from 406736 to 1116806 tid 1 2020-11-16T20:55:51.643 INFO:tasks.rados.rados.0.smithi166.stdout:49: writing smithi16641208-49 from 1709018 to 2364368 tid 2 2020-11-16T20:55:51.643 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:51.643 INFO:tasks.rados.rados.0.smithi166.stdout:34: finishing write tid 2 to smithi16641208-34 2020-11-16T20:55:51.643 INFO:tasks.rados.rados.0.smithi166.stdout:34: finishing write tid 3 to smithi16641208-34 2020-11-16T20:55:51.644 INFO:tasks.rados.rados.0.smithi166.stdout:34: finishing write tid 4 to smithi16641208-34 2020-11-16T20:55:51.644 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 34 v 27 (ObjNum 33 snap 0 seq_num 33) dirty exists 2020-11-16T20:55:51.644 INFO:tasks.rados.rados.0.smithi166.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2020-11-16T20:55:51.644 INFO:tasks.rados.rados.0.smithi166.stdout:35: finishing write tid 1 to smithi16641208-35 2020-11-16T20:55:51.644 INFO:tasks.rados.rados.0.smithi166.stdout:35: finishing write tid 2 to smithi16641208-35 2020-11-16T20:55:51.644 INFO:tasks.rados.rados.0.smithi166.stdout:35: finishing write tid 3 to smithi16641208-35 2020-11-16T20:55:51.644 INFO:tasks.rados.rados.0.smithi166.stdout:36: finishing write tid 1 to smithi16641208-36 2020-11-16T20:55:51.645 INFO:tasks.rados.rados.0.smithi166.stdout:35: finishing write tid 4 to smithi16641208-35 2020-11-16T20:55:51.645 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 35 v 27 (ObjNum 34 snap 0 seq_num 34) dirty exists 2020-11-16T20:55:51.645 INFO:tasks.rados.rados.0.smithi166.stdout:35: left oid 35 (ObjNum 34 snap 0 seq_num 34) 2020-11-16T20:55:51.645 INFO:tasks.rados.rados.0.smithi166.stdout:36: finishing write tid 2 to smithi16641208-36 2020-11-16T20:55:51.645 INFO:tasks.rados.rados.0.smithi166.stdout:36: finishing write tid 3 to smithi16641208-36 2020-11-16T20:55:51.645 INFO:tasks.rados.rados.0.smithi166.stdout:36: finishing write tid 4 to smithi16641208-36 2020-11-16T20:55:51.645 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 36 v 12 (ObjNum 35 snap 0 seq_num 35) dirty exists 2020-11-16T20:55:51.646 INFO:tasks.rados.rados.0.smithi166.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2020-11-16T20:55:51.646 INFO:tasks.rados.rados.0.smithi166.stdout:37: finishing write tid 1 to smithi16641208-37 2020-11-16T20:55:51.646 INFO:tasks.rados.rados.0.smithi166.stdout:37: finishing write tid 2 to smithi16641208-37 2020-11-16T20:55:51.646 INFO:tasks.rados.rados.0.smithi166.stdout:37: finishing write tid 3 to smithi16641208-37 2020-11-16T20:55:51.646 INFO:tasks.rados.rados.0.smithi166.stdout:38: finishing write tid 1 to smithi16641208-38 2020-11-16T20:55:51.646 INFO:tasks.rados.rados.0.smithi166.stdout:37: finishing write tid 4 to smithi16641208-37 2020-11-16T20:55:51.646 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 37 v 27 (ObjNum 36 snap 0 seq_num 36) dirty exists 2020-11-16T20:55:51.646 INFO:tasks.rados.rados.0.smithi166.stdout:37: left oid 37 (ObjNum 36 snap 0 seq_num 36) 2020-11-16T20:55:51.647 INFO:tasks.rados.rados.0.smithi166.stdout:38: finishing write tid 2 to smithi16641208-38 2020-11-16T20:55:51.647 INFO:tasks.rados.rados.0.smithi166.stdout:38: finishing write tid 3 to smithi16641208-38 2020-11-16T20:55:51.647 INFO:tasks.rados.rados.0.smithi166.stdout:38: finishing write tid 4 to smithi16641208-38 2020-11-16T20:55:51.647 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 38 v 15 (ObjNum 37 snap 0 seq_num 37) dirty exists 2020-11-16T20:55:51.647 INFO:tasks.rados.rados.0.smithi166.stdout:38: left oid 38 (ObjNum 37 snap 0 seq_num 37) 2020-11-16T20:55:51.647 INFO:tasks.rados.rados.0.smithi166.stdout:39: finishing write tid 1 to smithi16641208-39 2020-11-16T20:55:51.647 INFO:tasks.rados.rados.0.smithi166.stdout:39: finishing write tid 2 to smithi16641208-39 2020-11-16T20:55:51.647 INFO:tasks.rados.rados.0.smithi166.stdout:39: finishing write tid 3 to smithi16641208-39 2020-11-16T20:55:51.648 INFO:tasks.rados.rados.0.smithi166.stdout:39: finishing write tid 4 to smithi16641208-39 2020-11-16T20:55:51.648 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 39 v 30 (ObjNum 38 snap 0 seq_num 38) dirty exists 2020-11-16T20:55:51.648 INFO:tasks.rados.rados.0.smithi166.stdout:39: left oid 39 (ObjNum 38 snap 0 seq_num 38) 2020-11-16T20:55:51.648 INFO:tasks.rados.rados.0.smithi166.stdout:40: finishing write tid 1 to smithi16641208-40 2020-11-16T20:55:51.648 INFO:tasks.rados.rados.0.smithi166.stdout:40: finishing write tid 2 to smithi16641208-40 2020-11-16T20:55:51.648 INFO:tasks.rados.rados.0.smithi166.stdout:40: finishing write tid 3 to smithi16641208-40 2020-11-16T20:55:51.648 INFO:tasks.rados.rados.0.smithi166.stdout:40: finishing write tid 4 to smithi16641208-40 2020-11-16T20:55:51.649 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 40 v 12 (ObjNum 39 snap 0 seq_num 39) dirty exists 2020-11-16T20:55:51.649 INFO:tasks.rados.rados.0.smithi166.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2020-11-16T20:55:51.649 INFO:tasks.rados.rados.0.smithi166.stdout:41: finishing write tid 1 to smithi16641208-41 2020-11-16T20:55:51.649 INFO:tasks.rados.rados.0.smithi166.stdout:41: finishing write tid 2 to smithi16641208-41 2020-11-16T20:55:51.649 INFO:tasks.rados.rados.0.smithi166.stdout:41: finishing write tid 3 to smithi16641208-41 2020-11-16T20:55:51.649 INFO:tasks.rados.rados.0.smithi166.stdout:41: finishing write tid 4 to smithi16641208-41 2020-11-16T20:55:51.649 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 41 v 15 (ObjNum 40 snap 0 seq_num 40) dirty exists 2020-11-16T20:55:51.649 INFO:tasks.rados.rados.0.smithi166.stdout:41: left oid 41 (ObjNum 40 snap 0 seq_num 40) 2020-11-16T20:55:51.650 INFO:tasks.rados.rados.0.smithi166.stdout:42: finishing write tid 1 to smithi16641208-42 2020-11-16T20:55:51.650 INFO:tasks.rados.rados.0.smithi166.stdout:42: finishing write tid 2 to smithi16641208-42 2020-11-16T20:55:51.650 INFO:tasks.rados.rados.0.smithi166.stdout:42: finishing write tid 3 to smithi16641208-42 2020-11-16T20:55:51.650 INFO:tasks.rados.rados.0.smithi166.stdout:34: done (15 left) 2020-11-16T20:55:51.650 INFO:tasks.rados.rados.0.smithi166.stdout:35: done (14 left) 2020-11-16T20:55:51.650 INFO:tasks.rados.rados.0.smithi166.stdout:36: done (13 left) 2020-11-16T20:55:51.650 INFO:tasks.rados.rados.0.smithi166.stdout:37: done (12 left) 2020-11-16T20:55:51.651 INFO:tasks.rados.rados.0.smithi166.stdout:38: done (11 left) 2020-11-16T20:55:51.651 INFO:tasks.rados.rados.0.smithi166.stdout:39: done (10 left) 2020-11-16T20:55:51.651 INFO:tasks.rados.rados.0.smithi166.stdout:40: done (9 left) 2020-11-16T20:55:51.651 INFO:tasks.rados.rados.0.smithi166.stdout:41: done (8 left) 2020-11-16T20:55:51.651 INFO:tasks.rados.rados.0.smithi166.stdout:50: write initial oid 50 2020-11-16T20:55:51.651 INFO:tasks.rados.rados.0.smithi166.stdout:50: seq_num 49 ranges {423543=785319,1767500=799008} 2020-11-16T20:55:51.651 INFO:tasks.rados.rados.0.smithi166.stdout:50: writing smithi16641208-50 from 423543 to 1208862 tid 1 2020-11-16T20:55:51.651 INFO:tasks.rados.rados.0.smithi166.stdout:50: writing smithi16641208-50 from 1767500 to 2566508 tid 2 2020-11-16T20:55:51.652 INFO:tasks.rados.rados.0.smithi166.stdout:51: write initial oid 51 2020-11-16T20:55:51.652 INFO:tasks.rados.rados.0.smithi166.stdout:51: seq_num 50 ranges {440350=460568,1309629=542666,2323973=516377} 2020-11-16T20:55:51.652 INFO:tasks.rados.rados.0.smithi166.stdout:51: writing smithi16641208-51 from 440350 to 900918 tid 1 2020-11-16T20:55:51.652 INFO:tasks.rados.rados.0.smithi166.stdout:51: writing smithi16641208-51 from 1309629 to 1852295 tid 2 2020-11-16T20:55:51.652 INFO:tasks.rados.rados.0.smithi166.stdout:51: writing smithi16641208-51 from 2323973 to 2840350 tid 3 2020-11-16T20:55:51.652 INFO:tasks.rados.rados.0.smithi166.stdout:52: write initial oid 52 2020-11-16T20:55:51.652 INFO:tasks.rados.rados.0.smithi166.stdout:52: seq_num 51 ranges {457157=535817,1768111=402677} 2020-11-16T20:55:51.653 INFO:tasks.rados.rados.0.smithi166.stdout:52: writing smithi16641208-52 from 457157 to 992974 tid 1 2020-11-16T20:55:51.653 INFO:tasks.rados.rados.0.smithi166.stdout:52: writing smithi16641208-52 from 1768111 to 2170788 tid 2 2020-11-16T20:55:51.653 INFO:tasks.rados.rados.0.smithi166.stdout:53: write initial oid 53 2020-11-16T20:55:51.653 INFO:tasks.rados.rados.0.smithi166.stdout:53: seq_num 52 ranges {473964=611066,1826593=546335,2778819=95145} 2020-11-16T20:55:51.653 INFO:tasks.rados.rados.0.smithi166.stdout:53: writing smithi16641208-53 from 473964 to 1085030 tid 1 2020-11-16T20:55:51.653 INFO:tasks.rados.rados.0.smithi166.stdout:53: writing smithi16641208-53 from 1826593 to 2372928 tid 2 2020-11-16T20:55:51.653 INFO:tasks.rados.rados.0.smithi166.stdout:53: writing smithi16641208-53 from 2778819 to 2873964 tid 3 2020-11-16T20:55:51.654 INFO:tasks.rados.rados.0.smithi166.stdout:54: write initial oid 54 2020-11-16T20:55:51.654 INFO:tasks.rados.rados.0.smithi166.stdout:42: finishing write tid 4 to smithi16641208-42 2020-11-16T20:55:51.654 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 42 v 18 (ObjNum 41 snap 0 seq_num 41) dirty exists 2020-11-16T20:55:51.654 INFO:tasks.rados.rados.0.smithi166.stdout:42: left oid 42 (ObjNum 41 snap 0 seq_num 41) 2020-11-16T20:55:51.654 INFO:tasks.rados.rados.0.smithi166.stdout:43: finishing write tid 1 to smithi16641208-43 2020-11-16T20:55:51.654 INFO:tasks.rados.rados.0.smithi166.stdout:43: finishing write tid 2 to smithi16641208-43 2020-11-16T20:55:51.654 INFO:tasks.rados.rados.0.smithi166.stdout:54: seq_num 53 ranges {490771=686315,1885075=406346} 2020-11-16T20:55:51.655 INFO:tasks.rados.rados.0.smithi166.stdout:54: writing smithi16641208-54 from 490771 to 1177086 tid 1 2020-11-16T20:55:51.655 INFO:tasks.rados.rados.0.smithi166.stdout:54: writing smithi16641208-54 from 1885075 to 2291421 tid 2 2020-11-16T20:55:51.655 INFO:tasks.rados.rados.0.smithi166.stdout:42: done (12 left) 2020-11-16T20:55:51.655 INFO:tasks.rados.rados.0.smithi166.stdout:55: write initial oid 55 2020-11-16T20:55:51.655 INFO:tasks.rados.rados.0.smithi166.stdout:55: seq_num 54 ranges {507578=477917,1543557=550004,2833665=73913} 2020-11-16T20:55:51.655 INFO:tasks.rados.rados.0.smithi166.stdout:55: writing smithi16641208-55 from 507578 to 985495 tid 1 2020-11-16T20:55:51.655 INFO:tasks.rados.rados.0.smithi166.stdout:55: writing smithi16641208-55 from 1543557 to 2093561 tid 2 2020-11-16T20:55:51.655 INFO:tasks.rados.rados.0.smithi166.stdout:55: writing smithi16641208-55 from 2833665 to 2907578 tid 3 2020-11-16T20:55:51.656 INFO:tasks.rados.rados.0.smithi166.stdout:56: write initial oid 56 2020-11-16T20:55:51.656 INFO:tasks.rados.rados.0.smithi166.stdout:56: seq_num 55 ranges {524385=553166,1602039=410015,2577441=346944} 2020-11-16T20:55:51.656 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:55:51.656 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:55:51.656 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:55:51.656 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:55:51.656 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:55:51.657 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:55:51.657 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:55:51.657 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:55:51.658 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:55:51.633+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:55:51.659 INFO:tasks.rados.rados.0.smithi166.stdout:56: writing smithi16641208-56 from 524385 to 1077551 tid 1 2020-11-16T20:55:51.659 INFO:tasks.rados.rados.0.smithi166.stdout:56: writing smithi16641208-56 from 1602039 to 2012054 tid 2 2020-11-16T20:55:51.659 INFO:tasks.rados.rados.0.smithi166.stdout:56: writing smithi16641208-56 from 2577441 to 2924385 tid 3 2020-11-16T20:55:51.659 INFO:tasks.rados.rados.0.smithi166.stdout:57: write initial oid 57 2020-11-16T20:55:51.659 INFO:tasks.rados.rados.0.smithi166.stdout:57: seq_num 56 ranges {541192=628415,1660521=553673,2888511=52681} 2020-11-16T20:55:51.659 INFO:tasks.rados.rados.0.smithi166.stdout:57: writing smithi16641208-57 from 541192 to 1169607 tid 1 2020-11-16T20:55:51.660 INFO:tasks.rados.rados.0.smithi166.stdout:57: writing smithi16641208-57 from 1660521 to 2214194 tid 2 2020-11-16T20:55:51.660 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:55:51.660 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:55:51.660 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:55:51.660 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:55:51.660 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:55:51.661 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:55:51.661 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:55:51.661 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:55:51.661 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:55:51.662 INFO:tasks.rados.rados.0.smithi166.stdout:57: writing smithi16641208-57 from 2888511 to 2941192 tid 3 2020-11-16T20:55:51.663 INFO:tasks.rados.rados.0.smithi166.stdout:58: write initial oid 58 2020-11-16T20:55:51.663 INFO:tasks.rados.rados.0.smithi166.stdout:58: seq_num 57 ranges {557999=703664,1719003=413684,2632287=325712} 2020-11-16T20:55:51.669 INFO:tasks.rados.rados.0.smithi166.stdout:58: writing smithi16641208-58 from 557999 to 1261663 tid 1 2020-11-16T20:55:51.674 INFO:tasks.rados.rados.0.smithi166.stdout:58: writing smithi16641208-58 from 1719003 to 2132687 tid 2 2020-11-16T20:55:51.679 INFO:tasks.rados.rados.0.smithi166.stdout:58: writing smithi16641208-58 from 2632287 to 2957999 tid 3 2020-11-16T20:55:51.679 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:51.679 INFO:tasks.rados.rados.0.smithi166.stdout:43: finishing write tid 3 to smithi16641208-43 2020-11-16T20:55:51.680 INFO:tasks.rados.rados.0.smithi166.stdout:43: finishing write tid 4 to smithi16641208-43 2020-11-16T20:55:51.680 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 43 v 13 (ObjNum 42 snap 0 seq_num 42) dirty exists 2020-11-16T20:55:51.680 INFO:tasks.rados.rados.0.smithi166.stdout:43: left oid 43 (ObjNum 42 snap 0 seq_num 42) 2020-11-16T20:55:51.680 INFO:tasks.rados.rados.0.smithi166.stdout:44: finishing write tid 1 to smithi16641208-44 2020-11-16T20:55:51.680 INFO:tasks.rados.rados.0.smithi166.stdout:43: done (15 left) 2020-11-16T20:55:51.680 INFO:tasks.rados.rados.0.smithi166.stdout:59: write initial oid 59 2020-11-16T20:55:51.680 INFO:tasks.rados.rados.0.smithi166.stdout:59: seq_num 58 ranges {574806=778913,2061132=557342} 2020-11-16T20:55:51.686 INFO:tasks.rados.rados.0.smithi166.stdout:59: writing smithi16641208-59 from 574806 to 1353719 tid 1 2020-11-16T20:55:51.694 INFO:tasks.rados.rados.0.smithi166.stdout:59: writing smithi16641208-59 from 2061132 to 2618474 tid 2 2020-11-16T20:55:51.694 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:51.694 INFO:tasks.rados.rados.0.smithi166.stdout:44: finishing write tid 2 to smithi16641208-44 2020-11-16T20:55:51.694 INFO:tasks.rados.rados.0.smithi166.stdout:44: finishing write tid 3 to smithi16641208-44 2020-11-16T20:55:51.694 INFO:tasks.rados.rados.0.smithi166.stdout:44: finishing write tid 4 to smithi16641208-44 2020-11-16T20:55:51.694 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 44 v 16 (ObjNum 43 snap 0 seq_num 43) dirty exists 2020-11-16T20:55:51.695 INFO:tasks.rados.rados.0.smithi166.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2020-11-16T20:55:51.695 INFO:tasks.rados.rados.0.smithi166.stdout:45: finishing write tid 1 to smithi16641208-45 2020-11-16T20:55:51.695 INFO:tasks.rados.rados.0.smithi166.stdout:44: done (15 left) 2020-11-16T20:55:51.695 INFO:tasks.rados.rados.0.smithi166.stdout:60: write initial oid 60 2020-11-16T20:55:51.695 INFO:tasks.rados.rados.0.smithi166.stdout:60: seq_num 59 ranges {591613=454162,1719614=417353,2570780=420833} 2020-11-16T20:55:51.699 INFO:tasks.rados.rados.0.smithi166.stdout:60: writing smithi16641208-60 from 591613 to 1045775 tid 1 2020-11-16T20:55:51.705 INFO:tasks.rados.rados.0.smithi166.stdout:60: writing smithi16641208-60 from 1719614 to 2136967 tid 2 2020-11-16T20:55:51.710 INFO:tasks.rados.rados.0.smithi166.stdout:60: writing smithi16641208-60 from 2570780 to 2991613 tid 3 2020-11-16T20:55:51.710 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:51.711 INFO:tasks.rados.rados.0.smithi166.stdout:45: finishing write tid 2 to smithi16641208-45 2020-11-16T20:55:51.711 INFO:tasks.rados.rados.0.smithi166.stdout:46: finishing write tid 1 to smithi16641208-46 2020-11-16T20:55:51.711 INFO:tasks.rados.rados.0.smithi166.stdout:45: finishing write tid 3 to smithi16641208-45 2020-11-16T20:55:51.711 INFO:tasks.rados.rados.0.smithi166.stdout:45: finishing write tid 4 to smithi16641208-45 2020-11-16T20:55:51.711 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 45 v 30 (ObjNum 44 snap 0 seq_num 44) dirty exists 2020-11-16T20:55:51.711 INFO:tasks.rados.rados.0.smithi166.stdout:45: left oid 45 (ObjNum 44 snap 0 seq_num 44) 2020-11-16T20:55:51.711 INFO:tasks.rados.rados.0.smithi166.stdout:46: finishing write tid 2 to smithi16641208-46 2020-11-16T20:55:51.712 INFO:tasks.rados.rados.0.smithi166.stdout:45: done (15 left) 2020-11-16T20:55:51.712 INFO:tasks.rados.rados.0.smithi166.stdout:61: write initial oid 61 2020-11-16T20:55:51.712 INFO:tasks.rados.rados.0.smithi166.stdout:61: seq_num 60 ranges {608420=529411,1778096=561011,2881850=126570} 2020-11-16T20:55:51.716 INFO:tasks.rados.rados.0.smithi166.stdout:61: writing smithi16641208-61 from 608420 to 1137831 tid 1 2020-11-16T20:55:51.723 INFO:tasks.rados.rados.0.smithi166.stdout:61: writing smithi16641208-61 from 1778096 to 2339107 tid 2 2020-11-16T20:55:51.727 INFO:tasks.rados.rados.0.smithi166.stdout:61: writing smithi16641208-61 from 2881850 to 3008420 tid 3 2020-11-16T20:55:51.727 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:51.727 INFO:tasks.rados.rados.0.smithi166.stdout:47: finishing write tid 1 to smithi16641208-47 2020-11-16T20:55:51.728 INFO:tasks.rados.rados.0.smithi166.stdout:46: finishing write tid 3 to smithi16641208-46 2020-11-16T20:55:51.728 INFO:tasks.rados.rados.0.smithi166.stdout:46: finishing write tid 4 to smithi16641208-46 2020-11-16T20:55:51.728 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 46 v 29 (ObjNum 45 snap 0 seq_num 45) dirty exists 2020-11-16T20:55:51.728 INFO:tasks.rados.rados.0.smithi166.stdout:46: left oid 46 (ObjNum 45 snap 0 seq_num 45) 2020-11-16T20:55:51.728 INFO:tasks.rados.rados.0.smithi166.stdout:47: finishing write tid 2 to smithi16641208-47 2020-11-16T20:55:51.728 INFO:tasks.rados.rados.0.smithi166.stdout:47: finishing write tid 3 to smithi16641208-47 2020-11-16T20:55:51.728 INFO:tasks.rados.rados.0.smithi166.stdout:47: finishing write tid 4 to smithi16641208-47 2020-11-16T20:55:51.729 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 47 v 32 (ObjNum 46 snap 0 seq_num 46) dirty exists 2020-11-16T20:55:51.729 INFO:tasks.rados.rados.0.smithi166.stdout:47: left oid 47 (ObjNum 46 snap 0 seq_num 46) 2020-11-16T20:55:51.729 INFO:tasks.rados.rados.0.smithi166.stdout:48: finishing write tid 1 to smithi16641208-48 2020-11-16T20:55:51.729 INFO:tasks.rados.rados.0.smithi166.stdout:49: finishing write tid 1 to smithi16641208-49 2020-11-16T20:55:51.729 INFO:tasks.rados.rados.0.smithi166.stdout:48: finishing write tid 2 to smithi16641208-48 2020-11-16T20:55:51.729 INFO:tasks.rados.rados.0.smithi166.stdout:48: finishing write tid 3 to smithi16641208-48 2020-11-16T20:55:51.729 INFO:tasks.rados.rados.0.smithi166.stdout:48: finishing write tid 4 to smithi16641208-48 2020-11-16T20:55:51.730 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 48 v 35 (ObjNum 47 snap 0 seq_num 47) dirty exists 2020-11-16T20:55:51.730 INFO:tasks.rados.rados.0.smithi166.stdout:48: left oid 48 (ObjNum 47 snap 0 seq_num 47) 2020-11-16T20:55:51.730 INFO:tasks.rados.rados.0.smithi166.stdout:46: done (15 left) 2020-11-16T20:55:51.730 INFO:tasks.rados.rados.0.smithi166.stdout:47: done (14 left) 2020-11-16T20:55:51.730 INFO:tasks.rados.rados.0.smithi166.stdout:48: done (13 left) 2020-11-16T20:55:51.730 INFO:tasks.rados.rados.0.smithi166.stdout:62: write initial oid 62 2020-11-16T20:55:51.730 INFO:tasks.rados.rados.0.smithi166.stdout:62: seq_num 61 ranges {625227=721013,1952931=704669} 2020-11-16T20:55:51.732 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:55:51.736+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:55:51.734 INFO:tasks.rados.rados.0.smithi166.stdout:62: writing smithi16641208-62 from 625227 to 1346240 tid 1 2020-11-16T20:55:51.742 INFO:tasks.rados.rados.0.smithi166.stdout:62: writing smithi16641208-62 from 1952931 to 2657600 tid 2 2020-11-16T20:55:51.743 INFO:tasks.rados.rados.0.smithi166.stdout:63: write initial oid 63 2020-11-16T20:55:51.743 INFO:tasks.rados.rados.0.smithi166.stdout:63: seq_num 62 ranges {642034=796262,1895060=564680} 2020-11-16T20:55:51.751 INFO:tasks.rados.rados.0.smithi166.stdout:63: writing smithi16641208-63 from 642034 to 1438296 tid 1 2020-11-16T20:55:51.756 INFO:tasks.rados.rados.0.smithi166.stdout:63: writing smithi16641208-63 from 1895060 to 2459740 tid 2 2020-11-16T20:55:51.757 INFO:tasks.rados.rados.0.smithi166.stdout:64: write initial oid 64 2020-11-16T20:55:51.757 INFO:tasks.rados.rados.0.smithi166.stdout:49: finishing write tid 2 to smithi16641208-49 2020-11-16T20:55:51.757 INFO:tasks.rados.rados.0.smithi166.stdout:64: seq_num 63 ranges {658841=471511,1553542=708338,2964119=94722} 2020-11-16T20:55:51.763 INFO:tasks.rados.rados.0.smithi166.stdout:64: writing smithi16641208-64 from 658841 to 1130352 tid 1 2020-11-16T20:55:51.769 INFO:tasks.rados.rados.0.smithi166.stdout:64: writing smithi16641208-64 from 1553542 to 2261880 tid 2 2020-11-16T20:55:51.774 INFO:tasks.rados.rados.0.smithi166.stdout:64: writing smithi16641208-64 from 2964119 to 3058841 tid 3 2020-11-16T20:55:51.774 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:51.774 INFO:tasks.rados.rados.0.smithi166.stdout:49: finishing write tid 3 to smithi16641208-49 2020-11-16T20:55:51.774 INFO:tasks.rados.rados.0.smithi166.stdout:49: finishing write tid 4 to smithi16641208-49 2020-11-16T20:55:51.775 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 49 v 18 (ObjNum 48 snap 0 seq_num 48) dirty exists 2020-11-16T20:55:51.775 INFO:tasks.rados.rados.0.smithi166.stdout:49: left oid 49 (ObjNum 48 snap 0 seq_num 48) 2020-11-16T20:55:51.775 INFO:tasks.rados.rados.0.smithi166.stdout:50: finishing write tid 1 to smithi16641208-50 2020-11-16T20:55:51.775 INFO:tasks.rados.rados.0.smithi166.stdout:49: done (15 left) 2020-11-16T20:55:51.775 INFO:tasks.rados.rados.0.smithi166.stdout:65: write initial oid 65 2020-11-16T20:55:51.775 INFO:tasks.rados.rados.0.smithi166.stdout:65: seq_num 64 ranges {675648=546760,2012024=568349} 2020-11-16T20:55:51.781 INFO:tasks.rados.rados.0.smithi166.stdout:65: writing smithi16641208-65 from 675648 to 1222408 tid 1 2020-11-16T20:55:51.790 INFO:tasks.rados.rados.0.smithi166.stdout:65: writing smithi16641208-65 from 2012024 to 2580373 tid 2 2020-11-16T20:55:51.790 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:51.790 INFO:tasks.rados.rados.0.smithi166.stdout:50: finishing write tid 2 to smithi16641208-50 2020-11-16T20:55:51.790 INFO:tasks.rados.rados.0.smithi166.stdout:50: finishing write tid 3 to smithi16641208-50 2020-11-16T20:55:51.790 INFO:tasks.rados.rados.0.smithi166.stdout:50: finishing write tid 4 to smithi16641208-50 2020-11-16T20:55:51.790 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 50 v 21 (ObjNum 49 snap 0 seq_num 49) dirty exists 2020-11-16T20:55:51.791 INFO:tasks.rados.rados.0.smithi166.stdout:50: left oid 50 (ObjNum 49 snap 0 seq_num 49) 2020-11-16T20:55:51.791 INFO:tasks.rados.rados.0.smithi166.stdout:51: finishing write tid 1 to smithi16641208-51 2020-11-16T20:55:51.791 INFO:tasks.rados.rados.0.smithi166.stdout:51: finishing write tid 2 to smithi16641208-51 2020-11-16T20:55:51.791 INFO:tasks.rados.rados.0.smithi166.stdout:51: finishing write tid 3 to smithi16641208-51 2020-11-16T20:55:51.791 INFO:tasks.rados.rados.0.smithi166.stdout:51: finishing write tid 4 to smithi16641208-51 2020-11-16T20:55:51.791 INFO:tasks.rados.rados.0.smithi166.stdout:51: finishing write tid 5 to smithi16641208-51 2020-11-16T20:55:51.791 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 51 v 20 (ObjNum 50 snap 0 seq_num 50) dirty exists 2020-11-16T20:55:51.792 INFO:tasks.rados.rados.0.smithi166.stdout:51: left oid 51 (ObjNum 50 snap 0 seq_num 50) 2020-11-16T20:55:51.792 INFO:tasks.rados.rados.0.smithi166.stdout:52: finishing write tid 1 to smithi16641208-52 2020-11-16T20:55:51.792 INFO:tasks.rados.rados.0.smithi166.stdout:52: finishing write tid 2 to smithi16641208-52 2020-11-16T20:55:51.792 INFO:tasks.rados.rados.0.smithi166.stdout:52: finishing write tid 3 to smithi16641208-52 2020-11-16T20:55:51.792 INFO:tasks.rados.rados.0.smithi166.stdout:52: finishing write tid 4 to smithi16641208-52 2020-11-16T20:55:51.792 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 52 v 25 (ObjNum 51 snap 0 seq_num 51) dirty exists 2020-11-16T20:55:51.792 INFO:tasks.rados.rados.0.smithi166.stdout:52: left oid 52 (ObjNum 51 snap 0 seq_num 51) 2020-11-16T20:55:51.792 INFO:tasks.rados.rados.0.smithi166.stdout:53: finishing write tid 1 to smithi16641208-53 2020-11-16T20:55:51.793 INFO:tasks.rados.rados.0.smithi166.stdout:53: finishing write tid 2 to smithi16641208-53 2020-11-16T20:55:51.793 INFO:tasks.rados.rados.0.smithi166.stdout:53: finishing write tid 3 to smithi16641208-53 2020-11-16T20:55:51.793 INFO:tasks.rados.rados.0.smithi166.stdout:53: finishing write tid 4 to smithi16641208-53 2020-11-16T20:55:51.793 INFO:tasks.rados.rados.0.smithi166.stdout:53: finishing write tid 5 to smithi16641208-53 2020-11-16T20:55:51.793 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 53 v 29 (ObjNum 52 snap 0 seq_num 52) dirty exists 2020-11-16T20:55:51.793 INFO:tasks.rados.rados.0.smithi166.stdout:53: left oid 53 (ObjNum 52 snap 0 seq_num 52) 2020-11-16T20:55:51.793 INFO:tasks.rados.rados.0.smithi166.stdout:54: finishing write tid 1 to smithi16641208-54 2020-11-16T20:55:51.794 INFO:tasks.rados.rados.0.smithi166.stdout:54: finishing write tid 2 to smithi16641208-54 2020-11-16T20:55:51.794 INFO:tasks.rados.rados.0.smithi166.stdout:54: finishing write tid 3 to smithi16641208-54 2020-11-16T20:55:51.794 INFO:tasks.rados.rados.0.smithi166.stdout:54: finishing write tid 4 to smithi16641208-54 2020-11-16T20:55:51.794 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 54 v 24 (ObjNum 53 snap 0 seq_num 53) dirty exists 2020-11-16T20:55:51.794 INFO:tasks.rados.rados.0.smithi166.stdout:54: left oid 54 (ObjNum 53 snap 0 seq_num 53) 2020-11-16T20:55:51.794 INFO:tasks.rados.rados.0.smithi166.stdout:55: finishing write tid 1 to smithi16641208-55 2020-11-16T20:55:51.794 INFO:tasks.rados.rados.0.smithi166.stdout:55: finishing write tid 2 to smithi16641208-55 2020-11-16T20:55:51.794 INFO:tasks.rados.rados.0.smithi166.stdout:50: done (15 left) 2020-11-16T20:55:51.795 INFO:tasks.rados.rados.0.smithi166.stdout:51: done (14 left) 2020-11-16T20:55:51.795 INFO:tasks.rados.rados.0.smithi166.stdout:52: done (13 left) 2020-11-16T20:55:51.795 INFO:tasks.rados.rados.0.smithi166.stdout:53: done (12 left) 2020-11-16T20:55:51.795 INFO:tasks.rados.rados.0.smithi166.stdout:54: done (11 left) 2020-11-16T20:55:51.795 INFO:tasks.rados.rados.0.smithi166.stdout:66: write initial oid 66 2020-11-16T20:55:51.795 INFO:tasks.rados.rados.0.smithi166.stdout:55: finishing write tid 3 to smithi16641208-55 2020-11-16T20:55:51.795 INFO:tasks.rados.rados.0.smithi166.stdout:55: finishing write tid 4 to smithi16641208-55 2020-11-16T20:55:51.796 INFO:tasks.rados.rados.0.smithi166.stdout:55: finishing write tid 5 to smithi16641208-55 2020-11-16T20:55:51.796 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 55 v 24 (ObjNum 54 snap 0 seq_num 54) dirty exists 2020-11-16T20:55:51.796 INFO:tasks.rados.rados.0.smithi166.stdout:55: left oid 55 (ObjNum 54 snap 0 seq_num 54) 2020-11-16T20:55:51.796 INFO:tasks.rados.rados.0.smithi166.stdout:56: finishing write tid 1 to smithi16641208-56 2020-11-16T20:55:51.796 INFO:tasks.rados.rados.0.smithi166.stdout:66: seq_num 65 ranges {692455=622009,2070506=712007} 2020-11-16T20:55:51.796 INFO:tasks.rados.rados.0.smithi166.stdout:66: writing smithi16641208-66 from 692455 to 1314464 tid 1 2020-11-16T20:55:51.804 INFO:tasks.rados.rados.0.smithi166.stdout:66: writing smithi16641208-66 from 2070506 to 2782513 tid 2 2020-11-16T20:55:51.805 INFO:tasks.rados.rados.0.smithi166.stdout:55: done (11 left) 2020-11-16T20:55:51.805 INFO:tasks.rados.rados.0.smithi166.stdout:67: write initial oid 67 2020-11-16T20:55:51.805 INFO:tasks.rados.rados.0.smithi166.stdout:67: seq_num 66 ranges {709262=697258,2012635=572018,3046388=62874} 2020-11-16T20:55:51.812 INFO:tasks.rados.rados.0.smithi166.stdout:67: writing smithi16641208-67 from 709262 to 1406520 tid 1 2020-11-16T20:55:51.819 INFO:tasks.rados.rados.0.smithi166.stdout:67: writing smithi16641208-67 from 2012635 to 2584653 tid 2 2020-11-16T20:55:51.822 INFO:tasks.rados.rados.0.smithi166.stdout:67: writing smithi16641208-67 from 3046388 to 3109262 tid 3 2020-11-16T20:55:51.822 INFO:tasks.rados.rados.0.smithi166.stdout:68: write initial oid 68 2020-11-16T20:55:51.822 INFO:tasks.rados.rados.0.smithi166.stdout:68: seq_num 67 ranges {726069=772507,2071117=715676} 2020-11-16T20:55:51.827 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:51.827 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:51.830 INFO:tasks.rados.rados.0.smithi166.stdout:68: writing smithi16641208-68 from 726069 to 1498576 tid 1 2020-11-16T20:55:51.833 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:55:51.837+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:55:51.837 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:55:51.838 INFO:tasks.rados.rados.0.smithi166.stdout:68: writing smithi16641208-68 from 2071117 to 2786793 tid 2 2020-11-16T20:55:51.838 INFO:tasks.rados.rados.0.smithi166.stdout:69: write initial oid 69 2020-11-16T20:55:51.839 INFO:tasks.rados.rados.0.smithi166.stdout:69: seq_num 68 ranges {742876=447756,1729599=575687,3101234=41642} 2020-11-16T20:55:51.844 INFO:tasks.rados.rados.0.smithi166.stdout:69: writing smithi16641208-69 from 742876 to 1190632 tid 1 2020-11-16T20:55:51.850 INFO:tasks.rados.rados.0.smithi166.stdout:69: writing smithi16641208-69 from 1729599 to 2305286 tid 2 2020-11-16T20:55:51.855 INFO:tasks.rados.rados.0.smithi166.stdout:69: writing smithi16641208-69 from 3101234 to 3142876 tid 3 2020-11-16T20:55:51.855 INFO:tasks.rados.rados.0.smithi166.stdout:70: write initial oid 70 2020-11-16T20:55:51.855 INFO:tasks.rados.rados.0.smithi166.stdout:70: seq_num 69 ranges {759683=639358,1904434=719345,3128657=31026} 2020-11-16T20:55:51.863 INFO:tasks.rados.rados.0.smithi166.stdout:70: writing smithi16641208-70 from 759683 to 1399041 tid 1 2020-11-16T20:55:51.870 INFO:tasks.rados.rados.0.smithi166.stdout:70: writing smithi16641208-70 from 1904434 to 2623779 tid 2 2020-11-16T20:55:51.873 INFO:tasks.rados.rados.0.smithi166.stdout:70: writing smithi16641208-70 from 3128657 to 3159683 tid 3 2020-11-16T20:55:51.873 INFO:tasks.rados.rados.0.smithi166.stdout:71: write initial oid 71 2020-11-16T20:55:51.873 INFO:tasks.rados.rados.0.smithi166.stdout:71: seq_num 70 ranges {776490=714607,2246563=579356} 2020-11-16T20:55:51.881 INFO:tasks.rados.rados.0.smithi166.stdout:71: writing smithi16641208-71 from 776490 to 1491097 tid 1 2020-11-16T20:55:51.889 INFO:tasks.rados.rados.0.smithi166.stdout:71: writing smithi16641208-71 from 2246563 to 2825919 tid 2 2020-11-16T20:55:51.889 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:51.889 INFO:tasks.rados.rados.0.smithi166.stdout:56: finishing write tid 2 to smithi16641208-56 2020-11-16T20:55:51.889 INFO:tasks.rados.rados.0.smithi166.stdout:56: finishing write tid 3 to smithi16641208-56 2020-11-16T20:55:51.889 INFO:tasks.rados.rados.0.smithi166.stdout:56: finishing write tid 4 to smithi16641208-56 2020-11-16T20:55:51.890 INFO:tasks.rados.rados.0.smithi166.stdout:56: finishing write tid 5 to smithi16641208-56 2020-11-16T20:55:51.890 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 56 v 33 (ObjNum 55 snap 0 seq_num 55) dirty exists 2020-11-16T20:55:51.890 INFO:tasks.rados.rados.0.smithi166.stdout:56: left oid 56 (ObjNum 55 snap 0 seq_num 55) 2020-11-16T20:55:51.890 INFO:tasks.rados.rados.0.smithi166.stdout:57: finishing write tid 1 to smithi16641208-57 2020-11-16T20:55:51.890 INFO:tasks.rados.rados.0.smithi166.stdout:57: finishing write tid 2 to smithi16641208-57 2020-11-16T20:55:51.890 INFO:tasks.rados.rados.0.smithi166.stdout:57: finishing write tid 3 to smithi16641208-57 2020-11-16T20:55:51.890 INFO:tasks.rados.rados.0.smithi166.stdout:57: finishing write tid 4 to smithi16641208-57 2020-11-16T20:55:51.891 INFO:tasks.rados.rados.0.smithi166.stdout:57: finishing write tid 5 to smithi16641208-57 2020-11-16T20:55:51.891 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 57 v 28 (ObjNum 56 snap 0 seq_num 56) dirty exists 2020-11-16T20:55:51.891 INFO:tasks.rados.rados.0.smithi166.stdout:57: left oid 57 (ObjNum 56 snap 0 seq_num 56) 2020-11-16T20:55:51.891 INFO:tasks.rados.rados.0.smithi166.stdout:58: finishing write tid 1 to smithi16641208-58 2020-11-16T20:55:51.891 INFO:tasks.rados.rados.0.smithi166.stdout:58: finishing write tid 2 to smithi16641208-58 2020-11-16T20:55:51.891 INFO:tasks.rados.rados.0.smithi166.stdout:56: done (15 left) 2020-11-16T20:55:51.891 INFO:tasks.rados.rados.0.smithi166.stdout:57: done (14 left) 2020-11-16T20:55:51.891 INFO:tasks.rados.rados.0.smithi166.stdout:72: write initial oid 72 2020-11-16T20:55:51.892 INFO:tasks.rados.rados.0.smithi166.stdout:72: seq_num 71 ranges {793297=789856,2305045=723014} 2020-11-16T20:55:51.898 INFO:tasks.rados.rados.0.smithi166.stdout:72: writing smithi16641208-72 from 793297 to 1583153 tid 1 2020-11-16T20:55:51.908 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2020-11-16T20:55:51.909 INFO:tasks.rados.rados.0.smithi166.stdout:72: writing smithi16641208-72 from 2305045 to 3028059 tid 2 2020-11-16T20:55:51.909 INFO:tasks.rados.rados.0.smithi166.stdout:73: write initial oid 73 2020-11-16T20:55:51.909 INFO:tasks.rados.rados.0.smithi166.stdout:73: seq_num 72 ranges {410104=465105,1563527=583025,2810926=399178} 2020-11-16T20:55:51.913 INFO:tasks.rados.rados.0.smithi166.stdout:73: writing smithi16641208-73 from 410104 to 875209 tid 1 2020-11-16T20:55:51.920 INFO:tasks.rados.rados.0.smithi166.stdout:73: writing smithi16641208-73 from 1563527 to 2146552 tid 2 2020-11-16T20:55:51.927 INFO:tasks.rados.rados.0.smithi166.stdout:73: writing smithi16641208-73 from 2810926 to 3210104 tid 3 2020-11-16T20:55:51.927 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:51.927 INFO:tasks.rados.rados.0.smithi166.stdout:58: finishing write tid 3 to smithi16641208-58 2020-11-16T20:55:51.927 INFO:tasks.rados.rados.0.smithi166.stdout:58: finishing write tid 4 to smithi16641208-58 2020-11-16T20:55:51.927 INFO:tasks.rados.rados.0.smithi166.stdout:58: finishing write tid 5 to smithi16641208-58 2020-11-16T20:55:51.927 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 58 v 14 (ObjNum 57 snap 0 seq_num 57) dirty exists 2020-11-16T20:55:51.928 INFO:tasks.rados.rados.0.smithi166.stdout:58: left oid 58 (ObjNum 57 snap 0 seq_num 57) 2020-11-16T20:55:51.928 INFO:tasks.rados.rados.0.smithi166.stdout:59: finishing write tid 1 to smithi16641208-59 2020-11-16T20:55:51.928 INFO:tasks.rados.rados.0.smithi166.stdout:59: finishing write tid 2 to smithi16641208-59 2020-11-16T20:55:51.928 INFO:tasks.rados.rados.0.smithi166.stdout:58: done (15 left) 2020-11-16T20:55:51.928 INFO:tasks.rados.rados.0.smithi166.stdout:74: write initial oid 74 2020-11-16T20:55:51.928 INFO:tasks.rados.rados.0.smithi166.stdout:74: seq_num 73 ranges {426911=540354,1622009=726683,3121996=104915} 2020-11-16T20:55:51.932 INFO:tasks.rados.rados.0.smithi166.stdout:74: writing smithi16641208-74 from 426911 to 967265 tid 1 2020-11-16T20:55:51.934 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:55:51.937+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:55:51.940 INFO:tasks.rados.rados.0.smithi166.stdout:74: writing smithi16641208-74 from 1622009 to 2348692 tid 2 2020-11-16T20:55:51.945 INFO:tasks.rados.rados.0.smithi166.stdout:74: writing smithi16641208-74 from 3121996 to 3226911 tid 3 2020-11-16T20:55:51.945 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:51.946 INFO:tasks.rados.rados.0.smithi166.stdout:59: finishing write tid 3 to smithi16641208-59 2020-11-16T20:55:51.946 INFO:tasks.rados.rados.0.smithi166.stdout:59: finishing write tid 4 to smithi16641208-59 2020-11-16T20:55:51.946 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 59 v 17 (ObjNum 58 snap 0 seq_num 58) dirty exists 2020-11-16T20:55:51.946 INFO:tasks.rados.rados.0.smithi166.stdout:59: left oid 59 (ObjNum 58 snap 0 seq_num 58) 2020-11-16T20:55:51.946 INFO:tasks.rados.rados.0.smithi166.stdout:60: finishing write tid 1 to smithi16641208-60 2020-11-16T20:55:51.946 INFO:tasks.rados.rados.0.smithi166.stdout:60: finishing write tid 2 to smithi16641208-60 2020-11-16T20:55:51.946 INFO:tasks.rados.rados.0.smithi166.stdout:60: finishing write tid 3 to smithi16641208-60 2020-11-16T20:55:51.947 INFO:tasks.rados.rados.0.smithi166.stdout:60: finishing write tid 4 to smithi16641208-60 2020-11-16T20:55:51.947 INFO:tasks.rados.rados.0.smithi166.stdout:60: finishing write tid 5 to smithi16641208-60 2020-11-16T20:55:51.947 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 60 v 37 (ObjNum 59 snap 0 seq_num 59) dirty exists 2020-11-16T20:55:51.947 INFO:tasks.rados.rados.0.smithi166.stdout:60: left oid 60 (ObjNum 59 snap 0 seq_num 59) 2020-11-16T20:55:51.947 INFO:tasks.rados.rados.0.smithi166.stdout:61: finishing write tid 1 to smithi16641208-61 2020-11-16T20:55:51.947 INFO:tasks.rados.rados.0.smithi166.stdout:61: finishing write tid 2 to smithi16641208-61 2020-11-16T20:55:51.947 INFO:tasks.rados.rados.0.smithi166.stdout:61: finishing write tid 3 to smithi16641208-61 2020-11-16T20:55:51.948 INFO:tasks.rados.rados.0.smithi166.stdout:59: done (15 left) 2020-11-16T20:55:51.948 INFO:tasks.rados.rados.0.smithi166.stdout:60: done (14 left) 2020-11-16T20:55:51.948 INFO:tasks.rados.rados.0.smithi166.stdout:75: write initial oid 75 2020-11-16T20:55:51.948 INFO:tasks.rados.rados.0.smithi166.stdout:75: seq_num 74 ranges {443718=615603,1564138=470341,2633066=610652} 2020-11-16T20:55:51.951 INFO:tasks.rados.rados.0.smithi166.stdout:75: writing smithi16641208-75 from 443718 to 1059321 tid 1 2020-11-16T20:55:51.956 INFO:tasks.rados.rados.0.smithi166.stdout:75: writing smithi16641208-75 from 1564138 to 2034479 tid 2 2020-11-16T20:55:51.963 INFO:tasks.rados.rados.0.smithi166.stdout:75: writing smithi16641208-75 from 2633066 to 3243718 tid 3 2020-11-16T20:55:51.963 INFO:tasks.rados.rados.0.smithi166.stdout:76: write initial oid 76 2020-11-16T20:55:51.963 INFO:tasks.rados.rados.0.smithi166.stdout:76: seq_num 75 ranges {460525=690852,1622620=730352,3060489=200036} 2020-11-16T20:55:51.970 INFO:tasks.rados.rados.0.smithi166.stdout:76: writing smithi16641208-76 from 460525 to 1151377 tid 1 2020-11-16T20:55:51.977 INFO:tasks.rados.rados.0.smithi166.stdout:76: writing smithi16641208-76 from 1622620 to 2352972 tid 2 2020-11-16T20:55:51.982 INFO:tasks.rados.rados.0.smithi166.stdout:76: writing smithi16641208-76 from 3060489 to 3260525 tid 3 2020-11-16T20:55:51.983 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:51.983 INFO:tasks.rados.rados.0.smithi166.stdout:61: finishing write tid 4 to smithi16641208-61 2020-11-16T20:55:51.983 INFO:tasks.rados.rados.0.smithi166.stdout:62: finishing write tid 1 to smithi16641208-62 2020-11-16T20:55:51.983 INFO:tasks.rados.rados.0.smithi166.stdout:61: finishing write tid 5 to smithi16641208-61 2020-11-16T20:55:51.983 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 61 v 33 (ObjNum 60 snap 0 seq_num 60) dirty exists 2020-11-16T20:55:51.983 INFO:tasks.rados.rados.0.smithi166.stdout:61: left oid 61 (ObjNum 60 snap 0 seq_num 60) 2020-11-16T20:55:51.984 INFO:tasks.rados.rados.0.smithi166.stdout:62: finishing write tid 2 to smithi16641208-62 2020-11-16T20:55:51.984 INFO:tasks.rados.rados.0.smithi166.stdout:62: finishing write tid 3 to smithi16641208-62 2020-11-16T20:55:51.984 INFO:tasks.rados.rados.0.smithi166.stdout:62: finishing write tid 4 to smithi16641208-62 2020-11-16T20:55:51.984 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 62 v 36 (ObjNum 61 snap 0 seq_num 61) dirty exists 2020-11-16T20:55:51.984 INFO:tasks.rados.rados.0.smithi166.stdout:62: left oid 62 (ObjNum 61 snap 0 seq_num 61) 2020-11-16T20:55:51.984 INFO:tasks.rados.rados.0.smithi166.stdout:63: finishing write tid 1 to smithi16641208-63 2020-11-16T20:55:51.984 INFO:tasks.rados.rados.0.smithi166.stdout:63: finishing write tid 2 to smithi16641208-63 2020-11-16T20:55:51.985 INFO:tasks.rados.rados.0.smithi166.stdout:63: finishing write tid 3 to smithi16641208-63 2020-11-16T20:55:51.985 INFO:tasks.rados.rados.0.smithi166.stdout:63: finishing write tid 4 to smithi16641208-63 2020-11-16T20:55:51.985 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 63 v 20 (ObjNum 62 snap 0 seq_num 62) dirty exists 2020-11-16T20:55:51.985 INFO:tasks.rados.rados.0.smithi166.stdout:63: left oid 63 (ObjNum 62 snap 0 seq_num 62) 2020-11-16T20:55:51.985 INFO:tasks.rados.rados.0.smithi166.stdout:64: finishing write tid 1 to smithi16641208-64 2020-11-16T20:55:51.985 INFO:tasks.rados.rados.0.smithi166.stdout:64: finishing write tid 2 to smithi16641208-64 2020-11-16T20:55:51.985 INFO:tasks.rados.rados.0.smithi166.stdout:64: finishing write tid 3 to smithi16641208-64 2020-11-16T20:55:51.985 INFO:tasks.rados.rados.0.smithi166.stdout:64: finishing write tid 4 to smithi16641208-64 2020-11-16T20:55:51.986 INFO:tasks.rados.rados.0.smithi166.stdout:61: done (15 left) 2020-11-16T20:55:51.986 INFO:tasks.rados.rados.0.smithi166.stdout:62: done (14 left) 2020-11-16T20:55:51.986 INFO:tasks.rados.rados.0.smithi166.stdout:63: done (13 left) 2020-11-16T20:55:51.986 INFO:tasks.rados.rados.0.smithi166.stdout:77: write initial oid 77 2020-11-16T20:55:51.986 INFO:tasks.rados.rados.0.smithi166.stdout:77: seq_num 76 ranges {477332=766101,1681102=474010,2687912=589420} 2020-11-16T20:55:51.989 INFO:tasks.rados.rados.0.smithi166.stdout:77: writing smithi16641208-77 from 477332 to 1243433 tid 1 2020-11-16T20:55:51.994 INFO:tasks.rados.rados.0.smithi166.stdout:77: writing smithi16641208-77 from 1681102 to 2155112 tid 2 2020-11-16T20:55:52.000 INFO:tasks.rados.rados.0.smithi166.stdout:77: writing smithi16641208-77 from 2687912 to 3277332 tid 3 2020-11-16T20:55:52.001 INFO:tasks.rados.rados.0.smithi166.stdout:78: write initial oid 78 2020-11-16T20:55:52.001 INFO:tasks.rados.rados.0.smithi166.stdout:78: seq_num 77 ranges {494139=557703,1455937=734021,2948041=346098} 2020-11-16T20:55:52.006 INFO:tasks.rados.rados.0.smithi166.stdout:78: writing smithi16641208-78 from 494139 to 1051842 tid 1 2020-11-16T20:55:52.013 INFO:tasks.rados.rados.0.smithi166.stdout:78: writing smithi16641208-78 from 1455937 to 2189958 tid 2 2020-11-16T20:55:52.019 INFO:tasks.rados.rados.0.smithi166.stdout:78: writing smithi16641208-78 from 2948041 to 3294139 tid 3 2020-11-16T20:55:52.020 INFO:tasks.rados.rados.0.smithi166.stdout:79: write initial oid 79 2020-11-16T20:55:52.020 INFO:tasks.rados.rados.0.smithi166.stdout:64: finishing write tid 5 to smithi16641208-64 2020-11-16T20:55:52.020 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 64 v 32 (ObjNum 63 snap 0 seq_num 63) dirty exists 2020-11-16T20:55:52.020 INFO:tasks.rados.rados.0.smithi166.stdout:64: left oid 64 (ObjNum 63 snap 0 seq_num 63) 2020-11-16T20:55:52.020 INFO:tasks.rados.rados.0.smithi166.stdout:79: seq_num 78 ranges {510946=632952,1798066=477679,2742758=457217} 2020-11-16T20:55:52.026 INFO:tasks.rados.rados.0.smithi166.stdout:79: writing smithi16641208-79 from 510946 to 1143898 tid 1 2020-11-16T20:55:52.035 INFO:tasks.rados.rados.0.smithi166.stdout:79: writing smithi16641208-79 from 1798066 to 2275745 tid 2 2020-11-16T20:55:52.037 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:52.037 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:52.037 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:55:52.040+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:55:52.038 INFO:tasks.rados.rados.0.smithi166.stdout:79: writing smithi16641208-79 from 2742758 to 3199975 tid 3 2020-11-16T20:55:52.038 INFO:tasks.rados.rados.0.smithi166.stdout:64: done (15 left) 2020-11-16T20:55:52.038 INFO:tasks.rados.rados.0.smithi166.stdout:80: write initial oid 80 2020-11-16T20:55:52.038 INFO:tasks.rados.rados.0.smithi166.stdout:80: seq_num 79 ranges {527753=708201,1856548=737690,3286534=41219} 2020-11-16T20:55:52.045 INFO:tasks.rados.rados.0.smithi166.stdout:80: writing smithi16641208-80 from 527753 to 1235954 tid 1 2020-11-16T20:55:52.047 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:55:52.053 INFO:tasks.rados.rados.0.smithi166.stdout:80: writing smithi16641208-80 from 1856548 to 2594238 tid 2 2020-11-16T20:55:52.058 INFO:tasks.rados.rados.0.smithi166.stdout:80: writing smithi16641208-80 from 3286534 to 3327753 tid 3 2020-11-16T20:55:52.058 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.058 INFO:tasks.rados.rados.0.smithi166.stdout:65: finishing write tid 1 to smithi16641208-65 2020-11-16T20:55:52.058 INFO:tasks.rados.rados.0.smithi166.stdout:65: finishing write tid 2 to smithi16641208-65 2020-11-16T20:55:52.058 INFO:tasks.rados.rados.0.smithi166.stdout:65: finishing write tid 3 to smithi16641208-65 2020-11-16T20:55:52.059 INFO:tasks.rados.rados.0.smithi166.stdout:65: finishing write tid 4 to smithi16641208-65 2020-11-16T20:55:52.059 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 65 v 33 (ObjNum 64 snap 0 seq_num 64) dirty exists 2020-11-16T20:55:52.059 INFO:tasks.rados.rados.0.smithi166.stdout:65: left oid 65 (ObjNum 64 snap 0 seq_num 64) 2020-11-16T20:55:52.059 INFO:tasks.rados.rados.0.smithi166.stdout:66: finishing write tid 1 to smithi16641208-66 2020-11-16T20:55:52.059 INFO:tasks.rados.rados.0.smithi166.stdout:66: finishing write tid 2 to smithi16641208-66 2020-11-16T20:55:52.059 INFO:tasks.rados.rados.0.smithi166.stdout:66: finishing write tid 3 to smithi16641208-66 2020-11-16T20:55:52.059 INFO:tasks.rados.rados.0.smithi166.stdout:66: finishing write tid 4 to smithi16641208-66 2020-11-16T20:55:52.060 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 66 v 39 (ObjNum 65 snap 0 seq_num 65) dirty exists 2020-11-16T20:55:52.060 INFO:tasks.rados.rados.0.smithi166.stdout:66: left oid 66 (ObjNum 65 snap 0 seq_num 65) 2020-11-16T20:55:52.060 INFO:tasks.rados.rados.0.smithi166.stdout:67: finishing write tid 1 to smithi16641208-67 2020-11-16T20:55:52.060 INFO:tasks.rados.rados.0.smithi166.stdout:67: finishing write tid 2 to smithi16641208-67 2020-11-16T20:55:52.060 INFO:tasks.rados.rados.0.smithi166.stdout:67: finishing write tid 3 to smithi16641208-67 2020-11-16T20:55:52.060 INFO:tasks.rados.rados.0.smithi166.stdout:67: finishing write tid 4 to smithi16641208-67 2020-11-16T20:55:52.060 INFO:tasks.rados.rados.0.smithi166.stdout:67: finishing write tid 5 to smithi16641208-67 2020-11-16T20:55:52.061 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 67 v 41 (ObjNum 66 snap 0 seq_num 66) dirty exists 2020-11-16T20:55:52.061 INFO:tasks.rados.rados.0.smithi166.stdout:67: left oid 67 (ObjNum 66 snap 0 seq_num 66) 2020-11-16T20:55:52.061 INFO:tasks.rados.rados.0.smithi166.stdout:68: finishing write tid 1 to smithi16641208-68 2020-11-16T20:55:52.061 INFO:tasks.rados.rados.0.smithi166.stdout:68: finishing write tid 2 to smithi16641208-68 2020-11-16T20:55:52.061 INFO:tasks.rados.rados.0.smithi166.stdout:68: finishing write tid 3 to smithi16641208-68 2020-11-16T20:55:52.061 INFO:tasks.rados.rados.0.smithi166.stdout:65: done (15 left) 2020-11-16T20:55:52.061 INFO:tasks.rados.rados.0.smithi166.stdout:66: done (14 left) 2020-11-16T20:55:52.062 INFO:tasks.rados.rados.0.smithi166.stdout:67: done (13 left) 2020-11-16T20:55:52.062 INFO:tasks.rados.rados.0.smithi166.stdout:81: write initial oid 81 2020-11-16T20:55:52.062 INFO:tasks.rados.rados.0.smithi166.stdout:81: seq_num 80 ranges {544560=783450,1915030=481348,2797604=479761} 2020-11-16T20:55:52.065 INFO:tasks.rados.rados.0.smithi166.stdout:81: writing smithi16641208-81 from 544560 to 1328010 tid 1 2020-11-16T20:55:52.071 INFO:tasks.rados.rados.0.smithi166.stdout:81: writing smithi16641208-81 from 1915030 to 2396378 tid 2 2020-11-16T20:55:52.077 INFO:tasks.rados.rados.0.smithi166.stdout:81: writing smithi16641208-81 from 2797604 to 3277365 tid 3 2020-11-16T20:55:52.077 INFO:tasks.rados.rados.0.smithi166.stdout:82: write initial oid 82 2020-11-16T20:55:52.078 INFO:tasks.rados.rados.0.smithi166.stdout:82: seq_num 81 ranges {561367=458699,1573512=741359,2941380=419987} 2020-11-16T20:55:52.083 INFO:tasks.rados.rados.0.smithi166.stdout:82: writing smithi16641208-82 from 561367 to 1020066 tid 1 2020-11-16T20:55:52.090 INFO:tasks.rados.rados.0.smithi166.stdout:82: writing smithi16641208-82 from 1573512 to 2314871 tid 2 2020-11-16T20:55:52.097 INFO:tasks.rados.rados.0.smithi166.stdout:82: writing smithi16641208-82 from 2941380 to 3361367 tid 3 2020-11-16T20:55:52.097 INFO:tasks.rados.rados.0.smithi166.stdout:83: write initial oid 83 2020-11-16T20:55:52.097 INFO:tasks.rados.rados.0.smithi166.stdout:83: seq_num 82 ranges {578174=533948,1515641=485017,2736097=502305} 2020-11-16T20:55:52.103 INFO:tasks.rados.rados.0.smithi166.stdout:83: writing smithi16641208-83 from 578174 to 1112122 tid 1 2020-11-16T20:55:52.108 INFO:tasks.rados.rados.0.smithi166.stdout:83: writing smithi16641208-83 from 1515641 to 2000658 tid 2 2020-11-16T20:55:52.115 INFO:tasks.rados.rados.0.smithi166.stdout:83: writing smithi16641208-83 from 2736097 to 3238402 tid 3 2020-11-16T20:55:52.115 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.115 INFO:tasks.rados.rados.0.smithi166.stdout:68: finishing write tid 4 to smithi16641208-68 2020-11-16T20:55:52.116 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 68 v 44 (ObjNum 67 snap 0 seq_num 67) dirty exists 2020-11-16T20:55:52.116 INFO:tasks.rados.rados.0.smithi166.stdout:68: left oid 68 (ObjNum 67 snap 0 seq_num 67) 2020-11-16T20:55:52.116 INFO:tasks.rados.rados.0.smithi166.stdout:68: done (15 left) 2020-11-16T20:55:52.116 INFO:tasks.rados.rados.0.smithi166.stdout:84: write initial oid 84 2020-11-16T20:55:52.116 INFO:tasks.rados.rados.0.smithi166.stdout:84: seq_num 83 ranges {594981=609197,1974123=745028,3279873=115108} 2020-11-16T20:55:52.122 INFO:tasks.rados.rados.0.smithi166.stdout:84: writing smithi16641208-84 from 594981 to 1204178 tid 1 2020-11-16T20:55:52.130 INFO:tasks.rados.rados.0.smithi166.stdout:84: writing smithi16641208-84 from 1974123 to 2719151 tid 2 2020-11-16T20:55:52.135 INFO:tasks.rados.rados.0.smithi166.stdout:84: writing smithi16641208-84 from 3279873 to 3394981 tid 3 2020-11-16T20:55:52.135 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.135 INFO:tasks.rados.rados.0.smithi166.stdout:69: finishing write tid 1 to smithi16641208-69 2020-11-16T20:55:52.135 INFO:tasks.rados.rados.0.smithi166.stdout:69: finishing write tid 2 to smithi16641208-69 2020-11-16T20:55:52.135 INFO:tasks.rados.rados.0.smithi166.stdout:69: finishing write tid 3 to smithi16641208-69 2020-11-16T20:55:52.136 INFO:tasks.rados.rados.0.smithi166.stdout:69: finishing write tid 4 to smithi16641208-69 2020-11-16T20:55:52.136 INFO:tasks.rados.rados.0.smithi166.stdout:69: finishing write tid 5 to smithi16641208-69 2020-11-16T20:55:52.136 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 69 v 32 (ObjNum 68 snap 0 seq_num 68) dirty exists 2020-11-16T20:55:52.136 INFO:tasks.rados.rados.0.smithi166.stdout:69: left oid 69 (ObjNum 68 snap 0 seq_num 68) 2020-11-16T20:55:52.136 INFO:tasks.rados.rados.0.smithi166.stdout:70: finishing write tid 1 to smithi16641208-70 2020-11-16T20:55:52.136 INFO:tasks.rados.rados.0.smithi166.stdout:69: done (15 left) 2020-11-16T20:55:52.136 INFO:tasks.rados.rados.0.smithi166.stdout:85: write initial oid 85 2020-11-16T20:55:52.137 INFO:tasks.rados.rados.0.smithi166.stdout:85: seq_num 84 ranges {611788=400799,1748958=488686,2907296=504492} 2020-11-16T20:55:52.139 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:55:52.142+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:55:52.140 INFO:tasks.rados.rados.0.smithi166.stdout:85: writing smithi16641208-85 from 611788 to 1012587 tid 1 2020-11-16T20:55:52.148 INFO:tasks.rados.rados.0.smithi166.stdout:85: writing smithi16641208-85 from 1748958 to 2237644 tid 2 2020-11-16T20:55:52.154 INFO:tasks.rados.rados.0.smithi166.stdout:85: writing smithi16641208-85 from 2907296 to 3411788 tid 3 2020-11-16T20:55:52.155 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.155 INFO:tasks.rados.rados.0.smithi166.stdout:70: finishing write tid 2 to smithi16641208-70 2020-11-16T20:55:52.155 INFO:tasks.rados.rados.0.smithi166.stdout:70: finishing write tid 3 to smithi16641208-70 2020-11-16T20:55:52.155 INFO:tasks.rados.rados.0.smithi166.stdout:70: finishing write tid 4 to smithi16641208-70 2020-11-16T20:55:52.155 INFO:tasks.rados.rados.0.smithi166.stdout:70: finishing write tid 5 to smithi16641208-70 2020-11-16T20:55:52.155 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 70 v 48 (ObjNum 69 snap 0 seq_num 69) dirty exists 2020-11-16T20:55:52.156 INFO:tasks.rados.rados.0.smithi166.stdout:70: left oid 70 (ObjNum 69 snap 0 seq_num 69) 2020-11-16T20:55:52.156 INFO:tasks.rados.rados.0.smithi166.stdout:70: done (15 left) 2020-11-16T20:55:52.156 INFO:tasks.rados.rados.0.smithi166.stdout:86: write initial oid 86 2020-11-16T20:55:52.156 INFO:tasks.rados.rados.0.smithi166.stdout:86: seq_num 85 ranges {628595=476048,1807440=632344,2934719=452474} 2020-11-16T20:55:52.160 INFO:tasks.rados.rados.0.smithi166.stdout:86: writing smithi16641208-86 from 628595 to 1104643 tid 1 2020-11-16T20:55:52.168 INFO:tasks.rados.rados.0.smithi166.stdout:86: writing smithi16641208-86 from 1807440 to 2439784 tid 2 2020-11-16T20:55:52.173 INFO:tasks.rados.rados.0.smithi166.stdout:86: writing smithi16641208-86 from 2934719 to 3387193 tid 3 2020-11-16T20:55:52.174 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.174 INFO:tasks.rados.rados.0.smithi166.stdout:71: finishing write tid 1 to smithi16641208-71 2020-11-16T20:55:52.174 INFO:tasks.rados.rados.0.smithi166.stdout:71: finishing write tid 2 to smithi16641208-71 2020-11-16T20:55:52.174 INFO:tasks.rados.rados.0.smithi166.stdout:71: finishing write tid 3 to smithi16641208-71 2020-11-16T20:55:52.174 INFO:tasks.rados.rados.0.smithi166.stdout:71: finishing write tid 4 to smithi16641208-71 2020-11-16T20:55:52.175 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 71 v 35 (ObjNum 70 snap 0 seq_num 70) dirty exists 2020-11-16T20:55:52.175 INFO:tasks.rados.rados.0.smithi166.stdout:71: left oid 71 (ObjNum 70 snap 0 seq_num 70) 2020-11-16T20:55:52.175 INFO:tasks.rados.rados.0.smithi166.stdout:73: finishing write tid 1 to smithi16641208-73 2020-11-16T20:55:52.175 INFO:tasks.rados.rados.0.smithi166.stdout:72: finishing write tid 1 to smithi16641208-72 2020-11-16T20:55:52.175 INFO:tasks.rados.rados.0.smithi166.stdout:72: finishing write tid 2 to smithi16641208-72 2020-11-16T20:55:52.175 INFO:tasks.rados.rados.0.smithi166.stdout:72: finishing write tid 3 to smithi16641208-72 2020-11-16T20:55:52.175 INFO:tasks.rados.rados.0.smithi166.stdout:72: finishing write tid 4 to smithi16641208-72 2020-11-16T20:55:52.176 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 72 v 51 (ObjNum 71 snap 0 seq_num 71) dirty exists 2020-11-16T20:55:52.176 INFO:tasks.rados.rados.0.smithi166.stdout:72: left oid 72 (ObjNum 71 snap 0 seq_num 71) 2020-11-16T20:55:52.176 INFO:tasks.rados.rados.0.smithi166.stdout:73: finishing write tid 2 to smithi16641208-73 2020-11-16T20:55:52.176 INFO:tasks.rados.rados.0.smithi166.stdout:73: finishing write tid 3 to smithi16641208-73 2020-11-16T20:55:52.176 INFO:tasks.rados.rados.0.smithi166.stdout:73: finishing write tid 4 to smithi16641208-73 2020-11-16T20:55:52.176 INFO:tasks.rados.rados.0.smithi166.stdout:73: finishing write tid 5 to smithi16641208-73 2020-11-16T20:55:52.176 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 73 v 36 (ObjNum 72 snap 0 seq_num 72) dirty exists 2020-11-16T20:55:52.177 INFO:tasks.rados.rados.0.smithi166.stdout:73: left oid 73 (ObjNum 72 snap 0 seq_num 72) 2020-11-16T20:55:52.177 INFO:tasks.rados.rados.0.smithi166.stdout:74: finishing write tid 1 to smithi16641208-74 2020-11-16T20:55:52.177 INFO:tasks.rados.rados.0.smithi166.stdout:74: finishing write tid 2 to smithi16641208-74 2020-11-16T20:55:52.177 INFO:tasks.rados.rados.0.smithi166.stdout:74: finishing write tid 3 to smithi16641208-74 2020-11-16T20:55:52.177 INFO:tasks.rados.rados.0.smithi166.stdout:74: finishing write tid 4 to smithi16641208-74 2020-11-16T20:55:52.177 INFO:tasks.rados.rados.0.smithi166.stdout:74: finishing write tid 5 to smithi16641208-74 2020-11-16T20:55:52.177 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 74 v 55 (ObjNum 73 snap 0 seq_num 73) dirty exists 2020-11-16T20:55:52.178 INFO:tasks.rados.rados.0.smithi166.stdout:74: left oid 74 (ObjNum 73 snap 0 seq_num 73) 2020-11-16T20:55:52.178 INFO:tasks.rados.rados.0.smithi166.stdout:75: finishing write tid 1 to smithi16641208-75 2020-11-16T20:55:52.178 INFO:tasks.rados.rados.0.smithi166.stdout:75: finishing write tid 2 to smithi16641208-75 2020-11-16T20:55:52.178 INFO:tasks.rados.rados.0.smithi166.stdout:75: finishing write tid 3 to smithi16641208-75 2020-11-16T20:55:52.178 INFO:tasks.rados.rados.0.smithi166.stdout:75: finishing write tid 4 to smithi16641208-75 2020-11-16T20:55:52.178 INFO:tasks.rados.rados.0.smithi166.stdout:75: finishing write tid 5 to smithi16641208-75 2020-11-16T20:55:52.178 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 75 v 38 (ObjNum 74 snap 0 seq_num 74) dirty exists 2020-11-16T20:55:52.179 INFO:tasks.rados.rados.0.smithi166.stdout:75: left oid 75 (ObjNum 74 snap 0 seq_num 74) 2020-11-16T20:55:52.179 INFO:tasks.rados.rados.0.smithi166.stdout:76: finishing write tid 1 to smithi16641208-76 2020-11-16T20:55:52.179 INFO:tasks.rados.rados.0.smithi166.stdout:76: finishing write tid 2 to smithi16641208-76 2020-11-16T20:55:52.179 INFO:tasks.rados.rados.0.smithi166.stdout:76: finishing write tid 3 to smithi16641208-76 2020-11-16T20:55:52.179 INFO:tasks.rados.rados.0.smithi166.stdout:71: done (15 left) 2020-11-16T20:55:52.179 INFO:tasks.rados.rados.0.smithi166.stdout:72: done (14 left) 2020-11-16T20:55:52.179 INFO:tasks.rados.rados.0.smithi166.stdout:73: done (13 left) 2020-11-16T20:55:52.180 INFO:tasks.rados.rados.0.smithi166.stdout:74: done (12 left) 2020-11-16T20:55:52.180 INFO:tasks.rados.rados.0.smithi166.stdout:75: done (11 left) 2020-11-16T20:55:52.180 INFO:tasks.rados.rados.0.smithi166.stdout:87: write initial oid 87 2020-11-16T20:55:52.180 INFO:tasks.rados.rados.0.smithi166.stdout:87: seq_num 86 ranges {645402=551297,1749569=492355,2845789=599613} 2020-11-16T20:55:52.181 INFO:tasks.rados.rados.0.smithi166.stdout:87: writing smithi16641208-87 from 645402 to 1196699 tid 1 2020-11-16T20:55:52.188 INFO:tasks.rados.rados.0.smithi166.stdout:87: writing smithi16641208-87 from 1749569 to 2241924 tid 2 2020-11-16T20:55:52.196 INFO:tasks.rados.rados.0.smithi166.stdout:87: writing smithi16641208-87 from 2845789 to 3445402 tid 3 2020-11-16T20:55:52.196 INFO:tasks.rados.rados.0.smithi166.stdout:88: write initial oid 88 2020-11-16T20:55:52.196 INFO:tasks.rados.rados.0.smithi166.stdout:88: seq_num 87 ranges {662209=626546,1808051=636013,2873212=588997} 2020-11-16T20:55:52.203 INFO:tasks.rados.rados.0.smithi166.stdout:88: writing smithi16641208-88 from 662209 to 1288755 tid 1 2020-11-16T20:55:52.209 INFO:tasks.rados.rados.0.smithi166.stdout:88: writing smithi16641208-88 from 1808051 to 2444064 tid 2 2020-11-16T20:55:52.215 INFO:tasks.rados.rados.0.smithi166.stdout:88: writing smithi16641208-88 from 2873212 to 3462209 tid 3 2020-11-16T20:55:52.215 INFO:tasks.rados.rados.0.smithi166.stdout:89: write initial oid 89 2020-11-16T20:55:52.216 INFO:tasks.rados.rados.0.smithi166.stdout:89: seq_num 88 ranges {679016=701795,1866533=496024,2900635=402643} 2020-11-16T20:55:52.223 INFO:tasks.rados.rados.0.smithi166.stdout:89: writing smithi16641208-89 from 679016 to 1380811 tid 1 2020-11-16T20:55:52.228 INFO:tasks.rados.rados.0.smithi166.stdout:89: writing smithi16641208-89 from 1866533 to 2362557 tid 2 2020-11-16T20:55:52.234 INFO:tasks.rados.rados.0.smithi166.stdout:89: writing smithi16641208-89 from 2900635 to 3303278 tid 3 2020-11-16T20:55:52.234 INFO:tasks.rados.rados.0.smithi166.stdout:90: write initial oid 90 2020-11-16T20:55:52.234 INFO:tasks.rados.rados.0.smithi166.stdout:90: seq_num 89 ranges {695823=777044,1925015=639682,3328058=167765} 2020-11-16T20:55:52.239 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:55:52.243+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:55:52.242 INFO:tasks.rados.rados.0.smithi166.stdout:90: writing smithi16641208-90 from 695823 to 1472867 tid 1 2020-11-16T20:55:52.246 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:52.247 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:52.248 INFO:tasks.rados.rados.0.smithi166.stdout:90: writing smithi16641208-90 from 1925015 to 2564697 tid 2 2020-11-16T20:55:52.254 INFO:tasks.rados.rados.0.smithi166.stdout:90: writing smithi16641208-90 from 3328058 to 3495823 tid 3 2020-11-16T20:55:52.254 INFO:tasks.rados.rados.0.smithi166.stdout:91: write initial oid 91 2020-11-16T20:55:52.254 INFO:tasks.rados.rados.0.smithi166.stdout:91: seq_num 90 ranges {712630=452293,1583497=499693,2555481=425187} 2020-11-16T20:55:52.258 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:55:52.260 INFO:tasks.rados.rados.0.smithi166.stdout:91: writing smithi16641208-91 from 712630 to 1164923 tid 1 2020-11-16T20:55:52.265 INFO:tasks.rados.rados.0.smithi166.stdout:91: writing smithi16641208-91 from 1583497 to 2083190 tid 2 2020-11-16T20:55:52.271 INFO:tasks.rados.rados.0.smithi166.stdout:91: writing smithi16641208-91 from 2555481 to 2980668 tid 3 2020-11-16T20:55:52.271 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.271 INFO:tasks.rados.rados.0.smithi166.stdout:76: finishing write tid 4 to smithi16641208-76 2020-11-16T20:55:52.271 INFO:tasks.rados.rados.0.smithi166.stdout:76: finishing write tid 5 to smithi16641208-76 2020-11-16T20:55:52.271 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 76 v 59 (ObjNum 75 snap 0 seq_num 75) dirty exists 2020-11-16T20:55:52.272 INFO:tasks.rados.rados.0.smithi166.stdout:76: left oid 76 (ObjNum 75 snap 0 seq_num 75) 2020-11-16T20:55:52.272 INFO:tasks.rados.rados.0.smithi166.stdout:77: finishing write tid 1 to smithi16641208-77 2020-11-16T20:55:52.272 INFO:tasks.rados.rados.0.smithi166.stdout:77: finishing write tid 2 to smithi16641208-77 2020-11-16T20:55:52.272 INFO:tasks.rados.rados.0.smithi166.stdout:77: finishing write tid 3 to smithi16641208-77 2020-11-16T20:55:52.272 INFO:tasks.rados.rados.0.smithi166.stdout:77: finishing write tid 4 to smithi16641208-77 2020-11-16T20:55:52.272 INFO:tasks.rados.rados.0.smithi166.stdout:77: finishing write tid 5 to smithi16641208-77 2020-11-16T20:55:52.272 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 77 v 40 (ObjNum 76 snap 0 seq_num 76) dirty exists 2020-11-16T20:55:52.273 INFO:tasks.rados.rados.0.smithi166.stdout:77: left oid 77 (ObjNum 76 snap 0 seq_num 76) 2020-11-16T20:55:52.273 INFO:tasks.rados.rados.0.smithi166.stdout:78: finishing write tid 1 to smithi16641208-78 2020-11-16T20:55:52.273 INFO:tasks.rados.rados.0.smithi166.stdout:78: finishing write tid 2 to smithi16641208-78 2020-11-16T20:55:52.273 INFO:tasks.rados.rados.0.smithi166.stdout:78: finishing write tid 3 to smithi16641208-78 2020-11-16T20:55:52.273 INFO:tasks.rados.rados.0.smithi166.stdout:78: finishing write tid 4 to smithi16641208-78 2020-11-16T20:55:52.273 INFO:tasks.rados.rados.0.smithi166.stdout:78: finishing write tid 5 to smithi16641208-78 2020-11-16T20:55:52.273 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 78 v 44 (ObjNum 77 snap 0 seq_num 77) dirty exists 2020-11-16T20:55:52.274 INFO:tasks.rados.rados.0.smithi166.stdout:78: left oid 78 (ObjNum 77 snap 0 seq_num 77) 2020-11-16T20:55:52.274 INFO:tasks.rados.rados.0.smithi166.stdout:76: done (15 left) 2020-11-16T20:55:52.274 INFO:tasks.rados.rados.0.smithi166.stdout:77: done (14 left) 2020-11-16T20:55:52.274 INFO:tasks.rados.rados.0.smithi166.stdout:78: done (13 left) 2020-11-16T20:55:52.274 INFO:tasks.rados.rados.0.smithi166.stdout:92: write initial oid 92 2020-11-16T20:55:52.274 INFO:tasks.rados.rados.0.smithi166.stdout:92: seq_num 91 ranges {729437=527542,1925626=643351,3266551=262886} 2020-11-16T20:55:52.278 INFO:tasks.rados.rados.0.smithi166.stdout:92: writing smithi16641208-92 from 729437 to 1256979 tid 1 2020-11-16T20:55:52.285 INFO:tasks.rados.rados.0.smithi166.stdout:92: writing smithi16641208-92 from 1925626 to 2568977 tid 2 2020-11-16T20:55:52.291 INFO:tasks.rados.rados.0.smithi166.stdout:92: writing smithi16641208-92 from 3266551 to 3529437 tid 3 2020-11-16T20:55:52.291 INFO:tasks.rados.rados.0.smithi166.stdout:93: write initial oid 93 2020-11-16T20:55:52.291 INFO:tasks.rados.rados.0.smithi166.stdout:93: seq_num 92 ranges {746244=719144,2100461=503362,3126680=419564} 2020-11-16T20:55:52.299 INFO:tasks.rados.rados.0.smithi166.stdout:93: writing smithi16641208-93 from 746244 to 1465388 tid 1 2020-11-16T20:55:52.306 INFO:tasks.rados.rados.0.smithi166.stdout:93: writing smithi16641208-93 from 2100461 to 2603823 tid 2 2020-11-16T20:55:52.311 INFO:tasks.rados.rados.0.smithi166.stdout:93: writing smithi16641208-93 from 3126680 to 3546244 tid 3 2020-11-16T20:55:52.312 INFO:tasks.rados.rados.0.smithi166.stdout:94: write initial oid 94 2020-11-16T20:55:52.312 INFO:tasks.rados.rados.0.smithi166.stdout:94: seq_num 93 ranges {763051=794393,2158943=647020,3437750=125301} 2020-11-16T20:55:52.320 INFO:tasks.rados.rados.0.smithi166.stdout:94: writing smithi16641208-94 from 763051 to 1557444 tid 1 2020-11-16T20:55:52.327 INFO:tasks.rados.rados.0.smithi166.stdout:94: writing smithi16641208-94 from 2158943 to 2805963 tid 2 2020-11-16T20:55:52.331 INFO:tasks.rados.rados.0.smithi166.stdout:94: writing smithi16641208-94 from 3437750 to 3563051 tid 3 2020-11-16T20:55:52.332 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.332 INFO:tasks.rados.rados.0.smithi166.stdout:79: finishing write tid 1 to smithi16641208-79 2020-11-16T20:55:52.332 INFO:tasks.rados.rados.0.smithi166.stdout:79: finishing write tid 2 to smithi16641208-79 2020-11-16T20:55:52.332 INFO:tasks.rados.rados.0.smithi166.stdout:79: finishing write tid 3 to smithi16641208-79 2020-11-16T20:55:52.332 INFO:tasks.rados.rados.0.smithi166.stdout:79: finishing write tid 4 to smithi16641208-79 2020-11-16T20:55:52.332 INFO:tasks.rados.rados.0.smithi166.stdout:79: finishing write tid 5 to smithi16641208-79 2020-11-16T20:55:52.333 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 79 v 48 (ObjNum 78 snap 0 seq_num 78) dirty exists 2020-11-16T20:55:52.333 INFO:tasks.rados.rados.0.smithi166.stdout:79: left oid 79 (ObjNum 78 snap 0 seq_num 78) 2020-11-16T20:55:52.333 INFO:tasks.rados.rados.0.smithi166.stdout:80: finishing write tid 1 to smithi16641208-80 2020-11-16T20:55:52.333 INFO:tasks.rados.rados.0.smithi166.stdout:79: done (15 left) 2020-11-16T20:55:52.333 INFO:tasks.rados.rados.0.smithi166.stdout:95: write initial oid 95 2020-11-16T20:55:52.333 INFO:tasks.rados.rados.0.smithi166.stdout:95: seq_num 94 ranges {779858=469642,1817425=507031,2781526=586628} 2020-11-16T20:55:52.338 INFO:tasks.rados.rados.0.smithi166.stdout:95: writing smithi16641208-95 from 779858 to 1249500 tid 1 2020-11-16T20:55:52.340 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:55:52.344+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:55:52.344 INFO:tasks.rados.rados.0.smithi166.stdout:95: writing smithi16641208-95 from 1817425 to 2324456 tid 2 2020-11-16T20:55:52.350 INFO:tasks.rados.rados.0.smithi166.stdout:95: writing smithi16641208-95 from 2781526 to 3368154 tid 3 2020-11-16T20:55:52.350 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.351 INFO:tasks.rados.rados.0.smithi166.stdout:80: finishing write tid 2 to smithi16641208-80 2020-11-16T20:55:52.351 INFO:tasks.rados.rados.0.smithi166.stdout:80: finishing write tid 3 to smithi16641208-80 2020-11-16T20:55:52.351 INFO:tasks.rados.rados.0.smithi166.stdout:80: finishing write tid 4 to smithi16641208-80 2020-11-16T20:55:52.351 INFO:tasks.rados.rados.0.smithi166.stdout:80: finishing write tid 5 to smithi16641208-80 2020-11-16T20:55:52.351 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 80 v 63 (ObjNum 79 snap 0 seq_num 79) dirty exists 2020-11-16T20:55:52.351 INFO:tasks.rados.rados.0.smithi166.stdout:80: left oid 80 (ObjNum 79 snap 0 seq_num 79) 2020-11-16T20:55:52.352 INFO:tasks.rados.rados.0.smithi166.stdout:81: finishing write tid 1 to smithi16641208-81 2020-11-16T20:55:52.352 INFO:tasks.rados.rados.0.smithi166.stdout:80: done (15 left) 2020-11-16T20:55:52.352 INFO:tasks.rados.rados.0.smithi166.stdout:96: write initial oid 96 2020-11-16T20:55:52.352 INFO:tasks.rados.rados.0.smithi166.stdout:96: seq_num 95 ranges {796665=544891,1759554=650689,2976243=620422} 2020-11-16T20:55:52.358 INFO:tasks.rados.rados.0.smithi166.stdout:96: writing smithi16641208-96 from 796665 to 1341556 tid 1 2020-11-16T20:55:52.364 INFO:tasks.rados.rados.0.smithi166.stdout:96: writing smithi16641208-96 from 1759554 to 2410243 tid 2 2020-11-16T20:55:52.370 INFO:tasks.rados.rados.0.smithi166.stdout:96: writing smithi16641208-96 from 2976243 to 3596665 tid 3 2020-11-16T20:55:52.371 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.371 INFO:tasks.rados.rados.0.smithi166.stdout:81: finishing write tid 2 to smithi16641208-81 2020-11-16T20:55:52.371 INFO:tasks.rados.rados.0.smithi166.stdout:81: finishing write tid 3 to smithi16641208-81 2020-11-16T20:55:52.371 INFO:tasks.rados.rados.0.smithi166.stdout:81: finishing write tid 4 to smithi16641208-81 2020-11-16T20:55:52.371 INFO:tasks.rados.rados.0.smithi166.stdout:81: finishing write tid 5 to smithi16641208-81 2020-11-16T20:55:52.371 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 81 v 41 (ObjNum 80 snap 0 seq_num 80) dirty exists 2020-11-16T20:55:52.372 INFO:tasks.rados.rados.0.smithi166.stdout:81: left oid 81 (ObjNum 80 snap 0 seq_num 80) 2020-11-16T20:55:52.372 INFO:tasks.rados.rados.0.smithi166.stdout:82: finishing write tid 1 to smithi16641208-82 2020-11-16T20:55:52.372 INFO:tasks.rados.rados.0.smithi166.stdout:81: done (15 left) 2020-11-16T20:55:52.372 INFO:tasks.rados.rados.0.smithi166.stdout:97: write initial oid 97 2020-11-16T20:55:52.372 INFO:tasks.rados.rados.0.smithi166.stdout:97: seq_num 96 ranges {413472=620140,1818036=510700,3120019=493453} 2020-11-16T20:55:52.376 INFO:tasks.rados.rados.0.smithi166.stdout:97: writing smithi16641208-97 from 413472 to 1033612 tid 1 2020-11-16T20:55:52.383 INFO:tasks.rados.rados.0.smithi166.stdout:97: writing smithi16641208-97 from 1818036 to 2328736 tid 2 2020-11-16T20:55:52.391 INFO:tasks.rados.rados.0.smithi166.stdout:97: writing smithi16641208-97 from 3120019 to 3613472 tid 3 2020-11-16T20:55:52.391 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.391 INFO:tasks.rados.rados.0.smithi166.stdout:82: finishing write tid 2 to smithi16641208-82 2020-11-16T20:55:52.391 INFO:tasks.rados.rados.0.smithi166.stdout:82: finishing write tid 3 to smithi16641208-82 2020-11-16T20:55:52.391 INFO:tasks.rados.rados.0.smithi166.stdout:82: finishing write tid 4 to smithi16641208-82 2020-11-16T20:55:52.392 INFO:tasks.rados.rados.0.smithi166.stdout:82: finishing write tid 5 to smithi16641208-82 2020-11-16T20:55:52.392 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 82 v 67 (ObjNum 81 snap 0 seq_num 81) dirty exists 2020-11-16T20:55:52.392 INFO:tasks.rados.rados.0.smithi166.stdout:82: left oid 82 (ObjNum 81 snap 0 seq_num 81) 2020-11-16T20:55:52.392 INFO:tasks.rados.rados.0.smithi166.stdout:83: finishing write tid 1 to smithi16641208-83 2020-11-16T20:55:52.392 INFO:tasks.rados.rados.0.smithi166.stdout:82: done (15 left) 2020-11-16T20:55:52.392 INFO:tasks.rados.rados.0.smithi166.stdout:98: write initial oid 98 2020-11-16T20:55:52.392 INFO:tasks.rados.rados.0.smithi166.stdout:98: seq_num 97 ranges {430279=695389,1876518=654358,3031089=536797} 2020-11-16T20:55:52.397 INFO:tasks.rados.rados.0.smithi166.stdout:98: writing smithi16641208-98 from 430279 to 1125668 tid 1 2020-11-16T20:55:52.405 INFO:tasks.rados.rados.0.smithi166.stdout:98: writing smithi16641208-98 from 1876518 to 2530876 tid 2 2020-11-16T20:55:52.411 INFO:tasks.rados.rados.0.smithi166.stdout:98: writing smithi16641208-98 from 3031089 to 3567886 tid 3 2020-11-16T20:55:52.411 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.411 INFO:tasks.rados.rados.0.smithi166.stdout:83: finishing write tid 2 to smithi16641208-83 2020-11-16T20:55:52.412 INFO:tasks.rados.rados.0.smithi166.stdout:83: finishing write tid 3 to smithi16641208-83 2020-11-16T20:55:52.412 INFO:tasks.rados.rados.0.smithi166.stdout:83: finishing write tid 4 to smithi16641208-83 2020-11-16T20:55:52.412 INFO:tasks.rados.rados.0.smithi166.stdout:83: finishing write tid 5 to smithi16641208-83 2020-11-16T20:55:52.412 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 83 v 52 (ObjNum 82 snap 0 seq_num 82) dirty exists 2020-11-16T20:55:52.412 INFO:tasks.rados.rados.0.smithi166.stdout:83: left oid 83 (ObjNum 82 snap 0 seq_num 82) 2020-11-16T20:55:52.412 INFO:tasks.rados.rados.0.smithi166.stdout:84: finishing write tid 1 to smithi16641208-84 2020-11-16T20:55:52.412 INFO:tasks.rados.rados.0.smithi166.stdout:84: finishing write tid 2 to smithi16641208-84 2020-11-16T20:55:52.413 INFO:tasks.rados.rados.0.smithi166.stdout:84: finishing write tid 3 to smithi16641208-84 2020-11-16T20:55:52.413 INFO:tasks.rados.rados.0.smithi166.stdout:84: finishing write tid 4 to smithi16641208-84 2020-11-16T20:55:52.413 INFO:tasks.rados.rados.0.smithi166.stdout:83: done (15 left) 2020-11-16T20:55:52.413 INFO:tasks.rados.rados.0.smithi166.stdout:99: write initial oid 99 2020-11-16T20:55:52.413 INFO:tasks.rados.rados.0.smithi166.stdout:99: seq_num 98 ranges {447086=770638,1935000=798016,3458512=188574} 2020-11-16T20:55:52.417 INFO:tasks.rados.rados.0.smithi166.stdout:99: writing smithi16641208-99 from 447086 to 1217724 tid 1 2020-11-16T20:55:52.426 INFO:tasks.rados.rados.0.smithi166.stdout:99: writing smithi16641208-99 from 1935000 to 2733016 tid 2 2020-11-16T20:55:52.431 INFO:tasks.rados.rados.0.smithi166.stdout:99: writing smithi16641208-99 from 3458512 to 3647086 tid 3 2020-11-16T20:55:52.432 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.432 INFO:tasks.rados.rados.0.smithi166.stdout:84: finishing write tid 5 to smithi16641208-84 2020-11-16T20:55:52.432 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 84 v 71 (ObjNum 83 snap 0 seq_num 83) dirty exists 2020-11-16T20:55:52.432 INFO:tasks.rados.rados.0.smithi166.stdout:84: left oid 84 (ObjNum 83 snap 0 seq_num 83) 2020-11-16T20:55:52.432 INFO:tasks.rados.rados.0.smithi166.stdout:84: done (15 left) 2020-11-16T20:55:52.432 INFO:tasks.rados.rados.0.smithi166.stdout:100: write initial oid 100 2020-11-16T20:55:52.432 INFO:tasks.rados.rados.0.smithi166.stdout:100: seq_num 99 ranges {463893=562240,1593482=658027,2685935=559341} 2020-11-16T20:55:52.437 INFO:tasks.rados.rados.0.smithi166.stdout:100: writing smithi16641208-100 from 463893 to 1026133 tid 1 2020-11-16T20:55:52.441 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:55:52.445+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:55:52.444 INFO:tasks.rados.rados.0.smithi166.stdout:100: writing smithi16641208-100 from 1593482 to 2251509 tid 2 2020-11-16T20:55:52.450 INFO:tasks.rados.rados.0.smithi166.stdout:100: writing smithi16641208-100 from 2685935 to 3245276 tid 3 2020-11-16T20:55:52.450 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.450 INFO:tasks.rados.rados.0.smithi166.stdout:85: finishing write tid 1 to smithi16641208-85 2020-11-16T20:55:52.451 INFO:tasks.rados.rados.0.smithi166.stdout:85: finishing write tid 2 to smithi16641208-85 2020-11-16T20:55:52.451 INFO:tasks.rados.rados.0.smithi166.stdout:85: finishing write tid 3 to smithi16641208-85 2020-11-16T20:55:52.451 INFO:tasks.rados.rados.0.smithi166.stdout:85: finishing write tid 4 to smithi16641208-85 2020-11-16T20:55:52.451 INFO:tasks.rados.rados.0.smithi166.stdout:85: finishing write tid 5 to smithi16641208-85 2020-11-16T20:55:52.451 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 85 v 37 (ObjNum 84 snap 0 seq_num 84) dirty exists 2020-11-16T20:55:52.451 INFO:tasks.rados.rados.0.smithi166.stdout:85: left oid 85 (ObjNum 84 snap 0 seq_num 84) 2020-11-16T20:55:52.451 INFO:tasks.rados.rados.0.smithi166.stdout:86: finishing write tid 1 to smithi16641208-86 2020-11-16T20:55:52.452 INFO:tasks.rados.rados.0.smithi166.stdout:86: finishing write tid 2 to smithi16641208-86 2020-11-16T20:55:52.452 INFO:tasks.rados.rados.0.smithi166.stdout:85: done (15 left) 2020-11-16T20:55:52.452 INFO:tasks.rados.rados.0.smithi166.stdout:101: write initial oid 101 2020-11-16T20:55:52.452 INFO:tasks.rados.rados.0.smithi166.stdout:101: seq_num 100 ranges {480700=637489,1651964=401685,2713358=770613} 2020-11-16T20:55:52.452 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:52.453 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:52.456 INFO:tasks.rados.rados.0.smithi166.stdout:101: writing smithi16641208-101 from 480700 to 1118189 tid 1 2020-11-16T20:55:52.461 INFO:tasks.rados.rados.0.smithi166.stdout:101: writing smithi16641208-101 from 1651964 to 2053649 tid 2 2020-11-16T20:55:52.463 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:55:52.469 INFO:tasks.rados.rados.0.smithi166.stdout:101: writing smithi16641208-101 from 2713358 to 3483971 tid 3 2020-11-16T20:55:52.469 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.470 INFO:tasks.rados.rados.0.smithi166.stdout:86: finishing write tid 3 to smithi16641208-86 2020-11-16T20:55:52.470 INFO:tasks.rados.rados.0.smithi166.stdout:86: finishing write tid 4 to smithi16641208-86 2020-11-16T20:55:52.470 INFO:tasks.rados.rados.0.smithi166.stdout:86: finishing write tid 5 to smithi16641208-86 2020-11-16T20:55:52.470 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 86 v 41 (ObjNum 85 snap 0 seq_num 85) dirty exists 2020-11-16T20:55:52.470 INFO:tasks.rados.rados.0.smithi166.stdout:86: left oid 86 (ObjNum 85 snap 0 seq_num 85) 2020-11-16T20:55:52.470 INFO:tasks.rados.rados.0.smithi166.stdout:87: finishing write tid 1 to smithi16641208-87 2020-11-16T20:55:52.470 INFO:tasks.rados.rados.0.smithi166.stdout:86: done (15 left) 2020-11-16T20:55:52.471 INFO:tasks.rados.rados.0.smithi166.stdout:102: write initial oid 102 2020-11-16T20:55:52.471 INFO:tasks.rados.rados.0.smithi166.stdout:102: seq_num 101 ranges {497507=712738,1710446=661696,3140781=556726} 2020-11-16T20:55:52.476 INFO:tasks.rados.rados.0.smithi166.stdout:102: writing smithi16641208-102 from 497507 to 1210245 tid 1 2020-11-16T20:55:52.483 INFO:tasks.rados.rados.0.smithi166.stdout:102: writing smithi16641208-102 from 1710446 to 2372142 tid 2 2020-11-16T20:55:52.490 INFO:tasks.rados.rados.0.smithi166.stdout:102: writing smithi16641208-102 from 3140781 to 3697507 tid 3 2020-11-16T20:55:52.490 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.490 INFO:tasks.rados.rados.0.smithi166.stdout:87: finishing write tid 2 to smithi16641208-87 2020-11-16T20:55:52.491 INFO:tasks.rados.rados.0.smithi166.stdout:87: finishing write tid 3 to smithi16641208-87 2020-11-16T20:55:52.491 INFO:tasks.rados.rados.0.smithi166.stdout:87: finishing write tid 4 to smithi16641208-87 2020-11-16T20:55:52.491 INFO:tasks.rados.rados.0.smithi166.stdout:87: finishing write tid 5 to smithi16641208-87 2020-11-16T20:55:52.491 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 87 v 45 (ObjNum 86 snap 0 seq_num 86) dirty exists 2020-11-16T20:55:52.491 INFO:tasks.rados.rados.0.smithi166.stdout:87: left oid 87 (ObjNum 86 snap 0 seq_num 86) 2020-11-16T20:55:52.491 INFO:tasks.rados.rados.0.smithi166.stdout:88: finishing write tid 1 to smithi16641208-88 2020-11-16T20:55:52.491 INFO:tasks.rados.rados.0.smithi166.stdout:87: done (15 left) 2020-11-16T20:55:52.492 INFO:tasks.rados.rados.0.smithi166.stdout:103: write initial oid 103 2020-11-16T20:55:52.492 INFO:tasks.rados.rados.0.smithi166.stdout:103: seq_num 102 ranges {514314=787987,1768928=405354,2768204=509510} 2020-11-16T20:55:52.497 INFO:tasks.rados.rados.0.smithi166.stdout:103: writing smithi16641208-103 from 514314 to 1302301 tid 1 2020-11-16T20:55:52.502 INFO:tasks.rados.rados.0.smithi166.stdout:103: writing smithi16641208-103 from 1768928 to 2174282 tid 2 2020-11-16T20:55:52.509 INFO:tasks.rados.rados.0.smithi166.stdout:103: writing smithi16641208-103 from 2768204 to 3277714 tid 3 2020-11-16T20:55:52.509 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.509 INFO:tasks.rados.rados.0.smithi166.stdout:88: finishing write tid 2 to smithi16641208-88 2020-11-16T20:55:52.509 INFO:tasks.rados.rados.0.smithi166.stdout:88: finishing write tid 3 to smithi16641208-88 2020-11-16T20:55:52.509 INFO:tasks.rados.rados.0.smithi166.stdout:88: finishing write tid 4 to smithi16641208-88 2020-11-16T20:55:52.509 INFO:tasks.rados.rados.0.smithi166.stdout:88: finishing write tid 5 to smithi16641208-88 2020-11-16T20:55:52.510 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 88 v 44 (ObjNum 87 snap 0 seq_num 87) dirty exists 2020-11-16T20:55:52.510 INFO:tasks.rados.rados.0.smithi166.stdout:88: left oid 88 (ObjNum 87 snap 0 seq_num 87) 2020-11-16T20:55:52.510 INFO:tasks.rados.rados.0.smithi166.stdout:89: finishing write tid 1 to smithi16641208-89 2020-11-16T20:55:52.510 INFO:tasks.rados.rados.0.smithi166.stdout:88: done (15 left) 2020-11-16T20:55:52.510 INFO:tasks.rados.rados.0.smithi166.stdout:104: write initial oid 104 2020-11-16T20:55:52.510 INFO:tasks.rados.rados.0.smithi166.stdout:104: seq_num 103 ranges {531121=463236,1711057=665365,3079274=651847} 2020-11-16T20:55:52.514 INFO:tasks.rados.rados.0.smithi166.stdout:104: writing smithi16641208-104 from 531121 to 994357 tid 1 2020-11-16T20:55:52.522 INFO:tasks.rados.rados.0.smithi166.stdout:104: writing smithi16641208-104 from 1711057 to 2376422 tid 2 2020-11-16T20:55:52.530 INFO:tasks.rados.rados.0.smithi166.stdout:104: writing smithi16641208-104 from 3079274 to 3731121 tid 3 2020-11-16T20:55:52.530 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.530 INFO:tasks.rados.rados.0.smithi166.stdout:89: finishing write tid 2 to smithi16641208-89 2020-11-16T20:55:52.531 INFO:tasks.rados.rados.0.smithi166.stdout:89: finishing write tid 3 to smithi16641208-89 2020-11-16T20:55:52.531 INFO:tasks.rados.rados.0.smithi166.stdout:89: finishing write tid 4 to smithi16641208-89 2020-11-16T20:55:52.531 INFO:tasks.rados.rados.0.smithi166.stdout:89: finishing write tid 5 to smithi16641208-89 2020-11-16T20:55:52.531 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 89 v 75 (ObjNum 88 snap 0 seq_num 88) dirty exists 2020-11-16T20:55:52.531 INFO:tasks.rados.rados.0.smithi166.stdout:89: left oid 89 (ObjNum 88 snap 0 seq_num 88) 2020-11-16T20:55:52.531 INFO:tasks.rados.rados.0.smithi166.stdout:90: finishing write tid 1 to smithi16641208-90 2020-11-16T20:55:52.531 INFO:tasks.rados.rados.0.smithi166.stdout:89: done (15 left) 2020-11-16T20:55:52.532 INFO:tasks.rados.rados.0.smithi166.stdout:105: write initial oid 105 2020-11-16T20:55:52.532 INFO:tasks.rados.rados.0.smithi166.stdout:105: seq_num 104 ranges {547928=538485,1769539=409023,2706697=532054} 2020-11-16T20:55:52.536 INFO:tasks.rados.rados.0.smithi166.stdout:105: writing smithi16641208-105 from 547928 to 1086413 tid 1 2020-11-16T20:55:52.542 INFO:tasks.rados.rados.0.smithi166.stdout:105: writing smithi16641208-105 from 1769539 to 2178562 tid 2 2020-11-16T20:55:52.542 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:55:52.545+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:55:52.548 INFO:tasks.rados.rados.0.smithi166.stdout:105: writing smithi16641208-105 from 2706697 to 3238751 tid 3 2020-11-16T20:55:52.548 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.548 INFO:tasks.rados.rados.0.smithi166.stdout:90: finishing write tid 2 to smithi16641208-90 2020-11-16T20:55:52.549 INFO:tasks.rados.rados.0.smithi166.stdout:90: finishing write tid 3 to smithi16641208-90 2020-11-16T20:55:52.549 INFO:tasks.rados.rados.0.smithi166.stdout:90: finishing write tid 4 to smithi16641208-90 2020-11-16T20:55:52.549 INFO:tasks.rados.rados.0.smithi166.stdout:90: finishing write tid 5 to smithi16641208-90 2020-11-16T20:55:52.549 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 90 v 40 (ObjNum 89 snap 0 seq_num 89) dirty exists 2020-11-16T20:55:52.549 INFO:tasks.rados.rados.0.smithi166.stdout:90: left oid 90 (ObjNum 89 snap 0 seq_num 89) 2020-11-16T20:55:52.549 INFO:tasks.rados.rados.0.smithi166.stdout:91: finishing write tid 1 to smithi16641208-91 2020-11-16T20:55:52.549 INFO:tasks.rados.rados.0.smithi166.stdout:90: done (15 left) 2020-11-16T20:55:52.550 INFO:tasks.rados.rados.0.smithi166.stdout:106: write initial oid 106 2020-11-16T20:55:52.550 INFO:tasks.rados.rados.0.smithi166.stdout:106: seq_num 105 ranges {564735=613734,1828021=669034,3134120=630615} 2020-11-16T20:55:52.555 INFO:tasks.rados.rados.0.smithi166.stdout:106: writing smithi16641208-106 from 564735 to 1178469 tid 1 2020-11-16T20:55:52.562 INFO:tasks.rados.rados.0.smithi166.stdout:106: writing smithi16641208-106 from 1828021 to 2497055 tid 2 2020-11-16T20:55:52.569 INFO:tasks.rados.rados.0.smithi166.stdout:106: writing smithi16641208-106 from 3134120 to 3764735 tid 3 2020-11-16T20:55:52.570 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.570 INFO:tasks.rados.rados.0.smithi166.stdout:91: finishing write tid 2 to smithi16641208-91 2020-11-16T20:55:52.570 INFO:tasks.rados.rados.0.smithi166.stdout:91: finishing write tid 3 to smithi16641208-91 2020-11-16T20:55:52.570 INFO:tasks.rados.rados.0.smithi166.stdout:91: finishing write tid 4 to smithi16641208-91 2020-11-16T20:55:52.570 INFO:tasks.rados.rados.0.smithi166.stdout:91: finishing write tid 5 to smithi16641208-91 2020-11-16T20:55:52.570 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 91 v 79 (ObjNum 90 snap 0 seq_num 90) dirty exists 2020-11-16T20:55:52.571 INFO:tasks.rados.rados.0.smithi166.stdout:91: left oid 91 (ObjNum 90 snap 0 seq_num 90) 2020-11-16T20:55:52.571 INFO:tasks.rados.rados.0.smithi166.stdout:92: finishing write tid 1 to smithi16641208-92 2020-11-16T20:55:52.571 INFO:tasks.rados.rados.0.smithi166.stdout:92: finishing write tid 2 to smithi16641208-92 2020-11-16T20:55:52.571 INFO:tasks.rados.rados.0.smithi166.stdout:92: finishing write tid 3 to smithi16641208-92 2020-11-16T20:55:52.571 INFO:tasks.rados.rados.0.smithi166.stdout:92: finishing write tid 4 to smithi16641208-92 2020-11-16T20:55:52.571 INFO:tasks.rados.rados.0.smithi166.stdout:92: finishing write tid 5 to smithi16641208-92 2020-11-16T20:55:52.571 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 92 v 83 (ObjNum 91 snap 0 seq_num 91) dirty exists 2020-11-16T20:55:52.572 INFO:tasks.rados.rados.0.smithi166.stdout:92: left oid 92 (ObjNum 91 snap 0 seq_num 91) 2020-11-16T20:55:52.572 INFO:tasks.rados.rados.0.smithi166.stdout:91: done (15 left) 2020-11-16T20:55:52.572 INFO:tasks.rados.rados.0.smithi166.stdout:92: done (14 left) 2020-11-16T20:55:52.572 INFO:tasks.rados.rados.0.smithi166.stdout:107: write initial oid 107 2020-11-16T20:55:52.572 INFO:tasks.rados.rados.0.smithi166.stdout:107: seq_num 106 ranges {581542=688983,1886503=412692,2761543=670951} 2020-11-16T20:55:52.576 INFO:tasks.rados.rados.0.smithi166.stdout:107: writing smithi16641208-107 from 581542 to 1270525 tid 1 2020-11-16T20:55:52.582 INFO:tasks.rados.rados.0.smithi166.stdout:107: writing smithi16641208-107 from 1886503 to 2299195 tid 2 2020-11-16T20:55:52.588 INFO:tasks.rados.rados.0.smithi166.stdout:107: writing smithi16641208-107 from 2761543 to 3432494 tid 3 2020-11-16T20:55:52.589 INFO:tasks.rados.rados.0.smithi166.stdout:108: write initial oid 108 2020-11-16T20:55:52.589 INFO:tasks.rados.rados.0.smithi166.stdout:108: seq_num 107 ranges {598349=480585,1544985=672703,2905319=482223} 2020-11-16T20:55:52.594 INFO:tasks.rados.rados.0.smithi166.stdout:108: writing smithi16641208-108 from 598349 to 1078934 tid 1 2020-11-16T20:55:52.601 INFO:tasks.rados.rados.0.smithi166.stdout:108: writing smithi16641208-108 from 1544985 to 2217688 tid 2 2020-11-16T20:55:52.608 INFO:tasks.rados.rados.0.smithi166.stdout:108: writing smithi16641208-108 from 2905319 to 3387542 tid 3 2020-11-16T20:55:52.609 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.609 INFO:tasks.rados.rados.0.smithi166.stdout:93: finishing write tid 1 to smithi16641208-93 2020-11-16T20:55:52.609 INFO:tasks.rados.rados.0.smithi166.stdout:93: finishing write tid 2 to smithi16641208-93 2020-11-16T20:55:52.609 INFO:tasks.rados.rados.0.smithi166.stdout:93: finishing write tid 3 to smithi16641208-93 2020-11-16T20:55:52.609 INFO:tasks.rados.rados.0.smithi166.stdout:93: finishing write tid 4 to smithi16641208-93 2020-11-16T20:55:52.609 INFO:tasks.rados.rados.0.smithi166.stdout:93: finishing write tid 5 to smithi16641208-93 2020-11-16T20:55:52.609 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 93 v 56 (ObjNum 92 snap 0 seq_num 92) dirty exists 2020-11-16T20:55:52.610 INFO:tasks.rados.rados.0.smithi166.stdout:93: left oid 93 (ObjNum 92 snap 0 seq_num 92) 2020-11-16T20:55:52.610 INFO:tasks.rados.rados.0.smithi166.stdout:94: finishing write tid 1 to smithi16641208-94 2020-11-16T20:55:52.610 INFO:tasks.rados.rados.0.smithi166.stdout:94: finishing write tid 2 to smithi16641208-94 2020-11-16T20:55:52.610 INFO:tasks.rados.rados.0.smithi166.stdout:94: finishing write tid 3 to smithi16641208-94 2020-11-16T20:55:52.610 INFO:tasks.rados.rados.0.smithi166.stdout:94: finishing write tid 4 to smithi16641208-94 2020-11-16T20:55:52.610 INFO:tasks.rados.rados.0.smithi166.stdout:94: finishing write tid 5 to smithi16641208-94 2020-11-16T20:55:52.610 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 94 v 44 (ObjNum 93 snap 0 seq_num 93) dirty exists 2020-11-16T20:55:52.611 INFO:tasks.rados.rados.0.smithi166.stdout:94: left oid 94 (ObjNum 93 snap 0 seq_num 93) 2020-11-16T20:55:52.611 INFO:tasks.rados.rados.0.smithi166.stdout:95: finishing write tid 1 to smithi16641208-95 2020-11-16T20:55:52.611 INFO:tasks.rados.rados.0.smithi166.stdout:95: finishing write tid 2 to smithi16641208-95 2020-11-16T20:55:52.611 INFO:tasks.rados.rados.0.smithi166.stdout:95: finishing write tid 3 to smithi16641208-95 2020-11-16T20:55:52.611 INFO:tasks.rados.rados.0.smithi166.stdout:95: finishing write tid 4 to smithi16641208-95 2020-11-16T20:55:52.611 INFO:tasks.rados.rados.0.smithi166.stdout:95: finishing write tid 5 to smithi16641208-95 2020-11-16T20:55:52.611 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 95 v 49 (ObjNum 94 snap 0 seq_num 94) dirty exists 2020-11-16T20:55:52.612 INFO:tasks.rados.rados.0.smithi166.stdout:95: left oid 95 (ObjNum 94 snap 0 seq_num 94) 2020-11-16T20:55:52.612 INFO:tasks.rados.rados.0.smithi166.stdout:93: done (15 left) 2020-11-16T20:55:52.612 INFO:tasks.rados.rados.0.smithi166.stdout:94: done (14 left) 2020-11-16T20:55:52.612 INFO:tasks.rados.rados.0.smithi166.stdout:95: done (13 left) 2020-11-16T20:55:52.612 INFO:tasks.rados.rados.0.smithi166.stdout:109: write initial oid 109 2020-11-16T20:55:52.612 INFO:tasks.rados.rados.0.smithi166.stdout:109: seq_num 108 ranges {615156=555834,1603467=416361,2816389=693495} 2020-11-16T20:55:52.614 INFO:tasks.rados.rados.0.smithi166.stdout:109: writing smithi16641208-109 from 615156 to 1170990 tid 1 2020-11-16T20:55:52.616 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:52.617 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:52.619 INFO:tasks.rados.rados.0.smithi166.stdout:109: writing smithi16641208-109 from 1603467 to 2019828 tid 2 2020-11-16T20:55:52.627 INFO:tasks.rados.rados.0.smithi166.stdout:109: writing smithi16641208-109 from 2816389 to 3509884 tid 3 2020-11-16T20:55:52.627 INFO:tasks.rados.rados.0.smithi166.stdout:110: write initial oid 110 2020-11-16T20:55:52.627 INFO:tasks.rados.rados.0.smithi166.stdout:96: finishing write tid 1 to smithi16641208-96 2020-11-16T20:55:52.627 INFO:tasks.rados.rados.0.smithi166.stdout:110: seq_num 109 ranges {631963=631083,2061949=560019,3243812=504767} 2020-11-16T20:55:52.630 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:55:52.634 INFO:tasks.rados.rados.0.smithi166.stdout:110: writing smithi16641208-110 from 631963 to 1263046 tid 1 2020-11-16T20:55:52.641 INFO:tasks.rados.rados.0.smithi166.stdout:110: writing smithi16641208-110 from 2061949 to 2621968 tid 2 2020-11-16T20:55:52.643 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:52.647+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:52.648 INFO:tasks.rados.rados.0.smithi166.stdout:110: writing smithi16641208-110 from 3243812 to 3748579 tid 3 2020-11-16T20:55:52.648 INFO:tasks.rados.rados.0.smithi166.stdout:111: write initial oid 111 2020-11-16T20:55:52.648 INFO:tasks.rados.rados.0.smithi166.stdout:111: seq_num 110 ranges {648770=706332,2120431=420030,3271235=432392} 2020-11-16T20:55:52.655 INFO:tasks.rados.rados.0.smithi166.stdout:111: writing smithi16641208-111 from 648770 to 1355102 tid 1 2020-11-16T20:55:52.662 INFO:tasks.rados.rados.0.smithi166.stdout:111: writing smithi16641208-111 from 2120431 to 2540461 tid 2 2020-11-16T20:55:52.668 INFO:tasks.rados.rados.0.smithi166.stdout:111: writing smithi16641208-111 from 3271235 to 3703627 tid 3 2020-11-16T20:55:52.669 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.669 INFO:tasks.rados.rados.0.smithi166.stdout:96: finishing write tid 2 to smithi16641208-96 2020-11-16T20:55:52.669 INFO:tasks.rados.rados.0.smithi166.stdout:96: finishing write tid 3 to smithi16641208-96 2020-11-16T20:55:52.669 INFO:tasks.rados.rados.0.smithi166.stdout:96: finishing write tid 4 to smithi16641208-96 2020-11-16T20:55:52.669 INFO:tasks.rados.rados.0.smithi166.stdout:96: finishing write tid 5 to smithi16641208-96 2020-11-16T20:55:52.669 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 96 v 29 (ObjNum 95 snap 0 seq_num 95) dirty exists 2020-11-16T20:55:52.669 INFO:tasks.rados.rados.0.smithi166.stdout:96: left oid 96 (ObjNum 95 snap 0 seq_num 95) 2020-11-16T20:55:52.670 INFO:tasks.rados.rados.0.smithi166.stdout:97: finishing write tid 1 to smithi16641208-97 2020-11-16T20:55:52.670 INFO:tasks.rados.rados.0.smithi166.stdout:97: finishing write tid 2 to smithi16641208-97 2020-11-16T20:55:52.670 INFO:tasks.rados.rados.0.smithi166.stdout:97: finishing write tid 3 to smithi16641208-97 2020-11-16T20:55:52.670 INFO:tasks.rados.rados.0.smithi166.stdout:97: finishing write tid 4 to smithi16641208-97 2020-11-16T20:55:52.670 INFO:tasks.rados.rados.0.smithi166.stdout:97: finishing write tid 5 to smithi16641208-97 2020-11-16T20:55:52.670 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 97 v 33 (ObjNum 96 snap 0 seq_num 96) dirty exists 2020-11-16T20:55:52.670 INFO:tasks.rados.rados.0.smithi166.stdout:97: left oid 97 (ObjNum 96 snap 0 seq_num 96) 2020-11-16T20:55:52.671 INFO:tasks.rados.rados.0.smithi166.stdout:96: done (15 left) 2020-11-16T20:55:52.671 INFO:tasks.rados.rados.0.smithi166.stdout:97: done (14 left) 2020-11-16T20:55:52.671 INFO:tasks.rados.rados.0.smithi166.stdout:112: write initial oid 112 2020-11-16T20:55:52.671 INFO:tasks.rados.rados.0.smithi166.stdout:112: seq_num 111 ranges {665577=781581,2062560=563688,3182305=643664} 2020-11-16T20:55:52.676 INFO:tasks.rados.rados.0.smithi166.stdout:112: writing smithi16641208-112 from 665577 to 1447158 tid 1 2020-11-16T20:55:52.683 INFO:tasks.rados.rados.0.smithi166.stdout:112: writing smithi16641208-112 from 2062560 to 2626248 tid 2 2020-11-16T20:55:52.689 INFO:tasks.rados.rados.0.smithi166.stdout:112: writing smithi16641208-112 from 3182305 to 3825969 tid 3 2020-11-16T20:55:52.690 INFO:tasks.rados.rados.0.smithi166.stdout:113: write initial oid 113 2020-11-16T20:55:52.690 INFO:tasks.rados.rados.0.smithi166.stdout:113: seq_num 112 ranges {682384=456830,1721042=423699,2809728=454936,3731357=151027} 2020-11-16T20:55:52.696 INFO:tasks.rados.rados.0.smithi166.stdout:113: writing smithi16641208-113 from 682384 to 1139214 tid 1 2020-11-16T20:55:52.701 INFO:tasks.rados.rados.0.smithi166.stdout:113: writing smithi16641208-113 from 1721042 to 2144741 tid 2 2020-11-16T20:55:52.708 INFO:tasks.rados.rados.0.smithi166.stdout:113: writing smithi16641208-113 from 2809728 to 3264664 tid 3 2020-11-16T20:55:52.712 INFO:tasks.rados.rados.0.smithi166.stdout:113: writing smithi16641208-113 from 3731357 to 3882384 tid 4 2020-11-16T20:55:52.712 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.712 INFO:tasks.rados.rados.0.smithi166.stdout:98: finishing write tid 1 to smithi16641208-98 2020-11-16T20:55:52.712 INFO:tasks.rados.rados.0.smithi166.stdout:98: finishing write tid 2 to smithi16641208-98 2020-11-16T20:55:52.712 INFO:tasks.rados.rados.0.smithi166.stdout:98: finishing write tid 3 to smithi16641208-98 2020-11-16T20:55:52.713 INFO:tasks.rados.rados.0.smithi166.stdout:98: finishing write tid 4 to smithi16641208-98 2020-11-16T20:55:52.713 INFO:tasks.rados.rados.0.smithi166.stdout:98: finishing write tid 5 to smithi16641208-98 2020-11-16T20:55:52.713 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 98 v 48 (ObjNum 97 snap 0 seq_num 97) dirty exists 2020-11-16T20:55:52.713 INFO:tasks.rados.rados.0.smithi166.stdout:98: left oid 98 (ObjNum 97 snap 0 seq_num 97) 2020-11-16T20:55:52.713 INFO:tasks.rados.rados.0.smithi166.stdout:99: finishing write tid 1 to smithi16641208-99 2020-11-16T20:55:52.713 INFO:tasks.rados.rados.0.smithi166.stdout:99: finishing write tid 2 to smithi16641208-99 2020-11-16T20:55:52.713 INFO:tasks.rados.rados.0.smithi166.stdout:99: finishing write tid 3 to smithi16641208-99 2020-11-16T20:55:52.714 INFO:tasks.rados.rados.0.smithi166.stdout:99: finishing write tid 4 to smithi16641208-99 2020-11-16T20:55:52.714 INFO:tasks.rados.rados.0.smithi166.stdout:99: finishing write tid 5 to smithi16641208-99 2020-11-16T20:55:52.714 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 99 v 60 (ObjNum 98 snap 0 seq_num 98) dirty exists 2020-11-16T20:55:52.714 INFO:tasks.rados.rados.0.smithi166.stdout:99: left oid 99 (ObjNum 98 snap 0 seq_num 98) 2020-11-16T20:55:52.714 INFO:tasks.rados.rados.0.smithi166.stdout:100: finishing write tid 1 to smithi16641208-100 2020-11-16T20:55:52.714 INFO:tasks.rados.rados.0.smithi166.stdout:100: finishing write tid 2 to smithi16641208-100 2020-11-16T20:55:52.714 INFO:tasks.rados.rados.0.smithi166.stdout:98: done (15 left) 2020-11-16T20:55:52.715 INFO:tasks.rados.rados.0.smithi166.stdout:99: done (14 left) 2020-11-16T20:55:52.715 INFO:tasks.rados.rados.0.smithi166.stdout:114: write initial oid 114 2020-11-16T20:55:52.715 INFO:tasks.rados.rados.0.smithi166.stdout:114: seq_num 113 ranges {699191=532079,1779524=567357,2837151=666208} 2020-11-16T20:55:52.718 INFO:tasks.rados.rados.0.smithi166.stdout:114: writing smithi16641208-114 from 699191 to 1231270 tid 1 2020-11-16T20:55:52.725 INFO:tasks.rados.rados.0.smithi166.stdout:114: writing smithi16641208-114 from 1779524 to 2346881 tid 2 2020-11-16T20:55:52.731 INFO:tasks.rados.rados.0.smithi166.stdout:114: writing smithi16641208-114 from 2837151 to 3503359 tid 3 2020-11-16T20:55:52.731 INFO:tasks.rados.rados.0.smithi166.stdout:115: write initial oid 115 2020-11-16T20:55:52.732 INFO:tasks.rados.rados.0.smithi166.stdout:115: seq_num 114 ranges {715998=607328,1838006=427368,2864574=477480,3863835=52163} 2020-11-16T20:55:52.738 INFO:tasks.rados.rados.0.smithi166.stdout:115: writing smithi16641208-115 from 715998 to 1323326 tid 1 2020-11-16T20:55:52.744 INFO:tasks.rados.rados.0.smithi166.stdout:115: writing smithi16641208-115 from 1838006 to 2265374 tid 2 2020-11-16T20:55:52.744 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:55:52.748+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:55:52.750 INFO:tasks.rados.rados.0.smithi166.stdout:115: writing smithi16641208-115 from 2864574 to 3342054 tid 3 2020-11-16T20:55:52.754 INFO:tasks.rados.rados.0.smithi166.stdout:115: writing smithi16641208-115 from 3863835 to 3915998 tid 4 2020-11-16T20:55:52.754 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.754 INFO:tasks.rados.rados.0.smithi166.stdout:100: finishing write tid 3 to smithi16641208-100 2020-11-16T20:55:52.754 INFO:tasks.rados.rados.0.smithi166.stdout:100: finishing write tid 4 to smithi16641208-100 2020-11-16T20:55:52.754 INFO:tasks.rados.rados.0.smithi166.stdout:100: finishing write tid 5 to smithi16641208-100 2020-11-16T20:55:52.754 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 100 v 87 (ObjNum 99 snap 0 seq_num 99) dirty exists 2020-11-16T20:55:52.755 INFO:tasks.rados.rados.0.smithi166.stdout:100: left oid 100 (ObjNum 99 snap 0 seq_num 99) 2020-11-16T20:55:52.755 INFO:tasks.rados.rados.0.smithi166.stdout:101: finishing write tid 1 to smithi16641208-101 2020-11-16T20:55:52.755 INFO:tasks.rados.rados.0.smithi166.stdout:101: finishing write tid 2 to smithi16641208-101 2020-11-16T20:55:52.755 INFO:tasks.rados.rados.0.smithi166.stdout:101: finishing write tid 3 to smithi16641208-101 2020-11-16T20:55:52.755 INFO:tasks.rados.rados.0.smithi166.stdout:101: finishing write tid 4 to smithi16641208-101 2020-11-16T20:55:52.755 INFO:tasks.rados.rados.0.smithi166.stdout:101: finishing write tid 5 to smithi16641208-101 2020-11-16T20:55:52.755 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 101 v 91 (ObjNum 100 snap 0 seq_num 100) dirty exists 2020-11-16T20:55:52.755 INFO:tasks.rados.rados.0.smithi166.stdout:101: left oid 101 (ObjNum 100 snap 0 seq_num 100) 2020-11-16T20:55:52.756 INFO:tasks.rados.rados.0.smithi166.stdout:102: finishing write tid 1 to smithi16641208-102 2020-11-16T20:55:52.756 INFO:tasks.rados.rados.0.smithi166.stdout:102: finishing write tid 2 to smithi16641208-102 2020-11-16T20:55:52.756 INFO:tasks.rados.rados.0.smithi166.stdout:102: finishing write tid 3 to smithi16641208-102 2020-11-16T20:55:52.756 INFO:tasks.rados.rados.0.smithi166.stdout:102: finishing write tid 4 to smithi16641208-102 2020-11-16T20:55:52.756 INFO:tasks.rados.rados.0.smithi166.stdout:102: finishing write tid 5 to smithi16641208-102 2020-11-16T20:55:52.756 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 102 v 37 (ObjNum 101 snap 0 seq_num 101) dirty exists 2020-11-16T20:55:52.756 INFO:tasks.rados.rados.0.smithi166.stdout:102: left oid 102 (ObjNum 101 snap 0 seq_num 101) 2020-11-16T20:55:52.757 INFO:tasks.rados.rados.0.smithi166.stdout:103: finishing write tid 1 to smithi16641208-103 2020-11-16T20:55:52.757 INFO:tasks.rados.rados.0.smithi166.stdout:100: done (15 left) 2020-11-16T20:55:52.757 INFO:tasks.rados.rados.0.smithi166.stdout:101: done (14 left) 2020-11-16T20:55:52.757 INFO:tasks.rados.rados.0.smithi166.stdout:102: done (13 left) 2020-11-16T20:55:52.757 INFO:tasks.rados.rados.0.smithi166.stdout:116: write initial oid 116 2020-11-16T20:55:52.757 INFO:tasks.rados.rados.0.smithi166.stdout:116: seq_num 115 ranges {732805=798930,2296488=571026,3291997=405105} 2020-11-16T20:55:52.762 INFO:tasks.rados.rados.0.smithi166.stdout:116: writing smithi16641208-116 from 732805 to 1531735 tid 1 2020-11-16T20:55:52.769 INFO:tasks.rados.rados.0.smithi166.stdout:116: writing smithi16641208-116 from 2296488 to 2867514 tid 2 2020-11-16T20:55:52.774 INFO:tasks.rados.rados.0.smithi166.stdout:116: writing smithi16641208-116 from 3291997 to 3697102 tid 3 2020-11-16T20:55:52.774 INFO:tasks.rados.rados.0.smithi166.stdout:117: write initial oid 117 2020-11-16T20:55:52.774 INFO:tasks.rados.rados.0.smithi166.stdout:117: seq_num 116 ranges {749612=474179,1954970=431037,2919420=616377} 2020-11-16T20:55:52.781 INFO:tasks.rados.rados.0.smithi166.stdout:117: writing smithi16641208-117 from 749612 to 1223791 tid 1 2020-11-16T20:55:52.787 INFO:tasks.rados.rados.0.smithi166.stdout:117: writing smithi16641208-117 from 1954970 to 2386007 tid 2 2020-11-16T20:55:52.794 INFO:tasks.rados.rados.0.smithi166.stdout:117: writing smithi16641208-117 from 2919420 to 3535797 tid 3 2020-11-16T20:55:52.794 INFO:tasks.rados.rados.0.smithi166.stdout:118: write initial oid 118 2020-11-16T20:55:52.794 INFO:tasks.rados.rados.0.smithi166.stdout:118: seq_num 117 ranges {766419=549428,2013452=574695,3346843=427649} 2020-11-16T20:55:52.801 INFO:tasks.rados.rados.0.smithi166.stdout:118: writing smithi16641208-118 from 766419 to 1315847 tid 1 2020-11-16T20:55:52.809 INFO:tasks.rados.rados.0.smithi166.stdout:118: writing smithi16641208-118 from 2013452 to 2588147 tid 2 2020-11-16T20:55:52.816 INFO:tasks.rados.rados.0.smithi166.stdout:118: writing smithi16641208-118 from 3346843 to 3774492 tid 3 2020-11-16T20:55:52.816 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.816 INFO:tasks.rados.rados.0.smithi166.stdout:103: finishing write tid 2 to smithi16641208-103 2020-11-16T20:55:52.816 INFO:tasks.rados.rados.0.smithi166.stdout:103: finishing write tid 3 to smithi16641208-103 2020-11-16T20:55:52.817 INFO:tasks.rados.rados.0.smithi166.stdout:103: finishing write tid 4 to smithi16641208-103 2020-11-16T20:55:52.817 INFO:tasks.rados.rados.0.smithi166.stdout:104: finishing write tid 1 to smithi16641208-104 2020-11-16T20:55:52.817 INFO:tasks.rados.rados.0.smithi166.stdout:103: finishing write tid 5 to smithi16641208-103 2020-11-16T20:55:52.817 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 103 v 95 (ObjNum 102 snap 0 seq_num 102) dirty exists 2020-11-16T20:55:52.817 INFO:tasks.rados.rados.0.smithi166.stdout:103: left oid 103 (ObjNum 102 snap 0 seq_num 102) 2020-11-16T20:55:52.817 INFO:tasks.rados.rados.0.smithi166.stdout:104: finishing write tid 2 to smithi16641208-104 2020-11-16T20:55:52.818 INFO:tasks.rados.rados.0.smithi166.stdout:103: done (15 left) 2020-11-16T20:55:52.818 INFO:tasks.rados.rados.0.smithi166.stdout:119: write initial oid 119 2020-11-16T20:55:52.818 INFO:tasks.rados.rados.0.smithi166.stdout:119: seq_num 118 ranges {783226=624677,2071934=434706,2974266=638921} 2020-11-16T20:55:52.823 INFO:tasks.rados.rados.0.smithi166.stdout:119: writing smithi16641208-119 from 783226 to 1407903 tid 1 2020-11-16T20:55:52.827 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:52.827 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:52.829 INFO:tasks.rados.rados.0.smithi166.stdout:119: writing smithi16641208-119 from 2071934 to 2506640 tid 2 2020-11-16T20:55:52.837 INFO:tasks.rados.rados.0.smithi166.stdout:119: writing smithi16641208-119 from 2974266 to 3613187 tid 3 2020-11-16T20:55:52.837 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.837 INFO:tasks.rados.rados.0.smithi166.stdout:104: finishing write tid 3 to smithi16641208-104 2020-11-16T20:55:52.838 INFO:tasks.rados.rados.0.smithi166.stdout:104: finishing write tid 4 to smithi16641208-104 2020-11-16T20:55:52.838 INFO:tasks.rados.rados.0.smithi166.stdout:104: finishing write tid 5 to smithi16641208-104 2020-11-16T20:55:52.838 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 104 v 64 (ObjNum 103 snap 0 seq_num 103) dirty exists 2020-11-16T20:55:52.838 INFO:tasks.rados.rados.0.smithi166.stdout:104: left oid 104 (ObjNum 103 snap 0 seq_num 103) 2020-11-16T20:55:52.838 INFO:tasks.rados.rados.0.smithi166.stdout:105: finishing write tid 1 to smithi16641208-105 2020-11-16T20:55:52.838 INFO:tasks.rados.rados.0.smithi166.stdout:105: finishing write tid 2 to smithi16641208-105 2020-11-16T20:55:52.839 INFO:tasks.rados.rados.0.smithi166.stdout:105: finishing write tid 3 to smithi16641208-105 2020-11-16T20:55:52.839 INFO:tasks.rados.rados.0.smithi166.stdout:105: finishing write tid 4 to smithi16641208-105 2020-11-16T20:55:52.839 INFO:tasks.rados.rados.0.smithi166.stdout:105: finishing write tid 5 to smithi16641208-105 2020-11-16T20:55:52.839 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 105 v 68 (ObjNum 104 snap 0 seq_num 104) dirty exists 2020-11-16T20:55:52.839 INFO:tasks.rados.rados.0.smithi166.stdout:105: left oid 105 (ObjNum 104 snap 0 seq_num 104) 2020-11-16T20:55:52.839 INFO:tasks.rados.rados.0.smithi166.stdout:106: finishing write tid 1 to smithi16641208-106 2020-11-16T20:55:52.839 INFO:tasks.rados.rados.0.smithi166.stdout:106: finishing write tid 2 to smithi16641208-106 2020-11-16T20:55:52.839 INFO:tasks.rados.rados.0.smithi166.stdout:106: finishing write tid 3 to smithi16641208-106 2020-11-16T20:55:52.840 INFO:tasks.rados.rados.0.smithi166.stdout:106: finishing write tid 4 to smithi16641208-106 2020-11-16T20:55:52.840 INFO:tasks.rados.rados.0.smithi166.stdout:106: finishing write tid 5 to smithi16641208-106 2020-11-16T20:55:52.840 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 106 v 41 (ObjNum 105 snap 0 seq_num 105) dirty exists 2020-11-16T20:55:52.840 INFO:tasks.rados.rados.0.smithi166.stdout:106: left oid 106 (ObjNum 105 snap 0 seq_num 105) 2020-11-16T20:55:52.840 INFO:tasks.rados.rados.0.smithi166.stdout:107: finishing write tid 1 to smithi16641208-107 2020-11-16T20:55:52.840 INFO:tasks.rados.rados.0.smithi166.stdout:107: finishing write tid 2 to smithi16641208-107 2020-11-16T20:55:52.840 INFO:tasks.rados.rados.0.smithi166.stdout:107: finishing write tid 3 to smithi16641208-107 2020-11-16T20:55:52.841 INFO:tasks.rados.rados.0.smithi166.stdout:107: finishing write tid 4 to smithi16641208-107 2020-11-16T20:55:52.841 INFO:tasks.rados.rados.0.smithi166.stdout:107: finishing write tid 5 to smithi16641208-107 2020-11-16T20:55:52.841 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 107 v 45 (ObjNum 106 snap 0 seq_num 106) dirty exists 2020-11-16T20:55:52.841 INFO:tasks.rados.rados.0.smithi166.stdout:107: left oid 107 (ObjNum 106 snap 0 seq_num 106) 2020-11-16T20:55:52.841 INFO:tasks.rados.rados.0.smithi166.stdout:108: finishing write tid 1 to smithi16641208-108 2020-11-16T20:55:52.841 INFO:tasks.rados.rados.0.smithi166.stdout:108: finishing write tid 2 to smithi16641208-108 2020-11-16T20:55:52.841 INFO:tasks.rados.rados.0.smithi166.stdout:108: finishing write tid 3 to smithi16641208-108 2020-11-16T20:55:52.841 INFO:tasks.rados.rados.0.smithi166.stdout:108: finishing write tid 4 to smithi16641208-108 2020-11-16T20:55:52.842 INFO:tasks.rados.rados.0.smithi166.stdout:108: finishing write tid 5 to smithi16641208-108 2020-11-16T20:55:52.842 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 108 v 98 (ObjNum 107 snap 0 seq_num 107) dirty exists 2020-11-16T20:55:52.842 INFO:tasks.rados.rados.0.smithi166.stdout:108: left oid 108 (ObjNum 107 snap 0 seq_num 107) 2020-11-16T20:55:52.842 INFO:tasks.rados.rados.0.smithi166.stdout:104: done (15 left) 2020-11-16T20:55:52.842 INFO:tasks.rados.rados.0.smithi166.stdout:105: done (14 left) 2020-11-16T20:55:52.842 INFO:tasks.rados.rados.0.smithi166.stdout:106: done (13 left) 2020-11-16T20:55:52.842 INFO:tasks.rados.rados.0.smithi166.stdout:107: done (12 left) 2020-11-16T20:55:52.843 INFO:tasks.rados.rados.0.smithi166.stdout:108: done (11 left) 2020-11-16T20:55:52.843 INFO:tasks.rados.rados.0.smithi166.stdout:120: write initial oid 120 2020-11-16T20:55:52.843 INFO:tasks.rados.rados.0.smithi166.stdout:120: seq_num 119 ranges {400033=699926,1614063=385970} 2020-11-16T20:55:52.844 INFO:tasks.rados.rados.0.smithi166.stdout:120: writing smithi16641208-120 from 400033 to 1099959 tid 1 2020-11-16T20:55:52.844 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:55:52.845 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:55:52.849+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:55:52.848 INFO:tasks.rados.rados.0.smithi166.stdout:120: writing smithi16641208-120 from 1614063 to 2000033 tid 2 2020-11-16T20:55:52.848 INFO:tasks.rados.rados.0.smithi166.stdout:121: write initial oid 121 2020-11-16T20:55:52.848 INFO:tasks.rados.rados.0.smithi166.stdout:121: seq_num 120 ranges {416840=775175,1672545=344295} 2020-11-16T20:55:52.855 INFO:tasks.rados.rados.0.smithi166.stdout:121: writing smithi16641208-121 from 416840 to 1192015 tid 1 2020-11-16T20:55:52.859 INFO:tasks.rados.rados.0.smithi166.stdout:121: writing smithi16641208-121 from 1672545 to 2016840 tid 2 2020-11-16T20:55:52.860 INFO:tasks.rados.rados.0.smithi166.stdout:122: write initial oid 122 2020-11-16T20:55:52.860 INFO:tasks.rados.rados.0.smithi166.stdout:122: seq_num 121 ranges {433647=450424,1331027=582033} 2020-11-16T20:55:52.865 INFO:tasks.rados.rados.0.smithi166.stdout:122: writing smithi16641208-122 from 433647 to 884071 tid 1 2020-11-16T20:55:52.871 INFO:tasks.rados.rados.0.smithi166.stdout:122: writing smithi16641208-122 from 1331027 to 1913060 tid 2 2020-11-16T20:55:52.871 INFO:tasks.rados.rados.0.smithi166.stdout:123: write initial oid 123 2020-11-16T20:55:52.871 INFO:tasks.rados.rados.0.smithi166.stdout:123: seq_num 122 ranges {450454=642026,1505862=544592} 2020-11-16T20:55:52.877 INFO:tasks.rados.rados.0.smithi166.stdout:123: writing smithi16641208-123 from 450454 to 1092480 tid 1 2020-11-16T20:55:52.883 INFO:tasks.rados.rados.0.smithi166.stdout:123: writing smithi16641208-123 from 1505862 to 2050454 tid 2 2020-11-16T20:55:52.884 INFO:tasks.rados.rados.0.smithi166.stdout:124: write initial oid 124 2020-11-16T20:55:52.884 INFO:tasks.rados.rados.0.smithi166.stdout:109: finishing write tid 1 to smithi16641208-109 2020-11-16T20:55:52.884 INFO:tasks.rados.rados.0.smithi166.stdout:124: seq_num 123 ranges {467261=717275,1847991=219270} 2020-11-16T20:55:52.890 INFO:tasks.rados.rados.0.smithi166.stdout:124: writing smithi16641208-124 from 467261 to 1184536 tid 1 2020-11-16T20:55:52.894 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:55:52.894 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:55:52.894 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2020-11-16T20:55:52.894 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 0.05 2020-11-16T20:55:52.895 INFO:tasks.rados.rados.0.smithi166.stdout:124: writing smithi16641208-124 from 1847991 to 2067261 tid 2 2020-11-16T20:55:52.896 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.896 INFO:tasks.rados.rados.0.smithi166.stdout:109: finishing write tid 2 to smithi16641208-109 2020-11-16T20:55:52.896 INFO:tasks.rados.rados.0.smithi166.stdout:109: finishing write tid 3 to smithi16641208-109 2020-11-16T20:55:52.896 INFO:tasks.rados.rados.0.smithi166.stdout:109: finishing write tid 4 to smithi16641208-109 2020-11-16T20:55:52.896 INFO:tasks.rados.rados.0.smithi166.stdout:109: finishing write tid 5 to smithi16641208-109 2020-11-16T20:55:52.896 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 109 v 101 (ObjNum 108 snap 0 seq_num 108) dirty exists 2020-11-16T20:55:52.897 INFO:tasks.rados.rados.0.smithi166.stdout:109: left oid 109 (ObjNum 108 snap 0 seq_num 108) 2020-11-16T20:55:52.897 INFO:tasks.rados.rados.0.smithi166.stdout:110: finishing write tid 1 to smithi16641208-110 2020-11-16T20:55:52.897 INFO:tasks.rados.rados.0.smithi166.stdout:110: finishing write tid 2 to smithi16641208-110 2020-11-16T20:55:52.897 INFO:tasks.rados.rados.0.smithi166.stdout:110: finishing write tid 3 to smithi16641208-110 2020-11-16T20:55:52.897 INFO:tasks.rados.rados.0.smithi166.stdout:109: done (15 left) 2020-11-16T20:55:52.897 INFO:tasks.rados.rados.0.smithi166.stdout:125: write initial oid 125 2020-11-16T20:55:52.897 INFO:tasks.rados.rados.0.smithi166.stdout:125: seq_num 124 ranges {484068=792524,1906473=177595} 2020-11-16T20:55:52.904 INFO:tasks.rados.rados.0.smithi166.stdout:125: writing smithi16641208-125 from 484068 to 1276592 tid 1 2020-11-16T20:55:52.909 INFO:tasks.rados.rados.0.smithi166.stdout:125: writing smithi16641208-125 from 1906473 to 2084068 tid 2 2020-11-16T20:55:52.909 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:52.909 INFO:tasks.rados.rados.0.smithi166.stdout:110: finishing write tid 4 to smithi16641208-110 2020-11-16T20:55:52.909 INFO:tasks.rados.rados.0.smithi166.stdout:111: finishing write tid 1 to smithi16641208-111 2020-11-16T20:55:52.909 INFO:tasks.rados.rados.0.smithi166.stdout:110: finishing write tid 5 to smithi16641208-110 2020-11-16T20:55:52.909 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 110 v 103 (ObjNum 109 snap 0 seq_num 109) dirty exists 2020-11-16T20:55:52.910 INFO:tasks.rados.rados.0.smithi166.stdout:110: left oid 110 (ObjNum 109 snap 0 seq_num 109) 2020-11-16T20:55:52.910 INFO:tasks.rados.rados.0.smithi166.stdout:111: finishing write tid 2 to smithi16641208-111 2020-11-16T20:55:52.910 INFO:tasks.rados.rados.0.smithi166.stdout:111: finishing write tid 3 to smithi16641208-111 2020-11-16T20:55:52.910 INFO:tasks.rados.rados.0.smithi166.stdout:111: finishing write tid 4 to smithi16641208-111 2020-11-16T20:55:52.910 INFO:tasks.rados.rados.0.smithi166.stdout:111: finishing write tid 5 to smithi16641208-111 2020-11-16T20:55:52.910 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 111 v 49 (ObjNum 110 snap 0 seq_num 110) dirty exists 2020-11-16T20:55:52.911 INFO:tasks.rados.rados.0.smithi166.stdout:111: left oid 111 (ObjNum 110 snap 0 seq_num 110) 2020-11-16T20:55:52.911 INFO:tasks.rados.rados.0.smithi166.stdout:112: finishing write tid 1 to smithi16641208-112 2020-11-16T20:55:52.911 INFO:tasks.rados.rados.0.smithi166.stdout:112: finishing write tid 2 to smithi16641208-112 2020-11-16T20:55:52.911 INFO:tasks.rados.rados.0.smithi166.stdout:112: finishing write tid 3 to smithi16641208-112 2020-11-16T20:55:52.911 INFO:tasks.rados.rados.0.smithi166.stdout:112: finishing write tid 4 to smithi16641208-112 2020-11-16T20:55:52.911 INFO:tasks.rados.rados.0.smithi166.stdout:112: finishing write tid 5 to smithi16641208-112 2020-11-16T20:55:52.912 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 112 v 52 (ObjNum 111 snap 0 seq_num 111) dirty exists 2020-11-16T20:55:52.912 INFO:tasks.rados.rados.0.smithi166.stdout:112: left oid 112 (ObjNum 111 snap 0 seq_num 111) 2020-11-16T20:55:52.912 INFO:tasks.rados.rados.0.smithi166.stdout:113: finishing write tid 1 to smithi16641208-113 2020-11-16T20:55:52.912 INFO:tasks.rados.rados.0.smithi166.stdout:113: finishing write tid 2 to smithi16641208-113 2020-11-16T20:55:52.912 INFO:tasks.rados.rados.0.smithi166.stdout:113: finishing write tid 3 to smithi16641208-113 2020-11-16T20:55:52.912 INFO:tasks.rados.rados.0.smithi166.stdout:113: finishing write tid 4 to smithi16641208-113 2020-11-16T20:55:52.913 INFO:tasks.rados.rados.0.smithi166.stdout:113: finishing write tid 5 to smithi16641208-113 2020-11-16T20:55:52.913 INFO:tasks.rados.rados.0.smithi166.stdout:113: finishing write tid 6 to smithi16641208-113 2020-11-16T20:55:52.913 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 113 v 54 (ObjNum 112 snap 0 seq_num 112) dirty exists 2020-11-16T20:55:52.913 INFO:tasks.rados.rados.0.smithi166.stdout:113: left oid 113 (ObjNum 112 snap 0 seq_num 112) 2020-11-16T20:55:52.913 INFO:tasks.rados.rados.0.smithi166.stdout:114: finishing write tid 1 to smithi16641208-114 2020-11-16T20:55:52.913 INFO:tasks.rados.rados.0.smithi166.stdout:114: finishing write tid 2 to smithi16641208-114 2020-11-16T20:55:52.913 INFO:tasks.rados.rados.0.smithi166.stdout:114: finishing write tid 3 to smithi16641208-114 2020-11-16T20:55:52.914 INFO:tasks.rados.rados.0.smithi166.stdout:114: finishing write tid 4 to smithi16641208-114 2020-11-16T20:55:52.914 INFO:tasks.rados.rados.0.smithi166.stdout:114: finishing write tid 5 to smithi16641208-114 2020-11-16T20:55:52.914 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 114 v 56 (ObjNum 113 snap 0 seq_num 113) dirty exists 2020-11-16T20:55:52.914 INFO:tasks.rados.rados.0.smithi166.stdout:114: left oid 114 (ObjNum 113 snap 0 seq_num 113) 2020-11-16T20:55:52.914 INFO:tasks.rados.rados.0.smithi166.stdout:115: finishing write tid 1 to smithi16641208-115 2020-11-16T20:55:52.914 INFO:tasks.rados.rados.0.smithi166.stdout:115: finishing write tid 2 to smithi16641208-115 2020-11-16T20:55:52.915 INFO:tasks.rados.rados.0.smithi166.stdout:115: finishing write tid 3 to smithi16641208-115 2020-11-16T20:55:52.915 INFO:tasks.rados.rados.0.smithi166.stdout:115: finishing write tid 4 to smithi16641208-115 2020-11-16T20:55:52.915 INFO:tasks.rados.rados.0.smithi166.stdout:115: finishing write tid 5 to smithi16641208-115 2020-11-16T20:55:52.915 INFO:tasks.rados.rados.0.smithi166.stdout:115: finishing write tid 6 to smithi16641208-115 2020-11-16T20:55:52.915 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 115 v 59 (ObjNum 114 snap 0 seq_num 114) dirty exists 2020-11-16T20:55:52.916 INFO:tasks.rados.rados.0.smithi166.stdout:115: left oid 115 (ObjNum 114 snap 0 seq_num 114) 2020-11-16T20:55:52.916 INFO:tasks.rados.rados.0.smithi166.stdout:116: finishing write tid 1 to smithi16641208-116 2020-11-16T20:55:52.916 INFO:tasks.rados.rados.0.smithi166.stdout:116: finishing write tid 2 to smithi16641208-116 2020-11-16T20:55:52.916 INFO:tasks.rados.rados.0.smithi166.stdout:116: finishing write tid 3 to smithi16641208-116 2020-11-16T20:55:52.916 INFO:tasks.rados.rados.0.smithi166.stdout:117: finishing write tid 1 to smithi16641208-117 2020-11-16T20:55:52.916 INFO:tasks.rados.rados.0.smithi166.stdout:117: finishing write tid 2 to smithi16641208-117 2020-11-16T20:55:52.917 INFO:tasks.rados.rados.0.smithi166.stdout:117: finishing write tid 3 to smithi16641208-117 2020-11-16T20:55:52.917 INFO:tasks.rados.rados.0.smithi166.stdout:117: finishing write tid 4 to smithi16641208-117 2020-11-16T20:55:52.917 INFO:tasks.rados.rados.0.smithi166.stdout:118: finishing write tid 1 to smithi16641208-118 2020-11-16T20:55:52.917 INFO:tasks.rados.rados.0.smithi166.stdout:117: finishing write tid 5 to smithi16641208-117 2020-11-16T20:55:52.917 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 117 v 72 (ObjNum 116 snap 0 seq_num 116) dirty exists 2020-11-16T20:55:52.918 INFO:tasks.rados.rados.0.smithi166.stdout:117: left oid 117 (ObjNum 116 snap 0 seq_num 116) 2020-11-16T20:55:52.918 INFO:tasks.rados.rados.0.smithi166.stdout:116: finishing write tid 4 to smithi16641208-116 2020-11-16T20:55:52.918 INFO:tasks.rados.rados.0.smithi166.stdout:116: finishing write tid 5 to smithi16641208-116 2020-11-16T20:55:52.918 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 116 v 63 (ObjNum 115 snap 0 seq_num 115) dirty exists 2020-11-16T20:55:52.918 INFO:tasks.rados.rados.0.smithi166.stdout:116: left oid 116 (ObjNum 115 snap 0 seq_num 115) 2020-11-16T20:55:52.918 INFO:tasks.rados.rados.0.smithi166.stdout:118: finishing write tid 2 to smithi16641208-118 2020-11-16T20:55:52.918 INFO:tasks.rados.rados.0.smithi166.stdout:118: finishing write tid 3 to smithi16641208-118 2020-11-16T20:55:52.919 INFO:tasks.rados.rados.0.smithi166.stdout:118: finishing write tid 4 to smithi16641208-118 2020-11-16T20:55:52.919 INFO:tasks.rados.rados.0.smithi166.stdout:118: finishing write tid 5 to smithi16641208-118 2020-11-16T20:55:52.919 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 118 v 101 (ObjNum 117 snap 0 seq_num 117) dirty exists 2020-11-16T20:55:52.919 INFO:tasks.rados.rados.0.smithi166.stdout:118: left oid 118 (ObjNum 117 snap 0 seq_num 117) 2020-11-16T20:55:52.919 INFO:tasks.rados.rados.0.smithi166.stdout:119: finishing write tid 1 to smithi16641208-119 2020-11-16T20:55:52.919 INFO:tasks.rados.rados.0.smithi166.stdout:119: finishing write tid 2 to smithi16641208-119 2020-11-16T20:55:52.919 INFO:tasks.rados.rados.0.smithi166.stdout:119: finishing write tid 3 to smithi16641208-119 2020-11-16T20:55:52.920 INFO:tasks.rados.rados.0.smithi166.stdout:119: finishing write tid 4 to smithi16641208-119 2020-11-16T20:55:52.920 INFO:tasks.rados.rados.0.smithi166.stdout:119: finishing write tid 5 to smithi16641208-119 2020-11-16T20:55:52.920 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 119 v 74 (ObjNum 118 snap 0 seq_num 118) dirty exists 2020-11-16T20:55:52.920 INFO:tasks.rados.rados.0.smithi166.stdout:119: left oid 119 (ObjNum 118 snap 0 seq_num 118) 2020-11-16T20:55:52.920 INFO:tasks.rados.rados.0.smithi166.stdout:120: finishing write tid 1 to smithi16641208-120 2020-11-16T20:55:52.920 INFO:tasks.rados.rados.0.smithi166.stdout:120: finishing write tid 2 to smithi16641208-120 2020-11-16T20:55:52.920 INFO:tasks.rados.rados.0.smithi166.stdout:120: finishing write tid 3 to smithi16641208-120 2020-11-16T20:55:52.920 INFO:tasks.rados.rados.0.smithi166.stdout:120: finishing write tid 4 to smithi16641208-120 2020-11-16T20:55:52.921 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 120 v 76 (ObjNum 119 snap 0 seq_num 119) dirty exists 2020-11-16T20:55:52.921 INFO:tasks.rados.rados.0.smithi166.stdout:120: left oid 120 (ObjNum 119 snap 0 seq_num 119) 2020-11-16T20:55:52.921 INFO:tasks.rados.rados.0.smithi166.stdout:121: finishing write tid 1 to smithi16641208-121 2020-11-16T20:55:52.921 INFO:tasks.rados.rados.0.smithi166.stdout:121: finishing write tid 2 to smithi16641208-121 2020-11-16T20:55:52.921 INFO:tasks.rados.rados.0.smithi166.stdout:121: finishing write tid 3 to smithi16641208-121 2020-11-16T20:55:52.921 INFO:tasks.rados.rados.0.smithi166.stdout:122: finishing write tid 1 to smithi16641208-122 2020-11-16T20:55:52.921 INFO:tasks.rados.rados.0.smithi166.stdout:121: finishing write tid 4 to smithi16641208-121 2020-11-16T20:55:52.922 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 121 v 75 (ObjNum 120 snap 0 seq_num 120) dirty exists 2020-11-16T20:55:52.922 INFO:tasks.rados.rados.0.smithi166.stdout:121: left oid 121 (ObjNum 120 snap 0 seq_num 120) 2020-11-16T20:55:52.922 INFO:tasks.rados.rados.0.smithi166.stdout:122: finishing write tid 2 to smithi16641208-122 2020-11-16T20:55:52.922 INFO:tasks.rados.rados.0.smithi166.stdout:122: finishing write tid 3 to smithi16641208-122 2020-11-16T20:55:52.922 INFO:tasks.rados.rados.0.smithi166.stdout:122: finishing write tid 4 to smithi16641208-122 2020-11-16T20:55:52.922 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 122 v 104 (ObjNum 121 snap 0 seq_num 121) dirty exists 2020-11-16T20:55:52.922 INFO:tasks.rados.rados.0.smithi166.stdout:122: left oid 122 (ObjNum 121 snap 0 seq_num 121) 2020-11-16T20:55:52.922 INFO:tasks.rados.rados.0.smithi166.stdout:123: finishing write tid 1 to smithi16641208-123 2020-11-16T20:55:52.923 INFO:tasks.rados.rados.0.smithi166.stdout:123: finishing write tid 2 to smithi16641208-123 2020-11-16T20:55:52.923 INFO:tasks.rados.rados.0.smithi166.stdout:123: finishing write tid 3 to smithi16641208-123 2020-11-16T20:55:52.923 INFO:tasks.rados.rados.0.smithi166.stdout:123: finishing write tid 4 to smithi16641208-123 2020-11-16T20:55:52.923 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 123 v 78 (ObjNum 122 snap 0 seq_num 122) dirty exists 2020-11-16T20:55:52.923 INFO:tasks.rados.rados.0.smithi166.stdout:123: left oid 123 (ObjNum 122 snap 0 seq_num 122) 2020-11-16T20:55:52.923 INFO:tasks.rados.rados.0.smithi166.stdout:124: finishing write tid 1 to smithi16641208-124 2020-11-16T20:55:52.924 INFO:tasks.rados.rados.0.smithi166.stdout:110: done (15 left) 2020-11-16T20:55:52.924 INFO:tasks.rados.rados.0.smithi166.stdout:111: done (14 left) 2020-11-16T20:55:52.925 INFO:tasks.rados.rados.0.smithi166.stdout:112: done (13 left) 2020-11-16T20:55:52.925 INFO:tasks.rados.rados.0.smithi166.stdout:113: done (12 left) 2020-11-16T20:55:52.925 INFO:tasks.rados.rados.0.smithi166.stdout:114: done (11 left) 2020-11-16T20:55:52.925 INFO:tasks.rados.rados.0.smithi166.stdout:115: done (10 left) 2020-11-16T20:55:52.925 INFO:tasks.rados.rados.0.smithi166.stdout:116: done (9 left) 2020-11-16T20:55:52.925 INFO:tasks.rados.rados.0.smithi166.stdout:117: done (8 left) 2020-11-16T20:55:52.925 INFO:tasks.rados.rados.0.smithi166.stdout:118: done (7 left) 2020-11-16T20:55:52.926 INFO:tasks.rados.rados.0.smithi166.stdout:119: done (6 left) 2020-11-16T20:55:52.926 INFO:tasks.rados.rados.0.smithi166.stdout:120: done (5 left) 2020-11-16T20:55:52.926 INFO:tasks.rados.rados.0.smithi166.stdout:121: done (4 left) 2020-11-16T20:55:52.926 INFO:tasks.rados.rados.0.smithi166.stdout:122: done (3 left) 2020-11-16T20:55:52.926 INFO:tasks.rados.rados.0.smithi166.stdout:123: done (2 left) 2020-11-16T20:55:52.926 INFO:tasks.rados.rados.0.smithi166.stdout:126: write initial oid 126 2020-11-16T20:55:52.926 INFO:tasks.rados.rados.0.smithi166.stdout:126: seq_num 125 ranges {500875=467773,1564955=535920} 2020-11-16T20:55:52.927 INFO:tasks.rados.rados.0.smithi166.stdout:126: writing smithi16641208-126 from 500875 to 968648 tid 1 2020-11-16T20:55:52.927 INFO:tasks.rados.rados.0.smithi166.stdout:126: writing smithi16641208-126 from 1564955 to 2100875 tid 2 2020-11-16T20:55:52.927 INFO:tasks.rados.rados.0.smithi166.stdout:127: write initial oid 127 2020-11-16T20:55:52.927 INFO:tasks.rados.rados.0.smithi166.stdout:127: seq_num 126 ranges {517682=543022,1623437=494245} 2020-11-16T20:55:52.927 INFO:teuthology.orchestra.run.smithi166.stderr:nodeep-scrub is set 2020-11-16T20:55:52.929 INFO:tasks.rados.rados.0.smithi166.stdout:127: writing smithi16641208-127 from 517682 to 1060704 tid 1 2020-11-16T20:55:52.936 INFO:tasks.rados.rados.0.smithi166.stdout:127: writing smithi16641208-127 from 1623437 to 2117682 tid 2 2020-11-16T20:55:52.936 INFO:tasks.rados.rados.0.smithi166.stdout:128: write initial oid 128 2020-11-16T20:55:52.936 INFO:tasks.rados.rados.0.smithi166.stdout:128: seq_num 127 ranges {534489=618271,1565566=568923} 2020-11-16T20:55:52.942 INFO:tasks.rados.rados.0.smithi166.stdout:128: writing smithi16641208-128 from 534489 to 1152760 tid 1 2020-11-16T20:55:52.946 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:55:52.949+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:55:52.948 INFO:tasks.rados.rados.0.smithi166.stdout:128: writing smithi16641208-128 from 1565566 to 2134489 tid 2 2020-11-16T20:55:52.949 INFO:tasks.rados.rados.0.smithi166.stdout:129: write initial oid 129 2020-11-16T20:55:52.949 INFO:tasks.rados.rados.0.smithi166.stdout:124: finishing write tid 2 to smithi16641208-124 2020-11-16T20:55:52.949 INFO:tasks.rados.rados.0.smithi166.stdout:129: seq_num 128 ranges {551296=693520,2024048=127248} 2020-11-16T20:55:52.956 INFO:tasks.rados.rados.0.smithi166.stdout:129: writing smithi16641208-129 from 551296 to 1244816 tid 1 2020-11-16T20:55:52.961 INFO:tasks.rados.rados.0.smithi166.stdout:129: writing smithi16641208-129 from 2024048 to 2151296 tid 2 2020-11-16T20:55:52.961 INFO:tasks.rados.rados.0.smithi166.stdout:130: write initial oid 130 2020-11-16T20:55:52.961 INFO:tasks.rados.rados.0.smithi166.stdout:130: seq_num 129 ranges {568103=768769,2082530=85573} 2020-11-16T20:55:52.968 INFO:tasks.rados.rados.0.smithi166.stdout:130: writing smithi16641208-130 from 568103 to 1336872 tid 1 2020-11-16T20:55:52.973 INFO:tasks.rados.rados.0.smithi166.stdout:130: writing smithi16641208-130 from 2082530 to 2168103 tid 2 2020-11-16T20:55:52.973 INFO:tasks.rados.rados.0.smithi166.stdout:131: write initial oid 131 2020-11-16T20:55:52.973 INFO:tasks.rados.rados.0.smithi166.stdout:131: seq_num 130 ranges {584910=560371,1857365=327545} 2020-11-16T20:55:52.979 INFO:tasks.rados.rados.0.smithi166.stdout:131: writing smithi16641208-131 from 584910 to 1145281 tid 1 2020-11-16T20:55:52.986 INFO:tasks.rados.rados.0.smithi166.stdout:131: writing smithi16641208-131 from 1857365 to 2184910 tid 2 2020-11-16T20:55:52.986 INFO:tasks.rados.rados.0.smithi166.stdout:132: write initial oid 132 2020-11-16T20:55:52.986 INFO:tasks.rados.rados.0.smithi166.stdout:132: seq_num 131 ranges {601717=635620,1799494=402223} 2020-11-16T20:55:52.993 INFO:tasks.rados.rados.0.smithi166.stdout:132: writing smithi16641208-132 from 601717 to 1237337 tid 1 2020-11-16T20:55:52.999 INFO:tasks.rados.rados.0.smithi166.stdout:132: writing smithi16641208-132 from 1799494 to 2201717 tid 2 2020-11-16T20:55:53.000 INFO:tasks.rados.rados.0.smithi166.stdout:133: write initial oid 133 2020-11-16T20:55:53.000 INFO:tasks.rados.rados.0.smithi166.stdout:133: seq_num 132 ranges {618524=710869,1857976=360548} 2020-11-16T20:55:53.007 INFO:tasks.rados.rados.0.smithi166.stdout:133: writing smithi16641208-133 from 618524 to 1329393 tid 1 2020-11-16T20:55:53.012 INFO:tasks.rados.rados.0.smithi166.stdout:133: writing smithi16641208-133 from 1857976 to 2218524 tid 2 2020-11-16T20:55:53.012 INFO:tasks.rados.rados.0.smithi166.stdout:134: write initial oid 134 2020-11-16T20:55:53.013 INFO:tasks.rados.rados.0.smithi166.stdout:134: seq_num 133 ranges {635331=786118,1916458=318873} 2020-11-16T20:55:53.020 INFO:tasks.rados.rados.0.smithi166.stdout:134: writing smithi16641208-134 from 635331 to 1421449 tid 1 2020-11-16T20:55:53.025 INFO:tasks.rados.rados.0.smithi166.stdout:134: writing smithi16641208-134 from 1916458 to 2235331 tid 2 2020-11-16T20:55:53.025 INFO:tasks.rados.rados.0.smithi166.stdout:135: write initial oid 135 2020-11-16T20:55:53.025 INFO:tasks.rados.rados.0.smithi166.stdout:135: seq_num 134 ranges {652138=461367,1574940=677198} 2020-11-16T20:55:53.031 INFO:tasks.rados.rados.0.smithi166.stdout:135: writing smithi16641208-135 from 652138 to 1113505 tid 1 2020-11-16T20:55:53.036 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:53.036 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:53.038 INFO:tasks.rados.rados.0.smithi166.stdout:135: writing smithi16641208-135 from 1574940 to 2252138 tid 2 2020-11-16T20:55:53.038 INFO:tasks.rados.rados.0.smithi166.stdout:136: write initial oid 136 2020-11-16T20:55:53.038 INFO:tasks.rados.rados.0.smithi166.stdout:136: seq_num 135 ranges {668945=536616,1633422=491363} 2020-11-16T20:55:53.045 INFO:tasks.rados.rados.0.smithi166.stdout:136: writing smithi16641208-136 from 668945 to 1205561 tid 1 2020-11-16T20:55:53.047 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:55:53.051+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:55:53.048 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:55:53.050 INFO:tasks.rados.rados.0.smithi166.stdout:136: writing smithi16641208-136 from 1633422 to 2124785 tid 2 2020-11-16T20:55:53.051 INFO:tasks.rados.rados.0.smithi166.stdout:137: write initial oid 137 2020-11-16T20:55:53.051 INFO:tasks.rados.rados.0.smithi166.stdout:137: seq_num 136 ranges {685752=611865,1975551=310201} 2020-11-16T20:55:53.058 INFO:tasks.rados.rados.0.smithi166.stdout:137: writing smithi16641208-137 from 685752 to 1297617 tid 1 2020-11-16T20:55:53.063 INFO:tasks.rados.rados.0.smithi166.stdout:137: writing smithi16641208-137 from 1975551 to 2285752 tid 2 2020-11-16T20:55:53.064 INFO:tasks.rados.rados.0.smithi166.stdout:138: write initial oid 138 2020-11-16T20:55:53.064 INFO:tasks.rados.rados.0.smithi166.stdout:138: seq_num 137 ranges {702559=403467,1750386=495032} 2020-11-16T20:55:53.070 INFO:tasks.rados.rados.0.smithi166.stdout:138: writing smithi16641208-138 from 702559 to 1106026 tid 1 2020-11-16T20:55:53.077 INFO:tasks.rados.rados.0.smithi166.stdout:138: writing smithi16641208-138 from 1750386 to 2245418 tid 2 2020-11-16T20:55:53.077 INFO:tasks.rados.rados.0.smithi166.stdout:139: write initial oid 139 2020-11-16T20:55:53.077 INFO:tasks.rados.rados.0.smithi166.stdout:139: seq_num 138 ranges {719366=478716,1808868=510498} 2020-11-16T20:55:53.084 INFO:tasks.rados.rados.0.smithi166.stdout:139: writing smithi16641208-139 from 719366 to 1198082 tid 1 2020-11-16T20:55:53.091 INFO:tasks.rados.rados.0.smithi166.stdout:139: writing smithi16641208-139 from 1808868 to 2319366 tid 2 2020-11-16T20:55:53.091 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.091 INFO:tasks.rados.rados.0.smithi166.stdout:124: finishing write tid 3 to smithi16641208-124 2020-11-16T20:55:53.092 INFO:tasks.rados.rados.0.smithi166.stdout:124: finishing write tid 4 to smithi16641208-124 2020-11-16T20:55:53.092 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 124 v 59 (ObjNum 123 snap 0 seq_num 123) dirty exists 2020-11-16T20:55:53.092 INFO:tasks.rados.rados.0.smithi166.stdout:124: left oid 124 (ObjNum 123 snap 0 seq_num 123) 2020-11-16T20:55:53.092 INFO:tasks.rados.rados.0.smithi166.stdout:125: finishing write tid 1 to smithi16641208-125 2020-11-16T20:55:53.092 INFO:tasks.rados.rados.0.smithi166.stdout:126: finishing write tid 1 to smithi16641208-126 2020-11-16T20:55:53.092 INFO:tasks.rados.rados.0.smithi166.stdout:126: finishing write tid 2 to smithi16641208-126 2020-11-16T20:55:53.092 INFO:tasks.rados.rados.0.smithi166.stdout:126: finishing write tid 3 to smithi16641208-126 2020-11-16T20:55:53.093 INFO:tasks.rados.rados.0.smithi166.stdout:126: finishing write tid 4 to smithi16641208-126 2020-11-16T20:55:53.093 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 126 v 107 (ObjNum 125 snap 0 seq_num 125) dirty exists 2020-11-16T20:55:53.093 INFO:tasks.rados.rados.0.smithi166.stdout:126: left oid 126 (ObjNum 125 snap 0 seq_num 125) 2020-11-16T20:55:53.093 INFO:tasks.rados.rados.0.smithi166.stdout:125: finishing write tid 2 to smithi16641208-125 2020-11-16T20:55:53.093 INFO:tasks.rados.rados.0.smithi166.stdout:125: finishing write tid 3 to smithi16641208-125 2020-11-16T20:55:53.093 INFO:tasks.rados.rados.0.smithi166.stdout:125: finishing write tid 4 to smithi16641208-125 2020-11-16T20:55:53.093 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 125 v 61 (ObjNum 124 snap 0 seq_num 124) dirty exists 2020-11-16T20:55:53.094 INFO:tasks.rados.rados.0.smithi166.stdout:125: left oid 125 (ObjNum 124 snap 0 seq_num 124) 2020-11-16T20:55:53.094 INFO:tasks.rados.rados.0.smithi166.stdout:124: done (15 left) 2020-11-16T20:55:53.094 INFO:tasks.rados.rados.0.smithi166.stdout:125: done (14 left) 2020-11-16T20:55:53.094 INFO:tasks.rados.rados.0.smithi166.stdout:126: done (13 left) 2020-11-16T20:55:53.094 INFO:tasks.rados.rados.0.smithi166.stdout:140: write initial oid 140 2020-11-16T20:55:53.094 INFO:tasks.rados.rados.0.smithi166.stdout:140: seq_num 139 ranges {736173=553965,1867350=468823} 2020-11-16T20:55:53.098 INFO:tasks.rados.rados.0.smithi166.stdout:140: writing smithi16641208-140 from 736173 to 1290138 tid 1 2020-11-16T20:55:53.105 INFO:tasks.rados.rados.0.smithi166.stdout:140: writing smithi16641208-140 from 1867350 to 2336173 tid 2 2020-11-16T20:55:53.105 INFO:tasks.rados.rados.0.smithi166.stdout:141: write initial oid 141 2020-11-16T20:55:53.105 INFO:tasks.rados.rados.0.smithi166.stdout:127: finishing write tid 1 to smithi16641208-127 2020-11-16T20:55:53.105 INFO:tasks.rados.rados.0.smithi166.stdout:141: seq_num 140 ranges {752980=629214,1809479=543501} 2020-11-16T20:55:53.113 INFO:tasks.rados.rados.0.smithi166.stdout:141: writing smithi16641208-141 from 752980 to 1382194 tid 1 2020-11-16T20:55:53.119 INFO:tasks.rados.rados.0.smithi166.stdout:141: writing smithi16641208-141 from 1809479 to 2352980 tid 2 2020-11-16T20:55:53.120 INFO:tasks.rados.rados.0.smithi166.stdout:142: write initial oid 142 2020-11-16T20:55:53.120 INFO:tasks.rados.rados.0.smithi166.stdout:142: seq_num 141 ranges {769787=704463,2267961=101826} 2020-11-16T20:55:53.128 INFO:tasks.rados.rados.0.smithi166.stdout:142: writing smithi16641208-142 from 769787 to 1474250 tid 1 2020-11-16T20:55:53.133 INFO:tasks.rados.rados.0.smithi166.stdout:142: writing smithi16641208-142 from 2267961 to 2369787 tid 2 2020-11-16T20:55:53.134 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.134 INFO:tasks.rados.rados.0.smithi166.stdout:127: finishing write tid 2 to smithi16641208-127 2020-11-16T20:55:53.134 INFO:tasks.rados.rados.0.smithi166.stdout:127: finishing write tid 3 to smithi16641208-127 2020-11-16T20:55:53.134 INFO:tasks.rados.rados.0.smithi166.stdout:127: finishing write tid 4 to smithi16641208-127 2020-11-16T20:55:53.134 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 127 v 63 (ObjNum 126 snap 0 seq_num 126) dirty exists 2020-11-16T20:55:53.134 INFO:tasks.rados.rados.0.smithi166.stdout:127: left oid 127 (ObjNum 126 snap 0 seq_num 126) 2020-11-16T20:55:53.134 INFO:tasks.rados.rados.0.smithi166.stdout:128: finishing write tid 1 to smithi16641208-128 2020-11-16T20:55:53.135 INFO:tasks.rados.rados.0.smithi166.stdout:127: done (15 left) 2020-11-16T20:55:53.135 INFO:tasks.rados.rados.0.smithi166.stdout:143: write initial oid 143 2020-11-16T20:55:53.135 INFO:tasks.rados.rados.0.smithi166.stdout:143: seq_num 142 ranges {786594=779712,2326443=60151} 2020-11-16T20:55:53.143 INFO:tasks.rados.rados.0.smithi166.stdout:143: writing smithi16641208-143 from 786594 to 1566306 tid 1 2020-11-16T20:55:53.148 INFO:tasks.rados.rados.0.smithi166.stdout:143: writing smithi16641208-143 from 2326443 to 2386594 tid 2 2020-11-16T20:55:53.148 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.148 INFO:tasks.rados.rados.0.smithi166.stdout:128: finishing write tid 2 to smithi16641208-128 2020-11-16T20:55:53.149 INFO:tasks.rados.rados.0.smithi166.stdout:128: finishing write tid 3 to smithi16641208-128 2020-11-16T20:55:53.149 INFO:tasks.rados.rados.0.smithi166.stdout:128: finishing write tid 4 to smithi16641208-128 2020-11-16T20:55:53.149 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 128 v 65 (ObjNum 127 snap 0 seq_num 127) dirty exists 2020-11-16T20:55:53.149 INFO:tasks.rados.rados.0.smithi166.stdout:128: left oid 128 (ObjNum 127 snap 0 seq_num 127) 2020-11-16T20:55:53.149 INFO:tasks.rados.rados.0.smithi166.stdout:129: finishing write tid 1 to smithi16641208-129 2020-11-16T20:55:53.149 INFO:tasks.rados.rados.0.smithi166.stdout:129: finishing write tid 2 to smithi16641208-129 2020-11-16T20:55:53.149 INFO:tasks.rados.rados.0.smithi166.stdout:129: finishing write tid 3 to smithi16641208-129 2020-11-16T20:55:53.149 INFO:tasks.rados.rados.0.smithi166.stdout:129: finishing write tid 4 to smithi16641208-129 2020-11-16T20:55:53.150 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 129 v 81 (ObjNum 128 snap 0 seq_num 128) dirty exists 2020-11-16T20:55:53.150 INFO:tasks.rados.rados.0.smithi166.stdout:129: left oid 129 (ObjNum 128 snap 0 seq_num 128) 2020-11-16T20:55:53.150 INFO:tasks.rados.rados.0.smithi166.stdout:130: finishing write tid 1 to smithi16641208-130 2020-11-16T20:55:53.150 INFO:tasks.rados.rados.0.smithi166.stdout:131: finishing write tid 1 to smithi16641208-131 2020-11-16T20:55:53.150 INFO:tasks.rados.rados.0.smithi166.stdout:130: finishing write tid 2 to smithi16641208-130 2020-11-16T20:55:53.150 INFO:tasks.rados.rados.0.smithi166.stdout:130: finishing write tid 3 to smithi16641208-130 2020-11-16T20:55:53.150 INFO:tasks.rados.rados.0.smithi166.stdout:130: finishing write tid 4 to smithi16641208-130 2020-11-16T20:55:53.151 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 130 v 67 (ObjNum 129 snap 0 seq_num 129) dirty exists 2020-11-16T20:55:53.151 INFO:tasks.rados.rados.0.smithi166.stdout:130: left oid 130 (ObjNum 129 snap 0 seq_num 129) 2020-11-16T20:55:53.151 INFO:tasks.rados.rados.0.smithi166.stdout:128: done (15 left) 2020-11-16T20:55:53.151 INFO:tasks.rados.rados.0.smithi166.stdout:129: done (14 left) 2020-11-16T20:55:53.151 INFO:tasks.rados.rados.0.smithi166.stdout:130: done (13 left) 2020-11-16T20:55:53.151 INFO:tasks.rados.rados.0.smithi166.stdout:144: write initial oid 144 2020-11-16T20:55:53.151 INFO:tasks.rados.rados.0.smithi166.stdout:144: seq_num 143 ranges {403401=454961,1584925=506039} 2020-11-16T20:55:53.152 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:55:53.152+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:55:53.153 INFO:tasks.rados.rados.0.smithi166.stdout:144: writing smithi16641208-144 from 403401 to 858362 tid 1 2020-11-16T20:55:53.160 INFO:tasks.rados.rados.0.smithi166.stdout:144: writing smithi16641208-144 from 1584925 to 2090964 tid 2 2020-11-16T20:55:53.160 INFO:tasks.rados.rados.0.smithi166.stdout:145: write initial oid 145 2020-11-16T20:55:53.160 INFO:tasks.rados.rados.0.smithi166.stdout:145: seq_num 144 ranges {420208=530210,1527054=766050} 2020-11-16T20:55:53.165 INFO:tasks.rados.rados.0.smithi166.stdout:145: writing smithi16641208-145 from 420208 to 950418 tid 1 2020-11-16T20:55:53.173 INFO:tasks.rados.rados.0.smithi166.stdout:145: writing smithi16641208-145 from 1527054 to 2293104 tid 2 2020-11-16T20:55:53.173 INFO:tasks.rados.rados.0.smithi166.stdout:146: write initial oid 146 2020-11-16T20:55:53.173 INFO:tasks.rados.rados.0.smithi166.stdout:146: seq_num 145 ranges {437015=721812,1701889=509708} 2020-11-16T20:55:53.180 INFO:tasks.rados.rados.0.smithi166.stdout:146: writing smithi16641208-146 from 437015 to 1158827 tid 1 2020-11-16T20:55:53.187 INFO:tasks.rados.rados.0.smithi166.stdout:146: writing smithi16641208-146 from 1701889 to 2211597 tid 2 2020-11-16T20:55:53.187 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.187 INFO:tasks.rados.rados.0.smithi166.stdout:131: finishing write tid 2 to smithi16641208-131 2020-11-16T20:55:53.187 INFO:tasks.rados.rados.0.smithi166.stdout:131: finishing write tid 3 to smithi16641208-131 2020-11-16T20:55:53.187 INFO:tasks.rados.rados.0.smithi166.stdout:132: finishing write tid 1 to smithi16641208-132 2020-11-16T20:55:53.188 INFO:tasks.rados.rados.0.smithi166.stdout:131: finishing write tid 4 to smithi16641208-131 2020-11-16T20:55:53.188 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 131 v 65 (ObjNum 130 snap 0 seq_num 130) dirty exists 2020-11-16T20:55:53.188 INFO:tasks.rados.rados.0.smithi166.stdout:131: left oid 131 (ObjNum 130 snap 0 seq_num 130) 2020-11-16T20:55:53.188 INFO:tasks.rados.rados.0.smithi166.stdout:132: finishing write tid 2 to smithi16641208-132 2020-11-16T20:55:53.188 INFO:tasks.rados.rados.0.smithi166.stdout:132: finishing write tid 3 to smithi16641208-132 2020-11-16T20:55:53.188 INFO:tasks.rados.rados.0.smithi166.stdout:132: finishing write tid 4 to smithi16641208-132 2020-11-16T20:55:53.188 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 132 v 110 (ObjNum 131 snap 0 seq_num 131) dirty exists 2020-11-16T20:55:53.188 INFO:tasks.rados.rados.0.smithi166.stdout:132: left oid 132 (ObjNum 131 snap 0 seq_num 131) 2020-11-16T20:55:53.189 INFO:tasks.rados.rados.0.smithi166.stdout:133: finishing write tid 1 to smithi16641208-133 2020-11-16T20:55:53.189 INFO:tasks.rados.rados.0.smithi166.stdout:131: done (15 left) 2020-11-16T20:55:53.189 INFO:tasks.rados.rados.0.smithi166.stdout:132: done (14 left) 2020-11-16T20:55:53.189 INFO:tasks.rados.rados.0.smithi166.stdout:147: write initial oid 147 2020-11-16T20:55:53.189 INFO:tasks.rados.rados.0.smithi166.stdout:147: seq_num 146 ranges {453822=797061,1760371=653366} 2020-11-16T20:55:53.194 INFO:tasks.rados.rados.0.smithi166.stdout:147: writing smithi16641208-147 from 453822 to 1250883 tid 1 2020-11-16T20:55:53.200 INFO:tasks.rados.rados.0.smithi166.stdout:147: writing smithi16641208-147 from 1760371 to 2413737 tid 2 2020-11-16T20:55:53.200 INFO:tasks.rados.rados.0.smithi166.stdout:148: write initial oid 148 2020-11-16T20:55:53.200 INFO:tasks.rados.rados.0.smithi166.stdout:148: seq_num 147 ranges {470629=472310,1418853=513377} 2020-11-16T20:55:53.205 INFO:tasks.rados.rados.0.smithi166.stdout:148: writing smithi16641208-148 from 470629 to 942939 tid 1 2020-11-16T20:55:53.208 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:53.208 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:53.211 INFO:tasks.rados.rados.0.smithi166.stdout:148: writing smithi16641208-148 from 1418853 to 1932230 tid 2 2020-11-16T20:55:53.211 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.212 INFO:tasks.rados.rados.0.smithi166.stdout:133: finishing write tid 2 to smithi16641208-133 2020-11-16T20:55:53.212 INFO:tasks.rados.rados.0.smithi166.stdout:133: finishing write tid 3 to smithi16641208-133 2020-11-16T20:55:53.212 INFO:tasks.rados.rados.0.smithi166.stdout:133: finishing write tid 4 to smithi16641208-133 2020-11-16T20:55:53.212 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 133 v 66 (ObjNum 132 snap 0 seq_num 132) dirty exists 2020-11-16T20:55:53.212 INFO:tasks.rados.rados.0.smithi166.stdout:133: left oid 133 (ObjNum 132 snap 0 seq_num 132) 2020-11-16T20:55:53.212 INFO:tasks.rados.rados.0.smithi166.stdout:134: finishing write tid 1 to smithi16641208-134 2020-11-16T20:55:53.212 INFO:tasks.rados.rados.0.smithi166.stdout:134: finishing write tid 2 to smithi16641208-134 2020-11-16T20:55:53.213 INFO:tasks.rados.rados.0.smithi166.stdout:134: finishing write tid 3 to smithi16641208-134 2020-11-16T20:55:53.213 INFO:tasks.rados.rados.0.smithi166.stdout:133: done (15 left) 2020-11-16T20:55:53.213 INFO:tasks.rados.rados.0.smithi166.stdout:149: write initial oid 149 2020-11-16T20:55:53.213 INFO:tasks.rados.rados.0.smithi166.stdout:134: finishing write tid 4 to smithi16641208-134 2020-11-16T20:55:53.213 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 134 v 69 (ObjNum 133 snap 0 seq_num 133) dirty exists 2020-11-16T20:55:53.213 INFO:tasks.rados.rados.0.smithi166.stdout:134: left oid 134 (ObjNum 133 snap 0 seq_num 133) 2020-11-16T20:55:53.213 INFO:tasks.rados.rados.0.smithi166.stdout:135: finishing write tid 1 to smithi16641208-135 2020-11-16T20:55:53.214 INFO:tasks.rados.rados.0.smithi166.stdout:149: seq_num 148 ranges {487436=547559,1760982=657035} 2020-11-16T20:55:53.217 INFO:tasks.rados.rados.0.smithi166.stdout:149: writing smithi16641208-149 from 487436 to 1034995 tid 1 2020-11-16T20:55:53.219 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:55:53.225 INFO:tasks.rados.rados.0.smithi166.stdout:149: writing smithi16641208-149 from 1760982 to 2418017 tid 2 2020-11-16T20:55:53.225 INFO:tasks.rados.rados.0.smithi166.stdout:134: done (15 left) 2020-11-16T20:55:53.225 INFO:tasks.rados.rados.0.smithi166.stdout:150: write initial oid 150 2020-11-16T20:55:53.225 INFO:tasks.rados.rados.0.smithi166.stdout:150: seq_num 149 ranges {504243=622808,1819464=517046} 2020-11-16T20:55:53.231 INFO:tasks.rados.rados.0.smithi166.stdout:150: writing smithi16641208-150 from 504243 to 1127051 tid 1 2020-11-16T20:55:53.239 INFO:tasks.rados.rados.0.smithi166.stdout:150: writing smithi16641208-150 from 1819464 to 2336510 tid 2 2020-11-16T20:55:53.239 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.239 INFO:tasks.rados.rados.0.smithi166.stdout:135: finishing write tid 2 to smithi16641208-135 2020-11-16T20:55:53.239 INFO:tasks.rados.rados.0.smithi166.stdout:135: finishing write tid 3 to smithi16641208-135 2020-11-16T20:55:53.239 INFO:tasks.rados.rados.0.smithi166.stdout:135: finishing write tid 4 to smithi16641208-135 2020-11-16T20:55:53.239 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 135 v 84 (ObjNum 134 snap 0 seq_num 134) dirty exists 2020-11-16T20:55:53.240 INFO:tasks.rados.rados.0.smithi166.stdout:135: left oid 135 (ObjNum 134 snap 0 seq_num 134) 2020-11-16T20:55:53.240 INFO:tasks.rados.rados.0.smithi166.stdout:136: finishing write tid 1 to smithi16641208-136 2020-11-16T20:55:53.240 INFO:tasks.rados.rados.0.smithi166.stdout:136: finishing write tid 2 to smithi16641208-136 2020-11-16T20:55:53.240 INFO:tasks.rados.rados.0.smithi166.stdout:136: finishing write tid 3 to smithi16641208-136 2020-11-16T20:55:53.240 INFO:tasks.rados.rados.0.smithi166.stdout:135: done (15 left) 2020-11-16T20:55:53.240 INFO:tasks.rados.rados.0.smithi166.stdout:151: write initial oid 151 2020-11-16T20:55:53.240 INFO:tasks.rados.rados.0.smithi166.stdout:151: seq_num 150 ranges {521050=698057,1877946=643104} 2020-11-16T20:55:53.245 INFO:tasks.rados.rados.0.smithi166.stdout:151: writing smithi16641208-151 from 521050 to 1219107 tid 1 2020-11-16T20:55:53.248 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:53.252+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:53.253 INFO:tasks.rados.rados.0.smithi166.stdout:151: writing smithi16641208-151 from 1877946 to 2521050 tid 2 2020-11-16T20:55:53.253 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.253 INFO:tasks.rados.rados.0.smithi166.stdout:136: finishing write tid 4 to smithi16641208-136 2020-11-16T20:55:53.254 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 136 v 113 (ObjNum 135 snap 0 seq_num 135) dirty exists 2020-11-16T20:55:53.254 INFO:tasks.rados.rados.0.smithi166.stdout:136: left oid 136 (ObjNum 135 snap 0 seq_num 135) 2020-11-16T20:55:53.254 INFO:tasks.rados.rados.0.smithi166.stdout:137: finishing write tid 1 to smithi16641208-137 2020-11-16T20:55:53.254 INFO:tasks.rados.rados.0.smithi166.stdout:137: finishing write tid 2 to smithi16641208-137 2020-11-16T20:55:53.254 INFO:tasks.rados.rados.0.smithi166.stdout:137: finishing write tid 3 to smithi16641208-137 2020-11-16T20:55:53.254 INFO:tasks.rados.rados.0.smithi166.stdout:137: finishing write tid 4 to smithi16641208-137 2020-11-16T20:55:53.254 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 137 v 116 (ObjNum 136 snap 0 seq_num 136) dirty exists 2020-11-16T20:55:53.255 INFO:tasks.rados.rados.0.smithi166.stdout:137: left oid 137 (ObjNum 136 snap 0 seq_num 136) 2020-11-16T20:55:53.255 INFO:tasks.rados.rados.0.smithi166.stdout:138: finishing write tid 1 to smithi16641208-138 2020-11-16T20:55:53.255 INFO:tasks.rados.rados.0.smithi166.stdout:138: finishing write tid 2 to smithi16641208-138 2020-11-16T20:55:53.255 INFO:tasks.rados.rados.0.smithi166.stdout:138: finishing write tid 3 to smithi16641208-138 2020-11-16T20:55:53.255 INFO:tasks.rados.rados.0.smithi166.stdout:136: done (15 left) 2020-11-16T20:55:53.255 INFO:tasks.rados.rados.0.smithi166.stdout:137: done (14 left) 2020-11-16T20:55:53.255 INFO:tasks.rados.rados.0.smithi166.stdout:152: write initial oid 152 2020-11-16T20:55:53.255 INFO:tasks.rados.rados.0.smithi166.stdout:152: seq_num 151 ranges {537857=773306,1936428=520715} 2020-11-16T20:55:53.260 INFO:tasks.rados.rados.0.smithi166.stdout:152: writing smithi16641208-152 from 537857 to 1311163 tid 1 2020-11-16T20:55:53.267 INFO:tasks.rados.rados.0.smithi166.stdout:152: writing smithi16641208-152 from 1936428 to 2457143 tid 2 2020-11-16T20:55:53.267 INFO:tasks.rados.rados.0.smithi166.stdout:153: write initial oid 153 2020-11-16T20:55:53.267 INFO:tasks.rados.rados.0.smithi166.stdout:153: seq_num 152 ranges {554664=448555,1478557=664373} 2020-11-16T20:55:53.272 INFO:tasks.rados.rados.0.smithi166.stdout:153: writing smithi16641208-153 from 554664 to 1003219 tid 1 2020-11-16T20:55:53.279 INFO:tasks.rados.rados.0.smithi166.stdout:153: writing smithi16641208-153 from 1478557 to 2142930 tid 2 2020-11-16T20:55:53.279 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.279 INFO:tasks.rados.rados.0.smithi166.stdout:138: finishing write tid 4 to smithi16641208-138 2020-11-16T20:55:53.279 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 138 v 64 (ObjNum 137 snap 0 seq_num 137) dirty exists 2020-11-16T20:55:53.279 INFO:tasks.rados.rados.0.smithi166.stdout:138: left oid 138 (ObjNum 137 snap 0 seq_num 137) 2020-11-16T20:55:53.280 INFO:tasks.rados.rados.0.smithi166.stdout:138: done (15 left) 2020-11-16T20:55:53.280 INFO:tasks.rados.rados.0.smithi166.stdout:154: write initial oid 154 2020-11-16T20:55:53.280 INFO:tasks.rados.rados.0.smithi166.stdout:154: seq_num 153 ranges {571471=640157,1653392=524384} 2020-11-16T20:55:53.285 INFO:tasks.rados.rados.0.smithi166.stdout:154: writing smithi16641208-154 from 571471 to 1211628 tid 1 2020-11-16T20:55:53.292 INFO:tasks.rados.rados.0.smithi166.stdout:154: writing smithi16641208-154 from 1653392 to 2177776 tid 2 2020-11-16T20:55:53.292 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.292 INFO:tasks.rados.rados.0.smithi166.stdout:139: finishing write tid 1 to smithi16641208-139 2020-11-16T20:55:53.292 INFO:tasks.rados.rados.0.smithi166.stdout:139: finishing write tid 2 to smithi16641208-139 2020-11-16T20:55:53.292 INFO:tasks.rados.rados.0.smithi166.stdout:139: finishing write tid 3 to smithi16641208-139 2020-11-16T20:55:53.293 INFO:tasks.rados.rados.0.smithi166.stdout:139: finishing write tid 4 to smithi16641208-139 2020-11-16T20:55:53.293 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 139 v 119 (ObjNum 138 snap 0 seq_num 138) dirty exists 2020-11-16T20:55:53.293 INFO:tasks.rados.rados.0.smithi166.stdout:139: left oid 139 (ObjNum 138 snap 0 seq_num 138) 2020-11-16T20:55:53.293 INFO:tasks.rados.rados.0.smithi166.stdout:140: finishing write tid 1 to smithi16641208-140 2020-11-16T20:55:53.293 INFO:tasks.rados.rados.0.smithi166.stdout:140: finishing write tid 2 to smithi16641208-140 2020-11-16T20:55:53.293 INFO:tasks.rados.rados.0.smithi166.stdout:140: finishing write tid 3 to smithi16641208-140 2020-11-16T20:55:53.293 INFO:tasks.rados.rados.0.smithi166.stdout:140: finishing write tid 4 to smithi16641208-140 2020-11-16T20:55:53.294 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 140 v 122 (ObjNum 139 snap 0 seq_num 139) dirty exists 2020-11-16T20:55:53.294 INFO:tasks.rados.rados.0.smithi166.stdout:140: left oid 140 (ObjNum 139 snap 0 seq_num 139) 2020-11-16T20:55:53.294 INFO:tasks.rados.rados.0.smithi166.stdout:141: finishing write tid 1 to smithi16641208-141 2020-11-16T20:55:53.294 INFO:tasks.rados.rados.0.smithi166.stdout:141: finishing write tid 2 to smithi16641208-141 2020-11-16T20:55:53.294 INFO:tasks.rados.rados.0.smithi166.stdout:141: finishing write tid 3 to smithi16641208-141 2020-11-16T20:55:53.294 INFO:tasks.rados.rados.0.smithi166.stdout:141: finishing write tid 4 to smithi16641208-141 2020-11-16T20:55:53.294 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 141 v 72 (ObjNum 140 snap 0 seq_num 140) dirty exists 2020-11-16T20:55:53.294 INFO:tasks.rados.rados.0.smithi166.stdout:141: left oid 141 (ObjNum 140 snap 0 seq_num 140) 2020-11-16T20:55:53.295 INFO:tasks.rados.rados.0.smithi166.stdout:142: finishing write tid 1 to smithi16641208-142 2020-11-16T20:55:53.295 INFO:tasks.rados.rados.0.smithi166.stdout:139: done (15 left) 2020-11-16T20:55:53.295 INFO:tasks.rados.rados.0.smithi166.stdout:140: done (14 left) 2020-11-16T20:55:53.295 INFO:tasks.rados.rados.0.smithi166.stdout:141: done (13 left) 2020-11-16T20:55:53.295 INFO:tasks.rados.rados.0.smithi166.stdout:155: write initial oid 155 2020-11-16T20:55:53.295 INFO:tasks.rados.rados.0.smithi166.stdout:155: seq_num 154 ranges {588278=715406,1711874=668042} 2020-11-16T20:55:53.298 INFO:tasks.rados.rados.0.smithi166.stdout:155: writing smithi16641208-155 from 588278 to 1303684 tid 1 2020-11-16T20:55:53.305 INFO:tasks.rados.rados.0.smithi166.stdout:155: writing smithi16641208-155 from 1711874 to 2379916 tid 2 2020-11-16T20:55:53.305 INFO:tasks.rados.rados.0.smithi166.stdout:156: write initial oid 156 2020-11-16T20:55:53.305 INFO:tasks.rados.rados.0.smithi166.stdout:156: seq_num 155 ranges {605085=790655,2170356=434729} 2020-11-16T20:55:53.312 INFO:tasks.rados.rados.0.smithi166.stdout:156: writing smithi16641208-156 from 605085 to 1395740 tid 1 2020-11-16T20:55:53.319 INFO:tasks.rados.rados.0.smithi166.stdout:156: writing smithi16641208-156 from 2170356 to 2605085 tid 2 2020-11-16T20:55:53.319 INFO:tasks.rados.rados.0.smithi166.stdout:157: write initial oid 157 2020-11-16T20:55:53.320 INFO:tasks.rados.rados.0.smithi166.stdout:157: seq_num 156 ranges {621892=465904,1712485=671711} 2020-11-16T20:55:53.325 INFO:tasks.rados.rados.0.smithi166.stdout:157: writing smithi16641208-157 from 621892 to 1087796 tid 1 2020-11-16T20:55:53.333 INFO:tasks.rados.rados.0.smithi166.stdout:157: writing smithi16641208-157 from 1712485 to 2384196 tid 2 2020-11-16T20:55:53.333 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.333 INFO:tasks.rados.rados.0.smithi166.stdout:142: finishing write tid 2 to smithi16641208-142 2020-11-16T20:55:53.333 INFO:tasks.rados.rados.0.smithi166.stdout:142: finishing write tid 3 to smithi16641208-142 2020-11-16T20:55:53.334 INFO:tasks.rados.rados.0.smithi166.stdout:142: finishing write tid 4 to smithi16641208-142 2020-11-16T20:55:53.334 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 142 v 75 (ObjNum 141 snap 0 seq_num 141) dirty exists 2020-11-16T20:55:53.334 INFO:tasks.rados.rados.0.smithi166.stdout:142: left oid 142 (ObjNum 141 snap 0 seq_num 141) 2020-11-16T20:55:53.334 INFO:tasks.rados.rados.0.smithi166.stdout:143: finishing write tid 1 to smithi16641208-143 2020-11-16T20:55:53.334 INFO:tasks.rados.rados.0.smithi166.stdout:142: done (15 left) 2020-11-16T20:55:53.334 INFO:tasks.rados.rados.0.smithi166.stdout:158: write initial oid 158 2020-11-16T20:55:53.334 INFO:tasks.rados.rados.0.smithi166.stdout:158: seq_num 157 ranges {638699=541153,1770967=531722} 2020-11-16T20:55:53.340 INFO:tasks.rados.rados.0.smithi166.stdout:158: writing smithi16641208-158 from 638699 to 1179852 tid 1 2020-11-16T20:55:53.346 INFO:tasks.rados.rados.0.smithi166.stdout:158: writing smithi16641208-158 from 1770967 to 2302689 tid 2 2020-11-16T20:55:53.346 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.347 INFO:tasks.rados.rados.0.smithi166.stdout:143: finishing write tid 2 to smithi16641208-143 2020-11-16T20:55:53.347 INFO:tasks.rados.rados.0.smithi166.stdout:143: finishing write tid 3 to smithi16641208-143 2020-11-16T20:55:53.347 INFO:tasks.rados.rados.0.smithi166.stdout:143: finishing write tid 4 to smithi16641208-143 2020-11-16T20:55:53.347 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 143 v 125 (ObjNum 142 snap 0 seq_num 142) dirty exists 2020-11-16T20:55:53.347 INFO:tasks.rados.rados.0.smithi166.stdout:143: left oid 143 (ObjNum 142 snap 0 seq_num 142) 2020-11-16T20:55:53.347 INFO:tasks.rados.rados.0.smithi166.stdout:144: finishing write tid 1 to smithi16641208-144 2020-11-16T20:55:53.347 INFO:tasks.rados.rados.0.smithi166.stdout:143: done (15 left) 2020-11-16T20:55:53.348 INFO:tasks.rados.rados.0.smithi166.stdout:159: write initial oid 159 2020-11-16T20:55:53.348 INFO:tasks.rados.rados.0.smithi166.stdout:144: finishing write tid 2 to smithi16641208-144 2020-11-16T20:55:53.348 INFO:tasks.rados.rados.0.smithi166.stdout:144: finishing write tid 3 to smithi16641208-144 2020-11-16T20:55:53.348 INFO:tasks.rados.rados.0.smithi166.stdout:159: seq_num 158 ranges {655506=616402,1829449=675380} 2020-11-16T20:55:53.350 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:55:53.353+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:55:53.353 INFO:tasks.rados.rados.0.smithi166.stdout:159: writing smithi16641208-159 from 655506 to 1271908 tid 1 2020-11-16T20:55:53.358 INFO:teuthology.orchestra.run.smithi166.stdout:moved 0 / 81 (0%) 2020-11-16T20:55:53.358 INFO:teuthology.orchestra.run.smithi166.stdout:avg 10.125 2020-11-16T20:55:53.359 INFO:teuthology.orchestra.run.smithi166.stdout:stddev 2.42061 -> 2.42061 (expected baseline 2.97647) 2020-11-16T20:55:53.359 INFO:teuthology.orchestra.run.smithi166.stdout:min osd.2 with 7 -> 7 pgs (0.691358 -> 0.691358 * mean) 2020-11-16T20:55:53.359 INFO:teuthology.orchestra.run.smithi166.stdout:max osd.7 with 14 -> 14 pgs (1.38272 -> 1.38272 * mean) 2020-11-16T20:55:53.359 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:55:53.359 INFO:teuthology.orchestra.run.smithi166.stdout:oload 1000 2020-11-16T20:55:53.359 INFO:teuthology.orchestra.run.smithi166.stdout:max_change 0.05 2020-11-16T20:55:53.359 INFO:teuthology.orchestra.run.smithi166.stdout:max_change_osds 4 2020-11-16T20:55:53.360 INFO:teuthology.orchestra.run.smithi166.stdout:average_utilization 0.0003 2020-11-16T20:55:53.360 INFO:teuthology.orchestra.run.smithi166.stdout:overload_utilization 0.0033 2020-11-16T20:55:53.361 INFO:tasks.rados.rados.0.smithi166.stdout:159: writing smithi16641208-159 from 1829449 to 2504829 tid 2 2020-11-16T20:55:53.361 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.361 INFO:tasks.rados.rados.0.smithi166.stdout:144: finishing write tid 4 to smithi16641208-144 2020-11-16T20:55:53.361 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 144 v 78 (ObjNum 143 snap 0 seq_num 143) dirty exists 2020-11-16T20:55:53.361 INFO:tasks.rados.rados.0.smithi166.stdout:144: left oid 144 (ObjNum 143 snap 0 seq_num 143) 2020-11-16T20:55:53.361 INFO:tasks.rados.rados.0.smithi166.stdout:144: done (15 left) 2020-11-16T20:55:53.362 INFO:tasks.rados.rados.0.smithi166.stdout:160: write initial oid 160 2020-11-16T20:55:53.362 INFO:tasks.rados.rados.0.smithi166.stdout:160: seq_num 159 ranges {672313=691651,1887931=419038} 2020-11-16T20:55:53.362 INFO:teuthology.orchestra.run.smithi166.stderr:no change 2020-11-16T20:55:53.368 INFO:tasks.rados.rados.0.smithi166.stdout:160: writing smithi16641208-160 from 672313 to 1363964 tid 1 2020-11-16T20:55:53.374 INFO:tasks.rados.rados.0.smithi166.stdout:160: writing smithi16641208-160 from 1887931 to 2306969 tid 2 2020-11-16T20:55:53.374 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.375 INFO:tasks.rados.rados.0.smithi166.stdout:145: finishing write tid 1 to smithi16641208-145 2020-11-16T20:55:53.375 INFO:tasks.rados.rados.0.smithi166.stdout:145: finishing write tid 2 to smithi16641208-145 2020-11-16T20:55:53.375 INFO:tasks.rados.rados.0.smithi166.stdout:145: finishing write tid 3 to smithi16641208-145 2020-11-16T20:55:53.375 INFO:tasks.rados.rados.0.smithi166.stdout:145: finishing write tid 4 to smithi16641208-145 2020-11-16T20:55:53.375 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 145 v 87 (ObjNum 144 snap 0 seq_num 144) dirty exists 2020-11-16T20:55:53.375 INFO:tasks.rados.rados.0.smithi166.stdout:145: left oid 145 (ObjNum 144 snap 0 seq_num 144) 2020-11-16T20:55:53.375 INFO:tasks.rados.rados.0.smithi166.stdout:146: finishing write tid 1 to smithi16641208-146 2020-11-16T20:55:53.376 INFO:tasks.rados.rados.0.smithi166.stdout:146: finishing write tid 2 to smithi16641208-146 2020-11-16T20:55:53.376 INFO:tasks.rados.rados.0.smithi166.stdout:146: finishing write tid 3 to smithi16641208-146 2020-11-16T20:55:53.376 INFO:tasks.rados.rados.0.smithi166.stdout:146: finishing write tid 4 to smithi16641208-146 2020-11-16T20:55:53.376 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 146 v 90 (ObjNum 145 snap 0 seq_num 145) dirty exists 2020-11-16T20:55:53.376 INFO:tasks.rados.rados.0.smithi166.stdout:146: left oid 146 (ObjNum 145 snap 0 seq_num 145) 2020-11-16T20:55:53.376 INFO:tasks.rados.rados.0.smithi166.stdout:147: finishing write tid 1 to smithi16641208-147 2020-11-16T20:55:53.376 INFO:tasks.rados.rados.0.smithi166.stdout:147: finishing write tid 2 to smithi16641208-147 2020-11-16T20:55:53.377 INFO:tasks.rados.rados.0.smithi166.stdout:147: finishing write tid 3 to smithi16641208-147 2020-11-16T20:55:53.377 INFO:tasks.rados.rados.0.smithi166.stdout:147: finishing write tid 4 to smithi16641208-147 2020-11-16T20:55:53.377 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 147 v 67 (ObjNum 146 snap 0 seq_num 146) dirty exists 2020-11-16T20:55:53.377 INFO:tasks.rados.rados.0.smithi166.stdout:147: left oid 147 (ObjNum 146 snap 0 seq_num 146) 2020-11-16T20:55:53.377 INFO:tasks.rados.rados.0.smithi166.stdout:148: finishing write tid 1 to smithi16641208-148 2020-11-16T20:55:53.377 INFO:tasks.rados.rados.0.smithi166.stdout:148: finishing write tid 2 to smithi16641208-148 2020-11-16T20:55:53.377 INFO:tasks.rados.rados.0.smithi166.stdout:145: done (15 left) 2020-11-16T20:55:53.377 INFO:tasks.rados.rados.0.smithi166.stdout:146: done (14 left) 2020-11-16T20:55:53.378 INFO:tasks.rados.rados.0.smithi166.stdout:147: done (13 left) 2020-11-16T20:55:53.378 INFO:tasks.rados.rados.0.smithi166.stdout:161: write initial oid 161 2020-11-16T20:55:53.378 INFO:tasks.rados.rados.0.smithi166.stdout:148: finishing write tid 3 to smithi16641208-148 2020-11-16T20:55:53.378 INFO:tasks.rados.rados.0.smithi166.stdout:148: finishing write tid 4 to smithi16641208-148 2020-11-16T20:55:53.378 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 148 v 81 (ObjNum 147 snap 0 seq_num 147) dirty exists 2020-11-16T20:55:53.378 INFO:tasks.rados.rados.0.smithi166.stdout:148: left oid 148 (ObjNum 147 snap 0 seq_num 147) 2020-11-16T20:55:53.378 INFO:tasks.rados.rados.0.smithi166.stdout:149: finishing write tid 1 to smithi16641208-149 2020-11-16T20:55:53.379 INFO:tasks.rados.rados.0.smithi166.stdout:149: finishing write tid 2 to smithi16641208-149 2020-11-16T20:55:53.379 INFO:tasks.rados.rados.0.smithi166.stdout:149: finishing write tid 3 to smithi16641208-149 2020-11-16T20:55:53.379 INFO:tasks.rados.rados.0.smithi166.stdout:149: finishing write tid 4 to smithi16641208-149 2020-11-16T20:55:53.379 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 149 v 128 (ObjNum 148 snap 0 seq_num 148) dirty exists 2020-11-16T20:55:53.379 INFO:tasks.rados.rados.0.smithi166.stdout:149: left oid 149 (ObjNum 148 snap 0 seq_num 148) 2020-11-16T20:55:53.379 INFO:tasks.rados.rados.0.smithi166.stdout:150: finishing write tid 1 to smithi16641208-150 2020-11-16T20:55:53.379 INFO:tasks.rados.rados.0.smithi166.stdout:150: finishing write tid 2 to smithi16641208-150 2020-11-16T20:55:53.380 INFO:tasks.rados.rados.0.smithi166.stdout:150: finishing write tid 3 to smithi16641208-150 2020-11-16T20:55:53.380 INFO:tasks.rados.rados.0.smithi166.stdout:161: seq_num 160 ranges {689120=483253,1946413=679049} 2020-11-16T20:55:53.380 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2020-11-16T20:55:53.381 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 1.0 2020-11-16T20:55:53.381 INFO:tasks.rados.rados.0.smithi166.stdout:161: writing smithi16641208-161 from 689120 to 1172373 tid 1 2020-11-16T20:55:53.389 INFO:tasks.rados.rados.0.smithi166.stdout:161: writing smithi16641208-161 from 1946413 to 2625462 tid 2 2020-11-16T20:55:53.389 INFO:tasks.rados.rados.0.smithi166.stdout:148: done (13 left) 2020-11-16T20:55:53.389 INFO:tasks.rados.rados.0.smithi166.stdout:149: done (12 left) 2020-11-16T20:55:53.389 INFO:tasks.rados.rados.0.smithi166.stdout:162: write initial oid 162 2020-11-16T20:55:53.389 INFO:tasks.rados.rados.0.smithi166.stdout:162: seq_num 161 ranges {705927=558502,2004895=422707} 2020-11-16T20:55:53.396 INFO:tasks.rados.rados.0.smithi166.stdout:162: writing smithi16641208-162 from 705927 to 1264429 tid 1 2020-11-16T20:55:53.396 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:53.396 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:53.402 INFO:tasks.rados.rados.0.smithi166.stdout:162: writing smithi16641208-162 from 2004895 to 2427602 tid 2 2020-11-16T20:55:53.403 INFO:tasks.rados.rados.0.smithi166.stdout:163: write initial oid 163 2020-11-16T20:55:53.403 INFO:tasks.rados.rados.0.smithi166.stdout:163: seq_num 162 ranges {722734=633751,2063377=659357} 2020-11-16T20:55:53.410 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:55:53.411 INFO:tasks.rados.rados.0.smithi166.stdout:163: writing smithi16641208-163 from 722734 to 1356485 tid 1 2020-11-16T20:55:53.418 INFO:tasks.rados.rados.0.smithi166.stdout:163: writing smithi16641208-163 from 2063377 to 2722734 tid 2 2020-11-16T20:55:53.418 INFO:tasks.rados.rados.0.smithi166.stdout:164: write initial oid 164 2020-11-16T20:55:53.418 INFO:tasks.rados.rados.0.smithi166.stdout:164: seq_num 163 ranges {739541=709000,2121859=426376} 2020-11-16T20:55:53.427 INFO:tasks.rados.rados.0.smithi166.stdout:164: writing smithi16641208-164 from 739541 to 1448541 tid 1 2020-11-16T20:55:53.433 INFO:tasks.rados.rados.0.smithi166.stdout:164: writing smithi16641208-164 from 2121859 to 2548235 tid 2 2020-11-16T20:55:53.433 INFO:tasks.rados.rados.0.smithi166.stdout:165: write initial oid 165 2020-11-16T20:55:53.433 INFO:tasks.rados.rados.0.smithi166.stdout:165: seq_num 164 ranges {756348=784249,2063988=686387} 2020-11-16T20:55:53.442 INFO:tasks.rados.rados.0.smithi166.stdout:165: writing smithi16641208-165 from 756348 to 1540597 tid 1 2020-11-16T20:55:53.449 INFO:tasks.rados.rados.0.smithi166.stdout:165: writing smithi16641208-165 from 2063988 to 2750375 tid 2 2020-11-16T20:55:53.449 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.449 INFO:tasks.rados.rados.0.smithi166.stdout:150: finishing write tid 4 to smithi16641208-150 2020-11-16T20:55:53.450 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 150 v 93 (ObjNum 149 snap 0 seq_num 149) dirty exists 2020-11-16T20:55:53.450 INFO:tasks.rados.rados.0.smithi166.stdout:150: left oid 150 (ObjNum 149 snap 0 seq_num 149) 2020-11-16T20:55:53.450 INFO:tasks.rados.rados.0.smithi166.stdout:150: done (15 left) 2020-11-16T20:55:53.450 INFO:tasks.rados.rados.0.smithi166.stdout:166: write initial oid 166 2020-11-16T20:55:53.450 INFO:tasks.rados.rados.0.smithi166.stdout:166: seq_num 165 ranges {773155=459498,1722470=430045,2648676=124479} 2020-11-16T20:55:53.452 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:55:53.455+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:55:53.456 INFO:tasks.rados.rados.0.smithi166.stdout:166: writing smithi16641208-166 from 773155 to 1232653 tid 1 2020-11-16T20:55:53.461 INFO:tasks.rados.rados.0.smithi166.stdout:166: writing smithi16641208-166 from 1722470 to 2152515 tid 2 2020-11-16T20:55:53.465 INFO:tasks.rados.rados.0.smithi166.stdout:166: writing smithi16641208-166 from 2648676 to 2773155 tid 3 2020-11-16T20:55:53.465 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.465 INFO:tasks.rados.rados.0.smithi166.stdout:151: finishing write tid 1 to smithi16641208-151 2020-11-16T20:55:53.466 INFO:tasks.rados.rados.0.smithi166.stdout:151: finishing write tid 2 to smithi16641208-151 2020-11-16T20:55:53.466 INFO:tasks.rados.rados.0.smithi166.stdout:151: finishing write tid 3 to smithi16641208-151 2020-11-16T20:55:53.466 INFO:tasks.rados.rados.0.smithi166.stdout:151: finishing write tid 4 to smithi16641208-151 2020-11-16T20:55:53.466 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 151 v 96 (ObjNum 150 snap 0 seq_num 150) dirty exists 2020-11-16T20:55:53.466 INFO:tasks.rados.rados.0.smithi166.stdout:151: left oid 151 (ObjNum 150 snap 0 seq_num 150) 2020-11-16T20:55:53.466 INFO:tasks.rados.rados.0.smithi166.stdout:152: finishing write tid 1 to smithi16641208-152 2020-11-16T20:55:53.466 INFO:tasks.rados.rados.0.smithi166.stdout:152: finishing write tid 2 to smithi16641208-152 2020-11-16T20:55:53.467 INFO:tasks.rados.rados.0.smithi166.stdout:152: finishing write tid 3 to smithi16641208-152 2020-11-16T20:55:53.467 INFO:tasks.rados.rados.0.smithi166.stdout:152: finishing write tid 4 to smithi16641208-152 2020-11-16T20:55:53.467 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 152 v 84 (ObjNum 151 snap 0 seq_num 151) dirty exists 2020-11-16T20:55:53.467 INFO:tasks.rados.rados.0.smithi166.stdout:152: left oid 152 (ObjNum 151 snap 0 seq_num 151) 2020-11-16T20:55:53.467 INFO:tasks.rados.rados.0.smithi166.stdout:153: finishing write tid 1 to smithi16641208-153 2020-11-16T20:55:53.467 INFO:tasks.rados.rados.0.smithi166.stdout:153: finishing write tid 2 to smithi16641208-153 2020-11-16T20:55:53.467 INFO:tasks.rados.rados.0.smithi166.stdout:151: done (15 left) 2020-11-16T20:55:53.467 INFO:tasks.rados.rados.0.smithi166.stdout:152: done (14 left) 2020-11-16T20:55:53.468 INFO:tasks.rados.rados.0.smithi166.stdout:167: write initial oid 167 2020-11-16T20:55:53.468 INFO:tasks.rados.rados.0.smithi166.stdout:153: finishing write tid 3 to smithi16641208-153 2020-11-16T20:55:53.468 INFO:tasks.rados.rados.0.smithi166.stdout:153: finishing write tid 4 to smithi16641208-153 2020-11-16T20:55:53.468 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 153 v 70 (ObjNum 152 snap 0 seq_num 152) dirty exists 2020-11-16T20:55:53.468 INFO:tasks.rados.rados.0.smithi166.stdout:153: left oid 153 (ObjNum 152 snap 0 seq_num 152) 2020-11-16T20:55:53.468 INFO:tasks.rados.rados.0.smithi166.stdout:154: finishing write tid 1 to smithi16641208-154 2020-11-16T20:55:53.468 INFO:tasks.rados.rados.0.smithi166.stdout:167: seq_num 166 ranges {789962=534747,1780952=690056} 2020-11-16T20:55:53.472 INFO:tasks.rados.rados.0.smithi166.stdout:167: writing smithi16641208-167 from 789962 to 1324709 tid 1 2020-11-16T20:55:53.479 INFO:tasks.rados.rados.0.smithi166.stdout:167: writing smithi16641208-167 from 1780952 to 2471008 tid 2 2020-11-16T20:55:53.479 INFO:tasks.rados.rados.0.smithi166.stdout:153: done (14 left) 2020-11-16T20:55:53.479 INFO:tasks.rados.rados.0.smithi166.stdout:168: write initial oid 168 2020-11-16T20:55:53.479 INFO:tasks.rados.rados.0.smithi166.stdout:168: seq_num 167 ranges {406769=609996,1439434=433714,2303522=503247} 2020-11-16T20:55:53.484 INFO:tasks.rados.rados.0.smithi166.stdout:168: writing smithi16641208-168 from 406769 to 1016765 tid 1 2020-11-16T20:55:53.489 INFO:tasks.rados.rados.0.smithi166.stdout:168: writing smithi16641208-168 from 1439434 to 1873148 tid 2 2020-11-16T20:55:53.494 INFO:tasks.rados.rados.0.smithi166.stdout:168: writing smithi16641208-168 from 2303522 to 2806769 tid 3 2020-11-16T20:55:53.495 INFO:tasks.rados.rados.0.smithi166.stdout:169: write initial oid 169 2020-11-16T20:55:53.495 INFO:tasks.rados.rados.0.smithi166.stdout:169: seq_num 168 ranges {423576=401598,1497916=693725} 2020-11-16T20:55:53.499 INFO:tasks.rados.rados.0.smithi166.stdout:169: writing smithi16641208-169 from 423576 to 825174 tid 1 2020-11-16T20:55:53.507 INFO:tasks.rados.rados.0.smithi166.stdout:169: writing smithi16641208-169 from 1497916 to 2191641 tid 2 2020-11-16T20:55:53.508 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.508 INFO:tasks.rados.rados.0.smithi166.stdout:154: finishing write tid 2 to smithi16641208-154 2020-11-16T20:55:53.508 INFO:tasks.rados.rados.0.smithi166.stdout:154: finishing write tid 3 to smithi16641208-154 2020-11-16T20:55:53.508 INFO:tasks.rados.rados.0.smithi166.stdout:154: finishing write tid 4 to smithi16641208-154 2020-11-16T20:55:53.508 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 154 v 131 (ObjNum 153 snap 0 seq_num 153) dirty exists 2020-11-16T20:55:53.508 INFO:tasks.rados.rados.0.smithi166.stdout:154: left oid 154 (ObjNum 153 snap 0 seq_num 153) 2020-11-16T20:55:53.508 INFO:tasks.rados.rados.0.smithi166.stdout:155: finishing write tid 1 to smithi16641208-155 2020-11-16T20:55:53.509 INFO:tasks.rados.rados.0.smithi166.stdout:155: finishing write tid 2 to smithi16641208-155 2020-11-16T20:55:53.509 INFO:tasks.rados.rados.0.smithi166.stdout:155: finishing write tid 3 to smithi16641208-155 2020-11-16T20:55:53.509 INFO:tasks.rados.rados.0.smithi166.stdout:155: finishing write tid 4 to smithi16641208-155 2020-11-16T20:55:53.509 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 155 v 87 (ObjNum 154 snap 0 seq_num 154) dirty exists 2020-11-16T20:55:53.509 INFO:tasks.rados.rados.0.smithi166.stdout:155: left oid 155 (ObjNum 154 snap 0 seq_num 154) 2020-11-16T20:55:53.509 INFO:tasks.rados.rados.0.smithi166.stdout:156: finishing write tid 1 to smithi16641208-156 2020-11-16T20:55:53.509 INFO:tasks.rados.rados.0.smithi166.stdout:156: finishing write tid 2 to smithi16641208-156 2020-11-16T20:55:53.509 INFO:tasks.rados.rados.0.smithi166.stdout:156: finishing write tid 3 to smithi16641208-156 2020-11-16T20:55:53.510 INFO:tasks.rados.rados.0.smithi166.stdout:156: finishing write tid 4 to smithi16641208-156 2020-11-16T20:55:53.510 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 156 v 73 (ObjNum 155 snap 0 seq_num 155) dirty exists 2020-11-16T20:55:53.510 INFO:tasks.rados.rados.0.smithi166.stdout:156: left oid 156 (ObjNum 155 snap 0 seq_num 155) 2020-11-16T20:55:53.510 INFO:tasks.rados.rados.0.smithi166.stdout:157: finishing write tid 1 to smithi16641208-157 2020-11-16T20:55:53.510 INFO:tasks.rados.rados.0.smithi166.stdout:157: finishing write tid 2 to smithi16641208-157 2020-11-16T20:55:53.510 INFO:tasks.rados.rados.0.smithi166.stdout:157: finishing write tid 3 to smithi16641208-157 2020-11-16T20:55:53.510 INFO:tasks.rados.rados.0.smithi166.stdout:157: finishing write tid 4 to smithi16641208-157 2020-11-16T20:55:53.511 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 157 v 134 (ObjNum 156 snap 0 seq_num 156) dirty exists 2020-11-16T20:55:53.511 INFO:tasks.rados.rados.0.smithi166.stdout:157: left oid 157 (ObjNum 156 snap 0 seq_num 156) 2020-11-16T20:55:53.511 INFO:tasks.rados.rados.0.smithi166.stdout:154: done (15 left) 2020-11-16T20:55:53.511 INFO:tasks.rados.rados.0.smithi166.stdout:155: done (14 left) 2020-11-16T20:55:53.511 INFO:tasks.rados.rados.0.smithi166.stdout:156: done (13 left) 2020-11-16T20:55:53.511 INFO:tasks.rados.rados.0.smithi166.stdout:157: done (12 left) 2020-11-16T20:55:53.511 INFO:tasks.rados.rados.0.smithi166.stdout:170: write initial oid 170 2020-11-16T20:55:53.511 INFO:tasks.rados.rados.0.smithi166.stdout:170: seq_num 169 ranges {440383=476847,1556398=437383,2474721=365662} 2020-11-16T20:55:53.513 INFO:tasks.rados.rados.0.smithi166.stdout:170: writing smithi16641208-170 from 440383 to 917230 tid 1 2020-11-16T20:55:53.519 INFO:tasks.rados.rados.0.smithi166.stdout:170: writing smithi16641208-170 from 1556398 to 1993781 tid 2 2020-11-16T20:55:53.523 INFO:tasks.rados.rados.0.smithi166.stdout:170: writing smithi16641208-170 from 2474721 to 2840383 tid 3 2020-11-16T20:55:53.524 INFO:tasks.rados.rados.0.smithi166.stdout:171: write initial oid 171 2020-11-16T20:55:53.524 INFO:tasks.rados.rados.0.smithi166.stdout:171: seq_num 170 ranges {457190=552096,1614880=581041,2785791=71399} 2020-11-16T20:55:53.529 INFO:tasks.rados.rados.0.smithi166.stdout:171: writing smithi16641208-171 from 457190 to 1009286 tid 1 2020-11-16T20:55:53.536 INFO:tasks.rados.rados.0.smithi166.stdout:171: writing smithi16641208-171 from 1614880 to 2195921 tid 2 2020-11-16T20:55:53.540 INFO:tasks.rados.rados.0.smithi166.stdout:171: writing smithi16641208-171 from 2785791 to 2857190 tid 3 2020-11-16T20:55:53.540 INFO:tasks.rados.rados.0.smithi166.stdout:172: write initial oid 172 2020-11-16T20:55:53.540 INFO:tasks.rados.rados.0.smithi166.stdout:172: seq_num 171 ranges {473997=627345,1673362=441052,2529567=344430} 2020-11-16T20:55:53.546 INFO:tasks.rados.rados.0.smithi166.stdout:172: writing smithi16641208-172 from 473997 to 1101342 tid 1 2020-11-16T20:55:53.552 INFO:tasks.rados.rados.0.smithi166.stdout:172: writing smithi16641208-172 from 1673362 to 2114414 tid 2 2020-11-16T20:55:53.552 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:53.556+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:53.557 INFO:tasks.rados.rados.0.smithi166.stdout:172: writing smithi16641208-172 from 2529567 to 2873997 tid 3 2020-11-16T20:55:53.557 INFO:tasks.rados.rados.0.smithi166.stdout:173: write initial oid 173 2020-11-16T20:55:53.557 INFO:tasks.rados.rados.0.smithi166.stdout:173: seq_num 172 ranges {490804=702594,1615491=584710,2724284=166520} 2020-11-16T20:55:53.563 INFO:tasks.rados.rados.0.smithi166.stdout:173: writing smithi16641208-173 from 490804 to 1193398 tid 1 2020-11-16T20:55:53.569 INFO:tasks.rados.rados.0.smithi166.stdout:173: writing smithi16641208-173 from 1615491 to 2200201 tid 2 2020-11-16T20:55:53.571 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:53.572 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:53.574 INFO:tasks.rados.rados.0.smithi166.stdout:173: writing smithi16641208-173 from 2724284 to 2890804 tid 3 2020-11-16T20:55:53.574 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.574 INFO:tasks.rados.rados.0.smithi166.stdout:158: finishing write tid 1 to smithi16641208-158 2020-11-16T20:55:53.574 INFO:tasks.rados.rados.0.smithi166.stdout:158: finishing write tid 2 to smithi16641208-158 2020-11-16T20:55:53.575 INFO:tasks.rados.rados.0.smithi166.stdout:158: finishing write tid 3 to smithi16641208-158 2020-11-16T20:55:53.575 INFO:tasks.rados.rados.0.smithi166.stdout:158: finishing write tid 4 to smithi16641208-158 2020-11-16T20:55:53.575 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 158 v 99 (ObjNum 157 snap 0 seq_num 157) dirty exists 2020-11-16T20:55:53.575 INFO:tasks.rados.rados.0.smithi166.stdout:158: left oid 158 (ObjNum 157 snap 0 seq_num 157) 2020-11-16T20:55:53.575 INFO:tasks.rados.rados.0.smithi166.stdout:159: finishing write tid 1 to smithi16641208-159 2020-11-16T20:55:53.575 INFO:tasks.rados.rados.0.smithi166.stdout:159: finishing write tid 2 to smithi16641208-159 2020-11-16T20:55:53.575 INFO:tasks.rados.rados.0.smithi166.stdout:159: finishing write tid 3 to smithi16641208-159 2020-11-16T20:55:53.575 INFO:tasks.rados.rados.0.smithi166.stdout:159: finishing write tid 4 to smithi16641208-159 2020-11-16T20:55:53.576 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 159 v 76 (ObjNum 158 snap 0 seq_num 158) dirty exists 2020-11-16T20:55:53.576 INFO:tasks.rados.rados.0.smithi166.stdout:159: left oid 159 (ObjNum 158 snap 0 seq_num 158) 2020-11-16T20:55:53.576 INFO:tasks.rados.rados.0.smithi166.stdout:160: finishing write tid 1 to smithi16641208-160 2020-11-16T20:55:53.576 INFO:tasks.rados.rados.0.smithi166.stdout:160: finishing write tid 2 to smithi16641208-160 2020-11-16T20:55:53.576 INFO:tasks.rados.rados.0.smithi166.stdout:160: finishing write tid 3 to smithi16641208-160 2020-11-16T20:55:53.576 INFO:tasks.rados.rados.0.smithi166.stdout:160: finishing write tid 4 to smithi16641208-160 2020-11-16T20:55:53.576 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 160 v 90 (ObjNum 159 snap 0 seq_num 159) dirty exists 2020-11-16T20:55:53.577 INFO:tasks.rados.rados.0.smithi166.stdout:160: left oid 160 (ObjNum 159 snap 0 seq_num 159) 2020-11-16T20:55:53.577 INFO:tasks.rados.rados.0.smithi166.stdout:161: finishing write tid 1 to smithi16641208-161 2020-11-16T20:55:53.577 INFO:tasks.rados.rados.0.smithi166.stdout:161: finishing write tid 2 to smithi16641208-161 2020-11-16T20:55:53.577 INFO:tasks.rados.rados.0.smithi166.stdout:161: finishing write tid 3 to smithi16641208-161 2020-11-16T20:55:53.577 INFO:tasks.rados.rados.0.smithi166.stdout:161: finishing write tid 4 to smithi16641208-161 2020-11-16T20:55:53.577 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 161 v 137 (ObjNum 160 snap 0 seq_num 160) dirty exists 2020-11-16T20:55:53.577 INFO:tasks.rados.rados.0.smithi166.stdout:161: left oid 161 (ObjNum 160 snap 0 seq_num 160) 2020-11-16T20:55:53.577 INFO:tasks.rados.rados.0.smithi166.stdout:162: finishing write tid 1 to smithi16641208-162 2020-11-16T20:55:53.578 INFO:tasks.rados.rados.0.smithi166.stdout:162: finishing write tid 2 to smithi16641208-162 2020-11-16T20:55:53.578 INFO:tasks.rados.rados.0.smithi166.stdout:162: finishing write tid 3 to smithi16641208-162 2020-11-16T20:55:53.578 INFO:tasks.rados.rados.0.smithi166.stdout:158: done (15 left) 2020-11-16T20:55:53.578 INFO:tasks.rados.rados.0.smithi166.stdout:159: done (14 left) 2020-11-16T20:55:53.578 INFO:tasks.rados.rados.0.smithi166.stdout:160: done (13 left) 2020-11-16T20:55:53.578 INFO:tasks.rados.rados.0.smithi166.stdout:161: done (12 left) 2020-11-16T20:55:53.578 INFO:tasks.rados.rados.0.smithi166.stdout:174: write initial oid 174 2020-11-16T20:55:53.579 INFO:tasks.rados.rados.0.smithi166.stdout:174: seq_num 173 ranges {507611=777843,2073973=444721} 2020-11-16T20:55:53.582 INFO:tasks.rados.rados.0.smithi166.stdout:174: writing smithi16641208-174 from 507611 to 1285454 tid 1 2020-11-16T20:55:53.585 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:55:53.589 INFO:tasks.rados.rados.0.smithi166.stdout:174: writing smithi16641208-174 from 2073973 to 2518694 tid 2 2020-11-16T20:55:53.589 INFO:tasks.rados.rados.0.smithi166.stdout:175: write initial oid 175 2020-11-16T20:55:53.589 INFO:tasks.rados.rados.0.smithi166.stdout:175: seq_num 174 ranges {524418=453092,1732455=588379,2779130=145288} 2020-11-16T20:55:53.594 INFO:tasks.rados.rados.0.smithi166.stdout:175: writing smithi16641208-175 from 524418 to 977510 tid 1 2020-11-16T20:55:53.602 INFO:tasks.rados.rados.0.smithi166.stdout:175: writing smithi16641208-175 from 1732455 to 2320834 tid 2 2020-11-16T20:55:53.606 INFO:tasks.rados.rados.0.smithi166.stdout:175: writing smithi16641208-175 from 2779130 to 2924418 tid 3 2020-11-16T20:55:53.606 INFO:tasks.rados.rados.0.smithi166.stdout:176: write initial oid 176 2020-11-16T20:55:53.606 INFO:tasks.rados.rados.0.smithi166.stdout:176: seq_num 175 ranges {541225=644694,1907290=448390} 2020-11-16T20:55:53.612 INFO:tasks.rados.rados.0.smithi166.stdout:176: writing smithi16641208-176 from 541225 to 1185919 tid 1 2020-11-16T20:55:53.619 INFO:tasks.rados.rados.0.smithi166.stdout:176: writing smithi16641208-176 from 1907290 to 2355680 tid 2 2020-11-16T20:55:53.619 INFO:tasks.rados.rados.0.smithi166.stdout:177: write initial oid 177 2020-11-16T20:55:53.619 INFO:tasks.rados.rados.0.smithi166.stdout:177: seq_num 176 ranges {558032=719943,1849419=592048} 2020-11-16T20:55:53.627 INFO:tasks.rados.rados.0.smithi166.stdout:177: writing smithi16641208-177 from 558032 to 1277975 tid 1 2020-11-16T20:55:53.634 INFO:tasks.rados.rados.0.smithi166.stdout:177: writing smithi16641208-177 from 1849419 to 2441467 tid 2 2020-11-16T20:55:53.634 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.634 INFO:tasks.rados.rados.0.smithi166.stdout:162: finishing write tid 4 to smithi16641208-162 2020-11-16T20:55:53.635 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 162 v 140 (ObjNum 161 snap 0 seq_num 161) dirty exists 2020-11-16T20:55:53.635 INFO:tasks.rados.rados.0.smithi166.stdout:162: left oid 162 (ObjNum 161 snap 0 seq_num 161) 2020-11-16T20:55:53.635 INFO:tasks.rados.rados.0.smithi166.stdout:163: finishing write tid 1 to smithi16641208-163 2020-11-16T20:55:53.635 INFO:tasks.rados.rados.0.smithi166.stdout:163: finishing write tid 2 to smithi16641208-163 2020-11-16T20:55:53.635 INFO:tasks.rados.rados.0.smithi166.stdout:163: finishing write tid 3 to smithi16641208-163 2020-11-16T20:55:53.635 INFO:tasks.rados.rados.0.smithi166.stdout:163: finishing write tid 4 to smithi16641208-163 2020-11-16T20:55:53.635 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 163 v 143 (ObjNum 162 snap 0 seq_num 162) dirty exists 2020-11-16T20:55:53.636 INFO:tasks.rados.rados.0.smithi166.stdout:163: left oid 163 (ObjNum 162 snap 0 seq_num 162) 2020-11-16T20:55:53.636 INFO:tasks.rados.rados.0.smithi166.stdout:164: finishing write tid 1 to smithi16641208-164 2020-11-16T20:55:53.636 INFO:tasks.rados.rados.0.smithi166.stdout:164: finishing write tid 2 to smithi16641208-164 2020-11-16T20:55:53.636 INFO:tasks.rados.rados.0.smithi166.stdout:164: finishing write tid 3 to smithi16641208-164 2020-11-16T20:55:53.636 INFO:tasks.rados.rados.0.smithi166.stdout:164: finishing write tid 4 to smithi16641208-164 2020-11-16T20:55:53.636 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 164 v 146 (ObjNum 163 snap 0 seq_num 163) dirty exists 2020-11-16T20:55:53.636 INFO:tasks.rados.rados.0.smithi166.stdout:164: left oid 164 (ObjNum 163 snap 0 seq_num 163) 2020-11-16T20:55:53.637 INFO:tasks.rados.rados.0.smithi166.stdout:165: finishing write tid 1 to smithi16641208-165 2020-11-16T20:55:53.637 INFO:tasks.rados.rados.0.smithi166.stdout:165: finishing write tid 2 to smithi16641208-165 2020-11-16T20:55:53.637 INFO:tasks.rados.rados.0.smithi166.stdout:165: finishing write tid 3 to smithi16641208-165 2020-11-16T20:55:53.637 INFO:tasks.rados.rados.0.smithi166.stdout:165: finishing write tid 4 to smithi16641208-165 2020-11-16T20:55:53.637 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 165 v 102 (ObjNum 164 snap 0 seq_num 164) dirty exists 2020-11-16T20:55:53.637 INFO:tasks.rados.rados.0.smithi166.stdout:165: left oid 165 (ObjNum 164 snap 0 seq_num 164) 2020-11-16T20:55:53.637 INFO:tasks.rados.rados.0.smithi166.stdout:166: finishing write tid 1 to smithi16641208-166 2020-11-16T20:55:53.637 INFO:tasks.rados.rados.0.smithi166.stdout:166: finishing write tid 2 to smithi16641208-166 2020-11-16T20:55:53.638 INFO:tasks.rados.rados.0.smithi166.stdout:162: done (15 left) 2020-11-16T20:55:53.638 INFO:tasks.rados.rados.0.smithi166.stdout:163: done (14 left) 2020-11-16T20:55:53.638 INFO:tasks.rados.rados.0.smithi166.stdout:164: done (13 left) 2020-11-16T20:55:53.638 INFO:tasks.rados.rados.0.smithi166.stdout:165: done (12 left) 2020-11-16T20:55:53.638 INFO:tasks.rados.rados.0.smithi166.stdout:178: write initial oid 178 2020-11-16T20:55:53.638 INFO:tasks.rados.rados.0.smithi166.stdout:178: seq_num 177 ranges {574839=795192,1907901=452059} 2020-11-16T20:55:53.641 INFO:tasks.rados.rados.0.smithi166.stdout:178: writing smithi16641208-178 from 574839 to 1370031 tid 1 2020-11-16T20:55:53.647 INFO:tasks.rados.rados.0.smithi166.stdout:178: writing smithi16641208-178 from 1907901 to 2359960 tid 2 2020-11-16T20:55:53.647 INFO:tasks.rados.rados.0.smithi166.stdout:179: write initial oid 179 2020-11-16T20:55:53.647 INFO:tasks.rados.rados.0.smithi166.stdout:179: seq_num 178 ranges {591646=470441,1566383=595717,2888822=102824} 2020-11-16T20:55:53.653 INFO:tasks.rados.rados.0.smithi166.stdout:179: writing smithi16641208-179 from 591646 to 1062087 tid 1 2020-11-16T20:55:53.654 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:55:53.657+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:55:53.659 INFO:tasks.rados.rados.0.smithi166.stdout:179: writing smithi16641208-179 from 1566383 to 2162100 tid 2 2020-11-16T20:55:53.664 INFO:tasks.rados.rados.0.smithi166.stdout:179: writing smithi16641208-179 from 2888822 to 2991646 tid 3 2020-11-16T20:55:53.664 INFO:tasks.rados.rados.0.smithi166.stdout:180: write initial oid 180 2020-11-16T20:55:53.664 INFO:tasks.rados.rados.0.smithi166.stdout:180: seq_num 179 ranges {608453=545690,1624865=455728,2632598=375855} 2020-11-16T20:55:53.668 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:55:53.670 INFO:tasks.rados.rados.0.smithi166.stdout:180: writing smithi16641208-180 from 608453 to 1154143 tid 1 2020-11-16T20:55:53.676 INFO:tasks.rados.rados.0.smithi166.stdout:180: writing smithi16641208-180 from 1624865 to 2080593 tid 2 2020-11-16T20:55:53.681 INFO:tasks.rados.rados.0.smithi166.stdout:180: writing smithi16641208-180 from 2632598 to 3008453 tid 3 2020-11-16T20:55:53.682 INFO:tasks.rados.rados.0.smithi166.stdout:181: write initial oid 181 2020-11-16T20:55:53.682 INFO:tasks.rados.rados.0.smithi166.stdout:181: seq_num 180 ranges {625260=620939,1683347=599386,2943668=81592} 2020-11-16T20:55:53.688 INFO:tasks.rados.rados.0.smithi166.stdout:181: writing smithi16641208-181 from 625260 to 1246199 tid 1 2020-11-16T20:55:53.694 INFO:tasks.rados.rados.0.smithi166.stdout:181: writing smithi16641208-181 from 1683347 to 2282733 tid 2 2020-11-16T20:55:53.699 INFO:tasks.rados.rados.0.smithi166.stdout:181: writing smithi16641208-181 from 2943668 to 3025260 tid 3 2020-11-16T20:55:53.699 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.700 INFO:tasks.rados.rados.0.smithi166.stdout:166: finishing write tid 3 to smithi16641208-166 2020-11-16T20:55:53.700 INFO:tasks.rados.rados.0.smithi166.stdout:166: finishing write tid 4 to smithi16641208-166 2020-11-16T20:55:53.700 INFO:tasks.rados.rados.0.smithi166.stdout:166: finishing write tid 5 to smithi16641208-166 2020-11-16T20:55:53.700 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 166 v 106 (ObjNum 165 snap 0 seq_num 165) dirty exists 2020-11-16T20:55:53.700 INFO:tasks.rados.rados.0.smithi166.stdout:166: left oid 166 (ObjNum 165 snap 0 seq_num 165) 2020-11-16T20:55:53.700 INFO:tasks.rados.rados.0.smithi166.stdout:167: finishing write tid 1 to smithi16641208-167 2020-11-16T20:55:53.700 INFO:tasks.rados.rados.0.smithi166.stdout:167: finishing write tid 2 to smithi16641208-167 2020-11-16T20:55:53.701 INFO:tasks.rados.rados.0.smithi166.stdout:167: finishing write tid 3 to smithi16641208-167 2020-11-16T20:55:53.701 INFO:tasks.rados.rados.0.smithi166.stdout:167: finishing write tid 4 to smithi16641208-167 2020-11-16T20:55:53.701 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 167 v 109 (ObjNum 166 snap 0 seq_num 166) dirty exists 2020-11-16T20:55:53.701 INFO:tasks.rados.rados.0.smithi166.stdout:167: left oid 167 (ObjNum 166 snap 0 seq_num 166) 2020-11-16T20:55:53.701 INFO:tasks.rados.rados.0.smithi166.stdout:168: finishing write tid 1 to smithi16641208-168 2020-11-16T20:55:53.701 INFO:tasks.rados.rados.0.smithi166.stdout:168: finishing write tid 2 to smithi16641208-168 2020-11-16T20:55:53.701 INFO:tasks.rados.rados.0.smithi166.stdout:168: finishing write tid 3 to smithi16641208-168 2020-11-16T20:55:53.701 INFO:tasks.rados.rados.0.smithi166.stdout:168: finishing write tid 4 to smithi16641208-168 2020-11-16T20:55:53.702 INFO:tasks.rados.rados.0.smithi166.stdout:168: finishing write tid 5 to smithi16641208-168 2020-11-16T20:55:53.702 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 168 v 94 (ObjNum 167 snap 0 seq_num 167) dirty exists 2020-11-16T20:55:53.702 INFO:tasks.rados.rados.0.smithi166.stdout:168: left oid 168 (ObjNum 167 snap 0 seq_num 167) 2020-11-16T20:55:53.702 INFO:tasks.rados.rados.0.smithi166.stdout:169: finishing write tid 1 to smithi16641208-169 2020-11-16T20:55:53.702 INFO:tasks.rados.rados.0.smithi166.stdout:169: finishing write tid 2 to smithi16641208-169 2020-11-16T20:55:53.702 INFO:tasks.rados.rados.0.smithi166.stdout:169: finishing write tid 3 to smithi16641208-169 2020-11-16T20:55:53.702 INFO:tasks.rados.rados.0.smithi166.stdout:169: finishing write tid 4 to smithi16641208-169 2020-11-16T20:55:53.703 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 169 v 97 (ObjNum 168 snap 0 seq_num 168) dirty exists 2020-11-16T20:55:53.703 INFO:tasks.rados.rados.0.smithi166.stdout:169: left oid 169 (ObjNum 168 snap 0 seq_num 168) 2020-11-16T20:55:53.703 INFO:tasks.rados.rados.0.smithi166.stdout:170: finishing write tid 1 to smithi16641208-170 2020-11-16T20:55:53.703 INFO:tasks.rados.rados.0.smithi166.stdout:170: finishing write tid 2 to smithi16641208-170 2020-11-16T20:55:53.703 INFO:tasks.rados.rados.0.smithi166.stdout:170: finishing write tid 3 to smithi16641208-170 2020-11-16T20:55:53.703 INFO:tasks.rados.rados.0.smithi166.stdout:166: done (15 left) 2020-11-16T20:55:53.703 INFO:tasks.rados.rados.0.smithi166.stdout:167: done (14 left) 2020-11-16T20:55:53.703 INFO:tasks.rados.rados.0.smithi166.stdout:168: done (13 left) 2020-11-16T20:55:53.704 INFO:tasks.rados.rados.0.smithi166.stdout:169: done (12 left) 2020-11-16T20:55:53.704 INFO:tasks.rados.rados.0.smithi166.stdout:182: write initial oid 182 2020-11-16T20:55:53.704 INFO:tasks.rados.rados.0.smithi166.stdout:182: seq_num 181 ranges {642067=696188,2025476=459397,2971091=70976} 2020-11-16T20:55:53.706 INFO:tasks.rados.rados.0.smithi166.stdout:182: writing smithi16641208-182 from 642067 to 1338255 tid 1 2020-11-16T20:55:53.713 INFO:tasks.rados.rados.0.smithi166.stdout:182: writing smithi16641208-182 from 2025476 to 2484873 tid 2 2020-11-16T20:55:53.716 INFO:tasks.rados.rados.0.smithi166.stdout:182: writing smithi16641208-182 from 2971091 to 3042067 tid 3 2020-11-16T20:55:53.717 INFO:tasks.rados.rados.0.smithi166.stdout:183: write initial oid 183 2020-11-16T20:55:53.717 INFO:tasks.rados.rados.0.smithi166.stdout:183: seq_num 182 ranges {658874=771437,2083958=603055} 2020-11-16T20:55:53.725 INFO:tasks.rados.rados.0.smithi166.stdout:183: writing smithi16641208-183 from 658874 to 1430311 tid 1 2020-11-16T20:55:53.732 INFO:tasks.rados.rados.0.smithi166.stdout:183: writing smithi16641208-183 from 2083958 to 2687013 tid 2 2020-11-16T20:55:53.732 INFO:tasks.rados.rados.0.smithi166.stdout:184: write initial oid 184 2020-11-16T20:55:53.732 INFO:tasks.rados.rados.0.smithi166.stdout:184: seq_num 183 ranges {675681=563039,1858793=746713,3025937=49744} 2020-11-16T20:55:53.739 INFO:tasks.rados.rados.0.smithi166.stdout:184: writing smithi16641208-184 from 675681 to 1238720 tid 1 2020-11-16T20:55:53.747 INFO:tasks.rados.rados.0.smithi166.stdout:184: writing smithi16641208-184 from 1858793 to 2605506 tid 2 2020-11-16T20:55:53.749 INFO:tasks.rados.rados.0.smithi166.stdout:184: writing smithi16641208-184 from 3025937 to 3075681 tid 3 2020-11-16T20:55:53.750 INFO:tasks.rados.rados.0.smithi166.stdout:185: write initial oid 185 2020-11-16T20:55:53.750 INFO:tasks.rados.rados.0.smithi166.stdout:185: seq_num 184 ranges {692488=638288,1917275=606724} 2020-11-16T20:55:53.754 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:55:53.758+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:55:53.754 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:55:53.754 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:55:53.757 INFO:tasks.rados.rados.0.smithi166.stdout:185: writing smithi16641208-185 from 692488 to 1330776 tid 1 2020-11-16T20:55:53.764 INFO:tasks.rados.rados.0.smithi166.stdout:185: writing smithi16641208-185 from 1917275 to 2523999 tid 2 2020-11-16T20:55:53.764 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.765 INFO:tasks.rados.rados.0.smithi166.stdout:170: finishing write tid 4 to smithi16641208-170 2020-11-16T20:55:53.765 INFO:tasks.rados.rados.0.smithi166.stdout:170: finishing write tid 5 to smithi16641208-170 2020-11-16T20:55:53.765 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 170 v 80 (ObjNum 169 snap 0 seq_num 169) dirty exists 2020-11-16T20:55:53.765 INFO:tasks.rados.rados.0.smithi166.stdout:170: left oid 170 (ObjNum 169 snap 0 seq_num 169) 2020-11-16T20:55:53.765 INFO:tasks.rados.rados.0.smithi166.stdout:171: finishing write tid 1 to smithi16641208-171 2020-11-16T20:55:53.765 INFO:tasks.rados.rados.0.smithi166.stdout:171: finishing write tid 2 to smithi16641208-171 2020-11-16T20:55:53.765 INFO:tasks.rados.rados.0.smithi166.stdout:170: done (15 left) 2020-11-16T20:55:53.766 INFO:tasks.rados.rados.0.smithi166.stdout:186: write initial oid 186 2020-11-16T20:55:53.766 INFO:tasks.rados.rados.0.smithi166.stdout:186: seq_num 185 ranges {709295=713537,1859404=750382} 2020-11-16T20:55:53.766 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:55:53.772 INFO:tasks.rados.rados.0.smithi166.stdout:186: writing smithi16641208-186 from 709295 to 1422832 tid 1 2020-11-16T20:55:53.780 INFO:tasks.rados.rados.0.smithi166.stdout:186: writing smithi16641208-186 from 1859404 to 2609786 tid 2 2020-11-16T20:55:53.780 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.780 INFO:tasks.rados.rados.0.smithi166.stdout:171: finishing write tid 3 to smithi16641208-171 2020-11-16T20:55:53.780 INFO:tasks.rados.rados.0.smithi166.stdout:171: finishing write tid 4 to smithi16641208-171 2020-11-16T20:55:53.780 INFO:tasks.rados.rados.0.smithi166.stdout:171: finishing write tid 5 to smithi16641208-171 2020-11-16T20:55:53.781 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 171 v 84 (ObjNum 170 snap 0 seq_num 170) dirty exists 2020-11-16T20:55:53.781 INFO:tasks.rados.rados.0.smithi166.stdout:171: left oid 171 (ObjNum 170 snap 0 seq_num 170) 2020-11-16T20:55:53.781 INFO:tasks.rados.rados.0.smithi166.stdout:172: finishing write tid 1 to smithi16641208-172 2020-11-16T20:55:53.781 INFO:tasks.rados.rados.0.smithi166.stdout:171: done (15 left) 2020-11-16T20:55:53.781 INFO:tasks.rados.rados.0.smithi166.stdout:187: write initial oid 187 2020-11-16T20:55:53.781 INFO:tasks.rados.rados.0.smithi166.stdout:187: seq_num 186 ranges {726102=788786,1917886=610393,3108206=17896} 2020-11-16T20:55:53.785 INFO:teuthology.orchestra.run.smithi166.stdout:moved 0 / 81 (0%) 2020-11-16T20:55:53.785 INFO:teuthology.orchestra.run.smithi166.stdout:avg 10.125 2020-11-16T20:55:53.786 INFO:teuthology.orchestra.run.smithi166.stdout:stddev 2.42061 -> 2.42061 (expected baseline 2.97647) 2020-11-16T20:55:53.786 INFO:teuthology.orchestra.run.smithi166.stdout:min osd.2 with 7 -> 7 pgs (0.691358 -> 0.691358 * mean) 2020-11-16T20:55:53.786 INFO:teuthology.orchestra.run.smithi166.stdout:max osd.7 with 14 -> 14 pgs (1.38272 -> 1.38272 * mean) 2020-11-16T20:55:53.786 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:55:53.786 INFO:teuthology.orchestra.run.smithi166.stdout:oload 1000 2020-11-16T20:55:53.786 INFO:teuthology.orchestra.run.smithi166.stdout:max_change 1 2020-11-16T20:55:53.786 INFO:teuthology.orchestra.run.smithi166.stdout:max_change_osds 4 2020-11-16T20:55:53.787 INFO:teuthology.orchestra.run.smithi166.stdout:average_utilization 0.0003 2020-11-16T20:55:53.787 INFO:teuthology.orchestra.run.smithi166.stdout:overload_utilization 0.0033 2020-11-16T20:55:53.788 INFO:teuthology.orchestra.run.smithi166.stderr:no change 2020-11-16T20:55:53.788 INFO:tasks.rados.rados.0.smithi166.stdout:187: writing smithi16641208-187 from 726102 to 1514888 tid 1 2020-11-16T20:55:53.794 INFO:tasks.rados.rados.0.smithi166.stdout:187: writing smithi16641208-187 from 1917886 to 2528279 tid 2 2020-11-16T20:55:53.798 INFO:tasks.rados.rados.0.smithi166.stdout:187: writing smithi16641208-187 from 3108206 to 3126102 tid 3 2020-11-16T20:55:53.798 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.798 INFO:tasks.rados.rados.0.smithi166.stdout:172: finishing write tid 2 to smithi16641208-172 2020-11-16T20:55:53.799 INFO:tasks.rados.rados.0.smithi166.stdout:172: finishing write tid 3 to smithi16641208-172 2020-11-16T20:55:53.799 INFO:tasks.rados.rados.0.smithi166.stdout:172: finishing write tid 4 to smithi16641208-172 2020-11-16T20:55:53.799 INFO:tasks.rados.rados.0.smithi166.stdout:172: finishing write tid 5 to smithi16641208-172 2020-11-16T20:55:53.799 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 172 v 113 (ObjNum 171 snap 0 seq_num 171) dirty exists 2020-11-16T20:55:53.799 INFO:tasks.rados.rados.0.smithi166.stdout:172: left oid 172 (ObjNum 171 snap 0 seq_num 171) 2020-11-16T20:55:53.799 INFO:tasks.rados.rados.0.smithi166.stdout:173: finishing write tid 1 to smithi16641208-173 2020-11-16T20:55:53.799 INFO:tasks.rados.rados.0.smithi166.stdout:173: finishing write tid 2 to smithi16641208-173 2020-11-16T20:55:53.799 INFO:tasks.rados.rados.0.smithi166.stdout:172: done (15 left) 2020-11-16T20:55:53.800 INFO:tasks.rados.rados.0.smithi166.stdout:188: write initial oid 188 2020-11-16T20:55:53.800 INFO:tasks.rados.rados.0.smithi166.stdout:188: seq_num 187 ranges {742909=464035,1976368=754051} 2020-11-16T20:55:53.806 INFO:tasks.rados.rados.0.smithi166.stdout:188: writing smithi16641208-188 from 742909 to 1206944 tid 1 2020-11-16T20:55:53.806 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2020-11-16T20:55:53.807 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 0.05 2020-11-16T20:55:53.818 INFO:tasks.rados.rados.0.smithi166.stdout:188: writing smithi16641208-188 from 1976368 to 2730419 tid 2 2020-11-16T20:55:53.818 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.819 INFO:tasks.rados.rados.0.smithi166.stdout:173: finishing write tid 3 to smithi16641208-173 2020-11-16T20:55:53.819 INFO:tasks.rados.rados.0.smithi166.stdout:173: finishing write tid 4 to smithi16641208-173 2020-11-16T20:55:53.819 INFO:tasks.rados.rados.0.smithi166.stdout:173: finishing write tid 5 to smithi16641208-173 2020-11-16T20:55:53.819 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 173 v 101 (ObjNum 172 snap 0 seq_num 172) dirty exists 2020-11-16T20:55:53.819 INFO:tasks.rados.rados.0.smithi166.stdout:173: left oid 173 (ObjNum 172 snap 0 seq_num 172) 2020-11-16T20:55:53.819 INFO:tasks.rados.rados.0.smithi166.stdout:174: finishing write tid 1 to smithi16641208-174 2020-11-16T20:55:53.819 INFO:tasks.rados.rados.0.smithi166.stdout:174: finishing write tid 2 to smithi16641208-174 2020-11-16T20:55:53.820 INFO:tasks.rados.rados.0.smithi166.stdout:174: finishing write tid 3 to smithi16641208-174 2020-11-16T20:55:53.820 INFO:tasks.rados.rados.0.smithi166.stdout:174: finishing write tid 4 to smithi16641208-174 2020-11-16T20:55:53.820 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 174 v 116 (ObjNum 173 snap 0 seq_num 173) dirty exists 2020-11-16T20:55:53.820 INFO:tasks.rados.rados.0.smithi166.stdout:174: left oid 174 (ObjNum 173 snap 0 seq_num 173) 2020-11-16T20:55:53.820 INFO:tasks.rados.rados.0.smithi166.stdout:173: done (15 left) 2020-11-16T20:55:53.820 INFO:tasks.rados.rados.0.smithi166.stdout:174: done (14 left) 2020-11-16T20:55:53.820 INFO:tasks.rados.rados.0.smithi166.stdout:189: write initial oid 189 2020-11-16T20:55:53.820 INFO:tasks.rados.rados.0.smithi166.stdout:189: seq_num 188 ranges {759716=539284,2034850=614062} 2020-11-16T20:55:53.826 INFO:tasks.rados.rados.0.smithi166.stdout:189: writing smithi16641208-189 from 759716 to 1299000 tid 1 2020-11-16T20:55:53.834 INFO:tasks.rados.rados.0.smithi166.stdout:189: writing smithi16641208-189 from 2034850 to 2648912 tid 2 2020-11-16T20:55:53.834 INFO:tasks.rados.rados.0.smithi166.stdout:190: write initial oid 190 2020-11-16T20:55:53.834 INFO:tasks.rados.rados.0.smithi166.stdout:190: seq_num 189 ranges {776523=614533,1976979=757720} 2020-11-16T20:55:53.842 INFO:tasks.rados.rados.0.smithi166.stdout:190: writing smithi16641208-190 from 776523 to 1391056 tid 1 2020-11-16T20:55:53.850 INFO:tasks.rados.rados.0.smithi166.stdout:190: writing smithi16641208-190 from 1976979 to 2734699 tid 2 2020-11-16T20:55:53.850 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.851 INFO:tasks.rados.rados.0.smithi166.stdout:175: finishing write tid 1 to smithi16641208-175 2020-11-16T20:55:53.851 INFO:tasks.rados.rados.0.smithi166.stdout:175: finishing write tid 2 to smithi16641208-175 2020-11-16T20:55:53.851 INFO:tasks.rados.rados.0.smithi166.stdout:175: finishing write tid 3 to smithi16641208-175 2020-11-16T20:55:53.851 INFO:tasks.rados.rados.0.smithi166.stdout:175: finishing write tid 4 to smithi16641208-175 2020-11-16T20:55:53.851 INFO:tasks.rados.rados.0.smithi166.stdout:176: finishing write tid 1 to smithi16641208-176 2020-11-16T20:55:53.851 INFO:tasks.rados.rados.0.smithi166.stdout:175: finishing write tid 5 to smithi16641208-175 2020-11-16T20:55:53.851 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 175 v 150 (ObjNum 174 snap 0 seq_num 174) dirty exists 2020-11-16T20:55:53.852 INFO:tasks.rados.rados.0.smithi166.stdout:175: left oid 175 (ObjNum 174 snap 0 seq_num 174) 2020-11-16T20:55:53.852 INFO:tasks.rados.rados.0.smithi166.stdout:176: finishing write tid 2 to smithi16641208-176 2020-11-16T20:55:53.852 INFO:tasks.rados.rados.0.smithi166.stdout:175: done (15 left) 2020-11-16T20:55:53.852 INFO:tasks.rados.rados.0.smithi166.stdout:191: write initial oid 191 2020-11-16T20:55:53.852 INFO:tasks.rados.rados.0.smithi166.stdout:191: seq_num 190 ranges {793330=689782,2035461=617731,3101545=91785} 2020-11-16T20:55:53.854 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:55:53.857+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:55:53.859 INFO:tasks.rados.rados.0.smithi166.stdout:191: writing smithi16641208-191 from 793330 to 1483112 tid 1 2020-11-16T20:55:53.866 INFO:tasks.rados.rados.0.smithi166.stdout:191: writing smithi16641208-191 from 2035461 to 2653192 tid 2 2020-11-16T20:55:53.869 INFO:tasks.rados.rados.0.smithi166.stdout:191: writing smithi16641208-191 from 3101545 to 3193330 tid 3 2020-11-16T20:55:53.869 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.869 INFO:tasks.rados.rados.0.smithi166.stdout:176: finishing write tid 3 to smithi16641208-176 2020-11-16T20:55:53.870 INFO:tasks.rados.rados.0.smithi166.stdout:176: finishing write tid 4 to smithi16641208-176 2020-11-16T20:55:53.870 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 176 v 104 (ObjNum 175 snap 0 seq_num 175) dirty exists 2020-11-16T20:55:53.870 INFO:tasks.rados.rados.0.smithi166.stdout:176: left oid 176 (ObjNum 175 snap 0 seq_num 175) 2020-11-16T20:55:53.870 INFO:tasks.rados.rados.0.smithi166.stdout:177: finishing write tid 1 to smithi16641208-177 2020-11-16T20:55:53.870 INFO:tasks.rados.rados.0.smithi166.stdout:176: done (15 left) 2020-11-16T20:55:53.870 INFO:tasks.rados.rados.0.smithi166.stdout:192: write initial oid 192 2020-11-16T20:55:53.871 INFO:tasks.rados.rados.0.smithi166.stdout:192: seq_num 191 ranges {410137=481384,1410296=761389,2728968=481169} 2020-11-16T20:55:53.874 INFO:tasks.rados.rados.0.smithi166.stdout:192: writing smithi16641208-192 from 410137 to 891521 tid 1 2020-11-16T20:55:53.875 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:55:53.882 INFO:tasks.rados.rados.0.smithi166.stdout:192: writing smithi16641208-192 from 1410296 to 2171685 tid 2 2020-11-16T20:55:53.888 INFO:tasks.rados.rados.0.smithi166.stdout:192: writing smithi16641208-192 from 2728968 to 3210137 tid 3 2020-11-16T20:55:53.889 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.889 INFO:tasks.rados.rados.0.smithi166.stdout:177: finishing write tid 2 to smithi16641208-177 2020-11-16T20:55:53.889 INFO:tasks.rados.rados.0.smithi166.stdout:177: finishing write tid 3 to smithi16641208-177 2020-11-16T20:55:53.889 INFO:tasks.rados.rados.0.smithi166.stdout:177: finishing write tid 4 to smithi16641208-177 2020-11-16T20:55:53.889 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 177 v 153 (ObjNum 176 snap 0 seq_num 176) dirty exists 2020-11-16T20:55:53.889 INFO:tasks.rados.rados.0.smithi166.stdout:177: left oid 177 (ObjNum 176 snap 0 seq_num 176) 2020-11-16T20:55:53.890 INFO:tasks.rados.rados.0.smithi166.stdout:178: finishing write tid 1 to smithi16641208-178 2020-11-16T20:55:53.890 INFO:tasks.rados.rados.0.smithi166.stdout:177: done (15 left) 2020-11-16T20:55:53.890 INFO:tasks.rados.rados.0.smithi166.stdout:193: write initial oid 193 2020-11-16T20:55:53.890 INFO:tasks.rados.rados.0.smithi166.stdout:193: seq_num 192 ranges {426944=556633,1468778=621400,2872744=354200} 2020-11-16T20:55:53.894 INFO:tasks.rados.rados.0.smithi166.stdout:193: writing smithi16641208-193 from 426944 to 983577 tid 1 2020-11-16T20:55:53.900 INFO:tasks.rados.rados.0.smithi166.stdout:193: writing smithi16641208-193 from 1468778 to 2090178 tid 2 2020-11-16T20:55:53.907 INFO:tasks.rados.rados.0.smithi166.stdout:193: writing smithi16641208-193 from 2872744 to 3226944 tid 3 2020-11-16T20:55:53.908 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.908 INFO:tasks.rados.rados.0.smithi166.stdout:178: finishing write tid 2 to smithi16641208-178 2020-11-16T20:55:53.908 INFO:tasks.rados.rados.0.smithi166.stdout:178: finishing write tid 3 to smithi16641208-178 2020-11-16T20:55:53.908 INFO:tasks.rados.rados.0.smithi166.stdout:178: finishing write tid 4 to smithi16641208-178 2020-11-16T20:55:53.908 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 178 v 119 (ObjNum 177 snap 0 seq_num 177) dirty exists 2020-11-16T20:55:53.908 INFO:tasks.rados.rados.0.smithi166.stdout:178: left oid 178 (ObjNum 177 snap 0 seq_num 177) 2020-11-16T20:55:53.908 INFO:tasks.rados.rados.0.smithi166.stdout:179: finishing write tid 1 to smithi16641208-179 2020-11-16T20:55:53.909 INFO:tasks.rados.rados.0.smithi166.stdout:179: finishing write tid 2 to smithi16641208-179 2020-11-16T20:55:53.909 INFO:tasks.rados.rados.0.smithi166.stdout:179: finishing write tid 3 to smithi16641208-179 2020-11-16T20:55:53.909 INFO:tasks.rados.rados.0.smithi166.stdout:179: finishing write tid 4 to smithi16641208-179 2020-11-16T20:55:53.909 INFO:tasks.rados.rados.0.smithi166.stdout:179: finishing write tid 5 to smithi16641208-179 2020-11-16T20:55:53.909 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 179 v 88 (ObjNum 178 snap 0 seq_num 178) dirty exists 2020-11-16T20:55:53.909 INFO:tasks.rados.rados.0.smithi166.stdout:179: left oid 179 (ObjNum 178 snap 0 seq_num 178) 2020-11-16T20:55:53.909 INFO:tasks.rados.rados.0.smithi166.stdout:180: finishing write tid 1 to smithi16641208-180 2020-11-16T20:55:53.910 INFO:tasks.rados.rados.0.smithi166.stdout:180: finishing write tid 2 to smithi16641208-180 2020-11-16T20:55:53.910 INFO:tasks.rados.rados.0.smithi166.stdout:178: done (15 left) 2020-11-16T20:55:53.910 INFO:tasks.rados.rados.0.smithi166.stdout:179: done (14 left) 2020-11-16T20:55:53.910 INFO:tasks.rados.rados.0.smithi166.stdout:194: write initial oid 194 2020-11-16T20:55:53.910 INFO:tasks.rados.rados.0.smithi166.stdout:194: seq_num 193 ranges {443751=631882,1810907=765058,3067461=176290} 2020-11-16T20:55:53.914 INFO:tasks.rados.rados.0.smithi166.stdout:194: writing smithi16641208-194 from 443751 to 1075633 tid 1 2020-11-16T20:55:53.917 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:55:53.922 INFO:tasks.rados.rados.0.smithi166.stdout:194: writing smithi16641208-194 from 1810907 to 2575965 tid 2 2020-11-16T20:55:53.927 INFO:tasks.rados.rados.0.smithi166.stdout:194: writing smithi16641208-194 from 3067461 to 3243751 tid 3 2020-11-16T20:55:53.927 INFO:tasks.rados.rados.0.smithi166.stdout:180: finishing write tid 3 to smithi16641208-180 2020-11-16T20:55:53.927 INFO:tasks.rados.rados.0.smithi166.stdout:195: write initial oid 195 2020-11-16T20:55:53.927 INFO:tasks.rados.rados.0.smithi166.stdout:195: seq_num 194 ranges {460558=707131,1869389=508716,3094884=165674} 2020-11-16T20:55:53.933 INFO:tasks.rados.rados.0.smithi166.stdout:195: writing smithi16641208-195 from 460558 to 1167689 tid 1 2020-11-16T20:55:53.940 INFO:tasks.rados.rados.0.smithi166.stdout:195: writing smithi16641208-195 from 1869389 to 2378105 tid 2 2020-11-16T20:55:53.945 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:55:53.945 INFO:tasks.rados.rados.0.smithi166.stdout:195: writing smithi16641208-195 from 3094884 to 3260558 tid 3 2020-11-16T20:55:53.945 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:53.946 INFO:tasks.rados.rados.0.smithi166.stdout:180: finishing write tid 4 to smithi16641208-180 2020-11-16T20:55:53.946 INFO:tasks.rados.rados.0.smithi166.stdout:180: finishing write tid 5 to smithi16641208-180 2020-11-16T20:55:53.946 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 180 v 92 (ObjNum 179 snap 0 seq_num 179) dirty exists 2020-11-16T20:55:53.946 INFO:tasks.rados.rados.0.smithi166.stdout:180: left oid 180 (ObjNum 179 snap 0 seq_num 179) 2020-11-16T20:55:53.946 INFO:tasks.rados.rados.0.smithi166.stdout:181: finishing write tid 1 to smithi16641208-181 2020-11-16T20:55:53.946 INFO:tasks.rados.rados.0.smithi166.stdout:181: finishing write tid 2 to smithi16641208-181 2020-11-16T20:55:53.946 INFO:tasks.rados.rados.0.smithi166.stdout:180: done (15 left) 2020-11-16T20:55:53.947 INFO:tasks.rados.rados.0.smithi166.stdout:196: write initial oid 196 2020-11-16T20:55:53.947 INFO:tasks.rados.rados.0.smithi166.stdout:196: seq_num 195 ranges {477365=782380,1927871=768727,3122307=155058} 2020-11-16T20:55:53.952 INFO:tasks.rados.rados.0.smithi166.stdout:196: writing smithi16641208-196 from 477365 to 1259745 tid 1 2020-11-16T20:55:53.954 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:55:53.958+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:55:53.961 INFO:tasks.rados.rados.0.smithi166.stdout:196: writing smithi16641208-196 from 1927871 to 2696598 tid 2 2020-11-16T20:55:53.962 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:53.962 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:55:53.962 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:55:53.963 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:55:53.963 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.963 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:6 4.2 4:6173e90a:::smithi16641208-2:head [write 1542129~474678] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:55:53.963 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:50.920995+0000", 2020-11-16T20:55:53.963 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.044321821, 2020-11-16T20:55:53.963 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015006024, 2020-11-16T20:55:53.963 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:53.963 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:53.964 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:53.964 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:53.964 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:53.964 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 6 2020-11-16T20:55:53.964 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.964 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:53.964 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.965 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:53.965 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.920995+0000", 2020-11-16T20:55:53.965 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:53.965 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.965 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.965 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:53.965 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.920995+0000", 2020-11-16T20:55:53.966 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00025546299999999999 2020-11-16T20:55:53.966 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.966 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.966 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:53.966 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921251+0000", 2020-11-16T20:55:53.966 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1580000000000002e-06 2020-11-16T20:55:53.966 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.967 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.967 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:53.967 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921257+0000", 2020-11-16T20:55:53.967 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1695000000000001e-05 2020-11-16T20:55:53.967 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.967 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.967 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:53.967 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921269+0000", 2020-11-16T20:55:53.968 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5830000000000001e-06 2020-11-16T20:55:53.968 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.968 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.968 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:53.968 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921276+0000", 2020-11-16T20:55:53.968 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3115999999999999e-05 2020-11-16T20:55:53.968 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.969 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.969 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:53.969 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921319+0000", 2020-11-16T20:55:53.969 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5856999999999999e-05 2020-11-16T20:55:53.969 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.969 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.969 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:53.969 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921355+0000", 2020-11-16T20:55:53.970 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006537068 2020-11-16T20:55:53.970 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.970 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.970 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:53.970 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.927892+0000", 2020-11-16T20:55:53.970 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114212 2020-11-16T20:55:53.970 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.971 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.971 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:53.971 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.928006+0000", 2020-11-16T20:55:53.971 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011220199999999999 2020-11-16T20:55:53.971 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.971 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.971 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:55:53.972 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.928119+0000", 2020-11-16T20:55:53.972 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001874871 2020-11-16T20:55:53.972 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.972 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.972 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:53.972 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.929993+0000", 2020-11-16T20:55:53.972 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044080120000000002 2020-11-16T20:55:53.973 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.973 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.973 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:53.973 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.934401+0000", 2020-11-16T20:55:53.973 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0014990579999999999 2020-11-16T20:55:53.973 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.973 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.974 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:53.974 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.935901+0000", 2020-11-16T20:55:53.974 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6905999999999999e-05 2020-11-16T20:55:53.974 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.974 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.974 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:53.974 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.935967+0000", 2020-11-16T20:55:53.975 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3822999999999998e-05 2020-11-16T20:55:53.975 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.975 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.975 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:53.975 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.936001+0000", 2020-11-16T20:55:53.975 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015006024 2020-11-16T20:55:53.975 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:53.975 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:53.976 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:53.976 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.976 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.976 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:7 4.2 4:6173e90a:::smithi16641208-2:head [setxattr _header (55) in=7b,truncate 2016807] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:55:53.976 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:50.921316+0000", 2020-11-16T20:55:53.976 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.0440015479999998, 2020-11-16T20:55:53.976 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014824069, 2020-11-16T20:55:53.977 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:53.977 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:53.977 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:53.977 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:53.977 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:53.977 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 7 2020-11-16T20:55:53.977 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.977 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:53.978 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.978 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:53.978 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921316+0000", 2020-11-16T20:55:53.978 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:53.978 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.978 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.978 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:53.979 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921316+0000", 2020-11-16T20:55:53.979 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4039999999999999e-05 2020-11-16T20:55:53.979 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.979 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.979 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:53.979 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921350+0000", 2020-11-16T20:55:53.979 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9049999999999999e-06 2020-11-16T20:55:53.979 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.980 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.980 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:53.980 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921353+0000", 2020-11-16T20:55:53.980 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6320000000000002e-06 2020-11-16T20:55:53.980 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.980 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.980 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:53.981 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921360+0000", 2020-11-16T20:55:53.981 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4910000000000001e-06 2020-11-16T20:55:53.981 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.981 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.981 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:53.981 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921364+0000", 2020-11-16T20:55:53.981 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4629999999999998e-05 2020-11-16T20:55:53.981 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.982 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.982 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:53.982 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921408+0000", 2020-11-16T20:55:53.982 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0510000000000003e-05 2020-11-16T20:55:53.982 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.982 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.982 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:53.983 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921459+0000", 2020-11-16T20:55:53.983 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0075200880000000003 2020-11-16T20:55:53.983 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.983 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.983 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:53.983 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.928979+0000", 2020-11-16T20:55:53.983 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012349600000000001 2020-11-16T20:55:53.984 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.984 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.984 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:53.984 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.929102+0000", 2020-11-16T20:55:53.984 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017672200000000001 2020-11-16T20:55:53.984 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.984 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.984 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:55:53.985 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.929279+0000", 2020-11-16T20:55:53.985 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00072137799999999995 2020-11-16T20:55:53.985 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.985 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.985 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:53.985 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.930000+0000", 2020-11-16T20:55:53.985 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0060458669999999999 2020-11-16T20:55:53.986 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.986 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.986 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:53.986 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.936046+0000", 2020-11-16T20:55:53.986 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6188999999999999e-05 2020-11-16T20:55:53.986 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.986 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.986 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:53.987 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.936072+0000", 2020-11-16T20:55:53.987 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4582000000000002e-05 2020-11-16T20:55:53.987 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.987 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.987 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:53.987 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.936107+0000", 2020-11-16T20:55:53.987 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2539000000000001e-05 2020-11-16T20:55:53.988 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.988 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.988 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:53.988 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.936140+0000", 2020-11-16T20:55:53.988 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014824069 2020-11-16T20:55:53.988 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:53.988 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:53.988 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:53.989 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.989 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.989 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:8 4.2 4:6173e90a:::smithi16641208-2:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:55:53.989 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:50.921386+0000", 2020-11-16T20:55:53.989 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.0439306269999999, 2020-11-16T20:55:53.989 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015084947, 2020-11-16T20:55:53.989 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:53.990 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:55:53.990 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:53.990 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:53.990 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:53.990 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 8 2020-11-16T20:55:53.990 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.990 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:53.991 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.991 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:53.991 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921386+0000", 2020-11-16T20:55:53.991 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:53.991 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.991 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.991 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:53.991 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921386+0000", 2020-11-16T20:55:53.992 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6447999999999999e-05 2020-11-16T20:55:53.992 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.992 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.992 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:53.992 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921403+0000", 2020-11-16T20:55:53.992 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.467e-06 2020-11-16T20:55:53.992 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.993 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.993 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:53.993 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921406+0000", 2020-11-16T20:55:53.993 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8939999999999998e-06 2020-11-16T20:55:53.993 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.993 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.993 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:53.993 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921412+0000", 2020-11-16T20:55:53.994 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.455e-06 2020-11-16T20:55:53.994 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.994 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.994 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:53.994 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921416+0000", 2020-11-16T20:55:53.994 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.067e-05 2020-11-16T20:55:53.994 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.995 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.995 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:53.995 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921476+0000", 2020-11-16T20:55:53.995 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3448999999999999e-05 2020-11-16T20:55:53.995 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.995 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.995 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:53.995 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921500+0000", 2020-11-16T20:55:53.996 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0080803209999999997 2020-11-16T20:55:53.996 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.996 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.996 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:53.996 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.929580+0000", 2020-11-16T20:55:53.996 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7507000000000003e-05 2020-11-16T20:55:53.996 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.997 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.997 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:55:53.997 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.929648+0000", 2020-11-16T20:55:53.997 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0065208130000000003 2020-11-16T20:55:53.997 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.997 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.997 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:53.998 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.936168+0000", 2020-11-16T20:55:53.998 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8515000000000004e-05 2020-11-16T20:55:53.998 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.998 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.998 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:53.998 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.936237+0000", 2020-11-16T20:55:53.998 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000234408 2020-11-16T20:55:53.998 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:53.999 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:53.999 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:53.999 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.936471+0000", 2020-11-16T20:55:53.999 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015084947 2020-11-16T20:55:53.999 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:53.999 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:53.999 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.000 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.000 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.000 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:9 4.2 4:5ad6a7de:::smithi16641208-3:head [write 433614~550498,stat] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:55:54.000 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:50.926672+0000", 2020-11-16T20:55:54.000 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.0386450100000002, 2020-11-16T20:55:54.000 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011913829000000001, 2020-11-16T20:55:54.000 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:54.001 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:54.001 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:54.001 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:54.001 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:54.001 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 9 2020-11-16T20:55:54.001 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.001 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:54.001 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.002 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:54.002 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.926672+0000", 2020-11-16T20:55:54.002 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:54.002 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.002 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.002 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:54.002 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.926672+0000", 2020-11-16T20:55:54.003 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000143893 2020-11-16T20:55:54.003 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.003 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.003 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:54.003 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.926816+0000", 2020-11-16T20:55:54.003 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5769999999999996e-06 2020-11-16T20:55:54.003 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.004 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.004 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:54.004 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.926824+0000", 2020-11-16T20:55:54.004 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1956e-05 2020-11-16T20:55:54.004 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.004 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.004 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:54.004 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.926835+0000", 2020-11-16T20:55:54.005 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6549999999999999e-06 2020-11-16T20:55:54.005 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.005 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.005 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:54.005 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.926845+0000", 2020-11-16T20:55:54.005 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028299739999999999 2020-11-16T20:55:54.005 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.006 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.006 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.006 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.929675+0000", 2020-11-16T20:55:54.006 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0089077380000000001 2020-11-16T20:55:54.006 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.006 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.006 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:54.006 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.938583+0000", 2020-11-16T20:55:54.007 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0359999999999998e-06 2020-11-16T20:55:54.007 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.007 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.007 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:54.007 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.938586+0000", 2020-11-16T20:55:54.007 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011913829000000001 2020-11-16T20:55:54.007 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.008 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:54.008 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.008 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.008 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.008 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:10 4.2 4:5ad6a7de:::smithi16641208-3:head [write 1600611~433003] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:55:54.008 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:50.932929+0000", 2020-11-16T20:55:54.008 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.0323878670000002, 2020-11-16T20:55:54.008 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017104389000000001, 2020-11-16T20:55:54.009 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:54.009 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:54.009 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:54.009 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:54.009 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:54.009 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 10 2020-11-16T20:55:54.009 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.010 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:54.010 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.010 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:54.010 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.932929+0000", 2020-11-16T20:55:54.010 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:54.010 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.010 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.011 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:54.011 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.932929+0000", 2020-11-16T20:55:54.011 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00021076600000000001 2020-11-16T20:55:54.011 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.011 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.011 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:54.011 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933140+0000", 2020-11-16T20:55:54.011 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7219999999999996e-06 2020-11-16T20:55:54.012 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.012 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.012 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:54.012 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933146+0000", 2020-11-16T20:55:54.012 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9820000000000003e-06 2020-11-16T20:55:54.012 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.012 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.013 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:54.013 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933156+0000", 2020-11-16T20:55:54.013 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5419999999999999e-06 2020-11-16T20:55:54.013 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.013 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.013 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:54.013 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933160+0000", 2020-11-16T20:55:54.013 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1328000000000002e-05 2020-11-16T20:55:54.014 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.014 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.014 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.014 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933192+0000", 2020-11-16T20:55:54.014 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3809000000000001e-05 2020-11-16T20:55:54.014 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.014 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.015 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:54.015 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933225+0000", 2020-11-16T20:55:54.015 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010974360000000001 2020-11-16T20:55:54.015 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.015 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.015 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.015 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.944200+0000", 2020-11-16T20:55:54.016 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0456000000000003e-05 2020-11-16T20:55:54.016 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.016 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:54.016 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.944290+0000", 2020-11-16T20:55:54.016 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012946999999999999 2020-11-16T20:55:54.016 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.017 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:55:54.017 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.944420+0000", 2020-11-16T20:55:54.017 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0015868869999999999 2020-11-16T20:55:54.017 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.017 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.017 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:54.017 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.946007+0000", 2020-11-16T20:55:54.018 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030165180000000002 2020-11-16T20:55:54.018 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.018 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.018 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:54.018 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.949023+0000", 2020-11-16T20:55:54.018 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00091041899999999999 2020-11-16T20:55:54.018 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.018 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.019 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:54.019 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.949933+0000", 2020-11-16T20:55:54.019 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3227999999999998e-05 2020-11-16T20:55:54.019 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.019 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.019 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:54.019 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.949997+0000", 2020-11-16T20:55:54.020 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6902e-05 2020-11-16T20:55:54.020 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.020 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.020 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:54.020 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.950034+0000", 2020-11-16T20:55:54.020 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017104389000000001 2020-11-16T20:55:54.020 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.020 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:54.021 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.021 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.021 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.021 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:11 4.2 4:5ad6a7de:::smithi16641208-3:head [setxattr _header (55) in=7b,truncate 2033614] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:55:54.021 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:50.933183+0000", 2020-11-16T20:55:54.021 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.0321342609999999, 2020-11-16T20:55:54.021 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017012756, 2020-11-16T20:55:54.022 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:54.022 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:54.022 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:54.022 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:54.022 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:54.022 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 11 2020-11-16T20:55:54.022 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.022 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:54.023 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.023 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:54.023 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933183+0000", 2020-11-16T20:55:54.023 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:54.023 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.023 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.023 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:54.024 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933183+0000", 2020-11-16T20:55:54.024 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4416000000000001e-05 2020-11-16T20:55:54.024 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.024 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.024 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:54.024 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933207+0000", 2020-11-16T20:55:54.024 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2729999999999998e-06 2020-11-16T20:55:54.024 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.025 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.025 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:54.025 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933211+0000", 2020-11-16T20:55:54.025 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5659999999999997e-06 2020-11-16T20:55:54.025 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.025 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.025 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:54.026 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933216+0000", 2020-11-16T20:55:54.026 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8080000000000001e-06 2020-11-16T20:55:54.026 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.026 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.026 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:54.026 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933219+0000", 2020-11-16T20:55:54.026 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0898999999999997e-05 2020-11-16T20:55:54.026 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.027 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.027 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.027 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933250+0000", 2020-11-16T20:55:54.027 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6498000000000002e-05 2020-11-16T20:55:54.027 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.027 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.027 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:54.027 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933286+0000", 2020-11-16T20:55:54.028 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011919791000000001 2020-11-16T20:55:54.028 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.028 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.028 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.028 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945206+0000", 2020-11-16T20:55:54.028 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015679499999999999 2020-11-16T20:55:54.028 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.029 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.029 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:54.029 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945363+0000", 2020-11-16T20:55:54.029 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016523899999999999 2020-11-16T20:55:54.029 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.029 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.029 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:55:54.029 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945528+0000", 2020-11-16T20:55:54.030 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00067981699999999999 2020-11-16T20:55:54.030 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.030 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.030 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:54.030 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.946208+0000", 2020-11-16T20:55:54.030 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028874249999999999 2020-11-16T20:55:54.030 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.031 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.031 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:54.031 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.949095+0000", 2020-11-16T20:55:54.031 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00097101200000000005 2020-11-16T20:55:54.031 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.031 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.031 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:54.031 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.950066+0000", 2020-11-16T20:55:54.032 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3769000000000006e-05 2020-11-16T20:55:54.032 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.032 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.032 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:54.032 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.950130+0000", 2020-11-16T20:55:54.032 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5448000000000001e-05 2020-11-16T20:55:54.032 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.033 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.033 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:54.033 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.950196+0000", 2020-11-16T20:55:54.033 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017012756 2020-11-16T20:55:54.033 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.033 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:54.033 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.033 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.034 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.034 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:12 4.2 4:5ad6a7de:::smithi16641208-3:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:55:54.034 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:50.933238+0000", 2020-11-16T20:55:54.034 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.032078882, 2020-11-16T20:55:54.034 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01743347, 2020-11-16T20:55:54.034 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:54.034 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:55:54.035 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:54.035 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:54.035 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:54.035 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 12 2020-11-16T20:55:54.035 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.035 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:54.035 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.036 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:54.036 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933238+0000", 2020-11-16T20:55:54.036 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:54.036 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.036 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.036 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:54.036 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933238+0000", 2020-11-16T20:55:54.036 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5231999999999999e-05 2020-11-16T20:55:54.037 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.037 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.037 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:54.037 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933253+0000", 2020-11-16T20:55:54.037 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1020000000000001e-06 2020-11-16T20:55:54.037 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.037 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.037 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:54.038 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933257+0000", 2020-11-16T20:55:54.038 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9179999999999999e-06 2020-11-16T20:55:54.038 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.038 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.038 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:54.038 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933262+0000", 2020-11-16T20:55:54.038 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3999999999999999e-06 2020-11-16T20:55:54.039 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.039 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.039 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:54.039 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933265+0000", 2020-11-16T20:55:54.039 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5132000000000002e-05 2020-11-16T20:55:54.039 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.039 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.040 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.040 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933300+0000", 2020-11-16T20:55:54.040 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7764999999999999e-05 2020-11-16T20:55:54.040 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.040 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.040 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:54.040 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933328+0000", 2020-11-16T20:55:54.040 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012567474 2020-11-16T20:55:54.041 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.041 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.041 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.041 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945895+0000", 2020-11-16T20:55:54.041 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3967000000000003e-05 2020-11-16T20:55:54.041 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.041 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.042 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:55:54.042 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945989+0000", 2020-11-16T20:55:54.042 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042421170000000001 2020-11-16T20:55:54.042 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.042 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.042 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.042 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.950231+0000", 2020-11-16T20:55:54.042 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000126468 2020-11-16T20:55:54.043 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.043 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.043 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:54.043 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.950358+0000", 2020-11-16T20:55:54.043 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00031389500000000002 2020-11-16T20:55:54.043 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.043 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.044 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:54.044 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.950672+0000", 2020-11-16T20:55:54.044 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01743347 2020-11-16T20:55:54.044 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.044 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:54.044 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.044 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.044 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.045 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:54 4.2 4:4d074942:::smithi16641208-14:head [write 2011207~207284] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:55:54.045 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.068197+0000", 2020-11-16T20:55:54.045 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 2.8971196250000002, 2020-11-16T20:55:54.045 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014390336, 2020-11-16T20:55:54.045 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:54.045 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:54.045 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:54.046 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:54.046 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:54.046 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 54 2020-11-16T20:55:54.046 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.046 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:54.046 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.046 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:54.046 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068197+0000", 2020-11-16T20:55:54.047 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:54.047 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.047 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.047 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:54.047 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068197+0000", 2020-11-16T20:55:54.047 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4893000000000004e-05 2020-11-16T20:55:54.047 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.048 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.048 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:54.048 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068262+0000", 2020-11-16T20:55:54.048 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7729999999999999e-06 2020-11-16T20:55:54.048 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.048 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.048 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:54.048 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068267+0000", 2020-11-16T20:55:54.051 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0030999999999999e-05 2020-11-16T20:55:54.051 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.051 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.051 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:54.051 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068277+0000", 2020-11-16T20:55:54.051 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9889999999999997e-06 2020-11-16T20:55:54.052 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.052 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.052 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:54.052 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068283+0000", 2020-11-16T20:55:54.052 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5920000000000001e-05 2020-11-16T20:55:54.052 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.052 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.053 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.053 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068329+0000", 2020-11-16T20:55:54.053 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5628999999999999e-05 2020-11-16T20:55:54.053 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.053 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.053 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:54.053 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068385+0000", 2020-11-16T20:55:54.053 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0072515189999999997 2020-11-16T20:55:54.054 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.054 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.054 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.054 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.075636+0000", 2020-11-16T20:55:54.054 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8337000000000004e-05 2020-11-16T20:55:54.054 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.054 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.055 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:54.055 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.075735+0000", 2020-11-16T20:55:54.055 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013442700000000001 2020-11-16T20:55:54.055 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.055 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.055 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:55:54.055 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.075869+0000", 2020-11-16T20:55:54.055 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033871959999999999 2020-11-16T20:55:54.056 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.056 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.056 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:54.056 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.079256+0000", 2020-11-16T20:55:54.056 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0031450570000000001 2020-11-16T20:55:54.056 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.056 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.057 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:54.057 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.082401+0000", 2020-11-16T20:55:54.057 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5278999999999994e-05 2020-11-16T20:55:54.057 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.057 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.057 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:54.057 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.082486+0000", 2020-11-16T20:55:54.057 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5018999999999995e-05 2020-11-16T20:55:54.058 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.058 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.058 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:54.058 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.082552+0000", 2020-11-16T20:55:54.058 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6266999999999997e-05 2020-11-16T20:55:54.058 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.058 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.059 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:54.059 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.082588+0000", 2020-11-16T20:55:54.059 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014390336 2020-11-16T20:55:54.059 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.059 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:54.059 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.059 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.059 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.060 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:55 4.2 4:4d074942:::smithi16641208-14:head [setxattr _header (56) in=7b,truncate 2218491] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:55:54.060 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.068324+0000", 2020-11-16T20:55:54.060 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 2.8969927850000001, 2020-11-16T20:55:54.060 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014458934999999999, 2020-11-16T20:55:54.060 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:54.060 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:54.060 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:54.061 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:54.061 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:54.061 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 55 2020-11-16T20:55:54.061 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.061 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:54.061 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.061 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:54.061 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068324+0000", 2020-11-16T20:55:54.062 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:54.062 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.062 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.062 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:54.062 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068324+0000", 2020-11-16T20:55:54.062 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6533999999999999e-05 2020-11-16T20:55:54.062 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.063 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.063 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:54.063 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068371+0000", 2020-11-16T20:55:54.063 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.254e-06 2020-11-16T20:55:54.063 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.063 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.063 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:54.064 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068376+0000", 2020-11-16T20:55:54.064 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1327e-05 2020-11-16T20:55:54.064 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.064 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.064 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:54.064 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068387+0000", 2020-11-16T20:55:54.064 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6999999999999996e-06 2020-11-16T20:55:54.064 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:54.065 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068393+0000", 2020-11-16T20:55:54.065 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.443e-05 2020-11-16T20:55:54.065 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068438+0000", 2020-11-16T20:55:54.066 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3406999999999999e-05 2020-11-16T20:55:54.066 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.066 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.066 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:54.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068491+0000", 2020-11-16T20:55:54.066 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0099777070000000006 2020-11-16T20:55:54.066 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.067 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.067 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.067 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.078469+0000", 2020-11-16T20:55:54.067 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000127914 2020-11-16T20:55:54.067 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.067 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.067 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:54.068 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.078597+0000", 2020-11-16T20:55:54.068 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000140572 2020-11-16T20:55:54.068 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.068 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.068 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:55:54.068 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.078737+0000", 2020-11-16T20:55:54.068 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00070085899999999997 2020-11-16T20:55:54.068 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.069 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.069 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:54.069 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.079438+0000", 2020-11-16T20:55:54.069 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003012037 2020-11-16T20:55:54.069 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.069 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.069 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:54.070 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.082450+0000", 2020-11-16T20:55:54.070 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019947199999999999 2020-11-16T20:55:54.070 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.070 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.070 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:54.070 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.082650+0000", 2020-11-16T20:55:54.070 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1023000000000001e-05 2020-11-16T20:55:54.071 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.071 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.071 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:54.071 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.082721+0000", 2020-11-16T20:55:54.071 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2699000000000004e-05 2020-11-16T20:55:54.071 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.071 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.071 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:54.072 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.082783+0000", 2020-11-16T20:55:54.072 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014458934999999999 2020-11-16T20:55:54.072 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.072 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:54.072 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.072 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.072 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.072 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:56 4.2 4:4d074942:::smithi16641208-14:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:55:54.073 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.068419+0000", 2020-11-16T20:55:54.073 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 2.8968983289999999, 2020-11-16T20:55:54.073 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015157009000000001, 2020-11-16T20:55:54.073 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:54.073 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:55:54.073 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:54.073 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:54.074 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:54.074 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 56 2020-11-16T20:55:54.074 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.074 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:54.074 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.074 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:54.074 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068419+0000", 2020-11-16T20:55:54.074 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:54.075 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.075 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.075 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:54.075 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068419+0000", 2020-11-16T20:55:54.075 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8451e-05 2020-11-16T20:55:54.075 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.075 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.076 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:54.076 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068437+0000", 2020-11-16T20:55:54.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2359999999999998e-06 2020-11-16T20:55:54.076 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.076 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.076 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:54.076 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068441+0000", 2020-11-16T20:55:54.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3419999999999996e-06 2020-11-16T20:55:54.077 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.077 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.077 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:54.077 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068448+0000", 2020-11-16T20:55:54.077 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7240000000000001e-06 2020-11-16T20:55:54.077 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.077 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.078 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:54.078 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068450+0000", 2020-11-16T20:55:54.078 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0448000000000001e-05 2020-11-16T20:55:54.078 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.078 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.078 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.078 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068511+0000", 2020-11-16T20:55:54.078 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4044000000000001e-05 2020-11-16T20:55:54.079 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.079 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.079 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:54.079 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068545+0000", 2020-11-16T20:55:54.079 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010468658 2020-11-16T20:55:54.079 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.079 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.080 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.080 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.079014+0000", 2020-11-16T20:55:54.080 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000210347 2020-11-16T20:55:54.080 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.080 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.080 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:55:54.080 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.079224+0000", 2020-11-16T20:55:54.080 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003594767 2020-11-16T20:55:54.081 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.081 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.081 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.081 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.082819+0000", 2020-11-16T20:55:54.081 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.1457000000000003e-05 2020-11-16T20:55:54.081 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.081 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.082 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:54.082 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.082900+0000", 2020-11-16T20:55:54.082 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000675535 2020-11-16T20:55:54.082 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.082 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.082 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:54.082 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.083576+0000", 2020-11-16T20:55:54.082 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015157009000000001 2020-11-16T20:55:54.083 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.083 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:54.083 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.083 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.083 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.083 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:74 4.2 4:745e23d0:::smithi16641208-19:head [write 1903617~398909] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:55:54.083 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.133466+0000", 2020-11-16T20:55:54.084 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 2.8318513479999998, 2020-11-16T20:55:54.084 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014982218, 2020-11-16T20:55:54.084 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:54.084 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:54.084 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:54.084 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:54.084 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:54.084 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 74 2020-11-16T20:55:54.085 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.085 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:54.085 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.085 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:54.085 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133466+0000", 2020-11-16T20:55:54.085 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:54.085 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.086 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.086 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:54.086 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133466+0000", 2020-11-16T20:55:54.086 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000104579 2020-11-16T20:55:54.086 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.086 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.086 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:54.086 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133570+0000", 2020-11-16T20:55:54.087 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6339999999999998e-06 2020-11-16T20:55:54.087 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.087 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.087 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:54.087 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133576+0000", 2020-11-16T20:55:54.087 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6199999999999994e-06 2020-11-16T20:55:54.087 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.088 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.088 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:54.088 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133586+0000", 2020-11-16T20:55:54.088 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8150000000000002e-06 2020-11-16T20:55:54.088 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.088 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.088 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:54.088 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133591+0000", 2020-11-16T20:55:54.089 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3634000000000003e-05 2020-11-16T20:55:54.089 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.089 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.089 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.089 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133635+0000", 2020-11-16T20:55:54.089 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6422999999999998e-05 2020-11-16T20:55:54.089 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.089 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.090 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:54.090 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133691+0000", 2020-11-16T20:55:54.090 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0048726170000000001 2020-11-16T20:55:54.090 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.090 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.090 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.090 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.138564+0000", 2020-11-16T20:55:54.091 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000109758 2020-11-16T20:55:54.091 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.091 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.091 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:54.091 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.138674+0000", 2020-11-16T20:55:54.091 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013092400000000001 2020-11-16T20:55:54.091 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.091 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.092 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:55:54.092 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.138805+0000", 2020-11-16T20:55:54.092 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001078107 2020-11-16T20:55:54.092 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.092 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.092 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:54.092 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.139883+0000", 2020-11-16T20:55:54.093 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0058099190000000002 2020-11-16T20:55:54.093 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.093 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.093 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:54.093 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.145693+0000", 2020-11-16T20:55:54.093 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0026418050000000001 2020-11-16T20:55:54.093 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.094 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.094 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:54.094 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.148335+0000", 2020-11-16T20:55:54.094 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7541999999999998e-05 2020-11-16T20:55:54.094 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.094 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.094 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:54.095 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.148402+0000", 2020-11-16T20:55:54.095 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5840999999999997e-05 2020-11-16T20:55:54.095 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.095 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.095 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:54.095 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.148448+0000", 2020-11-16T20:55:54.095 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014982218 2020-11-16T20:55:54.095 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.096 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:54.096 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.096 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.096 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.096 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:75 4.2 4:745e23d0:::smithi16641208-19:head [setxattr _header (56) in=7b,truncate 2302526] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:55:54.096 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.133614+0000", 2020-11-16T20:55:54.096 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 2.8317032910000002, 2020-11-16T20:55:54.097 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01496713, 2020-11-16T20:55:54.097 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:54.097 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:54.097 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:54.097 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:54.097 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:54.097 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 75 2020-11-16T20:55:54.097 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.098 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:54.098 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.098 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:54.098 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133614+0000", 2020-11-16T20:55:54.098 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:54.098 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.098 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.099 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:54.099 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133614+0000", 2020-11-16T20:55:54.099 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1651999999999999e-05 2020-11-16T20:55:54.099 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.099 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.099 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:54.099 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133635+0000", 2020-11-16T20:55:54.099 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0479999999999999e-06 2020-11-16T20:55:54.100 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.100 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.100 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:54.100 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133638+0000", 2020-11-16T20:55:54.100 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5600000000000001e-06 2020-11-16T20:55:54.100 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.100 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.100 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:54.101 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133644+0000", 2020-11-16T20:55:54.101 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5409999999999999e-06 2020-11-16T20:55:54.101 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.101 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.101 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:54.101 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133647+0000", 2020-11-16T20:55:54.101 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.1018000000000003e-05 2020-11-16T20:55:54.102 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.102 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.102 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.102 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133728+0000", 2020-11-16T20:55:54.102 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2394e-05 2020-11-16T20:55:54.102 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.102 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.102 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:54.103 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133780+0000", 2020-11-16T20:55:54.103 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0056435809999999999 2020-11-16T20:55:54.103 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.103 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.103 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.103 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.139424+0000", 2020-11-16T20:55:54.103 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.1211999999999994e-05 2020-11-16T20:55:54.104 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.104 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.104 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:54.104 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.139505+0000", 2020-11-16T20:55:54.104 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015016300000000001 2020-11-16T20:55:54.104 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.104 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.104 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:55:54.105 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.139655+0000", 2020-11-16T20:55:54.105 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045067700000000002 2020-11-16T20:55:54.105 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.105 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.105 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:54.105 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.140106+0000", 2020-11-16T20:55:54.105 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0056263670000000002 2020-11-16T20:55:54.106 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.106 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.106 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:54.106 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.145732+0000", 2020-11-16T20:55:54.106 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0027693650000000002 2020-11-16T20:55:54.106 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.106 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.106 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:54.107 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.148501+0000", 2020-11-16T20:55:54.107 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0003000000000003e-05 2020-11-16T20:55:54.107 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.107 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.107 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:54.107 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.148541+0000", 2020-11-16T20:55:54.107 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9548999999999997e-05 2020-11-16T20:55:54.108 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.108 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.108 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:54.108 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.148581+0000", 2020-11-16T20:55:54.108 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01496713 2020-11-16T20:55:54.108 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.108 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:54.108 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.109 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.109 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.109 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:76 4.2 4:745e23d0:::smithi16641208-19:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:55:54.109 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.133665+0000", 2020-11-16T20:55:54.109 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 2.8316516200000001, 2020-11-16T20:55:54.109 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015245811, 2020-11-16T20:55:54.109 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:54.110 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:55:54.110 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:54.110 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:54.110 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:54.110 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 76 2020-11-16T20:55:54.110 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.110 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:54.110 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.111 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:54.111 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133665+0000", 2020-11-16T20:55:54.111 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:54.111 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.111 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.111 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:54.111 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133665+0000", 2020-11-16T20:55:54.112 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5531000000000001e-05 2020-11-16T20:55:54.112 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.112 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.112 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:54.112 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133681+0000", 2020-11-16T20:55:54.112 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.926e-06 2020-11-16T20:55:54.112 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.112 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:54.113 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133684+0000", 2020-11-16T20:55:54.113 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.772e-06 2020-11-16T20:55:54.113 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.113 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:54.113 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133690+0000", 2020-11-16T20:55:54.114 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.441e-06 2020-11-16T20:55:54.114 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.114 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.114 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:54.114 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133692+0000", 2020-11-16T20:55:54.114 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000110321 2020-11-16T20:55:54.114 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.114 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.115 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.115 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133802+0000", 2020-11-16T20:55:54.115 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6947000000000003e-05 2020-11-16T20:55:54.115 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.115 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.115 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:54.115 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133849+0000", 2020-11-16T20:55:54.116 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0060542399999999998 2020-11-16T20:55:54.116 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.116 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.116 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.116 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.139904+0000", 2020-11-16T20:55:54.116 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9409e-05 2020-11-16T20:55:54.116 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.116 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.117 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:55:54.117 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.139963+0000", 2020-11-16T20:55:54.117 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0086500080000000007 2020-11-16T20:55:54.117 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.117 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.117 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.117 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.148613+0000", 2020-11-16T20:55:54.117 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2390000000000001e-05 2020-11-16T20:55:54.118 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.118 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.118 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:54.118 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.148705+0000", 2020-11-16T20:55:54.118 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020582599999999999 2020-11-16T20:55:54.118 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.119 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.119 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:54.119 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.148911+0000", 2020-11-16T20:55:54.119 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015245811 2020-11-16T20:55:54.119 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.119 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:54.119 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.119 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.120 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.120 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:78 4.2 4:7ac6179f:::smithi16641208-20:head [write 1962099~357234] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:55:54.120 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.146882+0000", 2020-11-16T20:55:54.120 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 2.8184350789999999, 2020-11-16T20:55:54.120 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014299350000000001, 2020-11-16T20:55:54.120 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:54.120 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:54.121 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:54.121 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:54.121 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:54.121 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 78 2020-11-16T20:55:54.121 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.121 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:54.121 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.121 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:54.122 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.146882+0000", 2020-11-16T20:55:54.122 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:54.122 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.122 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.122 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:54.122 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.146882+0000", 2020-11-16T20:55:54.122 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016386600000000001 2020-11-16T20:55:54.123 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.123 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.123 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:54.123 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.147046+0000", 2020-11-16T20:55:54.123 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4850000000000003e-06 2020-11-16T20:55:54.123 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.123 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.123 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:54.124 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.147050+0000", 2020-11-16T20:55:54.124 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0149999999999992e-06 2020-11-16T20:55:54.124 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.124 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.124 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:54.124 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.147059+0000", 2020-11-16T20:55:54.124 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2029999999999997e-06 2020-11-16T20:55:54.125 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.125 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.125 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:54.125 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.147066+0000", 2020-11-16T20:55:54.125 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7719999999999999e-05 2020-11-16T20:55:54.125 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.125 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.125 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.126 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.147093+0000", 2020-11-16T20:55:54.126 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3250000000000002e-05 2020-11-16T20:55:54.126 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.126 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.126 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:54.126 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.147127+0000", 2020-11-16T20:55:54.126 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0067035710000000002 2020-11-16T20:55:54.127 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.127 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.127 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.127 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.153830+0000", 2020-11-16T20:55:54.127 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012541900000000001 2020-11-16T20:55:54.127 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.127 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.127 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:54.128 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.153956+0000", 2020-11-16T20:55:54.128 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018284099999999999 2020-11-16T20:55:54.128 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.128 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.128 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:55:54.128 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.154138+0000", 2020-11-16T20:55:54.128 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001741448 2020-11-16T20:55:54.128 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.129 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.129 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:54.129 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.155880+0000", 2020-11-16T20:55:54.129 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040298909999999999 2020-11-16T20:55:54.129 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.129 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.129 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:54.130 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.159910+0000", 2020-11-16T20:55:54.130 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001158334 2020-11-16T20:55:54.130 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.130 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.130 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:54.130 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.161068+0000", 2020-11-16T20:55:54.130 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5338000000000004e-05 2020-11-16T20:55:54.130 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.131 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.131 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:54.131 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.161133+0000", 2020-11-16T20:55:54.131 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7969000000000001e-05 2020-11-16T20:55:54.131 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.131 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.131 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:54.132 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.161181+0000", 2020-11-16T20:55:54.132 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014299350000000001 2020-11-16T20:55:54.132 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.132 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:54.132 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.132 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.132 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.132 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:79 4.2 4:7ac6179f:::smithi16641208-20:head [setxattr _header (56) in=7b,truncate 2319333] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:55:54.133 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.147089+0000", 2020-11-16T20:55:54.133 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 2.8182275969999999, 2020-11-16T20:55:54.133 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014287331, 2020-11-16T20:55:54.133 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:54.133 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:54.133 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:54.133 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:54.134 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:54.134 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 79 2020-11-16T20:55:54.134 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.134 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:54.134 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.134 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:54.134 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.147089+0000", 2020-11-16T20:55:54.134 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:54.135 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.135 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.135 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:54.135 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.147089+0000", 2020-11-16T20:55:54.135 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2787000000000001e-05 2020-11-16T20:55:54.135 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.135 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.136 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:54.136 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.147112+0000", 2020-11-16T20:55:54.136 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9040000000000001e-06 2020-11-16T20:55:54.136 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.136 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.136 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:54.136 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.147115+0000", 2020-11-16T20:55:54.136 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3859999999999998e-06 2020-11-16T20:55:54.137 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.137 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.137 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:54.137 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.147121+0000", 2020-11-16T20:55:54.137 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5349999999999999e-06 2020-11-16T20:55:54.137 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.137 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.138 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:54.138 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.147123+0000", 2020-11-16T20:55:54.138 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4056000000000001e-05 2020-11-16T20:55:54.138 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.138 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.138 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.138 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.147157+0000", 2020-11-16T20:55:54.138 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1038999999999997e-05 2020-11-16T20:55:54.139 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.139 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.139 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:54.139 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.147208+0000", 2020-11-16T20:55:54.139 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007806828 2020-11-16T20:55:54.139 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.139 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.140 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.140 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.155015+0000", 2020-11-16T20:55:54.140 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.1199000000000006e-05 2020-11-16T20:55:54.140 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.140 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.140 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:54.140 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.155096+0000", 2020-11-16T20:55:54.140 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011287500000000001 2020-11-16T20:55:54.141 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.141 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.141 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:55:54.141 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.155209+0000", 2020-11-16T20:55:54.141 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028631300000000002 2020-11-16T20:55:54.141 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.141 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.141 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:54.142 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.158072+0000", 2020-11-16T20:55:54.142 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002757631 2020-11-16T20:55:54.142 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.142 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.142 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:54.142 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.160830+0000", 2020-11-16T20:55:54.142 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00044601900000000003 2020-11-16T20:55:54.143 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.143 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.143 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:54.143 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.161276+0000", 2020-11-16T20:55:54.143 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5942000000000002e-05 2020-11-16T20:55:54.143 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.143 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.144 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:54.144 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.161322+0000", 2020-11-16T20:55:54.144 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5000000000000002e-05 2020-11-16T20:55:54.144 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.144 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.144 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:54.144 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.161377+0000", 2020-11-16T20:55:54.144 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014287331 2020-11-16T20:55:54.145 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.145 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:54.145 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.145 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.145 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.145 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:80 4.2 4:7ac6179f:::smithi16641208-20:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:55:54.145 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.147142+0000", 2020-11-16T20:55:54.146 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 2.818175326, 2020-11-16T20:55:54.146 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014563593, 2020-11-16T20:55:54.146 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:54.146 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:55:54.146 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:54.146 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:54.146 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:54.146 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 80 2020-11-16T20:55:54.147 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.147 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:54.147 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.147 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:54.147 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.147142+0000", 2020-11-16T20:55:54.147 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:54.147 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.148 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.148 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:54.148 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.147142+0000", 2020-11-16T20:55:54.148 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6792000000000001e-05 2020-11-16T20:55:54.148 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.148 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.148 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:54.148 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.147159+0000", 2020-11-16T20:55:54.149 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8839999999999998e-06 2020-11-16T20:55:54.149 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.149 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.149 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:54.149 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.147161+0000", 2020-11-16T20:55:54.149 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5740000000000003e-06 2020-11-16T20:55:54.149 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.150 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.150 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:54.150 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.147167+0000", 2020-11-16T20:55:54.150 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3800000000000001e-06 2020-11-16T20:55:54.150 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.150 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.150 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:54.150 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.147169+0000", 2020-11-16T20:55:54.151 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4088000000000001e-05 2020-11-16T20:55:54.151 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.151 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.151 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.151 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.147223+0000", 2020-11-16T20:55:54.151 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6784999999999999e-05 2020-11-16T20:55:54.151 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.152 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.152 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:54.152 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.147250+0000", 2020-11-16T20:55:54.152 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0082209220000000003 2020-11-16T20:55:54.152 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.152 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.152 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.152 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.155471+0000", 2020-11-16T20:55:54.153 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000117254 2020-11-16T20:55:54.153 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.153 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.153 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:55:54.153 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.155588+0000", 2020-11-16T20:55:54.153 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0058146999999999999 2020-11-16T20:55:54.153 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.154 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.154 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.154 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.161403+0000", 2020-11-16T20:55:54.154 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6181999999999998e-05 2020-11-16T20:55:54.154 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.154 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.154 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:54.154 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.161469+0000", 2020-11-16T20:55:54.155 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023603200000000001 2020-11-16T20:55:54.155 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.155 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.155 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:54.155 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.161705+0000", 2020-11-16T20:55:54.155 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014563593 2020-11-16T20:55:54.155 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.156 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:54.156 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.156 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.156 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.156 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:82 4.2 4:5d1acb82:::smithi16641208-21:head [write 2020581~315559] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:55:54.156 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.159907+0000", 2020-11-16T20:55:54.156 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 2.805410095, 2020-11-16T20:55:54.156 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013643875, 2020-11-16T20:55:54.157 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:54.157 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:54.157 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:54.157 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:54.157 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:54.157 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 82 2020-11-16T20:55:54.157 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.158 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:54.158 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.158 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:54.158 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.159907+0000", 2020-11-16T20:55:54.158 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:54.158 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.158 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.158 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:54.159 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.159907+0000", 2020-11-16T20:55:54.159 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000115247 2020-11-16T20:55:54.159 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.159 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.159 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:54.159 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.160022+0000", 2020-11-16T20:55:54.159 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2470000000000002e-06 2020-11-16T20:55:54.159 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.160 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.160 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:54.160 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.160029+0000", 2020-11-16T20:55:54.160 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4214e-05 2020-11-16T20:55:54.160 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.160 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.160 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:54.161 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.160044+0000", 2020-11-16T20:55:54.161 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3679999999999996e-06 2020-11-16T20:55:54.161 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.161 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.161 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:54.161 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.160051+0000", 2020-11-16T20:55:54.161 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9791e-05 2020-11-16T20:55:54.161 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.162 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.162 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.162 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.160081+0000", 2020-11-16T20:55:54.162 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3488999999999997e-05 2020-11-16T20:55:54.162 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.162 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.162 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:54.163 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.160114+0000", 2020-11-16T20:55:54.163 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0063365230000000002 2020-11-16T20:55:54.163 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.163 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.163 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.163 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.166451+0000", 2020-11-16T20:55:54.163 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010794300000000001 2020-11-16T20:55:54.163 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.164 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.164 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:54.164 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.166559+0000", 2020-11-16T20:55:54.164 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000117546 2020-11-16T20:55:54.164 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.164 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.164 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:55:54.165 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.166676+0000", 2020-11-16T20:55:54.165 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0011877509999999999 2020-11-16T20:55:54.165 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.165 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.165 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:54.165 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.167864+0000", 2020-11-16T20:55:54.165 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.005046114 2020-11-16T20:55:54.165 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.166 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.166 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:54.166 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.172910+0000", 2020-11-16T20:55:54.166 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000550218 2020-11-16T20:55:54.166 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.166 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.166 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:54.167 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.173460+0000", 2020-11-16T20:55:54.167 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6409999999999998e-05 2020-11-16T20:55:54.167 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.167 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.167 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:54.167 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.173507+0000", 2020-11-16T20:55:54.167 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4014000000000002e-05 2020-11-16T20:55:54.167 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.168 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.168 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:54.168 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.173551+0000", 2020-11-16T20:55:54.168 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013643875 2020-11-16T20:55:54.168 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.168 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:54.168 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.169 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.169 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.169 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:83 4.2 4:5d1acb82:::smithi16641208-21:head [setxattr _header (56) in=7b,truncate 2336140] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:55:54.169 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.160089+0000", 2020-11-16T20:55:54.169 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 2.8052282989999999, 2020-11-16T20:55:54.169 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013722801999999999, 2020-11-16T20:55:54.169 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:54.169 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:54.170 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:54.170 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:54.170 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:54.170 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 83 2020-11-16T20:55:54.170 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.170 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:54.170 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.171 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:54.171 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.160089+0000", 2020-11-16T20:55:54.171 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:54.171 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.171 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.171 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:54.171 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.160089+0000", 2020-11-16T20:55:54.171 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4026000000000002e-05 2020-11-16T20:55:54.172 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.172 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.172 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:54.172 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.160133+0000", 2020-11-16T20:55:54.172 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7180000000000001e-06 2020-11-16T20:55:54.172 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.172 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.173 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:54.173 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.160139+0000", 2020-11-16T20:55:54.173 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0098000000000001e-05 2020-11-16T20:55:54.173 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.173 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.173 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:54.173 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.160149+0000", 2020-11-16T20:55:54.173 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.763e-06 2020-11-16T20:55:54.174 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.174 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.174 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:54.174 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.160153+0000", 2020-11-16T20:55:54.174 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2782999999999999e-05 2020-11-16T20:55:54.174 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.175 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.175 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.175 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.160176+0000", 2020-11-16T20:55:54.175 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0948999999999998e-05 2020-11-16T20:55:54.175 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.175 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.175 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:54.175 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.160207+0000", 2020-11-16T20:55:54.176 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0069852990000000004 2020-11-16T20:55:54.176 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.176 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.176 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.176 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.167192+0000", 2020-11-16T20:55:54.176 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5416999999999999e-05 2020-11-16T20:55:54.176 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.177 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.177 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:54.177 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.167278+0000", 2020-11-16T20:55:54.177 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015800699999999999 2020-11-16T20:55:54.177 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.177 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.177 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:55:54.177 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.167436+0000", 2020-11-16T20:55:54.178 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0048770849999999998 2020-11-16T20:55:54.178 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.178 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.178 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:54.178 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.172313+0000", 2020-11-16T20:55:54.178 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00064775200000000003 2020-11-16T20:55:54.178 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.179 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.179 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:54.179 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.172961+0000", 2020-11-16T20:55:54.179 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00074224200000000005 2020-11-16T20:55:54.179 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.179 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.179 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:54.179 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.173703+0000", 2020-11-16T20:55:54.180 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6402e-05 2020-11-16T20:55:54.180 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.180 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.180 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:54.180 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.173759+0000", 2020-11-16T20:55:54.180 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2261e-05 2020-11-16T20:55:54.180 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.181 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.181 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:54.181 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.173812+0000", 2020-11-16T20:55:54.181 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013722801999999999 2020-11-16T20:55:54.181 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.181 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:54.181 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.181 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.182 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.182 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:84 4.2 4:5d1acb82:::smithi16641208-21:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:55:54.182 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.160188+0000", 2020-11-16T20:55:54.182 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 2.8051287710000001, 2020-11-16T20:55:54.182 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014157472000000001, 2020-11-16T20:55:54.182 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:54.182 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:55:54.183 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:54.183 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:54.183 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:54.183 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 84 2020-11-16T20:55:54.183 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.183 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:54.183 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.184 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:54.184 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.160188+0000", 2020-11-16T20:55:54.184 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:54.184 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.184 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.184 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:54.184 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.160188+0000", 2020-11-16T20:55:54.184 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0244e-05 2020-11-16T20:55:54.185 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.185 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.185 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:54.185 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.160219+0000", 2020-11-16T20:55:54.185 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4099999999999999e-06 2020-11-16T20:55:54.185 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.185 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.186 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:54.186 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.160224+0000", 2020-11-16T20:55:54.186 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0570999999999999e-05 2020-11-16T20:55:54.186 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.186 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.186 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:54.186 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.160235+0000", 2020-11-16T20:55:54.186 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3200000000000001e-06 2020-11-16T20:55:54.187 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.187 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.187 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:54.187 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.160239+0000", 2020-11-16T20:55:54.187 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1503999999999999e-05 2020-11-16T20:55:54.187 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.187 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.188 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.188 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.160260+0000", 2020-11-16T20:55:54.188 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8773e-05 2020-11-16T20:55:54.188 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.188 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.188 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:54.188 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.160289+0000", 2020-11-16T20:55:54.188 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0074189349999999998 2020-11-16T20:55:54.189 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.189 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.189 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.189 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.167708+0000", 2020-11-16T20:55:54.189 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000137534 2020-11-16T20:55:54.189 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.189 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.189 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:55:54.190 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.167846+0000", 2020-11-16T20:55:54.190 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006044822 2020-11-16T20:55:54.190 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.190 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.190 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.190 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.173890+0000", 2020-11-16T20:55:54.190 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.5606000000000006e-05 2020-11-16T20:55:54.191 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.191 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.191 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:54.191 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.173986+0000", 2020-11-16T20:55:54.191 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00035975299999999998 2020-11-16T20:55:54.191 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.191 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.191 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:54.192 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.174346+0000", 2020-11-16T20:55:54.192 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014157472000000001 2020-11-16T20:55:54.192 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.192 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:54.192 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.192 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.192 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.193 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:88 4.2 4:515e6cf6:::smithi16641208-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:55:54.193 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.173371+0000", 2020-11-16T20:55:54.193 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 2.7919462340000001, 2020-11-16T20:55:54.193 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013208407, 2020-11-16T20:55:54.193 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:54.193 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:55:54.193 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:54.193 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:54.194 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:54.194 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 88 2020-11-16T20:55:54.194 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.194 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:54.194 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.194 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:54.194 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.173371+0000", 2020-11-16T20:55:54.195 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:54.195 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.195 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.195 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:54.195 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.173371+0000", 2020-11-16T20:55:54.195 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9215999999999999e-05 2020-11-16T20:55:54.195 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.196 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.196 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:54.196 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.173400+0000", 2020-11-16T20:55:54.196 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5339999999999999e-06 2020-11-16T20:55:54.196 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.196 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.196 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:54.197 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.173406+0000", 2020-11-16T20:55:54.197 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0661e-05 2020-11-16T20:55:54.197 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.197 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.197 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:54.197 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.173416+0000", 2020-11-16T20:55:54.197 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6530000000000002e-06 2020-11-16T20:55:54.197 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.198 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.198 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:54.198 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.173421+0000", 2020-11-16T20:55:54.198 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018216700000000001 2020-11-16T20:55:54.198 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.198 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.198 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.199 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.173603+0000", 2020-11-16T20:55:54.199 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7417999999999998e-05 2020-11-16T20:55:54.199 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.199 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.199 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:54.199 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.173660+0000", 2020-11-16T20:55:54.199 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0046079729999999996 2020-11-16T20:55:54.200 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.200 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.200 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.200 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.178268+0000", 2020-11-16T20:55:54.200 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000115486 2020-11-16T20:55:54.200 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.200 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.200 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:55:54.201 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.178384+0000", 2020-11-16T20:55:54.201 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0059156219999999997 2020-11-16T20:55:54.201 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.201 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.201 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.201 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.184300+0000", 2020-11-16T20:55:54.201 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011126 2020-11-16T20:55:54.202 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.202 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.202 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:54.202 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.184411+0000", 2020-11-16T20:55:54.202 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021684170000000002 2020-11-16T20:55:54.202 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.202 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.202 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:54.203 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.186579+0000", 2020-11-16T20:55:54.203 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013208407 2020-11-16T20:55:54.203 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.203 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:54.203 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.203 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.203 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:54.204 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:54.211 INFO:tasks.rados.rados.0.smithi166.stdout:196: writing smithi16641208-196 from 3122307 to 3277365 tid 3 2020-11-16T20:55:54.212 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.212 INFO:tasks.rados.rados.0.smithi166.stdout:181: finishing write tid 3 to smithi16641208-181 2020-11-16T20:55:54.212 INFO:tasks.rados.rados.0.smithi166.stdout:181: finishing write tid 4 to smithi16641208-181 2020-11-16T20:55:54.212 INFO:tasks.rados.rados.0.smithi166.stdout:181: finishing write tid 5 to smithi16641208-181 2020-11-16T20:55:54.212 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 181 v 108 (ObjNum 180 snap 0 seq_num 180) dirty exists 2020-11-16T20:55:54.212 INFO:tasks.rados.rados.0.smithi166.stdout:181: left oid 181 (ObjNum 180 snap 0 seq_num 180) 2020-11-16T20:55:54.212 INFO:tasks.rados.rados.0.smithi166.stdout:182: finishing write tid 1 to smithi16641208-182 2020-11-16T20:55:54.213 INFO:tasks.rados.rados.0.smithi166.stdout:182: finishing write tid 2 to smithi16641208-182 2020-11-16T20:55:54.213 INFO:tasks.rados.rados.0.smithi166.stdout:181: done (15 left) 2020-11-16T20:55:54.213 INFO:tasks.rados.rados.0.smithi166.stdout:197: write initial oid 197 2020-11-16T20:55:54.213 INFO:tasks.rados.rados.0.smithi166.stdout:182: finishing write tid 3 to smithi16641208-182 2020-11-16T20:55:54.213 INFO:tasks.rados.rados.0.smithi166.stdout:182: finishing write tid 4 to smithi16641208-182 2020-11-16T20:55:54.213 INFO:tasks.rados.rados.0.smithi166.stdout:197: seq_num 196 ranges {494172=457629,1586353=512385,2749730=544442} 2020-11-16T20:55:54.213 INFO:tasks.rados.rados.0.smithi166.stdout:197: writing smithi16641208-197 from 494172 to 951801 tid 1 2020-11-16T20:55:54.213 INFO:tasks.rados.rados.0.smithi166.stdout:197: writing smithi16641208-197 from 1586353 to 2098738 tid 2 2020-11-16T20:55:54.214 INFO:tasks.rados.rados.0.smithi166.stdout:197: writing smithi16641208-197 from 2749730 to 3294172 tid 3 2020-11-16T20:55:54.214 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.214 INFO:tasks.rados.rados.0.smithi166.stdout:182: finishing write tid 5 to smithi16641208-182 2020-11-16T20:55:54.214 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 182 v 123 (ObjNum 181 snap 0 seq_num 181) dirty exists 2020-11-16T20:55:54.214 INFO:tasks.rados.rados.0.smithi166.stdout:182: left oid 182 (ObjNum 181 snap 0 seq_num 181) 2020-11-16T20:55:54.214 INFO:tasks.rados.rados.0.smithi166.stdout:182: done (15 left) 2020-11-16T20:55:54.214 INFO:tasks.rados.rados.0.smithi166.stdout:198: write initial oid 198 2020-11-16T20:55:54.215 INFO:tasks.rados.rados.0.smithi166.stdout:198: seq_num 197 ranges {510979=532878,1528482=772396,3060800=250179} 2020-11-16T20:55:54.215 INFO:tasks.rados.rados.0.smithi166.stdout:198: writing smithi16641208-198 from 510979 to 1043857 tid 1 2020-11-16T20:55:54.215 INFO:tasks.rados.rados.0.smithi166.stdout:198: writing smithi16641208-198 from 1528482 to 2300878 tid 2 2020-11-16T20:55:54.215 INFO:tasks.rados.rados.0.smithi166.stdout:198: writing smithi16641208-198 from 3060800 to 3310979 tid 3 2020-11-16T20:55:54.215 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.215 INFO:tasks.rados.rados.0.smithi166.stdout:183: finishing write tid 1 to smithi16641208-183 2020-11-16T20:55:54.215 INFO:tasks.rados.rados.0.smithi166.stdout:183: finishing write tid 2 to smithi16641208-183 2020-11-16T20:55:54.216 INFO:tasks.rados.rados.0.smithi166.stdout:183: finishing write tid 3 to smithi16641208-183 2020-11-16T20:55:54.216 INFO:tasks.rados.rados.0.smithi166.stdout:183: finishing write tid 4 to smithi16641208-183 2020-11-16T20:55:54.216 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 183 v 126 (ObjNum 182 snap 0 seq_num 182) dirty exists 2020-11-16T20:55:54.216 INFO:tasks.rados.rados.0.smithi166.stdout:183: left oid 183 (ObjNum 182 snap 0 seq_num 182) 2020-11-16T20:55:54.216 INFO:tasks.rados.rados.0.smithi166.stdout:184: finishing write tid 1 to smithi16641208-184 2020-11-16T20:55:54.216 INFO:tasks.rados.rados.0.smithi166.stdout:183: done (15 left) 2020-11-16T20:55:54.216 INFO:tasks.rados.rados.0.smithi166.stdout:199: write initial oid 199 2020-11-16T20:55:54.216 INFO:tasks.rados.rados.0.smithi166.stdout:199: seq_num 198 ranges {527786=724480,1703317=516054,2804576=435035} 2020-11-16T20:55:54.217 INFO:tasks.rados.rados.0.smithi166.stdout:199: writing smithi16641208-199 from 527786 to 1252266 tid 1 2020-11-16T20:55:54.217 INFO:tasks.rados.rados.0.smithi166.stdout:199: writing smithi16641208-199 from 1703317 to 2219371 tid 2 2020-11-16T20:55:54.217 INFO:tasks.rados.rados.0.smithi166.stdout:199: writing smithi16641208-199 from 2804576 to 3239611 tid 3 2020-11-16T20:55:54.217 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.217 INFO:tasks.rados.rados.0.smithi166.stdout:184: finishing write tid 2 to smithi16641208-184 2020-11-16T20:55:54.217 INFO:tasks.rados.rados.0.smithi166.stdout:184: finishing write tid 3 to smithi16641208-184 2020-11-16T20:55:54.217 INFO:tasks.rados.rados.0.smithi166.stdout:184: finishing write tid 4 to smithi16641208-184 2020-11-16T20:55:54.217 INFO:tasks.rados.rados.0.smithi166.stdout:184: finishing write tid 5 to smithi16641208-184 2020-11-16T20:55:54.218 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 184 v 112 (ObjNum 183 snap 0 seq_num 183) dirty exists 2020-11-16T20:55:54.218 INFO:tasks.rados.rados.0.smithi166.stdout:184: left oid 184 (ObjNum 183 snap 0 seq_num 183) 2020-11-16T20:55:54.218 INFO:tasks.rados.rados.0.smithi166.stdout:185: finishing write tid 1 to smithi16641208-185 2020-11-16T20:55:54.218 INFO:tasks.rados.rados.0.smithi166.stdout:184: done (15 left) 2020-11-16T20:55:54.218 INFO:tasks.rados.rados.0.smithi166.stdout:200: write initial oid 200 2020-11-16T20:55:54.218 INFO:tasks.rados.rados.0.smithi166.stdout:200: seq_num 199 ranges {544593=799729,1761799=776065,2948352=396241} 2020-11-16T20:55:54.218 INFO:tasks.rados.rados.0.smithi166.stdout:200: writing smithi16641208-200 from 544593 to 1344322 tid 1 2020-11-16T20:55:54.219 INFO:tasks.rados.rados.0.smithi166.stdout:200: writing smithi16641208-200 from 1761799 to 2537864 tid 2 2020-11-16T20:55:54.219 INFO:tasks.rados.rados.0.smithi166.stdout:200: writing smithi16641208-200 from 2948352 to 3344593 tid 3 2020-11-16T20:55:54.219 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.219 INFO:tasks.rados.rados.0.smithi166.stdout:185: finishing write tid 2 to smithi16641208-185 2020-11-16T20:55:54.219 INFO:tasks.rados.rados.0.smithi166.stdout:185: finishing write tid 3 to smithi16641208-185 2020-11-16T20:55:54.219 INFO:tasks.rados.rados.0.smithi166.stdout:186: finishing write tid 1 to smithi16641208-186 2020-11-16T20:55:54.219 INFO:tasks.rados.rados.0.smithi166.stdout:186: finishing write tid 2 to smithi16641208-186 2020-11-16T20:55:54.219 INFO:tasks.rados.rados.0.smithi166.stdout:186: finishing write tid 3 to smithi16641208-186 2020-11-16T20:55:54.220 INFO:tasks.rados.rados.0.smithi166.stdout:185: finishing write tid 4 to smithi16641208-185 2020-11-16T20:55:54.220 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 185 v 156 (ObjNum 184 snap 0 seq_num 184) dirty exists 2020-11-16T20:55:54.220 INFO:tasks.rados.rados.0.smithi166.stdout:185: left oid 185 (ObjNum 184 snap 0 seq_num 184) 2020-11-16T20:55:54.220 INFO:tasks.rados.rados.0.smithi166.stdout:187: finishing write tid 1 to smithi16641208-187 2020-11-16T20:55:54.220 INFO:tasks.rados.rados.0.smithi166.stdout:187: finishing write tid 2 to smithi16641208-187 2020-11-16T20:55:54.220 INFO:tasks.rados.rados.0.smithi166.stdout:185: done (15 left) 2020-11-16T20:55:54.220 INFO:tasks.rados.rados.0.smithi166.stdout:201: write initial oid 201 2020-11-16T20:55:54.221 INFO:tasks.rados.rados.0.smithi166.stdout:187: finishing write tid 3 to smithi16641208-187 2020-11-16T20:55:54.221 INFO:tasks.rados.rados.0.smithi166.stdout:188: finishing write tid 1 to smithi16641208-188 2020-11-16T20:55:54.221 INFO:tasks.rados.rados.0.smithi166.stdout:201: seq_num 200 ranges {561400=474978,1820281=519723,2859422=457579} 2020-11-16T20:55:54.221 INFO:tasks.rados.rados.0.smithi166.stdout:201: writing smithi16641208-201 from 561400 to 1036378 tid 1 2020-11-16T20:55:54.221 INFO:tasks.rados.rados.0.smithi166.stdout:201: writing smithi16641208-201 from 1820281 to 2340004 tid 2 2020-11-16T20:55:54.221 INFO:tasks.rados.rados.0.smithi166.stdout:201: writing smithi16641208-201 from 2859422 to 3317001 tid 3 2020-11-16T20:55:54.221 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.221 INFO:tasks.rados.rados.0.smithi166.stdout:186: finishing write tid 4 to smithi16641208-186 2020-11-16T20:55:54.222 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 186 v 115 (ObjNum 185 snap 0 seq_num 185) dirty exists 2020-11-16T20:55:54.222 INFO:tasks.rados.rados.0.smithi166.stdout:186: left oid 186 (ObjNum 185 snap 0 seq_num 185) 2020-11-16T20:55:54.222 INFO:tasks.rados.rados.0.smithi166.stdout:186: done (15 left) 2020-11-16T20:55:54.222 INFO:tasks.rados.rados.0.smithi166.stdout:202: write initial oid 202 2020-11-16T20:55:54.222 INFO:tasks.rados.rados.0.smithi166.stdout:202: seq_num 201 ranges {578207=550227,1762410=779734,3286845=91362} 2020-11-16T20:55:54.222 INFO:tasks.rados.rados.0.smithi166.stdout:202: writing smithi16641208-202 from 578207 to 1128434 tid 1 2020-11-16T20:55:54.222 INFO:tasks.rados.rados.0.smithi166.stdout:202: writing smithi16641208-202 from 1762410 to 2542144 tid 2 2020-11-16T20:55:54.223 INFO:tasks.rados.rados.0.smithi166.stdout:202: writing smithi16641208-202 from 3286845 to 3378207 tid 3 2020-11-16T20:55:54.223 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.223 INFO:tasks.rados.rados.0.smithi166.stdout:187: finishing write tid 4 to smithi16641208-187 2020-11-16T20:55:54.223 INFO:tasks.rados.rados.0.smithi166.stdout:187: finishing write tid 5 to smithi16641208-187 2020-11-16T20:55:54.223 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 187 v 130 (ObjNum 186 snap 0 seq_num 186) dirty exists 2020-11-16T20:55:54.223 INFO:tasks.rados.rados.0.smithi166.stdout:187: left oid 187 (ObjNum 186 snap 0 seq_num 186) 2020-11-16T20:55:54.223 INFO:tasks.rados.rados.0.smithi166.stdout:188: finishing write tid 2 to smithi16641208-188 2020-11-16T20:55:54.223 INFO:tasks.rados.rados.0.smithi166.stdout:188: finishing write tid 3 to smithi16641208-188 2020-11-16T20:55:54.224 INFO:tasks.rados.rados.0.smithi166.stdout:187: done (15 left) 2020-11-16T20:55:54.224 INFO:tasks.rados.rados.0.smithi166.stdout:203: write initial oid 203 2020-11-16T20:55:54.224 INFO:tasks.rados.rados.0.smithi166.stdout:203: seq_num 202 ranges {595014=625476,1820892=523392,2797915=596476} 2020-11-16T20:55:54.224 INFO:tasks.rados.rados.0.smithi166.stdout:203: writing smithi16641208-203 from 595014 to 1220490 tid 1 2020-11-16T20:55:54.224 INFO:tasks.rados.rados.0.smithi166.stdout:203: writing smithi16641208-203 from 1820892 to 2344284 tid 2 2020-11-16T20:55:54.224 INFO:tasks.rados.rados.0.smithi166.stdout:203: writing smithi16641208-203 from 2797915 to 3394391 tid 3 2020-11-16T20:55:54.224 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.224 INFO:tasks.rados.rados.0.smithi166.stdout:188: finishing write tid 4 to smithi16641208-188 2020-11-16T20:55:54.225 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 188 v 132 (ObjNum 187 snap 0 seq_num 187) dirty exists 2020-11-16T20:55:54.225 INFO:tasks.rados.rados.0.smithi166.stdout:188: left oid 188 (ObjNum 187 snap 0 seq_num 187) 2020-11-16T20:55:54.225 INFO:tasks.rados.rados.0.smithi166.stdout:189: finishing write tid 1 to smithi16641208-189 2020-11-16T20:55:54.225 INFO:tasks.rados.rados.0.smithi166.stdout:189: finishing write tid 2 to smithi16641208-189 2020-11-16T20:55:54.225 INFO:tasks.rados.rados.0.smithi166.stdout:189: finishing write tid 3 to smithi16641208-189 2020-11-16T20:55:54.225 INFO:tasks.rados.rados.0.smithi166.stdout:189: finishing write tid 4 to smithi16641208-189 2020-11-16T20:55:54.225 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 189 v 95 (ObjNum 188 snap 0 seq_num 188) dirty exists 2020-11-16T20:55:54.226 INFO:tasks.rados.rados.0.smithi166.stdout:189: left oid 189 (ObjNum 188 snap 0 seq_num 188) 2020-11-16T20:55:54.226 INFO:tasks.rados.rados.0.smithi166.stdout:190: finishing write tid 1 to smithi16641208-190 2020-11-16T20:55:54.226 INFO:tasks.rados.rados.0.smithi166.stdout:190: finishing write tid 2 to smithi16641208-190 2020-11-16T20:55:54.226 INFO:tasks.rados.rados.0.smithi166.stdout:188: done (15 left) 2020-11-16T20:55:54.226 INFO:tasks.rados.rados.0.smithi166.stdout:189: done (14 left) 2020-11-16T20:55:54.226 INFO:tasks.rados.rados.0.smithi166.stdout:204: write initial oid 204 2020-11-16T20:55:54.226 INFO:tasks.rados.rados.0.smithi166.stdout:204: seq_num 203 ranges {611821=700725,1879374=783403,3341691=70130} 2020-11-16T20:55:54.226 INFO:tasks.rados.rados.0.smithi166.stdout:204: writing smithi16641208-204 from 611821 to 1312546 tid 1 2020-11-16T20:55:54.227 INFO:tasks.rados.rados.0.smithi166.stdout:204: writing smithi16641208-204 from 1879374 to 2662777 tid 2 2020-11-16T20:55:54.227 INFO:tasks.rados.rados.0.smithi166.stdout:204: writing smithi16641208-204 from 3341691 to 3411821 tid 3 2020-11-16T20:55:54.227 INFO:tasks.rados.rados.0.smithi166.stdout:205: write initial oid 205 2020-11-16T20:55:54.227 INFO:tasks.rados.rados.0.smithi166.stdout:205: seq_num 204 ranges {628628=775974,1937856=527061,3252761=175867} 2020-11-16T20:55:54.227 INFO:tasks.rados.rados.0.smithi166.stdout:205: writing smithi16641208-205 from 628628 to 1404602 tid 1 2020-11-16T20:55:54.227 INFO:tasks.rados.rados.0.smithi166.stdout:205: writing smithi16641208-205 from 1937856 to 2464917 tid 2 2020-11-16T20:55:54.227 INFO:tasks.rados.rados.0.smithi166.stdout:205: writing smithi16641208-205 from 3252761 to 3428628 tid 3 2020-11-16T20:55:54.228 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.228 INFO:tasks.rados.rados.0.smithi166.stdout:191: finishing write tid 1 to smithi16641208-191 2020-11-16T20:55:54.228 INFO:tasks.rados.rados.0.smithi166.stdout:190: finishing write tid 3 to smithi16641208-190 2020-11-16T20:55:54.228 INFO:tasks.rados.rados.0.smithi166.stdout:191: finishing write tid 2 to smithi16641208-191 2020-11-16T20:55:54.228 INFO:tasks.rados.rados.0.smithi166.stdout:190: finishing write tid 4 to smithi16641208-190 2020-11-16T20:55:54.228 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 190 v 118 (ObjNum 189 snap 0 seq_num 189) dirty exists 2020-11-16T20:55:54.228 INFO:tasks.rados.rados.0.smithi166.stdout:190: left oid 190 (ObjNum 189 snap 0 seq_num 189) 2020-11-16T20:55:54.228 INFO:tasks.rados.rados.0.smithi166.stdout:191: finishing write tid 3 to smithi16641208-191 2020-11-16T20:55:54.229 INFO:tasks.rados.rados.0.smithi166.stdout:190: done (15 left) 2020-11-16T20:55:54.229 INFO:tasks.rados.rados.0.smithi166.stdout:206: write initial oid 206 2020-11-16T20:55:54.229 INFO:tasks.rados.rados.0.smithi166.stdout:206: seq_num 205 ranges {645435=451223,1879985=787072,3280184=165251} 2020-11-16T20:55:54.229 INFO:tasks.rados.rados.0.smithi166.stdout:206: writing smithi16641208-206 from 645435 to 1096658 tid 1 2020-11-16T20:55:54.229 INFO:tasks.rados.rados.0.smithi166.stdout:206: writing smithi16641208-206 from 1879985 to 2667057 tid 2 2020-11-16T20:55:54.229 INFO:tasks.rados.rados.0.smithi166.stdout:206: writing smithi16641208-206 from 3280184 to 3445435 tid 3 2020-11-16T20:55:54.229 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.229 INFO:tasks.rados.rados.0.smithi166.stdout:191: finishing write tid 4 to smithi16641208-191 2020-11-16T20:55:54.230 INFO:tasks.rados.rados.0.smithi166.stdout:191: finishing write tid 5 to smithi16641208-191 2020-11-16T20:55:54.230 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 191 v 160 (ObjNum 190 snap 0 seq_num 190) dirty exists 2020-11-16T20:55:54.230 INFO:tasks.rados.rados.0.smithi166.stdout:191: left oid 191 (ObjNum 190 snap 0 seq_num 190) 2020-11-16T20:55:54.230 INFO:tasks.rados.rados.0.smithi166.stdout:192: finishing write tid 1 to smithi16641208-192 2020-11-16T20:55:54.230 INFO:tasks.rados.rados.0.smithi166.stdout:192: finishing write tid 2 to smithi16641208-192 2020-11-16T20:55:54.230 INFO:tasks.rados.rados.0.smithi166.stdout:192: finishing write tid 3 to smithi16641208-192 2020-11-16T20:55:54.230 INFO:tasks.rados.rados.0.smithi166.stdout:191: done (15 left) 2020-11-16T20:55:54.231 INFO:tasks.rados.rados.0.smithi166.stdout:207: write initial oid 207 2020-11-16T20:55:54.231 INFO:tasks.rados.rados.0.smithi166.stdout:207: seq_num 206 ranges {662242=642825,2054820=530730,3307607=154635} 2020-11-16T20:55:54.231 INFO:tasks.rados.rados.0.smithi166.stdout:207: writing smithi16641208-207 from 662242 to 1305067 tid 1 2020-11-16T20:55:54.231 INFO:tasks.rados.rados.0.smithi166.stdout:207: writing smithi16641208-207 from 2054820 to 2585550 tid 2 2020-11-16T20:55:54.231 INFO:tasks.rados.rados.0.smithi166.stdout:207: writing smithi16641208-207 from 3307607 to 3462242 tid 3 2020-11-16T20:55:54.231 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.231 INFO:tasks.rados.rados.0.smithi166.stdout:192: finishing write tid 4 to smithi16641208-192 2020-11-16T20:55:54.231 INFO:tasks.rados.rados.0.smithi166.stdout:192: finishing write tid 5 to smithi16641208-192 2020-11-16T20:55:54.232 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 192 v 164 (ObjNum 191 snap 0 seq_num 191) dirty exists 2020-11-16T20:55:54.232 INFO:tasks.rados.rados.0.smithi166.stdout:192: left oid 192 (ObjNum 191 snap 0 seq_num 191) 2020-11-16T20:55:54.232 INFO:tasks.rados.rados.0.smithi166.stdout:193: finishing write tid 1 to smithi16641208-193 2020-11-16T20:55:54.232 INFO:tasks.rados.rados.0.smithi166.stdout:193: finishing write tid 2 to smithi16641208-193 2020-11-16T20:55:54.232 INFO:tasks.rados.rados.0.smithi166.stdout:193: finishing write tid 3 to smithi16641208-193 2020-11-16T20:55:54.232 INFO:tasks.rados.rados.0.smithi166.stdout:193: finishing write tid 4 to smithi16641208-193 2020-11-16T20:55:54.232 INFO:tasks.rados.rados.0.smithi166.stdout:193: finishing write tid 5 to smithi16641208-193 2020-11-16T20:55:54.232 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 193 v 168 (ObjNum 192 snap 0 seq_num 192) dirty exists 2020-11-16T20:55:54.233 INFO:tasks.rados.rados.0.smithi166.stdout:193: left oid 193 (ObjNum 192 snap 0 seq_num 192) 2020-11-16T20:55:54.233 INFO:tasks.rados.rados.0.smithi166.stdout:194: finishing write tid 1 to smithi16641208-194 2020-11-16T20:55:54.233 INFO:tasks.rados.rados.0.smithi166.stdout:194: finishing write tid 2 to smithi16641208-194 2020-11-16T20:55:54.233 INFO:tasks.rados.rados.0.smithi166.stdout:194: finishing write tid 3 to smithi16641208-194 2020-11-16T20:55:54.233 INFO:tasks.rados.rados.0.smithi166.stdout:194: finishing write tid 4 to smithi16641208-194 2020-11-16T20:55:54.233 INFO:tasks.rados.rados.0.smithi166.stdout:194: finishing write tid 5 to smithi16641208-194 2020-11-16T20:55:54.233 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 194 v 99 (ObjNum 193 snap 0 seq_num 193) dirty exists 2020-11-16T20:55:54.234 INFO:tasks.rados.rados.0.smithi166.stdout:194: left oid 194 (ObjNum 193 snap 0 seq_num 193) 2020-11-16T20:55:54.234 INFO:tasks.rados.rados.0.smithi166.stdout:195: finishing write tid 1 to smithi16641208-195 2020-11-16T20:55:54.234 INFO:tasks.rados.rados.0.smithi166.stdout:195: finishing write tid 2 to smithi16641208-195 2020-11-16T20:55:54.234 INFO:tasks.rados.rados.0.smithi166.stdout:195: finishing write tid 3 to smithi16641208-195 2020-11-16T20:55:54.234 INFO:tasks.rados.rados.0.smithi166.stdout:195: finishing write tid 4 to smithi16641208-195 2020-11-16T20:55:54.234 INFO:tasks.rados.rados.0.smithi166.stdout:195: finishing write tid 5 to smithi16641208-195 2020-11-16T20:55:54.234 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 195 v 102 (ObjNum 194 snap 0 seq_num 194) dirty exists 2020-11-16T20:55:54.234 INFO:tasks.rados.rados.0.smithi166.stdout:195: left oid 195 (ObjNum 194 snap 0 seq_num 194) 2020-11-16T20:55:54.235 INFO:tasks.rados.rados.0.smithi166.stdout:192: done (15 left) 2020-11-16T20:55:54.235 INFO:tasks.rados.rados.0.smithi166.stdout:193: done (14 left) 2020-11-16T20:55:54.235 INFO:tasks.rados.rados.0.smithi166.stdout:194: done (13 left) 2020-11-16T20:55:54.235 INFO:tasks.rados.rados.0.smithi166.stdout:195: done (12 left) 2020-11-16T20:55:54.235 INFO:tasks.rados.rados.0.smithi166.stdout:208: write initial oid 208 2020-11-16T20:55:54.235 INFO:tasks.rados.rados.0.smithi166.stdout:208: seq_num 207 ranges {679049=718074,2113302=674388,3335030=144019} 2020-11-16T20:55:54.235 INFO:tasks.rados.rados.0.smithi166.stdout:208: writing smithi16641208-208 from 679049 to 1397123 tid 1 2020-11-16T20:55:54.236 INFO:tasks.rados.rados.0.smithi166.stdout:208: writing smithi16641208-208 from 2113302 to 2787690 tid 2 2020-11-16T20:55:54.236 INFO:tasks.rados.rados.0.smithi166.stdout:208: writing smithi16641208-208 from 3335030 to 3479049 tid 3 2020-11-16T20:55:54.236 INFO:tasks.rados.rados.0.smithi166.stdout:209: write initial oid 209 2020-11-16T20:55:54.236 INFO:tasks.rados.rados.0.smithi166.stdout:209: seq_num 208 ranges {695856=793323,2171784=534399,3362453=133403} 2020-11-16T20:55:54.236 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:55:54.237 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:55:54.237 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:55:54.237 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:55:54.237 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:55:54.237 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:55:54.238 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:55:54.238 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:55:54.238 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:55:54.238 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:55:54.238 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:55:54.238 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:55:54.239 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:55:54.239 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:55:54.239 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:54.208+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:54.240 INFO:tasks.rados.rados.0.smithi166.stdout:209: writing smithi16641208-209 from 695856 to 1489179 tid 1 2020-11-16T20:55:54.240 INFO:tasks.rados.rados.0.smithi166.stdout:209: writing smithi16641208-209 from 2171784 to 2706183 tid 2 2020-11-16T20:55:54.240 INFO:tasks.rados.rados.0.smithi166.stdout:209: writing smithi16641208-209 from 3362453 to 3495856 tid 3 2020-11-16T20:55:54.240 INFO:tasks.rados.rados.0.smithi166.stdout:210: write initial oid 210 2020-11-16T20:55:54.240 INFO:tasks.rados.rados.0.smithi166.stdout:210: seq_num 209 ranges {712663=468572,1713913=678057,2873523=591733} 2020-11-16T20:55:54.241 INFO:tasks.rados.rados.0.smithi166.stdout:210: writing smithi16641208-210 from 712663 to 1181235 tid 1 2020-11-16T20:55:54.241 INFO:tasks.rados.rados.0.smithi166.stdout:210: writing smithi16641208-210 from 1713913 to 2391970 tid 2 2020-11-16T20:55:54.244 INFO:tasks.rados.rados.0.smithi166.stdout:210: writing smithi16641208-210 from 2873523 to 3465256 tid 3 2020-11-16T20:55:54.244 INFO:tasks.rados.rados.0.smithi166.stdout:211: write initial oid 211 2020-11-16T20:55:54.244 INFO:tasks.rados.rados.0.smithi166.stdout:211: seq_num 210 ranges {729470=543821,1772395=538068,2900946=403005} 2020-11-16T20:55:54.251 INFO:tasks.rados.rados.0.smithi166.stdout:211: writing smithi16641208-211 from 729470 to 1273291 tid 1 2020-11-16T20:55:54.256 INFO:tasks.rados.rados.0.smithi166.stdout:211: writing smithi16641208-211 from 1772395 to 2310463 tid 2 2020-11-16T20:55:54.263 INFO:tasks.rados.rados.0.smithi166.stdout:211: writing smithi16641208-211 from 2900946 to 3303951 tid 3 2020-11-16T20:55:54.263 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.264 INFO:tasks.rados.rados.0.smithi166.stdout:196: finishing write tid 1 to smithi16641208-196 2020-11-16T20:55:54.264 INFO:tasks.rados.rados.0.smithi166.stdout:196: finishing write tid 2 to smithi16641208-196 2020-11-16T20:55:54.264 INFO:tasks.rados.rados.0.smithi166.stdout:196: finishing write tid 3 to smithi16641208-196 2020-11-16T20:55:54.264 INFO:tasks.rados.rados.0.smithi166.stdout:196: finishing write tid 4 to smithi16641208-196 2020-11-16T20:55:54.264 INFO:tasks.rados.rados.0.smithi166.stdout:196: finishing write tid 5 to smithi16641208-196 2020-11-16T20:55:54.264 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 196 v 121 (ObjNum 195 snap 0 seq_num 195) dirty exists 2020-11-16T20:55:54.264 INFO:tasks.rados.rados.0.smithi166.stdout:196: left oid 196 (ObjNum 195 snap 0 seq_num 195) 2020-11-16T20:55:54.265 INFO:tasks.rados.rados.0.smithi166.stdout:197: finishing write tid 1 to smithi16641208-197 2020-11-16T20:55:54.265 INFO:tasks.rados.rados.0.smithi166.stdout:197: finishing write tid 2 to smithi16641208-197 2020-11-16T20:55:54.265 INFO:tasks.rados.rados.0.smithi166.stdout:197: finishing write tid 3 to smithi16641208-197 2020-11-16T20:55:54.265 INFO:tasks.rados.rados.0.smithi166.stdout:197: finishing write tid 4 to smithi16641208-197 2020-11-16T20:55:54.265 INFO:tasks.rados.rados.0.smithi166.stdout:197: finishing write tid 5 to smithi16641208-197 2020-11-16T20:55:54.265 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 197 v 172 (ObjNum 196 snap 0 seq_num 196) dirty exists 2020-11-16T20:55:54.265 INFO:tasks.rados.rados.0.smithi166.stdout:197: left oid 197 (ObjNum 196 snap 0 seq_num 196) 2020-11-16T20:55:54.265 INFO:tasks.rados.rados.0.smithi166.stdout:198: finishing write tid 1 to smithi16641208-198 2020-11-16T20:55:54.266 INFO:tasks.rados.rados.0.smithi166.stdout:198: finishing write tid 2 to smithi16641208-198 2020-11-16T20:55:54.266 INFO:tasks.rados.rados.0.smithi166.stdout:198: finishing write tid 3 to smithi16641208-198 2020-11-16T20:55:54.266 INFO:tasks.rados.rados.0.smithi166.stdout:198: finishing write tid 4 to smithi16641208-198 2020-11-16T20:55:54.266 INFO:tasks.rados.rados.0.smithi166.stdout:198: finishing write tid 5 to smithi16641208-198 2020-11-16T20:55:54.266 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 198 v 125 (ObjNum 197 snap 0 seq_num 197) dirty exists 2020-11-16T20:55:54.266 INFO:tasks.rados.rados.0.smithi166.stdout:198: left oid 198 (ObjNum 197 snap 0 seq_num 197) 2020-11-16T20:55:54.266 INFO:tasks.rados.rados.0.smithi166.stdout:199: finishing write tid 1 to smithi16641208-199 2020-11-16T20:55:54.267 INFO:tasks.rados.rados.0.smithi166.stdout:199: finishing write tid 2 to smithi16641208-199 2020-11-16T20:55:54.267 INFO:tasks.rados.rados.0.smithi166.stdout:199: finishing write tid 3 to smithi16641208-199 2020-11-16T20:55:54.267 INFO:tasks.rados.rados.0.smithi166.stdout:199: finishing write tid 4 to smithi16641208-199 2020-11-16T20:55:54.267 INFO:tasks.rados.rados.0.smithi166.stdout:199: finishing write tid 5 to smithi16641208-199 2020-11-16T20:55:54.267 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 199 v 101 (ObjNum 198 snap 0 seq_num 198) dirty exists 2020-11-16T20:55:54.267 INFO:tasks.rados.rados.0.smithi166.stdout:199: left oid 199 (ObjNum 198 snap 0 seq_num 198) 2020-11-16T20:55:54.267 INFO:tasks.rados.rados.0.smithi166.stdout:200: finishing write tid 1 to smithi16641208-200 2020-11-16T20:55:54.268 INFO:tasks.rados.rados.0.smithi166.stdout:200: finishing write tid 2 to smithi16641208-200 2020-11-16T20:55:54.268 INFO:tasks.rados.rados.0.smithi166.stdout:200: finishing write tid 3 to smithi16641208-200 2020-11-16T20:55:54.268 INFO:tasks.rados.rados.0.smithi166.stdout:200: finishing write tid 4 to smithi16641208-200 2020-11-16T20:55:54.268 INFO:tasks.rados.rados.0.smithi166.stdout:200: finishing write tid 5 to smithi16641208-200 2020-11-16T20:55:54.268 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 200 v 176 (ObjNum 199 snap 0 seq_num 199) dirty exists 2020-11-16T20:55:54.268 INFO:tasks.rados.rados.0.smithi166.stdout:200: left oid 200 (ObjNum 199 snap 0 seq_num 199) 2020-11-16T20:55:54.268 INFO:tasks.rados.rados.0.smithi166.stdout:201: finishing write tid 1 to smithi16641208-201 2020-11-16T20:55:54.268 INFO:tasks.rados.rados.0.smithi166.stdout:201: finishing write tid 2 to smithi16641208-201 2020-11-16T20:55:54.269 INFO:tasks.rados.rados.0.smithi166.stdout:201: finishing write tid 3 to smithi16641208-201 2020-11-16T20:55:54.269 INFO:tasks.rados.rados.0.smithi166.stdout:201: finishing write tid 4 to smithi16641208-201 2020-11-16T20:55:54.269 INFO:tasks.rados.rados.0.smithi166.stdout:201: finishing write tid 5 to smithi16641208-201 2020-11-16T20:55:54.269 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 201 v 180 (ObjNum 200 snap 0 seq_num 200) dirty exists 2020-11-16T20:55:54.269 INFO:tasks.rados.rados.0.smithi166.stdout:201: left oid 201 (ObjNum 200 snap 0 seq_num 200) 2020-11-16T20:55:54.269 INFO:tasks.rados.rados.0.smithi166.stdout:202: finishing write tid 1 to smithi16641208-202 2020-11-16T20:55:54.269 INFO:tasks.rados.rados.0.smithi166.stdout:202: finishing write tid 2 to smithi16641208-202 2020-11-16T20:55:54.270 INFO:tasks.rados.rados.0.smithi166.stdout:202: finishing write tid 3 to smithi16641208-202 2020-11-16T20:55:54.270 INFO:tasks.rados.rados.0.smithi166.stdout:202: finishing write tid 4 to smithi16641208-202 2020-11-16T20:55:54.270 INFO:tasks.rados.rados.0.smithi166.stdout:202: finishing write tid 5 to smithi16641208-202 2020-11-16T20:55:54.270 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 202 v 134 (ObjNum 201 snap 0 seq_num 201) dirty exists 2020-11-16T20:55:54.270 INFO:tasks.rados.rados.0.smithi166.stdout:202: left oid 202 (ObjNum 201 snap 0 seq_num 201) 2020-11-16T20:55:54.270 INFO:tasks.rados.rados.0.smithi166.stdout:203: finishing write tid 1 to smithi16641208-203 2020-11-16T20:55:54.270 INFO:tasks.rados.rados.0.smithi166.stdout:203: finishing write tid 2 to smithi16641208-203 2020-11-16T20:55:54.270 INFO:tasks.rados.rados.0.smithi166.stdout:196: done (15 left) 2020-11-16T20:55:54.271 INFO:tasks.rados.rados.0.smithi166.stdout:197: done (14 left) 2020-11-16T20:55:54.271 INFO:tasks.rados.rados.0.smithi166.stdout:198: done (13 left) 2020-11-16T20:55:54.271 INFO:tasks.rados.rados.0.smithi166.stdout:199: done (12 left) 2020-11-16T20:55:54.271 INFO:tasks.rados.rados.0.smithi166.stdout:200: done (11 left) 2020-11-16T20:55:54.271 INFO:tasks.rados.rados.0.smithi166.stdout:201: done (10 left) 2020-11-16T20:55:54.271 INFO:tasks.rados.rados.0.smithi166.stdout:202: done (9 left) 2020-11-16T20:55:54.271 INFO:tasks.rados.rados.0.smithi166.stdout:212: write initial oid 212 2020-11-16T20:55:54.272 INFO:tasks.rados.rados.0.smithi166.stdout:212: seq_num 211 ranges {746277=619070,1830877=681726,2928369=617908} 2020-11-16T20:55:54.272 INFO:tasks.rados.rados.0.smithi166.stdout:212: writing smithi16641208-212 from 746277 to 1365347 tid 1 2020-11-16T20:55:54.275 INFO:teuthology.orchestra.run.smithi166.stdout:moved 0 / 81 (0%) 2020-11-16T20:55:54.276 INFO:teuthology.orchestra.run.smithi166.stdout:avg 10.125 2020-11-16T20:55:54.276 INFO:teuthology.orchestra.run.smithi166.stdout:stddev 2.42061 -> 2.42061 (expected baseline 2.97647) 2020-11-16T20:55:54.276 INFO:teuthology.orchestra.run.smithi166.stdout:min osd.2 with 7 -> 7 pgs (0.691358 -> 0.691358 * mean) 2020-11-16T20:55:54.276 INFO:teuthology.orchestra.run.smithi166.stdout:max osd.7 with 14 -> 14 pgs (1.38272 -> 1.38272 * mean) 2020-11-16T20:55:54.276 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:55:54.276 INFO:teuthology.orchestra.run.smithi166.stdout:oload 1000 2020-11-16T20:55:54.277 INFO:teuthology.orchestra.run.smithi166.stdout:max_change 0.05 2020-11-16T20:55:54.277 INFO:teuthology.orchestra.run.smithi166.stdout:max_change_osds 4 2020-11-16T20:55:54.277 INFO:teuthology.orchestra.run.smithi166.stdout:average_utilization 0.0003 2020-11-16T20:55:54.277 INFO:teuthology.orchestra.run.smithi166.stdout:overload_utilization 0.0033 2020-11-16T20:55:54.277 INFO:tasks.rados.rados.0.smithi166.stdout:212: writing smithi16641208-212 from 1830877 to 2512603 tid 2 2020-11-16T20:55:54.278 INFO:teuthology.orchestra.run.smithi166.stderr:no change 2020-11-16T20:55:54.283 INFO:tasks.rados.rados.0.smithi166.stdout:212: writing smithi16641208-212 from 2928369 to 3546277 tid 3 2020-11-16T20:55:54.283 INFO:tasks.rados.rados.0.smithi166.stdout:213: write initial oid 213 2020-11-16T20:55:54.283 INFO:tasks.rados.rados.0.smithi166.stdout:213: seq_num 212 ranges {763084=694319,1889359=541737,2955792=541902} 2020-11-16T20:55:54.292 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2020-11-16T20:55:54.292 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 0.05 2020-11-16T20:55:54.292 INFO:tasks.rados.rados.0.smithi166.stdout:213: writing smithi16641208-213 from 763084 to 1457403 tid 1 2020-11-16T20:55:54.297 INFO:tasks.rados.rados.0.smithi166.stdout:213: writing smithi16641208-213 from 1889359 to 2431096 tid 2 2020-11-16T20:55:54.304 INFO:tasks.rados.rados.0.smithi166.stdout:213: writing smithi16641208-213 from 2955792 to 3497694 tid 3 2020-11-16T20:55:54.304 INFO:tasks.rados.rados.0.smithi166.stdout:214: write initial oid 214 2020-11-16T20:55:54.304 INFO:tasks.rados.rados.0.smithi166.stdout:214: seq_num 213 ranges {779891=485921,1947841=685395,3383215=196676} 2020-11-16T20:55:54.307 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:55:54.310+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:55:54.311 INFO:tasks.rados.rados.0.smithi166.stdout:214: writing smithi16641208-214 from 779891 to 1265812 tid 1 2020-11-16T20:55:54.320 INFO:tasks.rados.rados.0.smithi166.stdout:214: writing smithi16641208-214 from 1947841 to 2633236 tid 2 2020-11-16T20:55:54.325 INFO:tasks.rados.rados.0.smithi166.stdout:214: writing smithi16641208-214 from 3383215 to 3579891 tid 3 2020-11-16T20:55:54.325 INFO:tasks.rados.rados.0.smithi166.stdout:215: write initial oid 215 2020-11-16T20:55:54.325 INFO:tasks.rados.rados.0.smithi166.stdout:215: seq_num 214 ranges {796698=561170,2006323=545406,3126991=469707} 2020-11-16T20:55:54.332 INFO:tasks.rados.rados.0.smithi166.stdout:215: writing smithi16641208-215 from 796698 to 1357868 tid 1 2020-11-16T20:55:54.339 INFO:tasks.rados.rados.0.smithi166.stdout:215: writing smithi16641208-215 from 2006323 to 2551729 tid 2 2020-11-16T20:55:54.345 INFO:tasks.rados.rados.0.smithi166.stdout:215: writing smithi16641208-215 from 3126991 to 3596698 tid 3 2020-11-16T20:55:54.345 INFO:tasks.rados.rados.0.smithi166.stdout:216: write initial oid 216 2020-11-16T20:55:54.345 INFO:tasks.rados.rados.0.smithi166.stdout:216: seq_num 215 ranges {413505=636419,1664805=689064,3038061=492071} 2020-11-16T20:55:54.351 INFO:tasks.rados.rados.0.smithi166.stdout:216: writing smithi16641208-216 from 413505 to 1049924 tid 1 2020-11-16T20:55:54.359 INFO:tasks.rados.rados.0.smithi166.stdout:216: writing smithi16641208-216 from 1664805 to 2353869 tid 2 2020-11-16T20:55:54.366 INFO:tasks.rados.rados.0.smithi166.stdout:216: writing smithi16641208-216 from 3038061 to 3530132 tid 3 2020-11-16T20:55:54.366 INFO:tasks.rados.rados.0.smithi166.stdout:217: write initial oid 217 2020-11-16T20:55:54.366 INFO:tasks.rados.rados.0.smithi166.stdout:217: seq_num 216 ranges {430312=711668,1723287=549075,2781837=703343} 2020-11-16T20:55:54.372 INFO:tasks.rados.rados.0.smithi166.stdout:217: writing smithi16641208-217 from 430312 to 1141980 tid 1 2020-11-16T20:55:54.379 INFO:tasks.rados.rados.0.smithi166.stdout:217: writing smithi16641208-217 from 1723287 to 2272362 tid 2 2020-11-16T20:55:54.386 INFO:tasks.rados.rados.0.smithi166.stdout:217: writing smithi16641208-217 from 2781837 to 3485180 tid 3 2020-11-16T20:55:54.386 INFO:tasks.rados.rados.0.smithi166.stdout:218: write initial oid 218 2020-11-16T20:55:54.386 INFO:tasks.rados.rados.0.smithi166.stdout:218: seq_num 217 ranges {447119=786917,1665416=692733,2976554=514615} 2020-11-16T20:55:54.393 INFO:tasks.rados.rados.0.smithi166.stdout:218: writing smithi16641208-218 from 447119 to 1234036 tid 1 2020-11-16T20:55:54.398 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:54.398 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:55:54.399 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:55:54.399 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:54.399 INFO:tasks.rados.rados.0.smithi166.stdout:218: writing smithi16641208-218 from 1665416 to 2358149 tid 2 2020-11-16T20:55:54.406 INFO:tasks.rados.rados.0.smithi166.stdout:218: writing smithi16641208-218 from 2976554 to 3491169 tid 3 2020-11-16T20:55:54.406 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.407 INFO:tasks.rados.rados.0.smithi166.stdout:203: finishing write tid 3 to smithi16641208-203 2020-11-16T20:55:54.407 INFO:tasks.rados.rados.0.smithi166.stdout:203: finishing write tid 4 to smithi16641208-203 2020-11-16T20:55:54.407 INFO:tasks.rados.rados.0.smithi166.stdout:203: finishing write tid 5 to smithi16641208-203 2020-11-16T20:55:54.407 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 203 v 105 (ObjNum 202 snap 0 seq_num 202) dirty exists 2020-11-16T20:55:54.407 INFO:tasks.rados.rados.0.smithi166.stdout:203: left oid 203 (ObjNum 202 snap 0 seq_num 202) 2020-11-16T20:55:54.407 INFO:tasks.rados.rados.0.smithi166.stdout:204: finishing write tid 1 to smithi16641208-204 2020-11-16T20:55:54.407 INFO:tasks.rados.rados.0.smithi166.stdout:203: done (15 left) 2020-11-16T20:55:54.408 INFO:tasks.rados.rados.0.smithi166.stdout:219: write initial oid 219 2020-11-16T20:55:54.408 INFO:tasks.rados.rados.0.smithi166.stdout:204: finishing write tid 2 to smithi16641208-204 2020-11-16T20:55:54.408 INFO:tasks.rados.rados.0.smithi166.stdout:204: finishing write tid 3 to smithi16641208-204 2020-11-16T20:55:54.408 INFO:tasks.rados.rados.0.smithi166.stdout:204: finishing write tid 4 to smithi16641208-204 2020-11-16T20:55:54.408 INFO:tasks.rados.rados.0.smithi166.stdout:204: finishing write tid 5 to smithi16641208-204 2020-11-16T20:55:54.408 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 204 v 136 (ObjNum 203 snap 0 seq_num 203) dirty exists 2020-11-16T20:55:54.408 INFO:tasks.rados.rados.0.smithi166.stdout:204: left oid 204 (ObjNum 203 snap 0 seq_num 203) 2020-11-16T20:55:54.409 INFO:tasks.rados.rados.0.smithi166.stdout:205: finishing write tid 1 to smithi16641208-205 2020-11-16T20:55:54.409 INFO:tasks.rados.rados.0.smithi166.stdout:219: seq_num 218 ranges {463926=462166,1723898=436391,2603977=725887} 2020-11-16T20:55:54.409 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:55:54.410+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:55:54.412 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:55:54.412 INFO:tasks.rados.rados.0.smithi166.stdout:219: writing smithi16641208-219 from 463926 to 926092 tid 1 2020-11-16T20:55:54.418 INFO:tasks.rados.rados.0.smithi166.stdout:219: writing smithi16641208-219 from 1723898 to 2160289 tid 2 2020-11-16T20:55:54.425 INFO:tasks.rados.rados.0.smithi166.stdout:219: writing smithi16641208-219 from 2603977 to 3329864 tid 3 2020-11-16T20:55:54.425 INFO:tasks.rados.rados.0.smithi166.stdout:204: done (15 left) 2020-11-16T20:55:54.425 INFO:tasks.rados.rados.0.smithi166.stdout:220: write initial oid 220 2020-11-16T20:55:54.426 INFO:tasks.rados.rados.0.smithi166.stdout:220: seq_num 219 ranges {480733=537415,1782380=696402,3031400=537159} 2020-11-16T20:55:54.431 INFO:tasks.rados.rados.0.smithi166.stdout:220: writing smithi16641208-220 from 480733 to 1018148 tid 1 2020-11-16T20:55:54.439 INFO:tasks.rados.rados.0.smithi166.stdout:220: writing smithi16641208-220 from 1782380 to 2478782 tid 2 2020-11-16T20:55:54.446 INFO:tasks.rados.rados.0.smithi166.stdout:220: writing smithi16641208-220 from 3031400 to 3568559 tid 3 2020-11-16T20:55:54.446 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.446 INFO:tasks.rados.rados.0.smithi166.stdout:205: finishing write tid 2 to smithi16641208-205 2020-11-16T20:55:54.447 INFO:tasks.rados.rados.0.smithi166.stdout:205: finishing write tid 3 to smithi16641208-205 2020-11-16T20:55:54.447 INFO:tasks.rados.rados.0.smithi166.stdout:205: finishing write tid 4 to smithi16641208-205 2020-11-16T20:55:54.447 INFO:tasks.rados.rados.0.smithi166.stdout:205: finishing write tid 5 to smithi16641208-205 2020-11-16T20:55:54.447 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 205 v 184 (ObjNum 204 snap 0 seq_num 204) dirty exists 2020-11-16T20:55:54.447 INFO:tasks.rados.rados.0.smithi166.stdout:205: left oid 205 (ObjNum 204 snap 0 seq_num 204) 2020-11-16T20:55:54.447 INFO:tasks.rados.rados.0.smithi166.stdout:206: finishing write tid 1 to smithi16641208-206 2020-11-16T20:55:54.447 INFO:tasks.rados.rados.0.smithi166.stdout:206: finishing write tid 2 to smithi16641208-206 2020-11-16T20:55:54.448 INFO:tasks.rados.rados.0.smithi166.stdout:205: done (15 left) 2020-11-16T20:55:54.448 INFO:tasks.rados.rados.0.smithi166.stdout:221: write initial oid 221 2020-11-16T20:55:54.448 INFO:tasks.rados.rados.0.smithi166.stdout:221: seq_num 220 ranges {497540=612664,1840862=440060,3058823=464784} 2020-11-16T20:55:54.452 INFO:tasks.rados.rados.0.smithi166.stdout:221: writing smithi16641208-221 from 497540 to 1110204 tid 1 2020-11-16T20:55:54.459 INFO:tasks.rados.rados.0.smithi166.stdout:221: writing smithi16641208-221 from 1840862 to 2280922 tid 2 2020-11-16T20:55:54.466 INFO:tasks.rados.rados.0.smithi166.stdout:221: writing smithi16641208-221 from 3058823 to 3523607 tid 3 2020-11-16T20:55:54.466 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.466 INFO:tasks.rados.rados.0.smithi166.stdout:206: finishing write tid 3 to smithi16641208-206 2020-11-16T20:55:54.467 INFO:tasks.rados.rados.0.smithi166.stdout:206: finishing write tid 4 to smithi16641208-206 2020-11-16T20:55:54.467 INFO:tasks.rados.rados.0.smithi166.stdout:206: finishing write tid 5 to smithi16641208-206 2020-11-16T20:55:54.467 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 206 v 140 (ObjNum 205 snap 0 seq_num 205) dirty exists 2020-11-16T20:55:54.467 INFO:tasks.rados.rados.0.smithi166.stdout:206: left oid 206 (ObjNum 205 snap 0 seq_num 205) 2020-11-16T20:55:54.467 INFO:tasks.rados.rados.0.smithi166.stdout:207: finishing write tid 1 to smithi16641208-207 2020-11-16T20:55:54.467 INFO:tasks.rados.rados.0.smithi166.stdout:207: finishing write tid 2 to smithi16641208-207 2020-11-16T20:55:54.467 INFO:tasks.rados.rados.0.smithi166.stdout:207: finishing write tid 3 to smithi16641208-207 2020-11-16T20:55:54.468 INFO:tasks.rados.rados.0.smithi166.stdout:207: finishing write tid 4 to smithi16641208-207 2020-11-16T20:55:54.468 INFO:tasks.rados.rados.0.smithi166.stdout:207: finishing write tid 5 to smithi16641208-207 2020-11-16T20:55:54.468 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 207 v 108 (ObjNum 206 snap 0 seq_num 206) dirty exists 2020-11-16T20:55:54.468 INFO:tasks.rados.rados.0.smithi166.stdout:207: left oid 207 (ObjNum 206 snap 0 seq_num 206) 2020-11-16T20:55:54.468 INFO:tasks.rados.rados.0.smithi166.stdout:208: finishing write tid 1 to smithi16641208-208 2020-11-16T20:55:54.468 INFO:tasks.rados.rados.0.smithi166.stdout:208: finishing write tid 2 to smithi16641208-208 2020-11-16T20:55:54.468 INFO:tasks.rados.rados.0.smithi166.stdout:208: finishing write tid 3 to smithi16641208-208 2020-11-16T20:55:54.468 INFO:tasks.rados.rados.0.smithi166.stdout:206: done (15 left) 2020-11-16T20:55:54.469 INFO:tasks.rados.rados.0.smithi166.stdout:207: done (14 left) 2020-11-16T20:55:54.469 INFO:tasks.rados.rados.0.smithi166.stdout:222: write initial oid 222 2020-11-16T20:55:54.469 INFO:tasks.rados.rados.0.smithi166.stdout:222: seq_num 221 ranges {514347=404266,1499344=700071,2686246=676056} 2020-11-16T20:55:54.471 INFO:tasks.rados.rados.0.smithi166.stdout:222: writing smithi16641208-222 from 514347 to 918613 tid 1 2020-11-16T20:55:54.478 INFO:tasks.rados.rados.0.smithi166.stdout:222: writing smithi16641208-222 from 1499344 to 2199415 tid 2 2020-11-16T20:55:54.485 INFO:tasks.rados.rados.0.smithi166.stdout:222: writing smithi16641208-222 from 2686246 to 3362302 tid 3 2020-11-16T20:55:54.485 INFO:tasks.rados.rados.0.smithi166.stdout:223: write initial oid 223 2020-11-16T20:55:54.485 INFO:tasks.rados.rados.0.smithi166.stdout:208: finishing write tid 4 to smithi16641208-208 2020-11-16T20:55:54.485 INFO:tasks.rados.rados.0.smithi166.stdout:223: seq_num 222 ranges {531154=479515,1557826=443729,2713669=487328,3679295=51859} 2020-11-16T20:55:54.491 INFO:tasks.rados.rados.0.smithi166.stdout:223: writing smithi16641208-223 from 531154 to 1010669 tid 1 2020-11-16T20:55:54.496 INFO:tasks.rados.rados.0.smithi166.stdout:223: writing smithi16641208-223 from 1557826 to 2001555 tid 2 2020-11-16T20:55:54.503 INFO:tasks.rados.rados.0.smithi166.stdout:223: writing smithi16641208-223 from 2713669 to 3200997 tid 3 2020-11-16T20:55:54.506 INFO:tasks.rados.rados.0.smithi166.stdout:223: writing smithi16641208-223 from 3679295 to 3731154 tid 4 2020-11-16T20:55:54.506 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.506 INFO:tasks.rados.rados.0.smithi166.stdout:208: finishing write tid 5 to smithi16641208-208 2020-11-16T20:55:54.507 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 208 v 188 (ObjNum 207 snap 0 seq_num 207) dirty exists 2020-11-16T20:55:54.507 INFO:tasks.rados.rados.0.smithi166.stdout:208: left oid 208 (ObjNum 207 snap 0 seq_num 207) 2020-11-16T20:55:54.507 INFO:tasks.rados.rados.0.smithi166.stdout:208: done (15 left) 2020-11-16T20:55:54.507 INFO:tasks.rados.rados.0.smithi166.stdout:224: write initial oid 224 2020-11-16T20:55:54.507 INFO:tasks.rados.rados.0.smithi166.stdout:224: seq_num 223 ranges {547961=554764,1616308=703740,2741092=698600} 2020-11-16T20:55:54.509 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:55:54.513+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:55:54.512 INFO:tasks.rados.rados.0.smithi166.stdout:224: writing smithi16641208-224 from 547961 to 1102725 tid 1 2020-11-16T20:55:54.741 INFO:tasks.ceph.mgr.x.smithi059.stderr:2020-11-16T20:55:54.678+0000 7f8afd618700 -1 mgr.server reply reply (4) Interrupted system call no change 2020-11-16T20:55:54.741 INFO:tasks.rados.rados.0.smithi166.stdout:224: writing smithi16641208-224 from 1616308 to 2320048 tid 2 2020-11-16T20:55:54.741 INFO:tasks.rados.rados.0.smithi166.stdout:224: writing smithi16641208-224 from 2741092 to 3439692 tid 3 2020-11-16T20:55:54.741 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.742 INFO:tasks.rados.rados.0.smithi166.stdout:209: finishing write tid 1 to smithi16641208-209 2020-11-16T20:55:54.742 INFO:tasks.rados.rados.0.smithi166.stdout:209: finishing write tid 2 to smithi16641208-209 2020-11-16T20:55:54.742 INFO:tasks.rados.rados.0.smithi166.stdout:209: finishing write tid 3 to smithi16641208-209 2020-11-16T20:55:54.742 INFO:tasks.rados.rados.0.smithi166.stdout:209: finishing write tid 4 to smithi16641208-209 2020-11-16T20:55:54.742 INFO:tasks.rados.rados.0.smithi166.stdout:209: finishing write tid 5 to smithi16641208-209 2020-11-16T20:55:54.742 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 209 v 144 (ObjNum 208 snap 0 seq_num 208) dirty exists 2020-11-16T20:55:54.743 INFO:tasks.rados.rados.0.smithi166.stdout:209: left oid 209 (ObjNum 208 snap 0 seq_num 208) 2020-11-16T20:55:54.743 INFO:tasks.rados.rados.0.smithi166.stdout:210: finishing write tid 1 to smithi16641208-210 2020-11-16T20:55:54.743 INFO:tasks.rados.rados.0.smithi166.stdout:210: finishing write tid 2 to smithi16641208-210 2020-11-16T20:55:54.743 INFO:tasks.rados.rados.0.smithi166.stdout:210: finishing write tid 3 to smithi16641208-210 2020-11-16T20:55:54.743 INFO:tasks.rados.rados.0.smithi166.stdout:210: finishing write tid 4 to smithi16641208-210 2020-11-16T20:55:54.743 INFO:tasks.rados.rados.0.smithi166.stdout:210: finishing write tid 5 to smithi16641208-210 2020-11-16T20:55:54.743 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 210 v 192 (ObjNum 209 snap 0 seq_num 209) dirty exists 2020-11-16T20:55:54.744 INFO:tasks.rados.rados.0.smithi166.stdout:210: left oid 210 (ObjNum 209 snap 0 seq_num 209) 2020-11-16T20:55:54.744 INFO:tasks.rados.rados.0.smithi166.stdout:211: finishing write tid 1 to smithi16641208-211 2020-11-16T20:55:54.744 INFO:tasks.rados.rados.0.smithi166.stdout:211: finishing write tid 2 to smithi16641208-211 2020-11-16T20:55:54.744 INFO:tasks.rados.rados.0.smithi166.stdout:211: finishing write tid 3 to smithi16641208-211 2020-11-16T20:55:54.744 INFO:tasks.rados.rados.0.smithi166.stdout:209: done (15 left) 2020-11-16T20:55:54.744 INFO:tasks.rados.rados.0.smithi166.stdout:210: done (14 left) 2020-11-16T20:55:54.744 INFO:tasks.rados.rados.0.smithi166.stdout:225: write initial oid 225 2020-11-16T20:55:54.745 INFO:tasks.rados.rados.0.smithi166.stdout:225: seq_num 224 ranges {564768=630013,1674790=447398,2768515=626225} 2020-11-16T20:55:54.745 INFO:tasks.rados.rados.0.smithi166.stdout:225: writing smithi16641208-225 from 564768 to 1194781 tid 1 2020-11-16T20:55:54.745 INFO:tasks.rados.rados.0.smithi166.stdout:225: writing smithi16641208-225 from 1674790 to 2122188 tid 2 2020-11-16T20:55:54.745 INFO:tasks.rados.rados.0.smithi166.stdout:225: writing smithi16641208-225 from 2768515 to 3394740 tid 3 2020-11-16T20:55:54.745 INFO:tasks.rados.rados.0.smithi166.stdout:226: write initial oid 226 2020-11-16T20:55:54.745 INFO:tasks.rados.rados.0.smithi166.stdout:212: finishing write tid 1 to smithi16641208-212 2020-11-16T20:55:54.746 INFO:tasks.rados.rados.0.smithi166.stdout:226: seq_num 225 ranges {581575=705262,1733272=707409,3195938=437497} 2020-11-16T20:55:54.746 INFO:tasks.rados.rados.0.smithi166.stdout:226: writing smithi16641208-226 from 581575 to 1286837 tid 1 2020-11-16T20:55:54.746 INFO:tasks.rados.rados.0.smithi166.stdout:226: writing smithi16641208-226 from 1733272 to 2440681 tid 2 2020-11-16T20:55:54.746 INFO:tasks.rados.rados.0.smithi166.stdout:226: writing smithi16641208-226 from 3195938 to 3633435 tid 3 2020-11-16T20:55:54.746 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.746 INFO:tasks.rados.rados.0.smithi166.stdout:211: finishing write tid 4 to smithi16641208-211 2020-11-16T20:55:54.747 INFO:tasks.rados.rados.0.smithi166.stdout:211: finishing write tid 5 to smithi16641208-211 2020-11-16T20:55:54.747 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 211 v 110 (ObjNum 210 snap 0 seq_num 210) dirty exists 2020-11-16T20:55:54.747 INFO:tasks.rados.rados.0.smithi166.stdout:211: left oid 211 (ObjNum 210 snap 0 seq_num 210) 2020-11-16T20:55:54.747 INFO:tasks.rados.rados.0.smithi166.stdout:212: finishing write tid 2 to smithi16641208-212 2020-11-16T20:55:54.747 INFO:tasks.rados.rados.0.smithi166.stdout:212: finishing write tid 3 to smithi16641208-212 2020-11-16T20:55:54.747 INFO:tasks.rados.rados.0.smithi166.stdout:212: finishing write tid 4 to smithi16641208-212 2020-11-16T20:55:54.747 INFO:tasks.rados.rados.0.smithi166.stdout:211: done (15 left) 2020-11-16T20:55:54.748 INFO:tasks.rados.rados.0.smithi166.stdout:227: write initial oid 227 2020-11-16T20:55:54.748 INFO:tasks.rados.rados.0.smithi166.stdout:227: seq_num 226 ranges {598382=780511,2075401=451067,3107008=648769} 2020-11-16T20:55:54.748 INFO:tasks.rados.rados.0.smithi166.stdout:227: writing smithi16641208-227 from 598382 to 1378893 tid 1 2020-11-16T20:55:54.748 INFO:tasks.rados.rados.0.smithi166.stdout:227: writing smithi16641208-227 from 2075401 to 2526468 tid 2 2020-11-16T20:55:54.748 INFO:tasks.rados.rados.0.smithi166.stdout:227: writing smithi16641208-227 from 3107008 to 3755777 tid 3 2020-11-16T20:55:54.748 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.748 INFO:tasks.rados.rados.0.smithi166.stdout:212: finishing write tid 5 to smithi16641208-212 2020-11-16T20:55:54.749 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 212 v 129 (ObjNum 211 snap 0 seq_num 211) dirty exists 2020-11-16T20:55:54.749 INFO:tasks.rados.rados.0.smithi166.stdout:212: left oid 212 (ObjNum 211 snap 0 seq_num 211) 2020-11-16T20:55:54.749 INFO:tasks.rados.rados.0.smithi166.stdout:212: done (15 left) 2020-11-16T20:55:54.749 INFO:tasks.rados.rados.0.smithi166.stdout:228: write initial oid 228 2020-11-16T20:55:54.749 INFO:tasks.rados.rados.0.smithi166.stdout:228: seq_num 227 ranges {615189=455760,1733883=711078,3134431=460041} 2020-11-16T20:55:54.749 INFO:tasks.rados.rados.0.smithi166.stdout:228: writing smithi16641208-228 from 615189 to 1070949 tid 1 2020-11-16T20:55:54.749 INFO:tasks.rados.rados.0.smithi166.stdout:228: writing smithi16641208-228 from 1733883 to 2444961 tid 2 2020-11-16T20:55:54.749 INFO:tasks.rados.rados.0.smithi166.stdout:228: writing smithi16641208-228 from 3134431 to 3594472 tid 3 2020-11-16T20:55:54.750 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.750 INFO:tasks.rados.rados.0.smithi166.stdout:213: finishing write tid 1 to smithi16641208-213 2020-11-16T20:55:54.750 INFO:tasks.rados.rados.0.smithi166.stdout:213: finishing write tid 2 to smithi16641208-213 2020-11-16T20:55:54.750 INFO:tasks.rados.rados.0.smithi166.stdout:213: finishing write tid 3 to smithi16641208-213 2020-11-16T20:55:54.750 INFO:tasks.rados.rados.0.smithi166.stdout:213: finishing write tid 4 to smithi16641208-213 2020-11-16T20:55:54.750 INFO:tasks.rados.rados.0.smithi166.stdout:213: finishing write tid 5 to smithi16641208-213 2020-11-16T20:55:54.750 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 213 v 148 (ObjNum 212 snap 0 seq_num 212) dirty exists 2020-11-16T20:55:54.751 INFO:tasks.rados.rados.0.smithi166.stdout:213: left oid 213 (ObjNum 212 snap 0 seq_num 212) 2020-11-16T20:55:54.751 INFO:tasks.rados.rados.0.smithi166.stdout:214: finishing write tid 1 to smithi16641208-214 2020-11-16T20:55:54.751 INFO:tasks.rados.rados.0.smithi166.stdout:214: finishing write tid 2 to smithi16641208-214 2020-11-16T20:55:54.751 INFO:tasks.rados.rados.0.smithi166.stdout:214: finishing write tid 3 to smithi16641208-214 2020-11-16T20:55:54.751 INFO:tasks.rados.rados.0.smithi166.stdout:214: finishing write tid 4 to smithi16641208-214 2020-11-16T20:55:54.751 INFO:tasks.rados.rados.0.smithi166.stdout:214: finishing write tid 5 to smithi16641208-214 2020-11-16T20:55:54.751 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 214 v 133 (ObjNum 213 snap 0 seq_num 213) dirty exists 2020-11-16T20:55:54.751 INFO:tasks.rados.rados.0.smithi166.stdout:214: left oid 214 (ObjNum 213 snap 0 seq_num 213) 2020-11-16T20:55:54.752 INFO:tasks.rados.rados.0.smithi166.stdout:215: finishing write tid 1 to smithi16641208-215 2020-11-16T20:55:54.752 INFO:tasks.rados.rados.0.smithi166.stdout:215: finishing write tid 2 to smithi16641208-215 2020-11-16T20:55:54.752 INFO:tasks.rados.rados.0.smithi166.stdout:215: finishing write tid 3 to smithi16641208-215 2020-11-16T20:55:54.752 INFO:tasks.rados.rados.0.smithi166.stdout:215: finishing write tid 4 to smithi16641208-215 2020-11-16T20:55:54.752 INFO:tasks.rados.rados.0.smithi166.stdout:215: finishing write tid 5 to smithi16641208-215 2020-11-16T20:55:54.752 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 215 v 137 (ObjNum 214 snap 0 seq_num 214) dirty exists 2020-11-16T20:55:54.752 INFO:tasks.rados.rados.0.smithi166.stdout:215: left oid 215 (ObjNum 214 snap 0 seq_num 214) 2020-11-16T20:55:54.753 INFO:tasks.rados.rados.0.smithi166.stdout:216: finishing write tid 1 to smithi16641208-216 2020-11-16T20:55:54.753 INFO:tasks.rados.rados.0.smithi166.stdout:216: finishing write tid 2 to smithi16641208-216 2020-11-16T20:55:54.753 INFO:tasks.rados.rados.0.smithi166.stdout:216: finishing write tid 3 to smithi16641208-216 2020-11-16T20:55:54.753 INFO:tasks.rados.rados.0.smithi166.stdout:216: finishing write tid 4 to smithi16641208-216 2020-11-16T20:55:54.753 INFO:tasks.rados.rados.0.smithi166.stdout:216: finishing write tid 5 to smithi16641208-216 2020-11-16T20:55:54.753 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 216 v 196 (ObjNum 215 snap 0 seq_num 215) dirty exists 2020-11-16T20:55:54.753 INFO:tasks.rados.rados.0.smithi166.stdout:216: left oid 216 (ObjNum 215 snap 0 seq_num 215) 2020-11-16T20:55:54.754 INFO:tasks.rados.rados.0.smithi166.stdout:213: done (15 left) 2020-11-16T20:55:54.754 INFO:tasks.rados.rados.0.smithi166.stdout:214: done (14 left) 2020-11-16T20:55:54.754 INFO:tasks.rados.rados.0.smithi166.stdout:215: done (13 left) 2020-11-16T20:55:54.754 INFO:tasks.rados.rados.0.smithi166.stdout:216: done (12 left) 2020-11-16T20:55:54.754 INFO:tasks.rados.rados.0.smithi166.stdout:229: write initial oid 229 2020-11-16T20:55:54.754 INFO:tasks.rados.rados.0.smithi166.stdout:229: seq_num 228 ranges {631996=531009,1792365=454736,2761854=671313} 2020-11-16T20:55:54.754 INFO:tasks.rados.rados.0.smithi166.stdout:229: writing smithi16641208-229 from 631996 to 1163005 tid 1 2020-11-16T20:55:54.755 INFO:tasks.rados.rados.0.smithi166.stdout:229: writing smithi16641208-229 from 1792365 to 2247101 tid 2 2020-11-16T20:55:54.755 INFO:tasks.rados.rados.0.smithi166.stdout:229: writing smithi16641208-229 from 2761854 to 3433167 tid 3 2020-11-16T20:55:54.755 INFO:tasks.rados.rados.0.smithi166.stdout:230: write initial oid 230 2020-11-16T20:55:54.755 INFO:tasks.rados.rados.0.smithi166.stdout:230: seq_num 229 ranges {648803=722611,1967200=714747,3421983=426820} 2020-11-16T20:55:54.755 INFO:tasks.rados.rados.0.smithi166.stdout:230: writing smithi16641208-230 from 648803 to 1371414 tid 1 2020-11-16T20:55:54.755 INFO:tasks.rados.rados.0.smithi166.stdout:230: writing smithi16641208-230 from 1967200 to 2681947 tid 2 2020-11-16T20:55:54.755 INFO:tasks.rados.rados.0.smithi166.stdout:230: writing smithi16641208-230 from 3421983 to 3848803 tid 3 2020-11-16T20:55:54.755 INFO:tasks.rados.rados.0.smithi166.stdout:231: write initial oid 231 2020-11-16T20:55:54.756 INFO:tasks.rados.rados.0.smithi166.stdout:217: finishing write tid 1 to smithi16641208-217 2020-11-16T20:55:54.756 INFO:tasks.rados.rados.0.smithi166.stdout:231: seq_num 230 ranges {665610=797860,1909329=458405,2816700=410210} 2020-11-16T20:55:54.756 INFO:tasks.rados.rados.0.smithi166.stdout:231: writing smithi16641208-231 from 665610 to 1463470 tid 1 2020-11-16T20:55:54.756 INFO:tasks.rados.rados.0.smithi166.stdout:231: writing smithi16641208-231 from 1909329 to 2367734 tid 2 2020-11-16T20:55:54.756 INFO:tasks.rados.rados.0.smithi166.stdout:231: writing smithi16641208-231 from 2816700 to 3226910 tid 3 2020-11-16T20:55:54.756 INFO:tasks.rados.rados.0.smithi166.stdout:232: write initial oid 232 2020-11-16T20:55:54.756 INFO:tasks.rados.rados.0.smithi166.stdout:232: seq_num 231 ranges {682417=473109,1567811=602063,2844123=621482} 2020-11-16T20:55:54.757 INFO:tasks.rados.rados.0.smithi166.stdout:232: writing smithi16641208-232 from 682417 to 1155526 tid 1 2020-11-16T20:55:54.757 INFO:tasks.rados.rados.0.smithi166.stdout:232: writing smithi16641208-232 from 1567811 to 2169874 tid 2 2020-11-16T20:55:54.757 INFO:tasks.rados.rados.0.smithi166.stdout:232: writing smithi16641208-232 from 2844123 to 3465605 tid 3 2020-11-16T20:55:54.757 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.757 INFO:tasks.rados.rados.0.smithi166.stdout:217: finishing write tid 2 to smithi16641208-217 2020-11-16T20:55:54.757 INFO:tasks.rados.rados.0.smithi166.stdout:217: finishing write tid 3 to smithi16641208-217 2020-11-16T20:55:54.757 INFO:tasks.rados.rados.0.smithi166.stdout:217: finishing write tid 4 to smithi16641208-217 2020-11-16T20:55:54.757 INFO:tasks.rados.rados.0.smithi166.stdout:217: finishing write tid 5 to smithi16641208-217 2020-11-16T20:55:54.758 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 217 v 200 (ObjNum 216 snap 0 seq_num 216) dirty exists 2020-11-16T20:55:54.758 INFO:tasks.rados.rados.0.smithi166.stdout:217: left oid 217 (ObjNum 216 snap 0 seq_num 216) 2020-11-16T20:55:54.758 INFO:tasks.rados.rados.0.smithi166.stdout:218: finishing write tid 1 to smithi16641208-218 2020-11-16T20:55:54.758 INFO:tasks.rados.rados.0.smithi166.stdout:218: finishing write tid 2 to smithi16641208-218 2020-11-16T20:55:54.758 INFO:tasks.rados.rados.0.smithi166.stdout:218: finishing write tid 3 to smithi16641208-218 2020-11-16T20:55:54.758 INFO:tasks.rados.rados.0.smithi166.stdout:218: finishing write tid 4 to smithi16641208-218 2020-11-16T20:55:54.758 INFO:tasks.rados.rados.0.smithi166.stdout:218: finishing write tid 5 to smithi16641208-218 2020-11-16T20:55:54.759 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 218 v 152 (ObjNum 217 snap 0 seq_num 217) dirty exists 2020-11-16T20:55:54.759 INFO:tasks.rados.rados.0.smithi166.stdout:218: left oid 218 (ObjNum 217 snap 0 seq_num 217) 2020-11-16T20:55:54.759 INFO:tasks.rados.rados.0.smithi166.stdout:219: finishing write tid 1 to smithi16641208-219 2020-11-16T20:55:54.759 INFO:tasks.rados.rados.0.smithi166.stdout:219: finishing write tid 2 to smithi16641208-219 2020-11-16T20:55:54.759 INFO:tasks.rados.rados.0.smithi166.stdout:219: finishing write tid 3 to smithi16641208-219 2020-11-16T20:55:54.759 INFO:tasks.rados.rados.0.smithi166.stdout:219: finishing write tid 4 to smithi16641208-219 2020-11-16T20:55:54.759 INFO:tasks.rados.rados.0.smithi166.stdout:219: finishing write tid 5 to smithi16641208-219 2020-11-16T20:55:54.759 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 219 v 141 (ObjNum 218 snap 0 seq_num 218) dirty exists 2020-11-16T20:55:54.760 INFO:tasks.rados.rados.0.smithi166.stdout:219: left oid 219 (ObjNum 218 snap 0 seq_num 218) 2020-11-16T20:55:54.760 INFO:tasks.rados.rados.0.smithi166.stdout:220: finishing write tid 1 to smithi16641208-220 2020-11-16T20:55:54.760 INFO:tasks.rados.rados.0.smithi166.stdout:220: finishing write tid 2 to smithi16641208-220 2020-11-16T20:55:54.760 INFO:tasks.rados.rados.0.smithi166.stdout:220: finishing write tid 3 to smithi16641208-220 2020-11-16T20:55:54.760 INFO:tasks.rados.rados.0.smithi166.stdout:220: finishing write tid 4 to smithi16641208-220 2020-11-16T20:55:54.760 INFO:tasks.rados.rados.0.smithi166.stdout:220: finishing write tid 5 to smithi16641208-220 2020-11-16T20:55:54.760 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 220 v 145 (ObjNum 219 snap 0 seq_num 219) dirty exists 2020-11-16T20:55:54.760 INFO:tasks.rados.rados.0.smithi166.stdout:220: left oid 220 (ObjNum 219 snap 0 seq_num 219) 2020-11-16T20:55:54.761 INFO:tasks.rados.rados.0.smithi166.stdout:221: finishing write tid 1 to smithi16641208-221 2020-11-16T20:55:54.761 INFO:tasks.rados.rados.0.smithi166.stdout:221: finishing write tid 2 to smithi16641208-221 2020-11-16T20:55:54.761 INFO:tasks.rados.rados.0.smithi166.stdout:221: finishing write tid 3 to smithi16641208-221 2020-11-16T20:55:54.761 INFO:tasks.rados.rados.0.smithi166.stdout:221: finishing write tid 4 to smithi16641208-221 2020-11-16T20:55:54.761 INFO:tasks.rados.rados.0.smithi166.stdout:221: finishing write tid 5 to smithi16641208-221 2020-11-16T20:55:54.761 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 221 v 156 (ObjNum 220 snap 0 seq_num 220) dirty exists 2020-11-16T20:55:54.761 INFO:tasks.rados.rados.0.smithi166.stdout:221: left oid 221 (ObjNum 220 snap 0 seq_num 220) 2020-11-16T20:55:54.762 INFO:tasks.rados.rados.0.smithi166.stdout:217: done (15 left) 2020-11-16T20:55:54.762 INFO:tasks.rados.rados.0.smithi166.stdout:218: done (14 left) 2020-11-16T20:55:54.762 INFO:tasks.rados.rados.0.smithi166.stdout:219: done (13 left) 2020-11-16T20:55:54.762 INFO:tasks.rados.rados.0.smithi166.stdout:220: done (12 left) 2020-11-16T20:55:54.762 INFO:tasks.rados.rados.0.smithi166.stdout:221: done (11 left) 2020-11-16T20:55:54.762 INFO:tasks.rados.rados.0.smithi166.stdout:233: write initial oid 233 2020-11-16T20:55:54.762 INFO:tasks.rados.rados.0.smithi166.stdout:233: seq_num 232 ranges {699224=548358,2026293=462074,3271546=432754} 2020-11-16T20:55:54.762 INFO:tasks.rados.rados.0.smithi166.stdout:233: writing smithi16641208-233 from 699224 to 1247582 tid 1 2020-11-16T20:55:54.763 INFO:tasks.rados.rados.0.smithi166.stdout:233: writing smithi16641208-233 from 2026293 to 2488367 tid 2 2020-11-16T20:55:54.763 INFO:tasks.rados.rados.0.smithi166.stdout:233: writing smithi16641208-233 from 3271546 to 3704300 tid 3 2020-11-16T20:55:54.763 INFO:tasks.rados.rados.0.smithi166.stdout:234: write initial oid 234 2020-11-16T20:55:54.763 INFO:tasks.rados.rados.0.smithi166.stdout:222: finishing write tid 1 to smithi16641208-222 2020-11-16T20:55:54.763 INFO:tasks.rados.rados.0.smithi166.stdout:234: seq_num 233 ranges {716031=623607,2084775=605732,3298969=617062} 2020-11-16T20:55:54.763 INFO:tasks.rados.rados.0.smithi166.stdout:234: writing smithi16641208-234 from 716031 to 1339638 tid 1 2020-11-16T20:55:54.763 INFO:tasks.rados.rados.0.smithi166.stdout:234: writing smithi16641208-234 from 2084775 to 2690507 tid 2 2020-11-16T20:55:54.764 INFO:tasks.rados.rados.0.smithi166.stdout:234: writing smithi16641208-234 from 3298969 to 3916031 tid 3 2020-11-16T20:55:54.764 INFO:tasks.rados.rados.0.smithi166.stdout:235: write initial oid 235 2020-11-16T20:55:54.764 INFO:tasks.rados.rados.0.smithi166.stdout:235: seq_num 234 ranges {732838=698856,2026904=465743,3210039=571651} 2020-11-16T20:55:54.764 INFO:tasks.rados.rados.0.smithi166.stdout:235: writing smithi16641208-235 from 732838 to 1431694 tid 1 2020-11-16T20:55:54.764 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:54.764 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:55:54.765 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:55:54.765 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:55:54.765 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:54.765 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:55:54.766 INFO:teuthology.orchestra.run.smithi166.stdout:moved 3 / 81 (3.7037%) 2020-11-16T20:55:54.766 INFO:teuthology.orchestra.run.smithi166.stdout:avg 10.125 2020-11-16T20:55:54.766 INFO:teuthology.orchestra.run.smithi166.stdout:stddev 2.42061 -> 2.14695 (expected baseline 2.97647) 2020-11-16T20:55:54.766 INFO:teuthology.orchestra.run.smithi166.stdout:min osd.2 with 7 -> 7 pgs (0.691358 -> 0.691358 * mean) 2020-11-16T20:55:54.767 INFO:teuthology.orchestra.run.smithi166.stdout:max osd.7 with 14 -> 13 pgs (1.38272 -> 1.28395 * mean) 2020-11-16T20:55:54.767 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:55:54.767 INFO:teuthology.orchestra.run.smithi166.stdout:oload 110 2020-11-16T20:55:54.767 INFO:teuthology.orchestra.run.smithi166.stdout:max_change 0.05 2020-11-16T20:55:54.767 INFO:teuthology.orchestra.run.smithi166.stdout:max_change_osds 4 2020-11-16T20:55:54.767 INFO:teuthology.orchestra.run.smithi166.stdout:average_utilization 0.0003 2020-11-16T20:55:54.767 INFO:teuthology.orchestra.run.smithi166.stdout:overload_utilization 0.0004 2020-11-16T20:55:54.768 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6 weight 1.0000 -> 0.9500 2020-11-16T20:55:54.768 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3 weight 1.0000 -> 0.9500 2020-11-16T20:55:54.768 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4 weight 1.0000 -> 0.9500 2020-11-16T20:55:54.768 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7 weight 1.0000 -> 0.9500 2020-11-16T20:55:54.768 INFO:teuthology.orchestra.run.smithi166.stderr:no change 2020-11-16T20:55:54.768 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2020-11-16T20:55:54.769 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 3.0 2020-11-16T20:55:54.769 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:55:54.739+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:55:54.770 INFO:tasks.rados.rados.0.smithi166.stdout:235: writing smithi16641208-235 from 2026904 to 2492647 tid 2 2020-11-16T20:55:54.770 INFO:tasks.rados.rados.0.smithi166.stdout:235: writing smithi16641208-235 from 3210039 to 3781690 tid 3 2020-11-16T20:55:54.770 INFO:tasks.rados.rados.0.smithi166.stdout:236: write initial oid 236 2020-11-16T20:55:54.771 INFO:tasks.rados.rados.0.smithi166.stdout:236: seq_num 235 ranges {749645=774105,2085386=609401,3237462=712183} 2020-11-16T20:55:54.771 INFO:tasks.rados.rados.0.smithi166.stdout:236: writing smithi16641208-236 from 749645 to 1523750 tid 1 2020-11-16T20:55:54.771 INFO:tasks.rados.rados.0.smithi166.stdout:236: writing smithi16641208-236 from 2085386 to 2694787 tid 2 2020-11-16T20:55:54.776 INFO:tasks.rados.rados.0.smithi166.stdout:236: writing smithi16641208-236 from 3237462 to 3949645 tid 3 2020-11-16T20:55:54.776 INFO:tasks.rados.rados.0.smithi166.stdout:237: write initial oid 237 2020-11-16T20:55:54.776 INFO:tasks.rados.rados.0.smithi166.stdout:222: finishing write tid 2 to smithi16641208-222 2020-11-16T20:55:54.776 INFO:tasks.rados.rados.0.smithi166.stdout:237: seq_num 236 ranges {766452=565707,1860221=469412,2981238=594195} 2020-11-16T20:55:54.783 INFO:tasks.rados.rados.0.smithi166.stdout:237: writing smithi16641208-237 from 766452 to 1332159 tid 1 2020-11-16T20:55:54.789 INFO:tasks.rados.rados.0.smithi166.stdout:237: writing smithi16641208-237 from 1860221 to 2329633 tid 2 2020-11-16T20:55:54.798 INFO:tasks.rados.rados.0.smithi166.stdout:237: writing smithi16641208-237 from 2981238 to 3575433 tid 3 2020-11-16T20:55:54.798 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.798 INFO:tasks.rados.rados.0.smithi166.stdout:222: finishing write tid 3 to smithi16641208-222 2020-11-16T20:55:54.798 INFO:tasks.rados.rados.0.smithi166.stdout:222: finishing write tid 4 to smithi16641208-222 2020-11-16T20:55:54.798 INFO:tasks.rados.rados.0.smithi166.stdout:222: finishing write tid 5 to smithi16641208-222 2020-11-16T20:55:54.798 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 222 v 204 (ObjNum 221 snap 0 seq_num 221) dirty exists 2020-11-16T20:55:54.799 INFO:tasks.rados.rados.0.smithi166.stdout:222: left oid 222 (ObjNum 221 snap 0 seq_num 221) 2020-11-16T20:55:54.799 INFO:tasks.rados.rados.0.smithi166.stdout:223: finishing write tid 1 to smithi16641208-223 2020-11-16T20:55:54.799 INFO:tasks.rados.rados.0.smithi166.stdout:223: finishing write tid 2 to smithi16641208-223 2020-11-16T20:55:54.799 INFO:tasks.rados.rados.0.smithi166.stdout:222: done (15 left) 2020-11-16T20:55:54.799 INFO:tasks.rados.rados.0.smithi166.stdout:238: write initial oid 238 2020-11-16T20:55:54.799 INFO:tasks.rados.rados.0.smithi166.stdout:223: finishing write tid 3 to smithi16641208-223 2020-11-16T20:55:54.799 INFO:tasks.rados.rados.0.smithi166.stdout:223: finishing write tid 4 to smithi16641208-223 2020-11-16T20:55:54.799 INFO:tasks.rados.rados.0.smithi166.stdout:223: finishing write tid 5 to smithi16641208-223 2020-11-16T20:55:54.800 INFO:tasks.rados.rados.0.smithi166.stdout:224: finishing write tid 1 to smithi16641208-224 2020-11-16T20:55:54.800 INFO:tasks.rados.rados.0.smithi166.stdout:223: finishing write tid 6 to smithi16641208-223 2020-11-16T20:55:54.800 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 223 v 110 (ObjNum 222 snap 0 seq_num 222) dirty exists 2020-11-16T20:55:54.800 INFO:tasks.rados.rados.0.smithi166.stdout:223: left oid 223 (ObjNum 222 snap 0 seq_num 222) 2020-11-16T20:55:54.800 INFO:tasks.rados.rados.0.smithi166.stdout:224: finishing write tid 2 to smithi16641208-224 2020-11-16T20:55:54.800 INFO:tasks.rados.rados.0.smithi166.stdout:238: seq_num 237 ranges {783259=640956,1918703=613070,3008661=405467,3821939=161320} 2020-11-16T20:55:54.805 INFO:tasks.rados.rados.0.smithi166.stdout:238: writing smithi16641208-238 from 783259 to 1424215 tid 1 2020-11-16T20:55:54.812 INFO:tasks.rados.rados.0.smithi166.stdout:238: writing smithi16641208-238 from 1918703 to 2531773 tid 2 2020-11-16T20:55:54.818 INFO:tasks.rados.rados.0.smithi166.stdout:238: writing smithi16641208-238 from 3008661 to 3414128 tid 3 2020-11-16T20:55:54.826 INFO:tasks.rados.rados.0.smithi166.stdout:238: writing smithi16641208-238 from 3821939 to 3983259 tid 4 2020-11-16T20:55:54.827 INFO:tasks.rados.rados.0.smithi166.stdout:223: done (15 left) 2020-11-16T20:55:54.827 INFO:tasks.rados.rados.0.smithi166.stdout:239: write initial oid 239 2020-11-16T20:55:54.827 INFO:tasks.rados.rados.0.smithi166.stdout:224: finishing write tid 3 to smithi16641208-224 2020-11-16T20:55:54.827 INFO:tasks.rados.rados.0.smithi166.stdout:225: finishing write tid 1 to smithi16641208-225 2020-11-16T20:55:54.827 INFO:tasks.rados.rados.0.smithi166.stdout:225: finishing write tid 2 to smithi16641208-225 2020-11-16T20:55:54.827 INFO:tasks.rados.rados.0.smithi166.stdout:224: finishing write tid 4 to smithi16641208-224 2020-11-16T20:55:54.827 INFO:tasks.rados.rados.0.smithi166.stdout:224: finishing write tid 5 to smithi16641208-224 2020-11-16T20:55:54.828 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 224 v 208 (ObjNum 223 snap 0 seq_num 223) dirty exists 2020-11-16T20:55:54.828 INFO:tasks.rados.rados.0.smithi166.stdout:224: left oid 224 (ObjNum 223 snap 0 seq_num 223) 2020-11-16T20:55:54.828 INFO:tasks.rados.rados.0.smithi166.stdout:225: finishing write tid 3 to smithi16641208-225 2020-11-16T20:55:54.828 INFO:tasks.rados.rados.0.smithi166.stdout:239: seq_num 238 ranges {400066=716205,1860832=139234} 2020-11-16T20:55:54.829 INFO:tasks.rados.rados.0.smithi166.stdout:239: writing smithi16641208-239 from 400066 to 1116271 tid 1 2020-11-16T20:55:54.835 INFO:tasks.rados.rados.0.smithi166.stdout:239: writing smithi16641208-239 from 1860832 to 2000066 tid 2 2020-11-16T20:55:54.835 INFO:tasks.rados.rados.0.smithi166.stdout:224: done (15 left) 2020-11-16T20:55:54.835 INFO:tasks.rados.rados.0.smithi166.stdout:240: write initial oid 240 2020-11-16T20:55:54.835 INFO:tasks.rados.rados.0.smithi166.stdout:225: finishing write tid 4 to smithi16641208-225 2020-11-16T20:55:54.835 INFO:tasks.rados.rados.0.smithi166.stdout:240: seq_num 239 ranges {416873=791454,1919314=97559} 2020-11-16T20:55:54.836 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:55:54.839+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:55:54.842 INFO:tasks.rados.rados.0.smithi166.stdout:240: writing smithi16641208-240 from 416873 to 1208327 tid 1 2020-11-16T20:55:54.848 INFO:tasks.rados.rados.0.smithi166.stdout:240: writing smithi16641208-240 from 1919314 to 2016873 tid 2 2020-11-16T20:55:54.848 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.848 INFO:tasks.rados.rados.0.smithi166.stdout:226: finishing write tid 1 to smithi16641208-226 2020-11-16T20:55:54.848 INFO:tasks.rados.rados.0.smithi166.stdout:225: finishing write tid 5 to smithi16641208-225 2020-11-16T20:55:54.848 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 225 v 211 (ObjNum 224 snap 0 seq_num 224) dirty exists 2020-11-16T20:55:54.848 INFO:tasks.rados.rados.0.smithi166.stdout:225: left oid 225 (ObjNum 224 snap 0 seq_num 224) 2020-11-16T20:55:54.848 INFO:tasks.rados.rados.0.smithi166.stdout:226: finishing write tid 2 to smithi16641208-226 2020-11-16T20:55:54.849 INFO:tasks.rados.rados.0.smithi166.stdout:225: done (15 left) 2020-11-16T20:55:54.849 INFO:tasks.rados.rados.0.smithi166.stdout:241: write initial oid 241 2020-11-16T20:55:54.849 INFO:tasks.rados.rados.0.smithi166.stdout:241: seq_num 240 ranges {433680=466703,1577796=455884} 2020-11-16T20:55:54.853 INFO:tasks.rados.rados.0.smithi166.stdout:241: writing smithi16641208-241 from 433680 to 900383 tid 1 2020-11-16T20:55:54.859 INFO:tasks.rados.rados.0.smithi166.stdout:241: writing smithi16641208-241 from 1577796 to 2033680 tid 2 2020-11-16T20:55:54.860 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.860 INFO:tasks.rados.rados.0.smithi166.stdout:226: finishing write tid 3 to smithi16641208-226 2020-11-16T20:55:54.860 INFO:tasks.rados.rados.0.smithi166.stdout:226: finishing write tid 4 to smithi16641208-226 2020-11-16T20:55:54.860 INFO:tasks.rados.rados.0.smithi166.stdout:226: finishing write tid 5 to smithi16641208-226 2020-11-16T20:55:54.860 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 226 v 215 (ObjNum 225 snap 0 seq_num 225) dirty exists 2020-11-16T20:55:54.860 INFO:tasks.rados.rados.0.smithi166.stdout:226: left oid 226 (ObjNum 225 snap 0 seq_num 225) 2020-11-16T20:55:54.861 INFO:tasks.rados.rados.0.smithi166.stdout:227: finishing write tid 1 to smithi16641208-227 2020-11-16T20:55:54.861 INFO:tasks.rados.rados.0.smithi166.stdout:227: finishing write tid 2 to smithi16641208-227 2020-11-16T20:55:54.861 INFO:tasks.rados.rados.0.smithi166.stdout:227: finishing write tid 3 to smithi16641208-227 2020-11-16T20:55:54.861 INFO:tasks.rados.rados.0.smithi166.stdout:227: finishing write tid 4 to smithi16641208-227 2020-11-16T20:55:54.861 INFO:tasks.rados.rados.0.smithi166.stdout:227: finishing write tid 5 to smithi16641208-227 2020-11-16T20:55:54.861 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 227 v 149 (ObjNum 226 snap 0 seq_num 226) dirty exists 2020-11-16T20:55:54.861 INFO:tasks.rados.rados.0.smithi166.stdout:227: left oid 227 (ObjNum 226 snap 0 seq_num 226) 2020-11-16T20:55:54.862 INFO:tasks.rados.rados.0.smithi166.stdout:228: finishing write tid 1 to smithi16641208-228 2020-11-16T20:55:54.862 INFO:tasks.rados.rados.0.smithi166.stdout:226: done (15 left) 2020-11-16T20:55:54.862 INFO:tasks.rados.rados.0.smithi166.stdout:227: done (14 left) 2020-11-16T20:55:54.862 INFO:tasks.rados.rados.0.smithi166.stdout:242: write initial oid 242 2020-11-16T20:55:54.862 INFO:tasks.rados.rados.0.smithi166.stdout:242: seq_num 241 ranges {450487=541952,1636278=414209} 2020-11-16T20:55:54.865 INFO:tasks.rados.rados.0.smithi166.stdout:242: writing smithi16641208-242 from 450487 to 992439 tid 1 2020-11-16T20:55:54.872 INFO:tasks.rados.rados.0.smithi166.stdout:242: writing smithi16641208-242 from 1636278 to 2050487 tid 2 2020-11-16T20:55:54.872 INFO:tasks.rados.rados.0.smithi166.stdout:243: write initial oid 243 2020-11-16T20:55:54.872 INFO:tasks.rados.rados.0.smithi166.stdout:243: seq_num 242 ranges {467294=617201,1578407=488887} 2020-11-16T20:55:54.878 INFO:tasks.rados.rados.0.smithi166.stdout:243: writing smithi16641208-243 from 467294 to 1084495 tid 1 2020-11-16T20:55:54.886 INFO:tasks.rados.rados.0.smithi166.stdout:243: writing smithi16641208-243 from 1578407 to 2067294 tid 2 2020-11-16T20:55:54.886 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:54.886 INFO:tasks.rados.rados.0.smithi166.stdout:228: finishing write tid 2 to smithi16641208-228 2020-11-16T20:55:54.886 INFO:tasks.rados.rados.0.smithi166.stdout:228: finishing write tid 3 to smithi16641208-228 2020-11-16T20:55:54.886 INFO:tasks.rados.rados.0.smithi166.stdout:228: finishing write tid 4 to smithi16641208-228 2020-11-16T20:55:54.887 INFO:tasks.rados.rados.0.smithi166.stdout:228: finishing write tid 5 to smithi16641208-228 2020-11-16T20:55:54.887 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 228 v 153 (ObjNum 227 snap 0 seq_num 227) dirty exists 2020-11-16T20:55:54.887 INFO:tasks.rados.rados.0.smithi166.stdout:228: left oid 228 (ObjNum 227 snap 0 seq_num 227) 2020-11-16T20:55:54.887 INFO:tasks.rados.rados.0.smithi166.stdout:229: finishing write tid 1 to smithi16641208-229 2020-11-16T20:55:54.887 INFO:tasks.rados.rados.0.smithi166.stdout:229: finishing write tid 2 to smithi16641208-229 2020-11-16T20:55:54.887 INFO:tasks.rados.rados.0.smithi166.stdout:229: finishing write tid 3 to smithi16641208-229 2020-11-16T20:55:54.887 INFO:tasks.rados.rados.0.smithi166.stdout:229: finishing write tid 4 to smithi16641208-229 2020-11-16T20:55:54.888 INFO:tasks.rados.rados.0.smithi166.stdout:229: finishing write tid 5 to smithi16641208-229 2020-11-16T20:55:54.888 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 229 v 160 (ObjNum 228 snap 0 seq_num 228) dirty exists 2020-11-16T20:55:54.888 INFO:tasks.rados.rados.0.smithi166.stdout:229: left oid 229 (ObjNum 228 snap 0 seq_num 228) 2020-11-16T20:55:54.888 INFO:tasks.rados.rados.0.smithi166.stdout:230: finishing write tid 1 to smithi16641208-230 2020-11-16T20:55:54.888 INFO:tasks.rados.rados.0.smithi166.stdout:230: finishing write tid 2 to smithi16641208-230 2020-11-16T20:55:54.888 INFO:tasks.rados.rados.0.smithi166.stdout:230: finishing write tid 3 to smithi16641208-230 2020-11-16T20:55:54.888 INFO:tasks.rados.rados.0.smithi166.stdout:230: finishing write tid 4 to smithi16641208-230 2020-11-16T20:55:54.888 INFO:tasks.rados.rados.0.smithi166.stdout:230: finishing write tid 5 to smithi16641208-230 2020-11-16T20:55:54.889 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 230 v 219 (ObjNum 229 snap 0 seq_num 229) dirty exists 2020-11-16T20:55:54.889 INFO:tasks.rados.rados.0.smithi166.stdout:230: left oid 230 (ObjNum 229 snap 0 seq_num 229) 2020-11-16T20:55:54.889 INFO:tasks.rados.rados.0.smithi166.stdout:231: finishing write tid 1 to smithi16641208-231 2020-11-16T20:55:54.889 INFO:tasks.rados.rados.0.smithi166.stdout:231: finishing write tid 2 to smithi16641208-231 2020-11-16T20:55:54.889 INFO:tasks.rados.rados.0.smithi166.stdout:231: finishing write tid 3 to smithi16641208-231 2020-11-16T20:55:54.889 INFO:tasks.rados.rados.0.smithi166.stdout:231: finishing write tid 4 to smithi16641208-231 2020-11-16T20:55:54.889 INFO:tasks.rados.rados.0.smithi166.stdout:231: finishing write tid 5 to smithi16641208-231 2020-11-16T20:55:54.890 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 231 v 164 (ObjNum 230 snap 0 seq_num 230) dirty exists 2020-11-16T20:55:54.890 INFO:tasks.rados.rados.0.smithi166.stdout:231: left oid 231 (ObjNum 230 snap 0 seq_num 230) 2020-11-16T20:55:54.890 INFO:tasks.rados.rados.0.smithi166.stdout:232: finishing write tid 1 to smithi16641208-232 2020-11-16T20:55:54.890 INFO:tasks.rados.rados.0.smithi166.stdout:232: finishing write tid 2 to smithi16641208-232 2020-11-16T20:55:54.890 INFO:tasks.rados.rados.0.smithi166.stdout:232: finishing write tid 3 to smithi16641208-232 2020-11-16T20:55:54.890 INFO:tasks.rados.rados.0.smithi166.stdout:232: finishing write tid 4 to smithi16641208-232 2020-11-16T20:55:54.890 INFO:tasks.rados.rados.0.smithi166.stdout:232: finishing write tid 5 to smithi16641208-232 2020-11-16T20:55:54.890 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 232 v 223 (ObjNum 231 snap 0 seq_num 231) dirty exists 2020-11-16T20:55:54.891 INFO:tasks.rados.rados.0.smithi166.stdout:232: left oid 232 (ObjNum 231 snap 0 seq_num 231) 2020-11-16T20:55:54.891 INFO:tasks.rados.rados.0.smithi166.stdout:233: finishing write tid 1 to smithi16641208-233 2020-11-16T20:55:54.891 INFO:tasks.rados.rados.0.smithi166.stdout:233: finishing write tid 2 to smithi16641208-233 2020-11-16T20:55:54.891 INFO:tasks.rados.rados.0.smithi166.stdout:233: finishing write tid 3 to smithi16641208-233 2020-11-16T20:55:54.891 INFO:tasks.rados.rados.0.smithi166.stdout:233: finishing write tid 4 to smithi16641208-233 2020-11-16T20:55:54.891 INFO:tasks.rados.rados.0.smithi166.stdout:233: finishing write tid 5 to smithi16641208-233 2020-11-16T20:55:54.891 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 233 v 157 (ObjNum 232 snap 0 seq_num 232) dirty exists 2020-11-16T20:55:54.892 INFO:tasks.rados.rados.0.smithi166.stdout:233: left oid 233 (ObjNum 232 snap 0 seq_num 232) 2020-11-16T20:55:54.892 INFO:tasks.rados.rados.0.smithi166.stdout:234: finishing write tid 1 to smithi16641208-234 2020-11-16T20:55:54.892 INFO:tasks.rados.rados.0.smithi166.stdout:234: finishing write tid 2 to smithi16641208-234 2020-11-16T20:55:54.892 INFO:tasks.rados.rados.0.smithi166.stdout:234: finishing write tid 3 to smithi16641208-234 2020-11-16T20:55:54.892 INFO:tasks.rados.rados.0.smithi166.stdout:234: finishing write tid 4 to smithi16641208-234 2020-11-16T20:55:54.892 INFO:tasks.rados.rados.0.smithi166.stdout:234: finishing write tid 5 to smithi16641208-234 2020-11-16T20:55:54.892 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 234 v 161 (ObjNum 233 snap 0 seq_num 233) dirty exists 2020-11-16T20:55:54.892 INFO:tasks.rados.rados.0.smithi166.stdout:234: left oid 234 (ObjNum 233 snap 0 seq_num 233) 2020-11-16T20:55:54.893 INFO:tasks.rados.rados.0.smithi166.stdout:235: finishing write tid 1 to smithi16641208-235 2020-11-16T20:55:54.893 INFO:tasks.rados.rados.0.smithi166.stdout:235: finishing write tid 2 to smithi16641208-235 2020-11-16T20:55:54.893 INFO:tasks.rados.rados.0.smithi166.stdout:236: finishing write tid 1 to smithi16641208-236 2020-11-16T20:55:54.893 INFO:tasks.rados.rados.0.smithi166.stdout:235: finishing write tid 3 to smithi16641208-235 2020-11-16T20:55:54.893 INFO:tasks.rados.rados.0.smithi166.stdout:235: finishing write tid 4 to smithi16641208-235 2020-11-16T20:55:54.893 INFO:tasks.rados.rados.0.smithi166.stdout:235: finishing write tid 5 to smithi16641208-235 2020-11-16T20:55:54.893 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 235 v 165 (ObjNum 234 snap 0 seq_num 234) dirty exists 2020-11-16T20:55:54.894 INFO:tasks.rados.rados.0.smithi166.stdout:235: left oid 235 (ObjNum 234 snap 0 seq_num 234) 2020-11-16T20:55:54.894 INFO:tasks.rados.rados.0.smithi166.stdout:236: finishing write tid 2 to smithi16641208-236 2020-11-16T20:55:54.894 INFO:tasks.rados.rados.0.smithi166.stdout:236: finishing write tid 3 to smithi16641208-236 2020-11-16T20:55:54.894 INFO:tasks.rados.rados.0.smithi166.stdout:236: finishing write tid 4 to smithi16641208-236 2020-11-16T20:55:54.894 INFO:tasks.rados.rados.0.smithi166.stdout:236: finishing write tid 5 to smithi16641208-236 2020-11-16T20:55:54.894 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 236 v 114 (ObjNum 235 snap 0 seq_num 235) dirty exists 2020-11-16T20:55:54.894 INFO:tasks.rados.rados.0.smithi166.stdout:236: left oid 236 (ObjNum 235 snap 0 seq_num 235) 2020-11-16T20:55:54.894 INFO:tasks.rados.rados.0.smithi166.stdout:237: finishing write tid 1 to smithi16641208-237 2020-11-16T20:55:54.895 INFO:tasks.rados.rados.0.smithi166.stdout:237: finishing write tid 2 to smithi16641208-237 2020-11-16T20:55:54.895 INFO:tasks.rados.rados.0.smithi166.stdout:237: finishing write tid 3 to smithi16641208-237 2020-11-16T20:55:54.895 INFO:tasks.rados.rados.0.smithi166.stdout:237: finishing write tid 4 to smithi16641208-237 2020-11-16T20:55:54.895 INFO:tasks.rados.rados.0.smithi166.stdout:237: finishing write tid 5 to smithi16641208-237 2020-11-16T20:55:54.895 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 237 v 118 (ObjNum 236 snap 0 seq_num 236) dirty exists 2020-11-16T20:55:54.895 INFO:tasks.rados.rados.0.smithi166.stdout:237: left oid 237 (ObjNum 236 snap 0 seq_num 236) 2020-11-16T20:55:54.895 INFO:tasks.rados.rados.0.smithi166.stdout:238: finishing write tid 1 to smithi16641208-238 2020-11-16T20:55:54.896 INFO:tasks.rados.rados.0.smithi166.stdout:238: finishing write tid 2 to smithi16641208-238 2020-11-16T20:55:54.896 INFO:tasks.rados.rados.0.smithi166.stdout:238: finishing write tid 3 to smithi16641208-238 2020-11-16T20:55:54.896 INFO:tasks.rados.rados.0.smithi166.stdout:238: finishing write tid 4 to smithi16641208-238 2020-11-16T20:55:54.896 INFO:tasks.rados.rados.0.smithi166.stdout:238: finishing write tid 5 to smithi16641208-238 2020-11-16T20:55:54.896 INFO:tasks.rados.rados.0.smithi166.stdout:238: finishing write tid 6 to smithi16641208-238 2020-11-16T20:55:54.896 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 238 v 168 (ObjNum 237 snap 0 seq_num 237) dirty exists 2020-11-16T20:55:54.896 INFO:tasks.rados.rados.0.smithi166.stdout:238: left oid 238 (ObjNum 237 snap 0 seq_num 237) 2020-11-16T20:55:54.896 INFO:tasks.rados.rados.0.smithi166.stdout:239: finishing write tid 1 to smithi16641208-239 2020-11-16T20:55:54.897 INFO:tasks.rados.rados.0.smithi166.stdout:239: finishing write tid 2 to smithi16641208-239 2020-11-16T20:55:54.897 INFO:tasks.rados.rados.0.smithi166.stdout:239: finishing write tid 3 to smithi16641208-239 2020-11-16T20:55:54.897 INFO:tasks.rados.rados.0.smithi166.stdout:239: finishing write tid 4 to smithi16641208-239 2020-11-16T20:55:54.897 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 239 v 167 (ObjNum 238 snap 0 seq_num 238) dirty exists 2020-11-16T20:55:54.897 INFO:tasks.rados.rados.0.smithi166.stdout:239: left oid 239 (ObjNum 238 snap 0 seq_num 238) 2020-11-16T20:55:54.897 INFO:tasks.rados.rados.0.smithi166.stdout:240: finishing write tid 1 to smithi16641208-240 2020-11-16T20:55:54.897 INFO:tasks.rados.rados.0.smithi166.stdout:240: finishing write tid 2 to smithi16641208-240 2020-11-16T20:55:54.898 INFO:tasks.rados.rados.0.smithi166.stdout:240: finishing write tid 3 to smithi16641208-240 2020-11-16T20:55:54.898 INFO:tasks.rados.rados.0.smithi166.stdout:240: finishing write tid 4 to smithi16641208-240 2020-11-16T20:55:54.898 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 240 v 226 (ObjNum 239 snap 0 seq_num 239) dirty exists 2020-11-16T20:55:54.898 INFO:tasks.rados.rados.0.smithi166.stdout:240: left oid 240 (ObjNum 239 snap 0 seq_num 239) 2020-11-16T20:55:54.898 INFO:tasks.rados.rados.0.smithi166.stdout:241: finishing write tid 1 to smithi16641208-241 2020-11-16T20:55:54.898 INFO:tasks.rados.rados.0.smithi166.stdout:241: finishing write tid 2 to smithi16641208-241 2020-11-16T20:55:54.898 INFO:tasks.rados.rados.0.smithi166.stdout:242: finishing write tid 1 to smithi16641208-242 2020-11-16T20:55:54.898 INFO:tasks.rados.rados.0.smithi166.stdout:242: finishing write tid 2 to smithi16641208-242 2020-11-16T20:55:54.899 INFO:tasks.rados.rados.0.smithi166.stdout:242: finishing write tid 3 to smithi16641208-242 2020-11-16T20:55:54.899 INFO:tasks.rados.rados.0.smithi166.stdout:241: finishing write tid 3 to smithi16641208-241 2020-11-16T20:55:54.899 INFO:tasks.rados.rados.0.smithi166.stdout:241: finishing write tid 4 to smithi16641208-241 2020-11-16T20:55:54.899 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 241 v 171 (ObjNum 240 snap 0 seq_num 240) dirty exists 2020-11-16T20:55:54.899 INFO:tasks.rados.rados.0.smithi166.stdout:241: left oid 241 (ObjNum 240 snap 0 seq_num 240) 2020-11-16T20:55:54.899 INFO:tasks.rados.rados.0.smithi166.stdout:243: finishing write tid 1 to smithi16641208-243 2020-11-16T20:55:54.899 INFO:tasks.rados.rados.0.smithi166.stdout:228: done (15 left) 2020-11-16T20:55:54.900 INFO:tasks.rados.rados.0.smithi166.stdout:229: done (14 left) 2020-11-16T20:55:54.900 INFO:tasks.rados.rados.0.smithi166.stdout:230: done (13 left) 2020-11-16T20:55:54.900 INFO:tasks.rados.rados.0.smithi166.stdout:231: done (12 left) 2020-11-16T20:55:54.900 INFO:tasks.rados.rados.0.smithi166.stdout:232: done (11 left) 2020-11-16T20:55:54.900 INFO:tasks.rados.rados.0.smithi166.stdout:233: done (10 left) 2020-11-16T20:55:54.900 INFO:tasks.rados.rados.0.smithi166.stdout:234: done (9 left) 2020-11-16T20:55:54.900 INFO:tasks.rados.rados.0.smithi166.stdout:235: done (8 left) 2020-11-16T20:55:54.900 INFO:tasks.rados.rados.0.smithi166.stdout:236: done (7 left) 2020-11-16T20:55:54.901 INFO:tasks.rados.rados.0.smithi166.stdout:237: done (6 left) 2020-11-16T20:55:54.901 INFO:tasks.rados.rados.0.smithi166.stdout:238: done (5 left) 2020-11-16T20:55:54.901 INFO:tasks.rados.rados.0.smithi166.stdout:239: done (4 left) 2020-11-16T20:55:54.901 INFO:tasks.rados.rados.0.smithi166.stdout:240: done (3 left) 2020-11-16T20:55:54.901 INFO:tasks.rados.rados.0.smithi166.stdout:241: done (2 left) 2020-11-16T20:55:54.901 INFO:tasks.rados.rados.0.smithi166.stdout:244: write initial oid 244 2020-11-16T20:55:54.901 INFO:tasks.rados.rados.0.smithi166.stdout:244: seq_num 243 ranges {484101=692450,1636889=447212} 2020-11-16T20:55:54.902 INFO:tasks.rados.rados.0.smithi166.stdout:244: writing smithi16641208-244 from 484101 to 1176551 tid 1 2020-11-16T20:55:54.902 INFO:tasks.rados.rados.0.smithi166.stdout:244: writing smithi16641208-244 from 1636889 to 2084101 tid 2 2020-11-16T20:55:54.902 INFO:tasks.rados.rados.0.smithi166.stdout:245: write initial oid 245 2020-11-16T20:55:54.903 INFO:tasks.rados.rados.0.smithi166.stdout:245: seq_num 244 ranges {500908=484052,1411724=689184} 2020-11-16T20:55:54.904 INFO:tasks.rados.rados.0.smithi166.stdout:245: writing smithi16641208-245 from 500908 to 984960 tid 1 2020-11-16T20:55:54.911 INFO:tasks.rados.rados.0.smithi166.stdout:245: writing smithi16641208-245 from 1411724 to 2100908 tid 2 2020-11-16T20:55:54.911 INFO:tasks.rados.rados.0.smithi166.stdout:246: write initial oid 246 2020-11-16T20:55:54.911 INFO:tasks.rados.rados.0.smithi166.stdout:246: seq_num 245 ranges {517715=559301,1870206=247509} 2020-11-16T20:55:54.917 INFO:tasks.rados.rados.0.smithi166.stdout:246: writing smithi16641208-246 from 517715 to 1077016 tid 1 2020-11-16T20:55:54.923 INFO:tasks.rados.rados.0.smithi166.stdout:246: writing smithi16641208-246 from 1870206 to 2117715 tid 2 2020-11-16T20:55:54.923 INFO:tasks.rados.rados.0.smithi166.stdout:247: write initial oid 247 2020-11-16T20:55:54.924 INFO:tasks.rados.rados.0.smithi166.stdout:247: seq_num 246 ranges {534522=634550,1812335=322187} 2020-11-16T20:55:54.930 INFO:tasks.rados.rados.0.smithi166.stdout:247: writing smithi16641208-247 from 534522 to 1169072 tid 1 2020-11-16T20:55:54.936 INFO:tasks.rados.rados.0.smithi166.stdout:247: writing smithi16641208-247 from 1812335 to 2134522 tid 2 2020-11-16T20:55:54.936 INFO:tasks.rados.rados.0.smithi166.stdout:248: write initial oid 248 2020-11-16T20:55:54.936 INFO:tasks.rados.rados.0.smithi166.stdout:248: seq_num 247 ranges {551329=709799,1870817=280512} 2020-11-16T20:55:54.936 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:55:54.940+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:55:54.938 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2020-11-16T20:55:54.944 INFO:tasks.rados.rados.0.smithi166.stdout:248: writing smithi16641208-248 from 551329 to 1261128 tid 1 2020-11-16T20:55:54.949 INFO:tasks.rados.rados.0.smithi166.stdout:248: writing smithi16641208-248 from 1870817 to 2151329 tid 2 2020-11-16T20:55:54.949 INFO:tasks.rados.rados.0.smithi166.stdout:249: write initial oid 249 2020-11-16T20:55:54.949 INFO:tasks.rados.rados.0.smithi166.stdout:249: seq_num 248 ranges {568136=785048,1929299=238837} 2020-11-16T20:55:54.953 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:54.953 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:55:54.953 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:55:54.953 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:55:54.954 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.954 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:45 3.0 e33/19 3:0de98f2f:::smithi16641208-12:head v 33'3, mlcod=33'1)", 2020-11-16T20:55:54.954 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.038270+0000", 2020-11-16T20:55:54.954 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.9179535599999999, 2020-11-16T20:55:54.954 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003571505, 2020-11-16T20:55:54.954 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:54.955 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:54.955 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:54.955 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.955 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:54.955 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.038270+0000", 2020-11-16T20:55:54.955 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:54.955 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.955 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.956 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:54.956 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.038270+0000", 2020-11-16T20:55:54.956 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033263999999999999 2020-11-16T20:55:54.956 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.956 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.956 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:54.956 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.038602+0000", 2020-11-16T20:55:54.957 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9299999999999998e-06 2020-11-16T20:55:54.957 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.957 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.957 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:54.957 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.038612+0000", 2020-11-16T20:55:54.957 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6396e-05 2020-11-16T20:55:54.957 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.957 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.958 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:54.958 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.038629+0000", 2020-11-16T20:55:54.958 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5050000000000007e-06 2020-11-16T20:55:54.958 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.958 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.958 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:54.958 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.038637+0000", 2020-11-16T20:55:54.959 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8092e-05 2020-11-16T20:55:54.959 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.959 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.959 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.959 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.038685+0000", 2020-11-16T20:55:54.959 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0370999999999999e-05 2020-11-16T20:55:54.959 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.959 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.960 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:54.960 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.038706+0000", 2020-11-16T20:55:54.960 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030721070000000001 2020-11-16T20:55:54.960 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.960 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.960 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:54.960 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.041778+0000", 2020-11-16T20:55:54.961 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3464000000000001e-05 2020-11-16T20:55:54.961 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.961 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.961 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:54.961 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.041841+0000", 2020-11-16T20:55:54.961 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003571505 2020-11-16T20:55:54.961 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.961 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:54.962 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.962 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.962 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.962 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:65 3.0 e33/19 3:11e00e07:::smithi16641208-17:head v 33'4, mlcod=33'2)", 2020-11-16T20:55:54.962 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.101977+0000", 2020-11-16T20:55:54.962 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.854246582, 2020-11-16T20:55:54.962 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003375528, 2020-11-16T20:55:54.963 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:54.963 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:54.963 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:54.963 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.963 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:54.963 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.101977+0000", 2020-11-16T20:55:54.963 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:54.963 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.964 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.964 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:54.964 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.101977+0000", 2020-11-16T20:55:54.964 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00035505399999999999 2020-11-16T20:55:54.964 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.964 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.964 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:54.965 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.102332+0000", 2020-11-16T20:55:54.965 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.117e-05 2020-11-16T20:55:54.965 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.965 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.965 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:54.965 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.102343+0000", 2020-11-16T20:55:54.965 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2969000000000001e-05 2020-11-16T20:55:54.965 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.966 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.966 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:54.966 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.102356+0000", 2020-11-16T20:55:54.966 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.0790000000000001e-06 2020-11-16T20:55:54.966 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.966 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.966 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:54.967 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.102364+0000", 2020-11-16T20:55:54.967 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8276000000000003e-05 2020-11-16T20:55:54.967 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.967 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.967 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.967 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.102412+0000", 2020-11-16T20:55:54.967 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0891e-05 2020-11-16T20:55:54.968 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.968 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.968 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:54.968 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.102433+0000", 2020-11-16T20:55:54.968 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028777709999999999 2020-11-16T20:55:54.968 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.968 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.968 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:54.969 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.105311+0000", 2020-11-16T20:55:54.969 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1318e-05 2020-11-16T20:55:54.969 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.969 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.969 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:54.969 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.105352+0000", 2020-11-16T20:55:54.969 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003375528 2020-11-16T20:55:54.969 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.970 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:54.970 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.970 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.970 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.970 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:97 3.0 e33/19 3:35dec57e:::smithi16641208-25:head v 33'7, mlcod=33'5)", 2020-11-16T20:55:54.970 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.206251+0000", 2020-11-16T20:55:54.971 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.7499725110000002, 2020-11-16T20:55:54.971 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0034864520000000001, 2020-11-16T20:55:54.971 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:54.971 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:54.971 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:54.971 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.971 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:54.971 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.206251+0000", 2020-11-16T20:55:54.972 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:54.972 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.972 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.972 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:54.972 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.206251+0000", 2020-11-16T20:55:54.972 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00027329399999999999 2020-11-16T20:55:54.972 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.973 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.973 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:54.973 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.206524+0000", 2020-11-16T20:55:54.973 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9269999999999999e-06 2020-11-16T20:55:54.973 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.973 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.973 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:54.973 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.206531+0000", 2020-11-16T20:55:54.974 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1294999999999999e-05 2020-11-16T20:55:54.974 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.974 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.974 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:54.974 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.206542+0000", 2020-11-16T20:55:54.974 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.5929999999999995e-06 2020-11-16T20:55:54.974 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.975 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.975 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:54.975 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.206552+0000", 2020-11-16T20:55:54.975 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1955e-05 2020-11-16T20:55:54.975 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.975 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.975 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.975 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.206604+0000", 2020-11-16T20:55:54.976 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7246999999999998e-05 2020-11-16T20:55:54.976 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.976 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.976 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:54.976 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.206631+0000", 2020-11-16T20:55:54.976 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003055477 2020-11-16T20:55:54.976 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.977 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.977 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:54.977 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.209687+0000", 2020-11-16T20:55:54.977 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0664000000000001e-05 2020-11-16T20:55:54.977 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.977 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.977 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:54.977 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.209737+0000", 2020-11-16T20:55:54.978 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0034864520000000001 2020-11-16T20:55:54.978 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.978 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:54.978 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.978 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.978 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.978 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:170 3.0 e33/19 3:1e260d0e:::smithi16641208-43:head v 33'12, mlcod=33'10)", 2020-11-16T20:55:54.979 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.458057+0000", 2020-11-16T20:55:54.979 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.498166646, 2020-11-16T20:55:54.979 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040611839999999998, 2020-11-16T20:55:54.979 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:54.979 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:54.979 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:54.979 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.979 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:54.980 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458057+0000", 2020-11-16T20:55:54.980 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:54.980 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.980 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.980 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:54.980 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458057+0000", 2020-11-16T20:55:54.980 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000227333 2020-11-16T20:55:54.981 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.981 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.981 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:54.981 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458284+0000", 2020-11-16T20:55:54.981 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8389999999999996e-06 2020-11-16T20:55:54.981 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.981 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.981 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:54.982 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458293+0000", 2020-11-16T20:55:54.982 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9907999999999998e-05 2020-11-16T20:55:54.982 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.982 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.982 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:54.982 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458333+0000", 2020-11-16T20:55:54.982 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2132e-05 2020-11-16T20:55:54.983 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.983 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.983 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:54.983 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458345+0000", 2020-11-16T20:55:54.983 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0157000000000001e-05 2020-11-16T20:55:54.983 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.983 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.983 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.984 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458395+0000", 2020-11-16T20:55:54.984 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6659e-05 2020-11-16T20:55:54.984 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.984 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.984 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:54.984 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458422+0000", 2020-11-16T20:55:54.984 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0036338049999999999 2020-11-16T20:55:54.985 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.985 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.985 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:54.985 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.462056+0000", 2020-11-16T20:55:54.985 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2351e-05 2020-11-16T20:55:54.985 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.985 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.985 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:54.986 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.462118+0000", 2020-11-16T20:55:54.986 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040611839999999998 2020-11-16T20:55:54.986 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.986 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:54.986 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.986 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.986 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.987 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:171 3.0 e33/19 3:1e260d0e:::smithi16641208-43:head v 33'13, mlcod=33'10)", 2020-11-16T20:55:54.987 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.459169+0000", 2020-11-16T20:55:54.987 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.4970544000000001, 2020-11-16T20:55:54.987 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029906189999999999, 2020-11-16T20:55:54.987 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:54.987 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:54.987 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:54.987 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.988 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:54.988 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.459169+0000", 2020-11-16T20:55:54.988 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:54.988 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.988 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.988 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:54.988 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.459169+0000", 2020-11-16T20:55:54.989 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4212000000000002e-05 2020-11-16T20:55:54.989 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.989 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.989 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:54.989 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.459223+0000", 2020-11-16T20:55:54.989 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.1009999999999992e-06 2020-11-16T20:55:54.989 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.989 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.990 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:54.990 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.459231+0000", 2020-11-16T20:55:54.990 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3314e-05 2020-11-16T20:55:54.990 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.990 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.990 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:54.990 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.459245+0000", 2020-11-16T20:55:54.991 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7350000000000002e-06 2020-11-16T20:55:54.991 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.991 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.991 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:54.991 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.459253+0000", 2020-11-16T20:55:54.991 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4777999999999998e-05 2020-11-16T20:55:54.991 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.991 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.992 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:54.992 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.459288+0000", 2020-11-16T20:55:54.992 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2687000000000001e-05 2020-11-16T20:55:54.992 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.992 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.992 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:54.992 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.459301+0000", 2020-11-16T20:55:54.993 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028214590000000001 2020-11-16T20:55:54.993 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.993 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.993 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:54.993 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.462122+0000", 2020-11-16T20:55:54.993 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7333000000000003e-05 2020-11-16T20:55:54.993 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.993 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.994 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:54.994 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.462160+0000", 2020-11-16T20:55:54.994 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029906189999999999 2020-11-16T20:55:54.994 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.994 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:54.994 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:54.994 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.995 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.995 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:890 3.0 e35/19 3:2209b6da:::smithi16641208-202:head v 35'131, mlcod=35'129)", 2020-11-16T20:55:54.995 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.078620+0000", 2020-11-16T20:55:54.995 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.87760360100000001, 2020-11-16T20:55:54.995 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039687519999999999, 2020-11-16T20:55:54.995 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:54.995 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:54.995 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:54.996 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.996 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:54.996 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078620+0000", 2020-11-16T20:55:54.996 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:54.996 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.996 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.996 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:54.997 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078620+0000", 2020-11-16T20:55:54.997 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018733000000000001 2020-11-16T20:55:54.997 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.997 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.997 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:54.997 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078807+0000", 2020-11-16T20:55:54.997 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9799999999999993e-06 2020-11-16T20:55:54.997 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.998 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.998 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:54.998 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078817+0000", 2020-11-16T20:55:54.998 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5116000000000001e-05 2020-11-16T20:55:54.998 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.998 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.998 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:54.999 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078832+0000", 2020-11-16T20:55:54.999 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2634e-05 2020-11-16T20:55:54.999 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:54.999 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:54.999 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:54.999 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078845+0000", 2020-11-16T20:55:54.999 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1001999999999997e-05 2020-11-16T20:55:54.999 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.000 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.000 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.000 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078896+0000", 2020-11-16T20:55:55.000 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5238000000000001e-05 2020-11-16T20:55:55.000 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.000 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.000 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.001 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078921+0000", 2020-11-16T20:55:55.001 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035949210000000001 2020-11-16T20:55:55.001 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.001 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.001 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.001 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.082516+0000", 2020-11-16T20:55:55.001 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2531000000000001e-05 2020-11-16T20:55:55.001 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.002 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.002 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.002 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.082588+0000", 2020-11-16T20:55:55.002 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039687519999999999 2020-11-16T20:55:55.002 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.002 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.002 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.002 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.003 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.003 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:901 3.0 e35/19 3:29e07ad2:::smithi16641208-204:head v 35'134, mlcod=35'132)", 2020-11-16T20:55:55.003 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.128152+0000", 2020-11-16T20:55:55.003 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.82807138800000002, 2020-11-16T20:55:55.003 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042710120000000002, 2020-11-16T20:55:55.003 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.003 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.004 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.004 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.004 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.004 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128152+0000", 2020-11-16T20:55:55.004 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.004 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.004 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.004 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.005 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128152+0000", 2020-11-16T20:55:55.005 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019783600000000001 2020-11-16T20:55:55.005 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.005 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.005 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.005 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128350+0000", 2020-11-16T20:55:55.005 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6030000000000005e-06 2020-11-16T20:55:55.006 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.006 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.006 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.006 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128358+0000", 2020-11-16T20:55:55.006 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2595999999999999e-05 2020-11-16T20:55:55.006 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.006 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.006 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.007 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128371+0000", 2020-11-16T20:55:55.007 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3209999999999999e-06 2020-11-16T20:55:55.007 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.007 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.007 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.007 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128378+0000", 2020-11-16T20:55:55.007 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4047e-05 2020-11-16T20:55:55.008 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.008 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.008 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.008 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128422+0000", 2020-11-16T20:55:55.008 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9796000000000001e-05 2020-11-16T20:55:55.008 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.008 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.008 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.009 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128452+0000", 2020-11-16T20:55:55.009 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039150929999999997 2020-11-16T20:55:55.009 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.009 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.009 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.009 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.132367+0000", 2020-11-16T20:55:55.009 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5720000000000002e-05 2020-11-16T20:55:55.010 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.010 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.010 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.010 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.132423+0000", 2020-11-16T20:55:55.010 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042710120000000002 2020-11-16T20:55:55.010 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.010 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.011 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.011 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.011 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.011 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:927 3.0 e35/19 3:23ba105b:::smithi16641208-209:head v 35'143, mlcod=35'140)", 2020-11-16T20:55:55.011 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.230124+0000", 2020-11-16T20:55:55.011 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.72609945300000001, 2020-11-16T20:55:55.011 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00336929, 2020-11-16T20:55:55.011 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.012 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.012 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.012 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.012 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.012 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.230124+0000", 2020-11-16T20:55:55.012 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.012 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.012 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.013 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.013 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.230124+0000", 2020-11-16T20:55:55.013 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4858000000000006e-05 2020-11-16T20:55:55.013 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.013 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.013 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.013 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.230209+0000", 2020-11-16T20:55:55.014 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2269999999999999e-06 2020-11-16T20:55:55.014 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.014 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.014 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.014 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.230218+0000", 2020-11-16T20:55:55.014 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.447e-05 2020-11-16T20:55:55.014 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.014 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.015 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.015 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.230232+0000", 2020-11-16T20:55:55.015 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7190000000000001e-06 2020-11-16T20:55:55.015 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.015 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.015 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.015 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.230240+0000", 2020-11-16T20:55:55.016 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4162999999999997e-05 2020-11-16T20:55:55.016 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.016 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.016 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.230284+0000", 2020-11-16T20:55:55.016 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7886e-05 2020-11-16T20:55:55.016 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.017 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.017 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.230312+0000", 2020-11-16T20:55:55.017 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0031231039999999998 2020-11-16T20:55:55.017 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.017 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.017 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.017 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.233435+0000", 2020-11-16T20:55:55.018 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7862999999999998e-05 2020-11-16T20:55:55.018 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.018 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.018 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.018 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.233493+0000", 2020-11-16T20:55:55.018 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00336929 2020-11-16T20:55:55.018 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.018 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.019 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.019 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.019 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.019 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:945 3.0 e35/19 3:0893b5ca:::smithi16641208-213:head v 35'145, mlcod=35'143)", 2020-11-16T20:55:55.019 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.298660+0000", 2020-11-16T20:55:55.019 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.65756382400000002, 2020-11-16T20:55:55.019 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003872028, 2020-11-16T20:55:55.020 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.020 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.020 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.020 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.020 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.020 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298660+0000", 2020-11-16T20:55:55.020 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.020 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.021 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.021 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.021 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298660+0000", 2020-11-16T20:55:55.021 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000217042 2020-11-16T20:55:55.021 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.021 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.021 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.021 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298877+0000", 2020-11-16T20:55:55.022 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1629e-05 2020-11-16T20:55:55.022 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.022 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.022 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.022 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298888+0000", 2020-11-16T20:55:55.022 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7003999999999998e-05 2020-11-16T20:55:55.022 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.023 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.023 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.023 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298905+0000", 2020-11-16T20:55:55.023 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.5119999999999997e-06 2020-11-16T20:55:55.023 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.023 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.023 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.024 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298915+0000", 2020-11-16T20:55:55.024 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1298999999999997e-05 2020-11-16T20:55:55.024 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.024 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.024 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.024 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298976+0000", 2020-11-16T20:55:55.024 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1288000000000003e-05 2020-11-16T20:55:55.024 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.025 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.025 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.025 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.299007+0000", 2020-11-16T20:55:55.025 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0034819920000000002 2020-11-16T20:55:55.025 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.025 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.025 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.025 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.302489+0000", 2020-11-16T20:55:55.026 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2262000000000003e-05 2020-11-16T20:55:55.026 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.026 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.026 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.026 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.302532+0000", 2020-11-16T20:55:55.026 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003872028 2020-11-16T20:55:55.026 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.027 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.027 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.027 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.027 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.027 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:946 3.0 e35/19 3:0893b5ca:::smithi16641208-213:head v 35'146, mlcod=35'144)", 2020-11-16T20:55:55.027 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.304193+0000", 2020-11-16T20:55:55.027 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.65203059399999996, 2020-11-16T20:55:55.027 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00368089, 2020-11-16T20:55:55.028 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.028 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.028 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.028 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.028 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.028 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.304193+0000", 2020-11-16T20:55:55.028 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.029 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.029 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.029 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.029 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.304193+0000", 2020-11-16T20:55:55.029 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014031800000000001 2020-11-16T20:55:55.029 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.029 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.029 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.030 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.304333+0000", 2020-11-16T20:55:55.030 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0680000000000002e-06 2020-11-16T20:55:55.030 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.030 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.030 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.030 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.304339+0000", 2020-11-16T20:55:55.030 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9889999999999992e-06 2020-11-16T20:55:55.031 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.031 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.031 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.031 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.304347+0000", 2020-11-16T20:55:55.031 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.956e-06 2020-11-16T20:55:55.031 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.031 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.031 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.032 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.304354+0000", 2020-11-16T20:55:55.032 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9280000000000002e-05 2020-11-16T20:55:55.032 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.032 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.032 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.032 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.304413+0000", 2020-11-16T20:55:55.032 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8870999999999999e-05 2020-11-16T20:55:55.033 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.033 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.033 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.033 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.304442+0000", 2020-11-16T20:55:55.033 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003368855 2020-11-16T20:55:55.033 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.033 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.034 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.034 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.307811+0000", 2020-11-16T20:55:55.034 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2552999999999996e-05 2020-11-16T20:55:55.034 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.034 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.034 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.034 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.307874+0000", 2020-11-16T20:55:55.035 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00368089 2020-11-16T20:55:55.035 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.035 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.035 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.035 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.035 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.035 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:971 3.0 e35/19 3:07290a98:::smithi16641208-218:head v 35'150, mlcod=35'148)", 2020-11-16T20:55:55.035 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.406452+0000", 2020-11-16T20:55:55.036 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.54977180000000003, 2020-11-16T20:55:55.036 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035585740000000001, 2020-11-16T20:55:55.036 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.036 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.036 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.036 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.036 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.037 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.406452+0000", 2020-11-16T20:55:55.037 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.037 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.037 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.037 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.037 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.406452+0000", 2020-11-16T20:55:55.037 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00026527799999999998 2020-11-16T20:55:55.037 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.038 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.038 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.038 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.406717+0000", 2020-11-16T20:55:55.038 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0149000000000001e-05 2020-11-16T20:55:55.038 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.038 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.038 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.039 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.406727+0000", 2020-11-16T20:55:55.039 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0939999999999999e-05 2020-11-16T20:55:55.039 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.039 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.039 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.039 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.406748+0000", 2020-11-16T20:55:55.039 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4499999999999998e-06 2020-11-16T20:55:55.040 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.040 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.040 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.040 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.406755+0000", 2020-11-16T20:55:55.040 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4391000000000002e-05 2020-11-16T20:55:55.040 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.040 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.040 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.041 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.406810+0000", 2020-11-16T20:55:55.041 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6804e-05 2020-11-16T20:55:55.041 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.041 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.041 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.041 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.406837+0000", 2020-11-16T20:55:55.041 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0031073939999999999 2020-11-16T20:55:55.041 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.042 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.042 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.042 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.409944+0000", 2020-11-16T20:55:55.042 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6167999999999994e-05 2020-11-16T20:55:55.042 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.042 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.042 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.043 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.410010+0000", 2020-11-16T20:55:55.043 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035585740000000001 2020-11-16T20:55:55.043 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.043 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.043 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.043 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.043 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.043 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:986 3.0 e35/19 3:27235ecc:::smithi16641208-221:head v 35'154, mlcod=35'152)", 2020-11-16T20:55:55.044 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.465820+0000", 2020-11-16T20:55:55.044 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.49040288900000001, 2020-11-16T20:55:55.044 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003417177, 2020-11-16T20:55:55.044 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.044 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.044 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.044 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.045 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.045 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.465820+0000", 2020-11-16T20:55:55.045 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.045 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.045 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.045 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.045 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.465820+0000", 2020-11-16T20:55:55.045 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000225639 2020-11-16T20:55:55.046 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.046 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.046 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.046 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.466046+0000", 2020-11-16T20:55:55.046 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.4700000000000008e-06 2020-11-16T20:55:55.046 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.046 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.047 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.047 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.466056+0000", 2020-11-16T20:55:55.047 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2553e-05 2020-11-16T20:55:55.047 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.047 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.047 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.047 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.466068+0000", 2020-11-16T20:55:55.047 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8490000000000006e-06 2020-11-16T20:55:55.048 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.048 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.048 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.048 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.466076+0000", 2020-11-16T20:55:55.048 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8239000000000003e-05 2020-11-16T20:55:55.048 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.048 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.049 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.049 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.466134+0000", 2020-11-16T20:55:55.049 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9084000000000001e-05 2020-11-16T20:55:55.049 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.049 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.049 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.049 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.466173+0000", 2020-11-16T20:55:55.049 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003001423 2020-11-16T20:55:55.050 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.050 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.050 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.050 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.469175+0000", 2020-11-16T20:55:55.050 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2920000000000001e-05 2020-11-16T20:55:55.050 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.050 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.051 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.051 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.469238+0000", 2020-11-16T20:55:55.051 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003417177 2020-11-16T20:55:55.051 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.051 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.051 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.051 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.051 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.052 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:987 3.0 e35/19 3:27235ecc:::smithi16641208-221:head v 35'155, mlcod=35'153)", 2020-11-16T20:55:55.052 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.472714+0000", 2020-11-16T20:55:55.052 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.48350948900000001, 2020-11-16T20:55:55.052 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033349170000000002, 2020-11-16T20:55:55.052 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.052 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.052 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.053 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.053 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.053 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.472714+0000", 2020-11-16T20:55:55.053 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.053 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.053 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.053 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.053 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.472714+0000", 2020-11-16T20:55:55.054 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015006500000000001 2020-11-16T20:55:55.054 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.054 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.054 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.054 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.472864+0000", 2020-11-16T20:55:55.054 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1309999999999995e-06 2020-11-16T20:55:55.054 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.055 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.055 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.055 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.472873+0000", 2020-11-16T20:55:55.055 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2731999999999999e-05 2020-11-16T20:55:55.055 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.055 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.055 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.055 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.472886+0000", 2020-11-16T20:55:55.056 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.798e-06 2020-11-16T20:55:55.056 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.056 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.056 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.056 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.472893+0000", 2020-11-16T20:55:55.056 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0117000000000001e-05 2020-11-16T20:55:55.056 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.057 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.057 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.057 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.472943+0000", 2020-11-16T20:55:55.057 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7653000000000001e-05 2020-11-16T20:55:55.057 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.057 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.057 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.057 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.472970+0000", 2020-11-16T20:55:55.058 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030261730000000001 2020-11-16T20:55:55.058 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.058 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.058 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.058 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.475997+0000", 2020-11-16T20:55:55.058 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2247999999999998e-05 2020-11-16T20:55:55.058 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.059 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.059 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.059 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.476049+0000", 2020-11-16T20:55:55.059 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033349170000000002 2020-11-16T20:55:55.059 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.059 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.059 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.060 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.060 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.060 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1027 3.0 e35/19 3:2e3eb594:::smithi16641208-229:head v 35'158, mlcod=35'156)", 2020-11-16T20:55:55.060 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.628775+0000", 2020-11-16T20:55:55.060 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.32744852099999999, 2020-11-16T20:55:55.060 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037889909999999998, 2020-11-16T20:55:55.060 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.060 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.061 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.061 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.061 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.061 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.628775+0000", 2020-11-16T20:55:55.061 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.061 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.061 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.061 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.062 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.628775+0000", 2020-11-16T20:55:55.062 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013695999999999999 2020-11-16T20:55:55.062 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.062 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.062 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.062 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.628912+0000", 2020-11-16T20:55:55.062 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3069999999999997e-06 2020-11-16T20:55:55.063 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.063 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.063 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.063 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.628919+0000", 2020-11-16T20:55:55.063 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3563e-05 2020-11-16T20:55:55.063 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.063 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.063 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.064 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.628933+0000", 2020-11-16T20:55:55.064 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1379999999999999e-05 2020-11-16T20:55:55.064 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.064 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.064 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.064 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.628944+0000", 2020-11-16T20:55:55.064 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5838000000000003e-05 2020-11-16T20:55:55.065 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.065 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.629000+0000", 2020-11-16T20:55:55.065 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7489000000000001e-05 2020-11-16T20:55:55.065 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.629027+0000", 2020-11-16T20:55:55.066 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0034656069999999999 2020-11-16T20:55:55.066 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.066 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.066 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.632493+0000", 2020-11-16T20:55:55.066 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0846999999999994e-05 2020-11-16T20:55:55.067 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.067 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.067 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.067 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.632564+0000", 2020-11-16T20:55:55.067 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037889909999999998 2020-11-16T20:55:55.067 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.067 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.067 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.068 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.068 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.068 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1028 3.0 e35/19 3:2e3eb594:::smithi16641208-229:head v 35'159, mlcod=35'157)", 2020-11-16T20:55:55.068 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.635550+0000", 2020-11-16T20:55:55.068 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.32067294600000001, 2020-11-16T20:55:55.068 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042338380000000002, 2020-11-16T20:55:55.068 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.069 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.069 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.069 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.069 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.069 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635550+0000", 2020-11-16T20:55:55.069 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.069 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.069 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.070 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.070 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635550+0000", 2020-11-16T20:55:55.070 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018653699999999999 2020-11-16T20:55:55.070 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.070 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.070 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.070 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635737+0000", 2020-11-16T20:55:55.071 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.037e-06 2020-11-16T20:55:55.071 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.071 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.071 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.071 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635746+0000", 2020-11-16T20:55:55.071 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3001e-05 2020-11-16T20:55:55.071 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.071 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.072 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.072 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635759+0000", 2020-11-16T20:55:55.072 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7740000000000004e-06 2020-11-16T20:55:55.072 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.072 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.072 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.072 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635767+0000", 2020-11-16T20:55:55.073 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1385999999999999e-05 2020-11-16T20:55:55.073 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.073 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.073 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.073 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635818+0000", 2020-11-16T20:55:55.073 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6427e-05 2020-11-16T20:55:55.073 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.073 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.074 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.074 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635845+0000", 2020-11-16T20:55:55.074 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003885164 2020-11-16T20:55:55.074 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.074 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.074 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.074 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.639730+0000", 2020-11-16T20:55:55.075 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4512000000000003e-05 2020-11-16T20:55:55.075 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.075 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.075 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.075 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.639784+0000", 2020-11-16T20:55:55.075 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042338380000000002 2020-11-16T20:55:55.075 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.075 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.076 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.076 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.076 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.076 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1029 3.0 e35/19 3:2e3eb594:::smithi16641208-229:head v 35'160, mlcod=35'157)", 2020-11-16T20:55:55.076 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.636876+0000", 2020-11-16T20:55:55.076 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.31934768899999999, 2020-11-16T20:55:55.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0031666680000000001, 2020-11-16T20:55:55.076 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.077 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.077 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.077 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.077 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.077 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.636876+0000", 2020-11-16T20:55:55.077 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.077 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.078 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.078 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.078 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.636876+0000", 2020-11-16T20:55:55.078 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0337999999999999e-05 2020-11-16T20:55:55.078 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.078 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.078 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.078 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.636916+0000", 2020-11-16T20:55:55.079 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9689999999999997e-06 2020-11-16T20:55:55.079 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.079 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.079 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.079 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.636923+0000", 2020-11-16T20:55:55.079 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0329000000000001e-05 2020-11-16T20:55:55.079 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.080 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.080 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.080 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.636933+0000", 2020-11-16T20:55:55.080 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9509999999999997e-06 2020-11-16T20:55:55.080 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.080 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.080 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.080 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.636938+0000", 2020-11-16T20:55:55.081 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9811000000000002e-05 2020-11-16T20:55:55.081 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.081 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.081 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.081 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.636978+0000", 2020-11-16T20:55:55.081 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8075000000000001e-05 2020-11-16T20:55:55.081 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.081 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.082 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.082 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.637006+0000", 2020-11-16T20:55:55.082 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029822999999999998 2020-11-16T20:55:55.082 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.082 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.082 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.082 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.639988+0000", 2020-11-16T20:55:55.083 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3894999999999998e-05 2020-11-16T20:55:55.083 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.083 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.083 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.083 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.640042+0000", 2020-11-16T20:55:55.083 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0031666680000000001 2020-11-16T20:55:55.083 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.083 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.084 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.084 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.084 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.084 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1037 3.0 e35/19 3:0fda7169:::smithi16641208-231:head v 35'162, mlcod=35'160)", 2020-11-16T20:55:55.084 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.671040+0000", 2020-11-16T20:55:55.084 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.28518345699999997, 2020-11-16T20:55:55.084 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040297739999999999, 2020-11-16T20:55:55.085 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.085 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.085 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.085 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.085 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.085 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671040+0000", 2020-11-16T20:55:55.085 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.085 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.086 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.086 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.086 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671040+0000", 2020-11-16T20:55:55.086 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012993299999999999 2020-11-16T20:55:55.086 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.086 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.086 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.087 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671170+0000", 2020-11-16T20:55:55.087 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9879999999999999e-06 2020-11-16T20:55:55.087 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.087 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.087 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.087 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671180+0000", 2020-11-16T20:55:55.087 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0243e-05 2020-11-16T20:55:55.087 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.088 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.088 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.088 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671190+0000", 2020-11-16T20:55:55.088 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4890000000000003e-06 2020-11-16T20:55:55.088 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.088 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.088 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.089 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671196+0000", 2020-11-16T20:55:55.089 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9298999999999997e-05 2020-11-16T20:55:55.089 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.089 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.089 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.089 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671245+0000", 2020-11-16T20:55:55.089 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4561000000000001e-05 2020-11-16T20:55:55.089 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.090 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.090 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.090 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671269+0000", 2020-11-16T20:55:55.090 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037448540000000002 2020-11-16T20:55:55.090 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.090 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.090 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.091 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.675014+0000", 2020-11-16T20:55:55.091 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5407e-05 2020-11-16T20:55:55.091 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.091 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.091 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.091 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.675070+0000", 2020-11-16T20:55:55.091 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040297739999999999 2020-11-16T20:55:55.091 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.092 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.092 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.092 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.092 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.092 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1077 3.0 e35/19 3:11438865:::smithi16641208-239:head v 35'165, mlcod=35'163)", 2020-11-16T20:55:55.092 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.836661+0000", 2020-11-16T20:55:55.092 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.11956254600000001, 2020-11-16T20:55:55.093 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003702496, 2020-11-16T20:55:55.093 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.093 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.093 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.093 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.093 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.093 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.836661+0000", 2020-11-16T20:55:55.093 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.094 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.094 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.094 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.094 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.836661+0000", 2020-11-16T20:55:55.094 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033887400000000002 2020-11-16T20:55:55.094 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.094 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.094 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.095 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.837000+0000", 2020-11-16T20:55:55.095 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1289999999999998e-06 2020-11-16T20:55:55.095 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.095 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.095 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.095 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.837007+0000", 2020-11-16T20:55:55.095 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1179999999999998e-06 2020-11-16T20:55:55.096 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.096 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.096 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.096 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.837016+0000", 2020-11-16T20:55:55.096 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0419999999999999e-06 2020-11-16T20:55:55.096 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.096 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.096 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.097 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.837022+0000", 2020-11-16T20:55:55.097 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4710000000000003e-05 2020-11-16T20:55:55.097 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.097 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.097 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.097 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.837077+0000", 2020-11-16T20:55:55.097 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6928e-05 2020-11-16T20:55:55.097 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.098 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.098 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.098 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.837104+0000", 2020-11-16T20:55:55.098 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0031967969999999999 2020-11-16T20:55:55.098 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.098 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.098 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.099 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.840300+0000", 2020-11-16T20:55:55.099 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2898000000000007e-05 2020-11-16T20:55:55.099 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.099 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.099 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.099 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.840363+0000", 2020-11-16T20:55:55.099 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003702496 2020-11-16T20:55:55.099 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.100 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.100 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.100 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.100 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.100 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1102 3.0 e35/19 3:1c1ecb34:::smithi16641208-245:head v 35'172, mlcod=35'170)", 2020-11-16T20:55:55.100 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.920148+0000", 2020-11-16T20:55:55.100 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.036075060999999999, 2020-11-16T20:55:55.101 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053854699999999998, 2020-11-16T20:55:55.101 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.101 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.101 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.101 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.101 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.101 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920148+0000", 2020-11-16T20:55:55.101 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.102 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.102 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.102 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.102 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920148+0000", 2020-11-16T20:55:55.102 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019421400000000001 2020-11-16T20:55:55.102 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.102 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.103 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.103 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920342+0000", 2020-11-16T20:55:55.103 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6169999999999996e-06 2020-11-16T20:55:55.103 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.103 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.103 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.103 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920352+0000", 2020-11-16T20:55:55.103 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3684e-05 2020-11-16T20:55:55.104 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.104 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.104 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.104 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920366+0000", 2020-11-16T20:55:55.104 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7789999999999996e-06 2020-11-16T20:55:55.104 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.104 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.104 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.105 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920374+0000", 2020-11-16T20:55:55.105 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8783999999999995e-05 2020-11-16T20:55:55.105 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.105 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.105 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.105 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920472+0000", 2020-11-16T20:55:55.105 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6865000000000001e-05 2020-11-16T20:55:55.106 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.106 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.106 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.106 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920499+0000", 2020-11-16T20:55:55.106 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004975246 2020-11-16T20:55:55.106 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.106 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.106 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.107 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.925474+0000", 2020-11-16T20:55:55.107 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9280999999999997e-05 2020-11-16T20:55:55.107 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.107 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.107 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.107 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.925534+0000", 2020-11-16T20:55:55.107 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053854699999999998 2020-11-16T20:55:55.108 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.108 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.108 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.108 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.108 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.108 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1103 3.0 e35/19 3:1c1ecb34:::smithi16641208-245:head v 35'173, mlcod=35'170)", 2020-11-16T20:55:55.108 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.922587+0000", 2020-11-16T20:55:55.108 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.033636067999999998, 2020-11-16T20:55:55.109 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0032156979999999999, 2020-11-16T20:55:55.109 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.109 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.109 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.109 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.109 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.109 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.922587+0000", 2020-11-16T20:55:55.109 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.110 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.110 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.110 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.110 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.922587+0000", 2020-11-16T20:55:55.110 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8890999999999997e-05 2020-11-16T20:55:55.110 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.110 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.111 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.111 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.922626+0000", 2020-11-16T20:55:55.111 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6959999999999994e-06 2020-11-16T20:55:55.111 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.111 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.111 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.111 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.922635+0000", 2020-11-16T20:55:55.111 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1712999999999999e-05 2020-11-16T20:55:55.112 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.112 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.112 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.112 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.922647+0000", 2020-11-16T20:55:55.112 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4139999999999997e-06 2020-11-16T20:55:55.112 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.112 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.113 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.922654+0000", 2020-11-16T20:55:55.113 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9370999999999998e-05 2020-11-16T20:55:55.113 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.113 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.113 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.922713+0000", 2020-11-16T20:55:55.114 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6701000000000001e-05 2020-11-16T20:55:55.114 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.114 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.114 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.114 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.922740+0000", 2020-11-16T20:55:55.114 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030179339999999999 2020-11-16T20:55:55.114 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.114 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.115 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.115 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.925758+0000", 2020-11-16T20:55:55.115 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4978000000000002e-05 2020-11-16T20:55:55.115 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.115 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.115 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.115 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.925803+0000", 2020-11-16T20:55:55.116 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0032156979999999999 2020-11-16T20:55:55.116 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.116 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.116 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.116 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.116 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.116 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:55.121 INFO:tasks.rados.rados.0.smithi166.stdout:249: writing smithi16641208-249 from 568136 to 1353184 tid 1 2020-11-16T20:55:55.121 INFO:tasks.rados.rados.0.smithi166.stdout:249: writing smithi16641208-249 from 1929299 to 2168136 tid 2 2020-11-16T20:55:55.121 INFO:tasks.rados.rados.0.smithi166.stdout:250: write initial oid 250 2020-11-16T20:55:55.121 INFO:tasks.rados.rados.0.smithi166.stdout:250: seq_num 249 ranges {584943=460297,1587781=597162} 2020-11-16T20:55:55.121 INFO:tasks.rados.rados.0.smithi166.stdout:250: writing smithi16641208-250 from 584943 to 1045240 tid 1 2020-11-16T20:55:55.122 INFO:tasks.rados.rados.0.smithi166.stdout:250: writing smithi16641208-250 from 1587781 to 2184943 tid 2 2020-11-16T20:55:55.122 INFO:tasks.rados.rados.0.smithi166.stdout:251: write initial oid 251 2020-11-16T20:55:55.122 INFO:tasks.rados.rados.0.smithi166.stdout:251: seq_num 250 ranges {601750=535546,1929910=271840} 2020-11-16T20:55:55.122 INFO:tasks.rados.rados.0.smithi166.stdout:251: writing smithi16641208-251 from 601750 to 1137296 tid 1 2020-11-16T20:55:55.122 INFO:tasks.rados.rados.0.smithi166.stdout:251: writing smithi16641208-251 from 1929910 to 2201750 tid 2 2020-11-16T20:55:55.122 INFO:tasks.rados.rados.0.smithi166.stdout:252: write initial oid 252 2020-11-16T20:55:55.122 INFO:tasks.rados.rados.0.smithi166.stdout:252: seq_num 251 ranges {618557=727148,2104745=113812} 2020-11-16T20:55:55.123 INFO:tasks.rados.rados.0.smithi166.stdout:252: writing smithi16641208-252 from 618557 to 1345705 tid 1 2020-11-16T20:55:55.123 INFO:tasks.rados.rados.0.smithi166.stdout:252: writing smithi16641208-252 from 2104745 to 2218557 tid 2 2020-11-16T20:55:55.123 INFO:tasks.rados.rados.0.smithi166.stdout:253: write initial oid 253 2020-11-16T20:55:55.123 INFO:tasks.rados.rados.0.smithi166.stdout:253: seq_num 252 ranges {635364=402397,1763227=472137} 2020-11-16T20:55:55.123 INFO:tasks.rados.rados.0.smithi166.stdout:253: writing smithi16641208-253 from 635364 to 1037761 tid 1 2020-11-16T20:55:55.123 INFO:tasks.rados.rados.0.smithi166.stdout:253: writing smithi16641208-253 from 1763227 to 2235364 tid 2 2020-11-16T20:55:55.123 INFO:tasks.rados.rados.0.smithi166.stdout:254: write initial oid 254 2020-11-16T20:55:55.124 INFO:tasks.rados.rados.0.smithi166.stdout:254: seq_num 253 ranges {652171=477646,1821709=430462} 2020-11-16T20:55:55.124 INFO:tasks.rados.rados.0.smithi166.stdout:254: writing smithi16641208-254 from 652171 to 1129817 tid 1 2020-11-16T20:55:55.124 INFO:tasks.rados.rados.0.smithi166.stdout:254: writing smithi16641208-254 from 1821709 to 2252171 tid 2 2020-11-16T20:55:55.124 INFO:tasks.rados.rados.0.smithi166.stdout:255: write initial oid 255 2020-11-16T20:55:55.124 INFO:tasks.rados.rados.0.smithi166.stdout:255: seq_num 254 ranges {668978=552895,1763838=505140} 2020-11-16T20:55:55.124 INFO:tasks.rados.rados.0.smithi166.stdout:255: writing smithi16641208-255 from 668978 to 1221873 tid 1 2020-11-16T20:55:55.124 INFO:tasks.rados.rados.0.smithi166.stdout:255: writing smithi16641208-255 from 1763838 to 2268978 tid 2 2020-11-16T20:55:55.124 INFO:tasks.rados.rados.0.smithi166.stdout:256: write initial oid 256 2020-11-16T20:55:55.125 INFO:tasks.rados.rados.0.smithi166.stdout:256: seq_num 255 ranges {685785=628144,1822320=463465} 2020-11-16T20:55:55.125 INFO:tasks.rados.rados.0.smithi166.stdout:256: writing smithi16641208-256 from 685785 to 1313929 tid 1 2020-11-16T20:55:55.125 INFO:tasks.rados.rados.0.smithi166.stdout:256: writing smithi16641208-256 from 1822320 to 2285785 tid 2 2020-11-16T20:55:55.125 INFO:tasks.rados.rados.0.smithi166.stdout:257: write initial oid 257 2020-11-16T20:55:55.125 INFO:tasks.rados.rados.0.smithi166.stdout:257: seq_num 256 ranges {702592=703393,1880802=421790} 2020-11-16T20:55:55.125 INFO:tasks.rados.rados.0.smithi166.stdout:257: writing smithi16641208-257 from 702592 to 1405985 tid 1 2020-11-16T20:55:55.125 INFO:tasks.rados.rados.0.smithi166.stdout:257: writing smithi16641208-257 from 1880802 to 2302592 tid 2 2020-11-16T20:55:55.126 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.126 INFO:tasks.rados.rados.0.smithi166.stdout:243: finishing write tid 2 to smithi16641208-243 2020-11-16T20:55:55.126 INFO:tasks.rados.rados.0.smithi166.stdout:243: finishing write tid 3 to smithi16641208-243 2020-11-16T20:55:55.126 INFO:tasks.rados.rados.0.smithi166.stdout:243: finishing write tid 4 to smithi16641208-243 2020-11-16T20:55:55.126 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 243 v 121 (ObjNum 242 snap 0 seq_num 242) dirty exists 2020-11-16T20:55:55.126 INFO:tasks.rados.rados.0.smithi166.stdout:243: left oid 243 (ObjNum 242 snap 0 seq_num 242) 2020-11-16T20:55:55.126 INFO:tasks.rados.rados.0.smithi166.stdout:244: finishing write tid 1 to smithi16641208-244 2020-11-16T20:55:55.127 INFO:tasks.rados.rados.0.smithi166.stdout:242: finishing write tid 4 to smithi16641208-242 2020-11-16T20:55:55.127 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 242 v 173 (ObjNum 241 snap 0 seq_num 241) dirty exists 2020-11-16T20:55:55.127 INFO:tasks.rados.rados.0.smithi166.stdout:242: left oid 242 (ObjNum 241 snap 0 seq_num 241) 2020-11-16T20:55:55.127 INFO:tasks.rados.rados.0.smithi166.stdout:244: finishing write tid 2 to smithi16641208-244 2020-11-16T20:55:55.127 INFO:tasks.rados.rados.0.smithi166.stdout:244: finishing write tid 3 to smithi16641208-244 2020-11-16T20:55:55.127 INFO:tasks.rados.rados.0.smithi166.stdout:242: done (15 left) 2020-11-16T20:55:55.127 INFO:tasks.rados.rados.0.smithi166.stdout:243: done (14 left) 2020-11-16T20:55:55.127 INFO:tasks.rados.rados.0.smithi166.stdout:258: write initial oid 258 2020-11-16T20:55:55.128 INFO:tasks.rados.rados.0.smithi166.stdout:245: finishing write tid 1 to smithi16641208-245 2020-11-16T20:55:55.128 INFO:tasks.rados.rados.0.smithi166.stdout:244: finishing write tid 4 to smithi16641208-244 2020-11-16T20:55:55.128 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 244 v 170 (ObjNum 243 snap 0 seq_num 243) dirty exists 2020-11-16T20:55:55.128 INFO:tasks.rados.rados.0.smithi166.stdout:244: left oid 244 (ObjNum 243 snap 0 seq_num 243) 2020-11-16T20:55:55.128 INFO:tasks.rados.rados.0.smithi166.stdout:245: finishing write tid 2 to smithi16641208-245 2020-11-16T20:55:55.128 INFO:tasks.rados.rados.0.smithi166.stdout:245: finishing write tid 3 to smithi16641208-245 2020-11-16T20:55:55.128 INFO:tasks.rados.rados.0.smithi166.stdout:245: finishing write tid 4 to smithi16641208-245 2020-11-16T20:55:55.129 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 245 v 173 (ObjNum 244 snap 0 seq_num 244) dirty exists 2020-11-16T20:55:55.129 INFO:tasks.rados.rados.0.smithi166.stdout:245: left oid 245 (ObjNum 244 snap 0 seq_num 244) 2020-11-16T20:55:55.129 INFO:tasks.rados.rados.0.smithi166.stdout:246: finishing write tid 1 to smithi16641208-246 2020-11-16T20:55:55.129 INFO:tasks.rados.rados.0.smithi166.stdout:246: finishing write tid 2 to smithi16641208-246 2020-11-16T20:55:55.129 INFO:tasks.rados.rados.0.smithi166.stdout:246: finishing write tid 3 to smithi16641208-246 2020-11-16T20:55:55.129 INFO:tasks.rados.rados.0.smithi166.stdout:246: finishing write tid 4 to smithi16641208-246 2020-11-16T20:55:55.129 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 246 v 176 (ObjNum 245 snap 0 seq_num 245) dirty exists 2020-11-16T20:55:55.129 INFO:tasks.rados.rados.0.smithi166.stdout:246: left oid 246 (ObjNum 245 snap 0 seq_num 245) 2020-11-16T20:55:55.130 INFO:tasks.rados.rados.0.smithi166.stdout:247: finishing write tid 1 to smithi16641208-247 2020-11-16T20:55:55.130 INFO:tasks.rados.rados.0.smithi166.stdout:247: finishing write tid 2 to smithi16641208-247 2020-11-16T20:55:55.130 INFO:tasks.rados.rados.0.smithi166.stdout:247: finishing write tid 3 to smithi16641208-247 2020-11-16T20:55:55.130 INFO:tasks.rados.rados.0.smithi166.stdout:247: finishing write tid 4 to smithi16641208-247 2020-11-16T20:55:55.130 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 247 v 123 (ObjNum 246 snap 0 seq_num 246) dirty exists 2020-11-16T20:55:55.130 INFO:tasks.rados.rados.0.smithi166.stdout:247: left oid 247 (ObjNum 246 snap 0 seq_num 246) 2020-11-16T20:55:55.130 INFO:tasks.rados.rados.0.smithi166.stdout:248: finishing write tid 1 to smithi16641208-248 2020-11-16T20:55:55.131 INFO:tasks.rados.rados.0.smithi166.stdout:248: finishing write tid 2 to smithi16641208-248 2020-11-16T20:55:55.131 INFO:tasks.rados.rados.0.smithi166.stdout:249: finishing write tid 1 to smithi16641208-249 2020-11-16T20:55:55.131 INFO:tasks.rados.rados.0.smithi166.stdout:249: finishing write tid 2 to smithi16641208-249 2020-11-16T20:55:55.131 INFO:tasks.rados.rados.0.smithi166.stdout:249: finishing write tid 3 to smithi16641208-249 2020-11-16T20:55:55.131 INFO:tasks.rados.rados.0.smithi166.stdout:249: finishing write tid 4 to smithi16641208-249 2020-11-16T20:55:55.131 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 249 v 179 (ObjNum 248 snap 0 seq_num 248) dirty exists 2020-11-16T20:55:55.131 INFO:tasks.rados.rados.0.smithi166.stdout:249: left oid 249 (ObjNum 248 snap 0 seq_num 248) 2020-11-16T20:55:55.131 INFO:tasks.rados.rados.0.smithi166.stdout:248: finishing write tid 3 to smithi16641208-248 2020-11-16T20:55:55.132 INFO:tasks.rados.rados.0.smithi166.stdout:248: finishing write tid 4 to smithi16641208-248 2020-11-16T20:55:55.132 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 248 v 124 (ObjNum 247 snap 0 seq_num 247) dirty exists 2020-11-16T20:55:55.132 INFO:tasks.rados.rados.0.smithi166.stdout:248: left oid 248 (ObjNum 247 snap 0 seq_num 247) 2020-11-16T20:55:55.132 INFO:tasks.rados.rados.0.smithi166.stdout:251: finishing write tid 1 to smithi16641208-251 2020-11-16T20:55:55.132 INFO:tasks.rados.rados.0.smithi166.stdout:251: finishing write tid 2 to smithi16641208-251 2020-11-16T20:55:55.132 INFO:tasks.rados.rados.0.smithi166.stdout:251: finishing write tid 3 to smithi16641208-251 2020-11-16T20:55:55.132 INFO:tasks.rados.rados.0.smithi166.stdout:251: finishing write tid 4 to smithi16641208-251 2020-11-16T20:55:55.132 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 251 v 182 (ObjNum 250 snap 0 seq_num 250) dirty exists 2020-11-16T20:55:55.133 INFO:tasks.rados.rados.0.smithi166.stdout:251: left oid 251 (ObjNum 250 snap 0 seq_num 250) 2020-11-16T20:55:55.133 INFO:tasks.rados.rados.0.smithi166.stdout:250: finishing write tid 1 to smithi16641208-250 2020-11-16T20:55:55.133 INFO:tasks.rados.rados.0.smithi166.stdout:250: finishing write tid 2 to smithi16641208-250 2020-11-16T20:55:55.133 INFO:tasks.rados.rados.0.smithi166.stdout:250: finishing write tid 3 to smithi16641208-250 2020-11-16T20:55:55.133 INFO:tasks.rados.rados.0.smithi166.stdout:250: finishing write tid 4 to smithi16641208-250 2020-11-16T20:55:55.133 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 250 v 127 (ObjNum 249 snap 0 seq_num 249) dirty exists 2020-11-16T20:55:55.133 INFO:tasks.rados.rados.0.smithi166.stdout:250: left oid 250 (ObjNum 249 snap 0 seq_num 249) 2020-11-16T20:55:55.134 INFO:tasks.rados.rados.0.smithi166.stdout:252: finishing write tid 1 to smithi16641208-252 2020-11-16T20:55:55.134 INFO:tasks.rados.rados.0.smithi166.stdout:252: finishing write tid 2 to smithi16641208-252 2020-11-16T20:55:55.134 INFO:tasks.rados.rados.0.smithi166.stdout:252: finishing write tid 3 to smithi16641208-252 2020-11-16T20:55:55.134 INFO:tasks.rados.rados.0.smithi166.stdout:252: finishing write tid 4 to smithi16641208-252 2020-11-16T20:55:55.134 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 252 v 229 (ObjNum 251 snap 0 seq_num 251) dirty exists 2020-11-16T20:55:55.134 INFO:tasks.rados.rados.0.smithi166.stdout:252: left oid 252 (ObjNum 251 snap 0 seq_num 251) 2020-11-16T20:55:55.134 INFO:tasks.rados.rados.0.smithi166.stdout:253: finishing write tid 1 to smithi16641208-253 2020-11-16T20:55:55.135 INFO:tasks.rados.rados.0.smithi166.stdout:253: finishing write tid 2 to smithi16641208-253 2020-11-16T20:55:55.135 INFO:tasks.rados.rados.0.smithi166.stdout:253: finishing write tid 3 to smithi16641208-253 2020-11-16T20:55:55.135 INFO:tasks.rados.rados.0.smithi166.stdout:253: finishing write tid 4 to smithi16641208-253 2020-11-16T20:55:55.135 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 253 v 132 (ObjNum 252 snap 0 seq_num 252) dirty exists 2020-11-16T20:55:55.135 INFO:tasks.rados.rados.0.smithi166.stdout:253: left oid 253 (ObjNum 252 snap 0 seq_num 252) 2020-11-16T20:55:55.135 INFO:tasks.rados.rados.0.smithi166.stdout:254: finishing write tid 1 to smithi16641208-254 2020-11-16T20:55:55.135 INFO:tasks.rados.rados.0.smithi166.stdout:254: finishing write tid 2 to smithi16641208-254 2020-11-16T20:55:55.135 INFO:tasks.rados.rados.0.smithi166.stdout:254: finishing write tid 3 to smithi16641208-254 2020-11-16T20:55:55.136 INFO:tasks.rados.rados.0.smithi166.stdout:254: finishing write tid 4 to smithi16641208-254 2020-11-16T20:55:55.136 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 254 v 232 (ObjNum 253 snap 0 seq_num 253) dirty exists 2020-11-16T20:55:55.136 INFO:tasks.rados.rados.0.smithi166.stdout:254: left oid 254 (ObjNum 253 snap 0 seq_num 253) 2020-11-16T20:55:55.136 INFO:tasks.rados.rados.0.smithi166.stdout:255: finishing write tid 1 to smithi16641208-255 2020-11-16T20:55:55.136 INFO:tasks.rados.rados.0.smithi166.stdout:255: finishing write tid 2 to smithi16641208-255 2020-11-16T20:55:55.136 INFO:tasks.rados.rados.0.smithi166.stdout:255: finishing write tid 3 to smithi16641208-255 2020-11-16T20:55:55.136 INFO:tasks.rados.rados.0.smithi166.stdout:255: finishing write tid 4 to smithi16641208-255 2020-11-16T20:55:55.136 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 255 v 135 (ObjNum 254 snap 0 seq_num 254) dirty exists 2020-11-16T20:55:55.137 INFO:tasks.rados.rados.0.smithi166.stdout:255: left oid 255 (ObjNum 254 snap 0 seq_num 254) 2020-11-16T20:55:55.137 INFO:tasks.rados.rados.0.smithi166.stdout:256: finishing write tid 1 to smithi16641208-256 2020-11-16T20:55:55.137 INFO:tasks.rados.rados.0.smithi166.stdout:256: finishing write tid 2 to smithi16641208-256 2020-11-16T20:55:55.137 INFO:tasks.rados.rados.0.smithi166.stdout:256: finishing write tid 3 to smithi16641208-256 2020-11-16T20:55:55.137 INFO:tasks.rados.rados.0.smithi166.stdout:258: seq_num 257 ranges {719399=778642,1939284=380115} 2020-11-16T20:55:55.137 INFO:tasks.rados.rados.0.smithi166.stdout:258: writing smithi16641208-258 from 719399 to 1498041 tid 1 2020-11-16T20:55:55.137 INFO:tasks.rados.rados.0.smithi166.stdout:258: writing smithi16641208-258 from 1939284 to 2319399 tid 2 2020-11-16T20:55:55.138 INFO:tasks.rados.rados.0.smithi166.stdout:244: done (14 left) 2020-11-16T20:55:55.138 INFO:tasks.rados.rados.0.smithi166.stdout:245: done (13 left) 2020-11-16T20:55:55.138 INFO:tasks.rados.rados.0.smithi166.stdout:246: done (12 left) 2020-11-16T20:55:55.138 INFO:tasks.rados.rados.0.smithi166.stdout:247: done (11 left) 2020-11-16T20:55:55.138 INFO:tasks.rados.rados.0.smithi166.stdout:248: done (10 left) 2020-11-16T20:55:55.138 INFO:tasks.rados.rados.0.smithi166.stdout:249: done (9 left) 2020-11-16T20:55:55.138 INFO:tasks.rados.rados.0.smithi166.stdout:250: done (8 left) 2020-11-16T20:55:55.138 INFO:tasks.rados.rados.0.smithi166.stdout:251: done (7 left) 2020-11-16T20:55:55.139 INFO:tasks.rados.rados.0.smithi166.stdout:252: done (6 left) 2020-11-16T20:55:55.139 INFO:tasks.rados.rados.0.smithi166.stdout:253: done (5 left) 2020-11-16T20:55:55.139 INFO:tasks.rados.rados.0.smithi166.stdout:254: done (4 left) 2020-11-16T20:55:55.139 INFO:tasks.rados.rados.0.smithi166.stdout:255: done (3 left) 2020-11-16T20:55:55.139 INFO:tasks.rados.rados.0.smithi166.stdout:259: write initial oid 259 2020-11-16T20:55:55.139 INFO:tasks.rados.rados.0.smithi166.stdout:259: seq_num 258 ranges {736206=453891,1881413=454793} 2020-11-16T20:55:55.139 INFO:tasks.rados.rados.0.smithi166.stdout:259: writing smithi16641208-259 from 736206 to 1190097 tid 1 2020-11-16T20:55:55.140 INFO:tasks.rados.rados.0.smithi166.stdout:259: writing smithi16641208-259 from 1881413 to 2336206 tid 2 2020-11-16T20:55:55.140 INFO:tasks.rados.rados.0.smithi166.stdout:260: write initial oid 260 2020-11-16T20:55:55.140 INFO:tasks.rados.rados.0.smithi166.stdout:260: seq_num 259 ranges {753013=645493,2056248=296765} 2020-11-16T20:55:55.140 INFO:tasks.rados.rados.0.smithi166.stdout:260: writing smithi16641208-260 from 753013 to 1398506 tid 1 2020-11-16T20:55:55.140 INFO:tasks.rados.rados.0.smithi166.stdout:260: writing smithi16641208-260 from 2056248 to 2353013 tid 2 2020-11-16T20:55:55.140 INFO:tasks.rados.rados.0.smithi166.stdout:261: write initial oid 261 2020-11-16T20:55:55.140 INFO:tasks.rados.rados.0.smithi166.stdout:261: seq_num 260 ranges {769820=720742,2114730=255090} 2020-11-16T20:55:55.140 INFO:tasks.rados.rados.0.smithi166.stdout:261: writing smithi16641208-261 from 769820 to 1490562 tid 1 2020-11-16T20:55:55.141 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:55:55.141 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:55.121+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:55.142 INFO:tasks.rados.rados.0.smithi166.stdout:261: writing smithi16641208-261 from 2114730 to 2369820 tid 2 2020-11-16T20:55:55.143 INFO:tasks.rados.rados.0.smithi166.stdout:262: write initial oid 262 2020-11-16T20:55:55.143 INFO:tasks.rados.rados.0.smithi166.stdout:262: seq_num 261 ranges {786627=795991,2173212=213415} 2020-11-16T20:55:55.143 INFO:tasks.rados.rados.0.smithi166.stdout:262: writing smithi16641208-262 from 786627 to 1582618 tid 1 2020-11-16T20:55:55.143 INFO:tasks.rados.rados.0.smithi166.stdout:262: writing smithi16641208-262 from 2173212 to 2386627 tid 2 2020-11-16T20:55:55.143 INFO:tasks.rados.rados.0.smithi166.stdout:263: write initial oid 263 2020-11-16T20:55:55.143 INFO:tasks.rados.rados.0.smithi166.stdout:263: seq_num 262 ranges {403434=471240,1315341=400756} 2020-11-16T20:55:55.144 INFO:tasks.rados.rados.0.smithi166.stdout:263: writing smithi16641208-263 from 403434 to 874674 tid 1 2020-11-16T20:55:55.146 INFO:tasks.rados.rados.0.smithi166.stdout:263: writing smithi16641208-263 from 1315341 to 1716097 tid 2 2020-11-16T20:55:55.147 INFO:tasks.rados.rados.0.smithi166.stdout:264: write initial oid 264 2020-11-16T20:55:55.147 INFO:tasks.rados.rados.0.smithi166.stdout:257: finishing write tid 1 to smithi16641208-257 2020-11-16T20:55:55.147 INFO:tasks.rados.rados.0.smithi166.stdout:264: seq_num 263 ranges {420241=546489,1373823=544414} 2020-11-16T20:55:55.152 INFO:tasks.rados.rados.0.smithi166.stdout:264: writing smithi16641208-264 from 420241 to 966730 tid 1 2020-11-16T20:55:55.158 INFO:tasks.rados.rados.0.smithi166.stdout:264: writing smithi16641208-264 from 1373823 to 1918237 tid 2 2020-11-16T20:55:55.158 INFO:tasks.rados.rados.0.smithi166.stdout:265: write initial oid 265 2020-11-16T20:55:55.158 INFO:tasks.rados.rados.0.smithi166.stdout:265: seq_num 264 ranges {437048=621738,1832305=404425} 2020-11-16T20:55:55.164 INFO:tasks.rados.rados.0.smithi166.stdout:265: writing smithi16641208-265 from 437048 to 1058786 tid 1 2020-11-16T20:55:55.171 INFO:tasks.rados.rados.0.smithi166.stdout:265: writing smithi16641208-265 from 1832305 to 2236730 tid 2 2020-11-16T20:55:55.171 INFO:tasks.rados.rados.0.smithi166.stdout:266: write initial oid 266 2020-11-16T20:55:55.171 INFO:tasks.rados.rados.0.smithi166.stdout:266: seq_num 265 ranges {453855=696987,1890787=548083} 2020-11-16T20:55:55.178 INFO:tasks.rados.rados.0.smithi166.stdout:266: writing smithi16641208-266 from 453855 to 1150842 tid 1 2020-11-16T20:55:55.185 INFO:tasks.rados.rados.0.smithi166.stdout:266: writing smithi16641208-266 from 1890787 to 2438870 tid 2 2020-11-16T20:55:55.186 INFO:tasks.rados.rados.0.smithi166.stdout:267: write initial oid 267 2020-11-16T20:55:55.186 INFO:tasks.rados.rados.0.smithi166.stdout:267: seq_num 266 ranges {470662=772236,1832916=408094} 2020-11-16T20:55:55.193 INFO:tasks.rados.rados.0.smithi166.stdout:267: writing smithi16641208-267 from 470662 to 1242898 tid 1 2020-11-16T20:55:55.198 INFO:tasks.rados.rados.0.smithi166.stdout:267: writing smithi16641208-267 from 1832916 to 2241010 tid 2 2020-11-16T20:55:55.199 INFO:tasks.rados.rados.0.smithi166.stdout:268: write initial oid 268 2020-11-16T20:55:55.199 INFO:tasks.rados.rados.0.smithi166.stdout:268: seq_num 267 ranges {487469=563838,1607751=551752} 2020-11-16T20:55:55.204 INFO:tasks.rados.rados.0.smithi166.stdout:268: writing smithi16641208-268 from 487469 to 1051307 tid 1 2020-11-16T20:55:55.206 INFO:tasks.ceph.mgr.x.smithi059.stderr:2020-11-16T20:55:55.210+0000 7f8afd618700 -1 mgr.server reply reply (2) No such file or directory no change 2020-11-16T20:55:55.207 INFO:teuthology.orchestra.run.smithi166.stdout:moved 9 / 81 (11.1111%) 2020-11-16T20:55:55.207 INFO:teuthology.orchestra.run.smithi166.stdout:avg 10.125 2020-11-16T20:55:55.207 INFO:teuthology.orchestra.run.smithi166.stdout:stddev 2.42061 -> 3.68909 (expected baseline 2.97647) 2020-11-16T20:55:55.207 INFO:teuthology.orchestra.run.smithi166.stdout:min osd.2 with 7 -> 8 pgs (0.691358 -> 0.790123 * mean) 2020-11-16T20:55:55.208 INFO:teuthology.orchestra.run.smithi166.stdout:max osd.7 with 14 -> 14 pgs (1.38272 -> 1.38272 * mean) 2020-11-16T20:55:55.208 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:55:55.208 INFO:teuthology.orchestra.run.smithi166.stdout:oload 110 2020-11-16T20:55:55.208 INFO:teuthology.orchestra.run.smithi166.stdout:max_change 3 2020-11-16T20:55:55.208 INFO:teuthology.orchestra.run.smithi166.stdout:max_change_osds 4 2020-11-16T20:55:55.208 INFO:teuthology.orchestra.run.smithi166.stdout:average_utilization 0.0006 2020-11-16T20:55:55.208 INFO:teuthology.orchestra.run.smithi166.stdout:overload_utilization 0.0007 2020-11-16T20:55:55.209 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0 weight 1.0000 -> 0.4682 2020-11-16T20:55:55.209 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5 weight 1.0000 -> 0.5721 2020-11-16T20:55:55.210 INFO:teuthology.orchestra.run.smithi166.stderr:no change 2020-11-16T20:55:55.211 INFO:tasks.rados.rados.0.smithi166.stdout:268: writing smithi16641208-268 from 1607751 to 2159503 tid 2 2020-11-16T20:55:55.211 INFO:tasks.rados.rados.0.smithi166.stdout:269: write initial oid 269 2020-11-16T20:55:55.211 INFO:tasks.rados.rados.0.smithi166.stdout:269: seq_num 268 ranges {504276=639087,1666233=695410} 2020-11-16T20:55:55.217 INFO:tasks.rados.rados.0.smithi166.stdout:269: writing smithi16641208-269 from 504276 to 1143363 tid 1 2020-11-16T20:55:55.218 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:55:55.222+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:55:55.224 INFO:tasks.rados.rados.0.smithi166.stdout:269: writing smithi16641208-269 from 1666233 to 2361643 tid 2 2020-11-16T20:55:55.225 INFO:tasks.rados.rados.0.smithi166.stdout:270: write initial oid 270 2020-11-16T20:55:55.225 INFO:tasks.rados.rados.0.smithi166.stdout:270: seq_num 269 ranges {521083=714336,1724715=555421} 2020-11-16T20:55:55.231 INFO:tasks.rados.rados.0.smithi166.stdout:270: writing smithi16641208-270 from 521083 to 1235419 tid 1 2020-11-16T20:55:55.238 INFO:tasks.rados.rados.0.smithi166.stdout:270: writing smithi16641208-270 from 1724715 to 2280136 tid 2 2020-11-16T20:55:55.238 INFO:tasks.rados.rados.0.smithi166.stdout:271: write initial oid 271 2020-11-16T20:55:55.238 INFO:tasks.rados.rados.0.smithi166.stdout:271: seq_num 270 ranges {537890=789585,1783197=699079} 2020-11-16T20:55:55.245 INFO:tasks.rados.rados.0.smithi166.stdout:271: writing smithi16641208-271 from 537890 to 1327475 tid 1 2020-11-16T20:55:55.252 INFO:tasks.rados.rados.0.smithi166.stdout:271: writing smithi16641208-271 from 1783197 to 2482276 tid 2 2020-11-16T20:55:55.252 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.253 INFO:tasks.rados.rados.0.smithi166.stdout:256: finishing write tid 4 to smithi16641208-256 2020-11-16T20:55:55.253 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 256 v 176 (ObjNum 255 snap 0 seq_num 255) dirty exists 2020-11-16T20:55:55.253 INFO:tasks.rados.rados.0.smithi166.stdout:256: left oid 256 (ObjNum 255 snap 0 seq_num 255) 2020-11-16T20:55:55.253 INFO:tasks.rados.rados.0.smithi166.stdout:256: done (15 left) 2020-11-16T20:55:55.253 INFO:tasks.rados.rados.0.smithi166.stdout:272: write initial oid 272 2020-11-16T20:55:55.253 INFO:tasks.rados.rados.0.smithi166.stdout:272: seq_num 271 ranges {554697=464834,1725326=559090} 2020-11-16T20:55:55.257 INFO:tasks.rados.rados.0.smithi166.stdout:272: writing smithi16641208-272 from 554697 to 1019531 tid 1 2020-11-16T20:55:55.265 INFO:tasks.rados.rados.0.smithi166.stdout:272: writing smithi16641208-272 from 1725326 to 2284416 tid 2 2020-11-16T20:55:55.265 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.266 INFO:tasks.rados.rados.0.smithi166.stdout:257: finishing write tid 2 to smithi16641208-257 2020-11-16T20:55:55.266 INFO:tasks.rados.rados.0.smithi166.stdout:257: finishing write tid 3 to smithi16641208-257 2020-11-16T20:55:55.266 INFO:tasks.rados.rados.0.smithi166.stdout:257: finishing write tid 4 to smithi16641208-257 2020-11-16T20:55:55.266 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 257 v 185 (ObjNum 256 snap 0 seq_num 256) dirty exists 2020-11-16T20:55:55.266 INFO:tasks.rados.rados.0.smithi166.stdout:257: left oid 257 (ObjNum 256 snap 0 seq_num 256) 2020-11-16T20:55:55.267 INFO:tasks.rados.rados.0.smithi166.stdout:258: finishing write tid 1 to smithi16641208-258 2020-11-16T20:55:55.267 INFO:tasks.rados.rados.0.smithi166.stdout:257: done (15 left) 2020-11-16T20:55:55.267 INFO:tasks.rados.rados.0.smithi166.stdout:273: write initial oid 273 2020-11-16T20:55:55.267 INFO:tasks.rados.rados.0.smithi166.stdout:273: seq_num 272 ranges {571504=540083,1783808=702748} 2020-11-16T20:55:55.271 INFO:tasks.rados.rados.0.smithi166.stdout:273: writing smithi16641208-273 from 571504 to 1111587 tid 1 2020-11-16T20:55:55.279 INFO:tasks.rados.rados.0.smithi166.stdout:273: writing smithi16641208-273 from 1783808 to 2486556 tid 2 2020-11-16T20:55:55.279 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.280 INFO:tasks.rados.rados.0.smithi166.stdout:258: finishing write tid 2 to smithi16641208-258 2020-11-16T20:55:55.280 INFO:tasks.rados.rados.0.smithi166.stdout:258: finishing write tid 3 to smithi16641208-258 2020-11-16T20:55:55.280 INFO:tasks.rados.rados.0.smithi166.stdout:258: finishing write tid 4 to smithi16641208-258 2020-11-16T20:55:55.280 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 258 v 188 (ObjNum 257 snap 0 seq_num 257) dirty exists 2020-11-16T20:55:55.280 INFO:tasks.rados.rados.0.smithi166.stdout:258: left oid 258 (ObjNum 257 snap 0 seq_num 257) 2020-11-16T20:55:55.281 INFO:tasks.rados.rados.0.smithi166.stdout:259: finishing write tid 1 to smithi16641208-259 2020-11-16T20:55:55.281 INFO:tasks.rados.rados.0.smithi166.stdout:258: done (15 left) 2020-11-16T20:55:55.281 INFO:tasks.rados.rados.0.smithi166.stdout:274: write initial oid 274 2020-11-16T20:55:55.281 INFO:tasks.rados.rados.0.smithi166.stdout:274: seq_num 273 ranges {588311=615332,1842290=562759} 2020-11-16T20:55:55.286 INFO:tasks.rados.rados.0.smithi166.stdout:274: writing smithi16641208-274 from 588311 to 1203643 tid 1 2020-11-16T20:55:55.293 INFO:tasks.rados.rados.0.smithi166.stdout:274: writing smithi16641208-274 from 1842290 to 2405049 tid 2 2020-11-16T20:55:55.293 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.293 INFO:tasks.rados.rados.0.smithi166.stdout:259: finishing write tid 2 to smithi16641208-259 2020-11-16T20:55:55.293 INFO:tasks.rados.rados.0.smithi166.stdout:259: finishing write tid 3 to smithi16641208-259 2020-11-16T20:55:55.294 INFO:tasks.rados.rados.0.smithi166.stdout:259: finishing write tid 4 to smithi16641208-259 2020-11-16T20:55:55.294 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 259 v 191 (ObjNum 258 snap 0 seq_num 258) dirty exists 2020-11-16T20:55:55.294 INFO:tasks.rados.rados.0.smithi166.stdout:259: left oid 259 (ObjNum 258 snap 0 seq_num 258) 2020-11-16T20:55:55.294 INFO:tasks.rados.rados.0.smithi166.stdout:260: finishing write tid 1 to smithi16641208-260 2020-11-16T20:55:55.294 INFO:tasks.rados.rados.0.smithi166.stdout:260: finishing write tid 2 to smithi16641208-260 2020-11-16T20:55:55.294 INFO:tasks.rados.rados.0.smithi166.stdout:260: finishing write tid 3 to smithi16641208-260 2020-11-16T20:55:55.294 INFO:tasks.rados.rados.0.smithi166.stdout:260: finishing write tid 4 to smithi16641208-260 2020-11-16T20:55:55.295 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 260 v 179 (ObjNum 259 snap 0 seq_num 259) dirty exists 2020-11-16T20:55:55.295 INFO:tasks.rados.rados.0.smithi166.stdout:260: left oid 260 (ObjNum 259 snap 0 seq_num 259) 2020-11-16T20:55:55.295 INFO:tasks.rados.rados.0.smithi166.stdout:259: done (15 left) 2020-11-16T20:55:55.295 INFO:tasks.rados.rados.0.smithi166.stdout:260: done (14 left) 2020-11-16T20:55:55.295 INFO:tasks.rados.rados.0.smithi166.stdout:275: write initial oid 275 2020-11-16T20:55:55.295 INFO:tasks.rados.rados.0.smithi166.stdout:275: seq_num 274 ranges {605118=406934,1617125=706417} 2020-11-16T20:55:55.299 INFO:tasks.rados.rados.0.smithi166.stdout:275: writing smithi16641208-275 from 605118 to 1012052 tid 1 2020-11-16T20:55:55.306 INFO:tasks.rados.rados.0.smithi166.stdout:275: writing smithi16641208-275 from 1617125 to 2323542 tid 2 2020-11-16T20:55:55.306 INFO:tasks.rados.rados.0.smithi166.stdout:276: write initial oid 276 2020-11-16T20:55:55.307 INFO:tasks.rados.rados.0.smithi166.stdout:276: seq_num 275 ranges {621925=482183,1559254=566428} 2020-11-16T20:55:55.312 INFO:tasks.rados.rados.0.smithi166.stdout:276: writing smithi16641208-276 from 621925 to 1104108 tid 1 2020-11-16T20:55:55.319 INFO:tasks.rados.rados.0.smithi166.stdout:276: writing smithi16641208-276 from 1559254 to 2125682 tid 2 2020-11-16T20:55:55.319 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.319 INFO:tasks.rados.rados.0.smithi166.stdout:261: finishing write tid 1 to smithi16641208-261 2020-11-16T20:55:55.319 INFO:tasks.rados.rados.0.smithi166.stdout:261: finishing write tid 2 to smithi16641208-261 2020-11-16T20:55:55.320 INFO:tasks.rados.rados.0.smithi166.stdout:261: finishing write tid 3 to smithi16641208-261 2020-11-16T20:55:55.320 INFO:tasks.rados.rados.0.smithi166.stdout:261: finishing write tid 4 to smithi16641208-261 2020-11-16T20:55:55.320 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 261 v 194 (ObjNum 260 snap 0 seq_num 260) dirty exists 2020-11-16T20:55:55.320 INFO:tasks.rados.rados.0.smithi166.stdout:261: left oid 261 (ObjNum 260 snap 0 seq_num 260) 2020-11-16T20:55:55.320 INFO:tasks.rados.rados.0.smithi166.stdout:262: finishing write tid 1 to smithi16641208-262 2020-11-16T20:55:55.320 INFO:tasks.rados.rados.0.smithi166.stdout:262: finishing write tid 2 to smithi16641208-262 2020-11-16T20:55:55.320 INFO:tasks.rados.rados.0.smithi166.stdout:262: finishing write tid 3 to smithi16641208-262 2020-11-16T20:55:55.321 INFO:tasks.rados.rados.0.smithi166.stdout:262: finishing write tid 4 to smithi16641208-262 2020-11-16T20:55:55.321 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 262 v 197 (ObjNum 261 snap 0 seq_num 261) dirty exists 2020-11-16T20:55:55.321 INFO:tasks.rados.rados.0.smithi166.stdout:262: left oid 262 (ObjNum 261 snap 0 seq_num 261) 2020-11-16T20:55:55.321 INFO:tasks.rados.rados.0.smithi166.stdout:263: finishing write tid 1 to smithi16641208-263 2020-11-16T20:55:55.321 INFO:tasks.rados.rados.0.smithi166.stdout:261: done (15 left) 2020-11-16T20:55:55.321 INFO:tasks.rados.rados.0.smithi166.stdout:262: done (14 left) 2020-11-16T20:55:55.321 INFO:tasks.rados.rados.0.smithi166.stdout:277: write initial oid 277 2020-11-16T20:55:55.321 INFO:tasks.rados.rados.0.smithi166.stdout:277: seq_num 276 ranges {638732=557432,1617736=710086} 2020-11-16T20:55:55.322 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:55:55.323+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:55:55.325 INFO:tasks.rados.rados.0.smithi166.stdout:277: writing smithi16641208-277 from 638732 to 1196164 tid 1 2020-11-16T20:55:55.330 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:55.331 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:55:55.331 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:55:55.331 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:55.332 INFO:tasks.rados.rados.0.smithi166.stdout:277: writing smithi16641208-277 from 1617736 to 2327822 tid 2 2020-11-16T20:55:55.332 INFO:tasks.rados.rados.0.smithi166.stdout:278: write initial oid 278 2020-11-16T20:55:55.332 INFO:tasks.rados.rados.0.smithi166.stdout:278: seq_num 277 ranges {655539=632681,2076218=570097} 2020-11-16T20:55:55.339 INFO:tasks.rados.rados.0.smithi166.stdout:278: writing smithi16641208-278 from 655539 to 1288220 tid 1 2020-11-16T20:55:55.343 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:55:55.347 INFO:tasks.rados.rados.0.smithi166.stdout:278: writing smithi16641208-278 from 2076218 to 2646315 tid 2 2020-11-16T20:55:55.347 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.347 INFO:tasks.rados.rados.0.smithi166.stdout:263: finishing write tid 2 to smithi16641208-263 2020-11-16T20:55:55.347 INFO:tasks.rados.rados.0.smithi166.stdout:263: finishing write tid 3 to smithi16641208-263 2020-11-16T20:55:55.347 INFO:tasks.rados.rados.0.smithi166.stdout:263: finishing write tid 4 to smithi16641208-263 2020-11-16T20:55:55.348 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 263 v 235 (ObjNum 262 snap 0 seq_num 262) dirty exists 2020-11-16T20:55:55.348 INFO:tasks.rados.rados.0.smithi166.stdout:263: left oid 263 (ObjNum 262 snap 0 seq_num 262) 2020-11-16T20:55:55.348 INFO:tasks.rados.rados.0.smithi166.stdout:264: finishing write tid 1 to smithi16641208-264 2020-11-16T20:55:55.348 INFO:tasks.rados.rados.0.smithi166.stdout:264: finishing write tid 2 to smithi16641208-264 2020-11-16T20:55:55.348 INFO:tasks.rados.rados.0.smithi166.stdout:263: done (15 left) 2020-11-16T20:55:55.348 INFO:tasks.rados.rados.0.smithi166.stdout:279: write initial oid 279 2020-11-16T20:55:55.348 INFO:tasks.rados.rados.0.smithi166.stdout:279: seq_num 278 ranges {672346=707930,2134700=537646} 2020-11-16T20:55:55.355 INFO:tasks.rados.rados.0.smithi166.stdout:279: writing smithi16641208-279 from 672346 to 1380276 tid 1 2020-11-16T20:55:55.362 INFO:tasks.rados.rados.0.smithi166.stdout:279: writing smithi16641208-279 from 2134700 to 2672346 tid 2 2020-11-16T20:55:55.363 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.363 INFO:tasks.rados.rados.0.smithi166.stdout:264: finishing write tid 3 to smithi16641208-264 2020-11-16T20:55:55.363 INFO:tasks.rados.rados.0.smithi166.stdout:264: finishing write tid 4 to smithi16641208-264 2020-11-16T20:55:55.363 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 264 v 138 (ObjNum 263 snap 0 seq_num 263) dirty exists 2020-11-16T20:55:55.363 INFO:tasks.rados.rados.0.smithi166.stdout:264: left oid 264 (ObjNum 263 snap 0 seq_num 263) 2020-11-16T20:55:55.363 INFO:tasks.rados.rados.0.smithi166.stdout:265: finishing write tid 1 to smithi16641208-265 2020-11-16T20:55:55.364 INFO:tasks.rados.rados.0.smithi166.stdout:264: done (15 left) 2020-11-16T20:55:55.364 INFO:tasks.rados.rados.0.smithi166.stdout:280: write initial oid 280 2020-11-16T20:55:55.364 INFO:tasks.rados.rados.0.smithi166.stdout:280: seq_num 279 ranges {689153=783179,2076829=457413} 2020-11-16T20:55:55.371 INFO:tasks.rados.rados.0.smithi166.stdout:280: writing smithi16641208-280 from 689153 to 1472332 tid 1 2020-11-16T20:55:55.377 INFO:tasks.rados.rados.0.smithi166.stdout:280: writing smithi16641208-280 from 2076829 to 2534242 tid 2 2020-11-16T20:55:55.377 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.377 INFO:tasks.rados.rados.0.smithi166.stdout:265: finishing write tid 2 to smithi16641208-265 2020-11-16T20:55:55.377 INFO:tasks.rados.rados.0.smithi166.stdout:265: finishing write tid 3 to smithi16641208-265 2020-11-16T20:55:55.378 INFO:tasks.rados.rados.0.smithi166.stdout:265: finishing write tid 4 to smithi16641208-265 2020-11-16T20:55:55.378 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 265 v 182 (ObjNum 264 snap 0 seq_num 264) dirty exists 2020-11-16T20:55:55.378 INFO:tasks.rados.rados.0.smithi166.stdout:265: left oid 265 (ObjNum 264 snap 0 seq_num 264) 2020-11-16T20:55:55.378 INFO:tasks.rados.rados.0.smithi166.stdout:266: finishing write tid 1 to smithi16641208-266 2020-11-16T20:55:55.378 INFO:tasks.rados.rados.0.smithi166.stdout:265: done (15 left) 2020-11-16T20:55:55.378 INFO:tasks.rados.rados.0.smithi166.stdout:281: write initial oid 281 2020-11-16T20:55:55.378 INFO:tasks.rados.rados.0.smithi166.stdout:281: seq_num 280 ranges {705960=458428,1735311=717424} 2020-11-16T20:55:55.386 INFO:tasks.rados.rados.0.smithi166.stdout:281: writing smithi16641208-281 from 705960 to 1164388 tid 1 2020-11-16T20:55:55.392 INFO:tasks.rados.rados.0.smithi166.stdout:281: writing smithi16641208-281 from 1735311 to 2452735 tid 2 2020-11-16T20:55:55.392 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.392 INFO:tasks.rados.rados.0.smithi166.stdout:266: finishing write tid 2 to smithi16641208-266 2020-11-16T20:55:55.392 INFO:tasks.rados.rados.0.smithi166.stdout:266: finishing write tid 3 to smithi16641208-266 2020-11-16T20:55:55.392 INFO:tasks.rados.rados.0.smithi166.stdout:266: finishing write tid 4 to smithi16641208-266 2020-11-16T20:55:55.392 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 266 v 238 (ObjNum 265 snap 0 seq_num 265) dirty exists 2020-11-16T20:55:55.393 INFO:tasks.rados.rados.0.smithi166.stdout:266: left oid 266 (ObjNum 265 snap 0 seq_num 265) 2020-11-16T20:55:55.393 INFO:tasks.rados.rados.0.smithi166.stdout:267: finishing write tid 1 to smithi16641208-267 2020-11-16T20:55:55.393 INFO:tasks.rados.rados.0.smithi166.stdout:267: finishing write tid 2 to smithi16641208-267 2020-11-16T20:55:55.393 INFO:tasks.rados.rados.0.smithi166.stdout:266: done (15 left) 2020-11-16T20:55:55.393 INFO:tasks.rados.rados.0.smithi166.stdout:282: write initial oid 282 2020-11-16T20:55:55.393 INFO:tasks.rados.rados.0.smithi166.stdout:282: seq_num 281 ranges {722767=533677,1793793=461082} 2020-11-16T20:55:55.398 INFO:tasks.rados.rados.0.smithi166.stdout:282: writing smithi16641208-282 from 722767 to 1256444 tid 1 2020-11-16T20:55:55.404 INFO:tasks.rados.rados.0.smithi166.stdout:282: writing smithi16641208-282 from 1793793 to 2254875 tid 2 2020-11-16T20:55:55.404 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.405 INFO:tasks.rados.rados.0.smithi166.stdout:267: finishing write tid 3 to smithi16641208-267 2020-11-16T20:55:55.405 INFO:tasks.rados.rados.0.smithi166.stdout:267: finishing write tid 4 to smithi16641208-267 2020-11-16T20:55:55.405 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 267 v 241 (ObjNum 266 snap 0 seq_num 266) dirty exists 2020-11-16T20:55:55.405 INFO:tasks.rados.rados.0.smithi166.stdout:267: left oid 267 (ObjNum 266 snap 0 seq_num 266) 2020-11-16T20:55:55.405 INFO:tasks.rados.rados.0.smithi166.stdout:268: finishing write tid 1 to smithi16641208-268 2020-11-16T20:55:55.405 INFO:tasks.rados.rados.0.smithi166.stdout:268: finishing write tid 2 to smithi16641208-268 2020-11-16T20:55:55.406 INFO:tasks.rados.rados.0.smithi166.stdout:268: finishing write tid 3 to smithi16641208-268 2020-11-16T20:55:55.406 INFO:tasks.rados.rados.0.smithi166.stdout:267: done (15 left) 2020-11-16T20:55:55.406 INFO:tasks.rados.rados.0.smithi166.stdout:283: write initial oid 283 2020-11-16T20:55:55.406 INFO:tasks.rados.rados.0.smithi166.stdout:283: seq_num 282 ranges {739574=725279,1968628=721093} 2020-11-16T20:55:55.412 INFO:tasks.rados.rados.0.smithi166.stdout:283: writing smithi16641208-283 from 739574 to 1464853 tid 1 2020-11-16T20:55:55.420 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:55:55.424+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:55:55.420 INFO:tasks.rados.rados.0.smithi166.stdout:283: writing smithi16641208-283 from 1968628 to 2689721 tid 2 2020-11-16T20:55:55.420 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.421 INFO:tasks.rados.rados.0.smithi166.stdout:268: finishing write tid 4 to smithi16641208-268 2020-11-16T20:55:55.421 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 268 v 200 (ObjNum 267 snap 0 seq_num 267) dirty exists 2020-11-16T20:55:55.421 INFO:tasks.rados.rados.0.smithi166.stdout:268: left oid 268 (ObjNum 267 snap 0 seq_num 267) 2020-11-16T20:55:55.421 INFO:tasks.rados.rados.0.smithi166.stdout:269: finishing write tid 1 to smithi16641208-269 2020-11-16T20:55:55.421 INFO:tasks.rados.rados.0.smithi166.stdout:269: finishing write tid 2 to smithi16641208-269 2020-11-16T20:55:55.421 INFO:tasks.rados.rados.0.smithi166.stdout:268: done (15 left) 2020-11-16T20:55:55.421 INFO:tasks.rados.rados.0.smithi166.stdout:284: write initial oid 284 2020-11-16T20:55:55.422 INFO:tasks.rados.rados.0.smithi166.stdout:284: seq_num 283 ranges {756381=400528,1910757=464751} 2020-11-16T20:55:55.426 INFO:tasks.rados.rados.0.smithi166.stdout:284: writing smithi16641208-284 from 756381 to 1156909 tid 1 2020-11-16T20:55:55.433 INFO:tasks.rados.rados.0.smithi166.stdout:284: writing smithi16641208-284 from 1910757 to 2375508 tid 2 2020-11-16T20:55:55.434 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.434 INFO:tasks.rados.rados.0.smithi166.stdout:269: finishing write tid 3 to smithi16641208-269 2020-11-16T20:55:55.434 INFO:tasks.rados.rados.0.smithi166.stdout:269: finishing write tid 4 to smithi16641208-269 2020-11-16T20:55:55.434 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 269 v 185 (ObjNum 268 snap 0 seq_num 268) dirty exists 2020-11-16T20:55:55.434 INFO:tasks.rados.rados.0.smithi166.stdout:269: left oid 269 (ObjNum 268 snap 0 seq_num 268) 2020-11-16T20:55:55.435 INFO:tasks.rados.rados.0.smithi166.stdout:270: finishing write tid 1 to smithi16641208-270 2020-11-16T20:55:55.435 INFO:tasks.rados.rados.0.smithi166.stdout:270: finishing write tid 2 to smithi16641208-270 2020-11-16T20:55:55.435 INFO:tasks.rados.rados.0.smithi166.stdout:270: finishing write tid 3 to smithi16641208-270 2020-11-16T20:55:55.435 INFO:tasks.rados.rados.0.smithi166.stdout:269: done (15 left) 2020-11-16T20:55:55.435 INFO:tasks.rados.rados.0.smithi166.stdout:285: write initial oid 285 2020-11-16T20:55:55.435 INFO:tasks.rados.rados.0.smithi166.stdout:285: seq_num 284 ranges {773188=475777,1969239=724762} 2020-11-16T20:55:55.440 INFO:tasks.rados.rados.0.smithi166.stdout:285: writing smithi16641208-285 from 773188 to 1248965 tid 1 2020-11-16T20:55:55.449 INFO:tasks.rados.rados.0.smithi166.stdout:285: writing smithi16641208-285 from 1969239 to 2694001 tid 2 2020-11-16T20:55:55.449 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.449 INFO:tasks.rados.rados.0.smithi166.stdout:270: finishing write tid 4 to smithi16641208-270 2020-11-16T20:55:55.449 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 270 v 141 (ObjNum 269 snap 0 seq_num 269) dirty exists 2020-11-16T20:55:55.449 INFO:tasks.rados.rados.0.smithi166.stdout:270: left oid 270 (ObjNum 269 snap 0 seq_num 269) 2020-11-16T20:55:55.450 INFO:tasks.rados.rados.0.smithi166.stdout:270: done (15 left) 2020-11-16T20:55:55.450 INFO:tasks.rados.rados.0.smithi166.stdout:286: write initial oid 286 2020-11-16T20:55:55.450 INFO:tasks.rados.rados.0.smithi166.stdout:286: seq_num 285 ranges {789995=551026,2027721=468420} 2020-11-16T20:55:55.456 INFO:tasks.rados.rados.0.smithi166.stdout:286: writing smithi16641208-286 from 789995 to 1341021 tid 1 2020-11-16T20:55:55.463 INFO:tasks.rados.rados.0.smithi166.stdout:286: writing smithi16641208-286 from 2027721 to 2496141 tid 2 2020-11-16T20:55:55.463 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.463 INFO:tasks.rados.rados.0.smithi166.stdout:271: finishing write tid 1 to smithi16641208-271 2020-11-16T20:55:55.463 INFO:tasks.rados.rados.0.smithi166.stdout:271: finishing write tid 2 to smithi16641208-271 2020-11-16T20:55:55.464 INFO:tasks.rados.rados.0.smithi166.stdout:271: finishing write tid 3 to smithi16641208-271 2020-11-16T20:55:55.464 INFO:tasks.rados.rados.0.smithi166.stdout:271: finishing write tid 4 to smithi16641208-271 2020-11-16T20:55:55.464 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 271 v 244 (ObjNum 270 snap 0 seq_num 270) dirty exists 2020-11-16T20:55:55.464 INFO:tasks.rados.rados.0.smithi166.stdout:271: left oid 271 (ObjNum 270 snap 0 seq_num 270) 2020-11-16T20:55:55.464 INFO:tasks.rados.rados.0.smithi166.stdout:272: finishing write tid 1 to smithi16641208-272 2020-11-16T20:55:55.464 INFO:tasks.rados.rados.0.smithi166.stdout:272: finishing write tid 2 to smithi16641208-272 2020-11-16T20:55:55.464 INFO:tasks.rados.rados.0.smithi166.stdout:271: done (15 left) 2020-11-16T20:55:55.465 INFO:tasks.rados.rados.0.smithi166.stdout:287: write initial oid 287 2020-11-16T20:55:55.465 INFO:tasks.rados.rados.0.smithi166.stdout:272: finishing write tid 3 to smithi16641208-272 2020-11-16T20:55:55.465 INFO:tasks.rados.rados.0.smithi166.stdout:272: finishing write tid 4 to smithi16641208-272 2020-11-16T20:55:55.465 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 272 v 203 (ObjNum 271 snap 0 seq_num 271) dirty exists 2020-11-16T20:55:55.465 INFO:tasks.rados.rados.0.smithi166.stdout:272: left oid 272 (ObjNum 271 snap 0 seq_num 271) 2020-11-16T20:55:55.465 INFO:tasks.rados.rados.0.smithi166.stdout:273: finishing write tid 1 to smithi16641208-273 2020-11-16T20:55:55.465 INFO:tasks.rados.rados.0.smithi166.stdout:287: seq_num 286 ranges {406802=626275,1686203=728431} 2020-11-16T20:55:55.468 INFO:tasks.rados.rados.0.smithi166.stdout:287: writing smithi16641208-287 from 406802 to 1033077 tid 1 2020-11-16T20:55:55.476 INFO:tasks.rados.rados.0.smithi166.stdout:287: writing smithi16641208-287 from 1686203 to 2414634 tid 2 2020-11-16T20:55:55.476 INFO:tasks.rados.rados.0.smithi166.stdout:272: done (15 left) 2020-11-16T20:55:55.476 INFO:tasks.rados.rados.0.smithi166.stdout:288: write initial oid 288 2020-11-16T20:55:55.477 INFO:tasks.rados.rados.0.smithi166.stdout:288: seq_num 287 ranges {423609=701524,1628332=472089,2648987=174622} 2020-11-16T20:55:55.483 INFO:tasks.rados.rados.0.smithi166.stdout:288: writing smithi16641208-288 from 423609 to 1125133 tid 1 2020-11-16T20:55:55.488 INFO:tasks.rados.rados.0.smithi166.stdout:288: writing smithi16641208-288 from 1628332 to 2100421 tid 2 2020-11-16T20:55:55.493 INFO:tasks.rados.rados.0.smithi166.stdout:288: writing smithi16641208-288 from 2648987 to 2823609 tid 3 2020-11-16T20:55:55.493 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.493 INFO:tasks.rados.rados.0.smithi166.stdout:273: finishing write tid 2 to smithi16641208-273 2020-11-16T20:55:55.493 INFO:tasks.rados.rados.0.smithi166.stdout:273: finishing write tid 3 to smithi16641208-273 2020-11-16T20:55:55.493 INFO:tasks.rados.rados.0.smithi166.stdout:273: finishing write tid 4 to smithi16641208-273 2020-11-16T20:55:55.493 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 273 v 247 (ObjNum 272 snap 0 seq_num 272) dirty exists 2020-11-16T20:55:55.494 INFO:tasks.rados.rados.0.smithi166.stdout:273: left oid 273 (ObjNum 272 snap 0 seq_num 272) 2020-11-16T20:55:55.494 INFO:tasks.rados.rados.0.smithi166.stdout:274: finishing write tid 1 to smithi16641208-274 2020-11-16T20:55:55.494 INFO:tasks.rados.rados.0.smithi166.stdout:273: done (15 left) 2020-11-16T20:55:55.494 INFO:tasks.rados.rados.0.smithi166.stdout:289: write initial oid 289 2020-11-16T20:55:55.494 INFO:tasks.rados.rados.0.smithi166.stdout:289: seq_num 288 ranges {440416=776773,1686814=732100} 2020-11-16T20:55:55.499 INFO:tasks.rados.rados.0.smithi166.stdout:289: writing smithi16641208-289 from 440416 to 1217189 tid 1 2020-11-16T20:55:55.501 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:55.502 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:55:55.502 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:55:55.502 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:55:55.502 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:55.507 INFO:tasks.rados.rados.0.smithi166.stdout:289: writing smithi16641208-289 from 1686814 to 2418914 tid 2 2020-11-16T20:55:55.507 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.507 INFO:tasks.rados.rados.0.smithi166.stdout:274: finishing write tid 2 to smithi16641208-274 2020-11-16T20:55:55.507 INFO:tasks.rados.rados.0.smithi166.stdout:274: finishing write tid 3 to smithi16641208-274 2020-11-16T20:55:55.507 INFO:tasks.rados.rados.0.smithi166.stdout:274: finishing write tid 4 to smithi16641208-274 2020-11-16T20:55:55.508 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 274 v 144 (ObjNum 273 snap 0 seq_num 273) dirty exists 2020-11-16T20:55:55.508 INFO:tasks.rados.rados.0.smithi166.stdout:274: left oid 274 (ObjNum 273 snap 0 seq_num 273) 2020-11-16T20:55:55.508 INFO:tasks.rados.rados.0.smithi166.stdout:275: finishing write tid 1 to smithi16641208-275 2020-11-16T20:55:55.508 INFO:tasks.rados.rados.0.smithi166.stdout:275: finishing write tid 2 to smithi16641208-275 2020-11-16T20:55:55.508 INFO:tasks.rados.rados.0.smithi166.stdout:275: finishing write tid 3 to smithi16641208-275 2020-11-16T20:55:55.508 INFO:tasks.rados.rados.0.smithi166.stdout:275: finishing write tid 4 to smithi16641208-275 2020-11-16T20:55:55.508 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 275 v 250 (ObjNum 274 snap 0 seq_num 274) dirty exists 2020-11-16T20:55:55.509 INFO:tasks.rados.rados.0.smithi166.stdout:275: left oid 275 (ObjNum 274 snap 0 seq_num 274) 2020-11-16T20:55:55.509 INFO:tasks.rados.rados.0.smithi166.stdout:276: finishing write tid 1 to smithi16641208-276 2020-11-16T20:55:55.509 INFO:tasks.rados.rados.0.smithi166.stdout:274: done (15 left) 2020-11-16T20:55:55.509 INFO:tasks.rados.rados.0.smithi166.stdout:275: done (14 left) 2020-11-16T20:55:55.509 INFO:tasks.rados.rados.0.smithi166.stdout:290: write initial oid 290 2020-11-16T20:55:55.509 INFO:tasks.rados.rados.0.smithi166.stdout:290: seq_num 289 ranges {457223=568375,1461649=475758,2420186=437037} 2020-11-16T20:55:55.512 INFO:tasks.rados.rados.0.smithi166.stdout:290: writing smithi16641208-290 from 457223 to 1025598 tid 1 2020-11-16T20:55:55.513 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:55:55.518 INFO:tasks.rados.rados.0.smithi166.stdout:290: writing smithi16641208-290 from 1461649 to 1937407 tid 2 2020-11-16T20:55:55.523 INFO:tasks.rados.rados.0.smithi166.stdout:290: writing smithi16641208-290 from 2420186 to 2857223 tid 3 2020-11-16T20:55:55.523 INFO:tasks.rados.rados.0.smithi166.stdout:291: write initial oid 291 2020-11-16T20:55:55.523 INFO:tasks.rados.rados.0.smithi166.stdout:291: seq_num 290 ranges {474030=643624,1520131=735769} 2020-11-16T20:55:55.523 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:55.527+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:55.529 INFO:tasks.rados.rados.0.smithi166.stdout:291: writing smithi16641208-291 from 474030 to 1117654 tid 1 2020-11-16T20:55:55.537 INFO:tasks.rados.rados.0.smithi166.stdout:291: writing smithi16641208-291 from 1520131 to 2255900 tid 2 2020-11-16T20:55:55.537 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.537 INFO:tasks.rados.rados.0.smithi166.stdout:276: finishing write tid 2 to smithi16641208-276 2020-11-16T20:55:55.537 INFO:tasks.rados.rados.0.smithi166.stdout:276: finishing write tid 3 to smithi16641208-276 2020-11-16T20:55:55.537 INFO:tasks.rados.rados.0.smithi166.stdout:276: finishing write tid 4 to smithi16641208-276 2020-11-16T20:55:55.537 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 276 v 147 (ObjNum 275 snap 0 seq_num 275) dirty exists 2020-11-16T20:55:55.538 INFO:tasks.rados.rados.0.smithi166.stdout:276: left oid 276 (ObjNum 275 snap 0 seq_num 275) 2020-11-16T20:55:55.538 INFO:tasks.rados.rados.0.smithi166.stdout:277: finishing write tid 1 to smithi16641208-277 2020-11-16T20:55:55.538 INFO:tasks.rados.rados.0.smithi166.stdout:277: finishing write tid 2 to smithi16641208-277 2020-11-16T20:55:55.538 INFO:tasks.rados.rados.0.smithi166.stdout:277: finishing write tid 3 to smithi16641208-277 2020-11-16T20:55:55.538 INFO:tasks.rados.rados.0.smithi166.stdout:277: finishing write tid 4 to smithi16641208-277 2020-11-16T20:55:55.538 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 277 v 206 (ObjNum 276 snap 0 seq_num 276) dirty exists 2020-11-16T20:55:55.538 INFO:tasks.rados.rados.0.smithi166.stdout:277: left oid 277 (ObjNum 276 snap 0 seq_num 276) 2020-11-16T20:55:55.539 INFO:tasks.rados.rados.0.smithi166.stdout:278: finishing write tid 1 to smithi16641208-278 2020-11-16T20:55:55.539 INFO:tasks.rados.rados.0.smithi166.stdout:278: finishing write tid 2 to smithi16641208-278 2020-11-16T20:55:55.539 INFO:tasks.rados.rados.0.smithi166.stdout:278: finishing write tid 3 to smithi16641208-278 2020-11-16T20:55:55.539 INFO:tasks.rados.rados.0.smithi166.stdout:278: finishing write tid 4 to smithi16641208-278 2020-11-16T20:55:55.539 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 278 v 188 (ObjNum 277 snap 0 seq_num 277) dirty exists 2020-11-16T20:55:55.539 INFO:tasks.rados.rados.0.smithi166.stdout:278: left oid 278 (ObjNum 277 snap 0 seq_num 277) 2020-11-16T20:55:55.539 INFO:tasks.rados.rados.0.smithi166.stdout:279: finishing write tid 1 to smithi16641208-279 2020-11-16T20:55:55.540 INFO:tasks.rados.rados.0.smithi166.stdout:276: done (15 left) 2020-11-16T20:55:55.540 INFO:tasks.rados.rados.0.smithi166.stdout:277: done (14 left) 2020-11-16T20:55:55.540 INFO:tasks.rados.rados.0.smithi166.stdout:278: done (13 left) 2020-11-16T20:55:55.540 INFO:tasks.rados.rados.0.smithi166.stdout:292: write initial oid 292 2020-11-16T20:55:55.540 INFO:tasks.rados.rados.0.smithi166.stdout:292: seq_num 291 ranges {490837=718873,1862260=479427,2875032=15805} 2020-11-16T20:55:55.543 INFO:tasks.rados.rados.0.smithi166.stdout:292: writing smithi16641208-292 from 490837 to 1209710 tid 1 2020-11-16T20:55:55.549 INFO:tasks.rados.rados.0.smithi166.stdout:292: writing smithi16641208-292 from 1862260 to 2341687 tid 2 2020-11-16T20:55:55.552 INFO:tasks.rados.rados.0.smithi166.stdout:292: writing smithi16641208-292 from 2875032 to 2890837 tid 3 2020-11-16T20:55:55.553 INFO:tasks.rados.rados.0.smithi166.stdout:293: write initial oid 293 2020-11-16T20:55:55.553 INFO:tasks.rados.rados.0.smithi166.stdout:293: seq_num 292 ranges {507644=794122,1920742=623085} 2020-11-16T20:55:55.561 INFO:tasks.rados.rados.0.smithi166.stdout:293: writing smithi16641208-293 from 507644 to 1301766 tid 1 2020-11-16T20:55:55.569 INFO:tasks.rados.rados.0.smithi166.stdout:293: writing smithi16641208-293 from 1920742 to 2543827 tid 2 2020-11-16T20:55:55.569 INFO:tasks.rados.rados.0.smithi166.stdout:294: write initial oid 294 2020-11-16T20:55:55.570 INFO:tasks.rados.rados.0.smithi166.stdout:294: seq_num 293 ranges {524451=469371,1579224=483096,2529878=394573} 2020-11-16T20:55:55.575 INFO:tasks.rados.rados.0.smithi166.stdout:294: writing smithi16641208-294 from 524451 to 993822 tid 1 2020-11-16T20:55:55.582 INFO:tasks.rados.rados.0.smithi166.stdout:294: writing smithi16641208-294 from 1579224 to 2062320 tid 2 2020-11-16T20:55:55.588 INFO:tasks.rados.rados.0.smithi166.stdout:294: writing smithi16641208-294 from 2529878 to 2924451 tid 3 2020-11-16T20:55:55.588 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.589 INFO:tasks.rados.rados.0.smithi166.stdout:279: finishing write tid 2 to smithi16641208-279 2020-11-16T20:55:55.589 INFO:tasks.rados.rados.0.smithi166.stdout:279: finishing write tid 3 to smithi16641208-279 2020-11-16T20:55:55.589 INFO:tasks.rados.rados.0.smithi166.stdout:279: finishing write tid 4 to smithi16641208-279 2020-11-16T20:55:55.589 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 279 v 191 (ObjNum 278 snap 0 seq_num 278) dirty exists 2020-11-16T20:55:55.589 INFO:tasks.rados.rados.0.smithi166.stdout:279: left oid 279 (ObjNum 278 snap 0 seq_num 278) 2020-11-16T20:55:55.589 INFO:tasks.rados.rados.0.smithi166.stdout:280: finishing write tid 1 to smithi16641208-280 2020-11-16T20:55:55.589 INFO:tasks.rados.rados.0.smithi166.stdout:280: finishing write tid 2 to smithi16641208-280 2020-11-16T20:55:55.590 INFO:tasks.rados.rados.0.smithi166.stdout:279: done (15 left) 2020-11-16T20:55:55.590 INFO:tasks.rados.rados.0.smithi166.stdout:295: write initial oid 295 2020-11-16T20:55:55.590 INFO:tasks.rados.rados.0.smithi166.stdout:295: seq_num 294 ranges {541258=544620,1637706=626754,2840948=100310} 2020-11-16T20:55:55.595 INFO:tasks.rados.rados.0.smithi166.stdout:295: writing smithi16641208-295 from 541258 to 1085878 tid 1 2020-11-16T20:55:55.603 INFO:tasks.rados.rados.0.smithi166.stdout:295: writing smithi16641208-295 from 1637706 to 2264460 tid 2 2020-11-16T20:55:55.607 INFO:tasks.rados.rados.0.smithi166.stdout:295: writing smithi16641208-295 from 2840948 to 2941258 tid 3 2020-11-16T20:55:55.607 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.607 INFO:tasks.rados.rados.0.smithi166.stdout:280: finishing write tid 3 to smithi16641208-280 2020-11-16T20:55:55.607 INFO:tasks.rados.rados.0.smithi166.stdout:280: finishing write tid 4 to smithi16641208-280 2020-11-16T20:55:55.608 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 280 v 194 (ObjNum 279 snap 0 seq_num 279) dirty exists 2020-11-16T20:55:55.608 INFO:tasks.rados.rados.0.smithi166.stdout:280: left oid 280 (ObjNum 279 snap 0 seq_num 279) 2020-11-16T20:55:55.608 INFO:tasks.rados.rados.0.smithi166.stdout:281: finishing write tid 1 to smithi16641208-281 2020-11-16T20:55:55.608 INFO:tasks.rados.rados.0.smithi166.stdout:280: done (15 left) 2020-11-16T20:55:55.608 INFO:tasks.rados.rados.0.smithi166.stdout:296: write initial oid 296 2020-11-16T20:55:55.608 INFO:tasks.rados.rados.0.smithi166.stdout:296: seq_num 295 ranges {558065=619869,1579835=486765,2468371=489694} 2020-11-16T20:55:55.614 INFO:tasks.rados.rados.0.smithi166.stdout:296: writing smithi16641208-296 from 558065 to 1177934 tid 1 2020-11-16T20:55:55.620 INFO:tasks.rados.rados.0.smithi166.stdout:296: writing smithi16641208-296 from 1579835 to 2066600 tid 2 2020-11-16T20:55:55.622 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:55:55.626+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:55:55.626 INFO:tasks.rados.rados.0.smithi166.stdout:296: writing smithi16641208-296 from 2468371 to 2958065 tid 3 2020-11-16T20:55:55.626 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.626 INFO:tasks.rados.rados.0.smithi166.stdout:281: finishing write tid 2 to smithi16641208-281 2020-11-16T20:55:55.626 INFO:tasks.rados.rados.0.smithi166.stdout:281: finishing write tid 3 to smithi16641208-281 2020-11-16T20:55:55.626 INFO:tasks.rados.rados.0.smithi166.stdout:281: finishing write tid 4 to smithi16641208-281 2020-11-16T20:55:55.626 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 281 v 209 (ObjNum 280 snap 0 seq_num 280) dirty exists 2020-11-16T20:55:55.627 INFO:tasks.rados.rados.0.smithi166.stdout:281: left oid 281 (ObjNum 280 snap 0 seq_num 280) 2020-11-16T20:55:55.627 INFO:tasks.rados.rados.0.smithi166.stdout:282: finishing write tid 1 to smithi16641208-282 2020-11-16T20:55:55.627 INFO:tasks.rados.rados.0.smithi166.stdout:282: finishing write tid 2 to smithi16641208-282 2020-11-16T20:55:55.627 INFO:tasks.rados.rados.0.smithi166.stdout:281: done (15 left) 2020-11-16T20:55:55.627 INFO:tasks.rados.rados.0.smithi166.stdout:297: write initial oid 297 2020-11-16T20:55:55.627 INFO:tasks.rados.rados.0.smithi166.stdout:297: seq_num 296 ranges {574872=695118,2038317=630423} 2020-11-16T20:55:55.633 INFO:tasks.rados.rados.0.smithi166.stdout:297: writing smithi16641208-297 from 574872 to 1269990 tid 1 2020-11-16T20:55:55.642 INFO:tasks.rados.rados.0.smithi166.stdout:297: writing smithi16641208-297 from 2038317 to 2668740 tid 2 2020-11-16T20:55:55.643 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.643 INFO:tasks.rados.rados.0.smithi166.stdout:282: finishing write tid 3 to smithi16641208-282 2020-11-16T20:55:55.643 INFO:tasks.rados.rados.0.smithi166.stdout:282: finishing write tid 4 to smithi16641208-282 2020-11-16T20:55:55.643 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 282 v 150 (ObjNum 281 snap 0 seq_num 281) dirty exists 2020-11-16T20:55:55.643 INFO:tasks.rados.rados.0.smithi166.stdout:282: left oid 282 (ObjNum 281 snap 0 seq_num 281) 2020-11-16T20:55:55.643 INFO:tasks.rados.rados.0.smithi166.stdout:283: finishing write tid 1 to smithi16641208-283 2020-11-16T20:55:55.644 INFO:tasks.rados.rados.0.smithi166.stdout:283: finishing write tid 2 to smithi16641208-283 2020-11-16T20:55:55.644 INFO:tasks.rados.rados.0.smithi166.stdout:283: finishing write tid 3 to smithi16641208-283 2020-11-16T20:55:55.644 INFO:tasks.rados.rados.0.smithi166.stdout:283: finishing write tid 4 to smithi16641208-283 2020-11-16T20:55:55.644 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 283 v 212 (ObjNum 282 snap 0 seq_num 282) dirty exists 2020-11-16T20:55:55.644 INFO:tasks.rados.rados.0.smithi166.stdout:283: left oid 283 (ObjNum 282 snap 0 seq_num 282) 2020-11-16T20:55:55.644 INFO:tasks.rados.rados.0.smithi166.stdout:284: finishing write tid 1 to smithi16641208-284 2020-11-16T20:55:55.645 INFO:tasks.rados.rados.0.smithi166.stdout:284: finishing write tid 2 to smithi16641208-284 2020-11-16T20:55:55.645 INFO:tasks.rados.rados.0.smithi166.stdout:282: done (15 left) 2020-11-16T20:55:55.645 INFO:tasks.rados.rados.0.smithi166.stdout:283: done (14 left) 2020-11-16T20:55:55.645 INFO:tasks.rados.rados.0.smithi166.stdout:298: write initial oid 298 2020-11-16T20:55:55.645 INFO:tasks.rados.rados.0.smithi166.stdout:298: seq_num 297 ranges {591679=486720,1813152=490434} 2020-11-16T20:55:55.648 INFO:tasks.rados.rados.0.smithi166.stdout:298: writing smithi16641208-298 from 591679 to 1078399 tid 1 2020-11-16T20:55:55.655 INFO:tasks.rados.rados.0.smithi166.stdout:298: writing smithi16641208-298 from 1813152 to 2303586 tid 2 2020-11-16T20:55:55.655 INFO:tasks.rados.rados.0.smithi166.stdout:299: write initial oid 299 2020-11-16T20:55:55.656 INFO:tasks.rados.rados.0.smithi166.stdout:299: seq_num 298 ranges {608486=561969,1871634=634092,2950640=57846} 2020-11-16T20:55:55.662 INFO:tasks.rados.rados.0.smithi166.stdout:299: writing smithi16641208-299 from 608486 to 1170455 tid 1 2020-11-16T20:55:55.669 INFO:tasks.rados.rados.0.smithi166.stdout:299: writing smithi16641208-299 from 1871634 to 2505726 tid 2 2020-11-16T20:55:55.673 INFO:tasks.rados.rados.0.smithi166.stdout:299: writing smithi16641208-299 from 2950640 to 3008486 tid 3 2020-11-16T20:55:55.673 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.673 INFO:tasks.rados.rados.0.smithi166.stdout:284: finishing write tid 3 to smithi16641208-284 2020-11-16T20:55:55.673 INFO:tasks.rados.rados.0.smithi166.stdout:284: finishing write tid 4 to smithi16641208-284 2020-11-16T20:55:55.673 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 284 v 215 (ObjNum 283 snap 0 seq_num 283) dirty exists 2020-11-16T20:55:55.674 INFO:tasks.rados.rados.0.smithi166.stdout:284: left oid 284 (ObjNum 283 snap 0 seq_num 283) 2020-11-16T20:55:55.674 INFO:tasks.rados.rados.0.smithi166.stdout:285: finishing write tid 1 to smithi16641208-285 2020-11-16T20:55:55.674 INFO:tasks.rados.rados.0.smithi166.stdout:285: finishing write tid 2 to smithi16641208-285 2020-11-16T20:55:55.674 INFO:tasks.rados.rados.0.smithi166.stdout:285: finishing write tid 3 to smithi16641208-285 2020-11-16T20:55:55.674 INFO:tasks.rados.rados.0.smithi166.stdout:285: finishing write tid 4 to smithi16641208-285 2020-11-16T20:55:55.674 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 285 v 197 (ObjNum 284 snap 0 seq_num 284) dirty exists 2020-11-16T20:55:55.674 INFO:tasks.rados.rados.0.smithi166.stdout:285: left oid 285 (ObjNum 284 snap 0 seq_num 284) 2020-11-16T20:55:55.675 INFO:tasks.rados.rados.0.smithi166.stdout:286: finishing write tid 1 to smithi16641208-286 2020-11-16T20:55:55.675 INFO:tasks.rados.rados.0.smithi166.stdout:286: finishing write tid 2 to smithi16641208-286 2020-11-16T20:55:55.675 INFO:tasks.rados.rados.0.smithi166.stdout:286: finishing write tid 3 to smithi16641208-286 2020-11-16T20:55:55.675 INFO:tasks.rados.rados.0.smithi166.stdout:286: finishing write tid 4 to smithi16641208-286 2020-11-16T20:55:55.675 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 286 v 218 (ObjNum 285 snap 0 seq_num 285) dirty exists 2020-11-16T20:55:55.675 INFO:tasks.rados.rados.0.smithi166.stdout:286: left oid 286 (ObjNum 285 snap 0 seq_num 285) 2020-11-16T20:55:55.675 INFO:tasks.rados.rados.0.smithi166.stdout:287: finishing write tid 1 to smithi16641208-287 2020-11-16T20:55:55.676 INFO:tasks.rados.rados.0.smithi166.stdout:287: finishing write tid 2 to smithi16641208-287 2020-11-16T20:55:55.676 INFO:tasks.rados.rados.0.smithi166.stdout:284: done (15 left) 2020-11-16T20:55:55.676 INFO:tasks.rados.rados.0.smithi166.stdout:285: done (14 left) 2020-11-16T20:55:55.676 INFO:tasks.rados.rados.0.smithi166.stdout:286: done (13 left) 2020-11-16T20:55:55.676 INFO:tasks.rados.rados.0.smithi166.stdout:300: write initial oid 300 2020-11-16T20:55:55.676 INFO:tasks.rados.rados.0.smithi166.stdout:300: seq_num 299 ranges {625293=637218,1813763=494103,2978063=47230} 2020-11-16T20:55:55.680 INFO:tasks.rados.rados.0.smithi166.stdout:300: writing smithi16641208-300 from 625293 to 1262511 tid 1 2020-11-16T20:55:55.686 INFO:tasks.rados.rados.0.smithi166.stdout:300: writing smithi16641208-300 from 1813763 to 2307866 tid 2 2020-11-16T20:55:55.690 INFO:tasks.rados.rados.0.smithi166.stdout:300: writing smithi16641208-300 from 2978063 to 3025293 tid 3 2020-11-16T20:55:55.690 INFO:tasks.rados.rados.0.smithi166.stdout:301: write initial oid 301 2020-11-16T20:55:55.690 INFO:tasks.rados.rados.0.smithi166.stdout:301: seq_num 300 ranges {642100=712467,1872245=637761} 2020-11-16T20:55:55.697 INFO:tasks.rados.rados.0.smithi166.stdout:301: writing smithi16641208-301 from 642100 to 1354567 tid 1 2020-11-16T20:55:55.702 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:55:55.702 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:55:55.702 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:55:55.702 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:55:55.702 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.702 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:6 3.2 3:5ad6a7de:::smithi16641208-3:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e33)", 2020-11-16T20:55:55.703 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:50.930418+0000", 2020-11-16T20:55:55.703 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 4.7743920199999996, 2020-11-16T20:55:55.703 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011864081, 2020-11-16T20:55:55.703 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.703 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:55:55.703 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.703 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.704 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.704 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.930418+0000", 2020-11-16T20:55:55.704 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.704 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.704 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.704 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.704 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.930418+0000", 2020-11-16T20:55:55.705 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5051e-05 2020-11-16T20:55:55.705 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.705 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.705 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.705 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.930453+0000", 2020-11-16T20:55:55.705 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1640000000000003e-06 2020-11-16T20:55:55.705 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.706 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.706 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.706 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.930457+0000", 2020-11-16T20:55:55.706 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7309999999999999e-06 2020-11-16T20:55:55.706 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.706 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.706 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.706 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.930466+0000", 2020-11-16T20:55:55.707 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3919999999999999e-06 2020-11-16T20:55:55.707 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.707 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.707 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.707 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.930469+0000", 2020-11-16T20:55:55.707 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0010044240000000001 2020-11-16T20:55:55.707 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.708 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.708 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.708 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.931473+0000", 2020-11-16T20:55:55.708 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3275000000000005e-05 2020-11-16T20:55:55.708 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.708 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.708 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:55:55.709 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.931557+0000", 2020-11-16T20:55:55.709 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007159271 2020-11-16T20:55:55.709 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.709 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.709 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.709 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.938716+0000", 2020-11-16T20:55:55.709 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0420000000000002e-05 2020-11-16T20:55:55.709 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.710 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.710 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.710 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.938766+0000", 2020-11-16T20:55:55.710 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035153530000000001 2020-11-16T20:55:55.710 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.710 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.710 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.711 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.942282+0000", 2020-11-16T20:55:55.711 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011864081 2020-11-16T20:55:55.711 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.711 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.711 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.711 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.711 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.711 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:14 4.0 4:1af9bfbc:::smithi16641208-4:head [write 1659093~391328] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:55:55.712 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:50.945001+0000", 2020-11-16T20:55:55.712 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 4.7598084839999997, 2020-11-16T20:55:55.712 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012471629999999999, 2020-11-16T20:55:55.712 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.712 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.712 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:55.712 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:55.713 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:55.713 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 14 2020-11-16T20:55:55.713 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.713 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.713 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.713 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.713 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945001+0000", 2020-11-16T20:55:55.713 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.714 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.714 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.714 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.714 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945001+0000", 2020-11-16T20:55:55.714 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016394000000000001 2020-11-16T20:55:55.714 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.714 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.715 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.715 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945165+0000", 2020-11-16T20:55:55.715 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010788799999999999 2020-11-16T20:55:55.715 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.715 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.715 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.715 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945273+0000", 2020-11-16T20:55:55.716 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4436999999999999e-05 2020-11-16T20:55:55.716 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.716 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.716 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.716 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945287+0000", 2020-11-16T20:55:55.716 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8820000000000001e-06 2020-11-16T20:55:55.716 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.717 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.717 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.717 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945295+0000", 2020-11-16T20:55:55.717 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2850999999999998e-05 2020-11-16T20:55:55.717 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.717 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.717 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.717 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945368+0000", 2020-11-16T20:55:55.718 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1461000000000001e-05 2020-11-16T20:55:55.718 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.718 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.718 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:55.718 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945420+0000", 2020-11-16T20:55:55.718 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0057968509999999996 2020-11-16T20:55:55.718 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.719 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.719 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.719 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.951217+0000", 2020-11-16T20:55:55.719 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015647799999999999 2020-11-16T20:55:55.719 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.719 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.719 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.720 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.951373+0000", 2020-11-16T20:55:55.720 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013394599999999999 2020-11-16T20:55:55.720 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.720 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.720 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:55:55.720 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.951507+0000", 2020-11-16T20:55:55.720 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021567370000000002 2020-11-16T20:55:55.720 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.721 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.721 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:55.721 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.953664+0000", 2020-11-16T20:55:55.721 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0032496349999999999 2020-11-16T20:55:55.721 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.721 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.721 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.722 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.956913+0000", 2020-11-16T20:55:55.722 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00043367900000000002 2020-11-16T20:55:55.722 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.722 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.722 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.722 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.957347+0000", 2020-11-16T20:55:55.722 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6130999999999993e-05 2020-11-16T20:55:55.722 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.723 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.723 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.723 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.957423+0000", 2020-11-16T20:55:55.723 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9713999999999999e-05 2020-11-16T20:55:55.723 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.723 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.723 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.724 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.957473+0000", 2020-11-16T20:55:55.724 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012471629999999999 2020-11-16T20:55:55.724 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.724 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.724 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.724 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.724 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.724 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:15 4.0 4:1af9bfbc:::smithi16641208-4:head [setxattr _header (55) in=7b,truncate 2050421] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:55:55.725 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:50.945362+0000", 2020-11-16T20:55:55.725 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 4.7594473810000002, 2020-11-16T20:55:55.725 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012323358, 2020-11-16T20:55:55.725 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.725 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.725 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:55.725 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:55.725 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:55.726 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 15 2020-11-16T20:55:55.726 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.726 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.726 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.726 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.726 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945362+0000", 2020-11-16T20:55:55.726 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.727 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.727 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.727 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.727 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945362+0000", 2020-11-16T20:55:55.727 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2465000000000001e-05 2020-11-16T20:55:55.727 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.727 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.728 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.728 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945405+0000", 2020-11-16T20:55:55.728 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.421e-06 2020-11-16T20:55:55.728 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.728 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.728 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.728 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945411+0000", 2020-11-16T20:55:55.729 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1694e-05 2020-11-16T20:55:55.729 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.729 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.729 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.729 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945423+0000", 2020-11-16T20:55:55.729 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9430000000000003e-06 2020-11-16T20:55:55.729 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.729 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.730 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.730 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945430+0000", 2020-11-16T20:55:55.730 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000152779 2020-11-16T20:55:55.730 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.730 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.730 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.730 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945583+0000", 2020-11-16T20:55:55.731 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8047999999999998e-05 2020-11-16T20:55:55.731 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.731 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.731 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:55.731 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945631+0000", 2020-11-16T20:55:55.731 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0068418289999999998 2020-11-16T20:55:55.731 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.732 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.732 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.732 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.952472+0000", 2020-11-16T20:55:55.732 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000139099 2020-11-16T20:55:55.732 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.732 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.732 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.732 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.952612+0000", 2020-11-16T20:55:55.733 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000181399 2020-11-16T20:55:55.733 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.733 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.733 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:55:55.733 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.952793+0000", 2020-11-16T20:55:55.733 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00089535199999999998 2020-11-16T20:55:55.733 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.734 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.734 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:55.734 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.953688+0000", 2020-11-16T20:55:55.734 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0032970410000000001 2020-11-16T20:55:55.734 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.734 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.734 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.734 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.956985+0000", 2020-11-16T20:55:55.735 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00061651999999999996 2020-11-16T20:55:55.735 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.735 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.735 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.735 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.957602+0000", 2020-11-16T20:55:55.735 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6734999999999999e-05 2020-11-16T20:55:55.735 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.736 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.736 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.736 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.957649+0000", 2020-11-16T20:55:55.736 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7033000000000003e-05 2020-11-16T20:55:55.736 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.736 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.736 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.736 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.957686+0000", 2020-11-16T20:55:55.737 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012323358 2020-11-16T20:55:55.737 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.737 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.737 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.737 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.737 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.737 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:16 4.0 4:1af9bfbc:::smithi16641208-4:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:55:55.738 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:50.945471+0000", 2020-11-16T20:55:55.738 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 4.7593382829999999, 2020-11-16T20:55:55.738 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012712131, 2020-11-16T20:55:55.738 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.738 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:55:55.738 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:55.738 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:55.738 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:55.739 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 16 2020-11-16T20:55:55.739 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.739 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.739 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.739 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.739 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945471+0000", 2020-11-16T20:55:55.739 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.740 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.740 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.740 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.740 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945471+0000", 2020-11-16T20:55:55.740 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8924e-05 2020-11-16T20:55:55.740 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.740 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.740 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.741 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945500+0000", 2020-11-16T20:55:55.741 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1600000000000003e-06 2020-11-16T20:55:55.741 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.741 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.741 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.741 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945506+0000", 2020-11-16T20:55:55.741 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1238e-05 2020-11-16T20:55:55.742 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.742 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.742 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.742 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945518+0000", 2020-11-16T20:55:55.742 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6099999999999999e-06 2020-11-16T20:55:55.742 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.742 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.742 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.743 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945522+0000", 2020-11-16T20:55:55.743 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013128700000000001 2020-11-16T20:55:55.743 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.743 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.743 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.743 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945654+0000", 2020-11-16T20:55:55.743 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6220999999999998e-05 2020-11-16T20:55:55.744 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.744 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.744 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:55.744 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945690+0000", 2020-11-16T20:55:55.744 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00746505 2020-11-16T20:55:55.744 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.744 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.744 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.745 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.953155+0000", 2020-11-16T20:55:55.745 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000135473 2020-11-16T20:55:55.745 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.745 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.745 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:55:55.745 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.953290+0000", 2020-11-16T20:55:55.745 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044399729999999998 2020-11-16T20:55:55.746 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.746 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.746 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.746 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.957730+0000", 2020-11-16T20:55:55.746 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000134661 2020-11-16T20:55:55.746 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.746 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.746 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.747 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.957865+0000", 2020-11-16T20:55:55.747 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00031853399999999998 2020-11-16T20:55:55.747 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.747 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.747 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.747 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958184+0000", 2020-11-16T20:55:55.747 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012712131 2020-11-16T20:55:55.748 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.748 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.748 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.748 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.748 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.748 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:132 4.0 4:06339924:::smithi16641208-33:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:55:55.748 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.315332+0000", 2020-11-16T20:55:55.748 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 4.3894777009999997, 2020-11-16T20:55:55.749 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011231123000000001, 2020-11-16T20:55:55.749 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.749 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:55:55.749 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:55.749 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:55.749 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:55.749 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 132 2020-11-16T20:55:55.749 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.750 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.750 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.750 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.750 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.315332+0000", 2020-11-16T20:55:55.750 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.750 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.750 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.751 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.751 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.315332+0000", 2020-11-16T20:55:55.751 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6592e-05 2020-11-16T20:55:55.751 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.751 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.751 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.751 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.315349+0000", 2020-11-16T20:55:55.752 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2839999999999995e-06 2020-11-16T20:55:55.752 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.752 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.752 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.752 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.315358+0000", 2020-11-16T20:55:55.752 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5060000000000001e-06 2020-11-16T20:55:55.752 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.752 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.753 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.753 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.315364+0000", 2020-11-16T20:55:55.753 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6869999999999999e-06 2020-11-16T20:55:55.753 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.753 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.753 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.753 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.315367+0000", 2020-11-16T20:55:55.754 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3063000000000002e-05 2020-11-16T20:55:55.754 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.754 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.754 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.754 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.315440+0000", 2020-11-16T20:55:55.754 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8826000000000001e-05 2020-11-16T20:55:55.754 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.754 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.755 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:55.755 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.315469+0000", 2020-11-16T20:55:55.755 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00597038 2020-11-16T20:55:55.755 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.755 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.755 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.755 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.321439+0000", 2020-11-16T20:55:55.756 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000103409 2020-11-16T20:55:55.756 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.756 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.756 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:55:55.756 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.321543+0000", 2020-11-16T20:55:55.756 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0047522800000000002 2020-11-16T20:55:55.756 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.756 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.757 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.757 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.326295+0000", 2020-11-16T20:55:55.757 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6406e-05 2020-11-16T20:55:55.757 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.757 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.757 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.757 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.326371+0000", 2020-11-16T20:55:55.758 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019169 2020-11-16T20:55:55.758 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.758 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.758 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.758 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.326563+0000", 2020-11-16T20:55:55.758 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011231123000000001 2020-11-16T20:55:55.758 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.758 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.759 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.759 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.759 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.759 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:193 3.2 3:4f9279ea:::smithi16641208-49:head [write 406736~710070,stat] snapc 0=[] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e33)", 2020-11-16T20:55:55.759 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.540502+0000", 2020-11-16T20:55:55.759 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 4.1643075410000003, 2020-11-16T20:55:55.759 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012983668, 2020-11-16T20:55:55.760 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.760 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.760 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.760 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.760 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.760 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.540502+0000", 2020-11-16T20:55:55.760 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.760 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.761 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.761 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.761 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.540502+0000", 2020-11-16T20:55:55.761 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016754500000000001 2020-11-16T20:55:55.761 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.761 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.761 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.762 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.540670+0000", 2020-11-16T20:55:55.762 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5729999999999998e-06 2020-11-16T20:55:55.762 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.762 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.762 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.762 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.540675+0000", 2020-11-16T20:55:55.762 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.4380000000000001e-06 2020-11-16T20:55:55.763 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.763 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.763 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.763 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.540685+0000", 2020-11-16T20:55:55.763 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6959999999999994e-06 2020-11-16T20:55:55.763 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.763 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.763 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.764 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.540693+0000", 2020-11-16T20:55:55.764 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3952000000000002e-05 2020-11-16T20:55:55.764 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.764 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.764 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.764 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.540737+0000", 2020-11-16T20:55:55.764 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000132144 2020-11-16T20:55:55.765 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.765 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.765 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.765 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.540869+0000", 2020-11-16T20:55:55.765 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000117553 2020-11-16T20:55:55.765 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.765 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.765 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:55:55.766 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.540987+0000", 2020-11-16T20:55:55.766 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001578765 2020-11-16T20:55:55.766 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.766 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.766 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:55.766 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.542566+0000", 2020-11-16T20:55:55.766 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002449335 2020-11-16T20:55:55.767 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.767 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.767 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.767 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.545015+0000", 2020-11-16T20:55:55.767 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0083326890000000008 2020-11-16T20:55:55.767 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.767 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.767 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.768 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.553348+0000", 2020-11-16T20:55:55.768 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6248999999999997e-05 2020-11-16T20:55:55.768 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.768 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.768 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.768 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.553394+0000", 2020-11-16T20:55:55.768 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1729000000000002e-05 2020-11-16T20:55:55.769 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.769 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.769 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.769 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.553486+0000", 2020-11-16T20:55:55.769 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012983668 2020-11-16T20:55:55.769 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.769 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.769 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.770 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.770 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.770 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:892 4.0 4:2209b6da:::smithi16641208-202:head [write 3286845~91362] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:55:55.770 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.089828+0000", 2020-11-16T20:55:55.770 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 1.614981287, 2020-11-16T20:55:55.770 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011577130999999999, 2020-11-16T20:55:55.770 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.771 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.771 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:55.771 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:55.771 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:55.771 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 892 2020-11-16T20:55:55.771 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.771 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.771 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.772 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.772 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.089828+0000", 2020-11-16T20:55:55.772 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.772 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.772 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.772 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.772 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.089828+0000", 2020-11-16T20:55:55.773 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.638e-05 2020-11-16T20:55:55.773 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.773 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.773 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.773 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.089875+0000", 2020-11-16T20:55:55.773 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3480000000000003e-06 2020-11-16T20:55:55.773 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.773 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.774 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.774 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.089880+0000", 2020-11-16T20:55:55.774 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6920000000000008e-06 2020-11-16T20:55:55.774 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.774 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.774 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.774 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.089889+0000", 2020-11-16T20:55:55.775 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8790000000000002e-06 2020-11-16T20:55:55.775 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.775 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.775 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.775 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.089894+0000", 2020-11-16T20:55:55.775 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0574999999999997e-05 2020-11-16T20:55:55.775 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.775 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.776 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.776 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.089934+0000", 2020-11-16T20:55:55.776 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2484000000000001e-05 2020-11-16T20:55:55.776 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.776 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.776 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:55.776 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.089987+0000", 2020-11-16T20:55:55.777 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.005327142 2020-11-16T20:55:55.777 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.777 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.777 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.777 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.095314+0000", 2020-11-16T20:55:55.777 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015352700000000001 2020-11-16T20:55:55.777 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.777 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.778 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.778 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.095467+0000", 2020-11-16T20:55:55.778 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018658699999999999 2020-11-16T20:55:55.778 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.778 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.778 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:55:55.778 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.095654+0000", 2020-11-16T20:55:55.779 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0031838589999999998 2020-11-16T20:55:55.779 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.779 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.779 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:55.779 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.098838+0000", 2020-11-16T20:55:55.779 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00042524899999999999 2020-11-16T20:55:55.779 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.779 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.780 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.780 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.099263+0000", 2020-11-16T20:55:55.780 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0020721049999999999 2020-11-16T20:55:55.780 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.780 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.780 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.780 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.101335+0000", 2020-11-16T20:55:55.781 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3537e-05 2020-11-16T20:55:55.781 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.781 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.781 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.781 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.101379+0000", 2020-11-16T20:55:55.781 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6767e-05 2020-11-16T20:55:55.781 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.781 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.782 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.782 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.101406+0000", 2020-11-16T20:55:55.782 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011577130999999999 2020-11-16T20:55:55.782 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.782 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.782 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.782 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.783 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.783 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:893 4.0 4:2209b6da:::smithi16641208-202:head [setxattr _header (57) in=7b,truncate 3378207] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:55:55.783 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.089925+0000", 2020-11-16T20:55:55.783 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 1.6148846189999999, 2020-11-16T20:55:55.783 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011751533999999999, 2020-11-16T20:55:55.783 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.783 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.783 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:55.784 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:55.784 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:55.784 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 893 2020-11-16T20:55:55.784 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.784 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.784 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.784 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.785 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.089925+0000", 2020-11-16T20:55:55.785 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.785 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.785 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.785 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.785 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.089925+0000", 2020-11-16T20:55:55.785 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0505e-05 2020-11-16T20:55:55.785 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.786 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.786 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.786 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.089956+0000", 2020-11-16T20:55:55.786 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6710000000000004e-06 2020-11-16T20:55:55.786 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.786 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.786 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.787 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.089961+0000", 2020-11-16T20:55:55.787 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1973e-05 2020-11-16T20:55:55.787 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.787 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.787 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.787 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.089973+0000", 2020-11-16T20:55:55.787 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6870000000000002e-06 2020-11-16T20:55:55.787 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.788 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.788 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.788 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.089978+0000", 2020-11-16T20:55:55.788 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5397000000000001e-05 2020-11-16T20:55:55.788 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.788 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.788 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.789 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.090003+0000", 2020-11-16T20:55:55.789 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1850000000000001e-05 2020-11-16T20:55:55.789 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.789 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.789 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:55.789 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.090045+0000", 2020-11-16T20:55:55.789 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0062134979999999996 2020-11-16T20:55:55.789 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.790 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.790 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.790 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.096259+0000", 2020-11-16T20:55:55.790 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012287499999999999 2020-11-16T20:55:55.790 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.790 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.790 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.790 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.096382+0000", 2020-11-16T20:55:55.791 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015991900000000001 2020-11-16T20:55:55.791 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.791 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.791 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:55:55.791 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.096541+0000", 2020-11-16T20:55:55.791 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0023028359999999999 2020-11-16T20:55:55.791 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.792 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.792 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:55.792 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.098844+0000", 2020-11-16T20:55:55.792 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00048900300000000001 2020-11-16T20:55:55.792 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.792 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.792 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.792 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.099333+0000", 2020-11-16T20:55:55.793 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0022280799999999999 2020-11-16T20:55:55.793 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.793 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.793 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.793 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.101561+0000", 2020-11-16T20:55:55.793 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2985999999999997e-05 2020-11-16T20:55:55.793 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.793 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.794 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.794 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.101614+0000", 2020-11-16T20:55:55.794 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2254000000000004e-05 2020-11-16T20:55:55.794 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.794 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.794 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.794 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.101677+0000", 2020-11-16T20:55:55.795 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011751533999999999 2020-11-16T20:55:55.795 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.795 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.795 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.795 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.795 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.795 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:894 4.0 4:2209b6da:::smithi16641208-202:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:55:55.795 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.090013+0000", 2020-11-16T20:55:55.796 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 1.6147970229999999, 2020-11-16T20:55:55.796 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012044397, 2020-11-16T20:55:55.796 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.796 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:55:55.796 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:55.796 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:55.796 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:55.797 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 894 2020-11-16T20:55:55.797 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.797 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.797 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.797 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.797 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.090013+0000", 2020-11-16T20:55:55.797 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.797 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.798 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.798 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.090013+0000", 2020-11-16T20:55:55.798 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5743000000000001e-05 2020-11-16T20:55:55.798 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.798 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.799 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.090038+0000", 2020-11-16T20:55:55.799 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5580000000000001e-06 2020-11-16T20:55:55.799 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.799 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.799 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.799 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.090042+0000", 2020-11-16T20:55:55.799 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7179999999999999e-06 2020-11-16T20:55:55.799 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.800 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.800 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.800 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.090049+0000", 2020-11-16T20:55:55.800 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2320000000000001e-06 2020-11-16T20:55:55.800 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.800 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.800 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.801 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.090052+0000", 2020-11-16T20:55:55.801 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5281999999999999e-05 2020-11-16T20:55:55.801 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.801 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.801 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.801 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.090087+0000", 2020-11-16T20:55:55.801 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2074000000000003e-05 2020-11-16T20:55:55.802 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.802 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.802 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:55.802 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.090139+0000", 2020-11-16T20:55:55.802 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0066825180000000001 2020-11-16T20:55:55.802 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.802 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.803 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.803 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.096822+0000", 2020-11-16T20:55:55.803 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011396 2020-11-16T20:55:55.803 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.803 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.803 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:55:55.803 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.096936+0000", 2020-11-16T20:55:55.803 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004773233 2020-11-16T20:55:55.804 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.804 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.804 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.804 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.101709+0000", 2020-11-16T20:55:55.804 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5786999999999997e-05 2020-11-16T20:55:55.804 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.804 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.805 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.805 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.101795+0000", 2020-11-16T20:55:55.805 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00026229200000000002 2020-11-16T20:55:55.805 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.805 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.805 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.805 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.102057+0000", 2020-11-16T20:55:55.806 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012044397 2020-11-16T20:55:55.806 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.806 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.806 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.806 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.806 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.806 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1061 3.2 3:6a153756:::smithi16641208-236:head [write 749645~774105,stat] snapc 0=[] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e35)", 2020-11-16T20:55:55.806 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.768193+0000", 2020-11-16T20:55:55.807 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.93661713700000004, 2020-11-16T20:55:55.807 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012210159999999999, 2020-11-16T20:55:55.807 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.807 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.807 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.807 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.807 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.808 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.768193+0000", 2020-11-16T20:55:55.808 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.808 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.808 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.808 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.808 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.768193+0000", 2020-11-16T20:55:55.808 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00041627299999999999 2020-11-16T20:55:55.809 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.809 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.809 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.809 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.768609+0000", 2020-11-16T20:55:55.809 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0271e-05 2020-11-16T20:55:55.809 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.809 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.809 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.810 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.768619+0000", 2020-11-16T20:55:55.810 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7359000000000001e-05 2020-11-16T20:55:55.810 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.810 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.810 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.810 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.768636+0000", 2020-11-16T20:55:55.810 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8359999999999998e-06 2020-11-16T20:55:55.811 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.811 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.811 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.811 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.768645+0000", 2020-11-16T20:55:55.811 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7156e-05 2020-11-16T20:55:55.811 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.811 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.811 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.812 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.768692+0000", 2020-11-16T20:55:55.812 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011223299999999999 2020-11-16T20:55:55.812 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.812 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.812 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.812 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.768805+0000", 2020-11-16T20:55:55.812 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000106482 2020-11-16T20:55:55.813 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.813 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.813 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:55:55.813 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.768911+0000", 2020-11-16T20:55:55.813 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0020716380000000002 2020-11-16T20:55:55.813 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.813 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.813 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:55.814 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.770983+0000", 2020-11-16T20:55:55.814 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006386081 2020-11-16T20:55:55.814 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.814 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.814 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.814 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.777369+0000", 2020-11-16T20:55:55.814 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002874068 2020-11-16T20:55:55.815 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.815 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.815 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.815 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.780243+0000", 2020-11-16T20:55:55.815 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.1408000000000004e-05 2020-11-16T20:55:55.815 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.815 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.816 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.816 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.780324+0000", 2020-11-16T20:55:55.816 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8355000000000005e-05 2020-11-16T20:55:55.816 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.816 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.816 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.816 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.780403+0000", 2020-11-16T20:55:55.816 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012210159999999999 2020-11-16T20:55:55.817 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.817 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.817 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.817 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.817 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.817 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1100 4.0 4:1e86053b:::smithi16641208-244:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:55:55.817 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.904112+0000", 2020-11-16T20:55:55.818 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.80069795799999999, 2020-11-16T20:55:55.818 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021275207000000001, 2020-11-16T20:55:55.818 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.818 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:55:55.818 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:55.818 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:55.818 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:55.818 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1100 2020-11-16T20:55:55.819 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.819 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.819 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.819 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.819 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904112+0000", 2020-11-16T20:55:55.819 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.819 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.820 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.820 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.820 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904112+0000", 2020-11-16T20:55:55.820 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2320999999999998e-05 2020-11-16T20:55:55.820 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.820 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.820 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.820 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904144+0000", 2020-11-16T20:55:55.821 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8300000000000001e-06 2020-11-16T20:55:55.821 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.821 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.821 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.821 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904150+0000", 2020-11-16T20:55:55.821 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2289999999999999e-05 2020-11-16T20:55:55.821 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.821 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.822 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.822 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904162+0000", 2020-11-16T20:55:55.822 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1189999999999999e-06 2020-11-16T20:55:55.822 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.822 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.822 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.823 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904166+0000", 2020-11-16T20:55:55.823 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00041665099999999998 2020-11-16T20:55:55.823 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.823 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.823 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.823 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904583+0000", 2020-11-16T20:55:55.823 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4852999999999999e-05 2020-11-16T20:55:55.823 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.824 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.824 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:55.824 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904628+0000", 2020-11-16T20:55:55.824 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012226348999999999 2020-11-16T20:55:55.824 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.824 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.824 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.824 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.916854+0000", 2020-11-16T20:55:55.825 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000130242 2020-11-16T20:55:55.825 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.825 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.825 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:55:55.825 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.916984+0000", 2020-11-16T20:55:55.825 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078369049999999999 2020-11-16T20:55:55.825 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.826 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.826 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.826 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.924821+0000", 2020-11-16T20:55:55.826 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9945999999999997e-05 2020-11-16T20:55:55.826 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.826 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.826 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.827 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.924901+0000", 2020-11-16T20:55:55.827 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000485701 2020-11-16T20:55:55.827 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.827 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.827 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.827 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.925387+0000", 2020-11-16T20:55:55.827 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021275207000000001 2020-11-16T20:55:55.827 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.828 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.828 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.828 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.828 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.828 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:201 3.2 3:515e6cf6:::smithi16641208-22:head [copy-from ver 21] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e35)", 2020-11-16T20:55:55.828 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.969037+0000", 2020-11-16T20:55:55.828 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.73577241000000004, 2020-11-16T20:55:55.829 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021703407000000001, 2020-11-16T20:55:55.829 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.829 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.829 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.829 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.829 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.829 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969037+0000", 2020-11-16T20:55:55.829 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.830 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.830 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.830 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.830 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969037+0000", 2020-11-16T20:55:55.830 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1260000000000006e-05 2020-11-16T20:55:55.830 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.830 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.831 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.831 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969099+0000", 2020-11-16T20:55:55.831 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8179999999999993e-06 2020-11-16T20:55:55.831 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.831 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.831 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.831 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969107+0000", 2020-11-16T20:55:55.831 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.428e-05 2020-11-16T20:55:55.832 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.832 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.832 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.832 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969122+0000", 2020-11-16T20:55:55.832 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9359999999999999e-06 2020-11-16T20:55:55.832 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.832 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.833 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.833 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969130+0000", 2020-11-16T20:55:55.833 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000117713 2020-11-16T20:55:55.833 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.833 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.833 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.833 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969247+0000", 2020-11-16T20:55:55.833 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014414199999999999 2020-11-16T20:55:55.834 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.834 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.834 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.834 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969391+0000", 2020-11-16T20:55:55.834 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.005648737 2020-11-16T20:55:55.834 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.834 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.835 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:55:55.835 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.975040+0000", 2020-11-16T20:55:55.835 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011700868999999999 2020-11-16T20:55:55.835 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.835 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.835 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:55.835 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.986741+0000", 2020-11-16T20:55:55.836 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00078654400000000002 2020-11-16T20:55:55.836 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.836 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.836 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.836 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987528+0000", 2020-11-16T20:55:55.836 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030922979999999998 2020-11-16T20:55:55.836 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.836 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.837 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.837 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.990620+0000", 2020-11-16T20:55:55.837 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9068999999999999e-05 2020-11-16T20:55:55.837 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.837 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.837 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.837 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.990689+0000", 2020-11-16T20:55:55.838 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1740999999999998e-05 2020-11-16T20:55:55.838 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.838 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.838 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.838 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.990741+0000", 2020-11-16T20:55:55.838 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021703407000000001 2020-11-16T20:55:55.838 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.838 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.839 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.839 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.839 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.839 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:202 3.2 3:5723fd94:::smithi16641208-211:head [copy-from ver 110] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e35)", 2020-11-16T20:55:55.839 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:55:55.839 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.73562919400000004, 2020-11-16T20:55:55.839 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027790216999999999, 2020-11-16T20:55:55.840 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.840 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.840 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.840 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.840 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.840 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:55:55.840 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.840 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.841 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.841 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.841 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:55:55.841 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1907999999999998e-05 2020-11-16T20:55:55.841 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.841 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.841 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.841 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969232+0000", 2020-11-16T20:55:55.842 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5270000000000004e-06 2020-11-16T20:55:55.842 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.842 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.842 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.842 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969239+0000", 2020-11-16T20:55:55.842 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3062e-05 2020-11-16T20:55:55.842 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.843 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.843 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.843 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969252+0000", 2020-11-16T20:55:55.843 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8919999999999997e-06 2020-11-16T20:55:55.843 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.843 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.843 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.843 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969258+0000", 2020-11-16T20:55:55.844 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00040859799999999998 2020-11-16T20:55:55.844 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.844 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.844 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.844 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969666+0000", 2020-11-16T20:55:55.844 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0932000000000003e-05 2020-11-16T20:55:55.844 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.845 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.845 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.845 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969757+0000", 2020-11-16T20:55:55.845 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010999395 2020-11-16T20:55:55.845 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.845 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.845 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:55:55.845 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.980757+0000", 2020-11-16T20:55:55.846 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006260659 2020-11-16T20:55:55.846 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.846 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.846 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:55.846 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987017+0000", 2020-11-16T20:55:55.846 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0080836880000000003 2020-11-16T20:55:55.846 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.847 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.847 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.847 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995101+0000", 2020-11-16T20:55:55.847 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001796829 2020-11-16T20:55:55.847 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.847 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.847 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.847 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996898+0000", 2020-11-16T20:55:55.848 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2086000000000003e-05 2020-11-16T20:55:55.848 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.848 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.848 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.848 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996940+0000", 2020-11-16T20:55:55.848 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0641e-05 2020-11-16T20:55:55.848 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.849 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.849 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.849 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996971+0000", 2020-11-16T20:55:55.849 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027790216999999999 2020-11-16T20:55:55.849 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.849 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.849 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.849 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.850 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.850 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1121 3.2 3:7ef90409:::smithi16641208-250:head [write 584943~460297,stat] snapc 0=[] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e35)", 2020-11-16T20:55:55.850 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.979302+0000", 2020-11-16T20:55:55.850 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.72550762899999999, 2020-11-16T20:55:55.850 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018294922000000002, 2020-11-16T20:55:55.850 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.850 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.850 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.851 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.851 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.851 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.979302+0000", 2020-11-16T20:55:55.851 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.851 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.851 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.851 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.852 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.979302+0000", 2020-11-16T20:55:55.852 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016355300000000001 2020-11-16T20:55:55.852 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.852 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.852 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.852 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.979466+0000", 2020-11-16T20:55:55.852 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9299999999999998e-06 2020-11-16T20:55:55.852 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.853 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.853 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.853 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.979476+0000", 2020-11-16T20:55:55.853 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7201999999999999e-05 2020-11-16T20:55:55.853 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.853 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.853 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.854 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.979493+0000", 2020-11-16T20:55:55.854 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8890000000000008e-06 2020-11-16T20:55:55.854 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.854 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.854 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.854 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.979502+0000", 2020-11-16T20:55:55.854 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0060374069999999998 2020-11-16T20:55:55.854 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.855 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.855 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.855 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.985539+0000", 2020-11-16T20:55:55.855 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000144306 2020-11-16T20:55:55.855 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.855 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.855 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.856 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.985683+0000", 2020-11-16T20:55:55.856 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015322099999999999 2020-11-16T20:55:55.856 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.856 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.856 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:55:55.856 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.985837+0000", 2020-11-16T20:55:55.856 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001516189 2020-11-16T20:55:55.856 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.857 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.857 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:55.857 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987353+0000", 2020-11-16T20:55:55.857 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010080207000000001 2020-11-16T20:55:55.857 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.857 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.857 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.858 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.997433+0000", 2020-11-16T20:55:55.858 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9851000000000001e-05 2020-11-16T20:55:55.858 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.858 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.858 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.858 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.997483+0000", 2020-11-16T20:55:55.858 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7873000000000001e-05 2020-11-16T20:55:55.858 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.859 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.859 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.859 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.997521+0000", 2020-11-16T20:55:55.859 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6293999999999998e-05 2020-11-16T20:55:55.859 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.859 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.859 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.860 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.997597+0000", 2020-11-16T20:55:55.860 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018294922000000002 2020-11-16T20:55:55.860 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.860 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.860 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.860 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.860 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.860 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1122 3.2 3:7ef90409:::smithi16641208-250:head [write 1587781~597162] snapc 0=[] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e35)", 2020-11-16T20:55:55.861 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.983325+0000", 2020-11-16T20:55:55.861 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.72148429199999997, 2020-11-16T20:55:55.861 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019229049000000002, 2020-11-16T20:55:55.861 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.861 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.861 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.861 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.861 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.862 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983325+0000", 2020-11-16T20:55:55.862 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.862 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.862 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.862 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.862 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983325+0000", 2020-11-16T20:55:55.862 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015493500000000001 2020-11-16T20:55:55.863 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.863 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.863 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.863 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983480+0000", 2020-11-16T20:55:55.863 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4990000000000002e-06 2020-11-16T20:55:55.863 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.863 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.863 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.864 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983486+0000", 2020-11-16T20:55:55.864 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7037e-05 2020-11-16T20:55:55.864 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.864 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.864 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.864 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983503+0000", 2020-11-16T20:55:55.864 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6639999999999998e-06 2020-11-16T20:55:55.865 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.865 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.865 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.865 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983511+0000", 2020-11-16T20:55:55.865 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003260757 2020-11-16T20:55:55.865 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.865 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.866 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.866 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.986771+0000", 2020-11-16T20:55:55.866 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000136346 2020-11-16T20:55:55.866 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.866 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.866 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:55:55.866 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.986908+0000", 2020-11-16T20:55:55.866 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010723052 2020-11-16T20:55:55.867 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.867 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.867 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.867 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.997631+0000", 2020-11-16T20:55:55.867 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5947999999999998e-05 2020-11-16T20:55:55.867 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.867 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.868 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.868 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.997717+0000", 2020-11-16T20:55:55.868 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016206200000000001 2020-11-16T20:55:55.868 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.868 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.868 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:55:55.868 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.997879+0000", 2020-11-16T20:55:55.868 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003597205 2020-11-16T20:55:55.869 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.869 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.869 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.869 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.001476+0000", 2020-11-16T20:55:55.869 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1767000000000001e-05 2020-11-16T20:55:55.869 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.869 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.870 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.870 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.001528+0000", 2020-11-16T20:55:55.870 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00085415100000000004 2020-11-16T20:55:55.870 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.870 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.870 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:55.870 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002382+0000", 2020-11-16T20:55:55.870 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000102564 2020-11-16T20:55:55.871 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.871 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.871 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.871 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002484+0000", 2020-11-16T20:55:55.871 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0061999999999994e-05 2020-11-16T20:55:55.871 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.871 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.872 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.872 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002554+0000", 2020-11-16T20:55:55.872 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019229049000000002 2020-11-16T20:55:55.872 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.872 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.872 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.872 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.872 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.873 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1123 3.2 3:7ef90409:::smithi16641208-250:head [setxattr _header (57) in=7b,truncate 2184943] snapc 0=[] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e35)", 2020-11-16T20:55:55.873 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.983910+0000", 2020-11-16T20:55:55.873 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.72089954700000003, 2020-11-16T20:55:55.873 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018919126000000001, 2020-11-16T20:55:55.873 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.873 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.873 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.873 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.874 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.874 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983910+0000", 2020-11-16T20:55:55.874 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.874 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.874 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.874 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.874 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983910+0000", 2020-11-16T20:55:55.875 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6406999999999998e-05 2020-11-16T20:55:55.875 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.875 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.875 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.875 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983957+0000", 2020-11-16T20:55:55.875 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0913999999999999e-05 2020-11-16T20:55:55.875 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.875 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.876 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.876 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983967+0000", 2020-11-16T20:55:55.876 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4635e-05 2020-11-16T20:55:55.876 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.876 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.876 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.876 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983982+0000", 2020-11-16T20:55:55.877 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8420000000000005e-06 2020-11-16T20:55:55.877 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.877 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.877 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.877 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983990+0000", 2020-11-16T20:55:55.877 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029550890000000002 2020-11-16T20:55:55.877 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.877 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.878 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.878 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.986945+0000", 2020-11-16T20:55:55.878 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5418000000000003e-05 2020-11-16T20:55:55.878 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.878 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.878 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:55:55.878 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987010+0000", 2020-11-16T20:55:55.879 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011737546 2020-11-16T20:55:55.879 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.879 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.879 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.879 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.998748+0000", 2020-11-16T20:55:55.879 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000104208 2020-11-16T20:55:55.879 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.879 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.880 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.880 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.998852+0000", 2020-11-16T20:55:55.880 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015971400000000001 2020-11-16T20:55:55.880 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.880 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.880 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:55:55.880 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.999012+0000", 2020-11-16T20:55:55.881 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0025627029999999999 2020-11-16T20:55:55.881 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.881 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.881 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.881 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.001575+0000", 2020-11-16T20:55:55.881 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0382000000000001e-05 2020-11-16T20:55:55.881 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.881 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.882 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.882 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.001615+0000", 2020-11-16T20:55:55.882 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001134216 2020-11-16T20:55:55.882 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.882 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.882 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:55.882 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002749+0000", 2020-11-16T20:55:55.883 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2852000000000002e-05 2020-11-16T20:55:55.883 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.883 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.883 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.883 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002792+0000", 2020-11-16T20:55:55.883 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7200000000000003e-05 2020-11-16T20:55:55.883 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.883 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.884 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.884 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002829+0000", 2020-11-16T20:55:55.884 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018919126000000001 2020-11-16T20:55:55.884 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.884 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.884 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.884 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.884 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.885 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:206 3.2 3:7ef90409:::smithi16641208-250:head [read 0~1] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+known_if_redirected e35)", 2020-11-16T20:55:55.885 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.984112+0000", 2020-11-16T20:55:55.885 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.72069802999999999, 2020-11-16T20:55:55.885 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018870285000000001, 2020-11-16T20:55:55.885 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.885 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:55:55.885 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.886 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.886 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.886 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.984112+0000", 2020-11-16T20:55:55.886 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.886 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.886 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.886 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.886 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.984112+0000", 2020-11-16T20:55:55.887 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2836000000000002e-05 2020-11-16T20:55:55.887 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.887 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.887 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.887 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.984144+0000", 2020-11-16T20:55:55.887 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7229999999999998e-06 2020-11-16T20:55:55.887 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.888 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.888 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.888 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.984151+0000", 2020-11-16T20:55:55.888 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5872e-05 2020-11-16T20:55:55.888 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.888 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.888 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.888 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.984167+0000", 2020-11-16T20:55:55.889 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3956e-05 2020-11-16T20:55:55.889 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.889 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.889 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.889 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.984181+0000", 2020-11-16T20:55:55.889 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002868916 2020-11-16T20:55:55.889 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.890 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.890 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.890 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987050+0000", 2020-11-16T20:55:55.890 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000100128 2020-11-16T20:55:55.890 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.890 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.890 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:55:55.890 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987150+0000", 2020-11-16T20:55:55.891 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012240048 2020-11-16T20:55:55.891 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.891 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.891 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.891 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.999390+0000", 2020-11-16T20:55:55.891 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8245999999999997e-05 2020-11-16T20:55:55.891 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.892 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.892 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:55:55.892 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.999458+0000", 2020-11-16T20:55:55.892 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003399507 2020-11-16T20:55:55.892 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.892 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.892 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.892 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002858+0000", 2020-11-16T20:55:55.893 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4651000000000002e-05 2020-11-16T20:55:55.893 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.893 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.893 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.893 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002913+0000", 2020-11-16T20:55:55.893 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9401999999999997e-05 2020-11-16T20:55:55.893 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.894 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.894 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.894 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002982+0000", 2020-11-16T20:55:55.894 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018870285000000001 2020-11-16T20:55:55.894 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.894 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.894 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.894 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.895 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.895 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:207 3.2 3:5c36260c:::smithi16641208-128:head [copy-from ver 65] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e35)", 2020-11-16T20:55:55.895 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.995515+0000", 2020-11-16T20:55:55.895 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.70929473700000001, 2020-11-16T20:55:55.895 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015181605000000001, 2020-11-16T20:55:55.895 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.895 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.896 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.896 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.896 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.896 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995515+0000", 2020-11-16T20:55:55.896 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.896 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.896 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.896 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.897 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995515+0000", 2020-11-16T20:55:55.897 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3939000000000001e-05 2020-11-16T20:55:55.897 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.897 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.897 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.897 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995559+0000", 2020-11-16T20:55:55.897 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3459999999999996e-06 2020-11-16T20:55:55.898 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.898 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.898 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.898 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995566+0000", 2020-11-16T20:55:55.898 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5123000000000001e-05 2020-11-16T20:55:55.898 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.898 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.898 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.899 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995581+0000", 2020-11-16T20:55:55.899 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8569999999999995e-06 2020-11-16T20:55:55.899 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.899 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.899 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.899 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995589+0000", 2020-11-16T20:55:55.899 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6199000000000002e-05 2020-11-16T20:55:55.900 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.900 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.900 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.900 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995645+0000", 2020-11-16T20:55:55.900 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000102872 2020-11-16T20:55:55.900 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.900 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.900 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.901 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995748+0000", 2020-11-16T20:55:55.901 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040666239999999996 2020-11-16T20:55:55.901 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.901 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.901 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:55:55.901 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.999815+0000", 2020-11-16T20:55:55.901 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030237390000000001 2020-11-16T20:55:55.902 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.902 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.902 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:55.902 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002839+0000", 2020-11-16T20:55:55.902 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0076955519999999996 2020-11-16T20:55:55.902 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.902 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.902 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.903 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.010534+0000", 2020-11-16T20:55:55.903 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0246000000000001e-05 2020-11-16T20:55:55.903 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.903 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.903 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.903 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.010564+0000", 2020-11-16T20:55:55.903 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1739e-05 2020-11-16T20:55:55.904 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.904 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.904 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.904 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.010626+0000", 2020-11-16T20:55:55.904 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0369000000000003e-05 2020-11-16T20:55:55.904 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.904 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.904 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.905 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.010697+0000", 2020-11-16T20:55:55.905 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015181605000000001 2020-11-16T20:55:55.905 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.905 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.905 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.905 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.905 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.906 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:208 3.2 3:762d577a:::smithi16641208-195:head [copy-from ver 102] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e35)", 2020-11-16T20:55:55.906 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.003022+0000", 2020-11-16T20:55:55.906 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.70178755800000003, 2020-11-16T20:55:55.906 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017627352999999998, 2020-11-16T20:55:55.906 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.906 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:55:55.906 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.906 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.907 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.907 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003022+0000", 2020-11-16T20:55:55.907 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.907 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.907 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.907 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.907 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003022+0000", 2020-11-16T20:55:55.908 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3676e-05 2020-11-16T20:55:55.908 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.908 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.908 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.908 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003066+0000", 2020-11-16T20:55:55.908 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2129999999999999e-06 2020-11-16T20:55:55.908 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.908 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.909 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.909 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003071+0000", 2020-11-16T20:55:55.909 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2689999999999999e-06 2020-11-16T20:55:55.909 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.909 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.909 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.909 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003079+0000", 2020-11-16T20:55:55.910 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6480000000000002e-06 2020-11-16T20:55:55.910 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.910 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.910 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.910 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003084+0000", 2020-11-16T20:55:55.910 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9362000000000001e-05 2020-11-16T20:55:55.910 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.910 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.911 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.911 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003113+0000", 2020-11-16T20:55:55.911 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1527999999999999e-05 2020-11-16T20:55:55.911 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.911 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.911 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.911 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003165+0000", 2020-11-16T20:55:55.911 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042510660000000004 2020-11-16T20:55:55.912 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.912 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.912 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:55:55.912 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.007416+0000", 2020-11-16T20:55:55.912 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0043608070000000004 2020-11-16T20:55:55.912 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.912 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.913 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:55:55.913 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.011777+0000", 2020-11-16T20:55:55.913 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0086685419999999996 2020-11-16T20:55:55.913 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.913 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.913 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.913 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.020445+0000", 2020-11-16T20:55:55.913 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8176000000000004e-05 2020-11-16T20:55:55.914 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.914 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.914 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:55:55.914 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.020533+0000", 2020-11-16T20:55:55.914 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9265999999999997e-05 2020-11-16T20:55:55.914 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.914 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.915 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:55:55.915 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.020603+0000", 2020-11-16T20:55:55.915 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6799999999999999e-05 2020-11-16T20:55:55.915 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.915 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.915 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.915 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.020649+0000", 2020-11-16T20:55:55.915 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017627352999999998 2020-11-16T20:55:55.916 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.916 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.916 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.916 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.916 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.916 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1148 4.0 4:0285a053:::smithi16641208-256:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:55:55.916 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.060859+0000", 2020-11-16T20:55:55.917 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.64395020000000003, 2020-11-16T20:55:55.917 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018754663000000001, 2020-11-16T20:55:55.917 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:55:55.917 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:55:55.917 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:55:55.917 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:55:55.917 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:55:55.917 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1148 2020-11-16T20:55:55.918 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.918 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:55:55.918 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.918 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:55:55.918 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.060859+0000", 2020-11-16T20:55:55.918 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:55:55.918 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.919 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.919 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:55:55.919 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.060859+0000", 2020-11-16T20:55:55.919 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9090000000000001e-05 2020-11-16T20:55:55.919 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.919 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.919 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:55:55.919 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.060889+0000", 2020-11-16T20:55:55.920 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2449999999999998e-06 2020-11-16T20:55:55.920 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.920 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.920 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:55:55.920 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.060894+0000", 2020-11-16T20:55:55.920 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0559e-05 2020-11-16T20:55:55.920 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.921 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.921 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:55:55.921 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.060904+0000", 2020-11-16T20:55:55.921 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4089999999999996e-06 2020-11-16T20:55:55.921 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.921 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.921 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:55:55.921 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.060909+0000", 2020-11-16T20:55:55.922 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00040223899999999998 2020-11-16T20:55:55.922 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.922 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.922 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.922 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.061311+0000", 2020-11-16T20:55:55.922 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4712000000000001e-05 2020-11-16T20:55:55.922 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.923 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.923 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:55:55.923 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.061366+0000", 2020-11-16T20:55:55.923 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012445941 2020-11-16T20:55:55.923 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.923 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.923 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.923 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.073812+0000", 2020-11-16T20:55:55.924 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015803799999999999 2020-11-16T20:55:55.924 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.924 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.924 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:55:55.924 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.073970+0000", 2020-11-16T20:55:55.924 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0048616500000000003 2020-11-16T20:55:55.924 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.924 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.925 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:55:55.925 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.078831+0000", 2020-11-16T20:55:55.925 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1623000000000002e-05 2020-11-16T20:55:55.925 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.925 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.925 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:55:55.925 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.078903+0000", 2020-11-16T20:55:55.926 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00071115700000000002 2020-11-16T20:55:55.926 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:55:55.926 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:55:55.926 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:55:55.926 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.079614+0000", 2020-11-16T20:55:55.926 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018754663000000001 2020-11-16T20:55:55.926 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.927 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.927 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.927 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:55:55.927 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:55:55.927 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:55:55.934 INFO:tasks.rados.rados.0.smithi166.stdout:301: writing smithi16641208-301 from 1872245 to 2510006 tid 2 2020-11-16T20:55:55.934 INFO:tasks.rados.rados.0.smithi166.stdout:302: write initial oid 302 2020-11-16T20:55:55.934 INFO:tasks.rados.rados.0.smithi166.stdout:302: seq_num 301 ranges {658907=787716,1930727=497772,3032909=25998} 2020-11-16T20:55:55.934 INFO:tasks.rados.rados.0.smithi166.stdout:302: writing smithi16641208-302 from 658907 to 1446623 tid 1 2020-11-16T20:55:55.935 INFO:tasks.rados.rados.0.smithi166.stdout:302: writing smithi16641208-302 from 1930727 to 2428499 tid 2 2020-11-16T20:55:55.935 INFO:tasks.rados.rados.0.smithi166.stdout:302: writing smithi16641208-302 from 3032909 to 3058907 tid 3 2020-11-16T20:55:55.935 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.935 INFO:tasks.rados.rados.0.smithi166.stdout:287: finishing write tid 3 to smithi16641208-287 2020-11-16T20:55:55.935 INFO:tasks.rados.rados.0.smithi166.stdout:287: finishing write tid 4 to smithi16641208-287 2020-11-16T20:55:55.935 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 287 v 153 (ObjNum 286 snap 0 seq_num 286) dirty exists 2020-11-16T20:55:55.935 INFO:tasks.rados.rados.0.smithi166.stdout:287: left oid 287 (ObjNum 286 snap 0 seq_num 286) 2020-11-16T20:55:55.935 INFO:tasks.rados.rados.0.smithi166.stdout:288: finishing write tid 1 to smithi16641208-288 2020-11-16T20:55:55.936 INFO:tasks.rados.rados.0.smithi166.stdout:288: finishing write tid 2 to smithi16641208-288 2020-11-16T20:55:55.936 INFO:tasks.rados.rados.0.smithi166.stdout:288: finishing write tid 3 to smithi16641208-288 2020-11-16T20:55:55.936 INFO:tasks.rados.rados.0.smithi166.stdout:288: finishing write tid 4 to smithi16641208-288 2020-11-16T20:55:55.936 INFO:tasks.rados.rados.0.smithi166.stdout:288: finishing write tid 5 to smithi16641208-288 2020-11-16T20:55:55.936 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 288 v 201 (ObjNum 287 snap 0 seq_num 287) dirty exists 2020-11-16T20:55:55.936 INFO:tasks.rados.rados.0.smithi166.stdout:288: left oid 288 (ObjNum 287 snap 0 seq_num 287) 2020-11-16T20:55:55.936 INFO:tasks.rados.rados.0.smithi166.stdout:287: done (15 left) 2020-11-16T20:55:55.937 INFO:tasks.rados.rados.0.smithi166.stdout:288: done (14 left) 2020-11-16T20:55:55.937 INFO:tasks.rados.rados.0.smithi166.stdout:303: write initial oid 303 2020-11-16T20:55:55.937 INFO:tasks.rados.rados.0.smithi166.stdout:303: seq_num 302 ranges {675714=462965,1589209=641430,2943979=131735} 2020-11-16T20:55:55.937 INFO:tasks.rados.rados.0.smithi166.stdout:303: writing smithi16641208-303 from 675714 to 1138679 tid 1 2020-11-16T20:55:55.937 INFO:tasks.rados.rados.0.smithi166.stdout:303: writing smithi16641208-303 from 1589209 to 2230639 tid 2 2020-11-16T20:55:55.937 INFO:tasks.rados.rados.0.smithi166.stdout:303: writing smithi16641208-303 from 2943979 to 3075714 tid 3 2020-11-16T20:55:55.937 INFO:tasks.rados.rados.0.smithi166.stdout:304: write initial oid 304 2020-11-16T20:55:55.937 INFO:tasks.rados.rados.0.smithi166.stdout:304: seq_num 303 ranges {692521=538214,1931338=785088} 2020-11-16T20:55:55.938 INFO:tasks.rados.rados.0.smithi166.stdout:304: writing smithi16641208-304 from 692521 to 1230735 tid 1 2020-11-16T20:55:55.938 INFO:tasks.rados.rados.0.smithi166.stdout:304: writing smithi16641208-304 from 1931338 to 2716426 tid 2 2020-11-16T20:55:55.938 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.938 INFO:tasks.rados.rados.0.smithi166.stdout:289: finishing write tid 1 to smithi16641208-289 2020-11-16T20:55:55.938 INFO:tasks.rados.rados.0.smithi166.stdout:289: finishing write tid 2 to smithi16641208-289 2020-11-16T20:55:55.938 INFO:tasks.rados.rados.0.smithi166.stdout:289: finishing write tid 3 to smithi16641208-289 2020-11-16T20:55:55.938 INFO:tasks.rados.rados.0.smithi166.stdout:289: finishing write tid 4 to smithi16641208-289 2020-11-16T20:55:55.939 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 289 v 156 (ObjNum 288 snap 0 seq_num 288) dirty exists 2020-11-16T20:55:55.939 INFO:tasks.rados.rados.0.smithi166.stdout:289: left oid 289 (ObjNum 288 snap 0 seq_num 288) 2020-11-16T20:55:55.939 INFO:tasks.rados.rados.0.smithi166.stdout:290: finishing write tid 1 to smithi16641208-290 2020-11-16T20:55:55.939 INFO:tasks.rados.rados.0.smithi166.stdout:290: finishing write tid 2 to smithi16641208-290 2020-11-16T20:55:55.939 INFO:tasks.rados.rados.0.smithi166.stdout:290: finishing write tid 3 to smithi16641208-290 2020-11-16T20:55:55.939 INFO:tasks.rados.rados.0.smithi166.stdout:289: done (15 left) 2020-11-16T20:55:55.939 INFO:tasks.rados.rados.0.smithi166.stdout:305: write initial oid 305 2020-11-16T20:55:55.940 INFO:tasks.rados.rados.0.smithi166.stdout:305: seq_num 304 ranges {709328=613463,1989820=645099} 2020-11-16T20:55:55.940 INFO:tasks.rados.rados.0.smithi166.stdout:305: writing smithi16641208-305 from 709328 to 1322791 tid 1 2020-11-16T20:55:55.940 INFO:tasks.rados.rados.0.smithi166.stdout:305: writing smithi16641208-305 from 1989820 to 2634919 tid 2 2020-11-16T20:55:55.940 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.940 INFO:tasks.rados.rados.0.smithi166.stdout:290: finishing write tid 4 to smithi16641208-290 2020-11-16T20:55:55.940 INFO:tasks.rados.rados.0.smithi166.stdout:290: finishing write tid 5 to smithi16641208-290 2020-11-16T20:55:55.940 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 290 v 222 (ObjNum 289 snap 0 seq_num 289) dirty exists 2020-11-16T20:55:55.940 INFO:tasks.rados.rados.0.smithi166.stdout:290: left oid 290 (ObjNum 289 snap 0 seq_num 289) 2020-11-16T20:55:55.941 INFO:tasks.rados.rados.0.smithi166.stdout:291: finishing write tid 1 to smithi16641208-291 2020-11-16T20:55:55.941 INFO:tasks.rados.rados.0.smithi166.stdout:291: finishing write tid 2 to smithi16641208-291 2020-11-16T20:55:55.941 INFO:tasks.rados.rados.0.smithi166.stdout:291: finishing write tid 3 to smithi16641208-291 2020-11-16T20:55:55.941 INFO:tasks.rados.rados.0.smithi166.stdout:290: done (15 left) 2020-11-16T20:55:55.941 INFO:tasks.rados.rados.0.smithi166.stdout:306: write initial oid 306 2020-11-16T20:55:55.941 INFO:tasks.rados.rados.0.smithi166.stdout:306: seq_num 305 ranges {726135=405065,1764655=788757,3026248=99887} 2020-11-16T20:55:55.941 INFO:tasks.rados.rados.0.smithi166.stdout:306: writing smithi16641208-306 from 726135 to 1131200 tid 1 2020-11-16T20:55:55.941 INFO:tasks.rados.rados.0.smithi166.stdout:306: writing smithi16641208-306 from 1764655 to 2553412 tid 2 2020-11-16T20:55:55.942 INFO:tasks.rados.rados.0.smithi166.stdout:306: writing smithi16641208-306 from 3026248 to 3126135 tid 3 2020-11-16T20:55:55.942 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.942 INFO:tasks.rados.rados.0.smithi166.stdout:292: finishing write tid 1 to smithi16641208-292 2020-11-16T20:55:55.942 INFO:tasks.rados.rados.0.smithi166.stdout:291: finishing write tid 4 to smithi16641208-291 2020-11-16T20:55:55.942 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 291 v 253 (ObjNum 290 snap 0 seq_num 290) dirty exists 2020-11-16T20:55:55.942 INFO:tasks.rados.rados.0.smithi166.stdout:291: left oid 291 (ObjNum 290 snap 0 seq_num 290) 2020-11-16T20:55:55.942 INFO:tasks.rados.rados.0.smithi166.stdout:292: finishing write tid 2 to smithi16641208-292 2020-11-16T20:55:55.943 INFO:tasks.rados.rados.0.smithi166.stdout:292: finishing write tid 3 to smithi16641208-292 2020-11-16T20:55:55.943 INFO:tasks.rados.rados.0.smithi166.stdout:292: finishing write tid 4 to smithi16641208-292 2020-11-16T20:55:55.943 INFO:tasks.rados.rados.0.smithi166.stdout:292: finishing write tid 5 to smithi16641208-292 2020-11-16T20:55:55.943 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 292 v 205 (ObjNum 291 snap 0 seq_num 291) dirty exists 2020-11-16T20:55:55.943 INFO:tasks.rados.rados.0.smithi166.stdout:292: left oid 292 (ObjNum 291 snap 0 seq_num 291) 2020-11-16T20:55:55.943 INFO:tasks.rados.rados.0.smithi166.stdout:293: finishing write tid 1 to smithi16641208-293 2020-11-16T20:55:55.943 INFO:tasks.rados.rados.0.smithi166.stdout:293: finishing write tid 2 to smithi16641208-293 2020-11-16T20:55:55.944 INFO:tasks.rados.rados.0.smithi166.stdout:293: finishing write tid 3 to smithi16641208-293 2020-11-16T20:55:55.944 INFO:tasks.rados.rados.0.smithi166.stdout:293: finishing write tid 4 to smithi16641208-293 2020-11-16T20:55:55.944 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 293 v 255 (ObjNum 292 snap 0 seq_num 292) dirty exists 2020-11-16T20:55:55.944 INFO:tasks.rados.rados.0.smithi166.stdout:293: left oid 293 (ObjNum 292 snap 0 seq_num 292) 2020-11-16T20:55:55.944 INFO:tasks.rados.rados.0.smithi166.stdout:294: finishing write tid 1 to smithi16641208-294 2020-11-16T20:55:55.944 INFO:tasks.rados.rados.0.smithi166.stdout:294: finishing write tid 2 to smithi16641208-294 2020-11-16T20:55:55.944 INFO:tasks.rados.rados.0.smithi166.stdout:294: finishing write tid 3 to smithi16641208-294 2020-11-16T20:55:55.944 INFO:tasks.rados.rados.0.smithi166.stdout:294: finishing write tid 4 to smithi16641208-294 2020-11-16T20:55:55.945 INFO:tasks.rados.rados.0.smithi166.stdout:294: finishing write tid 5 to smithi16641208-294 2020-11-16T20:55:55.945 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 294 v 160 (ObjNum 293 snap 0 seq_num 293) dirty exists 2020-11-16T20:55:55.945 INFO:tasks.rados.rados.0.smithi166.stdout:294: left oid 294 (ObjNum 293 snap 0 seq_num 293) 2020-11-16T20:55:55.945 INFO:tasks.rados.rados.0.smithi166.stdout:295: finishing write tid 1 to smithi16641208-295 2020-11-16T20:55:55.945 INFO:tasks.rados.rados.0.smithi166.stdout:295: finishing write tid 2 to smithi16641208-295 2020-11-16T20:55:55.945 INFO:tasks.rados.rados.0.smithi166.stdout:295: finishing write tid 3 to smithi16641208-295 2020-11-16T20:55:55.945 INFO:tasks.rados.rados.0.smithi166.stdout:295: finishing write tid 4 to smithi16641208-295 2020-11-16T20:55:55.945 INFO:tasks.rados.rados.0.smithi166.stdout:295: finishing write tid 5 to smithi16641208-295 2020-11-16T20:55:55.946 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 295 v 209 (ObjNum 294 snap 0 seq_num 294) dirty exists 2020-11-16T20:55:55.946 INFO:tasks.rados.rados.0.smithi166.stdout:295: left oid 295 (ObjNum 294 snap 0 seq_num 294) 2020-11-16T20:55:55.946 INFO:tasks.rados.rados.0.smithi166.stdout:296: finishing write tid 1 to smithi16641208-296 2020-11-16T20:55:55.946 INFO:tasks.rados.rados.0.smithi166.stdout:296: finishing write tid 2 to smithi16641208-296 2020-11-16T20:55:55.946 INFO:tasks.rados.rados.0.smithi166.stdout:296: finishing write tid 3 to smithi16641208-296 2020-11-16T20:55:55.946 INFO:tasks.rados.rados.0.smithi166.stdout:296: finishing write tid 4 to smithi16641208-296 2020-11-16T20:55:55.946 INFO:tasks.rados.rados.0.smithi166.stdout:296: finishing write tid 5 to smithi16641208-296 2020-11-16T20:55:55.947 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 296 v 213 (ObjNum 295 snap 0 seq_num 295) dirty exists 2020-11-16T20:55:55.947 INFO:tasks.rados.rados.0.smithi166.stdout:296: left oid 296 (ObjNum 295 snap 0 seq_num 295) 2020-11-16T20:55:55.947 INFO:tasks.rados.rados.0.smithi166.stdout:297: finishing write tid 1 to smithi16641208-297 2020-11-16T20:55:55.947 INFO:tasks.rados.rados.0.smithi166.stdout:297: finishing write tid 2 to smithi16641208-297 2020-11-16T20:55:55.947 INFO:tasks.rados.rados.0.smithi166.stdout:297: finishing write tid 3 to smithi16641208-297 2020-11-16T20:55:55.947 INFO:tasks.rados.rados.0.smithi166.stdout:297: finishing write tid 4 to smithi16641208-297 2020-11-16T20:55:55.947 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 297 v 216 (ObjNum 296 snap 0 seq_num 296) dirty exists 2020-11-16T20:55:55.947 INFO:tasks.rados.rados.0.smithi166.stdout:297: left oid 297 (ObjNum 296 snap 0 seq_num 296) 2020-11-16T20:55:55.948 INFO:tasks.rados.rados.0.smithi166.stdout:298: finishing write tid 1 to smithi16641208-298 2020-11-16T20:55:55.948 INFO:tasks.rados.rados.0.smithi166.stdout:291: done (15 left) 2020-11-16T20:55:55.948 INFO:tasks.rados.rados.0.smithi166.stdout:292: done (14 left) 2020-11-16T20:55:55.948 INFO:tasks.rados.rados.0.smithi166.stdout:293: done (13 left) 2020-11-16T20:55:55.948 INFO:tasks.rados.rados.0.smithi166.stdout:294: done (12 left) 2020-11-16T20:55:55.948 INFO:tasks.rados.rados.0.smithi166.stdout:295: done (11 left) 2020-11-16T20:55:55.948 INFO:tasks.rados.rados.0.smithi166.stdout:296: done (10 left) 2020-11-16T20:55:55.949 INFO:tasks.rados.rados.0.smithi166.stdout:297: done (9 left) 2020-11-16T20:55:55.949 INFO:tasks.rados.rados.0.smithi166.stdout:307: write initial oid 307 2020-11-16T20:55:55.949 INFO:tasks.rados.rados.0.smithi166.stdout:307: seq_num 306 ranges {742942=480314,1823137=648768} 2020-11-16T20:55:55.949 INFO:tasks.rados.rados.0.smithi166.stdout:307: writing smithi16641208-307 from 742942 to 1223256 tid 1 2020-11-16T20:55:55.949 INFO:tasks.rados.rados.0.smithi166.stdout:307: writing smithi16641208-307 from 1823137 to 2471905 tid 2 2020-11-16T20:55:55.949 INFO:tasks.rados.rados.0.smithi166.stdout:308: write initial oid 308 2020-11-16T20:55:55.949 INFO:tasks.rados.rados.0.smithi166.stdout:308: seq_num 307 ranges {759749=555563,1765266=792426,2964741=195008} 2020-11-16T20:55:55.949 INFO:tasks.rados.rados.0.smithi166.stdout:308: writing smithi16641208-308 from 759749 to 1315312 tid 1 2020-11-16T20:55:55.950 INFO:tasks.rados.rados.0.smithi166.stdout:308: writing smithi16641208-308 from 1765266 to 2557692 tid 2 2020-11-16T20:55:55.950 INFO:tasks.rados.rados.0.smithi166.stdout:308: writing smithi16641208-308 from 2964741 to 3159749 tid 3 2020-11-16T20:55:55.950 INFO:tasks.rados.rados.0.smithi166.stdout:309: write initial oid 309 2020-11-16T20:55:55.950 INFO:tasks.rados.rados.0.smithi166.stdout:309: seq_num 308 ranges {776556=630812,1823748=652437,3108517=68039} 2020-11-16T20:55:55.950 INFO:tasks.rados.rados.0.smithi166.stdout:309: writing smithi16641208-309 from 776556 to 1407368 tid 1 2020-11-16T20:55:55.950 INFO:tasks.rados.rados.0.smithi166.stdout:309: writing smithi16641208-309 from 1823748 to 2476185 tid 2 2020-11-16T20:55:55.950 INFO:tasks.rados.rados.0.smithi166.stdout:309: writing smithi16641208-309 from 3108517 to 3176556 tid 3 2020-11-16T20:55:55.951 INFO:tasks.rados.rados.0.smithi166.stdout:310: write initial oid 310 2020-11-16T20:55:55.951 INFO:tasks.rados.rados.0.smithi166.stdout:310: seq_num 309 ranges {793363=706061,2282230=796095} 2020-11-16T20:55:55.951 INFO:tasks.rados.rados.0.smithi166.stdout:310: writing smithi16641208-310 from 793363 to 1499424 tid 1 2020-11-16T20:55:55.951 INFO:tasks.rados.rados.0.smithi166.stdout:310: writing smithi16641208-310 from 2282230 to 3078325 tid 2 2020-11-16T20:55:55.951 INFO:tasks.rados.rados.0.smithi166.stdout:311: write initial oid 311 2020-11-16T20:55:55.951 INFO:tasks.rados.rados.0.smithi166.stdout:311: seq_num 310 ranges {410170=781310,1940712=656106,3163363=46807} 2020-11-16T20:55:55.951 INFO:tasks.rados.rados.0.smithi166.stdout:311: writing smithi16641208-311 from 410170 to 1191480 tid 1 2020-11-16T20:55:55.951 INFO:tasks.rados.rados.0.smithi166.stdout:311: writing smithi16641208-311 from 1940712 to 2596818 tid 2 2020-11-16T20:55:55.952 INFO:tasks.rados.rados.0.smithi166.stdout:311: writing smithi16641208-311 from 3163363 to 3210170 tid 3 2020-11-16T20:55:55.952 INFO:tasks.rados.rados.0.smithi166.stdout:312: write initial oid 312 2020-11-16T20:55:55.952 INFO:tasks.rados.rados.0.smithi166.stdout:312: seq_num 311 ranges {426977=456559,1482841=799764,2958080=268897} 2020-11-16T20:55:55.952 INFO:tasks.rados.rados.0.smithi166.stdout:312: writing smithi16641208-312 from 426977 to 883536 tid 1 2020-11-16T20:55:55.952 INFO:tasks.rados.rados.0.smithi166.stdout:312: writing smithi16641208-312 from 1482841 to 2282605 tid 2 2020-11-16T20:55:55.952 INFO:tasks.rados.rados.0.smithi166.stdout:312: writing smithi16641208-312 from 2958080 to 3226977 tid 3 2020-11-16T20:55:55.952 INFO:tasks.rados.rados.0.smithi166.stdout:313: write initial oid 313 2020-11-16T20:55:55.952 INFO:tasks.rados.rados.0.smithi166.stdout:313: seq_num 312 ranges {443784=648161,1657676=659775,2818209=425575} 2020-11-16T20:55:55.953 INFO:tasks.rados.rados.0.smithi166.stdout:313: writing smithi16641208-313 from 443784 to 1091945 tid 1 2020-11-16T20:55:55.953 INFO:tasks.rados.rados.0.smithi166.stdout:313: writing smithi16641208-313 from 1657676 to 2317451 tid 2 2020-11-16T20:55:55.953 INFO:tasks.rados.rados.0.smithi166.stdout:313: writing smithi16641208-313 from 2818209 to 3243784 tid 3 2020-11-16T20:55:55.953 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.953 INFO:tasks.rados.rados.0.smithi166.stdout:298: finishing write tid 2 to smithi16641208-298 2020-11-16T20:55:55.953 INFO:tasks.rados.rados.0.smithi166.stdout:298: finishing write tid 3 to smithi16641208-298 2020-11-16T20:55:55.953 INFO:tasks.rados.rados.0.smithi166.stdout:298: finishing write tid 4 to smithi16641208-298 2020-11-16T20:55:55.954 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 298 v 255 (ObjNum 297 snap 0 seq_num 297) dirty exists 2020-11-16T20:55:55.954 INFO:tasks.rados.rados.0.smithi166.stdout:298: left oid 298 (ObjNum 297 snap 0 seq_num 297) 2020-11-16T20:55:55.954 INFO:tasks.rados.rados.0.smithi166.stdout:299: finishing write tid 1 to smithi16641208-299 2020-11-16T20:55:55.954 INFO:tasks.rados.rados.0.smithi166.stdout:299: finishing write tid 2 to smithi16641208-299 2020-11-16T20:55:55.954 INFO:tasks.rados.rados.0.smithi166.stdout:299: finishing write tid 3 to smithi16641208-299 2020-11-16T20:55:55.954 INFO:tasks.rados.rados.0.smithi166.stdout:298: done (15 left) 2020-11-16T20:55:55.954 INFO:tasks.rados.rados.0.smithi166.stdout:314: write initial oid 314 2020-11-16T20:55:55.954 INFO:tasks.rados.rados.0.smithi166.stdout:314: seq_num 313 ranges {460591=723410,1716158=403433,2729279=440140} 2020-11-16T20:55:55.955 INFO:tasks.rados.rados.0.smithi166.stdout:314: writing smithi16641208-314 from 460591 to 1184001 tid 1 2020-11-16T20:55:55.955 INFO:tasks.rados.rados.0.smithi166.stdout:314: writing smithi16641208-314 from 1716158 to 2119591 tid 2 2020-11-16T20:55:55.955 INFO:tasks.rados.rados.0.smithi166.stdout:314: writing smithi16641208-314 from 2729279 to 3169419 tid 3 2020-11-16T20:55:55.955 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.955 INFO:tasks.rados.rados.0.smithi166.stdout:299: finishing write tid 4 to smithi16641208-299 2020-11-16T20:55:55.955 INFO:tasks.rados.rados.0.smithi166.stdout:299: finishing write tid 5 to smithi16641208-299 2020-11-16T20:55:55.955 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 299 v 259 (ObjNum 298 snap 0 seq_num 298) dirty exists 2020-11-16T20:55:55.956 INFO:tasks.rados.rados.0.smithi166.stdout:299: left oid 299 (ObjNum 298 snap 0 seq_num 298) 2020-11-16T20:55:55.956 INFO:tasks.rados.rados.0.smithi166.stdout:300: finishing write tid 1 to smithi16641208-300 2020-11-16T20:55:55.956 INFO:tasks.rados.rados.0.smithi166.stdout:300: finishing write tid 2 to smithi16641208-300 2020-11-16T20:55:55.956 INFO:tasks.rados.rados.0.smithi166.stdout:300: finishing write tid 3 to smithi16641208-300 2020-11-16T20:55:55.956 INFO:tasks.rados.rados.0.smithi166.stdout:300: finishing write tid 4 to smithi16641208-300 2020-11-16T20:55:55.956 INFO:tasks.rados.rados.0.smithi166.stdout:300: finishing write tid 5 to smithi16641208-300 2020-11-16T20:55:55.956 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 300 v 226 (ObjNum 299 snap 0 seq_num 299) dirty exists 2020-11-16T20:55:55.956 INFO:tasks.rados.rados.0.smithi166.stdout:300: left oid 300 (ObjNum 299 snap 0 seq_num 299) 2020-11-16T20:55:55.957 INFO:tasks.rados.rados.0.smithi166.stdout:301: finishing write tid 1 to smithi16641208-301 2020-11-16T20:55:55.957 INFO:tasks.rados.rados.0.smithi166.stdout:301: finishing write tid 2 to smithi16641208-301 2020-11-16T20:55:55.957 INFO:tasks.rados.rados.0.smithi166.stdout:301: finishing write tid 3 to smithi16641208-301 2020-11-16T20:55:55.957 INFO:tasks.rados.rados.0.smithi166.stdout:301: finishing write tid 4 to smithi16641208-301 2020-11-16T20:55:55.957 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 301 v 163 (ObjNum 300 snap 0 seq_num 300) dirty exists 2020-11-16T20:55:55.957 INFO:tasks.rados.rados.0.smithi166.stdout:301: left oid 301 (ObjNum 300 snap 0 seq_num 300) 2020-11-16T20:55:55.957 INFO:tasks.rados.rados.0.smithi166.stdout:302: finishing write tid 1 to smithi16641208-302 2020-11-16T20:55:55.958 INFO:tasks.rados.rados.0.smithi166.stdout:302: finishing write tid 2 to smithi16641208-302 2020-11-16T20:55:55.958 INFO:tasks.rados.rados.0.smithi166.stdout:302: finishing write tid 3 to smithi16641208-302 2020-11-16T20:55:55.958 INFO:tasks.rados.rados.0.smithi166.stdout:302: finishing write tid 4 to smithi16641208-302 2020-11-16T20:55:55.958 INFO:tasks.rados.rados.0.smithi166.stdout:299: done (15 left) 2020-11-16T20:55:55.958 INFO:tasks.rados.rados.0.smithi166.stdout:300: done (14 left) 2020-11-16T20:55:55.958 INFO:tasks.rados.rados.0.smithi166.stdout:301: done (13 left) 2020-11-16T20:55:55.958 INFO:tasks.rados.rados.0.smithi166.stdout:315: write initial oid 315 2020-11-16T20:55:55.958 INFO:tasks.rados.rados.0.smithi166.stdout:315: seq_num 314 ranges {477398=798659,1774640=663444,2873055=404343} 2020-11-16T20:55:55.959 INFO:tasks.rados.rados.0.smithi166.stdout:315: writing smithi16641208-315 from 477398 to 1276057 tid 1 2020-11-16T20:55:55.959 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:55.932+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:55.959 INFO:teuthology.orchestra.run.smithi166.stderr:noscrub is unset 2020-11-16T20:55:55.960 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:55:55.961 INFO:tasks.rados.rados.0.smithi166.stdout:315: writing smithi16641208-315 from 1774640 to 2438084 tid 2 2020-11-16T20:55:55.961 INFO:tasks.rados.rados.0.smithi166.stdout:315: writing smithi16641208-315 from 2873055 to 3277398 tid 3 2020-11-16T20:55:55.961 INFO:tasks.rados.rados.0.smithi166.stdout:316: write initial oid 316 2020-11-16T20:55:55.961 INFO:tasks.rados.rados.0.smithi166.stdout:316: seq_num 315 ranges {494205=473908,1433122=407102,2384125=462684} 2020-11-16T20:55:55.961 INFO:tasks.rados.rados.0.smithi166.stdout:316: writing smithi16641208-316 from 494205 to 968113 tid 1 2020-11-16T20:55:55.962 INFO:tasks.rados.rados.0.smithi166.stdout:316: writing smithi16641208-316 from 1433122 to 1840224 tid 2 2020-11-16T20:55:55.962 INFO:tasks.rados.rados.0.smithi166.stdout:316: writing smithi16641208-316 from 2384125 to 2846809 tid 3 2020-11-16T20:55:55.963 INFO:tasks.rados.rados.0.smithi166.stdout:317: write initial oid 317 2020-11-16T20:55:55.963 INFO:tasks.rados.rados.0.smithi166.stdout:317: seq_num 316 ranges {511012=549157,1775251=550760,3095195=215817} 2020-11-16T20:55:55.969 INFO:tasks.rados.rados.0.smithi166.stdout:317: writing smithi16641208-317 from 511012 to 1060169 tid 1 2020-11-16T20:55:55.976 INFO:tasks.rados.rados.0.smithi166.stdout:317: writing smithi16641208-317 from 1775251 to 2326011 tid 2 2020-11-16T20:55:55.982 INFO:tasks.rados.rados.0.smithi166.stdout:317: writing smithi16641208-317 from 3095195 to 3311012 tid 3 2020-11-16T20:55:55.982 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:55.983 INFO:tasks.rados.rados.0.smithi166.stdout:302: finishing write tid 5 to smithi16641208-302 2020-11-16T20:55:55.983 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 302 v 167 (ObjNum 301 snap 0 seq_num 301) dirty exists 2020-11-16T20:55:55.983 INFO:tasks.rados.rados.0.smithi166.stdout:302: left oid 302 (ObjNum 301 snap 0 seq_num 301) 2020-11-16T20:55:55.983 INFO:tasks.rados.rados.0.smithi166.stdout:302: done (15 left) 2020-11-16T20:55:55.983 INFO:tasks.rados.rados.0.smithi166.stdout:318: write initial oid 318 2020-11-16T20:55:55.983 INFO:tasks.rados.rados.0.smithi166.stdout:318: seq_num 317 ranges {527819=624406,1833733=410771,2722618=601581} 2020-11-16T20:55:55.988 INFO:tasks.rados.rados.0.smithi166.stdout:318: writing smithi16641208-318 from 527819 to 1152225 tid 1 2020-11-16T20:55:55.994 INFO:tasks.rados.rados.0.smithi166.stdout:318: writing smithi16641208-318 from 1833733 to 2244504 tid 2 2020-11-16T20:55:56.000 INFO:tasks.rados.rados.0.smithi166.stdout:318: writing smithi16641208-318 from 2722618 to 3324199 tid 3 2020-11-16T20:55:56.001 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:56.001 INFO:tasks.rados.rados.0.smithi166.stdout:303: finishing write tid 1 to smithi16641208-303 2020-11-16T20:55:56.001 INFO:tasks.rados.rados.0.smithi166.stdout:303: finishing write tid 2 to smithi16641208-303 2020-11-16T20:55:56.001 INFO:tasks.rados.rados.0.smithi166.stdout:303: finishing write tid 3 to smithi16641208-303 2020-11-16T20:55:56.001 INFO:tasks.rados.rados.0.smithi166.stdout:303: finishing write tid 4 to smithi16641208-303 2020-11-16T20:55:56.001 INFO:tasks.rados.rados.0.smithi166.stdout:303: finishing write tid 5 to smithi16641208-303 2020-11-16T20:55:56.002 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 303 v 171 (ObjNum 302 snap 0 seq_num 302) dirty exists 2020-11-16T20:55:56.002 INFO:tasks.rados.rados.0.smithi166.stdout:303: left oid 303 (ObjNum 302 snap 0 seq_num 302) 2020-11-16T20:55:56.002 INFO:tasks.rados.rados.0.smithi166.stdout:303: done (15 left) 2020-11-16T20:55:56.002 INFO:tasks.rados.rados.0.smithi166.stdout:319: write initial oid 319 2020-11-16T20:55:56.002 INFO:tasks.rados.rados.0.smithi166.stdout:319: seq_num 318 ranges {544626=699655,1892215=554429,3150041=194585} 2020-11-16T20:55:56.007 INFO:tasks.rados.rados.0.smithi166.stdout:319: writing smithi16641208-319 from 544626 to 1244281 tid 1 2020-11-16T20:55:56.014 INFO:tasks.rados.rados.0.smithi166.stdout:319: writing smithi16641208-319 from 1892215 to 2446644 tid 2 2020-11-16T20:55:56.019 INFO:tasks.rados.rados.0.smithi166.stdout:319: writing smithi16641208-319 from 3150041 to 3344626 tid 3 2020-11-16T20:55:56.019 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:56.020 INFO:tasks.rados.rados.0.smithi166.stdout:304: finishing write tid 1 to smithi16641208-304 2020-11-16T20:55:56.020 INFO:tasks.rados.rados.0.smithi166.stdout:304: finishing write tid 2 to smithi16641208-304 2020-11-16T20:55:56.020 INFO:tasks.rados.rados.0.smithi166.stdout:304: finishing write tid 3 to smithi16641208-304 2020-11-16T20:55:56.020 INFO:tasks.rados.rados.0.smithi166.stdout:304: finishing write tid 4 to smithi16641208-304 2020-11-16T20:55:56.020 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 304 v 262 (ObjNum 303 snap 0 seq_num 303) dirty exists 2020-11-16T20:55:56.020 INFO:tasks.rados.rados.0.smithi166.stdout:304: left oid 304 (ObjNum 303 snap 0 seq_num 303) 2020-11-16T20:55:56.020 INFO:tasks.rados.rados.0.smithi166.stdout:304: done (15 left) 2020-11-16T20:55:56.021 INFO:tasks.rados.rados.0.smithi166.stdout:320: write initial oid 320 2020-11-16T20:55:56.021 INFO:tasks.rados.rados.0.smithi166.stdout:320: seq_num 319 ranges {561433=774904,1950697=414440,2777464=583969} 2020-11-16T20:55:56.026 INFO:tasks.rados.rados.0.smithi166.stdout:320: writing smithi16641208-320 from 561433 to 1336337 tid 1 2020-11-16T20:55:56.029 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:55:56.033+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:55:56.032 INFO:tasks.rados.rados.0.smithi166.stdout:320: writing smithi16641208-320 from 1950697 to 2365137 tid 2 2020-11-16T20:55:56.039 INFO:tasks.rados.rados.0.smithi166.stdout:320: writing smithi16641208-320 from 2777464 to 3361433 tid 3 2020-11-16T20:55:56.039 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:56.039 INFO:tasks.rados.rados.0.smithi166.stdout:305: finishing write tid 1 to smithi16641208-305 2020-11-16T20:55:56.039 INFO:tasks.rados.rados.0.smithi166.stdout:305: finishing write tid 2 to smithi16641208-305 2020-11-16T20:55:56.040 INFO:tasks.rados.rados.0.smithi166.stdout:305: finishing write tid 3 to smithi16641208-305 2020-11-16T20:55:56.040 INFO:tasks.rados.rados.0.smithi166.stdout:305: finishing write tid 4 to smithi16641208-305 2020-11-16T20:55:56.040 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 305 v 229 (ObjNum 304 snap 0 seq_num 304) dirty exists 2020-11-16T20:55:56.040 INFO:tasks.rados.rados.0.smithi166.stdout:305: left oid 305 (ObjNum 304 snap 0 seq_num 304) 2020-11-16T20:55:56.040 INFO:tasks.rados.rados.0.smithi166.stdout:306: finishing write tid 1 to smithi16641208-306 2020-11-16T20:55:56.040 INFO:tasks.rados.rados.0.smithi166.stdout:305: done (15 left) 2020-11-16T20:55:56.040 INFO:tasks.rados.rados.0.smithi166.stdout:321: write initial oid 321 2020-11-16T20:55:56.041 INFO:tasks.rados.rados.0.smithi166.stdout:306: finishing write tid 2 to smithi16641208-306 2020-11-16T20:55:56.041 INFO:tasks.rados.rados.0.smithi166.stdout:306: finishing write tid 3 to smithi16641208-306 2020-11-16T20:55:56.041 INFO:tasks.rados.rados.0.smithi166.stdout:306: finishing write tid 4 to smithi16641208-306 2020-11-16T20:55:56.041 INFO:tasks.rados.rados.0.smithi166.stdout:306: finishing write tid 5 to smithi16641208-306 2020-11-16T20:55:56.041 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 306 v 175 (ObjNum 305 snap 0 seq_num 305) dirty exists 2020-11-16T20:55:56.041 INFO:tasks.rados.rados.0.smithi166.stdout:306: left oid 306 (ObjNum 305 snap 0 seq_num 305) 2020-11-16T20:55:56.041 INFO:tasks.rados.rados.0.smithi166.stdout:307: finishing write tid 1 to smithi16641208-307 2020-11-16T20:55:56.041 INFO:tasks.rados.rados.0.smithi166.stdout:321: seq_num 320 ranges {578240=566506,1609179=558098,2804887=551750} 2020-11-16T20:55:56.045 INFO:tasks.rados.rados.0.smithi166.stdout:321: writing smithi16641208-321 from 578240 to 1144746 tid 1 2020-11-16T20:55:56.051 INFO:tasks.rados.rados.0.smithi166.stdout:321: writing smithi16641208-321 from 1609179 to 2167277 tid 2 2020-11-16T20:55:56.057 INFO:tasks.rados.rados.0.smithi166.stdout:321: writing smithi16641208-321 from 2804887 to 3356637 tid 3 2020-11-16T20:55:56.057 INFO:tasks.rados.rados.0.smithi166.stdout:306: done (15 left) 2020-11-16T20:55:56.058 INFO:tasks.rados.rados.0.smithi166.stdout:322: write initial oid 322 2020-11-16T20:55:56.058 INFO:tasks.rados.rados.0.smithi166.stdout:322: seq_num 321 ranges {595047=641755,1667661=418109,2548663=763022} 2020-11-16T20:55:56.067 INFO:tasks.rados.rados.0.smithi166.stdout:322: writing smithi16641208-322 from 595047 to 1236802 tid 1 2020-11-16T20:55:56.070 INFO:tasks.rados.rados.0.smithi166.stdout:322: writing smithi16641208-322 from 1667661 to 2085770 tid 2 2020-11-16T20:55:56.077 INFO:tasks.rados.rados.0.smithi166.stdout:322: writing smithi16641208-322 from 2548663 to 3311685 tid 3 2020-11-16T20:55:56.078 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:56.078 INFO:tasks.rados.rados.0.smithi166.stdout:307: finishing write tid 2 to smithi16641208-307 2020-11-16T20:55:56.078 INFO:tasks.rados.rados.0.smithi166.stdout:307: finishing write tid 3 to smithi16641208-307 2020-11-16T20:55:56.078 INFO:tasks.rados.rados.0.smithi166.stdout:307: finishing write tid 4 to smithi16641208-307 2020-11-16T20:55:56.078 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 307 v 265 (ObjNum 306 snap 0 seq_num 306) dirty exists 2020-11-16T20:55:56.078 INFO:tasks.rados.rados.0.smithi166.stdout:307: left oid 307 (ObjNum 306 snap 0 seq_num 306) 2020-11-16T20:55:56.078 INFO:tasks.rados.rados.0.smithi166.stdout:308: finishing write tid 1 to smithi16641208-308 2020-11-16T20:55:56.079 INFO:tasks.rados.rados.0.smithi166.stdout:307: done (15 left) 2020-11-16T20:55:56.079 INFO:tasks.rados.rados.0.smithi166.stdout:323: write initial oid 323 2020-11-16T20:55:56.079 INFO:tasks.rados.rados.0.smithi166.stdout:323: seq_num 322 ranges {611854=717004,2126143=561767,3259733=152121} 2020-11-16T20:55:56.085 INFO:tasks.rados.rados.0.smithi166.stdout:323: writing smithi16641208-323 from 611854 to 1328858 tid 1 2020-11-16T20:55:56.092 INFO:tasks.rados.rados.0.smithi166.stdout:323: writing smithi16641208-323 from 2126143 to 2687910 tid 2 2020-11-16T20:55:56.097 INFO:tasks.rados.rados.0.smithi166.stdout:323: writing smithi16641208-323 from 3259733 to 3411854 tid 3 2020-11-16T20:55:56.097 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:56.097 INFO:tasks.rados.rados.0.smithi166.stdout:308: finishing write tid 2 to smithi16641208-308 2020-11-16T20:55:56.097 INFO:tasks.rados.rados.0.smithi166.stdout:308: finishing write tid 3 to smithi16641208-308 2020-11-16T20:55:56.098 INFO:tasks.rados.rados.0.smithi166.stdout:308: finishing write tid 4 to smithi16641208-308 2020-11-16T20:55:56.098 INFO:tasks.rados.rados.0.smithi166.stdout:308: finishing write tid 5 to smithi16641208-308 2020-11-16T20:55:56.098 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 308 v 220 (ObjNum 307 snap 0 seq_num 307) dirty exists 2020-11-16T20:55:56.098 INFO:tasks.rados.rados.0.smithi166.stdout:308: left oid 308 (ObjNum 307 snap 0 seq_num 307) 2020-11-16T20:55:56.098 INFO:tasks.rados.rados.0.smithi166.stdout:309: finishing write tid 1 to smithi16641208-309 2020-11-16T20:55:56.098 INFO:tasks.rados.rados.0.smithi166.stdout:309: finishing write tid 2 to smithi16641208-309 2020-11-16T20:55:56.098 INFO:tasks.rados.rados.0.smithi166.stdout:309: finishing write tid 3 to smithi16641208-309 2020-11-16T20:55:56.099 INFO:tasks.rados.rados.0.smithi166.stdout:309: finishing write tid 4 to smithi16641208-309 2020-11-16T20:55:56.099 INFO:tasks.rados.rados.0.smithi166.stdout:309: finishing write tid 5 to smithi16641208-309 2020-11-16T20:55:56.099 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 309 v 233 (ObjNum 308 snap 0 seq_num 308) dirty exists 2020-11-16T20:55:56.099 INFO:tasks.rados.rados.0.smithi166.stdout:309: left oid 309 (ObjNum 308 snap 0 seq_num 308) 2020-11-16T20:55:56.099 INFO:tasks.rados.rados.0.smithi166.stdout:310: finishing write tid 1 to smithi16641208-310 2020-11-16T20:55:56.099 INFO:tasks.rados.rados.0.smithi166.stdout:310: finishing write tid 2 to smithi16641208-310 2020-11-16T20:55:56.099 INFO:tasks.rados.rados.0.smithi166.stdout:310: finishing write tid 3 to smithi16641208-310 2020-11-16T20:55:56.099 INFO:tasks.rados.rados.0.smithi166.stdout:310: finishing write tid 4 to smithi16641208-310 2020-11-16T20:55:56.100 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 310 v 178 (ObjNum 309 snap 0 seq_num 309) dirty exists 2020-11-16T20:55:56.100 INFO:tasks.rados.rados.0.smithi166.stdout:310: left oid 310 (ObjNum 309 snap 0 seq_num 309) 2020-11-16T20:55:56.100 INFO:tasks.rados.rados.0.smithi166.stdout:311: finishing write tid 1 to smithi16641208-311 2020-11-16T20:55:56.100 INFO:tasks.rados.rados.0.smithi166.stdout:311: finishing write tid 2 to smithi16641208-311 2020-11-16T20:55:56.100 INFO:tasks.rados.rados.0.smithi166.stdout:311: finishing write tid 3 to smithi16641208-311 2020-11-16T20:55:56.100 INFO:tasks.rados.rados.0.smithi166.stdout:311: finishing write tid 4 to smithi16641208-311 2020-11-16T20:55:56.100 INFO:tasks.rados.rados.0.smithi166.stdout:311: finishing write tid 5 to smithi16641208-311 2020-11-16T20:55:56.101 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 311 v 182 (ObjNum 310 snap 0 seq_num 310) dirty exists 2020-11-16T20:55:56.101 INFO:tasks.rados.rados.0.smithi166.stdout:311: left oid 311 (ObjNum 310 snap 0 seq_num 310) 2020-11-16T20:55:56.101 INFO:tasks.rados.rados.0.smithi166.stdout:312: finishing write tid 1 to smithi16641208-312 2020-11-16T20:55:56.101 INFO:tasks.rados.rados.0.smithi166.stdout:312: finishing write tid 2 to smithi16641208-312 2020-11-16T20:55:56.101 INFO:tasks.rados.rados.0.smithi166.stdout:308: done (15 left) 2020-11-16T20:55:56.101 INFO:tasks.rados.rados.0.smithi166.stdout:309: done (14 left) 2020-11-16T20:55:56.101 INFO:tasks.rados.rados.0.smithi166.stdout:310: done (13 left) 2020-11-16T20:55:56.101 INFO:tasks.rados.rados.0.smithi166.stdout:311: done (12 left) 2020-11-16T20:55:56.102 INFO:tasks.rados.rados.0.smithi166.stdout:324: write initial oid 324 2020-11-16T20:55:56.102 INFO:tasks.rados.rados.0.smithi166.stdout:324: seq_num 323 ranges {628661=792253,2184625=421778,3403509=25152} 2020-11-16T20:55:56.104 INFO:tasks.rados.rados.0.smithi166.stdout:324: writing smithi16641208-324 from 628661 to 1420914 tid 1 2020-11-16T20:55:56.111 INFO:tasks.rados.rados.0.smithi166.stdout:324: writing smithi16641208-324 from 2184625 to 2606403 tid 2 2020-11-16T20:55:56.116 INFO:tasks.rados.rados.0.smithi166.stdout:324: writing smithi16641208-324 from 3403509 to 3428661 tid 3 2020-11-16T20:55:56.116 INFO:tasks.rados.rados.0.smithi166.stdout:325: write initial oid 325 2020-11-16T20:55:56.116 INFO:tasks.rados.rados.0.smithi166.stdout:325: seq_num 324 ranges {645468=467502,1726754=565436,2798226=596838} 2020-11-16T20:55:56.118 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:55:56.118 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:55:56.118 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:55:56.119 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:55:56.122 INFO:tasks.rados.rados.0.smithi166.stdout:325: writing smithi16641208-325 from 645468 to 1112970 tid 1 2020-11-16T20:55:56.129 INFO:tasks.rados.rados.0.smithi166.stdout:325: writing smithi16641208-325 from 1726754 to 2292190 tid 2 2020-11-16T20:55:56.129 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:55:56.133+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:55:56.131 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:55:56.135 INFO:tasks.rados.rados.0.smithi166.stdout:325: writing smithi16641208-325 from 2798226 to 3395064 tid 3 2020-11-16T20:55:56.136 INFO:tasks.rados.rados.0.smithi166.stdout:326: write initial oid 326 2020-11-16T20:55:56.136 INFO:tasks.rados.rados.0.smithi166.stdout:326: seq_num 325 ranges {662275=542751,1785236=425447,2942002=520273} 2020-11-16T20:55:56.142 INFO:tasks.rados.rados.0.smithi166.stdout:326: writing smithi16641208-326 from 662275 to 1205026 tid 1 2020-11-16T20:55:56.148 INFO:tasks.rados.rados.0.smithi166.stdout:326: writing smithi16641208-326 from 1785236 to 2210683 tid 2 2020-11-16T20:55:56.155 INFO:tasks.rados.rados.0.smithi166.stdout:326: writing smithi16641208-326 from 2942002 to 3462275 tid 3 2020-11-16T20:55:56.155 INFO:tasks.rados.rados.0.smithi166.stdout:327: write initial oid 327 2020-11-16T20:55:56.155 INFO:tasks.rados.rados.0.smithi166.stdout:327: seq_num 326 ranges {679082=618000,1843718=569105,2853072=626010} 2020-11-16T20:55:56.162 INFO:tasks.rados.rados.0.smithi166.stdout:327: writing smithi16641208-327 from 679082 to 1297082 tid 1 2020-11-16T20:55:56.168 INFO:tasks.rados.rados.0.smithi166.stdout:327: writing smithi16641208-327 from 1843718 to 2412823 tid 2 2020-11-16T20:55:56.175 INFO:tasks.rados.rados.0.smithi166.stdout:327: writing smithi16641208-327 from 2853072 to 3479082 tid 3 2020-11-16T20:55:56.175 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:56.175 INFO:tasks.rados.rados.0.smithi166.stdout:312: finishing write tid 3 to smithi16641208-312 2020-11-16T20:55:56.175 INFO:tasks.rados.rados.0.smithi166.stdout:312: finishing write tid 4 to smithi16641208-312 2020-11-16T20:55:56.176 INFO:tasks.rados.rados.0.smithi166.stdout:312: finishing write tid 5 to smithi16641208-312 2020-11-16T20:55:56.176 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 312 v 186 (ObjNum 311 snap 0 seq_num 311) dirty exists 2020-11-16T20:55:56.176 INFO:tasks.rados.rados.0.smithi166.stdout:312: left oid 312 (ObjNum 311 snap 0 seq_num 311) 2020-11-16T20:55:56.176 INFO:tasks.rados.rados.0.smithi166.stdout:313: finishing write tid 1 to smithi16641208-313 2020-11-16T20:55:56.176 INFO:tasks.rados.rados.0.smithi166.stdout:313: finishing write tid 2 to smithi16641208-313 2020-11-16T20:55:56.176 INFO:tasks.rados.rados.0.smithi166.stdout:313: finishing write tid 3 to smithi16641208-313 2020-11-16T20:55:56.177 INFO:tasks.rados.rados.0.smithi166.stdout:312: done (15 left) 2020-11-16T20:55:56.177 INFO:tasks.rados.rados.0.smithi166.stdout:328: write initial oid 328 2020-11-16T20:55:56.177 INFO:tasks.rados.rados.0.smithi166.stdout:313: finishing write tid 4 to smithi16641208-313 2020-11-16T20:55:56.177 INFO:tasks.rados.rados.0.smithi166.stdout:313: finishing write tid 5 to smithi16641208-313 2020-11-16T20:55:56.177 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 313 v 234 (ObjNum 312 snap 0 seq_num 312) dirty exists 2020-11-16T20:55:56.177 INFO:tasks.rados.rados.0.smithi166.stdout:313: left oid 313 (ObjNum 312 snap 0 seq_num 312) 2020-11-16T20:55:56.177 INFO:tasks.rados.rados.0.smithi166.stdout:314: finishing write tid 1 to smithi16641208-314 2020-11-16T20:55:56.178 INFO:tasks.rados.rados.0.smithi166.stdout:314: finishing write tid 2 to smithi16641208-314 2020-11-16T20:55:56.178 INFO:tasks.rados.rados.0.smithi166.stdout:315: finishing write tid 1 to smithi16641208-315 2020-11-16T20:55:56.178 INFO:tasks.rados.rados.0.smithi166.stdout:314: finishing write tid 3 to smithi16641208-314 2020-11-16T20:55:56.178 INFO:tasks.rados.rados.0.smithi166.stdout:314: finishing write tid 4 to smithi16641208-314 2020-11-16T20:55:56.178 INFO:tasks.rados.rados.0.smithi166.stdout:328: seq_num 327 ranges {695889=409602,1618553=712763,2996848=499041} 2020-11-16T20:55:56.181 INFO:tasks.rados.rados.0.smithi166.stdout:328: writing smithi16641208-328 from 695889 to 1105491 tid 1 2020-11-16T20:55:56.188 INFO:tasks.rados.rados.0.smithi166.stdout:328: writing smithi16641208-328 from 1618553 to 2331316 tid 2 2020-11-16T20:55:56.195 INFO:tasks.rados.rados.0.smithi166.stdout:328: writing smithi16641208-328 from 2996848 to 3495889 tid 3 2020-11-16T20:55:56.195 INFO:tasks.rados.rados.0.smithi166.stdout:313: done (15 left) 2020-11-16T20:55:56.195 INFO:tasks.rados.rados.0.smithi166.stdout:329: write initial oid 329 2020-11-16T20:55:56.195 INFO:tasks.rados.rados.0.smithi166.stdout:329: seq_num 328 ranges {712696=484851,1960682=572774,3307918=204778} 2020-11-16T20:55:56.201 INFO:tasks.rados.rados.0.smithi166.stdout:329: writing smithi16641208-329 from 712696 to 1197547 tid 1 2020-11-16T20:55:56.209 INFO:tasks.rados.rados.0.smithi166.stdout:329: writing smithi16641208-329 from 1960682 to 2533456 tid 2 2020-11-16T20:55:56.215 INFO:tasks.rados.rados.0.smithi166.stdout:329: writing smithi16641208-329 from 3307918 to 3512696 tid 3 2020-11-16T20:55:56.215 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:56.215 INFO:tasks.rados.rados.0.smithi166.stdout:314: finishing write tid 5 to smithi16641208-314 2020-11-16T20:55:56.215 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 314 v 269 (ObjNum 313 snap 0 seq_num 313) dirty exists 2020-11-16T20:55:56.215 INFO:tasks.rados.rados.0.smithi166.stdout:314: left oid 314 (ObjNum 313 snap 0 seq_num 313) 2020-11-16T20:55:56.216 INFO:tasks.rados.rados.0.smithi166.stdout:314: done (15 left) 2020-11-16T20:55:56.216 INFO:tasks.rados.rados.0.smithi166.stdout:330: write initial oid 330 2020-11-16T20:55:56.216 INFO:tasks.rados.rados.0.smithi166.stdout:330: seq_num 329 ranges {729503=560100,2019164=716432,3335341=194162} 2020-11-16T20:55:56.222 INFO:tasks.rados.rados.0.smithi166.stdout:330: writing smithi16641208-330 from 729503 to 1289603 tid 1 2020-11-16T20:55:56.230 INFO:tasks.rados.rados.0.smithi166.stdout:330: writing smithi16641208-330 from 2019164 to 2735596 tid 2 2020-11-16T20:55:56.230 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:55:56.234+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:55:56.235 INFO:tasks.rados.rados.0.smithi166.stdout:330: writing smithi16641208-330 from 3335341 to 3529503 tid 3 2020-11-16T20:55:56.235 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:56.235 INFO:tasks.rados.rados.0.smithi166.stdout:315: finishing write tid 2 to smithi16641208-315 2020-11-16T20:55:56.235 INFO:tasks.rados.rados.0.smithi166.stdout:315: finishing write tid 3 to smithi16641208-315 2020-11-16T20:55:56.235 INFO:tasks.rados.rados.0.smithi166.stdout:315: finishing write tid 4 to smithi16641208-315 2020-11-16T20:55:56.236 INFO:tasks.rados.rados.0.smithi166.stdout:315: finishing write tid 5 to smithi16641208-315 2020-11-16T20:55:56.236 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 315 v 271 (ObjNum 314 snap 0 seq_num 314) dirty exists 2020-11-16T20:55:56.236 INFO:tasks.rados.rados.0.smithi166.stdout:315: left oid 315 (ObjNum 314 snap 0 seq_num 314) 2020-11-16T20:55:56.236 INFO:tasks.rados.rados.0.smithi166.stdout:316: finishing write tid 1 to smithi16641208-316 2020-11-16T20:55:56.236 INFO:tasks.rados.rados.0.smithi166.stdout:316: finishing write tid 2 to smithi16641208-316 2020-11-16T20:55:56.236 INFO:tasks.rados.rados.0.smithi166.stdout:316: finishing write tid 3 to smithi16641208-316 2020-11-16T20:55:56.236 INFO:tasks.rados.rados.0.smithi166.stdout:317: finishing write tid 1 to smithi16641208-317 2020-11-16T20:55:56.237 INFO:tasks.rados.rados.0.smithi166.stdout:315: done (15 left) 2020-11-16T20:55:56.237 INFO:tasks.rados.rados.0.smithi166.stdout:331: write initial oid 331 2020-11-16T20:55:56.237 INFO:tasks.rados.rados.0.smithi166.stdout:316: finishing write tid 4 to smithi16641208-316 2020-11-16T20:55:56.237 INFO:tasks.rados.rados.0.smithi166.stdout:316: finishing write tid 5 to smithi16641208-316 2020-11-16T20:55:56.237 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 316 v 190 (ObjNum 315 snap 0 seq_num 315) dirty exists 2020-11-16T20:55:56.237 INFO:tasks.rados.rados.0.smithi166.stdout:316: left oid 316 (ObjNum 315 snap 0 seq_num 315) 2020-11-16T20:55:56.237 INFO:tasks.rados.rados.0.smithi166.stdout:317: finishing write tid 2 to smithi16641208-317 2020-11-16T20:55:56.238 INFO:tasks.rados.rados.0.smithi166.stdout:317: finishing write tid 3 to smithi16641208-317 2020-11-16T20:55:56.238 INFO:tasks.rados.rados.0.smithi166.stdout:317: finishing write tid 4 to smithi16641208-317 2020-11-16T20:55:56.238 INFO:tasks.rados.rados.0.smithi166.stdout:317: finishing write tid 5 to smithi16641208-317 2020-11-16T20:55:56.238 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 317 v 193 (ObjNum 316 snap 0 seq_num 316) dirty exists 2020-11-16T20:55:56.238 INFO:tasks.rados.rados.0.smithi166.stdout:317: left oid 317 (ObjNum 316 snap 0 seq_num 316) 2020-11-16T20:55:56.238 INFO:tasks.rados.rados.0.smithi166.stdout:318: finishing write tid 1 to smithi16641208-318 2020-11-16T20:55:56.238 INFO:tasks.rados.rados.0.smithi166.stdout:318: finishing write tid 2 to smithi16641208-318 2020-11-16T20:55:56.238 INFO:tasks.rados.rados.0.smithi166.stdout:318: finishing write tid 3 to smithi16641208-318 2020-11-16T20:55:56.239 INFO:tasks.rados.rados.0.smithi166.stdout:318: finishing write tid 4 to smithi16641208-318 2020-11-16T20:55:56.239 INFO:tasks.rados.rados.0.smithi166.stdout:331: seq_num 330 ranges {746310=635349,2077646=576443,3362764=183546} 2020-11-16T20:55:56.240 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:55:56.242 INFO:tasks.rados.rados.0.smithi166.stdout:331: writing smithi16641208-331 from 746310 to 1381659 tid 1 2020-11-16T20:55:56.249 INFO:tasks.rados.rados.0.smithi166.stdout:331: writing smithi16641208-331 from 2077646 to 2654089 tid 2 2020-11-16T20:55:56.254 INFO:tasks.rados.rados.0.smithi166.stdout:331: writing smithi16641208-331 from 3362764 to 3546310 tid 3 2020-11-16T20:55:56.254 INFO:tasks.rados.rados.0.smithi166.stdout:316: done (15 left) 2020-11-16T20:55:56.255 INFO:tasks.rados.rados.0.smithi166.stdout:317: done (14 left) 2020-11-16T20:55:56.255 INFO:tasks.rados.rados.0.smithi166.stdout:332: write initial oid 332 2020-11-16T20:55:56.255 INFO:tasks.rados.rados.0.smithi166.stdout:332: seq_num 331 ranges {763117=710598,2136128=720101,3390187=172930} 2020-11-16T20:55:56.262 INFO:tasks.rados.rados.0.smithi166.stdout:332: writing smithi16641208-332 from 763117 to 1473715 tid 1 2020-11-16T20:55:56.271 INFO:tasks.rados.rados.0.smithi166.stdout:332: writing smithi16641208-332 from 2136128 to 2856229 tid 2 2020-11-16T20:55:56.275 INFO:tasks.rados.rados.0.smithi166.stdout:332: writing smithi16641208-332 from 3390187 to 3563117 tid 3 2020-11-16T20:55:56.275 INFO:tasks.rados.rados.0.smithi166.stdout:333: write initial oid 333 2020-11-16T20:55:56.275 INFO:tasks.rados.rados.0.smithi166.stdout:318: finishing write tid 5 to smithi16641208-318 2020-11-16T20:55:56.276 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 318 v 194 (ObjNum 317 snap 0 seq_num 317) dirty exists 2020-11-16T20:55:56.276 INFO:tasks.rados.rados.0.smithi166.stdout:318: left oid 318 (ObjNum 317 snap 0 seq_num 317) 2020-11-16T20:55:56.276 INFO:tasks.rados.rados.0.smithi166.stdout:333: seq_num 332 ranges {779924=785847,2078257=580112,3301257=278667} 2020-11-16T20:55:56.283 INFO:tasks.rados.rados.0.smithi166.stdout:333: writing smithi16641208-333 from 779924 to 1565771 tid 1 2020-11-16T20:55:56.290 INFO:tasks.rados.rados.0.smithi166.stdout:333: writing smithi16641208-333 from 2078257 to 2658369 tid 2 2020-11-16T20:55:56.295 INFO:tasks.rados.rados.0.smithi166.stdout:333: writing smithi16641208-333 from 3301257 to 3579924 tid 3 2020-11-16T20:55:56.295 INFO:tasks.rados.rados.0.smithi166.stdout:318: done (15 left) 2020-11-16T20:55:56.296 INFO:tasks.rados.rados.0.smithi166.stdout:334: write initial oid 334 2020-11-16T20:55:56.296 INFO:tasks.rados.rados.0.smithi166.stdout:334: seq_num 333 ranges {796731=461096,1736739=723770,2928680=668051} 2020-11-16T20:55:56.302 INFO:tasks.rados.rados.0.smithi166.stdout:334: writing smithi16641208-334 from 796731 to 1257827 tid 1 2020-11-16T20:55:56.309 INFO:tasks.rados.rados.0.smithi166.stdout:334: writing smithi16641208-334 from 1736739 to 2460509 tid 2 2020-11-16T20:55:56.314 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:55:56.314 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:55:56.314 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:55:56.315 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:55:56.315 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:55:56.316 INFO:tasks.rados.rados.0.smithi166.stdout:334: writing smithi16641208-334 from 2928680 to 3596731 tid 3 2020-11-16T20:55:56.316 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:56.317 INFO:tasks.rados.rados.0.smithi166.stdout:319: finishing write tid 1 to smithi16641208-319 2020-11-16T20:55:56.317 INFO:tasks.rados.rados.0.smithi166.stdout:319: finishing write tid 2 to smithi16641208-319 2020-11-16T20:55:56.317 INFO:tasks.rados.rados.0.smithi166.stdout:319: finishing write tid 3 to smithi16641208-319 2020-11-16T20:55:56.317 INFO:tasks.rados.rados.0.smithi166.stdout:319: finishing write tid 4 to smithi16641208-319 2020-11-16T20:55:56.317 INFO:tasks.rados.rados.0.smithi166.stdout:319: finishing write tid 5 to smithi16641208-319 2020-11-16T20:55:56.317 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 319 v 275 (ObjNum 318 snap 0 seq_num 318) dirty exists 2020-11-16T20:55:56.317 INFO:tasks.rados.rados.0.smithi166.stdout:319: left oid 319 (ObjNum 318 snap 0 seq_num 318) 2020-11-16T20:55:56.318 INFO:tasks.rados.rados.0.smithi166.stdout:320: finishing write tid 1 to smithi16641208-320 2020-11-16T20:55:56.318 INFO:tasks.rados.rados.0.smithi166.stdout:320: finishing write tid 2 to smithi16641208-320 2020-11-16T20:55:56.318 INFO:tasks.rados.rados.0.smithi166.stdout:320: finishing write tid 3 to smithi16641208-320 2020-11-16T20:55:56.318 INFO:tasks.rados.rados.0.smithi166.stdout:320: finishing write tid 4 to smithi16641208-320 2020-11-16T20:55:56.318 INFO:tasks.rados.rados.0.smithi166.stdout:320: finishing write tid 5 to smithi16641208-320 2020-11-16T20:55:56.318 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 320 v 224 (ObjNum 319 snap 0 seq_num 319) dirty exists 2020-11-16T20:55:56.318 INFO:tasks.rados.rados.0.smithi166.stdout:320: left oid 320 (ObjNum 319 snap 0 seq_num 319) 2020-11-16T20:55:56.319 INFO:tasks.rados.rados.0.smithi166.stdout:321: finishing write tid 1 to smithi16641208-321 2020-11-16T20:55:56.319 INFO:tasks.rados.rados.0.smithi166.stdout:321: finishing write tid 2 to smithi16641208-321 2020-11-16T20:55:56.319 INFO:tasks.rados.rados.0.smithi166.stdout:319: done (15 left) 2020-11-16T20:55:56.319 INFO:tasks.rados.rados.0.smithi166.stdout:320: done (14 left) 2020-11-16T20:55:56.319 INFO:tasks.rados.rados.0.smithi166.stdout:335: write initial oid 335 2020-11-16T20:55:56.319 INFO:tasks.rados.rados.0.smithi166.stdout:335: seq_num 334 ranges {413538=536345,1395221=583781,2556103=658617} 2020-11-16T20:55:56.321 INFO:tasks.rados.rados.0.smithi166.stdout:335: writing smithi16641208-335 from 413538 to 949883 tid 1 2020-11-16T20:55:56.325 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:55:56.327 INFO:tasks.rados.rados.0.smithi166.stdout:335: writing smithi16641208-335 from 1395221 to 1979002 tid 2 2020-11-16T20:55:56.330 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:55:56.334+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:55:56.334 INFO:tasks.rados.rados.0.smithi166.stdout:335: writing smithi16641208-335 from 2556103 to 3214720 tid 3 2020-11-16T20:55:56.335 INFO:tasks.rados.rados.0.smithi166.stdout:336: write initial oid 336 2020-11-16T20:55:56.335 INFO:tasks.rados.rados.0.smithi166.stdout:336: seq_num 335 ranges {430345=727947,1570056=727439,2699879=469889} 2020-11-16T20:55:56.341 INFO:tasks.rados.rados.0.smithi166.stdout:336: writing smithi16641208-336 from 430345 to 1158292 tid 1 2020-11-16T20:55:56.348 INFO:tasks.rados.rados.0.smithi166.stdout:336: writing smithi16641208-336 from 1570056 to 2297495 tid 2 2020-11-16T20:55:56.353 INFO:tasks.rados.rados.0.smithi166.stdout:336: writing smithi16641208-336 from 2699879 to 3169768 tid 3 2020-11-16T20:55:56.353 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:56.354 INFO:tasks.rados.rados.0.smithi166.stdout:321: finishing write tid 3 to smithi16641208-321 2020-11-16T20:55:56.354 INFO:tasks.rados.rados.0.smithi166.stdout:321: finishing write tid 4 to smithi16641208-321 2020-11-16T20:55:56.354 INFO:tasks.rados.rados.0.smithi166.stdout:322: finishing write tid 1 to smithi16641208-322 2020-11-16T20:55:56.354 INFO:tasks.rados.rados.0.smithi166.stdout:322: finishing write tid 2 to smithi16641208-322 2020-11-16T20:55:56.354 INFO:tasks.rados.rados.0.smithi166.stdout:321: finishing write tid 5 to smithi16641208-321 2020-11-16T20:55:56.354 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 321 v 225 (ObjNum 320 snap 0 seq_num 320) dirty exists 2020-11-16T20:55:56.354 INFO:tasks.rados.rados.0.smithi166.stdout:321: left oid 321 (ObjNum 320 snap 0 seq_num 320) 2020-11-16T20:55:56.355 INFO:tasks.rados.rados.0.smithi166.stdout:322: finishing write tid 3 to smithi16641208-322 2020-11-16T20:55:56.355 INFO:tasks.rados.rados.0.smithi166.stdout:321: done (15 left) 2020-11-16T20:55:56.355 INFO:tasks.rados.rados.0.smithi166.stdout:337: write initial oid 337 2020-11-16T20:55:56.355 INFO:tasks.rados.rados.0.smithi166.stdout:337: seq_num 336 ranges {447152=403196,1512185=587450,2727302=681161} 2020-11-16T20:55:56.358 INFO:tasks.rados.rados.0.smithi166.stdout:337: writing smithi16641208-337 from 447152 to 850348 tid 1 2020-11-16T20:55:56.365 INFO:tasks.rados.rados.0.smithi166.stdout:337: writing smithi16641208-337 from 1512185 to 2099635 tid 2 2020-11-16T20:55:56.373 INFO:tasks.rados.rados.0.smithi166.stdout:337: writing smithi16641208-337 from 2727302 to 3408463 tid 3 2020-11-16T20:55:56.373 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:56.373 INFO:tasks.rados.rados.0.smithi166.stdout:322: finishing write tid 4 to smithi16641208-322 2020-11-16T20:55:56.373 INFO:tasks.rados.rados.0.smithi166.stdout:323: finishing write tid 1 to smithi16641208-323 2020-11-16T20:55:56.373 INFO:tasks.rados.rados.0.smithi166.stdout:322: finishing write tid 5 to smithi16641208-322 2020-11-16T20:55:56.374 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 322 v 229 (ObjNum 321 snap 0 seq_num 321) dirty exists 2020-11-16T20:55:56.374 INFO:tasks.rados.rados.0.smithi166.stdout:322: left oid 322 (ObjNum 321 snap 0 seq_num 321) 2020-11-16T20:55:56.374 INFO:tasks.rados.rados.0.smithi166.stdout:323: finishing write tid 2 to smithi16641208-323 2020-11-16T20:55:56.374 INFO:tasks.rados.rados.0.smithi166.stdout:323: finishing write tid 3 to smithi16641208-323 2020-11-16T20:55:56.374 INFO:tasks.rados.rados.0.smithi166.stdout:323: finishing write tid 4 to smithi16641208-323 2020-11-16T20:55:56.374 INFO:tasks.rados.rados.0.smithi166.stdout:323: finishing write tid 5 to smithi16641208-323 2020-11-16T20:55:56.374 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 323 v 279 (ObjNum 322 snap 0 seq_num 322) dirty exists 2020-11-16T20:55:56.375 INFO:tasks.rados.rados.0.smithi166.stdout:323: left oid 323 (ObjNum 322 snap 0 seq_num 322) 2020-11-16T20:55:56.375 INFO:tasks.rados.rados.0.smithi166.stdout:322: done (15 left) 2020-11-16T20:55:56.375 INFO:tasks.rados.rados.0.smithi166.stdout:323: done (14 left) 2020-11-16T20:55:56.375 INFO:tasks.rados.rados.0.smithi166.stdout:338: write initial oid 338 2020-11-16T20:55:56.375 INFO:tasks.rados.rados.0.smithi166.stdout:338: seq_num 337 ranges {463959=478445,1570667=731108,3038372=492433} 2020-11-16T20:55:56.378 INFO:tasks.rados.rados.0.smithi166.stdout:338: writing smithi16641208-338 from 463959 to 942404 tid 1 2020-11-16T20:55:56.386 INFO:tasks.rados.rados.0.smithi166.stdout:338: writing smithi16641208-338 from 1570667 to 2301775 tid 2 2020-11-16T20:55:56.394 INFO:tasks.rados.rados.0.smithi166.stdout:338: writing smithi16641208-338 from 3038372 to 3530805 tid 3 2020-11-16T20:55:56.394 INFO:tasks.rados.rados.0.smithi166.stdout:339: write initial oid 339 2020-11-16T20:55:56.394 INFO:tasks.rados.rados.0.smithi166.stdout:339: seq_num 338 ranges {480766=553694,1629149=591119,2782148=420058} 2020-11-16T20:55:56.400 INFO:tasks.rados.rados.0.smithi166.stdout:339: writing smithi16641208-339 from 480766 to 1034460 tid 1 2020-11-16T20:55:56.408 INFO:tasks.rados.rados.0.smithi166.stdout:339: writing smithi16641208-339 from 1629149 to 2220268 tid 2 2020-11-16T20:55:56.414 INFO:tasks.rados.rados.0.smithi166.stdout:339: writing smithi16641208-339 from 2782148 to 3202206 tid 3 2020-11-16T20:55:56.415 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:56.415 INFO:tasks.rados.rados.0.smithi166.stdout:324: finishing write tid 1 to smithi16641208-324 2020-11-16T20:55:56.415 INFO:tasks.rados.rados.0.smithi166.stdout:324: finishing write tid 2 to smithi16641208-324 2020-11-16T20:55:56.415 INFO:tasks.rados.rados.0.smithi166.stdout:325: finishing write tid 1 to smithi16641208-325 2020-11-16T20:55:56.415 INFO:tasks.rados.rados.0.smithi166.stdout:324: finishing write tid 3 to smithi16641208-324 2020-11-16T20:55:56.415 INFO:tasks.rados.rados.0.smithi166.stdout:324: finishing write tid 4 to smithi16641208-324 2020-11-16T20:55:56.415 INFO:tasks.rados.rados.0.smithi166.stdout:325: finishing write tid 2 to smithi16641208-325 2020-11-16T20:55:56.416 INFO:tasks.rados.rados.0.smithi166.stdout:324: finishing write tid 5 to smithi16641208-324 2020-11-16T20:55:56.416 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 324 v 198 (ObjNum 323 snap 0 seq_num 323) dirty exists 2020-11-16T20:55:56.416 INFO:tasks.rados.rados.0.smithi166.stdout:324: left oid 324 (ObjNum 323 snap 0 seq_num 323) 2020-11-16T20:55:56.416 INFO:tasks.rados.rados.0.smithi166.stdout:325: finishing write tid 3 to smithi16641208-325 2020-11-16T20:55:56.416 INFO:tasks.rados.rados.0.smithi166.stdout:324: done (15 left) 2020-11-16T20:55:56.416 INFO:tasks.rados.rados.0.smithi166.stdout:340: write initial oid 340 2020-11-16T20:55:56.416 INFO:tasks.rados.rados.0.smithi166.stdout:340: seq_num 339 ranges {497573=628943,1687631=734777,3093218=604355} 2020-11-16T20:55:56.421 INFO:tasks.rados.rados.0.smithi166.stdout:340: writing smithi16641208-340 from 497573 to 1126516 tid 1 2020-11-16T20:55:56.424 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:55:56.428 INFO:tasks.rados.rados.0.smithi166.stdout:340: writing smithi16641208-340 from 1687631 to 2422408 tid 2 2020-11-16T20:55:56.431 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:55:56.434+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:55:56.436 INFO:tasks.rados.rados.0.smithi166.stdout:340: writing smithi16641208-340 from 3093218 to 3697573 tid 3 2020-11-16T20:55:56.436 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:55:56.436 INFO:tasks.rados.rados.0.smithi166.stdout:325: finishing write tid 4 to smithi16641208-325 2020-11-16T20:55:56.436 INFO:tasks.rados.rados.0.smithi166.stdout:325: finishing write tid 5 to smithi16641208-325 2020-11-16T20:55:56.437 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 325 v 283 (ObjNum 324 snap 0 seq_num 324) dirty exists 2020-11-16T20:55:56.437 INFO:tasks.rados.rados.0.smithi166.stdout:325: left oid 325 (ObjNum 324 snap 0 seq_num 324) 2020-11-16T20:55:56.437 INFO:tasks.rados.rados.0.smithi166.stdout:326: finishing write tid 1 to smithi16641208-326 2020-11-16T20:55:56.437 INFO:tasks.rados.rados.0.smithi166.stdout:326: finishing write tid 2 to smithi16641208-326 2020-11-16T20:55:56.437 INFO:tasks.rados.rados.0.smithi166.stdout:326: finishing write tid 3 to smithi16641208-326 2020-11-16T20:55:56.437 INFO:tasks.rados.rados.0.smithi166.stdout:326: finishing write tid 4 to smithi16641208-326 2020-11-16T20:55:56.437 INFO:tasks.rados.rados.0.smithi166.stdout:326: finishing write tid 5 to smithi16641208-326 2020-11-16T20:55:56.437 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 326 v 200 (ObjNum 325 snap 0 seq_num 325) dirty exists 2020-11-16T20:55:56.438 INFO:tasks.rados.rados.0.smithi166.stdout:326: left oid 326 (ObjNum 325 snap 0 seq_num 325) 2020-11-16T20:55:56.438 INFO:tasks.rados.rados.0.smithi166.stdout:327: finishing write tid 1 to smithi16641208-327 2020-11-16T20:55:56.438 INFO:tasks.rados.rados.0.smithi166.stdout:327: finishing write tid 2 to smithi16641208-327 2020-11-16T20:55:56.438 INFO:tasks.rados.rados.0.smithi166.stdout:327: finishing write tid 3 to smithi16641208-327 2020-11-16T20:55:56.438 INFO:tasks.rados.rados.0.smithi166.stdout:327: finishing write tid 4 to smithi16641208-327 2020-11-16T20:55:56.438 INFO:tasks.rados.rados.0.smithi166.stdout:327: finishing write tid 5 to smithi16641208-327 2020-11-16T20:55:56.438 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 327 v 233 (ObjNum 326 snap 0 seq_num 326) dirty exists 2020-11-16T20:55:56.439 INFO:tasks.rados.rados.0.smithi166.stdout:327: left oid 327 (ObjNum 326 snap 0 seq_num 326) 2020-11-16T20:55:56.439 INFO:tasks.rados.rados.0.smithi166.stdout:328: finishing write tid 1 to smithi16641208-328 2020-11-16T20:55:56.439 INFO:tasks.rados.rados.0.smithi166.stdout:328: finishing write tid 2 to smithi16641208-328 2020-11-16T20:55:56.439 INFO:tasks.rados.rados.0.smithi166.stdout:328: finishing write tid 3 to smithi16641208-328 2020-11-16T20:55:56.439 INFO:tasks.rados.rados.0.smithi166.stdout:328: finishing write tid 4 to smithi16641208-328 2020-11-16T20:55:56.439 INFO:tasks.rados.rados.0.smithi166.stdout:328: finishing write tid 5 to smithi16641208-328 2020-11-16T20:55:56.439 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 328 v 237 (ObjNum 327 snap 0 seq_num 327) dirty exists 2020-11-16T20:55:56.440 INFO:tasks.rados.rados.0.smithi166.stdout:328: left oid 328 (ObjNum 327 snap 0 seq_num 327) 2020-11-16T20:55:56.440 INFO:tasks.rados.rados.0.smithi166.stdout:329: finishing write tid 1 to smithi16641208-329 2020-11-16T20:55:56.440 INFO:tasks.rados.rados.0.smithi166.stdout:329: finishing write tid 2 to smithi16641208-329 2020-11-16T20:55:56.440 INFO:tasks.rados.rados.0.smithi166.stdout:329: finishing write tid 3 to smithi16641208-329 2020-11-16T20:55:56.440 INFO:tasks.rados.rados.0.smithi166.stdout:329: finishing write tid 4 to smithi16641208-329 2020-11-16T20:55:56.440 INFO:tasks.rados.rados.0.smithi166.stdout:329: finishing write tid 5 to smithi16641208-329 2020-11-16T20:55:56.440 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 329 v 241 (ObjNum 328 snap 0 seq_num 328) dirty exists 2020-11-16T20:55:56.440 INFO:tasks.rados.rados.0.smithi166.stdout:329: left oid 329 (ObjNum 328 snap 0 seq_num 328) 2020-11-16T20:55:56.441 INFO:tasks.rados.rados.0.smithi166.stdout:330: finishing write tid 1 to smithi16641208-330 2020-11-16T20:55:56.441 INFO:tasks.rados.rados.0.smithi166.stdout:330: finishing write tid 2 to smithi16641208-330 2020-11-16T20:55:56.441 INFO:tasks.rados.rados.0.smithi166.stdout:330: finishing write tid 3 to smithi16641208-330 2020-11-16T20:55:56.441 INFO:tasks.rados.rados.0.smithi166.stdout:330: finishing write tid 4 to smithi16641208-330 2020-11-16T20:55:56.441 INFO:tasks.rados.rados.0.smithi166.stdout:330: finishing write tid 5 to smithi16641208-330 2020-11-16T20:55:56.441 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 330 v 245 (ObjNum 329 snap 0 seq_num 329) dirty exists 2020-11-16T20:55:56.441 INFO:tasks.rados.rados.0.smithi166.stdout:330: left oid 330 (ObjNum 329 snap 0 seq_num 329) 2020-11-16T20:55:56.442 INFO:tasks.rados.rados.0.smithi166.stdout:325: done (15 left) 2020-11-16T20:55:56.442 INFO:tasks.rados.rados.0.smithi166.stdout:326: done (14 left) 2020-11-16T20:55:56.442 INFO:tasks.rados.rados.0.smithi166.stdout:327: done (13 left) 2020-11-16T20:55:56.442 INFO:tasks.rados.rados.0.smithi166.stdout:328: done (12 left) 2020-11-16T20:55:56.442 INFO:tasks.rados.rados.0.smithi166.stdout:329: done (11 left) 2020-11-16T20:55:56.442 INFO:tasks.rados.rados.0.smithi166.stdout:330: done (10 left) 2020-11-16T20:55:56.442 INFO:tasks.rados.rados.0.smithi166.stdout:341: write initial oid 341 2020-11-16T20:55:56.442 INFO:tasks.rados.rados.0.smithi166.stdout:341: seq_num 340 ranges {514380=704192,1629760=478435,2604288=442602} 2020-11-16T20:55:56.443 INFO:tasks.rados.rados.0.smithi166.stdout:341: writing smithi16641208-341 from 514380 to 1218572 tid 1 2020-11-16T20:55:56.447 INFO:tasks.rados.rados.0.smithi166.stdout:341: writing smithi16641208-341 from 1629760 to 2108195 tid 2 2020-11-16T20:55:56.447 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:55:56.452 INFO:tasks.rados.rados.0.smithi166.stdout:341: writing smithi16641208-341 from 2604288 to 3046890 tid 3 2020-11-16T20:55:56.453 INFO:tasks.rados.rados.0.smithi166.stdout:342: write initial oid 342 2020-11-16T20:55:56.453 INFO:tasks.rados.rados.0.smithi166.stdout:342: seq_num 341 ranges {531187=779441,2088242=738446,3431711=299476} 2020-11-16T20:55:56.460 INFO:tasks.rados.rados.0.smithi166.stdout:342: writing smithi16641208-342 from 531187 to 1310628 tid 1 2020-11-16T20:55:56.468 INFO:tasks.rados.rados.0.smithi166.stdout:342: writing smithi16641208-342 from 2088242 to 2826688 tid 2 2020-11-16T20:55:56.470 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:55:56.474 INFO:tasks.rados.rados.0.smithi166.stdout:342: writing smithi16641208-342 from 3431711 to 3731187 tid 3 2020-11-16T20:55:56.474 INFO:tasks.rados.rados.0.smithi166.stdout:331: finishing write tid 1 to smithi16641208-331 2020-11-16T20:55:56.474 INFO:tasks.rados.rados.0.smithi166.stdout:343: write initial oid 343 2020-11-16T20:55:56.474 INFO:tasks.rados.rados.0.smithi166.stdout:343: seq_num 342 ranges {547994=454690,1746724=482104,2659134=465146,3605976=142018} 2020-11-16T20:56:00.723 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2020-11-16T20:56:00.724 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:56:00.724 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:56:00.724 INFO:tasks.thrashosds.thrasher:inject_pause on 5 2020-11-16T20:56:00.724 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2020-11-16T20:56:00.724 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2020-11-16T20:56:00.725 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2020-11-16T20:56:00.808 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:00.808 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:56:00.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:56:00.808 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:56:00.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.809 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2 4.1 4:9ab04c4a:::smithi16641208-1:head [write 1542129~474678] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:56:00.809 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:50.908568+0000", 2020-11-16T20:56:00.809 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.5740258889999996, 2020-11-16T20:56:00.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021914067999999998, 2020-11-16T20:56:00.809 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:00.809 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:00.809 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:00.810 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:00.810 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:00.810 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2 2020-11-16T20:56:00.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.810 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:00.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:00.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.908568+0000", 2020-11-16T20:56:00.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:00.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:00.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.908568+0000", 2020-11-16T20:56:00.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00088228000000000004 2020-11-16T20:56:00.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:00.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909450+0000", 2020-11-16T20:56:00.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3519999999999999e-05 2020-11-16T20:56:00.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:00.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909463+0000", 2020-11-16T20:56:00.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7048e-05 2020-11-16T20:56:00.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:00.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909481+0000", 2020-11-16T20:56:00.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9990000000000002e-06 2020-11-16T20:56:00.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:00.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909488+0000", 2020-11-16T20:56:00.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3529000000000003e-05 2020-11-16T20:56:00.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909531+0000", 2020-11-16T20:56:00.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3068000000000001e-05 2020-11-16T20:56:00.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:00.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909584+0000", 2020-11-16T20:56:00.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014302456999999999 2020-11-16T20:56:00.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.923887+0000", 2020-11-16T20:56:00.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000106143 2020-11-16T20:56:00.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:00.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.923993+0000", 2020-11-16T20:56:00.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013497100000000001 2020-11-16T20:56:00.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:00.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.924128+0000", 2020-11-16T20:56:00.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004911655 2020-11-16T20:56:00.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:00.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.929039+0000", 2020-11-16T20:56:00.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010511899999999999 2020-11-16T20:56:00.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:00.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.929144+0000", 2020-11-16T20:56:00.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012105729999999999 2020-11-16T20:56:00.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:00.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.930355+0000", 2020-11-16T20:56:00.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0148000000000007e-05 2020-11-16T20:56:00.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:00.820 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.930425+0000", 2020-11-16T20:56:00.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6558000000000003e-05 2020-11-16T20:56:00.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:00.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.930482+0000", 2020-11-16T20:56:00.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021914067999999998 2020-11-16T20:56:00.821 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.821 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:00.821 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.822 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3 4.1 4:9ab04c4a:::smithi16641208-1:head [setxattr _header (55) in=7b,truncate 2016807] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:56:00.822 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:50.909532+0000", 2020-11-16T20:56:00.822 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.5730618019999998, 2020-11-16T20:56:00.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021063467999999998, 2020-11-16T20:56:00.822 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:00.822 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:00.823 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:00.823 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:00.823 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:00.823 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3 2020-11-16T20:56:00.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.823 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:00.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:00.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909532+0000", 2020-11-16T20:56:00.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:00.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:00.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909532+0000", 2020-11-16T20:56:00.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4731000000000003e-05 2020-11-16T20:56:00.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:00.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909577+0000", 2020-11-16T20:56:00.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4577e-05 2020-11-16T20:56:00.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:00.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909591+0000", 2020-11-16T20:56:00.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1420000000000001e-05 2020-11-16T20:56:00.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:00.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909603+0000", 2020-11-16T20:56:00.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7830000000000004e-06 2020-11-16T20:56:00.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:00.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909608+0000", 2020-11-16T20:56:00.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000192685 2020-11-16T20:56:00.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909801+0000", 2020-11-16T20:56:00.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0266000000000003e-05 2020-11-16T20:56:00.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:00.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909851+0000", 2020-11-16T20:56:00.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015280820000000001 2020-11-16T20:56:00.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.925132+0000", 2020-11-16T20:56:00.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3510999999999995e-05 2020-11-16T20:56:00.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:00.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.925206+0000", 2020-11-16T20:56:00.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5099999999999994e-05 2020-11-16T20:56:00.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:00.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.925301+0000", 2020-11-16T20:56:00.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0038318240000000002 2020-11-16T20:56:00.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:00.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.929132+0000", 2020-11-16T20:56:00.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8430000000000001e-05 2020-11-16T20:56:00.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:00.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.929151+0000", 2020-11-16T20:56:00.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0013663670000000001 2020-11-16T20:56:00.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:00.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.930517+0000", 2020-11-16T20:56:00.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6217999999999998e-05 2020-11-16T20:56:00.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:00.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.930554+0000", 2020-11-16T20:56:00.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1736000000000002e-05 2020-11-16T20:56:00.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:00.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.930595+0000", 2020-11-16T20:56:00.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021063467999999998 2020-11-16T20:56:00.835 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.835 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:00.835 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.835 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:4 4.1 4:9ab04c4a:::smithi16641208-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:56:00.836 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:50.909649+0000", 2020-11-16T20:56:00.836 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.5729445359999996, 2020-11-16T20:56:00.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023768465999999999, 2020-11-16T20:56:00.836 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:00.836 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:00.836 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:00.836 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:00.836 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:00.837 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 4 2020-11-16T20:56:00.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.837 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:00.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:00.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909649+0000", 2020-11-16T20:56:00.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:00.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:00.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909649+0000", 2020-11-16T20:56:00.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0568000000000003e-05 2020-11-16T20:56:00.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:00.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909680+0000", 2020-11-16T20:56:00.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1929999999999998e-06 2020-11-16T20:56:00.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:00.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909686+0000", 2020-11-16T20:56:00.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2179e-05 2020-11-16T20:56:00.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:00.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909698+0000", 2020-11-16T20:56:00.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2190000000000003e-06 2020-11-16T20:56:00.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:00.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909703+0000", 2020-11-16T20:56:00.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030855599999999998 2020-11-16T20:56:00.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.910012+0000", 2020-11-16T20:56:00.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5745000000000003e-05 2020-11-16T20:56:00.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:00.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.910058+0000", 2020-11-16T20:56:00.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015477383000000001 2020-11-16T20:56:00.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.925535+0000", 2020-11-16T20:56:00.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012808700000000001 2020-11-16T20:56:00.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:00.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.925663+0000", 2020-11-16T20:56:00.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049709960000000001 2020-11-16T20:56:00.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.930634+0000", 2020-11-16T20:56:00.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022177000000000001 2020-11-16T20:56:00.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:00.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.930856+0000", 2020-11-16T20:56:00.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0025617700000000001 2020-11-16T20:56:00.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:00.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.933418+0000", 2020-11-16T20:56:00.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023768465999999999 2020-11-16T20:56:00.846 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.846 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:00.846 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.846 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:58 4.1 4:a4a335f7:::smithi16641208-15:head [write 2069689~165609] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:56:00.847 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.081169+0000", 2020-11-16T20:56:00.847 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.4014246779999997, 2020-11-16T20:56:00.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016764563, 2020-11-16T20:56:00.847 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:00.847 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:00.847 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:00.847 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:00.848 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:00.848 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 58 2020-11-16T20:56:00.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.848 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:00.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:00.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.081169+0000", 2020-11-16T20:56:00.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:00.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:00.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.081169+0000", 2020-11-16T20:56:00.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018155600000000001 2020-11-16T20:56:00.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:00.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.081350+0000", 2020-11-16T20:56:00.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8670000000000002e-06 2020-11-16T20:56:00.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:00.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.081355+0000", 2020-11-16T20:56:00.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.96e-06 2020-11-16T20:56:00.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:00.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.081363+0000", 2020-11-16T20:56:00.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4610000000000001e-06 2020-11-16T20:56:00.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:00.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.081368+0000", 2020-11-16T20:56:00.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1174999999999998e-05 2020-11-16T20:56:00.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.081409+0000", 2020-11-16T20:56:00.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6449e-05 2020-11-16T20:56:00.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:00.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.081475+0000", 2020-11-16T20:56:00.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067914639999999997 2020-11-16T20:56:00.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.088267+0000", 2020-11-16T20:56:00.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000155482 2020-11-16T20:56:00.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:00.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.088422+0000", 2020-11-16T20:56:00.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019984000000000001 2020-11-16T20:56:00.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:00.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.088622+0000", 2020-11-16T20:56:00.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0086678929999999994 2020-11-16T20:56:00.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:00.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.097290+0000", 2020-11-16T20:56:00.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029699199999999999 2020-11-16T20:56:00.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:00.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.097587+0000", 2020-11-16T20:56:00.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000231881 2020-11-16T20:56:00.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:00.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.097819+0000", 2020-11-16T20:56:00.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8405999999999995e-05 2020-11-16T20:56:00.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:00.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.097887+0000", 2020-11-16T20:56:00.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6137000000000002e-05 2020-11-16T20:56:00.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:00.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.097933+0000", 2020-11-16T20:56:00.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016764563 2020-11-16T20:56:00.859 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.859 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:00.859 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.859 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:60 4.1 4:a4a335f7:::smithi16641208-15:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:56:00.860 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.081449+0000", 2020-11-16T20:56:00.860 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.4011449259999997, 2020-11-16T20:56:00.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017035185000000001, 2020-11-16T20:56:00.860 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:00.860 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:00.860 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:00.860 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:00.861 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:00.861 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 60 2020-11-16T20:56:00.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.861 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:00.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:00.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.081449+0000", 2020-11-16T20:56:00.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:00.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:00.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.081449+0000", 2020-11-16T20:56:00.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7405999999999999e-05 2020-11-16T20:56:00.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:00.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.081466+0000", 2020-11-16T20:56:00.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.196e-06 2020-11-16T20:56:00.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:00.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.081469+0000", 2020-11-16T20:56:00.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9390000000000002e-06 2020-11-16T20:56:00.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:00.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.081475+0000", 2020-11-16T20:56:00.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8619999999999999e-06 2020-11-16T20:56:00.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:00.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.081478+0000", 2020-11-16T20:56:00.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9196000000000004e-05 2020-11-16T20:56:00.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.081577+0000", 2020-11-16T20:56:00.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1239999999999997e-05 2020-11-16T20:56:00.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:00.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.081628+0000", 2020-11-16T20:56:00.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082266720000000008 2020-11-16T20:56:00.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.089855+0000", 2020-11-16T20:56:00.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014089300000000001 2020-11-16T20:56:00.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:00.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.089996+0000", 2020-11-16T20:56:00.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0081853150000000003 2020-11-16T20:56:00.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.098181+0000", 2020-11-16T20:56:00.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8588e-05 2020-11-16T20:56:00.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:00.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.098270+0000", 2020-11-16T20:56:00.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000213878 2020-11-16T20:56:00.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:00.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.098484+0000", 2020-11-16T20:56:00.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017035185000000001 2020-11-16T20:56:00.870 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.870 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:00.870 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.870 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:183 4.1 4:b6545a47:::smithi16641208-46:head [setxattr _header (56) in=7b,truncate 2756315] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:56:00.871 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.502988+0000", 2020-11-16T20:56:00.871 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9796051439999998, 2020-11-16T20:56:00.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029750506999999999, 2020-11-16T20:56:00.871 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:00.871 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:00.871 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:00.871 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:00.872 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:00.872 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 183 2020-11-16T20:56:00.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.872 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:00.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:00.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.502988+0000", 2020-11-16T20:56:00.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:00.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:00.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.502988+0000", 2020-11-16T20:56:00.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4046e-05 2020-11-16T20:56:00.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:00.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503012+0000", 2020-11-16T20:56:00.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1219999999999999e-06 2020-11-16T20:56:00.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:00.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503016+0000", 2020-11-16T20:56:00.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8220000000000003e-06 2020-11-16T20:56:00.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:00.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503021+0000", 2020-11-16T20:56:00.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.689e-06 2020-11-16T20:56:00.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:00.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503024+0000", 2020-11-16T20:56:00.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024917599999999999 2020-11-16T20:56:00.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503273+0000", 2020-11-16T20:56:00.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2070999999999998e-05 2020-11-16T20:56:00.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:00.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503315+0000", 2020-11-16T20:56:00.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015620333 2020-11-16T20:56:00.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518936+0000", 2020-11-16T20:56:00.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014316700000000001 2020-11-16T20:56:00.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:00.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519079+0000", 2020-11-16T20:56:00.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000106921 2020-11-16T20:56:00.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:00.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519186+0000", 2020-11-16T20:56:00.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01291979 2020-11-16T20:56:00.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:00.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532106+0000", 2020-11-16T20:56:00.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00037033699999999999 2020-11-16T20:56:00.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.881 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:00.881 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532476+0000", 2020-11-16T20:56:00.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018681700000000001 2020-11-16T20:56:00.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.881 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:00.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532663+0000", 2020-11-16T20:56:00.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0011e-05 2020-11-16T20:56:00.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:00.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532703+0000", 2020-11-16T20:56:00.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6205000000000003e-05 2020-11-16T20:56:00.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:00.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532739+0000", 2020-11-16T20:56:00.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029750506999999999 2020-11-16T20:56:00.883 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.883 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:00.883 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.884 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:184 4.1 4:b6545a47:::smithi16641208-46:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:56:00.884 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.503052+0000", 2020-11-16T20:56:00.884 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9795415360000002, 2020-11-16T20:56:00.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032452030999999999, 2020-11-16T20:56:00.884 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:00.884 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:00.885 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:00.885 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:00.885 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:00.885 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 184 2020-11-16T20:56:00.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.885 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:00.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:00.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503052+0000", 2020-11-16T20:56:00.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:00.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:00.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503052+0000", 2020-11-16T20:56:00.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7108999999999998e-05 2020-11-16T20:56:00.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:00.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503069+0000", 2020-11-16T20:56:00.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2590000000000001e-06 2020-11-16T20:56:00.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.888 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:00.888 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503072+0000", 2020-11-16T20:56:00.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3119999999999999e-06 2020-11-16T20:56:00.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.888 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:00.888 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503079+0000", 2020-11-16T20:56:00.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6520000000000002e-06 2020-11-16T20:56:00.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:00.889 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503081+0000", 2020-11-16T20:56:00.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000263331 2020-11-16T20:56:00.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.890 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.890 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503345+0000", 2020-11-16T20:56:00.890 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9370000000000002e-05 2020-11-16T20:56:00.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.890 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:00.891 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503404+0000", 2020-11-16T20:56:00.891 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016025681999999999 2020-11-16T20:56:00.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.891 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.891 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519430+0000", 2020-11-16T20:56:00.891 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114862 2020-11-16T20:56:00.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.892 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.892 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:00.892 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519545+0000", 2020-11-16T20:56:00.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013224174 2020-11-16T20:56:00.892 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.892 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.892 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.893 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532769+0000", 2020-11-16T20:56:00.893 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5945000000000006e-05 2020-11-16T20:56:00.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:00.893 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532845+0000", 2020-11-16T20:56:00.893 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0026593350000000001 2020-11-16T20:56:00.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.894 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.894 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:00.894 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.535504+0000", 2020-11-16T20:56:00.894 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032452030999999999 2020-11-16T20:56:00.894 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.894 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:00.894 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.895 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.895 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:186 4.1 4:81558809:::smithi16641208-47:head [write 1992054~651681] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:56:00.895 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.517420+0000", 2020-11-16T20:56:00.895 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9651734640000003, 2020-11-16T20:56:00.895 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020789111999999998, 2020-11-16T20:56:00.895 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:00.895 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:00.896 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:00.896 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:00.896 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:00.896 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 186 2020-11-16T20:56:00.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.896 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:00.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.897 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:00.897 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.517420+0000", 2020-11-16T20:56:00.897 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:00.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.897 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.897 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:00.897 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.517420+0000", 2020-11-16T20:56:00.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00095766700000000005 2020-11-16T20:56:00.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.898 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:00.898 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518378+0000", 2020-11-16T20:56:00.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5520000000000005e-06 2020-11-16T20:56:00.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.899 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:00.899 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518386+0000", 2020-11-16T20:56:00.899 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6719e-05 2020-11-16T20:56:00.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.899 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.899 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:00.899 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518403+0000", 2020-11-16T20:56:00.900 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1780000000000001e-05 2020-11-16T20:56:00.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.900 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.900 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:00.900 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518415+0000", 2020-11-16T20:56:00.900 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0065288209999999998 2020-11-16T20:56:00.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.524944+0000", 2020-11-16T20:56:00.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8589000000000001e-05 2020-11-16T20:56:00.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:00.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.525042+0000", 2020-11-16T20:56:00.902 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011179300000000001 2020-11-16T20:56:00.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.902 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:00.902 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.525154+0000", 2020-11-16T20:56:00.902 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010486807000000001 2020-11-16T20:56:00.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.903 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:00.903 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.535641+0000", 2020-11-16T20:56:00.903 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002288478 2020-11-16T20:56:00.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.903 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:00.903 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.537929+0000", 2020-11-16T20:56:00.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017148 2020-11-16T20:56:00.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:00.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.538101+0000", 2020-11-16T20:56:00.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2397999999999994e-05 2020-11-16T20:56:00.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.905 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:00.905 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.538163+0000", 2020-11-16T20:56:00.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6028e-05 2020-11-16T20:56:00.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.905 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:00.905 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.538209+0000", 2020-11-16T20:56:00.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020789111999999998 2020-11-16T20:56:00.906 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.906 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:00.906 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.906 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:187 4.1 4:81558809:::smithi16641208-47:head [setxattr _header (56) in=7b,truncate 2773122] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:56:00.906 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.518465+0000", 2020-11-16T20:56:00.907 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9641285039999996, 2020-11-16T20:56:00.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019854842000000001, 2020-11-16T20:56:00.907 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:00.907 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:00.907 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:00.907 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:00.907 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:00.908 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 187 2020-11-16T20:56:00.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.908 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:00.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.908 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:00.908 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518465+0000", 2020-11-16T20:56:00.908 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:00.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.909 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:00.909 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518465+0000", 2020-11-16T20:56:00.909 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4765999999999998e-05 2020-11-16T20:56:00.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:00.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518510+0000", 2020-11-16T20:56:00.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2600000000000002e-06 2020-11-16T20:56:00.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:00.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518516+0000", 2020-11-16T20:56:00.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1122e-05 2020-11-16T20:56:00.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.911 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:00.911 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518527+0000", 2020-11-16T20:56:00.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.041e-06 2020-11-16T20:56:00.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.912 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:00.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518534+0000", 2020-11-16T20:56:00.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01181623 2020-11-16T20:56:00.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.912 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.530350+0000", 2020-11-16T20:56:00.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000122574 2020-11-16T20:56:00.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.913 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:00.913 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.530473+0000", 2020-11-16T20:56:00.913 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013381499999999999 2020-11-16T20:56:00.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:00.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.530607+0000", 2020-11-16T20:56:00.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050979880000000003 2020-11-16T20:56:00.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:00.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.535705+0000", 2020-11-16T20:56:00.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0022644829999999999 2020-11-16T20:56:00.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.915 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:00.915 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.537969+0000", 2020-11-16T20:56:00.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027665600000000002 2020-11-16T20:56:00.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:00.916 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.538246+0000", 2020-11-16T20:56:00.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6341000000000003e-05 2020-11-16T20:56:00.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:00.916 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.538282+0000", 2020-11-16T20:56:00.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7565999999999999e-05 2020-11-16T20:56:00.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.917 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:00.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.538320+0000", 2020-11-16T20:56:00.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019854842000000001 2020-11-16T20:56:00.918 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.918 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:00.918 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.918 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:188 4.1 4:81558809:::smithi16641208-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:56:00.918 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.518571+0000", 2020-11-16T20:56:00.919 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9640226580000002, 2020-11-16T20:56:00.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020188205000000001, 2020-11-16T20:56:00.919 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:00.919 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:00.919 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:00.919 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:00.919 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:00.920 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 188 2020-11-16T20:56:00.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.920 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:00.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.920 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:00.921 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518571+0000", 2020-11-16T20:56:00.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:00.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.922 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:00.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518571+0000", 2020-11-16T20:56:00.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0468999999999999e-05 2020-11-16T20:56:00.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:00.923 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518601+0000", 2020-11-16T20:56:00.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8640000000000001e-06 2020-11-16T20:56:00.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:00.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518607+0000", 2020-11-16T20:56:00.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0756e-05 2020-11-16T20:56:00.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.925 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:00.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518618+0000", 2020-11-16T20:56:00.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.707e-06 2020-11-16T20:56:00.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:00.926 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518623+0000", 2020-11-16T20:56:00.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012452283 2020-11-16T20:56:00.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.531075+0000", 2020-11-16T20:56:00.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3591999999999995e-05 2020-11-16T20:56:00.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:00.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.531159+0000", 2020-11-16T20:56:00.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0071979870000000003 2020-11-16T20:56:00.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.538357+0000", 2020-11-16T20:56:00.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000130765 2020-11-16T20:56:00.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:00.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.538487+0000", 2020-11-16T20:56:00.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027178199999999998 2020-11-16T20:56:00.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.931 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:00.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.538759+0000", 2020-11-16T20:56:00.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020188205000000001 2020-11-16T20:56:00.931 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.931 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:00.931 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.932 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:190 4.1 4:9bd9f31d:::smithi16641208-48:head [write 2050536~739393] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:56:00.932 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.533224+0000", 2020-11-16T20:56:00.932 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9493696690000002, 2020-11-16T20:56:00.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020522064999999999, 2020-11-16T20:56:00.932 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:00.933 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:00.933 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:00.933 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:00.933 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:00.933 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 190 2020-11-16T20:56:00.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.933 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:00.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:00.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.533224+0000", 2020-11-16T20:56:00.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:00.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:00.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.533224+0000", 2020-11-16T20:56:00.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00081165199999999995 2020-11-16T20:56:00.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:00.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534036+0000", 2020-11-16T20:56:00.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1900000000000003e-06 2020-11-16T20:56:00.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:00.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534041+0000", 2020-11-16T20:56:00.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.696e-06 2020-11-16T20:56:00.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:00.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534050+0000", 2020-11-16T20:56:00.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.553e-06 2020-11-16T20:56:00.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:00.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534056+0000", 2020-11-16T20:56:00.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014711769999999999 2020-11-16T20:56:00.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.535527+0000", 2020-11-16T20:56:00.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5160000000000002e-05 2020-11-16T20:56:00.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:00.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.535562+0000", 2020-11-16T20:56:00.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0093947040000000002 2020-11-16T20:56:00.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.544957+0000", 2020-11-16T20:56:00.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0178000000000003e-05 2020-11-16T20:56:00.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:00.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.545047+0000", 2020-11-16T20:56:00.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111687 2020-11-16T20:56:00.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:00.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.545159+0000", 2020-11-16T20:56:00.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008033419 2020-11-16T20:56:00.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:00.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.553192+0000", 2020-11-16T20:56:00.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000232372 2020-11-16T20:56:00.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.942 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:00.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.553425+0000", 2020-11-16T20:56:00.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024492399999999999 2020-11-16T20:56:00.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:00.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.553670+0000", 2020-11-16T20:56:00.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8164000000000002e-05 2020-11-16T20:56:00.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:00.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.553718+0000", 2020-11-16T20:56:00.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8189000000000001e-05 2020-11-16T20:56:00.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:00.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.553746+0000", 2020-11-16T20:56:00.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020522064999999999 2020-11-16T20:56:00.946 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.946 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:00.946 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.947 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:191 4.1 4:9bd9f31d:::smithi16641208-48:head [setxattr _header (56) in=7b,truncate 2789929] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:56:00.947 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.534076+0000", 2020-11-16T20:56:00.947 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9485177839999999, 2020-11-16T20:56:00.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019848184000000001, 2020-11-16T20:56:00.947 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:00.948 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:00.948 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:00.948 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:00.948 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:00.949 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 191 2020-11-16T20:56:00.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.949 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:00.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:00.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534076+0000", 2020-11-16T20:56:00.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:00.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:00.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534076+0000", 2020-11-16T20:56:00.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2396999999999999e-05 2020-11-16T20:56:00.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:00.952 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534098+0000", 2020-11-16T20:56:00.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2200000000000001e-06 2020-11-16T20:56:00.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.952 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:00.952 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534101+0000", 2020-11-16T20:56:00.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4469999999999997e-06 2020-11-16T20:56:00.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.953 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.953 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:00.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534107+0000", 2020-11-16T20:56:00.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6110000000000001e-06 2020-11-16T20:56:00.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:00.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534109+0000", 2020-11-16T20:56:00.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0016345800000000001 2020-11-16T20:56:00.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.535744+0000", 2020-11-16T20:56:00.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2768e-05 2020-11-16T20:56:00.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:00.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.535797+0000", 2020-11-16T20:56:00.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010322687000000001 2020-11-16T20:56:00.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.546120+0000", 2020-11-16T20:56:00.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7729000000000001e-05 2020-11-16T20:56:00.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:00.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.546197+0000", 2020-11-16T20:56:00.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010100800000000001 2020-11-16T20:56:00.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:00.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.546298+0000", 2020-11-16T20:56:00.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070115330000000003 2020-11-16T20:56:00.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:00.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.553310+0000", 2020-11-16T20:56:00.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019339300000000001 2020-11-16T20:56:00.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:00.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.553503+0000", 2020-11-16T20:56:00.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027218199999999999 2020-11-16T20:56:00.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:00.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.553775+0000", 2020-11-16T20:56:00.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1480000000000002e-05 2020-11-16T20:56:00.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:00.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.553827+0000", 2020-11-16T20:56:00.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7149000000000001e-05 2020-11-16T20:56:00.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:00.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.553924+0000", 2020-11-16T20:56:00.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019848184000000001 2020-11-16T20:56:00.962 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.963 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:00.963 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.964 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:192 4.1 4:9bd9f31d:::smithi16641208-48:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:56:00.964 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.534127+0000", 2020-11-16T20:56:00.964 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9484669090000004, 2020-11-16T20:56:00.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020369108, 2020-11-16T20:56:00.964 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:00.964 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:00.965 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:00.965 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:00.965 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:00.965 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 192 2020-11-16T20:56:00.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.965 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:00.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:00.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534127+0000", 2020-11-16T20:56:00.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:00.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:00.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534127+0000", 2020-11-16T20:56:00.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4786e-05 2020-11-16T20:56:00.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:00.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534141+0000", 2020-11-16T20:56:00.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9780000000000001e-06 2020-11-16T20:56:00.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:00.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534144+0000", 2020-11-16T20:56:00.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8170000000000004e-06 2020-11-16T20:56:00.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:00.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534150+0000", 2020-11-16T20:56:00.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.277e-06 2020-11-16T20:56:00.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:00.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534153+0000", 2020-11-16T20:56:00.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001673892 2020-11-16T20:56:00.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.535826+0000", 2020-11-16T20:56:00.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9031e-05 2020-11-16T20:56:00.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:00.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.535855+0000", 2020-11-16T20:56:00.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010653924 2020-11-16T20:56:00.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.546509+0000", 2020-11-16T20:56:00.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0140000000000002e-05 2020-11-16T20:56:00.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:00.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.546590+0000", 2020-11-16T20:56:00.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073883509999999996 2020-11-16T20:56:00.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.553978+0000", 2020-11-16T20:56:00.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000133027 2020-11-16T20:56:00.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:00.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.554111+0000", 2020-11-16T20:56:00.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00038488500000000001 2020-11-16T20:56:00.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:00.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.554496+0000", 2020-11-16T20:56:00.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020369108 2020-11-16T20:56:00.974 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.974 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:00.974 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.975 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:1004 4.1 4:be507de1:::smithi16641208-224:head [setxattr _header (57) in=7b,truncate 3747961] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:00.975 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.532969+0000", 2020-11-16T20:56:00.975 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.949624963, 2020-11-16T20:56:00.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024559619000000001, 2020-11-16T20:56:00.975 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:00.975 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:00.976 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:00.976 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:00.976 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:00.976 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1004 2020-11-16T20:56:00.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.976 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:00.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:00.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.532969+0000", 2020-11-16T20:56:00.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:00.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:00.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.532969+0000", 2020-11-16T20:56:00.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2059999999999999e-05 2020-11-16T20:56:00.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:00.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.532991+0000", 2020-11-16T20:56:00.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1200000000000002e-06 2020-11-16T20:56:00.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:00.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.532994+0000", 2020-11-16T20:56:00.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4489999999999998e-06 2020-11-16T20:56:00.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:00.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.532999+0000", 2020-11-16T20:56:00.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6879999999999999e-06 2020-11-16T20:56:00.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:00.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.533002+0000", 2020-11-16T20:56:00.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030528899999999998 2020-11-16T20:56:00.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.533307+0000", 2020-11-16T20:56:00.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0117000000000006e-05 2020-11-16T20:56:00.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:00.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.533387+0000", 2020-11-16T20:56:00.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016762563000000001 2020-11-16T20:56:00.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.550150+0000", 2020-11-16T20:56:00.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000167782 2020-11-16T20:56:00.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:00.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.550318+0000", 2020-11-16T20:56:00.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000200127 2020-11-16T20:56:00.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:00.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.550518+0000", 2020-11-16T20:56:00.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060820880000000003 2020-11-16T20:56:00.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:00.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.556600+0000", 2020-11-16T20:56:00.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00076796999999999998 2020-11-16T20:56:00.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:00.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.557368+0000", 2020-11-16T20:56:00.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5091e-05 2020-11-16T20:56:00.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:00.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.557403+0000", 2020-11-16T20:56:00.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1698000000000003e-05 2020-11-16T20:56:00.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:00.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.557485+0000", 2020-11-16T20:56:00.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3577e-05 2020-11-16T20:56:00.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:00.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.557528+0000", 2020-11-16T20:56:00.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024559619000000001 2020-11-16T20:56:00.987 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.987 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:00.987 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.988 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:1005 4.1 4:be507de1:::smithi16641208-224:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:56:00.988 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.533021+0000", 2020-11-16T20:56:00.988 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.949572087, 2020-11-16T20:56:00.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026389474, 2020-11-16T20:56:00.988 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:00.989 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:00.989 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:00.989 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:00.989 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:00.989 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1005 2020-11-16T20:56:00.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.989 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:00.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:00.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.533021+0000", 2020-11-16T20:56:00.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:00.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:00.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.533021+0000", 2020-11-16T20:56:00.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4973e-05 2020-11-16T20:56:00.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:00.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.533036+0000", 2020-11-16T20:56:00.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.005e-06 2020-11-16T20:56:00.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:00.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.533039+0000", 2020-11-16T20:56:00.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8259999999999998e-06 2020-11-16T20:56:00.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:00.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.533045+0000", 2020-11-16T20:56:00.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.599e-06 2020-11-16T20:56:00.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:00.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.533048+0000", 2020-11-16T20:56:00.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000366127 2020-11-16T20:56:00.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.533414+0000", 2020-11-16T20:56:00.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6974999999999998e-05 2020-11-16T20:56:00.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:00.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.533451+0000", 2020-11-16T20:56:00.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017437446999999998 2020-11-16T20:56:00.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.550888+0000", 2020-11-16T20:56:00.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000125792 2020-11-16T20:56:00.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:00.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.551014+0000", 2020-11-16T20:56:00.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0065486909999999997 2020-11-16T20:56:00.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:00.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.557563+0000", 2020-11-16T20:56:00.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9114000000000002e-05 2020-11-16T20:56:00.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:00.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.557642+0000", 2020-11-16T20:56:00.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001768925 2020-11-16T20:56:00.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:00.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.559411+0000", 2020-11-16T20:56:00.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026389474 2020-11-16T20:56:00.998 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.998 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:00.998 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:00.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:00.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:00.999 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:1010 4.1 4:b0e01256:::smithi16641208-225:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:56:00.999 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.553023+0000", 2020-11-16T20:56:00.999 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.9295709480000001, 2020-11-16T20:56:01.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027571351000000001, 2020-11-16T20:56:01.000 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:01.000 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:01.001 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:01.001 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:01.001 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:01.001 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1010 2020-11-16T20:56:01.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.002 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:01.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:01.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.553023+0000", 2020-11-16T20:56:01.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:01.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:01.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.553023+0000", 2020-11-16T20:56:01.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5097e-05 2020-11-16T20:56:01.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:01.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.553038+0000", 2020-11-16T20:56:01.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7530000000000002e-06 2020-11-16T20:56:01.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:01.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.553040+0000", 2020-11-16T20:56:01.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5899999999999998e-06 2020-11-16T20:56:01.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:01.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.553046+0000", 2020-11-16T20:56:01.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4040000000000002e-06 2020-11-16T20:56:01.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:01.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.553048+0000", 2020-11-16T20:56:01.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000325762 2020-11-16T20:56:01.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:01.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.553374+0000", 2020-11-16T20:56:01.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2778999999999999e-05 2020-11-16T20:56:01.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:01.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.553407+0000", 2020-11-16T20:56:01.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016312167999999998 2020-11-16T20:56:01.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:01.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.569719+0000", 2020-11-16T20:56:01.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016948000000000001 2020-11-16T20:56:01.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:01.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.569889+0000", 2020-11-16T20:56:01.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0092219190000000003 2020-11-16T20:56:01.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:01.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.579111+0000", 2020-11-16T20:56:01.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3689999999999994e-05 2020-11-16T20:56:01.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:01.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.579184+0000", 2020-11-16T20:56:01.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014097090000000001 2020-11-16T20:56:01.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:01.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.580594+0000", 2020-11-16T20:56:01.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027571351000000001 2020-11-16T20:56:01.015 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:01.015 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:01.016 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:01.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.016 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:1395 4.1 4:90f27223:::smithi16641208-314:head [write 2729279~440140] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:01.016 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:55.932164+0000", 2020-11-16T20:56:01.016 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.55042963, 2020-11-16T20:56:01.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020447857999999999, 2020-11-16T20:56:01.017 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:01.017 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:01.017 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:01.017 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:01.017 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:01.017 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1395 2020-11-16T20:56:01.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.018 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:01.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:01.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932164+0000", 2020-11-16T20:56:01.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:01.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:01.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932164+0000", 2020-11-16T20:56:01.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00040945199999999998 2020-11-16T20:56:01.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:01.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932573+0000", 2020-11-16T20:56:01.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2610000000000001e-06 2020-11-16T20:56:01.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:01.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932579+0000", 2020-11-16T20:56:01.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2048999999999999e-05 2020-11-16T20:56:01.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:01.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932591+0000", 2020-11-16T20:56:01.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1419999999999998e-06 2020-11-16T20:56:01.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:01.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932597+0000", 2020-11-16T20:56:01.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6355e-05 2020-11-16T20:56:01.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:01.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932633+0000", 2020-11-16T20:56:01.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9140999999999997e-05 2020-11-16T20:56:01.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:01.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932672+0000", 2020-11-16T20:56:01.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012168481 2020-11-16T20:56:01.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:01.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.944841+0000", 2020-11-16T20:56:01.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000151595 2020-11-16T20:56:01.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:01.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.944992+0000", 2020-11-16T20:56:01.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000181187 2020-11-16T20:56:01.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:01.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.945174+0000", 2020-11-16T20:56:01.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0065972560000000001 2020-11-16T20:56:01.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:01.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.951771+0000", 2020-11-16T20:56:01.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000478849 2020-11-16T20:56:01.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:01.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.952250+0000", 2020-11-16T20:56:01.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023924100000000001 2020-11-16T20:56:01.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:01.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.952489+0000", 2020-11-16T20:56:01.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7015999999999997e-05 2020-11-16T20:56:01.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:01.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.952556+0000", 2020-11-16T20:56:01.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5832999999999999e-05 2020-11-16T20:56:01.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.028 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:01.028 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.952612+0000", 2020-11-16T20:56:01.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020447857999999999 2020-11-16T20:56:01.028 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:01.028 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:01.028 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:01.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.029 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:1396 4.1 4:90f27223:::smithi16641208-314:head [setxattr _header (57) in=7b,truncate 3260591] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:01.029 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:55.932620+0000", 2020-11-16T20:56:01.029 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.54997370199999995, 2020-11-16T20:56:01.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020116397000000001, 2020-11-16T20:56:01.029 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:01.030 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:01.030 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:01.030 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:01.030 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:01.030 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1396 2020-11-16T20:56:01.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.030 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:01.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:01.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932620+0000", 2020-11-16T20:56:01.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:01.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:01.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932620+0000", 2020-11-16T20:56:01.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4824000000000002e-05 2020-11-16T20:56:01.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:01.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932645+0000", 2020-11-16T20:56:01.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.241e-06 2020-11-16T20:56:01.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.033 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:01.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932648+0000", 2020-11-16T20:56:01.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6099999999999997e-06 2020-11-16T20:56:01.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.033 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:01.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932654+0000", 2020-11-16T20:56:01.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.405e-06 2020-11-16T20:56:01.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:01.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932657+0000", 2020-11-16T20:56:01.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2293000000000003e-05 2020-11-16T20:56:01.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:01.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932699+0000", 2020-11-16T20:56:01.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2019000000000003e-05 2020-11-16T20:56:01.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:01.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932771+0000", 2020-11-16T20:56:01.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01338723 2020-11-16T20:56:01.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:01.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.946158+0000", 2020-11-16T20:56:01.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016052699999999999 2020-11-16T20:56:01.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:01.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.946319+0000", 2020-11-16T20:56:01.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000182404 2020-11-16T20:56:01.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:01.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.946501+0000", 2020-11-16T20:56:01.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053645849999999998 2020-11-16T20:56:01.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:01.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.951866+0000", 2020-11-16T20:56:01.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00042421599999999999 2020-11-16T20:56:01.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:01.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.952290+0000", 2020-11-16T20:56:01.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00036755700000000002 2020-11-16T20:56:01.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:01.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.952658+0000", 2020-11-16T20:56:01.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1888999999999998e-05 2020-11-16T20:56:01.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:01.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.952700+0000", 2020-11-16T20:56:01.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6597000000000002e-05 2020-11-16T20:56:01.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:01.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.952736+0000", 2020-11-16T20:56:01.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020116397000000001 2020-11-16T20:56:01.041 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:01.041 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:01.041 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:01.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.042 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:1397 4.1 4:90f27223:::smithi16641208-314:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:56:01.042 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:55.932676+0000", 2020-11-16T20:56:01.042 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.54991788799999997, 2020-11-16T20:56:01.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020566254999999999, 2020-11-16T20:56:01.042 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:01.042 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:01.042 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:01.043 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:01.043 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:01.043 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1397 2020-11-16T20:56:01.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.043 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:01.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:01.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932676+0000", 2020-11-16T20:56:01.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:01.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:01.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932676+0000", 2020-11-16T20:56:01.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5418e-05 2020-11-16T20:56:01.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:01.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932691+0000", 2020-11-16T20:56:01.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4599999999999999e-06 2020-11-16T20:56:01.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:01.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932695+0000", 2020-11-16T20:56:01.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8589999999999994e-06 2020-11-16T20:56:01.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:01.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932703+0000", 2020-11-16T20:56:01.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9999999999999998e-06 2020-11-16T20:56:01.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:01.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932707+0000", 2020-11-16T20:56:01.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2159999999999999e-05 2020-11-16T20:56:01.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:01.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932800+0000", 2020-11-16T20:56:01.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4050000000000001e-05 2020-11-16T20:56:01.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:01.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932834+0000", 2020-11-16T20:56:01.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014268094 2020-11-16T20:56:01.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.049 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:01.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.947102+0000", 2020-11-16T20:56:01.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011844 2020-11-16T20:56:01.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.049 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:01.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.947220+0000", 2020-11-16T20:56:01.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055706100000000001 2020-11-16T20:56:01.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.050 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:01.050 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.952791+0000", 2020-11-16T20:56:01.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000143843 2020-11-16T20:56:01.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.051 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:01.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.952935+0000", 2020-11-16T20:56:01.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030732099999999999 2020-11-16T20:56:01.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.051 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:01.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.953242+0000", 2020-11-16T20:56:01.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020566254999999999 2020-11-16T20:56:01.052 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:01.052 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:01.052 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:01.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.052 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:308 4.2 e36/22 4:6c6ed246:::smithi16641208-316:head v 36'89, mlcod=35'87)", 2020-11-16T20:56:01.053 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:55.977367+0000", 2020-11-16T20:56:01.053 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.50522655100000002, 2020-11-16T20:56:01.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016911609000000001, 2020-11-16T20:56:01.053 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:01.053 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:01.053 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:01.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.053 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:01.054 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.977367+0000", 2020-11-16T20:56:01.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:01.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.054 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:01.054 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.977367+0000", 2020-11-16T20:56:01.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056716259999999999 2020-11-16T20:56:01.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:01.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.983039+0000", 2020-11-16T20:56:01.055 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1566000000000001e-05 2020-11-16T20:56:01.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:01.056 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.983050+0000", 2020-11-16T20:56:01.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7226000000000001e-05 2020-11-16T20:56:01.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.056 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:01.056 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.983067+0000", 2020-11-16T20:56:01.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0988999999999999e-05 2020-11-16T20:56:01.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:01.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.983078+0000", 2020-11-16T20:56:01.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3957999999999997e-05 2020-11-16T20:56:01.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:01.058 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.983172+0000", 2020-11-16T20:56:01.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3204999999999998e-05 2020-11-16T20:56:01.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.058 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:01.058 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.983206+0000", 2020-11-16T20:56:01.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011012348 2020-11-16T20:56:01.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.059 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:01.059 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.994218+0000", 2020-11-16T20:56:01.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0690999999999999e-05 2020-11-16T20:56:01.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:01.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:01.059 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:01.060 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.994279+0000", 2020-11-16T20:56:01.060 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016911609000000001 2020-11-16T20:56:01.060 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:01.060 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:01.060 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:01.060 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:01.060 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:01.060 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:01.061 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:56:01.062 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:00.727+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:01.062 INFO:tasks.rados.rados.0.smithi166.stdout:343: writing smithi16641208-343 from 547994 to 1002684 tid 1 2020-11-16T20:56:01.062 INFO:tasks.rados.rados.0.smithi166.stdout:343: writing smithi16641208-343 from 1746724 to 2228828 tid 2 2020-11-16T20:56:01.062 INFO:tasks.rados.rados.0.smithi166.stdout:343: writing smithi16641208-343 from 2659134 to 3124280 tid 3 2020-11-16T20:56:01.063 INFO:tasks.rados.rados.0.smithi166.stdout:343: writing smithi16641208-343 from 3605976 to 3747994 tid 4 2020-11-16T20:56:01.063 INFO:tasks.rados.rados.0.smithi166.stdout:344: write initial oid 344 2020-11-16T20:56:01.063 INFO:tasks.rados.rados.0.smithi166.stdout:331: finishing write tid 2 to smithi16641208-331 2020-11-16T20:56:01.063 INFO:tasks.rados.rados.0.smithi166.stdout:344: seq_num 343 ranges {564801=646292,1921559=742115,3202910=561891} 2020-11-16T20:56:01.063 INFO:tasks.rados.rados.0.smithi166.stdout:344: writing smithi16641208-344 from 564801 to 1211093 tid 1 2020-11-16T20:56:01.063 INFO:tasks.rados.rados.0.smithi166.stdout:344: writing smithi16641208-344 from 1921559 to 2663674 tid 2 2020-11-16T20:56:01.063 INFO:tasks.rados.rados.0.smithi166.stdout:344: writing smithi16641208-344 from 3202910 to 3764801 tid 3 2020-11-16T20:56:01.064 INFO:tasks.rados.rados.0.smithi166.stdout:345: write initial oid 345 2020-11-16T20:56:01.064 INFO:tasks.rados.rados.0.smithi166.stdout:345: seq_num 344 ranges {581608=721541,1863688=485773,3113980=604043} 2020-11-16T20:56:01.064 INFO:tasks.rados.rados.0.smithi166.stdout:345: writing smithi16641208-345 from 581608 to 1303149 tid 1 2020-11-16T20:56:01.064 INFO:tasks.rados.rados.0.smithi166.stdout:345: writing smithi16641208-345 from 1863688 to 2349461 tid 2 2020-11-16T20:56:01.064 INFO:tasks.rados.rados.0.smithi166.stdout:345: writing smithi16641208-345 from 3113980 to 3718023 tid 3 2020-11-16T20:56:01.064 INFO:tasks.rados.rados.0.smithi166.stdout:346: write initial oid 346 2020-11-16T20:56:01.064 INFO:tasks.rados.rados.0.smithi166.stdout:346: seq_num 345 ranges {598415=796790,1922170=745784,3141403=415315} 2020-11-16T20:56:01.065 INFO:tasks.rados.rados.0.smithi166.stdout:346: writing smithi16641208-346 from 598415 to 1395205 tid 1 2020-11-16T20:56:01.065 INFO:tasks.rados.rados.0.smithi166.stdout:346: writing smithi16641208-346 from 1922170 to 2667954 tid 2 2020-11-16T20:56:01.065 INFO:tasks.rados.rados.0.smithi166.stdout:346: writing smithi16641208-346 from 3141403 to 3556718 tid 3 2020-11-16T20:56:01.065 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.065 INFO:tasks.rados.rados.0.smithi166.stdout:331: finishing write tid 3 to smithi16641208-331 2020-11-16T20:56:01.065 INFO:tasks.rados.rados.0.smithi166.stdout:331: finishing write tid 4 to smithi16641208-331 2020-11-16T20:56:01.065 INFO:tasks.rados.rados.0.smithi166.stdout:331: finishing write tid 5 to smithi16641208-331 2020-11-16T20:56:01.065 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 331 v 249 (ObjNum 330 snap 0 seq_num 330) dirty exists 2020-11-16T20:56:01.066 INFO:tasks.rados.rados.0.smithi166.stdout:331: left oid 331 (ObjNum 330 snap 0 seq_num 330) 2020-11-16T20:56:01.066 INFO:tasks.rados.rados.0.smithi166.stdout:332: finishing write tid 1 to smithi16641208-332 2020-11-16T20:56:01.066 INFO:tasks.rados.rados.0.smithi166.stdout:332: finishing write tid 2 to smithi16641208-332 2020-11-16T20:56:01.066 INFO:tasks.rados.rados.0.smithi166.stdout:332: finishing write tid 3 to smithi16641208-332 2020-11-16T20:56:01.066 INFO:tasks.rados.rados.0.smithi166.stdout:332: finishing write tid 4 to smithi16641208-332 2020-11-16T20:56:01.066 INFO:tasks.rados.rados.0.smithi166.stdout:332: finishing write tid 5 to smithi16641208-332 2020-11-16T20:56:01.066 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 332 v 204 (ObjNum 331 snap 0 seq_num 331) dirty exists 2020-11-16T20:56:01.067 INFO:tasks.rados.rados.0.smithi166.stdout:332: left oid 332 (ObjNum 331 snap 0 seq_num 331) 2020-11-16T20:56:01.067 INFO:tasks.rados.rados.0.smithi166.stdout:333: finishing write tid 1 to smithi16641208-333 2020-11-16T20:56:01.067 INFO:tasks.rados.rados.0.smithi166.stdout:333: finishing write tid 2 to smithi16641208-333 2020-11-16T20:56:01.067 INFO:tasks.rados.rados.0.smithi166.stdout:333: finishing write tid 3 to smithi16641208-333 2020-11-16T20:56:01.067 INFO:tasks.rados.rados.0.smithi166.stdout:333: finishing write tid 4 to smithi16641208-333 2020-11-16T20:56:01.067 INFO:tasks.rados.rados.0.smithi166.stdout:333: finishing write tid 5 to smithi16641208-333 2020-11-16T20:56:01.067 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 333 v 253 (ObjNum 332 snap 0 seq_num 332) dirty exists 2020-11-16T20:56:01.068 INFO:tasks.rados.rados.0.smithi166.stdout:333: left oid 333 (ObjNum 332 snap 0 seq_num 332) 2020-11-16T20:56:01.068 INFO:tasks.rados.rados.0.smithi166.stdout:334: finishing write tid 1 to smithi16641208-334 2020-11-16T20:56:01.068 INFO:tasks.rados.rados.0.smithi166.stdout:334: finishing write tid 2 to smithi16641208-334 2020-11-16T20:56:01.068 INFO:tasks.rados.rados.0.smithi166.stdout:331: done (15 left) 2020-11-16T20:56:01.068 INFO:tasks.rados.rados.0.smithi166.stdout:332: done (14 left) 2020-11-16T20:56:01.068 INFO:tasks.rados.rados.0.smithi166.stdout:333: done (13 left) 2020-11-16T20:56:01.068 INFO:tasks.rados.rados.0.smithi166.stdout:347: write initial oid 347 2020-11-16T20:56:01.069 INFO:tasks.rados.rados.0.smithi166.stdout:347: seq_num 346 ranges {615222=472039,1580652=489442,2768826=626587} 2020-11-16T20:56:01.069 INFO:tasks.rados.rados.0.smithi166.stdout:347: writing smithi16641208-347 from 615222 to 1087261 tid 1 2020-11-16T20:56:01.069 INFO:tasks.rados.rados.0.smithi166.stdout:347: writing smithi16641208-347 from 1580652 to 2070094 tid 2 2020-11-16T20:56:01.069 INFO:tasks.rados.rados.0.smithi166.stdout:347: writing smithi16641208-347 from 2768826 to 3395413 tid 3 2020-11-16T20:56:01.069 INFO:tasks.rados.rados.0.smithi166.stdout:348: write initial oid 348 2020-11-16T20:56:01.069 INFO:tasks.rados.rados.0.smithi166.stdout:348: seq_num 347 ranges {632029=547288,1639134=749453,2796249=437859,3653524=178505} 2020-11-16T20:56:01.069 INFO:tasks.rados.rados.0.smithi166.stdout:348: writing smithi16641208-348 from 632029 to 1179317 tid 1 2020-11-16T20:56:01.069 INFO:tasks.rados.rados.0.smithi166.stdout:348: writing smithi16641208-348 from 1639134 to 2388587 tid 2 2020-11-16T20:56:01.070 INFO:tasks.rados.rados.0.smithi166.stdout:348: writing smithi16641208-348 from 2796249 to 3234108 tid 3 2020-11-16T20:56:01.070 INFO:tasks.rados.rados.0.smithi166.stdout:348: writing smithi16641208-348 from 3653524 to 3832029 tid 4 2020-11-16T20:56:01.070 INFO:tasks.rados.rados.0.smithi166.stdout:349: write initial oid 349 2020-11-16T20:56:01.070 INFO:tasks.rados.rados.0.smithi166.stdout:349: seq_num 348 ranges {648836=622537,1981263=493111,3107319=741517} 2020-11-16T20:56:01.070 INFO:tasks.rados.rados.0.smithi166.stdout:349: writing smithi16641208-349 from 648836 to 1271373 tid 1 2020-11-16T20:56:01.070 INFO:tasks.rados.rados.0.smithi166.stdout:349: writing smithi16641208-349 from 1981263 to 2474374 tid 2 2020-11-16T20:56:01.070 INFO:tasks.rados.rados.0.smithi166.stdout:349: writing smithi16641208-349 from 3107319 to 3848836 tid 3 2020-11-16T20:56:01.071 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.071 INFO:tasks.rados.rados.0.smithi166.stdout:334: finishing write tid 3 to smithi16641208-334 2020-11-16T20:56:01.071 INFO:tasks.rados.rados.0.smithi166.stdout:334: finishing write tid 4 to smithi16641208-334 2020-11-16T20:56:01.071 INFO:tasks.rados.rados.0.smithi166.stdout:334: finishing write tid 5 to smithi16641208-334 2020-11-16T20:56:01.071 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 334 v 257 (ObjNum 333 snap 0 seq_num 333) dirty exists 2020-11-16T20:56:01.071 INFO:tasks.rados.rados.0.smithi166.stdout:334: left oid 334 (ObjNum 333 snap 0 seq_num 333) 2020-11-16T20:56:01.071 INFO:tasks.rados.rados.0.smithi166.stdout:335: finishing write tid 1 to smithi16641208-335 2020-11-16T20:56:01.072 INFO:tasks.rados.rados.0.smithi166.stdout:335: finishing write tid 2 to smithi16641208-335 2020-11-16T20:56:01.072 INFO:tasks.rados.rados.0.smithi166.stdout:335: finishing write tid 3 to smithi16641208-335 2020-11-16T20:56:01.072 INFO:tasks.rados.rados.0.smithi166.stdout:335: finishing write tid 4 to smithi16641208-335 2020-11-16T20:56:01.072 INFO:tasks.rados.rados.0.smithi166.stdout:335: finishing write tid 5 to smithi16641208-335 2020-11-16T20:56:01.072 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 335 v 238 (ObjNum 334 snap 0 seq_num 334) dirty exists 2020-11-16T20:56:01.072 INFO:tasks.rados.rados.0.smithi166.stdout:335: left oid 335 (ObjNum 334 snap 0 seq_num 334) 2020-11-16T20:56:01.072 INFO:tasks.rados.rados.0.smithi166.stdout:336: finishing write tid 1 to smithi16641208-336 2020-11-16T20:56:01.072 INFO:tasks.rados.rados.0.smithi166.stdout:336: finishing write tid 2 to smithi16641208-336 2020-11-16T20:56:01.073 INFO:tasks.rados.rados.0.smithi166.stdout:336: finishing write tid 3 to smithi16641208-336 2020-11-16T20:56:01.073 INFO:tasks.rados.rados.0.smithi166.stdout:336: finishing write tid 4 to smithi16641208-336 2020-11-16T20:56:01.073 INFO:tasks.rados.rados.0.smithi166.stdout:336: finishing write tid 5 to smithi16641208-336 2020-11-16T20:56:01.073 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 336 v 242 (ObjNum 335 snap 0 seq_num 335) dirty exists 2020-11-16T20:56:01.073 INFO:tasks.rados.rados.0.smithi166.stdout:336: left oid 336 (ObjNum 335 snap 0 seq_num 335) 2020-11-16T20:56:01.073 INFO:tasks.rados.rados.0.smithi166.stdout:334: done (15 left) 2020-11-16T20:56:01.073 INFO:tasks.rados.rados.0.smithi166.stdout:335: done (14 left) 2020-11-16T20:56:01.074 INFO:tasks.rados.rados.0.smithi166.stdout:336: done (13 left) 2020-11-16T20:56:01.074 INFO:tasks.rados.rados.0.smithi166.stdout:350: write initial oid 350 2020-11-16T20:56:01.074 INFO:tasks.rados.rados.0.smithi166.stdout:350: seq_num 349 ranges {665643=697786,2039745=753122,3534742=330901} 2020-11-16T20:56:01.074 INFO:tasks.rados.rados.0.smithi166.stdout:350: writing smithi16641208-350 from 665643 to 1363429 tid 1 2020-11-16T20:56:01.074 INFO:tasks.rados.rados.0.smithi166.stdout:350: writing smithi16641208-350 from 2039745 to 2792867 tid 2 2020-11-16T20:56:01.074 INFO:tasks.rados.rados.0.smithi166.stdout:350: writing smithi16641208-350 from 3534742 to 3865643 tid 3 2020-11-16T20:56:01.074 INFO:tasks.rados.rados.0.smithi166.stdout:351: write initial oid 351 2020-11-16T20:56:01.074 INFO:tasks.rados.rados.0.smithi166.stdout:351: seq_num 350 ranges {682450=489388,1814580=496780,2878518=788028} 2020-11-16T20:56:01.075 INFO:tasks.rados.rados.0.smithi166.stdout:351: writing smithi16641208-351 from 682450 to 1171838 tid 1 2020-11-16T20:56:01.075 INFO:tasks.rados.rados.0.smithi166.stdout:351: writing smithi16641208-351 from 1814580 to 2311360 tid 2 2020-11-16T20:56:01.075 INFO:tasks.rados.rados.0.smithi166.stdout:351: writing smithi16641208-351 from 2878518 to 3666546 tid 3 2020-11-16T20:56:01.075 INFO:tasks.rados.rados.0.smithi166.stdout:352: write initial oid 352 2020-11-16T20:56:01.075 INFO:tasks.rados.rados.0.smithi166.stdout:352: seq_num 351 ranges {699257=564637,1873062=640438,3305941=593316} 2020-11-16T20:56:01.075 INFO:tasks.rados.rados.0.smithi166.stdout:352: writing smithi16641208-352 from 699257 to 1263894 tid 1 2020-11-16T20:56:01.075 INFO:tasks.rados.rados.0.smithi166.stdout:352: writing smithi16641208-352 from 1873062 to 2513500 tid 2 2020-11-16T20:56:01.076 INFO:tasks.rados.rados.0.smithi166.stdout:352: writing smithi16641208-352 from 3305941 to 3899257 tid 3 2020-11-16T20:56:01.076 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.076 INFO:tasks.rados.rados.0.smithi166.stdout:337: finishing write tid 1 to smithi16641208-337 2020-11-16T20:56:01.076 INFO:tasks.rados.rados.0.smithi166.stdout:337: finishing write tid 2 to smithi16641208-337 2020-11-16T20:56:01.076 INFO:tasks.rados.rados.0.smithi166.stdout:337: finishing write tid 3 to smithi16641208-337 2020-11-16T20:56:01.076 INFO:tasks.rados.rados.0.smithi166.stdout:337: finishing write tid 4 to smithi16641208-337 2020-11-16T20:56:01.076 INFO:tasks.rados.rados.0.smithi166.stdout:337: finishing write tid 5 to smithi16641208-337 2020-11-16T20:56:01.076 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 337 v 261 (ObjNum 336 snap 0 seq_num 336) dirty exists 2020-11-16T20:56:01.077 INFO:tasks.rados.rados.0.smithi166.stdout:337: left oid 337 (ObjNum 336 snap 0 seq_num 336) 2020-11-16T20:56:01.077 INFO:tasks.rados.rados.0.smithi166.stdout:338: finishing write tid 1 to smithi16641208-338 2020-11-16T20:56:01.077 INFO:tasks.rados.rados.0.smithi166.stdout:337: done (15 left) 2020-11-16T20:56:01.077 INFO:tasks.rados.rados.0.smithi166.stdout:353: write initial oid 353 2020-11-16T20:56:01.077 INFO:tasks.rados.rados.0.smithi166.stdout:353: seq_num 352 ranges {716064=639886,1815191=500449,2817011=526925} 2020-11-16T20:56:01.077 INFO:tasks.rados.rados.0.smithi166.stdout:353: writing smithi16641208-353 from 716064 to 1355950 tid 1 2020-11-16T20:56:01.077 INFO:tasks.rados.rados.0.smithi166.stdout:353: writing smithi16641208-353 from 1815191 to 2315640 tid 2 2020-11-16T20:56:01.077 INFO:tasks.rados.rados.0.smithi166.stdout:353: writing smithi16641208-353 from 2817011 to 3343936 tid 3 2020-11-16T20:56:01.078 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.078 INFO:tasks.rados.rados.0.smithi166.stdout:338: finishing write tid 2 to smithi16641208-338 2020-11-16T20:56:01.078 INFO:tasks.rados.rados.0.smithi166.stdout:338: finishing write tid 3 to smithi16641208-338 2020-11-16T20:56:01.078 INFO:tasks.rados.rados.0.smithi166.stdout:338: finishing write tid 4 to smithi16641208-338 2020-11-16T20:56:01.078 INFO:tasks.rados.rados.0.smithi166.stdout:338: finishing write tid 5 to smithi16641208-338 2020-11-16T20:56:01.078 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 338 v 246 (ObjNum 337 snap 0 seq_num 337) dirty exists 2020-11-16T20:56:01.078 INFO:tasks.rados.rados.0.smithi166.stdout:338: left oid 338 (ObjNum 337 snap 0 seq_num 337) 2020-11-16T20:56:01.079 INFO:tasks.rados.rados.0.smithi166.stdout:339: finishing write tid 1 to smithi16641208-339 2020-11-16T20:56:01.079 INFO:tasks.rados.rados.0.smithi166.stdout:338: done (15 left) 2020-11-16T20:56:01.079 INFO:tasks.rados.rados.0.smithi166.stdout:354: write initial oid 354 2020-11-16T20:56:01.079 INFO:tasks.rados.rados.0.smithi166.stdout:354: seq_num 353 ranges {732871=715135,1873673=644107,3244434=688437} 2020-11-16T20:56:01.079 INFO:tasks.rados.rados.0.smithi166.stdout:354: writing smithi16641208-354 from 732871 to 1448006 tid 1 2020-11-16T20:56:01.079 INFO:tasks.rados.rados.0.smithi166.stdout:354: writing smithi16641208-354 from 1873673 to 2517780 tid 2 2020-11-16T20:56:01.079 INFO:tasks.rados.rados.0.smithi166.stdout:354: writing smithi16641208-354 from 3244434 to 3932871 tid 3 2020-11-16T20:56:01.079 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.080 INFO:tasks.rados.rados.0.smithi166.stdout:339: finishing write tid 2 to smithi16641208-339 2020-11-16T20:56:01.080 INFO:tasks.rados.rados.0.smithi166.stdout:339: finishing write tid 3 to smithi16641208-339 2020-11-16T20:56:01.080 INFO:tasks.rados.rados.0.smithi166.stdout:339: finishing write tid 4 to smithi16641208-339 2020-11-16T20:56:01.080 INFO:tasks.rados.rados.0.smithi166.stdout:339: finishing write tid 5 to smithi16641208-339 2020-11-16T20:56:01.080 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 339 v 287 (ObjNum 338 snap 0 seq_num 338) dirty exists 2020-11-16T20:56:01.080 INFO:tasks.rados.rados.0.smithi166.stdout:339: left oid 339 (ObjNum 338 snap 0 seq_num 338) 2020-11-16T20:56:01.080 INFO:tasks.rados.rados.0.smithi166.stdout:340: finishing write tid 1 to smithi16641208-340 2020-11-16T20:56:01.081 INFO:tasks.rados.rados.0.smithi166.stdout:339: done (15 left) 2020-11-16T20:56:01.081 INFO:tasks.rados.rados.0.smithi166.stdout:355: write initial oid 355 2020-11-16T20:56:01.081 INFO:tasks.rados.rados.0.smithi166.stdout:355: seq_num 354 ranges {749678=790384,2332155=504118,3271857=549469} 2020-11-16T20:56:01.081 INFO:tasks.rados.rados.0.smithi166.stdout:355: writing smithi16641208-355 from 749678 to 1540062 tid 1 2020-11-16T20:56:01.081 INFO:tasks.rados.rados.0.smithi166.stdout:355: writing smithi16641208-355 from 2332155 to 2836273 tid 2 2020-11-16T20:56:01.081 INFO:tasks.rados.rados.0.smithi166.stdout:355: writing smithi16641208-355 from 3271857 to 3821326 tid 3 2020-11-16T20:56:01.081 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.081 INFO:tasks.rados.rados.0.smithi166.stdout:340: finishing write tid 2 to smithi16641208-340 2020-11-16T20:56:01.082 INFO:tasks.rados.rados.0.smithi166.stdout:340: finishing write tid 3 to smithi16641208-340 2020-11-16T20:56:01.082 INFO:tasks.rados.rados.0.smithi166.stdout:340: finishing write tid 4 to smithi16641208-340 2020-11-16T20:56:01.082 INFO:tasks.rados.rados.0.smithi166.stdout:340: finishing write tid 5 to smithi16641208-340 2020-11-16T20:56:01.082 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 340 v 208 (ObjNum 339 snap 0 seq_num 339) dirty exists 2020-11-16T20:56:01.082 INFO:tasks.rados.rados.0.smithi166.stdout:340: left oid 340 (ObjNum 339 snap 0 seq_num 339) 2020-11-16T20:56:01.082 INFO:tasks.rados.rados.0.smithi166.stdout:341: finishing write tid 1 to smithi16641208-341 2020-11-16T20:56:01.082 INFO:tasks.rados.rados.0.smithi166.stdout:341: finishing write tid 2 to smithi16641208-341 2020-11-16T20:56:01.083 INFO:tasks.rados.rados.0.smithi166.stdout:341: finishing write tid 3 to smithi16641208-341 2020-11-16T20:56:01.083 INFO:tasks.rados.rados.0.smithi166.stdout:340: done (15 left) 2020-11-16T20:56:01.083 INFO:tasks.rados.rados.0.smithi166.stdout:356: write initial oid 356 2020-11-16T20:56:01.083 INFO:tasks.rados.rados.0.smithi166.stdout:356: seq_num 355 ranges {766485=465633,1990637=647776,3299280=667205} 2020-11-16T20:56:01.083 INFO:tasks.rados.rados.0.smithi166.stdout:356: writing smithi16641208-356 from 766485 to 1232118 tid 1 2020-11-16T20:56:01.083 INFO:tasks.rados.rados.0.smithi166.stdout:356: writing smithi16641208-356 from 1990637 to 2638413 tid 2 2020-11-16T20:56:01.083 INFO:tasks.rados.rados.0.smithi166.stdout:356: writing smithi16641208-356 from 3299280 to 3966485 tid 3 2020-11-16T20:56:01.083 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.084 INFO:tasks.rados.rados.0.smithi166.stdout:341: finishing write tid 4 to smithi16641208-341 2020-11-16T20:56:01.084 INFO:tasks.rados.rados.0.smithi166.stdout:341: finishing write tid 5 to smithi16641208-341 2020-11-16T20:56:01.084 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 341 v 265 (ObjNum 340 snap 0 seq_num 340) dirty exists 2020-11-16T20:56:01.084 INFO:tasks.rados.rados.0.smithi166.stdout:341: left oid 341 (ObjNum 340 snap 0 seq_num 340) 2020-11-16T20:56:01.084 INFO:tasks.rados.rados.0.smithi166.stdout:342: finishing write tid 1 to smithi16641208-342 2020-11-16T20:56:01.084 INFO:tasks.rados.rados.0.smithi166.stdout:341: done (15 left) 2020-11-16T20:56:01.084 INFO:tasks.rados.rados.0.smithi166.stdout:357: write initial oid 357 2020-11-16T20:56:01.085 INFO:tasks.rados.rados.0.smithi166.stdout:357: seq_num 356 ranges {783292=540882,1932766=507787,3210350=572013} 2020-11-16T20:56:01.085 INFO:tasks.rados.rados.0.smithi166.stdout:357: writing smithi16641208-357 from 783292 to 1324174 tid 1 2020-11-16T20:56:01.085 INFO:tasks.rados.rados.0.smithi166.stdout:357: writing smithi16641208-357 from 1932766 to 2440553 tid 2 2020-11-16T20:56:01.085 INFO:tasks.rados.rados.0.smithi166.stdout:357: writing smithi16641208-357 from 3210350 to 3782363 tid 3 2020-11-16T20:56:01.085 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.085 INFO:tasks.rados.rados.0.smithi166.stdout:342: finishing write tid 2 to smithi16641208-342 2020-11-16T20:56:01.085 INFO:tasks.rados.rados.0.smithi166.stdout:342: finishing write tid 3 to smithi16641208-342 2020-11-16T20:56:01.085 INFO:tasks.rados.rados.0.smithi166.stdout:342: finishing write tid 4 to smithi16641208-342 2020-11-16T20:56:01.086 INFO:tasks.rados.rados.0.smithi166.stdout:342: finishing write tid 5 to smithi16641208-342 2020-11-16T20:56:01.086 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 342 v 212 (ObjNum 341 snap 0 seq_num 341) dirty exists 2020-11-16T20:56:01.086 INFO:tasks.rados.rados.0.smithi166.stdout:342: left oid 342 (ObjNum 341 snap 0 seq_num 341) 2020-11-16T20:56:01.086 INFO:tasks.rados.rados.0.smithi166.stdout:343: finishing write tid 1 to smithi16641208-343 2020-11-16T20:56:01.086 INFO:tasks.rados.rados.0.smithi166.stdout:343: finishing write tid 2 to smithi16641208-343 2020-11-16T20:56:01.086 INFO:tasks.rados.rados.0.smithi166.stdout:343: finishing write tid 3 to smithi16641208-343 2020-11-16T20:56:01.086 INFO:tasks.rados.rados.0.smithi166.stdout:343: finishing write tid 4 to smithi16641208-343 2020-11-16T20:56:01.087 INFO:tasks.rados.rados.0.smithi166.stdout:343: finishing write tid 5 to smithi16641208-343 2020-11-16T20:56:01.087 INFO:tasks.rados.rados.0.smithi166.stdout:343: finishing write tid 6 to smithi16641208-343 2020-11-16T20:56:01.087 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 343 v 292 (ObjNum 342 snap 0 seq_num 342) dirty exists 2020-11-16T20:56:01.087 INFO:tasks.rados.rados.0.smithi166.stdout:343: left oid 343 (ObjNum 342 snap 0 seq_num 342) 2020-11-16T20:56:01.087 INFO:tasks.rados.rados.0.smithi166.stdout:344: finishing write tid 1 to smithi16641208-344 2020-11-16T20:56:01.087 INFO:tasks.rados.rados.0.smithi166.stdout:344: finishing write tid 2 to smithi16641208-344 2020-11-16T20:56:01.087 INFO:tasks.rados.rados.0.smithi166.stdout:344: finishing write tid 3 to smithi16641208-344 2020-11-16T20:56:01.087 INFO:tasks.rados.rados.0.smithi166.stdout:344: finishing write tid 4 to smithi16641208-344 2020-11-16T20:56:01.088 INFO:tasks.rados.rados.0.smithi166.stdout:345: finishing write tid 1 to smithi16641208-345 2020-11-16T20:56:01.088 INFO:tasks.rados.rados.0.smithi166.stdout:345: finishing write tid 2 to smithi16641208-345 2020-11-16T20:56:01.088 INFO:tasks.rados.rados.0.smithi166.stdout:345: finishing write tid 3 to smithi16641208-345 2020-11-16T20:56:01.088 INFO:tasks.rados.rados.0.smithi166.stdout:345: finishing write tid 4 to smithi16641208-345 2020-11-16T20:56:01.088 INFO:tasks.rados.rados.0.smithi166.stdout:345: finishing write tid 5 to smithi16641208-345 2020-11-16T20:56:01.088 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 345 v 296 (ObjNum 344 snap 0 seq_num 344) dirty exists 2020-11-16T20:56:01.088 INFO:tasks.rados.rados.0.smithi166.stdout:345: left oid 345 (ObjNum 344 snap 0 seq_num 344) 2020-11-16T20:56:01.088 INFO:tasks.rados.rados.0.smithi166.stdout:346: finishing write tid 1 to smithi16641208-346 2020-11-16T20:56:01.089 INFO:tasks.rados.rados.0.smithi166.stdout:344: finishing write tid 5 to smithi16641208-344 2020-11-16T20:56:01.089 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 344 v 250 (ObjNum 343 snap 0 seq_num 343) dirty exists 2020-11-16T20:56:01.089 INFO:tasks.rados.rados.0.smithi166.stdout:344: left oid 344 (ObjNum 343 snap 0 seq_num 343) 2020-11-16T20:56:01.089 INFO:tasks.rados.rados.0.smithi166.stdout:342: done (15 left) 2020-11-16T20:56:01.089 INFO:tasks.rados.rados.0.smithi166.stdout:343: done (14 left) 2020-11-16T20:56:01.089 INFO:tasks.rados.rados.0.smithi166.stdout:344: done (13 left) 2020-11-16T20:56:01.089 INFO:tasks.rados.rados.0.smithi166.stdout:345: done (12 left) 2020-11-16T20:56:01.090 INFO:tasks.rados.rados.0.smithi166.stdout:358: write initial oid 358 2020-11-16T20:56:01.090 INFO:tasks.rados.rados.0.smithi166.stdout:358: seq_num 357 ranges {400099=616131,1591248=408851} 2020-11-16T20:56:01.090 INFO:tasks.rados.rados.0.smithi166.stdout:358: writing smithi16641208-358 from 400099 to 1016230 tid 1 2020-11-16T20:56:01.090 INFO:tasks.rados.rados.0.smithi166.stdout:358: writing smithi16641208-358 from 1591248 to 2000099 tid 2 2020-11-16T20:56:01.090 INFO:tasks.rados.rados.0.smithi166.stdout:359: write initial oid 359 2020-11-16T20:56:01.090 INFO:tasks.rados.rados.0.smithi166.stdout:359: seq_num 358 ranges {416906=407733,1366083=511456} 2020-11-16T20:56:01.090 INFO:tasks.rados.rados.0.smithi166.stdout:359: writing smithi16641208-359 from 416906 to 824639 tid 1 2020-11-16T20:56:01.090 INFO:tasks.rados.rados.0.smithi166.stdout:359: writing smithi16641208-359 from 1366083 to 1877539 tid 2 2020-11-16T20:56:01.091 INFO:tasks.rados.rados.0.smithi166.stdout:360: write initial oid 360 2020-11-16T20:56:01.091 INFO:tasks.rados.rados.0.smithi166.stdout:360: seq_num 359 ranges {433713=482982,1424565=609148} 2020-11-16T20:56:01.091 INFO:tasks.rados.rados.0.smithi166.stdout:360: writing smithi16641208-360 from 433713 to 916695 tid 1 2020-11-16T20:56:01.091 INFO:tasks.rados.rados.0.smithi166.stdout:360: writing smithi16641208-360 from 1424565 to 2033713 tid 2 2020-11-16T20:56:01.091 INFO:tasks.rados.rados.0.smithi166.stdout:361: write initial oid 361 2020-11-16T20:56:01.091 INFO:tasks.rados.rados.0.smithi166.stdout:361: seq_num 360 ranges {450520=558231,1483047=515125} 2020-11-16T20:56:01.091 INFO:tasks.rados.rados.0.smithi166.stdout:361: writing smithi16641208-361 from 450520 to 1008751 tid 1 2020-11-16T20:56:01.092 INFO:tasks.rados.rados.0.smithi166.stdout:361: writing smithi16641208-361 from 1483047 to 1998172 tid 2 2020-11-16T20:56:01.092 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.092 INFO:tasks.rados.rados.0.smithi166.stdout:346: finishing write tid 2 to smithi16641208-346 2020-11-16T20:56:01.092 INFO:tasks.rados.rados.0.smithi166.stdout:346: finishing write tid 3 to smithi16641208-346 2020-11-16T20:56:01.092 INFO:tasks.rados.rados.0.smithi166.stdout:346: finishing write tid 4 to smithi16641208-346 2020-11-16T20:56:01.092 INFO:tasks.rados.rados.0.smithi166.stdout:346: finishing write tid 5 to smithi16641208-346 2020-11-16T20:56:01.092 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 346 v 300 (ObjNum 345 snap 0 seq_num 345) dirty exists 2020-11-16T20:56:01.092 INFO:tasks.rados.rados.0.smithi166.stdout:346: left oid 346 (ObjNum 345 snap 0 seq_num 345) 2020-11-16T20:56:01.093 INFO:tasks.rados.rados.0.smithi166.stdout:347: finishing write tid 1 to smithi16641208-347 2020-11-16T20:56:01.093 INFO:tasks.rados.rados.0.smithi166.stdout:346: done (15 left) 2020-11-16T20:56:01.093 INFO:tasks.rados.rados.0.smithi166.stdout:362: write initial oid 362 2020-11-16T20:56:01.093 INFO:tasks.rados.rados.0.smithi166.stdout:362: seq_num 361 ranges {467327=633480,1825176=242151} 2020-11-16T20:56:01.093 INFO:tasks.rados.rados.0.smithi166.stdout:362: writing smithi16641208-362 from 467327 to 1100807 tid 1 2020-11-16T20:56:01.093 INFO:tasks.rados.rados.0.smithi166.stdout:362: writing smithi16641208-362 from 1825176 to 2067327 tid 2 2020-11-16T20:56:01.093 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.094 INFO:tasks.rados.rados.0.smithi166.stdout:347: finishing write tid 2 to smithi16641208-347 2020-11-16T20:56:01.094 INFO:tasks.rados.rados.0.smithi166.stdout:347: finishing write tid 3 to smithi16641208-347 2020-11-16T20:56:01.094 INFO:tasks.rados.rados.0.smithi166.stdout:347: finishing write tid 4 to smithi16641208-347 2020-11-16T20:56:01.094 INFO:tasks.rados.rados.0.smithi166.stdout:347: finishing write tid 5 to smithi16641208-347 2020-11-16T20:56:01.094 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 347 v 216 (ObjNum 346 snap 0 seq_num 346) dirty exists 2020-11-16T20:56:01.094 INFO:tasks.rados.rados.0.smithi166.stdout:347: left oid 347 (ObjNum 346 snap 0 seq_num 346) 2020-11-16T20:56:01.094 INFO:tasks.rados.rados.0.smithi166.stdout:348: finishing write tid 1 to smithi16641208-348 2020-11-16T20:56:01.094 INFO:tasks.rados.rados.0.smithi166.stdout:347: done (15 left) 2020-11-16T20:56:01.095 INFO:tasks.rados.rados.0.smithi166.stdout:363: write initial oid 363 2020-11-16T20:56:01.095 INFO:tasks.rados.rados.0.smithi166.stdout:363: seq_num 362 ranges {484134=708729,1883658=200476} 2020-11-16T20:56:01.095 INFO:tasks.rados.rados.0.smithi166.stdout:363: writing smithi16641208-363 from 484134 to 1192863 tid 1 2020-11-16T20:56:01.095 INFO:tasks.rados.rados.0.smithi166.stdout:363: writing smithi16641208-363 from 1883658 to 2084134 tid 2 2020-11-16T20:56:01.095 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.095 INFO:tasks.rados.rados.0.smithi166.stdout:348: finishing write tid 2 to smithi16641208-348 2020-11-16T20:56:01.095 INFO:tasks.rados.rados.0.smithi166.stdout:348: finishing write tid 3 to smithi16641208-348 2020-11-16T20:56:01.096 INFO:tasks.rados.rados.0.smithi166.stdout:348: finishing write tid 4 to smithi16641208-348 2020-11-16T20:56:01.096 INFO:tasks.rados.rados.0.smithi166.stdout:348: finishing write tid 5 to smithi16641208-348 2020-11-16T20:56:01.096 INFO:tasks.rados.rados.0.smithi166.stdout:348: finishing write tid 6 to smithi16641208-348 2020-11-16T20:56:01.096 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 348 v 255 (ObjNum 347 snap 0 seq_num 347) dirty exists 2020-11-16T20:56:01.096 INFO:tasks.rados.rados.0.smithi166.stdout:348: left oid 348 (ObjNum 347 snap 0 seq_num 347) 2020-11-16T20:56:01.096 INFO:tasks.rados.rados.0.smithi166.stdout:349: finishing write tid 1 to smithi16641208-349 2020-11-16T20:56:01.096 INFO:tasks.rados.rados.0.smithi166.stdout:348: done (15 left) 2020-11-16T20:56:01.096 INFO:tasks.rados.rados.0.smithi166.stdout:364: write initial oid 364 2020-11-16T20:56:01.097 INFO:tasks.rados.rados.0.smithi166.stdout:364: seq_num 363 ranges {500941=783978,1942140=158801} 2020-11-16T20:56:01.097 INFO:tasks.rados.rados.0.smithi166.stdout:364: writing smithi16641208-364 from 500941 to 1284919 tid 1 2020-11-16T20:56:01.097 INFO:tasks.rados.rados.0.smithi166.stdout:364: writing smithi16641208-364 from 1942140 to 2100941 tid 2 2020-11-16T20:56:01.097 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.097 INFO:tasks.rados.rados.0.smithi166.stdout:349: finishing write tid 2 to smithi16641208-349 2020-11-16T20:56:01.097 INFO:tasks.rados.rados.0.smithi166.stdout:349: finishing write tid 3 to smithi16641208-349 2020-11-16T20:56:01.097 INFO:tasks.rados.rados.0.smithi166.stdout:349: finishing write tid 4 to smithi16641208-349 2020-11-16T20:56:01.097 INFO:tasks.rados.rados.0.smithi166.stdout:350: finishing write tid 1 to smithi16641208-350 2020-11-16T20:56:01.098 INFO:tasks.rados.rados.0.smithi166.stdout:350: finishing write tid 2 to smithi16641208-350 2020-11-16T20:56:01.098 INFO:tasks.rados.rados.0.smithi166.stdout:350: finishing write tid 3 to smithi16641208-350 2020-11-16T20:56:01.098 INFO:tasks.rados.rados.0.smithi166.stdout:350: finishing write tid 4 to smithi16641208-350 2020-11-16T20:56:01.098 INFO:tasks.rados.rados.0.smithi166.stdout:350: finishing write tid 5 to smithi16641208-350 2020-11-16T20:56:01.098 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 350 v 269 (ObjNum 349 snap 0 seq_num 349) dirty exists 2020-11-16T20:56:01.098 INFO:tasks.rados.rados.0.smithi166.stdout:350: left oid 350 (ObjNum 349 snap 0 seq_num 349) 2020-11-16T20:56:01.098 INFO:tasks.rados.rados.0.smithi166.stdout:349: finishing write tid 5 to smithi16641208-349 2020-11-16T20:56:01.099 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 349 v 304 (ObjNum 348 snap 0 seq_num 348) dirty exists 2020-11-16T20:56:01.099 INFO:tasks.rados.rados.0.smithi166.stdout:349: left oid 349 (ObjNum 348 snap 0 seq_num 348) 2020-11-16T20:56:01.099 INFO:tasks.rados.rados.0.smithi166.stdout:351: finishing write tid 1 to smithi16641208-351 2020-11-16T20:56:01.099 INFO:tasks.rados.rados.0.smithi166.stdout:349: done (15 left) 2020-11-16T20:56:01.099 INFO:tasks.rados.rados.0.smithi166.stdout:350: done (14 left) 2020-11-16T20:56:01.099 INFO:tasks.rados.rados.0.smithi166.stdout:365: write initial oid 365 2020-11-16T20:56:01.099 INFO:tasks.rados.rados.0.smithi166.stdout:365: seq_num 364 ranges {517748=459227,1600622=406110} 2020-11-16T20:56:01.099 INFO:tasks.rados.rados.0.smithi166.stdout:365: writing smithi16641208-365 from 517748 to 976975 tid 1 2020-11-16T20:56:01.100 INFO:tasks.rados.rados.0.smithi166.stdout:365: writing smithi16641208-365 from 1600622 to 2006732 tid 2 2020-11-16T20:56:01.100 INFO:tasks.rados.rados.0.smithi166.stdout:366: write initial oid 366 2020-11-16T20:56:01.100 INFO:tasks.rados.rados.0.smithi166.stdout:366: seq_num 365 ranges {534555=650829,1659104=475451} 2020-11-16T20:56:01.100 INFO:tasks.rados.rados.0.smithi166.stdout:366: writing smithi16641208-366 from 534555 to 1185384 tid 1 2020-11-16T20:56:01.100 INFO:tasks.rados.rados.0.smithi166.stdout:366: writing smithi16641208-366 from 1659104 to 2134555 tid 2 2020-11-16T20:56:01.100 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.100 INFO:tasks.rados.rados.0.smithi166.stdout:351: finishing write tid 2 to smithi16641208-351 2020-11-16T20:56:01.101 INFO:tasks.rados.rados.0.smithi166.stdout:351: finishing write tid 3 to smithi16641208-351 2020-11-16T20:56:01.101 INFO:tasks.rados.rados.0.smithi166.stdout:351: finishing write tid 4 to smithi16641208-351 2020-11-16T20:56:01.101 INFO:tasks.rados.rados.0.smithi166.stdout:351: finishing write tid 5 to smithi16641208-351 2020-11-16T20:56:01.101 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 351 v 308 (ObjNum 350 snap 0 seq_num 350) dirty exists 2020-11-16T20:56:01.101 INFO:tasks.rados.rados.0.smithi166.stdout:351: left oid 351 (ObjNum 350 snap 0 seq_num 350) 2020-11-16T20:56:01.101 INFO:tasks.rados.rados.0.smithi166.stdout:352: finishing write tid 1 to smithi16641208-352 2020-11-16T20:56:01.101 INFO:tasks.rados.rados.0.smithi166.stdout:352: finishing write tid 2 to smithi16641208-352 2020-11-16T20:56:01.101 INFO:tasks.rados.rados.0.smithi166.stdout:352: finishing write tid 3 to smithi16641208-352 2020-11-16T20:56:01.102 INFO:tasks.rados.rados.0.smithi166.stdout:352: finishing write tid 4 to smithi16641208-352 2020-11-16T20:56:01.102 INFO:tasks.rados.rados.0.smithi166.stdout:351: done (15 left) 2020-11-16T20:56:01.102 INFO:tasks.rados.rados.0.smithi166.stdout:367: write initial oid 367 2020-11-16T20:56:01.102 INFO:tasks.rados.rados.0.smithi166.stdout:352: finishing write tid 5 to smithi16641208-352 2020-11-16T20:56:01.102 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 352 v 259 (ObjNum 351 snap 0 seq_num 351) dirty exists 2020-11-16T20:56:01.102 INFO:tasks.rados.rados.0.smithi166.stdout:352: left oid 352 (ObjNum 351 snap 0 seq_num 351) 2020-11-16T20:56:01.102 INFO:tasks.rados.rados.0.smithi166.stdout:353: finishing write tid 1 to smithi16641208-353 2020-11-16T20:56:01.103 INFO:tasks.rados.rados.0.smithi166.stdout:367: seq_num 366 ranges {551362=726078,1717586=409779} 2020-11-16T20:56:01.103 INFO:tasks.rados.rados.0.smithi166.stdout:367: writing smithi16641208-367 from 551362 to 1277440 tid 1 2020-11-16T20:56:01.103 INFO:tasks.rados.rados.0.smithi166.stdout:367: writing smithi16641208-367 from 1717586 to 2127365 tid 2 2020-11-16T20:56:01.103 INFO:tasks.rados.rados.0.smithi166.stdout:352: done (15 left) 2020-11-16T20:56:01.103 INFO:tasks.rados.rados.0.smithi166.stdout:368: write initial oid 368 2020-11-16T20:56:01.103 INFO:tasks.rados.rados.0.smithi166.stdout:368: seq_num 367 ranges {568169=401327,1376068=669790} 2020-11-16T20:56:01.103 INFO:tasks.rados.rados.0.smithi166.stdout:368: writing smithi16641208-368 from 568169 to 969496 tid 1 2020-11-16T20:56:01.103 INFO:tasks.rados.rados.0.smithi166.stdout:368: writing smithi16641208-368 from 1376068 to 2045858 tid 2 2020-11-16T20:56:01.104 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.104 INFO:tasks.rados.rados.0.smithi166.stdout:353: finishing write tid 2 to smithi16641208-353 2020-11-16T20:56:01.104 INFO:tasks.rados.rados.0.smithi166.stdout:353: finishing write tid 3 to smithi16641208-353 2020-11-16T20:56:01.104 INFO:tasks.rados.rados.0.smithi166.stdout:353: finishing write tid 4 to smithi16641208-353 2020-11-16T20:56:01.104 INFO:tasks.rados.rados.0.smithi166.stdout:353: finishing write tid 5 to smithi16641208-353 2020-11-16T20:56:01.104 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 353 v 312 (ObjNum 352 snap 0 seq_num 352) dirty exists 2020-11-16T20:56:01.104 INFO:tasks.rados.rados.0.smithi166.stdout:353: left oid 353 (ObjNum 352 snap 0 seq_num 352) 2020-11-16T20:56:01.104 INFO:tasks.rados.rados.0.smithi166.stdout:354: finishing write tid 1 to smithi16641208-354 2020-11-16T20:56:01.105 INFO:tasks.rados.rados.0.smithi166.stdout:353: done (15 left) 2020-11-16T20:56:01.105 INFO:tasks.rados.rados.0.smithi166.stdout:369: write initial oid 369 2020-11-16T20:56:01.105 INFO:tasks.rados.rados.0.smithi166.stdout:369: seq_num 368 ranges {584976=476576,1834550=350426} 2020-11-16T20:56:01.105 INFO:tasks.rados.rados.0.smithi166.stdout:369: writing smithi16641208-369 from 584976 to 1061552 tid 1 2020-11-16T20:56:01.105 INFO:tasks.rados.rados.0.smithi166.stdout:369: writing smithi16641208-369 from 1834550 to 2184976 tid 2 2020-11-16T20:56:01.105 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.105 INFO:tasks.rados.rados.0.smithi166.stdout:354: finishing write tid 2 to smithi16641208-354 2020-11-16T20:56:01.106 INFO:tasks.rados.rados.0.smithi166.stdout:354: finishing write tid 3 to smithi16641208-354 2020-11-16T20:56:01.106 INFO:tasks.rados.rados.0.smithi166.stdout:354: finishing write tid 4 to smithi16641208-354 2020-11-16T20:56:01.106 INFO:tasks.rados.rados.0.smithi166.stdout:354: finishing write tid 5 to smithi16641208-354 2020-11-16T20:56:01.106 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 354 v 313 (ObjNum 353 snap 0 seq_num 353) dirty exists 2020-11-16T20:56:01.106 INFO:tasks.rados.rados.0.smithi166.stdout:354: left oid 354 (ObjNum 353 snap 0 seq_num 353) 2020-11-16T20:56:01.106 INFO:tasks.rados.rados.0.smithi166.stdout:355: finishing write tid 1 to smithi16641208-355 2020-11-16T20:56:01.106 INFO:tasks.rados.rados.0.smithi166.stdout:355: finishing write tid 2 to smithi16641208-355 2020-11-16T20:56:01.107 INFO:tasks.rados.rados.0.smithi166.stdout:355: finishing write tid 3 to smithi16641208-355 2020-11-16T20:56:01.107 INFO:tasks.rados.rados.0.smithi166.stdout:355: finishing write tid 4 to smithi16641208-355 2020-11-16T20:56:01.107 INFO:tasks.rados.rados.0.smithi166.stdout:354: done (15 left) 2020-11-16T20:56:01.107 INFO:tasks.rados.rados.0.smithi166.stdout:370: write initial oid 370 2020-11-16T20:56:01.107 INFO:tasks.rados.rados.0.smithi166.stdout:355: finishing write tid 5 to smithi16641208-355 2020-11-16T20:56:01.107 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 355 v 220 (ObjNum 354 snap 0 seq_num 354) dirty exists 2020-11-16T20:56:01.107 INFO:tasks.rados.rados.0.smithi166.stdout:355: left oid 355 (ObjNum 354 snap 0 seq_num 354) 2020-11-16T20:56:01.107 INFO:tasks.rados.rados.0.smithi166.stdout:356: finishing write tid 1 to smithi16641208-356 2020-11-16T20:56:01.108 INFO:tasks.rados.rados.0.smithi166.stdout:370: seq_num 369 ranges {601783=551825,1776679=425104} 2020-11-16T20:56:01.108 INFO:tasks.rados.rados.0.smithi166.stdout:370: writing smithi16641208-370 from 601783 to 1153608 tid 1 2020-11-16T20:56:01.108 INFO:tasks.rados.rados.0.smithi166.stdout:370: writing smithi16641208-370 from 1776679 to 2201783 tid 2 2020-11-16T20:56:01.108 INFO:tasks.rados.rados.0.smithi166.stdout:355: done (15 left) 2020-11-16T20:56:01.108 INFO:tasks.rados.rados.0.smithi166.stdout:371: write initial oid 371 2020-11-16T20:56:01.108 INFO:tasks.rados.rados.0.smithi166.stdout:371: seq_num 370 ranges {618590=627074,1835161=383429} 2020-11-16T20:56:01.108 INFO:tasks.rados.rados.0.smithi166.stdout:371: writing smithi16641208-371 from 618590 to 1245664 tid 1 2020-11-16T20:56:01.109 INFO:tasks.rados.rados.0.smithi166.stdout:371: writing smithi16641208-371 from 1835161 to 2218590 tid 2 2020-11-16T20:56:01.109 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.109 INFO:tasks.rados.rados.0.smithi166.stdout:356: finishing write tid 2 to smithi16641208-356 2020-11-16T20:56:01.109 INFO:tasks.rados.rados.0.smithi166.stdout:356: finishing write tid 3 to smithi16641208-356 2020-11-16T20:56:01.109 INFO:tasks.rados.rados.0.smithi166.stdout:356: finishing write tid 4 to smithi16641208-356 2020-11-16T20:56:01.109 INFO:tasks.rados.rados.0.smithi166.stdout:356: finishing write tid 5 to smithi16641208-356 2020-11-16T20:56:01.109 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 356 v 224 (ObjNum 355 snap 0 seq_num 355) dirty exists 2020-11-16T20:56:01.109 INFO:tasks.rados.rados.0.smithi166.stdout:356: left oid 356 (ObjNum 355 snap 0 seq_num 355) 2020-11-16T20:56:01.110 INFO:tasks.rados.rados.0.smithi166.stdout:357: finishing write tid 1 to smithi16641208-357 2020-11-16T20:56:01.110 INFO:tasks.rados.rados.0.smithi166.stdout:357: finishing write tid 2 to smithi16641208-357 2020-11-16T20:56:01.110 INFO:tasks.rados.rados.0.smithi166.stdout:356: done (15 left) 2020-11-16T20:56:01.110 INFO:tasks.rados.rados.0.smithi166.stdout:372: write initial oid 372 2020-11-16T20:56:01.110 INFO:tasks.rados.rados.0.smithi166.stdout:372: seq_num 371 ranges {635397=702323,1893643=341754} 2020-11-16T20:56:01.110 INFO:tasks.rados.rados.0.smithi166.stdout:372: writing smithi16641208-372 from 635397 to 1337720 tid 1 2020-11-16T20:56:01.110 INFO:tasks.rados.rados.0.smithi166.stdout:372: writing smithi16641208-372 from 1893643 to 2235397 tid 2 2020-11-16T20:56:01.111 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.111 INFO:tasks.rados.rados.0.smithi166.stdout:357: finishing write tid 3 to smithi16641208-357 2020-11-16T20:56:01.111 INFO:tasks.rados.rados.0.smithi166.stdout:357: finishing write tid 4 to smithi16641208-357 2020-11-16T20:56:01.111 INFO:tasks.rados.rados.0.smithi166.stdout:357: finishing write tid 5 to smithi16641208-357 2020-11-16T20:56:01.111 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 357 v 228 (ObjNum 356 snap 0 seq_num 356) dirty exists 2020-11-16T20:56:01.111 INFO:tasks.rados.rados.0.smithi166.stdout:357: left oid 357 (ObjNum 356 snap 0 seq_num 356) 2020-11-16T20:56:01.111 INFO:tasks.rados.rados.0.smithi166.stdout:358: finishing write tid 1 to smithi16641208-358 2020-11-16T20:56:01.111 INFO:tasks.rados.rados.0.smithi166.stdout:358: finishing write tid 2 to smithi16641208-358 2020-11-16T20:56:01.112 INFO:tasks.rados.rados.0.smithi166.stdout:358: finishing write tid 3 to smithi16641208-358 2020-11-16T20:56:01.112 INFO:tasks.rados.rados.0.smithi166.stdout:358: finishing write tid 4 to smithi16641208-358 2020-11-16T20:56:01.112 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 358 v 316 (ObjNum 357 snap 0 seq_num 357) dirty exists 2020-11-16T20:56:01.112 INFO:tasks.rados.rados.0.smithi166.stdout:358: left oid 358 (ObjNum 357 snap 0 seq_num 357) 2020-11-16T20:56:01.112 INFO:tasks.rados.rados.0.smithi166.stdout:359: finishing write tid 1 to smithi16641208-359 2020-11-16T20:56:01.112 INFO:tasks.rados.rados.0.smithi166.stdout:359: finishing write tid 2 to smithi16641208-359 2020-11-16T20:56:01.112 INFO:tasks.rados.rados.0.smithi166.stdout:357: done (15 left) 2020-11-16T20:56:01.112 INFO:tasks.rados.rados.0.smithi166.stdout:358: done (14 left) 2020-11-16T20:56:01.113 INFO:tasks.rados.rados.0.smithi166.stdout:373: write initial oid 373 2020-11-16T20:56:01.113 INFO:tasks.rados.rados.0.smithi166.stdout:373: seq_num 372 ranges {652204=777572,1952125=300079} 2020-11-16T20:56:01.113 INFO:tasks.rados.rados.0.smithi166.stdout:373: writing smithi16641208-373 from 652204 to 1429776 tid 1 2020-11-16T20:56:01.113 INFO:tasks.rados.rados.0.smithi166.stdout:373: writing smithi16641208-373 from 1952125 to 2252204 tid 2 2020-11-16T20:56:01.113 INFO:tasks.rados.rados.0.smithi166.stdout:374: write initial oid 374 2020-11-16T20:56:01.113 INFO:tasks.rados.rados.0.smithi166.stdout:359: finishing write tid 3 to smithi16641208-359 2020-11-16T20:56:01.113 INFO:tasks.rados.rados.0.smithi166.stdout:374: seq_num 373 ranges {669011=569174,2010607=258404} 2020-11-16T20:56:01.114 INFO:tasks.rados.rados.0.smithi166.stdout:374: writing smithi16641208-374 from 669011 to 1238185 tid 1 2020-11-16T20:56:01.114 INFO:tasks.rados.rados.0.smithi166.stdout:374: writing smithi16641208-374 from 2010607 to 2269011 tid 2 2020-11-16T20:56:01.114 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.114 INFO:tasks.rados.rados.0.smithi166.stdout:359: finishing write tid 4 to smithi16641208-359 2020-11-16T20:56:01.114 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 359 v 319 (ObjNum 358 snap 0 seq_num 358) dirty exists 2020-11-16T20:56:01.114 INFO:tasks.rados.rados.0.smithi166.stdout:359: left oid 359 (ObjNum 358 snap 0 seq_num 358) 2020-11-16T20:56:01.114 INFO:tasks.rados.rados.0.smithi166.stdout:359: done (15 left) 2020-11-16T20:56:01.114 INFO:tasks.rados.rados.0.smithi166.stdout:375: write initial oid 375 2020-11-16T20:56:01.115 INFO:tasks.rados.rados.0.smithi166.stdout:375: seq_num 374 ranges {685818=644423,2069089=216729} 2020-11-16T20:56:01.115 INFO:tasks.rados.rados.0.smithi166.stdout:375: writing smithi16641208-375 from 685818 to 1330241 tid 1 2020-11-16T20:56:01.115 INFO:tasks.rados.rados.0.smithi166.stdout:375: writing smithi16641208-375 from 2069089 to 2285818 tid 2 2020-11-16T20:56:01.115 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.115 INFO:tasks.rados.rados.0.smithi166.stdout:360: finishing write tid 1 to smithi16641208-360 2020-11-16T20:56:01.115 INFO:tasks.rados.rados.0.smithi166.stdout:360: finishing write tid 2 to smithi16641208-360 2020-11-16T20:56:01.115 INFO:tasks.rados.rados.0.smithi166.stdout:360: finishing write tid 3 to smithi16641208-360 2020-11-16T20:56:01.116 INFO:tasks.rados.rados.0.smithi166.stdout:360: finishing write tid 4 to smithi16641208-360 2020-11-16T20:56:01.116 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 360 v 322 (ObjNum 359 snap 0 seq_num 359) dirty exists 2020-11-16T20:56:01.116 INFO:tasks.rados.rados.0.smithi166.stdout:360: left oid 360 (ObjNum 359 snap 0 seq_num 359) 2020-11-16T20:56:01.116 INFO:tasks.rados.rados.0.smithi166.stdout:361: finishing write tid 1 to smithi16641208-361 2020-11-16T20:56:01.116 INFO:tasks.rados.rados.0.smithi166.stdout:361: finishing write tid 2 to smithi16641208-361 2020-11-16T20:56:01.116 INFO:tasks.rados.rados.0.smithi166.stdout:361: finishing write tid 3 to smithi16641208-361 2020-11-16T20:56:01.116 INFO:tasks.rados.rados.0.smithi166.stdout:361: finishing write tid 4 to smithi16641208-361 2020-11-16T20:56:01.116 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 361 v 262 (ObjNum 360 snap 0 seq_num 360) dirty exists 2020-11-16T20:56:01.117 INFO:tasks.rados.rados.0.smithi166.stdout:361: left oid 361 (ObjNum 360 snap 0 seq_num 360) 2020-11-16T20:56:01.117 INFO:tasks.rados.rados.0.smithi166.stdout:362: finishing write tid 1 to smithi16641208-362 2020-11-16T20:56:01.117 INFO:tasks.rados.rados.0.smithi166.stdout:362: finishing write tid 2 to smithi16641208-362 2020-11-16T20:56:01.117 INFO:tasks.rados.rados.0.smithi166.stdout:362: finishing write tid 3 to smithi16641208-362 2020-11-16T20:56:01.117 INFO:tasks.rados.rados.0.smithi166.stdout:362: finishing write tid 4 to smithi16641208-362 2020-11-16T20:56:01.117 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 362 v 325 (ObjNum 361 snap 0 seq_num 361) dirty exists 2020-11-16T20:56:01.117 INFO:tasks.rados.rados.0.smithi166.stdout:362: left oid 362 (ObjNum 361 snap 0 seq_num 361) 2020-11-16T20:56:01.118 INFO:tasks.rados.rados.0.smithi166.stdout:363: finishing write tid 1 to smithi16641208-363 2020-11-16T20:56:01.118 INFO:tasks.rados.rados.0.smithi166.stdout:363: finishing write tid 2 to smithi16641208-363 2020-11-16T20:56:01.118 INFO:tasks.rados.rados.0.smithi166.stdout:360: done (15 left) 2020-11-16T20:56:01.118 INFO:tasks.rados.rados.0.smithi166.stdout:361: done (14 left) 2020-11-16T20:56:01.118 INFO:tasks.rados.rados.0.smithi166.stdout:362: done (13 left) 2020-11-16T20:56:01.118 INFO:tasks.rados.rados.0.smithi166.stdout:376: write initial oid 376 2020-11-16T20:56:01.118 INFO:tasks.rados.rados.0.smithi166.stdout:376: seq_num 375 ranges {702625=719672,2127571=175054} 2020-11-16T20:56:01.119 INFO:tasks.rados.rados.0.smithi166.stdout:376: writing smithi16641208-376 from 702625 to 1422297 tid 1 2020-11-16T20:56:01.119 INFO:tasks.rados.rados.0.smithi166.stdout:376: writing smithi16641208-376 from 2127571 to 2302625 tid 2 2020-11-16T20:56:01.119 INFO:tasks.rados.rados.0.smithi166.stdout:377: write initial oid 377 2020-11-16T20:56:01.119 INFO:tasks.rados.rados.0.smithi166.stdout:377: seq_num 376 ranges {719432=794921,2186053=133379} 2020-11-16T20:56:01.119 INFO:tasks.rados.rados.0.smithi166.stdout:377: writing smithi16641208-377 from 719432 to 1514353 tid 1 2020-11-16T20:56:01.119 INFO:tasks.rados.rados.0.smithi166.stdout:377: writing smithi16641208-377 from 2186053 to 2319432 tid 2 2020-11-16T20:56:01.119 INFO:tasks.rados.rados.0.smithi166.stdout:378: write initial oid 378 2020-11-16T20:56:01.119 INFO:tasks.rados.rados.0.smithi166.stdout:363: finishing write tid 3 to smithi16641208-363 2020-11-16T20:56:01.120 INFO:tasks.rados.rados.0.smithi166.stdout:378: seq_num 377 ranges {736239=470170,1728182=571782} 2020-11-16T20:56:01.120 INFO:tasks.rados.rados.0.smithi166.stdout:378: writing smithi16641208-378 from 736239 to 1206409 tid 1 2020-11-16T20:56:01.120 INFO:tasks.rados.rados.0.smithi166.stdout:378: writing smithi16641208-378 from 1728182 to 2299964 tid 2 2020-11-16T20:56:01.120 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.120 INFO:tasks.rados.rados.0.smithi166.stdout:363: finishing write tid 4 to smithi16641208-363 2020-11-16T20:56:01.120 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 363 v 328 (ObjNum 362 snap 0 seq_num 362) dirty exists 2020-11-16T20:56:01.120 INFO:tasks.rados.rados.0.smithi166.stdout:363: left oid 363 (ObjNum 362 snap 0 seq_num 362) 2020-11-16T20:56:01.120 INFO:tasks.rados.rados.0.smithi166.stdout:363: done (15 left) 2020-11-16T20:56:01.121 INFO:tasks.rados.rados.0.smithi166.stdout:379: write initial oid 379 2020-11-16T20:56:01.121 INFO:tasks.rados.rados.0.smithi166.stdout:379: seq_num 378 ranges {753046=545419,1786664=431793} 2020-11-16T20:56:01.121 INFO:tasks.rados.rados.0.smithi166.stdout:379: writing smithi16641208-379 from 753046 to 1298465 tid 1 2020-11-16T20:56:01.121 INFO:tasks.rados.rados.0.smithi166.stdout:379: writing smithi16641208-379 from 1786664 to 2218457 tid 2 2020-11-16T20:56:01.121 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.121 INFO:tasks.rados.rados.0.smithi166.stdout:364: finishing write tid 1 to smithi16641208-364 2020-11-16T20:56:01.121 INFO:tasks.rados.rados.0.smithi166.stdout:364: finishing write tid 2 to smithi16641208-364 2020-11-16T20:56:01.122 INFO:tasks.rados.rados.0.smithi166.stdout:364: finishing write tid 3 to smithi16641208-364 2020-11-16T20:56:01.122 INFO:tasks.rados.rados.0.smithi166.stdout:364: finishing write tid 4 to smithi16641208-364 2020-11-16T20:56:01.122 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 364 v 331 (ObjNum 363 snap 0 seq_num 363) dirty exists 2020-11-16T20:56:01.122 INFO:tasks.rados.rados.0.smithi166.stdout:364: left oid 364 (ObjNum 363 snap 0 seq_num 363) 2020-11-16T20:56:01.122 INFO:tasks.rados.rados.0.smithi166.stdout:365: finishing write tid 1 to smithi16641208-365 2020-11-16T20:56:01.122 INFO:tasks.rados.rados.0.smithi166.stdout:365: finishing write tid 2 to smithi16641208-365 2020-11-16T20:56:01.122 INFO:tasks.rados.rados.0.smithi166.stdout:365: finishing write tid 3 to smithi16641208-365 2020-11-16T20:56:01.122 INFO:tasks.rados.rados.0.smithi166.stdout:365: finishing write tid 4 to smithi16641208-365 2020-11-16T20:56:01.123 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 365 v 265 (ObjNum 364 snap 0 seq_num 364) dirty exists 2020-11-16T20:56:01.123 INFO:tasks.rados.rados.0.smithi166.stdout:365: left oid 365 (ObjNum 364 snap 0 seq_num 364) 2020-11-16T20:56:01.123 INFO:tasks.rados.rados.0.smithi166.stdout:366: finishing write tid 1 to smithi16641208-366 2020-11-16T20:56:01.123 INFO:tasks.rados.rados.0.smithi166.stdout:364: done (15 left) 2020-11-16T20:56:01.123 INFO:tasks.rados.rados.0.smithi166.stdout:365: done (14 left) 2020-11-16T20:56:01.123 INFO:tasks.rados.rados.0.smithi166.stdout:380: write initial oid 380 2020-11-16T20:56:01.123 INFO:tasks.rados.rados.0.smithi166.stdout:380: seq_num 379 ranges {769853=620668,1845146=524707} 2020-11-16T20:56:01.124 INFO:tasks.rados.rados.0.smithi166.stdout:380: writing smithi16641208-380 from 769853 to 1390521 tid 1 2020-11-16T20:56:01.124 INFO:tasks.rados.rados.0.smithi166.stdout:380: writing smithi16641208-380 from 1845146 to 2369853 tid 2 2020-11-16T20:56:01.124 INFO:tasks.rados.rados.0.smithi166.stdout:381: write initial oid 381 2020-11-16T20:56:01.124 INFO:tasks.rados.rados.0.smithi166.stdout:381: seq_num 380 ranges {786660=695917,1903628=435462} 2020-11-16T20:56:01.124 INFO:tasks.rados.rados.0.smithi166.stdout:381: writing smithi16641208-381 from 786660 to 1482577 tid 1 2020-11-16T20:56:01.124 INFO:tasks.rados.rados.0.smithi166.stdout:381: writing smithi16641208-381 from 1903628 to 2339090 tid 2 2020-11-16T20:56:01.124 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.124 INFO:tasks.rados.rados.0.smithi166.stdout:366: finishing write tid 2 to smithi16641208-366 2020-11-16T20:56:01.125 INFO:tasks.rados.rados.0.smithi166.stdout:366: finishing write tid 3 to smithi16641208-366 2020-11-16T20:56:01.125 INFO:tasks.rados.rados.0.smithi166.stdout:366: finishing write tid 4 to smithi16641208-366 2020-11-16T20:56:01.125 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 366 v 266 (ObjNum 365 snap 0 seq_num 365) dirty exists 2020-11-16T20:56:01.125 INFO:tasks.rados.rados.0.smithi166.stdout:366: left oid 366 (ObjNum 365 snap 0 seq_num 365) 2020-11-16T20:56:01.125 INFO:tasks.rados.rados.0.smithi166.stdout:367: finishing write tid 1 to smithi16641208-367 2020-11-16T20:56:01.125 INFO:tasks.rados.rados.0.smithi166.stdout:367: finishing write tid 2 to smithi16641208-367 2020-11-16T20:56:01.125 INFO:tasks.rados.rados.0.smithi166.stdout:367: finishing write tid 3 to smithi16641208-367 2020-11-16T20:56:01.125 INFO:tasks.rados.rados.0.smithi166.stdout:367: finishing write tid 4 to smithi16641208-367 2020-11-16T20:56:01.126 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 367 v 269 (ObjNum 366 snap 0 seq_num 366) dirty exists 2020-11-16T20:56:01.126 INFO:tasks.rados.rados.0.smithi166.stdout:367: left oid 367 (ObjNum 366 snap 0 seq_num 366) 2020-11-16T20:56:01.126 INFO:tasks.rados.rados.0.smithi166.stdout:368: finishing write tid 1 to smithi16641208-368 2020-11-16T20:56:01.126 INFO:tasks.rados.rados.0.smithi166.stdout:366: done (15 left) 2020-11-16T20:56:01.126 INFO:tasks.rados.rados.0.smithi166.stdout:367: done (14 left) 2020-11-16T20:56:01.126 INFO:tasks.rados.rados.0.smithi166.stdout:382: write initial oid 382 2020-11-16T20:56:01.126 INFO:tasks.rados.rados.0.smithi166.stdout:382: seq_num 381 ranges {403467=487519,1562110=579120} 2020-11-16T20:56:01.127 INFO:tasks.rados.rados.0.smithi166.stdout:382: writing smithi16641208-382 from 403467 to 890986 tid 1 2020-11-16T20:56:01.127 INFO:tasks.rados.rados.0.smithi166.stdout:382: writing smithi16641208-382 from 1562110 to 2141230 tid 2 2020-11-16T20:56:01.127 INFO:tasks.rados.rados.0.smithi166.stdout:383: write initial oid 383 2020-11-16T20:56:01.127 INFO:tasks.rados.rados.0.smithi166.stdout:368: finishing write tid 2 to smithi16641208-368 2020-11-16T20:56:01.127 INFO:tasks.rados.rados.0.smithi166.stdout:383: seq_num 382 ranges {420274=562768,1620592=439131} 2020-11-16T20:56:01.127 INFO:tasks.rados.rados.0.smithi166.stdout:383: writing smithi16641208-383 from 420274 to 983042 tid 1 2020-11-16T20:56:01.127 INFO:tasks.rados.rados.0.smithi166.stdout:383: writing smithi16641208-383 from 1620592 to 2059723 tid 2 2020-11-16T20:56:01.128 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.128 INFO:tasks.rados.rados.0.smithi166.stdout:368: finishing write tid 3 to smithi16641208-368 2020-11-16T20:56:01.128 INFO:tasks.rados.rados.0.smithi166.stdout:368: finishing write tid 4 to smithi16641208-368 2020-11-16T20:56:01.128 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 368 v 334 (ObjNum 367 snap 0 seq_num 367) dirty exists 2020-11-16T20:56:01.128 INFO:tasks.rados.rados.0.smithi166.stdout:368: left oid 368 (ObjNum 367 snap 0 seq_num 367) 2020-11-16T20:56:01.128 INFO:tasks.rados.rados.0.smithi166.stdout:369: finishing write tid 1 to smithi16641208-369 2020-11-16T20:56:01.128 INFO:tasks.rados.rados.0.smithi166.stdout:369: finishing write tid 2 to smithi16641208-369 2020-11-16T20:56:01.128 INFO:tasks.rados.rados.0.smithi166.stdout:368: done (15 left) 2020-11-16T20:56:01.129 INFO:tasks.rados.rados.0.smithi166.stdout:384: write initial oid 384 2020-11-16T20:56:01.129 INFO:tasks.rados.rados.0.smithi166.stdout:384: seq_num 383 ranges {437081=638017,1679074=582789} 2020-11-16T20:56:01.129 INFO:tasks.rados.rados.0.smithi166.stdout:384: writing smithi16641208-384 from 437081 to 1075098 tid 1 2020-11-16T20:56:01.129 INFO:tasks.rados.rados.0.smithi166.stdout:384: writing smithi16641208-384 from 1679074 to 2261863 tid 2 2020-11-16T20:56:01.129 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.129 INFO:tasks.rados.rados.0.smithi166.stdout:369: finishing write tid 3 to smithi16641208-369 2020-11-16T20:56:01.129 INFO:tasks.rados.rados.0.smithi166.stdout:369: finishing write tid 4 to smithi16641208-369 2020-11-16T20:56:01.129 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 369 v 231 (ObjNum 368 snap 0 seq_num 368) dirty exists 2020-11-16T20:56:01.130 INFO:tasks.rados.rados.0.smithi166.stdout:369: left oid 369 (ObjNum 368 snap 0 seq_num 368) 2020-11-16T20:56:01.130 INFO:tasks.rados.rados.0.smithi166.stdout:370: finishing write tid 1 to smithi16641208-370 2020-11-16T20:56:01.130 INFO:tasks.rados.rados.0.smithi166.stdout:370: finishing write tid 2 to smithi16641208-370 2020-11-16T20:56:01.130 INFO:tasks.rados.rados.0.smithi166.stdout:370: finishing write tid 3 to smithi16641208-370 2020-11-16T20:56:01.130 INFO:tasks.rados.rados.0.smithi166.stdout:369: done (15 left) 2020-11-16T20:56:01.130 INFO:tasks.rados.rados.0.smithi166.stdout:385: write initial oid 385 2020-11-16T20:56:01.130 INFO:tasks.rados.rados.0.smithi166.stdout:385: seq_num 384 ranges {453888=713266,1737556=442800} 2020-11-16T20:56:01.131 INFO:tasks.rados.rados.0.smithi166.stdout:385: writing smithi16641208-385 from 453888 to 1167154 tid 1 2020-11-16T20:56:01.131 INFO:tasks.rados.rados.0.smithi166.stdout:385: writing smithi16641208-385 from 1737556 to 2180356 tid 2 2020-11-16T20:56:01.131 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.131 INFO:tasks.rados.rados.0.smithi166.stdout:370: finishing write tid 4 to smithi16641208-370 2020-11-16T20:56:01.131 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 370 v 272 (ObjNum 369 snap 0 seq_num 369) dirty exists 2020-11-16T20:56:01.131 INFO:tasks.rados.rados.0.smithi166.stdout:370: left oid 370 (ObjNum 369 snap 0 seq_num 369) 2020-11-16T20:56:01.131 INFO:tasks.rados.rados.0.smithi166.stdout:371: finishing write tid 1 to smithi16641208-371 2020-11-16T20:56:01.131 INFO:tasks.rados.rados.0.smithi166.stdout:370: done (15 left) 2020-11-16T20:56:01.132 INFO:tasks.rados.rados.0.smithi166.stdout:386: write initial oid 386 2020-11-16T20:56:01.132 INFO:tasks.rados.rados.0.smithi166.stdout:386: seq_num 385 ranges {470695=788515,1679685=586458} 2020-11-16T20:56:01.132 INFO:tasks.rados.rados.0.smithi166.stdout:386: writing smithi16641208-386 from 470695 to 1259210 tid 1 2020-11-16T20:56:01.132 INFO:tasks.rados.rados.0.smithi166.stdout:386: writing smithi16641208-386 from 1679685 to 2266143 tid 2 2020-11-16T20:56:01.132 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.132 INFO:tasks.rados.rados.0.smithi166.stdout:371: finishing write tid 2 to smithi16641208-371 2020-11-16T20:56:01.132 INFO:tasks.rados.rados.0.smithi166.stdout:371: finishing write tid 3 to smithi16641208-371 2020-11-16T20:56:01.133 INFO:tasks.rados.rados.0.smithi166.stdout:371: finishing write tid 4 to smithi16641208-371 2020-11-16T20:56:01.133 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 371 v 272 (ObjNum 370 snap 0 seq_num 370) dirty exists 2020-11-16T20:56:01.133 INFO:tasks.rados.rados.0.smithi166.stdout:371: left oid 371 (ObjNum 370 snap 0 seq_num 370) 2020-11-16T20:56:01.133 INFO:tasks.rados.rados.0.smithi166.stdout:372: finishing write tid 1 to smithi16641208-372 2020-11-16T20:56:01.133 INFO:tasks.rados.rados.0.smithi166.stdout:372: finishing write tid 2 to smithi16641208-372 2020-11-16T20:56:01.133 INFO:tasks.rados.rados.0.smithi166.stdout:373: finishing write tid 1 to smithi16641208-373 2020-11-16T20:56:01.133 INFO:tasks.rados.rados.0.smithi166.stdout:372: finishing write tid 3 to smithi16641208-372 2020-11-16T20:56:01.133 INFO:tasks.rados.rados.0.smithi166.stdout:373: finishing write tid 2 to smithi16641208-373 2020-11-16T20:56:01.134 INFO:tasks.rados.rados.0.smithi166.stdout:372: finishing write tid 4 to smithi16641208-372 2020-11-16T20:56:01.134 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 372 v 275 (ObjNum 371 snap 0 seq_num 371) dirty exists 2020-11-16T20:56:01.134 INFO:tasks.rados.rados.0.smithi166.stdout:372: left oid 372 (ObjNum 371 snap 0 seq_num 371) 2020-11-16T20:56:01.134 INFO:tasks.rados.rados.0.smithi166.stdout:373: finishing write tid 3 to smithi16641208-373 2020-11-16T20:56:01.134 INFO:tasks.rados.rados.0.smithi166.stdout:373: finishing write tid 4 to smithi16641208-373 2020-11-16T20:56:01.134 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 373 v 234 (ObjNum 372 snap 0 seq_num 372) dirty exists 2020-11-16T20:56:01.134 INFO:tasks.rados.rados.0.smithi166.stdout:373: left oid 373 (ObjNum 372 snap 0 seq_num 372) 2020-11-16T20:56:01.135 INFO:tasks.rados.rados.0.smithi166.stdout:374: finishing write tid 1 to smithi16641208-374 2020-11-16T20:56:01.135 INFO:tasks.rados.rados.0.smithi166.stdout:371: done (15 left) 2020-11-16T20:56:01.135 INFO:tasks.rados.rados.0.smithi166.stdout:372: done (14 left) 2020-11-16T20:56:01.135 INFO:tasks.rados.rados.0.smithi166.stdout:373: done (13 left) 2020-11-16T20:56:01.135 INFO:tasks.rados.rados.0.smithi166.stdout:387: write initial oid 387 2020-11-16T20:56:01.135 INFO:tasks.rados.rados.0.smithi166.stdout:387: seq_num 386 ranges {487502=463764,1738167=446469} 2020-11-16T20:56:01.135 INFO:tasks.rados.rados.0.smithi166.stdout:387: writing smithi16641208-387 from 487502 to 951266 tid 1 2020-11-16T20:56:01.135 INFO:tasks.rados.rados.0.smithi166.stdout:387: writing smithi16641208-387 from 1738167 to 2184636 tid 2 2020-11-16T20:56:01.136 INFO:tasks.rados.rados.0.smithi166.stdout:388: write initial oid 388 2020-11-16T20:56:01.136 INFO:tasks.rados.rados.0.smithi166.stdout:388: seq_num 387 ranges {504309=539013,1796649=590127} 2020-11-16T20:56:01.136 INFO:tasks.rados.rados.0.smithi166.stdout:388: writing smithi16641208-388 from 504309 to 1043322 tid 1 2020-11-16T20:56:01.136 INFO:tasks.rados.rados.0.smithi166.stdout:388: writing smithi16641208-388 from 1796649 to 2386776 tid 2 2020-11-16T20:56:01.136 INFO:tasks.rados.rados.0.smithi166.stdout:389: write initial oid 389 2020-11-16T20:56:01.136 INFO:tasks.rados.rados.0.smithi166.stdout:389: seq_num 388 ranges {521116=730615,1971484=549632} 2020-11-16T20:56:01.136 INFO:tasks.rados.rados.0.smithi166.stdout:389: writing smithi16641208-389 from 521116 to 1251731 tid 1 2020-11-16T20:56:01.137 INFO:tasks.rados.rados.0.smithi166.stdout:389: writing smithi16641208-389 from 1971484 to 2521116 tid 2 2020-11-16T20:56:01.137 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.137 INFO:tasks.rados.rados.0.smithi166.stdout:374: finishing write tid 2 to smithi16641208-374 2020-11-16T20:56:01.137 INFO:tasks.rados.rados.0.smithi166.stdout:374: finishing write tid 3 to smithi16641208-374 2020-11-16T20:56:01.137 INFO:tasks.rados.rados.0.smithi166.stdout:374: finishing write tid 4 to smithi16641208-374 2020-11-16T20:56:01.137 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 374 v 237 (ObjNum 373 snap 0 seq_num 373) dirty exists 2020-11-16T20:56:01.137 INFO:tasks.rados.rados.0.smithi166.stdout:374: left oid 374 (ObjNum 373 snap 0 seq_num 373) 2020-11-16T20:56:01.137 INFO:tasks.rados.rados.0.smithi166.stdout:375: finishing write tid 1 to smithi16641208-375 2020-11-16T20:56:01.138 INFO:tasks.rados.rados.0.smithi166.stdout:374: done (15 left) 2020-11-16T20:56:01.138 INFO:tasks.rados.rados.0.smithi166.stdout:390: write initial oid 390 2020-11-16T20:56:01.138 INFO:tasks.rados.rados.0.smithi166.stdout:390: seq_num 389 ranges {537923=405864,1513613=593796} 2020-11-16T20:56:01.138 INFO:tasks.rados.rados.0.smithi166.stdout:390: writing smithi16641208-390 from 537923 to 943787 tid 1 2020-11-16T20:56:01.138 INFO:tasks.rados.rados.0.smithi166.stdout:390: writing smithi16641208-390 from 1513613 to 2107409 tid 2 2020-11-16T20:56:01.138 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.138 INFO:tasks.rados.rados.0.smithi166.stdout:375: finishing write tid 2 to smithi16641208-375 2020-11-16T20:56:01.139 INFO:tasks.rados.rados.0.smithi166.stdout:375: finishing write tid 3 to smithi16641208-375 2020-11-16T20:56:01.139 INFO:tasks.rados.rados.0.smithi166.stdout:375: finishing write tid 4 to smithi16641208-375 2020-11-16T20:56:01.139 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 375 v 273 (ObjNum 374 snap 0 seq_num 374) dirty exists 2020-11-16T20:56:01.139 INFO:tasks.rados.rados.0.smithi166.stdout:375: left oid 375 (ObjNum 374 snap 0 seq_num 374) 2020-11-16T20:56:01.139 INFO:tasks.rados.rados.0.smithi166.stdout:376: finishing write tid 1 to smithi16641208-376 2020-11-16T20:56:01.139 INFO:tasks.rados.rados.0.smithi166.stdout:376: finishing write tid 2 to smithi16641208-376 2020-11-16T20:56:01.139 INFO:tasks.rados.rados.0.smithi166.stdout:377: finishing write tid 1 to smithi16641208-377 2020-11-16T20:56:01.139 INFO:tasks.rados.rados.0.smithi166.stdout:376: finishing write tid 3 to smithi16641208-376 2020-11-16T20:56:01.140 INFO:tasks.rados.rados.0.smithi166.stdout:376: finishing write tid 4 to smithi16641208-376 2020-11-16T20:56:01.140 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 376 v 240 (ObjNum 375 snap 0 seq_num 375) dirty exists 2020-11-16T20:56:01.140 INFO:tasks.rados.rados.0.smithi166.stdout:376: left oid 376 (ObjNum 375 snap 0 seq_num 375) 2020-11-16T20:56:01.140 INFO:tasks.rados.rados.0.smithi166.stdout:378: finishing write tid 1 to smithi16641208-378 2020-11-16T20:56:01.140 INFO:tasks.rados.rados.0.smithi166.stdout:378: finishing write tid 2 to smithi16641208-378 2020-11-16T20:56:01.140 INFO:tasks.rados.rados.0.smithi166.stdout:378: finishing write tid 3 to smithi16641208-378 2020-11-16T20:56:01.140 INFO:tasks.rados.rados.0.smithi166.stdout:378: finishing write tid 4 to smithi16641208-378 2020-11-16T20:56:01.141 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 378 v 277 (ObjNum 377 snap 0 seq_num 377) dirty exists 2020-11-16T20:56:01.141 INFO:tasks.rados.rados.0.smithi166.stdout:378: left oid 378 (ObjNum 377 snap 0 seq_num 377) 2020-11-16T20:56:01.141 INFO:tasks.rados.rados.0.smithi166.stdout:377: finishing write tid 2 to smithi16641208-377 2020-11-16T20:56:01.141 INFO:tasks.rados.rados.0.smithi166.stdout:377: finishing write tid 3 to smithi16641208-377 2020-11-16T20:56:01.141 INFO:tasks.rados.rados.0.smithi166.stdout:377: finishing write tid 4 to smithi16641208-377 2020-11-16T20:56:01.141 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 377 v 242 (ObjNum 376 snap 0 seq_num 376) dirty exists 2020-11-16T20:56:01.141 INFO:tasks.rados.rados.0.smithi166.stdout:377: left oid 377 (ObjNum 376 snap 0 seq_num 376) 2020-11-16T20:56:01.142 INFO:tasks.rados.rados.0.smithi166.stdout:379: finishing write tid 1 to smithi16641208-379 2020-11-16T20:56:01.142 INFO:tasks.rados.rados.0.smithi166.stdout:380: finishing write tid 1 to smithi16641208-380 2020-11-16T20:56:01.142 INFO:tasks.rados.rados.0.smithi166.stdout:379: finishing write tid 2 to smithi16641208-379 2020-11-16T20:56:01.142 INFO:tasks.rados.rados.0.smithi166.stdout:379: finishing write tid 3 to smithi16641208-379 2020-11-16T20:56:01.142 INFO:tasks.rados.rados.0.smithi166.stdout:379: finishing write tid 4 to smithi16641208-379 2020-11-16T20:56:01.142 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 379 v 245 (ObjNum 378 snap 0 seq_num 378) dirty exists 2020-11-16T20:56:01.142 INFO:tasks.rados.rados.0.smithi166.stdout:379: left oid 379 (ObjNum 378 snap 0 seq_num 378) 2020-11-16T20:56:01.142 INFO:tasks.rados.rados.0.smithi166.stdout:380: finishing write tid 2 to smithi16641208-380 2020-11-16T20:56:01.143 INFO:tasks.rados.rados.0.smithi166.stdout:380: finishing write tid 3 to smithi16641208-380 2020-11-16T20:56:01.143 INFO:tasks.rados.rados.0.smithi166.stdout:380: finishing write tid 4 to smithi16641208-380 2020-11-16T20:56:01.143 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 380 v 337 (ObjNum 379 snap 0 seq_num 379) dirty exists 2020-11-16T20:56:01.143 INFO:tasks.rados.rados.0.smithi166.stdout:380: left oid 380 (ObjNum 379 snap 0 seq_num 379) 2020-11-16T20:56:01.143 INFO:tasks.rados.rados.0.smithi166.stdout:381: finishing write tid 1 to smithi16641208-381 2020-11-16T20:56:01.143 INFO:tasks.rados.rados.0.smithi166.stdout:382: finishing write tid 1 to smithi16641208-382 2020-11-16T20:56:01.143 INFO:tasks.rados.rados.0.smithi166.stdout:381: finishing write tid 2 to smithi16641208-381 2020-11-16T20:56:01.144 INFO:tasks.rados.rados.0.smithi166.stdout:381: finishing write tid 3 to smithi16641208-381 2020-11-16T20:56:01.144 INFO:tasks.rados.rados.0.smithi166.stdout:381: finishing write tid 4 to smithi16641208-381 2020-11-16T20:56:01.144 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 381 v 250 (ObjNum 380 snap 0 seq_num 380) dirty exists 2020-11-16T20:56:01.144 INFO:tasks.rados.rados.0.smithi166.stdout:381: left oid 381 (ObjNum 380 snap 0 seq_num 380) 2020-11-16T20:56:01.144 INFO:tasks.rados.rados.0.smithi166.stdout:382: finishing write tid 2 to smithi16641208-382 2020-11-16T20:56:01.144 INFO:tasks.rados.rados.0.smithi166.stdout:382: finishing write tid 3 to smithi16641208-382 2020-11-16T20:56:01.144 INFO:tasks.rados.rados.0.smithi166.stdout:382: finishing write tid 4 to smithi16641208-382 2020-11-16T20:56:01.144 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 382 v 280 (ObjNum 381 snap 0 seq_num 381) dirty exists 2020-11-16T20:56:01.145 INFO:tasks.rados.rados.0.smithi166.stdout:382: left oid 382 (ObjNum 381 snap 0 seq_num 381) 2020-11-16T20:56:01.145 INFO:tasks.rados.rados.0.smithi166.stdout:383: finishing write tid 1 to smithi16641208-383 2020-11-16T20:56:01.145 INFO:tasks.rados.rados.0.smithi166.stdout:383: finishing write tid 2 to smithi16641208-383 2020-11-16T20:56:01.145 INFO:tasks.rados.rados.0.smithi166.stdout:383: finishing write tid 3 to smithi16641208-383 2020-11-16T20:56:01.145 INFO:tasks.rados.rados.0.smithi166.stdout:383: finishing write tid 4 to smithi16641208-383 2020-11-16T20:56:01.145 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 383 v 254 (ObjNum 382 snap 0 seq_num 382) dirty exists 2020-11-16T20:56:01.145 INFO:tasks.rados.rados.0.smithi166.stdout:383: left oid 383 (ObjNum 382 snap 0 seq_num 382) 2020-11-16T20:56:01.145 INFO:tasks.rados.rados.0.smithi166.stdout:384: finishing write tid 1 to smithi16641208-384 2020-11-16T20:56:01.146 INFO:tasks.rados.rados.0.smithi166.stdout:384: finishing write tid 2 to smithi16641208-384 2020-11-16T20:56:01.146 INFO:tasks.rados.rados.0.smithi166.stdout:384: finishing write tid 3 to smithi16641208-384 2020-11-16T20:56:01.146 INFO:tasks.rados.rados.0.smithi166.stdout:384: finishing write tid 4 to smithi16641208-384 2020-11-16T20:56:01.146 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 384 v 257 (ObjNum 383 snap 0 seq_num 383) dirty exists 2020-11-16T20:56:01.146 INFO:tasks.rados.rados.0.smithi166.stdout:384: left oid 384 (ObjNum 383 snap 0 seq_num 383) 2020-11-16T20:56:01.146 INFO:tasks.rados.rados.0.smithi166.stdout:385: finishing write tid 1 to smithi16641208-385 2020-11-16T20:56:01.146 INFO:tasks.rados.rados.0.smithi166.stdout:385: finishing write tid 2 to smithi16641208-385 2020-11-16T20:56:01.147 INFO:tasks.rados.rados.0.smithi166.stdout:385: finishing write tid 3 to smithi16641208-385 2020-11-16T20:56:01.147 INFO:tasks.rados.rados.0.smithi166.stdout:385: finishing write tid 4 to smithi16641208-385 2020-11-16T20:56:01.147 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 385 v 340 (ObjNum 384 snap 0 seq_num 384) dirty exists 2020-11-16T20:56:01.147 INFO:tasks.rados.rados.0.smithi166.stdout:385: left oid 385 (ObjNum 384 snap 0 seq_num 384) 2020-11-16T20:56:01.147 INFO:tasks.rados.rados.0.smithi166.stdout:386: finishing write tid 1 to smithi16641208-386 2020-11-16T20:56:01.147 INFO:tasks.rados.rados.0.smithi166.stdout:386: finishing write tid 2 to smithi16641208-386 2020-11-16T20:56:01.147 INFO:tasks.rados.rados.0.smithi166.stdout:386: finishing write tid 3 to smithi16641208-386 2020-11-16T20:56:01.148 INFO:tasks.rados.rados.0.smithi166.stdout:386: finishing write tid 4 to smithi16641208-386 2020-11-16T20:56:01.148 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 386 v 283 (ObjNum 385 snap 0 seq_num 385) dirty exists 2020-11-16T20:56:01.148 INFO:tasks.rados.rados.0.smithi166.stdout:386: left oid 386 (ObjNum 385 snap 0 seq_num 385) 2020-11-16T20:56:01.148 INFO:tasks.rados.rados.0.smithi166.stdout:387: finishing write tid 1 to smithi16641208-387 2020-11-16T20:56:01.148 INFO:tasks.rados.rados.0.smithi166.stdout:387: finishing write tid 2 to smithi16641208-387 2020-11-16T20:56:01.148 INFO:tasks.rados.rados.0.smithi166.stdout:387: finishing write tid 3 to smithi16641208-387 2020-11-16T20:56:01.148 INFO:tasks.rados.rados.0.smithi166.stdout:387: finishing write tid 4 to smithi16641208-387 2020-11-16T20:56:01.148 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 387 v 343 (ObjNum 386 snap 0 seq_num 386) dirty exists 2020-11-16T20:56:01.149 INFO:tasks.rados.rados.0.smithi166.stdout:387: left oid 387 (ObjNum 386 snap 0 seq_num 386) 2020-11-16T20:56:01.149 INFO:tasks.rados.rados.0.smithi166.stdout:388: finishing write tid 1 to smithi16641208-388 2020-11-16T20:56:01.149 INFO:tasks.rados.rados.0.smithi166.stdout:388: finishing write tid 2 to smithi16641208-388 2020-11-16T20:56:01.149 INFO:tasks.rados.rados.0.smithi166.stdout:388: finishing write tid 3 to smithi16641208-388 2020-11-16T20:56:01.149 INFO:tasks.rados.rados.0.smithi166.stdout:389: finishing write tid 1 to smithi16641208-389 2020-11-16T20:56:01.149 INFO:tasks.rados.rados.0.smithi166.stdout:388: finishing write tid 4 to smithi16641208-388 2020-11-16T20:56:01.149 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 388 v 286 (ObjNum 387 snap 0 seq_num 387) dirty exists 2020-11-16T20:56:01.150 INFO:tasks.rados.rados.0.smithi166.stdout:388: left oid 388 (ObjNum 387 snap 0 seq_num 387) 2020-11-16T20:56:01.150 INFO:tasks.rados.rados.0.smithi166.stdout:389: finishing write tid 2 to smithi16641208-389 2020-11-16T20:56:01.150 INFO:tasks.rados.rados.0.smithi166.stdout:390: finishing write tid 1 to smithi16641208-390 2020-11-16T20:56:01.150 INFO:tasks.rados.rados.0.smithi166.stdout:375: done (15 left) 2020-11-16T20:56:01.150 INFO:tasks.rados.rados.0.smithi166.stdout:376: done (14 left) 2020-11-16T20:56:01.150 INFO:tasks.rados.rados.0.smithi166.stdout:377: done (13 left) 2020-11-16T20:56:01.150 INFO:tasks.rados.rados.0.smithi166.stdout:378: done (12 left) 2020-11-16T20:56:01.151 INFO:tasks.rados.rados.0.smithi166.stdout:379: done (11 left) 2020-11-16T20:56:01.151 INFO:tasks.rados.rados.0.smithi166.stdout:380: done (10 left) 2020-11-16T20:56:01.151 INFO:tasks.rados.rados.0.smithi166.stdout:381: done (9 left) 2020-11-16T20:56:01.151 INFO:tasks.rados.rados.0.smithi166.stdout:382: done (8 left) 2020-11-16T20:56:01.151 INFO:tasks.rados.rados.0.smithi166.stdout:383: done (7 left) 2020-11-16T20:56:01.151 INFO:tasks.rados.rados.0.smithi166.stdout:384: done (6 left) 2020-11-16T20:56:01.151 INFO:tasks.rados.rados.0.smithi166.stdout:385: done (5 left) 2020-11-16T20:56:01.151 INFO:tasks.rados.rados.0.smithi166.stdout:386: done (4 left) 2020-11-16T20:56:01.152 INFO:tasks.rados.rados.0.smithi166.stdout:387: done (3 left) 2020-11-16T20:56:01.152 INFO:tasks.rados.rados.0.smithi166.stdout:388: done (2 left) 2020-11-16T20:56:01.152 INFO:tasks.rados.rados.0.smithi166.stdout:391: write initial oid 391 2020-11-16T20:56:01.152 INFO:tasks.rados.rados.0.smithi166.stdout:391: seq_num 390 ranges {554730=481113,1572095=737454} 2020-11-16T20:56:01.152 INFO:tasks.rados.rados.0.smithi166.stdout:391: writing smithi16641208-391 from 554730 to 1035843 tid 1 2020-11-16T20:56:01.152 INFO:tasks.rados.rados.0.smithi166.stdout:391: writing smithi16641208-391 from 1572095 to 2309549 tid 2 2020-11-16T20:56:01.152 INFO:tasks.rados.rados.0.smithi166.stdout:392: write initial oid 392 2020-11-16T20:56:01.152 INFO:tasks.rados.rados.0.smithi166.stdout:392: seq_num 391 ranges {571537=556362,1630577=597465} 2020-11-16T20:56:01.153 INFO:tasks.rados.rados.0.smithi166.stdout:392: writing smithi16641208-392 from 571537 to 1127899 tid 1 2020-11-16T20:56:01.153 INFO:tasks.rados.rados.0.smithi166.stdout:392: writing smithi16641208-392 from 1630577 to 2228042 tid 2 2020-11-16T20:56:01.153 INFO:tasks.rados.rados.0.smithi166.stdout:393: write initial oid 393 2020-11-16T20:56:01.153 INFO:tasks.rados.rados.0.smithi166.stdout:393: seq_num 392 ranges {588344=631611,1689059=741123} 2020-11-16T20:56:01.153 INFO:tasks.rados.rados.0.smithi166.stdout:393: writing smithi16641208-393 from 588344 to 1219955 tid 1 2020-11-16T20:56:01.153 INFO:tasks.rados.rados.0.smithi166.stdout:393: writing smithi16641208-393 from 1689059 to 2430182 tid 2 2020-11-16T20:56:01.153 INFO:tasks.rados.rados.0.smithi166.stdout:394: write initial oid 394 2020-11-16T20:56:01.154 INFO:tasks.rados.rados.0.smithi166.stdout:394: seq_num 393 ranges {605151=706860,2031188=573963} 2020-11-16T20:56:01.154 INFO:tasks.rados.rados.0.smithi166.stdout:394: writing smithi16641208-394 from 605151 to 1312011 tid 1 2020-11-16T20:56:01.154 INFO:tasks.rados.rados.0.smithi166.stdout:394: writing smithi16641208-394 from 2031188 to 2605151 tid 2 2020-11-16T20:56:01.154 INFO:tasks.rados.rados.0.smithi166.stdout:395: write initial oid 395 2020-11-16T20:56:01.154 INFO:tasks.rados.rados.0.smithi166.stdout:395: seq_num 394 ranges {621958=782109,2089670=532288} 2020-11-16T20:56:01.154 INFO:tasks.rados.rados.0.smithi166.stdout:395: writing smithi16641208-395 from 621958 to 1404067 tid 1 2020-11-16T20:56:01.154 INFO:tasks.rados.rados.0.smithi166.stdout:395: writing smithi16641208-395 from 2089670 to 2621958 tid 2 2020-11-16T20:56:01.154 INFO:tasks.rados.rados.0.smithi166.stdout:396: write initial oid 396 2020-11-16T20:56:01.155 INFO:tasks.rados.rados.0.smithi166.stdout:396: seq_num 395 ranges {638765=457358,1748152=604803} 2020-11-16T20:56:01.155 INFO:tasks.rados.rados.0.smithi166.stdout:396: writing smithi16641208-396 from 638765 to 1096123 tid 1 2020-11-16T20:56:01.155 INFO:tasks.rados.rados.0.smithi166.stdout:396: writing smithi16641208-396 from 1748152 to 2352955 tid 2 2020-11-16T20:56:01.155 INFO:tasks.rados.rados.0.smithi166.stdout:397: write initial oid 397 2020-11-16T20:56:01.155 INFO:tasks.rados.rados.0.smithi166.stdout:397: seq_num 396 ranges {655572=648960,1922987=732585} 2020-11-16T20:56:01.155 INFO:tasks.rados.rados.0.smithi166.stdout:397: writing smithi16641208-397 from 655572 to 1304532 tid 1 2020-11-16T20:56:01.155 INFO:tasks.rados.rados.0.smithi166.stdout:397: writing smithi16641208-397 from 1922987 to 2655572 tid 2 2020-11-16T20:56:01.156 INFO:tasks.rados.rados.0.smithi166.stdout:398: write initial oid 398 2020-11-16T20:56:01.156 INFO:tasks.rados.rados.0.smithi166.stdout:398: seq_num 397 ranges {672379=724209,1865116=608472} 2020-11-16T20:56:01.156 INFO:tasks.rados.rados.0.smithi166.stdout:398: writing smithi16641208-398 from 672379 to 1396588 tid 1 2020-11-16T20:56:01.156 INFO:tasks.rados.rados.0.smithi166.stdout:398: writing smithi16641208-398 from 1865116 to 2473588 tid 2 2020-11-16T20:56:01.156 INFO:tasks.rados.rados.0.smithi166.stdout:399: write initial oid 399 2020-11-16T20:56:01.156 INFO:tasks.rados.rados.0.smithi166.stdout:399: seq_num 398 ranges {689186=799458,1923598=752130} 2020-11-16T20:56:01.156 INFO:tasks.rados.rados.0.smithi166.stdout:399: writing smithi16641208-399 from 689186 to 1488644 tid 1 2020-11-16T20:56:01.156 INFO:tasks.rados.rados.0.smithi166.stdout:399: writing smithi16641208-399 from 1923598 to 2675728 tid 2 2020-11-16T20:56:01.157 INFO:tasks.rados.rados.0.smithi166.stdout:400: write initial oid 400 2020-11-16T20:56:01.157 INFO:tasks.rados.rados.0.smithi166.stdout:400: seq_num 399 ranges {705993=474707,1582080=612141} 2020-11-16T20:56:01.157 INFO:tasks.rados.rados.0.smithi166.stdout:400: writing smithi16641208-400 from 705993 to 1180700 tid 1 2020-11-16T20:56:01.157 INFO:tasks.rados.rados.0.smithi166.stdout:400: writing smithi16641208-400 from 1582080 to 2194221 tid 2 2020-11-16T20:56:01.157 INFO:tasks.rados.rados.0.smithi166.stdout:401: write initial oid 401 2020-11-16T20:56:01.157 INFO:tasks.rados.rados.0.smithi166.stdout:401: seq_num 400 ranges {722800=549956,2040562=682238} 2020-11-16T20:56:01.157 INFO:tasks.rados.rados.0.smithi166.stdout:401: writing smithi16641208-401 from 722800 to 1272756 tid 1 2020-11-16T20:56:01.158 INFO:tasks.rados.rados.0.smithi166.stdout:401: writing smithi16641208-401 from 2040562 to 2722800 tid 2 2020-11-16T20:56:01.158 INFO:tasks.rados.rados.0.smithi166.stdout:402: write initial oid 402 2020-11-16T20:56:01.158 INFO:tasks.rados.rados.0.smithi166.stdout:402: seq_num 401 ranges {739607=625205,1982691=499457} 2020-11-16T20:56:01.158 INFO:tasks.rados.rados.0.smithi166.stdout:402: writing smithi16641208-402 from 739607 to 1364812 tid 1 2020-11-16T20:56:01.158 INFO:tasks.rados.rados.0.smithi166.stdout:402: writing smithi16641208-402 from 1982691 to 2482148 tid 2 2020-11-16T20:56:01.158 INFO:tasks.rados.rados.0.smithi166.stdout:403: write initial oid 403 2020-11-16T20:56:01.158 INFO:tasks.rados.rados.0.smithi166.stdout:403: seq_num 402 ranges {756414=700454,2041173=715241} 2020-11-16T20:56:01.158 INFO:tasks.rados.rados.0.smithi166.stdout:403: writing smithi16641208-403 from 756414 to 1456868 tid 1 2020-11-16T20:56:01.159 INFO:tasks.rados.rados.0.smithi166.stdout:403: writing smithi16641208-403 from 2041173 to 2756414 tid 2 2020-11-16T20:56:01.159 INFO:tasks.rados.rados.0.smithi166.stdout:404: write initial oid 404 2020-11-16T20:56:01.159 INFO:tasks.rados.rados.0.smithi166.stdout:404: seq_num 403 ranges {773221=492056,1816008=503126} 2020-11-16T20:56:01.159 INFO:tasks.rados.rados.0.smithi166.stdout:404: writing smithi16641208-404 from 773221 to 1265277 tid 1 2020-11-16T20:56:01.159 INFO:tasks.rados.rados.0.smithi166.stdout:404: writing smithi16641208-404 from 1816008 to 2319134 tid 2 2020-11-16T20:56:01.159 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.159 INFO:tasks.rados.rados.0.smithi166.stdout:390: finishing write tid 2 to smithi16641208-390 2020-11-16T20:56:01.159 INFO:tasks.rados.rados.0.smithi166.stdout:390: finishing write tid 3 to smithi16641208-390 2020-11-16T20:56:01.160 INFO:tasks.rados.rados.0.smithi166.stdout:390: finishing write tid 4 to smithi16641208-390 2020-11-16T20:56:01.160 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 390 v 289 (ObjNum 389 snap 0 seq_num 389) dirty exists 2020-11-16T20:56:01.160 INFO:tasks.rados.rados.0.smithi166.stdout:390: left oid 390 (ObjNum 389 snap 0 seq_num 389) 2020-11-16T20:56:01.160 INFO:tasks.rados.rados.0.smithi166.stdout:389: finishing write tid 3 to smithi16641208-389 2020-11-16T20:56:01.160 INFO:tasks.rados.rados.0.smithi166.stdout:391: finishing write tid 1 to smithi16641208-391 2020-11-16T20:56:01.160 INFO:tasks.rados.rados.0.smithi166.stdout:389: finishing write tid 4 to smithi16641208-389 2020-11-16T20:56:01.160 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 389 v 276 (ObjNum 388 snap 0 seq_num 388) dirty exists 2020-11-16T20:56:01.161 INFO:tasks.rados.rados.0.smithi166.stdout:389: left oid 389 (ObjNum 388 snap 0 seq_num 388) 2020-11-16T20:56:01.161 INFO:tasks.rados.rados.0.smithi166.stdout:391: finishing write tid 2 to smithi16641208-391 2020-11-16T20:56:01.161 INFO:tasks.rados.rados.0.smithi166.stdout:391: finishing write tid 3 to smithi16641208-391 2020-11-16T20:56:01.161 INFO:tasks.rados.rados.0.smithi166.stdout:391: finishing write tid 4 to smithi16641208-391 2020-11-16T20:56:01.161 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 391 v 346 (ObjNum 390 snap 0 seq_num 390) dirty exists 2020-11-16T20:56:01.161 INFO:tasks.rados.rados.0.smithi166.stdout:391: left oid 391 (ObjNum 390 snap 0 seq_num 390) 2020-11-16T20:56:01.161 INFO:tasks.rados.rados.0.smithi166.stdout:392: finishing write tid 1 to smithi16641208-392 2020-11-16T20:56:01.161 INFO:tasks.rados.rados.0.smithi166.stdout:392: finishing write tid 2 to smithi16641208-392 2020-11-16T20:56:01.162 INFO:tasks.rados.rados.0.smithi166.stdout:392: finishing write tid 3 to smithi16641208-392 2020-11-16T20:56:01.162 INFO:tasks.rados.rados.0.smithi166.stdout:392: finishing write tid 4 to smithi16641208-392 2020-11-16T20:56:01.162 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 392 v 349 (ObjNum 391 snap 0 seq_num 391) dirty exists 2020-11-16T20:56:01.162 INFO:tasks.rados.rados.0.smithi166.stdout:392: left oid 392 (ObjNum 391 snap 0 seq_num 391) 2020-11-16T20:56:01.162 INFO:tasks.rados.rados.0.smithi166.stdout:393: finishing write tid 1 to smithi16641208-393 2020-11-16T20:56:01.162 INFO:tasks.rados.rados.0.smithi166.stdout:393: finishing write tid 2 to smithi16641208-393 2020-11-16T20:56:01.162 INFO:tasks.rados.rados.0.smithi166.stdout:393: finishing write tid 3 to smithi16641208-393 2020-11-16T20:56:01.163 INFO:tasks.rados.rados.0.smithi166.stdout:393: finishing write tid 4 to smithi16641208-393 2020-11-16T20:56:01.163 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 393 v 278 (ObjNum 392 snap 0 seq_num 392) dirty exists 2020-11-16T20:56:01.163 INFO:tasks.rados.rados.0.smithi166.stdout:393: left oid 393 (ObjNum 392 snap 0 seq_num 392) 2020-11-16T20:56:01.163 INFO:tasks.rados.rados.0.smithi166.stdout:394: finishing write tid 1 to smithi16641208-394 2020-11-16T20:56:01.163 INFO:tasks.rados.rados.0.smithi166.stdout:394: finishing write tid 2 to smithi16641208-394 2020-11-16T20:56:01.163 INFO:tasks.rados.rados.0.smithi166.stdout:394: finishing write tid 3 to smithi16641208-394 2020-11-16T20:56:01.163 INFO:tasks.rados.rados.0.smithi166.stdout:394: finishing write tid 4 to smithi16641208-394 2020-11-16T20:56:01.163 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 394 v 352 (ObjNum 393 snap 0 seq_num 393) dirty exists 2020-11-16T20:56:01.164 INFO:tasks.rados.rados.0.smithi166.stdout:394: left oid 394 (ObjNum 393 snap 0 seq_num 393) 2020-11-16T20:56:01.164 INFO:tasks.rados.rados.0.smithi166.stdout:395: finishing write tid 1 to smithi16641208-395 2020-11-16T20:56:01.164 INFO:tasks.rados.rados.0.smithi166.stdout:395: finishing write tid 2 to smithi16641208-395 2020-11-16T20:56:01.164 INFO:tasks.rados.rados.0.smithi166.stdout:395: finishing write tid 3 to smithi16641208-395 2020-11-16T20:56:01.164 INFO:tasks.rados.rados.0.smithi166.stdout:395: finishing write tid 4 to smithi16641208-395 2020-11-16T20:56:01.164 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 395 v 281 (ObjNum 394 snap 0 seq_num 394) dirty exists 2020-11-16T20:56:01.164 INFO:tasks.rados.rados.0.smithi166.stdout:395: left oid 395 (ObjNum 394 snap 0 seq_num 394) 2020-11-16T20:56:01.164 INFO:tasks.rados.rados.0.smithi166.stdout:396: finishing write tid 1 to smithi16641208-396 2020-11-16T20:56:01.165 INFO:tasks.rados.rados.0.smithi166.stdout:396: finishing write tid 2 to smithi16641208-396 2020-11-16T20:56:01.165 INFO:tasks.rados.rados.0.smithi166.stdout:396: finishing write tid 3 to smithi16641208-396 2020-11-16T20:56:01.165 INFO:tasks.rados.rados.0.smithi166.stdout:396: finishing write tid 4 to smithi16641208-396 2020-11-16T20:56:01.165 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 396 v 284 (ObjNum 395 snap 0 seq_num 395) dirty exists 2020-11-16T20:56:01.165 INFO:tasks.rados.rados.0.smithi166.stdout:396: left oid 396 (ObjNum 395 snap 0 seq_num 395) 2020-11-16T20:56:01.165 INFO:tasks.rados.rados.0.smithi166.stdout:397: finishing write tid 1 to smithi16641208-397 2020-11-16T20:56:01.165 INFO:tasks.rados.rados.0.smithi166.stdout:397: finishing write tid 2 to smithi16641208-397 2020-11-16T20:56:01.166 INFO:tasks.rados.rados.0.smithi166.stdout:397: finishing write tid 3 to smithi16641208-397 2020-11-16T20:56:01.166 INFO:tasks.rados.rados.0.smithi166.stdout:397: finishing write tid 4 to smithi16641208-397 2020-11-16T20:56:01.166 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 397 v 287 (ObjNum 396 snap 0 seq_num 396) dirty exists 2020-11-16T20:56:01.166 INFO:tasks.rados.rados.0.smithi166.stdout:397: left oid 397 (ObjNum 396 snap 0 seq_num 396) 2020-11-16T20:56:01.166 INFO:tasks.rados.rados.0.smithi166.stdout:398: finishing write tid 1 to smithi16641208-398 2020-11-16T20:56:01.166 INFO:tasks.rados.rados.0.smithi166.stdout:398: finishing write tid 2 to smithi16641208-398 2020-11-16T20:56:01.166 INFO:tasks.rados.rados.0.smithi166.stdout:398: finishing write tid 3 to smithi16641208-398 2020-11-16T20:56:01.167 INFO:tasks.rados.rados.0.smithi166.stdout:398: finishing write tid 4 to smithi16641208-398 2020-11-16T20:56:01.167 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 398 v 290 (ObjNum 397 snap 0 seq_num 397) dirty exists 2020-11-16T20:56:01.167 INFO:tasks.rados.rados.0.smithi166.stdout:398: left oid 398 (ObjNum 397 snap 0 seq_num 397) 2020-11-16T20:56:01.167 INFO:tasks.rados.rados.0.smithi166.stdout:399: finishing write tid 1 to smithi16641208-399 2020-11-16T20:56:01.167 INFO:tasks.rados.rados.0.smithi166.stdout:399: finishing write tid 2 to smithi16641208-399 2020-11-16T20:56:01.167 INFO:tasks.rados.rados.0.smithi166.stdout:399: finishing write tid 3 to smithi16641208-399 2020-11-16T20:56:01.167 INFO:tasks.rados.rados.0.smithi166.stdout:399: finishing write tid 4 to smithi16641208-399 2020-11-16T20:56:01.168 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 399 v 292 (ObjNum 398 snap 0 seq_num 398) dirty exists 2020-11-16T20:56:01.168 INFO:tasks.rados.rados.0.smithi166.stdout:399: left oid 399 (ObjNum 398 snap 0 seq_num 398) 2020-11-16T20:56:01.168 INFO:tasks.rados.rados.0.smithi166.stdout:400: finishing write tid 1 to smithi16641208-400 2020-11-16T20:56:01.168 INFO:tasks.rados.rados.0.smithi166.stdout:400: finishing write tid 2 to smithi16641208-400 2020-11-16T20:56:01.168 INFO:tasks.rados.rados.0.smithi166.stdout:400: finishing write tid 3 to smithi16641208-400 2020-11-16T20:56:01.168 INFO:tasks.rados.rados.0.smithi166.stdout:400: finishing write tid 4 to smithi16641208-400 2020-11-16T20:56:01.168 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 400 v 355 (ObjNum 399 snap 0 seq_num 399) dirty exists 2020-11-16T20:56:01.168 INFO:tasks.rados.rados.0.smithi166.stdout:400: left oid 400 (ObjNum 399 snap 0 seq_num 399) 2020-11-16T20:56:01.169 INFO:tasks.rados.rados.0.smithi166.stdout:401: finishing write tid 1 to smithi16641208-401 2020-11-16T20:56:01.169 INFO:tasks.rados.rados.0.smithi166.stdout:401: finishing write tid 2 to smithi16641208-401 2020-11-16T20:56:01.169 INFO:tasks.rados.rados.0.smithi166.stdout:401: finishing write tid 3 to smithi16641208-401 2020-11-16T20:56:01.169 INFO:tasks.rados.rados.0.smithi166.stdout:401: finishing write tid 4 to smithi16641208-401 2020-11-16T20:56:01.169 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 401 v 260 (ObjNum 400 snap 0 seq_num 400) dirty exists 2020-11-16T20:56:01.169 INFO:tasks.rados.rados.0.smithi166.stdout:401: left oid 401 (ObjNum 400 snap 0 seq_num 400) 2020-11-16T20:56:01.169 INFO:tasks.rados.rados.0.smithi166.stdout:402: finishing write tid 1 to smithi16641208-402 2020-11-16T20:56:01.169 INFO:tasks.rados.rados.0.smithi166.stdout:402: finishing write tid 2 to smithi16641208-402 2020-11-16T20:56:01.170 INFO:tasks.rados.rados.0.smithi166.stdout:402: finishing write tid 3 to smithi16641208-402 2020-11-16T20:56:01.170 INFO:tasks.rados.rados.0.smithi166.stdout:402: finishing write tid 4 to smithi16641208-402 2020-11-16T20:56:01.170 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 402 v 261 (ObjNum 401 snap 0 seq_num 401) dirty exists 2020-11-16T20:56:01.170 INFO:tasks.rados.rados.0.smithi166.stdout:402: left oid 402 (ObjNum 401 snap 0 seq_num 401) 2020-11-16T20:56:01.170 INFO:tasks.rados.rados.0.smithi166.stdout:403: finishing write tid 1 to smithi16641208-403 2020-11-16T20:56:01.170 INFO:tasks.rados.rados.0.smithi166.stdout:403: finishing write tid 2 to smithi16641208-403 2020-11-16T20:56:01.170 INFO:tasks.rados.rados.0.smithi166.stdout:403: finishing write tid 3 to smithi16641208-403 2020-11-16T20:56:01.171 INFO:tasks.rados.rados.0.smithi166.stdout:403: finishing write tid 4 to smithi16641208-403 2020-11-16T20:56:01.171 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 403 v 264 (ObjNum 402 snap 0 seq_num 402) dirty exists 2020-11-16T20:56:01.171 INFO:tasks.rados.rados.0.smithi166.stdout:403: left oid 403 (ObjNum 402 snap 0 seq_num 402) 2020-11-16T20:56:01.171 INFO:tasks.rados.rados.0.smithi166.stdout:404: finishing write tid 1 to smithi16641208-404 2020-11-16T20:56:01.171 INFO:tasks.rados.rados.0.smithi166.stdout:389: done (15 left) 2020-11-16T20:56:01.171 INFO:tasks.rados.rados.0.smithi166.stdout:390: done (14 left) 2020-11-16T20:56:01.171 INFO:tasks.rados.rados.0.smithi166.stdout:391: done (13 left) 2020-11-16T20:56:01.172 INFO:tasks.rados.rados.0.smithi166.stdout:392: done (12 left) 2020-11-16T20:56:01.172 INFO:tasks.rados.rados.0.smithi166.stdout:393: done (11 left) 2020-11-16T20:56:01.172 INFO:tasks.rados.rados.0.smithi166.stdout:394: done (10 left) 2020-11-16T20:56:01.172 INFO:tasks.rados.rados.0.smithi166.stdout:395: done (9 left) 2020-11-16T20:56:01.172 INFO:tasks.rados.rados.0.smithi166.stdout:396: done (8 left) 2020-11-16T20:56:01.172 INFO:tasks.rados.rados.0.smithi166.stdout:397: done (7 left) 2020-11-16T20:56:01.172 INFO:tasks.rados.rados.0.smithi166.stdout:398: done (6 left) 2020-11-16T20:56:01.172 INFO:tasks.rados.rados.0.smithi166.stdout:399: done (5 left) 2020-11-16T20:56:01.173 INFO:tasks.rados.rados.0.smithi166.stdout:400: done (4 left) 2020-11-16T20:56:01.173 INFO:tasks.rados.rados.0.smithi166.stdout:401: done (3 left) 2020-11-16T20:56:01.173 INFO:tasks.rados.rados.0.smithi166.stdout:402: done (2 left) 2020-11-16T20:56:01.173 INFO:tasks.rados.rados.0.smithi166.stdout:403: done (1 left) 2020-11-16T20:56:01.173 INFO:tasks.rados.rados.0.smithi166.stdout:405: write initial oid 405 2020-11-16T20:56:01.173 INFO:tasks.rados.rados.0.smithi166.stdout:405: seq_num 404 ranges {790028=567305,1874490=763137} 2020-11-16T20:56:01.173 INFO:tasks.rados.rados.0.smithi166.stdout:405: writing smithi16641208-405 from 790028 to 1357333 tid 1 2020-11-16T20:56:01.173 INFO:tasks.rados.rados.0.smithi166.stdout:405: writing smithi16641208-405 from 1874490 to 2637627 tid 2 2020-11-16T20:56:01.174 INFO:tasks.rados.rados.0.smithi166.stdout:406: write initial oid 406 2020-11-16T20:56:01.174 INFO:tasks.rados.rados.0.smithi166.stdout:406: seq_num 405 ranges {406835=642554,1532972=506795,2772312=34523} 2020-11-16T20:56:01.174 INFO:tasks.rados.rados.0.smithi166.stdout:406: writing smithi16641208-406 from 406835 to 1049389 tid 1 2020-11-16T20:56:01.174 INFO:tasks.rados.rados.0.smithi166.stdout:406: writing smithi16641208-406 from 1532972 to 2039767 tid 2 2020-11-16T20:56:01.174 INFO:tasks.rados.rados.0.smithi166.stdout:406: writing smithi16641208-406 from 2772312 to 2806835 tid 3 2020-11-16T20:56:01.174 INFO:tasks.rados.rados.0.smithi166.stdout:407: write initial oid 407 2020-11-16T20:56:01.174 INFO:tasks.rados.rados.0.smithi166.stdout:407: seq_num 406 ranges {423642=717803,1875101=766806} 2020-11-16T20:56:01.175 INFO:tasks.rados.rados.0.smithi166.stdout:407: writing smithi16641208-407 from 423642 to 1141445 tid 1 2020-11-16T20:56:01.175 INFO:tasks.rados.rados.0.smithi166.stdout:407: writing smithi16641208-407 from 1875101 to 2641907 tid 2 2020-11-16T20:56:01.175 INFO:tasks.rados.rados.0.smithi166.stdout:408: write initial oid 408 2020-11-16T20:56:01.175 INFO:tasks.rados.rados.0.smithi166.stdout:408: seq_num 407 ranges {440449=793052,1933583=510464} 2020-11-16T20:56:01.175 INFO:tasks.rados.rados.0.smithi166.stdout:408: writing smithi16641208-408 from 440449 to 1233501 tid 1 2020-11-16T20:56:01.175 INFO:tasks.rados.rados.0.smithi166.stdout:408: writing smithi16641208-408 from 1933583 to 2444047 tid 2 2020-11-16T20:56:01.175 INFO:tasks.rados.rados.0.smithi166.stdout:409: write initial oid 409 2020-11-16T20:56:01.175 INFO:tasks.rados.rados.0.smithi166.stdout:409: seq_num 408 ranges {457256=468301,1592065=770475,2854581=2675} 2020-11-16T20:56:01.176 INFO:tasks.rados.rados.0.smithi166.stdout:409: writing smithi16641208-409 from 457256 to 925557 tid 1 2020-11-16T20:56:01.176 INFO:tasks.rados.rados.0.smithi166.stdout:409: writing smithi16641208-409 from 1592065 to 2362540 tid 2 2020-11-16T20:56:01.176 INFO:tasks.rados.rados.0.smithi166.stdout:409: writing smithi16641208-409 from 2854581 to 2857256 tid 3 2020-11-16T20:56:01.176 INFO:tasks.rados.rados.0.smithi166.stdout:410: write initial oid 410 2020-11-16T20:56:01.176 INFO:tasks.rados.rados.0.smithi166.stdout:410: seq_num 409 ranges {474063=543550,1650547=514133,2765651=108412} 2020-11-16T20:56:01.176 INFO:tasks.rados.rados.0.smithi166.stdout:410: writing smithi16641208-410 from 474063 to 1017613 tid 1 2020-11-16T20:56:01.176 INFO:tasks.rados.rados.0.smithi166.stdout:410: writing smithi16641208-410 from 1650547 to 2164680 tid 2 2020-11-16T20:56:01.177 INFO:tasks.rados.rados.0.smithi166.stdout:410: writing smithi16641208-410 from 2765651 to 2874063 tid 3 2020-11-16T20:56:01.177 INFO:tasks.rados.rados.0.smithi166.stdout:411: write initial oid 411 2020-11-16T20:56:01.177 INFO:tasks.rados.rados.0.smithi166.stdout:411: seq_num 410 ranges {490870=618799,1592676=774144,2793074=97796} 2020-11-16T20:56:01.177 INFO:tasks.rados.rados.0.smithi166.stdout:411: writing smithi16641208-411 from 490870 to 1109669 tid 1 2020-11-16T20:56:01.177 INFO:tasks.rados.rados.0.smithi166.stdout:411: writing smithi16641208-411 from 1592676 to 2366820 tid 2 2020-11-16T20:56:01.177 INFO:tasks.rados.rados.0.smithi166.stdout:411: writing smithi16641208-411 from 2793074 to 2890870 tid 3 2020-11-16T20:56:01.177 INFO:tasks.rados.rados.0.smithi166.stdout:412: write initial oid 412 2020-11-16T20:56:01.177 INFO:tasks.rados.rados.0.smithi166.stdout:412: seq_num 411 ranges {507677=410401,1367511=517802,2420497=487180} 2020-11-16T20:56:01.178 INFO:tasks.rados.rados.0.smithi166.stdout:412: writing smithi16641208-412 from 507677 to 918078 tid 1 2020-11-16T20:56:01.178 INFO:tasks.rados.rados.0.smithi166.stdout:412: writing smithi16641208-412 from 1367511 to 1885313 tid 2 2020-11-16T20:56:01.178 INFO:tasks.rados.rados.0.smithi166.stdout:412: writing smithi16641208-412 from 2420497 to 2907677 tid 3 2020-11-16T20:56:01.178 INFO:tasks.rados.rados.0.smithi166.stdout:413: write initial oid 413 2020-11-16T20:56:01.178 INFO:tasks.rados.rados.0.smithi166.stdout:413: seq_num 412 ranges {524484=485650,1425993=661460,2847920=76564} 2020-11-16T20:56:01.178 INFO:tasks.rados.rados.0.smithi166.stdout:413: writing smithi16641208-413 from 524484 to 1010134 tid 1 2020-11-16T20:56:01.178 INFO:tasks.rados.rados.0.smithi166.stdout:413: writing smithi16641208-413 from 1425993 to 2087453 tid 2 2020-11-16T20:56:01.178 INFO:tasks.rados.rados.0.smithi166.stdout:413: writing smithi16641208-413 from 2847920 to 2924484 tid 3 2020-11-16T20:56:01.179 INFO:tasks.rados.rados.0.smithi166.stdout:414: write initial oid 414 2020-11-16T20:56:01.179 INFO:tasks.rados.rados.0.smithi166.stdout:414: seq_num 413 ranges {541291=560899,1884475=521471} 2020-11-16T20:56:01.179 INFO:tasks.rados.rados.0.smithi166.stdout:414: writing smithi16641208-414 from 541291 to 1102190 tid 1 2020-11-16T20:56:01.179 INFO:tasks.rados.rados.0.smithi166.stdout:414: writing smithi16641208-414 from 1884475 to 2405946 tid 2 2020-11-16T20:56:01.179 INFO:tasks.rados.rados.0.smithi166.stdout:415: write initial oid 415 2020-11-16T20:56:01.179 INFO:tasks.rados.rados.0.smithi166.stdout:415: seq_num 414 ranges {558098=636148,1826604=665129} 2020-11-16T20:56:01.179 INFO:tasks.rados.rados.0.smithi166.stdout:415: writing smithi16641208-415 from 558098 to 1194246 tid 1 2020-11-16T20:56:01.180 INFO:tasks.rados.rados.0.smithi166.stdout:415: writing smithi16641208-415 from 1826604 to 2491733 tid 2 2020-11-16T20:56:01.180 INFO:tasks.rados.rados.0.smithi166.stdout:416: write initial oid 416 2020-11-16T20:56:01.180 INFO:tasks.rados.rados.0.smithi166.stdout:404: finishing write tid 2 to smithi16641208-404 2020-11-16T20:56:01.180 INFO:tasks.rados.rados.0.smithi166.stdout:416: seq_num 415 ranges {574905=711397,1885086=525140,2930189=44716} 2020-11-16T20:56:01.180 INFO:tasks.rados.rados.0.smithi166.stdout:416: writing smithi16641208-416 from 574905 to 1286302 tid 1 2020-11-16T20:56:01.180 INFO:tasks.rados.rados.0.smithi166.stdout:416: writing smithi16641208-416 from 1885086 to 2410226 tid 2 2020-11-16T20:56:01.180 INFO:tasks.rados.rados.0.smithi166.stdout:416: writing smithi16641208-416 from 2930189 to 2974905 tid 3 2020-11-16T20:56:01.180 INFO:tasks.rados.rados.0.smithi166.stdout:417: write initial oid 417 2020-11-16T20:56:01.181 INFO:tasks.rados.rados.0.smithi166.stdout:417: seq_num 416 ranges {591712=786646,1943568=668798} 2020-11-16T20:56:01.181 INFO:tasks.rados.rados.0.smithi166.stdout:417: writing smithi16641208-417 from 591712 to 1378358 tid 1 2020-11-16T20:56:01.181 INFO:tasks.rados.rados.0.smithi166.stdout:417: writing smithi16641208-417 from 1943568 to 2612366 tid 2 2020-11-16T20:56:01.181 INFO:tasks.rados.rados.0.smithi166.stdout:418: write initial oid 418 2020-11-16T20:56:01.181 INFO:tasks.rados.rados.0.smithi166.stdout:418: seq_num 417 ranges {608519=461895,1602050=528809,2585035=423484} 2020-11-16T20:56:01.181 INFO:tasks.rados.rados.0.smithi166.stdout:418: writing smithi16641208-418 from 608519 to 1070414 tid 1 2020-11-16T20:56:01.181 INFO:tasks.rados.rados.0.smithi166.stdout:418: writing smithi16641208-418 from 1602050 to 2130859 tid 2 2020-11-16T20:56:01.182 INFO:tasks.rados.rados.0.smithi166.stdout:418: writing smithi16641208-418 from 2585035 to 3008519 tid 3 2020-11-16T20:56:01.182 INFO:tasks.rados.rados.0.smithi166.stdout:419: write initial oid 419 2020-11-16T20:56:01.182 INFO:tasks.rados.rados.0.smithi166.stdout:419: seq_num 418 ranges {625326=537144,1944179=672467} 2020-11-16T20:56:01.182 INFO:tasks.rados.rados.0.smithi166.stdout:419: writing smithi16641208-419 from 625326 to 1162470 tid 1 2020-11-16T20:56:01.182 INFO:tasks.rados.rados.0.smithi166.stdout:419: writing smithi16641208-419 from 1944179 to 2616646 tid 2 2020-11-16T20:56:01.182 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.182 INFO:tasks.rados.rados.0.smithi166.stdout:404: finishing write tid 3 to smithi16641208-404 2020-11-16T20:56:01.182 INFO:tasks.rados.rados.0.smithi166.stdout:404: finishing write tid 4 to smithi16641208-404 2020-11-16T20:56:01.183 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 404 v 291 (ObjNum 403 snap 0 seq_num 403) dirty exists 2020-11-16T20:56:01.183 INFO:tasks.rados.rados.0.smithi166.stdout:404: left oid 404 (ObjNum 403 snap 0 seq_num 403) 2020-11-16T20:56:01.183 INFO:tasks.rados.rados.0.smithi166.stdout:405: finishing write tid 1 to smithi16641208-405 2020-11-16T20:56:01.183 INFO:tasks.rados.rados.0.smithi166.stdout:405: finishing write tid 2 to smithi16641208-405 2020-11-16T20:56:01.183 INFO:tasks.rados.rados.0.smithi166.stdout:404: done (15 left) 2020-11-16T20:56:01.183 INFO:tasks.rados.rados.0.smithi166.stdout:420: write initial oid 420 2020-11-16T20:56:01.183 INFO:tasks.rados.rados.0.smithi166.stdout:420: seq_num 419 ranges {642133=728746,2119014=532478} 2020-11-16T20:56:01.184 INFO:tasks.rados.rados.0.smithi166.stdout:420: writing smithi16641208-420 from 642133 to 1370879 tid 1 2020-11-16T20:56:01.184 INFO:tasks.rados.rados.0.smithi166.stdout:420: writing smithi16641208-420 from 2119014 to 2651492 tid 2 2020-11-16T20:56:01.184 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.184 INFO:tasks.rados.rados.0.smithi166.stdout:405: finishing write tid 3 to smithi16641208-405 2020-11-16T20:56:01.184 INFO:tasks.rados.rados.0.smithi166.stdout:405: finishing write tid 4 to smithi16641208-405 2020-11-16T20:56:01.184 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 405 v 267 (ObjNum 404 snap 0 seq_num 404) dirty exists 2020-11-16T20:56:01.184 INFO:tasks.rados.rados.0.smithi166.stdout:405: left oid 405 (ObjNum 404 snap 0 seq_num 404) 2020-11-16T20:56:01.184 INFO:tasks.rados.rados.0.smithi166.stdout:406: finishing write tid 1 to smithi16641208-406 2020-11-16T20:56:01.185 INFO:tasks.rados.rados.0.smithi166.stdout:406: finishing write tid 2 to smithi16641208-406 2020-11-16T20:56:01.185 INFO:tasks.rados.rados.0.smithi166.stdout:406: finishing write tid 3 to smithi16641208-406 2020-11-16T20:56:01.185 INFO:tasks.rados.rados.0.smithi166.stdout:406: finishing write tid 4 to smithi16641208-406 2020-11-16T20:56:01.185 INFO:tasks.rados.rados.0.smithi166.stdout:406: finishing write tid 5 to smithi16641208-406 2020-11-16T20:56:01.185 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 406 v 296 (ObjNum 405 snap 0 seq_num 405) dirty exists 2020-11-16T20:56:01.185 INFO:tasks.rados.rados.0.smithi166.stdout:406: left oid 406 (ObjNum 405 snap 0 seq_num 405) 2020-11-16T20:56:01.185 INFO:tasks.rados.rados.0.smithi166.stdout:407: finishing write tid 1 to smithi16641208-407 2020-11-16T20:56:01.185 INFO:tasks.rados.rados.0.smithi166.stdout:407: finishing write tid 2 to smithi16641208-407 2020-11-16T20:56:01.186 INFO:tasks.rados.rados.0.smithi166.stdout:407: finishing write tid 3 to smithi16641208-407 2020-11-16T20:56:01.186 INFO:tasks.rados.rados.0.smithi166.stdout:407: finishing write tid 4 to smithi16641208-407 2020-11-16T20:56:01.186 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 407 v 270 (ObjNum 406 snap 0 seq_num 406) dirty exists 2020-11-16T20:56:01.186 INFO:tasks.rados.rados.0.smithi166.stdout:407: left oid 407 (ObjNum 406 snap 0 seq_num 406) 2020-11-16T20:56:01.186 INFO:tasks.rados.rados.0.smithi166.stdout:405: done (15 left) 2020-11-16T20:56:01.186 INFO:tasks.rados.rados.0.smithi166.stdout:406: done (14 left) 2020-11-16T20:56:01.186 INFO:tasks.rados.rados.0.smithi166.stdout:407: done (13 left) 2020-11-16T20:56:01.187 INFO:tasks.rados.rados.0.smithi166.stdout:421: write initial oid 421 2020-11-16T20:56:01.187 INFO:tasks.rados.rados.0.smithi166.stdout:421: seq_num 420 ranges {658940=403995,1777496=676136,2950951=107989} 2020-11-16T20:56:01.187 INFO:tasks.rados.rados.0.smithi166.stdout:421: writing smithi16641208-421 from 658940 to 1062935 tid 1 2020-11-16T20:56:01.187 INFO:tasks.rados.rados.0.smithi166.stdout:421: writing smithi16641208-421 from 1777496 to 2453632 tid 2 2020-11-16T20:56:01.187 INFO:tasks.rados.rados.0.smithi166.stdout:421: writing smithi16641208-421 from 2950951 to 3058940 tid 3 2020-11-16T20:56:01.187 INFO:tasks.rados.rados.0.smithi166.stdout:422: write initial oid 422 2020-11-16T20:56:01.187 INFO:tasks.rados.rados.0.smithi166.stdout:422: seq_num 421 ranges {675747=479244,1835978=536147} 2020-11-16T20:56:01.187 INFO:tasks.rados.rados.0.smithi166.stdout:422: writing smithi16641208-422 from 675747 to 1154991 tid 1 2020-11-16T20:56:01.188 INFO:tasks.rados.rados.0.smithi166.stdout:422: writing smithi16641208-422 from 1835978 to 2372125 tid 2 2020-11-16T20:56:01.188 INFO:tasks.rados.rados.0.smithi166.stdout:423: write initial oid 423 2020-11-16T20:56:01.188 INFO:tasks.rados.rados.0.smithi166.stdout:423: seq_num 422 ranges {692554=554493,1778107=679805,2889444=203110} 2020-11-16T20:56:01.188 INFO:tasks.rados.rados.0.smithi166.stdout:423: writing smithi16641208-423 from 692554 to 1247047 tid 1 2020-11-16T20:56:01.188 INFO:tasks.rados.rados.0.smithi166.stdout:423: writing smithi16641208-423 from 1778107 to 2457912 tid 2 2020-11-16T20:56:01.188 INFO:tasks.rados.rados.0.smithi166.stdout:423: writing smithi16641208-423 from 2889444 to 3092554 tid 3 2020-11-16T20:56:01.188 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.189 INFO:tasks.rados.rados.0.smithi166.stdout:408: finishing write tid 1 to smithi16641208-408 2020-11-16T20:56:01.189 INFO:tasks.rados.rados.0.smithi166.stdout:408: finishing write tid 2 to smithi16641208-408 2020-11-16T20:56:01.189 INFO:tasks.rados.rados.0.smithi166.stdout:408: finishing write tid 3 to smithi16641208-408 2020-11-16T20:56:01.189 INFO:tasks.rados.rados.0.smithi166.stdout:408: finishing write tid 4 to smithi16641208-408 2020-11-16T20:56:01.189 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 408 v 358 (ObjNum 407 snap 0 seq_num 407) dirty exists 2020-11-16T20:56:01.189 INFO:tasks.rados.rados.0.smithi166.stdout:408: left oid 408 (ObjNum 407 snap 0 seq_num 407) 2020-11-16T20:56:01.189 INFO:tasks.rados.rados.0.smithi166.stdout:409: finishing write tid 1 to smithi16641208-409 2020-11-16T20:56:01.189 INFO:tasks.rados.rados.0.smithi166.stdout:409: finishing write tid 2 to smithi16641208-409 2020-11-16T20:56:01.190 INFO:tasks.rados.rados.0.smithi166.stdout:409: finishing write tid 3 to smithi16641208-409 2020-11-16T20:56:01.190 INFO:tasks.rados.rados.0.smithi166.stdout:409: finishing write tid 4 to smithi16641208-409 2020-11-16T20:56:01.190 INFO:tasks.rados.rados.0.smithi166.stdout:409: finishing write tid 5 to smithi16641208-409 2020-11-16T20:56:01.190 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 409 v 300 (ObjNum 408 snap 0 seq_num 408) dirty exists 2020-11-16T20:56:01.190 INFO:tasks.rados.rados.0.smithi166.stdout:409: left oid 409 (ObjNum 408 snap 0 seq_num 408) 2020-11-16T20:56:01.190 INFO:tasks.rados.rados.0.smithi166.stdout:410: finishing write tid 1 to smithi16641208-410 2020-11-16T20:56:01.190 INFO:tasks.rados.rados.0.smithi166.stdout:410: finishing write tid 2 to smithi16641208-410 2020-11-16T20:56:01.191 INFO:tasks.rados.rados.0.smithi166.stdout:408: done (15 left) 2020-11-16T20:56:01.191 INFO:tasks.rados.rados.0.smithi166.stdout:409: done (14 left) 2020-11-16T20:56:01.191 INFO:tasks.rados.rados.0.smithi166.stdout:424: write initial oid 424 2020-11-16T20:56:01.191 INFO:tasks.rados.rados.0.smithi166.stdout:424: seq_num 423 ranges {709361=629742,1836589=539816,3033220=76141} 2020-11-16T20:56:01.191 INFO:tasks.rados.rados.0.smithi166.stdout:424: writing smithi16641208-424 from 709361 to 1339103 tid 1 2020-11-16T20:56:01.191 INFO:tasks.rados.rados.0.smithi166.stdout:424: writing smithi16641208-424 from 1836589 to 2376405 tid 2 2020-11-16T20:56:01.191 INFO:tasks.rados.rados.0.smithi166.stdout:424: writing smithi16641208-424 from 3033220 to 3109361 tid 3 2020-11-16T20:56:01.191 INFO:tasks.rados.rados.0.smithi166.stdout:425: write initial oid 425 2020-11-16T20:56:01.192 INFO:tasks.rados.rados.0.smithi166.stdout:425: seq_num 424 ranges {726168=704991,1895071=683474} 2020-11-16T20:56:01.192 INFO:tasks.rados.rados.0.smithi166.stdout:425: writing smithi16641208-425 from 726168 to 1431159 tid 1 2020-11-16T20:56:01.192 INFO:tasks.rados.rados.0.smithi166.stdout:425: writing smithi16641208-425 from 1895071 to 2578545 tid 2 2020-11-16T20:56:01.192 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.192 INFO:tasks.rados.rados.0.smithi166.stdout:410: finishing write tid 3 to smithi16641208-410 2020-11-16T20:56:01.192 INFO:tasks.rados.rados.0.smithi166.stdout:410: finishing write tid 4 to smithi16641208-410 2020-11-16T20:56:01.192 INFO:tasks.rados.rados.0.smithi166.stdout:410: finishing write tid 5 to smithi16641208-410 2020-11-16T20:56:01.192 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 410 v 304 (ObjNum 409 snap 0 seq_num 409) dirty exists 2020-11-16T20:56:01.193 INFO:tasks.rados.rados.0.smithi166.stdout:410: left oid 410 (ObjNum 409 snap 0 seq_num 409) 2020-11-16T20:56:01.193 INFO:tasks.rados.rados.0.smithi166.stdout:411: finishing write tid 1 to smithi16641208-411 2020-11-16T20:56:01.193 INFO:tasks.rados.rados.0.smithi166.stdout:411: finishing write tid 2 to smithi16641208-411 2020-11-16T20:56:01.193 INFO:tasks.rados.rados.0.smithi166.stdout:411: finishing write tid 3 to smithi16641208-411 2020-11-16T20:56:01.193 INFO:tasks.rados.rados.0.smithi166.stdout:411: finishing write tid 4 to smithi16641208-411 2020-11-16T20:56:01.193 INFO:tasks.rados.rados.0.smithi166.stdout:411: finishing write tid 5 to smithi16641208-411 2020-11-16T20:56:01.193 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 411 v 295 (ObjNum 410 snap 0 seq_num 410) dirty exists 2020-11-16T20:56:01.194 INFO:tasks.rados.rados.0.smithi166.stdout:411: left oid 411 (ObjNum 410 snap 0 seq_num 410) 2020-11-16T20:56:01.194 INFO:tasks.rados.rados.0.smithi166.stdout:412: finishing write tid 1 to smithi16641208-412 2020-11-16T20:56:01.194 INFO:tasks.rados.rados.0.smithi166.stdout:412: finishing write tid 2 to smithi16641208-412 2020-11-16T20:56:01.194 INFO:tasks.rados.rados.0.smithi166.stdout:412: finishing write tid 3 to smithi16641208-412 2020-11-16T20:56:01.194 INFO:tasks.rados.rados.0.smithi166.stdout:412: finishing write tid 4 to smithi16641208-412 2020-11-16T20:56:01.194 INFO:tasks.rados.rados.0.smithi166.stdout:412: finishing write tid 5 to smithi16641208-412 2020-11-16T20:56:01.194 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 412 v 362 (ObjNum 411 snap 0 seq_num 411) dirty exists 2020-11-16T20:56:01.194 INFO:tasks.rados.rados.0.smithi166.stdout:412: left oid 412 (ObjNum 411 snap 0 seq_num 411) 2020-11-16T20:56:01.195 INFO:tasks.rados.rados.0.smithi166.stdout:410: done (15 left) 2020-11-16T20:56:01.195 INFO:tasks.rados.rados.0.smithi166.stdout:411: done (14 left) 2020-11-16T20:56:01.195 INFO:tasks.rados.rados.0.smithi166.stdout:412: done (13 left) 2020-11-16T20:56:01.195 INFO:tasks.rados.rados.0.smithi166.stdout:426: write initial oid 426 2020-11-16T20:56:01.195 INFO:tasks.rados.rados.0.smithi166.stdout:426: seq_num 425 ranges {742975=780240,1953553=427132,2971713=171262} 2020-11-16T20:56:01.195 INFO:tasks.rados.rados.0.smithi166.stdout:426: writing smithi16641208-426 from 742975 to 1523215 tid 1 2020-11-16T20:56:01.195 INFO:tasks.rados.rados.0.smithi166.stdout:426: writing smithi16641208-426 from 1953553 to 2380685 tid 2 2020-11-16T20:56:01.196 INFO:tasks.rados.rados.0.smithi166.stdout:426: writing smithi16641208-426 from 2971713 to 3142975 tid 3 2020-11-16T20:56:01.196 INFO:tasks.rados.rados.0.smithi166.stdout:427: write initial oid 427 2020-11-16T20:56:01.196 INFO:tasks.rados.rados.0.smithi166.stdout:427: seq_num 426 ranges {759782=571842,2012035=687143} 2020-11-16T20:56:01.196 INFO:tasks.rados.rados.0.smithi166.stdout:427: writing smithi16641208-427 from 759782 to 1331624 tid 1 2020-11-16T20:56:01.196 INFO:tasks.rados.rados.0.smithi166.stdout:427: writing smithi16641208-427 from 2012035 to 2699178 tid 2 2020-11-16T20:56:01.196 INFO:tasks.rados.rados.0.smithi166.stdout:428: write initial oid 428 2020-11-16T20:56:01.196 INFO:tasks.rados.rados.0.smithi166.stdout:428: seq_num 427 ranges {776589=647091,2070517=430801,3026559=150030} 2020-11-16T20:56:01.197 INFO:tasks.rados.rados.0.smithi166.stdout:428: writing smithi16641208-428 from 776589 to 1423680 tid 1 2020-11-16T20:56:01.197 INFO:tasks.rados.rados.0.smithi166.stdout:428: writing smithi16641208-428 from 2070517 to 2501318 tid 2 2020-11-16T20:56:01.197 INFO:tasks.rados.rados.0.smithi166.stdout:428: writing smithi16641208-428 from 3026559 to 3176589 tid 3 2020-11-16T20:56:01.197 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.197 INFO:tasks.rados.rados.0.smithi166.stdout:413: finishing write tid 1 to smithi16641208-413 2020-11-16T20:56:01.197 INFO:tasks.rados.rados.0.smithi166.stdout:413: finishing write tid 2 to smithi16641208-413 2020-11-16T20:56:01.197 INFO:tasks.rados.rados.0.smithi166.stdout:413: finishing write tid 3 to smithi16641208-413 2020-11-16T20:56:01.197 INFO:tasks.rados.rados.0.smithi166.stdout:413: finishing write tid 4 to smithi16641208-413 2020-11-16T20:56:01.198 INFO:tasks.rados.rados.0.smithi166.stdout:413: finishing write tid 5 to smithi16641208-413 2020-11-16T20:56:01.198 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 413 v 299 (ObjNum 412 snap 0 seq_num 412) dirty exists 2020-11-16T20:56:01.198 INFO:tasks.rados.rados.0.smithi166.stdout:413: left oid 413 (ObjNum 412 snap 0 seq_num 412) 2020-11-16T20:56:01.198 INFO:tasks.rados.rados.0.smithi166.stdout:414: finishing write tid 1 to smithi16641208-414 2020-11-16T20:56:01.198 INFO:tasks.rados.rados.0.smithi166.stdout:414: finishing write tid 2 to smithi16641208-414 2020-11-16T20:56:01.198 INFO:tasks.rados.rados.0.smithi166.stdout:414: finishing write tid 3 to smithi16641208-414 2020-11-16T20:56:01.198 INFO:tasks.rados.rados.0.smithi166.stdout:414: finishing write tid 4 to smithi16641208-414 2020-11-16T20:56:01.199 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 414 v 273 (ObjNum 413 snap 0 seq_num 413) dirty exists 2020-11-16T20:56:01.199 INFO:tasks.rados.rados.0.smithi166.stdout:414: left oid 414 (ObjNum 413 snap 0 seq_num 413) 2020-11-16T20:56:01.199 INFO:tasks.rados.rados.0.smithi166.stdout:415: finishing write tid 1 to smithi16641208-415 2020-11-16T20:56:01.199 INFO:tasks.rados.rados.0.smithi166.stdout:415: finishing write tid 2 to smithi16641208-415 2020-11-16T20:56:01.199 INFO:tasks.rados.rados.0.smithi166.stdout:415: finishing write tid 3 to smithi16641208-415 2020-11-16T20:56:01.199 INFO:tasks.rados.rados.0.smithi166.stdout:413: done (15 left) 2020-11-16T20:56:01.199 INFO:tasks.rados.rados.0.smithi166.stdout:414: done (14 left) 2020-11-16T20:56:01.199 INFO:tasks.rados.rados.0.smithi166.stdout:429: write initial oid 429 2020-11-16T20:56:01.200 INFO:tasks.rados.rados.0.smithi166.stdout:429: seq_num 428 ranges {793396=722340,2128999=690812} 2020-11-16T20:56:01.200 INFO:tasks.rados.rados.0.smithi166.stdout:429: writing smithi16641208-429 from 793396 to 1515736 tid 1 2020-11-16T20:56:01.200 INFO:tasks.rados.rados.0.smithi166.stdout:429: writing smithi16641208-429 from 2128999 to 2819811 tid 2 2020-11-16T20:56:01.200 INFO:tasks.rados.rados.0.smithi166.stdout:430: write initial oid 430 2020-11-16T20:56:01.200 INFO:tasks.rados.rados.0.smithi166.stdout:430: seq_num 429 ranges {410203=797589,1787481=434470,2681405=528798} 2020-11-16T20:56:01.200 INFO:tasks.rados.rados.0.smithi166.stdout:430: writing smithi16641208-430 from 410203 to 1207792 tid 1 2020-11-16T20:56:01.200 INFO:tasks.rados.rados.0.smithi166.stdout:430: writing smithi16641208-430 from 1787481 to 2221951 tid 2 2020-11-16T20:56:01.201 INFO:tasks.rados.rados.0.smithi166.stdout:430: writing smithi16641208-430 from 2681405 to 3210203 tid 3 2020-11-16T20:56:01.201 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.201 INFO:tasks.rados.rados.0.smithi166.stdout:415: finishing write tid 4 to smithi16641208-415 2020-11-16T20:56:01.201 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 415 v 307 (ObjNum 414 snap 0 seq_num 414) dirty exists 2020-11-16T20:56:01.201 INFO:tasks.rados.rados.0.smithi166.stdout:415: left oid 415 (ObjNum 414 snap 0 seq_num 414) 2020-11-16T20:56:01.201 INFO:tasks.rados.rados.0.smithi166.stdout:415: done (15 left) 2020-11-16T20:56:01.201 INFO:tasks.rados.rados.0.smithi166.stdout:431: write initial oid 431 2020-11-16T20:56:01.201 INFO:tasks.rados.rados.0.smithi166.stdout:431: seq_num 430 ranges {427010=472838,1329610=694481,2708828=518182} 2020-11-16T20:56:01.202 INFO:tasks.rados.rados.0.smithi166.stdout:431: writing smithi16641208-431 from 427010 to 899848 tid 1 2020-11-16T20:56:01.202 INFO:tasks.rados.rados.0.smithi166.stdout:431: writing smithi16641208-431 from 1329610 to 2024091 tid 2 2020-11-16T20:56:01.202 INFO:tasks.rados.rados.0.smithi166.stdout:431: writing smithi16641208-431 from 2708828 to 3227010 tid 3 2020-11-16T20:56:01.202 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.202 INFO:tasks.rados.rados.0.smithi166.stdout:416: finishing write tid 1 to smithi16641208-416 2020-11-16T20:56:01.202 INFO:tasks.rados.rados.0.smithi166.stdout:416: finishing write tid 2 to smithi16641208-416 2020-11-16T20:56:01.202 INFO:tasks.rados.rados.0.smithi166.stdout:416: finishing write tid 3 to smithi16641208-416 2020-11-16T20:56:01.203 INFO:tasks.rados.rados.0.smithi166.stdout:416: finishing write tid 4 to smithi16641208-416 2020-11-16T20:56:01.203 INFO:tasks.rados.rados.0.smithi166.stdout:416: finishing write tid 5 to smithi16641208-416 2020-11-16T20:56:01.203 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 416 v 277 (ObjNum 415 snap 0 seq_num 415) dirty exists 2020-11-16T20:56:01.203 INFO:tasks.rados.rados.0.smithi166.stdout:416: left oid 416 (ObjNum 415 snap 0 seq_num 415) 2020-11-16T20:56:01.203 INFO:tasks.rados.rados.0.smithi166.stdout:417: finishing write tid 1 to smithi16641208-417 2020-11-16T20:56:01.203 INFO:tasks.rados.rados.0.smithi166.stdout:417: finishing write tid 2 to smithi16641208-417 2020-11-16T20:56:01.203 INFO:tasks.rados.rados.0.smithi166.stdout:417: finishing write tid 3 to smithi16641208-417 2020-11-16T20:56:01.203 INFO:tasks.rados.rados.0.smithi166.stdout:417: finishing write tid 4 to smithi16641208-417 2020-11-16T20:56:01.204 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 417 v 280 (ObjNum 416 snap 0 seq_num 416) dirty exists 2020-11-16T20:56:01.204 INFO:tasks.rados.rados.0.smithi166.stdout:417: left oid 417 (ObjNum 416 snap 0 seq_num 416) 2020-11-16T20:56:01.204 INFO:tasks.rados.rados.0.smithi166.stdout:418: finishing write tid 1 to smithi16641208-418 2020-11-16T20:56:01.204 INFO:tasks.rados.rados.0.smithi166.stdout:418: finishing write tid 2 to smithi16641208-418 2020-11-16T20:56:01.204 INFO:tasks.rados.rados.0.smithi166.stdout:418: finishing write tid 3 to smithi16641208-418 2020-11-16T20:56:01.204 INFO:tasks.rados.rados.0.smithi166.stdout:418: finishing write tid 4 to smithi16641208-418 2020-11-16T20:56:01.204 INFO:tasks.rados.rados.0.smithi166.stdout:418: finishing write tid 5 to smithi16641208-418 2020-11-16T20:56:01.204 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 418 v 284 (ObjNum 417 snap 0 seq_num 417) dirty exists 2020-11-16T20:56:01.205 INFO:tasks.rados.rados.0.smithi166.stdout:418: left oid 418 (ObjNum 417 snap 0 seq_num 417) 2020-11-16T20:56:01.205 INFO:tasks.rados.rados.0.smithi166.stdout:416: done (15 left) 2020-11-16T20:56:01.205 INFO:tasks.rados.rados.0.smithi166.stdout:417: done (14 left) 2020-11-16T20:56:01.205 INFO:tasks.rados.rados.0.smithi166.stdout:418: done (13 left) 2020-11-16T20:56:01.205 INFO:tasks.rados.rados.0.smithi166.stdout:432: write initial oid 432 2020-11-16T20:56:01.205 INFO:tasks.rados.rados.0.smithi166.stdout:432: seq_num 431 ranges {443817=548087,1788092=438139,3019898=223919} 2020-11-16T20:56:01.205 INFO:tasks.rados.rados.0.smithi166.stdout:432: writing smithi16641208-432 from 443817 to 991904 tid 1 2020-11-16T20:56:01.206 INFO:tasks.rados.rados.0.smithi166.stdout:432: writing smithi16641208-432 from 1788092 to 2226231 tid 2 2020-11-16T20:56:01.206 INFO:tasks.rados.rados.0.smithi166.stdout:432: writing smithi16641208-432 from 3019898 to 3243817 tid 3 2020-11-16T20:56:01.206 INFO:tasks.rados.rados.0.smithi166.stdout:433: write initial oid 433 2020-11-16T20:56:01.206 INFO:tasks.rados.rados.0.smithi166.stdout:419: finishing write tid 1 to smithi16641208-419 2020-11-16T20:56:01.206 INFO:tasks.rados.rados.0.smithi166.stdout:433: seq_num 432 ranges {460624=623336,1846574=698150,3163674=96950} 2020-11-16T20:56:01.206 INFO:tasks.rados.rados.0.smithi166.stdout:433: writing smithi16641208-433 from 460624 to 1083960 tid 1 2020-11-16T20:56:01.206 INFO:tasks.rados.rados.0.smithi166.stdout:433: writing smithi16641208-433 from 1846574 to 2544724 tid 2 2020-11-16T20:56:01.207 INFO:tasks.rados.rados.0.smithi166.stdout:433: writing smithi16641208-433 from 3163674 to 3260624 tid 3 2020-11-16T20:56:01.207 INFO:tasks.rados.rados.0.smithi166.stdout:434: write initial oid 434 2020-11-16T20:56:01.207 INFO:tasks.rados.rados.0.smithi166.stdout:434: seq_num 433 ranges {477431=698585,1905056=441808,3074744=202687} 2020-11-16T20:56:01.207 INFO:tasks.rados.rados.0.smithi166.stdout:434: writing smithi16641208-434 from 477431 to 1176016 tid 1 2020-11-16T20:56:01.207 INFO:tasks.rados.rados.0.smithi166.stdout:434: writing smithi16641208-434 from 1905056 to 2346864 tid 2 2020-11-16T20:56:01.207 INFO:tasks.rados.rados.0.smithi166.stdout:434: writing smithi16641208-434 from 3074744 to 3277431 tid 3 2020-11-16T20:56:01.207 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.207 INFO:tasks.rados.rados.0.smithi166.stdout:419: finishing write tid 2 to smithi16641208-419 2020-11-16T20:56:01.208 INFO:tasks.rados.rados.0.smithi166.stdout:419: finishing write tid 3 to smithi16641208-419 2020-11-16T20:56:01.208 INFO:tasks.rados.rados.0.smithi166.stdout:419: finishing write tid 4 to smithi16641208-419 2020-11-16T20:56:01.208 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 419 v 287 (ObjNum 418 snap 0 seq_num 418) dirty exists 2020-11-16T20:56:01.208 INFO:tasks.rados.rados.0.smithi166.stdout:419: left oid 419 (ObjNum 418 snap 0 seq_num 418) 2020-11-16T20:56:01.208 INFO:tasks.rados.rados.0.smithi166.stdout:420: finishing write tid 1 to smithi16641208-420 2020-11-16T20:56:01.208 INFO:tasks.rados.rados.0.smithi166.stdout:420: finishing write tid 2 to smithi16641208-420 2020-11-16T20:56:01.208 INFO:tasks.rados.rados.0.smithi166.stdout:420: finishing write tid 3 to smithi16641208-420 2020-11-16T20:56:01.208 INFO:tasks.rados.rados.0.smithi166.stdout:420: finishing write tid 4 to smithi16641208-420 2020-11-16T20:56:01.209 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 420 v 290 (ObjNum 419 snap 0 seq_num 419) dirty exists 2020-11-16T20:56:01.209 INFO:tasks.rados.rados.0.smithi166.stdout:420: left oid 420 (ObjNum 419 snap 0 seq_num 419) 2020-11-16T20:56:01.209 INFO:tasks.rados.rados.0.smithi166.stdout:421: finishing write tid 1 to smithi16641208-421 2020-11-16T20:56:01.209 INFO:tasks.rados.rados.0.smithi166.stdout:421: finishing write tid 2 to smithi16641208-421 2020-11-16T20:56:01.209 INFO:tasks.rados.rados.0.smithi166.stdout:421: finishing write tid 3 to smithi16641208-421 2020-11-16T20:56:01.209 INFO:tasks.rados.rados.0.smithi166.stdout:421: finishing write tid 4 to smithi16641208-421 2020-11-16T20:56:01.209 INFO:tasks.rados.rados.0.smithi166.stdout:421: finishing write tid 5 to smithi16641208-421 2020-11-16T20:56:01.210 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 421 v 311 (ObjNum 420 snap 0 seq_num 420) dirty exists 2020-11-16T20:56:01.210 INFO:tasks.rados.rados.0.smithi166.stdout:421: left oid 421 (ObjNum 420 snap 0 seq_num 420) 2020-11-16T20:56:01.210 INFO:tasks.rados.rados.0.smithi166.stdout:419: done (15 left) 2020-11-16T20:56:01.210 INFO:tasks.rados.rados.0.smithi166.stdout:420: done (14 left) 2020-11-16T20:56:01.210 INFO:tasks.rados.rados.0.smithi166.stdout:421: done (13 left) 2020-11-16T20:56:01.210 INFO:tasks.rados.rados.0.smithi166.stdout:435: write initial oid 435 2020-11-16T20:56:01.210 INFO:tasks.rados.rados.0.smithi166.stdout:435: seq_num 434 ranges {494238=490187,1563538=701819,2818520=475718} 2020-11-16T20:56:01.210 INFO:tasks.rados.rados.0.smithi166.stdout:435: writing smithi16641208-435 from 494238 to 984425 tid 1 2020-11-16T20:56:01.211 INFO:tasks.rados.rados.0.smithi166.stdout:435: writing smithi16641208-435 from 1563538 to 2265357 tid 2 2020-11-16T20:56:01.211 INFO:tasks.rados.rados.0.smithi166.stdout:435: writing smithi16641208-435 from 2818520 to 3294238 tid 3 2020-11-16T20:56:01.211 INFO:tasks.rados.rados.0.smithi166.stdout:436: write initial oid 436 2020-11-16T20:56:01.211 INFO:tasks.rados.rados.0.smithi166.stdout:436: seq_num 435 ranges {511045=565436,1622020=445477,2729590=556855} 2020-11-16T20:56:01.211 INFO:tasks.rados.rados.0.smithi166.stdout:436: writing smithi16641208-436 from 511045 to 1076481 tid 1 2020-11-16T20:56:01.211 INFO:tasks.rados.rados.0.smithi166.stdout:436: writing smithi16641208-436 from 1622020 to 2067497 tid 2 2020-11-16T20:56:01.211 INFO:tasks.rados.rados.0.smithi166.stdout:436: writing smithi16641208-436 from 2729590 to 3286445 tid 3 2020-11-16T20:56:01.212 INFO:tasks.rados.rados.0.smithi166.stdout:437: write initial oid 437 2020-11-16T20:56:01.212 INFO:tasks.rados.rados.0.smithi166.stdout:437: seq_num 436 ranges {527852=640685,1680502=589135,2757013=570839} 2020-11-16T20:56:01.212 INFO:tasks.rados.rados.0.smithi166.stdout:437: writing smithi16641208-437 from 527852 to 1168537 tid 1 2020-11-16T20:56:01.212 INFO:tasks.rados.rados.0.smithi166.stdout:437: writing smithi16641208-437 from 1680502 to 2269637 tid 2 2020-11-16T20:56:01.212 INFO:tasks.rados.rados.0.smithi166.stdout:437: writing smithi16641208-437 from 2757013 to 3327852 tid 3 2020-11-16T20:56:01.212 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.212 INFO:tasks.rados.rados.0.smithi166.stdout:422: finishing write tid 1 to smithi16641208-422 2020-11-16T20:56:01.212 INFO:tasks.rados.rados.0.smithi166.stdout:422: finishing write tid 2 to smithi16641208-422 2020-11-16T20:56:01.213 INFO:tasks.rados.rados.0.smithi166.stdout:422: finishing write tid 3 to smithi16641208-422 2020-11-16T20:56:01.213 INFO:tasks.rados.rados.0.smithi166.stdout:422: finishing write tid 4 to smithi16641208-422 2020-11-16T20:56:01.213 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 422 v 314 (ObjNum 421 snap 0 seq_num 421) dirty exists 2020-11-16T20:56:01.213 INFO:tasks.rados.rados.0.smithi166.stdout:422: left oid 422 (ObjNum 421 snap 0 seq_num 421) 2020-11-16T20:56:01.213 INFO:tasks.rados.rados.0.smithi166.stdout:423: finishing write tid 1 to smithi16641208-423 2020-11-16T20:56:01.213 INFO:tasks.rados.rados.0.smithi166.stdout:423: finishing write tid 2 to smithi16641208-423 2020-11-16T20:56:01.213 INFO:tasks.rados.rados.0.smithi166.stdout:423: finishing write tid 3 to smithi16641208-423 2020-11-16T20:56:01.214 INFO:tasks.rados.rados.0.smithi166.stdout:423: finishing write tid 4 to smithi16641208-423 2020-11-16T20:56:01.214 INFO:tasks.rados.rados.0.smithi166.stdout:423: finishing write tid 5 to smithi16641208-423 2020-11-16T20:56:01.214 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 423 v 303 (ObjNum 422 snap 0 seq_num 422) dirty exists 2020-11-16T20:56:01.214 INFO:tasks.rados.rados.0.smithi166.stdout:423: left oid 423 (ObjNum 422 snap 0 seq_num 422) 2020-11-16T20:56:01.214 INFO:tasks.rados.rados.0.smithi166.stdout:424: finishing write tid 1 to smithi16641208-424 2020-11-16T20:56:01.214 INFO:tasks.rados.rados.0.smithi166.stdout:424: finishing write tid 2 to smithi16641208-424 2020-11-16T20:56:01.214 INFO:tasks.rados.rados.0.smithi166.stdout:424: finishing write tid 3 to smithi16641208-424 2020-11-16T20:56:01.215 INFO:tasks.rados.rados.0.smithi166.stdout:422: done (15 left) 2020-11-16T20:56:01.215 INFO:tasks.rados.rados.0.smithi166.stdout:423: done (14 left) 2020-11-16T20:56:01.215 INFO:tasks.rados.rados.0.smithi166.stdout:438: write initial oid 438 2020-11-16T20:56:01.215 INFO:tasks.rados.rados.0.smithi166.stdout:438: seq_num 437 ranges {544659=715934,1738984=449146,2784436=560223} 2020-11-16T20:56:01.215 INFO:tasks.rados.rados.0.smithi166.stdout:438: writing smithi16641208-438 from 544659 to 1260593 tid 1 2020-11-16T20:56:01.215 INFO:tasks.rados.rados.0.smithi166.stdout:438: writing smithi16641208-438 from 1738984 to 2188130 tid 2 2020-11-16T20:56:01.215 INFO:tasks.rados.rados.0.smithi166.stdout:438: writing smithi16641208-438 from 2784436 to 3344659 tid 3 2020-11-16T20:56:01.215 INFO:tasks.rados.rados.0.smithi166.stdout:439: write initial oid 439 2020-11-16T20:56:01.216 INFO:tasks.rados.rados.0.smithi166.stdout:439: seq_num 438 ranges {561466=791183,2081113=592804,3095506=265960} 2020-11-16T20:56:01.216 INFO:tasks.rados.rados.0.smithi166.stdout:439: writing smithi16641208-439 from 561466 to 1352649 tid 1 2020-11-16T20:56:01.216 INFO:tasks.rados.rados.0.smithi166.stdout:439: writing smithi16641208-439 from 2081113 to 2673917 tid 2 2020-11-16T20:56:01.216 INFO:tasks.rados.rados.0.smithi166.stdout:439: writing smithi16641208-439 from 3095506 to 3361466 tid 3 2020-11-16T20:56:01.216 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.216 INFO:tasks.rados.rados.0.smithi166.stdout:424: finishing write tid 4 to smithi16641208-424 2020-11-16T20:56:01.216 INFO:tasks.rados.rados.0.smithi166.stdout:424: finishing write tid 5 to smithi16641208-424 2020-11-16T20:56:01.217 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 424 v 318 (ObjNum 423 snap 0 seq_num 423) dirty exists 2020-11-16T20:56:01.217 INFO:tasks.rados.rados.0.smithi166.stdout:424: left oid 424 (ObjNum 423 snap 0 seq_num 423) 2020-11-16T20:56:01.217 INFO:tasks.rados.rados.0.smithi166.stdout:425: finishing write tid 1 to smithi16641208-425 2020-11-16T20:56:01.217 INFO:tasks.rados.rados.0.smithi166.stdout:425: finishing write tid 2 to smithi16641208-425 2020-11-16T20:56:01.217 INFO:tasks.rados.rados.0.smithi166.stdout:425: finishing write tid 3 to smithi16641208-425 2020-11-16T20:56:01.217 INFO:tasks.rados.rados.0.smithi166.stdout:425: finishing write tid 4 to smithi16641208-425 2020-11-16T20:56:01.217 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 425 v 321 (ObjNum 424 snap 0 seq_num 424) dirty exists 2020-11-16T20:56:01.217 INFO:tasks.rados.rados.0.smithi166.stdout:425: left oid 425 (ObjNum 424 snap 0 seq_num 424) 2020-11-16T20:56:01.218 INFO:tasks.rados.rados.0.smithi166.stdout:424: done (15 left) 2020-11-16T20:56:01.218 INFO:tasks.rados.rados.0.smithi166.stdout:425: done (14 left) 2020-11-16T20:56:01.218 INFO:tasks.rados.rados.0.smithi166.stdout:440: write initial oid 440 2020-11-16T20:56:01.218 INFO:tasks.rados.rados.0.smithi166.stdout:440: seq_num 439 ranges {578273=466432,1739595=452815,2722929=655344} 2020-11-16T20:56:01.218 INFO:tasks.rados.rados.0.smithi166.stdout:440: writing smithi16641208-440 from 578273 to 1044705 tid 1 2020-11-16T20:56:01.218 INFO:tasks.rados.rados.0.smithi166.stdout:440: writing smithi16641208-440 from 1739595 to 2192410 tid 2 2020-11-16T20:56:01.218 INFO:tasks.rados.rados.0.smithi166.stdout:440: writing smithi16641208-440 from 2722929 to 3378273 tid 3 2020-11-16T20:56:01.219 INFO:tasks.rados.rados.0.smithi166.stdout:441: write initial oid 441 2020-11-16T20:56:01.219 INFO:tasks.rados.rados.0.smithi166.stdout:441: seq_num 440 ranges {595080=541681,1798077=596473,3150352=244728} 2020-11-16T20:56:01.219 INFO:tasks.rados.rados.0.smithi166.stdout:441: writing smithi16641208-441 from 595080 to 1136761 tid 1 2020-11-16T20:56:01.219 INFO:tasks.rados.rados.0.smithi166.stdout:441: writing smithi16641208-441 from 1798077 to 2394550 tid 2 2020-11-16T20:56:01.219 INFO:tasks.rados.rados.0.smithi166.stdout:441: writing smithi16641208-441 from 3150352 to 3395080 tid 3 2020-11-16T20:56:01.219 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.219 INFO:tasks.rados.rados.0.smithi166.stdout:426: finishing write tid 1 to smithi16641208-426 2020-11-16T20:56:01.220 INFO:tasks.rados.rados.0.smithi166.stdout:426: finishing write tid 2 to smithi16641208-426 2020-11-16T20:56:01.220 INFO:tasks.rados.rados.0.smithi166.stdout:426: finishing write tid 3 to smithi16641208-426 2020-11-16T20:56:01.220 INFO:tasks.rados.rados.0.smithi166.stdout:426: finishing write tid 4 to smithi16641208-426 2020-11-16T20:56:01.220 INFO:tasks.rados.rados.0.smithi166.stdout:426: finishing write tid 5 to smithi16641208-426 2020-11-16T20:56:01.220 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 426 v 307 (ObjNum 425 snap 0 seq_num 425) dirty exists 2020-11-16T20:56:01.220 INFO:tasks.rados.rados.0.smithi166.stdout:426: left oid 426 (ObjNum 425 snap 0 seq_num 425) 2020-11-16T20:56:01.220 INFO:tasks.rados.rados.0.smithi166.stdout:427: finishing write tid 1 to smithi16641208-427 2020-11-16T20:56:01.220 INFO:tasks.rados.rados.0.smithi166.stdout:427: finishing write tid 2 to smithi16641208-427 2020-11-16T20:56:01.221 INFO:tasks.rados.rados.0.smithi166.stdout:426: done (15 left) 2020-11-16T20:56:01.221 INFO:tasks.rados.rados.0.smithi166.stdout:442: write initial oid 442 2020-11-16T20:56:01.221 INFO:tasks.rados.rados.0.smithi166.stdout:442: seq_num 441 ranges {611887=733283,1972912=456484,2894128=517759} 2020-11-16T20:56:01.221 INFO:tasks.rados.rados.0.smithi166.stdout:442: writing smithi16641208-442 from 611887 to 1345170 tid 1 2020-11-16T20:56:01.221 INFO:tasks.rados.rados.0.smithi166.stdout:442: writing smithi16641208-442 from 1972912 to 2429396 tid 2 2020-11-16T20:56:01.221 INFO:tasks.rados.rados.0.smithi166.stdout:442: writing smithi16641208-442 from 2894128 to 3411887 tid 3 2020-11-16T20:56:01.221 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.221 INFO:tasks.rados.rados.0.smithi166.stdout:427: finishing write tid 3 to smithi16641208-427 2020-11-16T20:56:01.222 INFO:tasks.rados.rados.0.smithi166.stdout:427: finishing write tid 4 to smithi16641208-427 2020-11-16T20:56:01.222 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 427 v 310 (ObjNum 426 snap 0 seq_num 426) dirty exists 2020-11-16T20:56:01.222 INFO:tasks.rados.rados.0.smithi166.stdout:427: left oid 427 (ObjNum 426 snap 0 seq_num 426) 2020-11-16T20:56:01.222 INFO:tasks.rados.rados.0.smithi166.stdout:428: finishing write tid 1 to smithi16641208-428 2020-11-16T20:56:01.222 INFO:tasks.rados.rados.0.smithi166.stdout:427: done (15 left) 2020-11-16T20:56:01.222 INFO:tasks.rados.rados.0.smithi166.stdout:443: write initial oid 443 2020-11-16T20:56:01.222 INFO:tasks.rados.rados.0.smithi166.stdout:443: seq_num 442 ranges {628694=408532,1515041=600142,2805198=552112} 2020-11-16T20:56:01.223 INFO:tasks.rados.rados.0.smithi166.stdout:443: writing smithi16641208-443 from 628694 to 1037226 tid 1 2020-11-16T20:56:01.223 INFO:tasks.rados.rados.0.smithi166.stdout:443: writing smithi16641208-443 from 1515041 to 2115183 tid 2 2020-11-16T20:56:01.223 INFO:tasks.rados.rados.0.smithi166.stdout:443: writing smithi16641208-443 from 2805198 to 3357310 tid 3 2020-11-16T20:56:01.223 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.223 INFO:tasks.rados.rados.0.smithi166.stdout:428: finishing write tid 2 to smithi16641208-428 2020-11-16T20:56:01.223 INFO:tasks.rados.rados.0.smithi166.stdout:428: finishing write tid 3 to smithi16641208-428 2020-11-16T20:56:01.223 INFO:tasks.rados.rados.0.smithi166.stdout:428: finishing write tid 4 to smithi16641208-428 2020-11-16T20:56:01.223 INFO:tasks.rados.rados.0.smithi166.stdout:428: finishing write tid 5 to smithi16641208-428 2020-11-16T20:56:01.224 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 428 v 363 (ObjNum 427 snap 0 seq_num 427) dirty exists 2020-11-16T20:56:01.224 INFO:tasks.rados.rados.0.smithi166.stdout:428: left oid 428 (ObjNum 427 snap 0 seq_num 427) 2020-11-16T20:56:01.224 INFO:tasks.rados.rados.0.smithi166.stdout:429: finishing write tid 1 to smithi16641208-429 2020-11-16T20:56:01.224 INFO:tasks.rados.rados.0.smithi166.stdout:429: finishing write tid 2 to smithi16641208-429 2020-11-16T20:56:01.224 INFO:tasks.rados.rados.0.smithi166.stdout:428: done (15 left) 2020-11-16T20:56:01.224 INFO:tasks.rados.rados.0.smithi166.stdout:444: write initial oid 444 2020-11-16T20:56:01.224 INFO:tasks.rados.rados.0.smithi166.stdout:444: seq_num 443 ranges {645501=483781,1573523=460153,2548974=763384} 2020-11-16T20:56:01.225 INFO:tasks.rados.rados.0.smithi166.stdout:444: writing smithi16641208-444 from 645501 to 1129282 tid 1 2020-11-16T20:56:01.225 INFO:tasks.rados.rados.0.smithi166.stdout:444: writing smithi16641208-444 from 1573523 to 2033676 tid 2 2020-11-16T20:56:01.225 INFO:tasks.rados.rados.0.smithi166.stdout:444: writing smithi16641208-444 from 2548974 to 3312358 tid 3 2020-11-16T20:56:01.225 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.225 INFO:tasks.rados.rados.0.smithi166.stdout:429: finishing write tid 3 to smithi16641208-429 2020-11-16T20:56:01.225 INFO:tasks.rados.rados.0.smithi166.stdout:429: finishing write tid 4 to smithi16641208-429 2020-11-16T20:56:01.225 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 429 v 366 (ObjNum 428 snap 0 seq_num 428) dirty exists 2020-11-16T20:56:01.225 INFO:tasks.rados.rados.0.smithi166.stdout:429: left oid 429 (ObjNum 428 snap 0 seq_num 428) 2020-11-16T20:56:01.226 INFO:tasks.rados.rados.0.smithi166.stdout:430: finishing write tid 1 to smithi16641208-430 2020-11-16T20:56:01.226 INFO:tasks.rados.rados.0.smithi166.stdout:429: done (15 left) 2020-11-16T20:56:01.226 INFO:tasks.rados.rados.0.smithi166.stdout:445: write initial oid 445 2020-11-16T20:56:01.226 INFO:tasks.rados.rados.0.smithi166.stdout:445: seq_num 444 ranges {662308=559030,1632005=603811,2860044=602264} 2020-11-16T20:56:01.226 INFO:tasks.rados.rados.0.smithi166.stdout:445: writing smithi16641208-445 from 662308 to 1221338 tid 1 2020-11-16T20:56:01.226 INFO:tasks.rados.rados.0.smithi166.stdout:445: writing smithi16641208-445 from 1632005 to 2235816 tid 2 2020-11-16T20:56:01.226 INFO:tasks.rados.rados.0.smithi166.stdout:445: writing smithi16641208-445 from 2860044 to 3462308 tid 3 2020-11-16T20:56:01.226 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.227 INFO:tasks.rados.rados.0.smithi166.stdout:430: finishing write tid 2 to smithi16641208-430 2020-11-16T20:56:01.227 INFO:tasks.rados.rados.0.smithi166.stdout:430: finishing write tid 3 to smithi16641208-430 2020-11-16T20:56:01.227 INFO:tasks.rados.rados.0.smithi166.stdout:430: finishing write tid 4 to smithi16641208-430 2020-11-16T20:56:01.227 INFO:tasks.rados.rados.0.smithi166.stdout:430: finishing write tid 5 to smithi16641208-430 2020-11-16T20:56:01.227 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 430 v 294 (ObjNum 429 snap 0 seq_num 429) dirty exists 2020-11-16T20:56:01.227 INFO:tasks.rados.rados.0.smithi166.stdout:430: left oid 430 (ObjNum 429 snap 0 seq_num 429) 2020-11-16T20:56:01.227 INFO:tasks.rados.rados.0.smithi166.stdout:431: finishing write tid 1 to smithi16641208-431 2020-11-16T20:56:01.228 INFO:tasks.rados.rados.0.smithi166.stdout:430: done (15 left) 2020-11-16T20:56:01.228 INFO:tasks.rados.rados.0.smithi166.stdout:446: write initial oid 446 2020-11-16T20:56:01.228 INFO:tasks.rados.rados.0.smithi166.stdout:446: seq_num 445 ranges {679115=634279,2090487=463822,3003820=475295} 2020-11-16T20:56:01.228 INFO:tasks.rados.rados.0.smithi166.stdout:446: writing smithi16641208-446 from 679115 to 1313394 tid 1 2020-11-16T20:56:01.228 INFO:tasks.rados.rados.0.smithi166.stdout:446: writing smithi16641208-446 from 2090487 to 2554309 tid 2 2020-11-16T20:56:01.228 INFO:tasks.rados.rados.0.smithi166.stdout:446: writing smithi16641208-446 from 3003820 to 3479115 tid 3 2020-11-16T20:56:01.228 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.228 INFO:tasks.rados.rados.0.smithi166.stdout:431: finishing write tid 2 to smithi16641208-431 2020-11-16T20:56:01.229 INFO:tasks.rados.rados.0.smithi166.stdout:431: finishing write tid 3 to smithi16641208-431 2020-11-16T20:56:01.229 INFO:tasks.rados.rados.0.smithi166.stdout:431: finishing write tid 4 to smithi16641208-431 2020-11-16T20:56:01.229 INFO:tasks.rados.rados.0.smithi166.stdout:431: finishing write tid 5 to smithi16641208-431 2020-11-16T20:56:01.229 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 431 v 314 (ObjNum 430 snap 0 seq_num 430) dirty exists 2020-11-16T20:56:01.229 INFO:tasks.rados.rados.0.smithi166.stdout:431: left oid 431 (ObjNum 430 snap 0 seq_num 430) 2020-11-16T20:56:01.229 INFO:tasks.rados.rados.0.smithi166.stdout:432: finishing write tid 1 to smithi16641208-432 2020-11-16T20:56:01.229 INFO:tasks.rados.rados.0.smithi166.stdout:432: finishing write tid 2 to smithi16641208-432 2020-11-16T20:56:01.230 INFO:tasks.rados.rados.0.smithi166.stdout:431: done (15 left) 2020-11-16T20:56:01.230 INFO:tasks.rados.rados.0.smithi166.stdout:447: write initial oid 447 2020-11-16T20:56:01.230 INFO:tasks.rados.rados.0.smithi166.stdout:447: seq_num 446 ranges {695922=709528,2032616=607480,3198537=297385} 2020-11-16T20:56:01.230 INFO:tasks.rados.rados.0.smithi166.stdout:447: writing smithi16641208-447 from 695922 to 1405450 tid 1 2020-11-16T20:56:01.230 INFO:tasks.rados.rados.0.smithi166.stdout:447: writing smithi16641208-447 from 2032616 to 2640096 tid 2 2020-11-16T20:56:01.230 INFO:tasks.rados.rados.0.smithi166.stdout:447: writing smithi16641208-447 from 3198537 to 3495922 tid 3 2020-11-16T20:56:01.230 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.230 INFO:tasks.rados.rados.0.smithi166.stdout:432: finishing write tid 3 to smithi16641208-432 2020-11-16T20:56:01.231 INFO:tasks.rados.rados.0.smithi166.stdout:432: finishing write tid 4 to smithi16641208-432 2020-11-16T20:56:01.231 INFO:tasks.rados.rados.0.smithi166.stdout:432: finishing write tid 5 to smithi16641208-432 2020-11-16T20:56:01.231 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 432 v 370 (ObjNum 431 snap 0 seq_num 431) dirty exists 2020-11-16T20:56:01.231 INFO:tasks.rados.rados.0.smithi166.stdout:432: left oid 432 (ObjNum 431 snap 0 seq_num 431) 2020-11-16T20:56:01.231 INFO:tasks.rados.rados.0.smithi166.stdout:433: finishing write tid 1 to smithi16641208-433 2020-11-16T20:56:01.231 INFO:tasks.rados.rados.0.smithi166.stdout:433: finishing write tid 2 to smithi16641208-433 2020-11-16T20:56:01.231 INFO:tasks.rados.rados.0.smithi166.stdout:433: finishing write tid 3 to smithi16641208-433 2020-11-16T20:56:01.231 INFO:tasks.rados.rados.0.smithi166.stdout:433: finishing write tid 4 to smithi16641208-433 2020-11-16T20:56:01.232 INFO:tasks.rados.rados.0.smithi166.stdout:433: finishing write tid 5 to smithi16641208-433 2020-11-16T20:56:01.232 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 433 v 323 (ObjNum 432 snap 0 seq_num 432) dirty exists 2020-11-16T20:56:01.232 INFO:tasks.rados.rados.0.smithi166.stdout:433: left oid 433 (ObjNum 432 snap 0 seq_num 432) 2020-11-16T20:56:01.232 INFO:tasks.rados.rados.0.smithi166.stdout:434: finishing write tid 1 to smithi16641208-434 2020-11-16T20:56:01.232 INFO:tasks.rados.rados.0.smithi166.stdout:434: finishing write tid 2 to smithi16641208-434 2020-11-16T20:56:01.232 INFO:tasks.rados.rados.0.smithi166.stdout:434: finishing write tid 3 to smithi16641208-434 2020-11-16T20:56:01.232 INFO:tasks.rados.rados.0.smithi166.stdout:435: finishing write tid 1 to smithi16641208-435 2020-11-16T20:56:01.233 INFO:tasks.rados.rados.0.smithi166.stdout:435: finishing write tid 2 to smithi16641208-435 2020-11-16T20:56:01.233 INFO:tasks.rados.rados.0.smithi166.stdout:432: done (15 left) 2020-11-16T20:56:01.233 INFO:tasks.rados.rados.0.smithi166.stdout:433: done (14 left) 2020-11-16T20:56:01.233 INFO:tasks.rados.rados.0.smithi166.stdout:448: write initial oid 448 2020-11-16T20:56:01.233 INFO:tasks.rados.rados.0.smithi166.stdout:448: seq_num 447 ranges {712729=784777,2091098=467491,3342313=170416} 2020-11-16T20:56:01.233 INFO:tasks.rados.rados.0.smithi166.stdout:448: writing smithi16641208-448 from 712729 to 1497506 tid 1 2020-11-16T20:56:01.233 INFO:tasks.rados.rados.0.smithi166.stdout:448: writing smithi16641208-448 from 2091098 to 2558589 tid 2 2020-11-16T20:56:01.233 INFO:tasks.rados.rados.0.smithi166.stdout:448: writing smithi16641208-448 from 3342313 to 3512729 tid 3 2020-11-16T20:56:01.234 INFO:tasks.rados.rados.0.smithi166.stdout:449: write initial oid 449 2020-11-16T20:56:01.234 INFO:tasks.rados.rados.0.smithi166.stdout:449: seq_num 448 ranges {729536=460026,1749580=611149,2853383=452450} 2020-11-16T20:56:01.234 INFO:tasks.rados.rados.0.smithi166.stdout:449: writing smithi16641208-449 from 729536 to 1189562 tid 1 2020-11-16T20:56:01.234 INFO:tasks.rados.rados.0.smithi166.stdout:449: writing smithi16641208-449 from 1749580 to 2360729 tid 2 2020-11-16T20:56:01.234 INFO:tasks.rados.rados.0.smithi166.stdout:449: writing smithi16641208-449 from 2853383 to 3305833 tid 3 2020-11-16T20:56:01.234 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.234 INFO:tasks.rados.rados.0.smithi166.stdout:434: finishing write tid 4 to smithi16641208-434 2020-11-16T20:56:01.235 INFO:tasks.rados.rados.0.smithi166.stdout:434: finishing write tid 5 to smithi16641208-434 2020-11-16T20:56:01.235 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 434 v 327 (ObjNum 433 snap 0 seq_num 433) dirty exists 2020-11-16T20:56:01.235 INFO:tasks.rados.rados.0.smithi166.stdout:434: left oid 434 (ObjNum 433 snap 0 seq_num 433) 2020-11-16T20:56:01.235 INFO:tasks.rados.rados.0.smithi166.stdout:435: finishing write tid 3 to smithi16641208-435 2020-11-16T20:56:01.235 INFO:tasks.rados.rados.0.smithi166.stdout:434: done (15 left) 2020-11-16T20:56:01.235 INFO:tasks.rados.rados.0.smithi166.stdout:450: write initial oid 450 2020-11-16T20:56:01.235 INFO:tasks.rados.rados.0.smithi166.stdout:450: seq_num 449 ranges {746343=651628,1924415=754807,3397159=149184} 2020-11-16T20:56:01.235 INFO:tasks.rados.rados.0.smithi166.stdout:450: writing smithi16641208-450 from 746343 to 1397971 tid 1 2020-11-16T20:56:01.236 INFO:tasks.rados.rados.0.smithi166.stdout:450: writing smithi16641208-450 from 1924415 to 2679222 tid 2 2020-11-16T20:56:01.236 INFO:tasks.rados.rados.0.smithi166.stdout:450: writing smithi16641208-450 from 3397159 to 3546343 tid 3 2020-11-16T20:56:01.236 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.236 INFO:tasks.rados.rados.0.smithi166.stdout:435: finishing write tid 4 to smithi16641208-435 2020-11-16T20:56:01.236 INFO:tasks.rados.rados.0.smithi166.stdout:435: finishing write tid 5 to smithi16641208-435 2020-11-16T20:56:01.236 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 435 v 298 (ObjNum 434 snap 0 seq_num 434) dirty exists 2020-11-16T20:56:01.236 INFO:tasks.rados.rados.0.smithi166.stdout:435: left oid 435 (ObjNum 434 snap 0 seq_num 434) 2020-11-16T20:56:01.237 INFO:tasks.rados.rados.0.smithi166.stdout:436: finishing write tid 1 to smithi16641208-436 2020-11-16T20:56:01.237 INFO:tasks.rados.rados.0.smithi166.stdout:435: done (15 left) 2020-11-16T20:56:01.237 INFO:tasks.rados.rados.0.smithi166.stdout:451: write initial oid 451 2020-11-16T20:56:01.237 INFO:tasks.rados.rados.0.smithi166.stdout:451: seq_num 450 ranges {763150=726877,1982897=614818,3024582=474994} 2020-11-16T20:56:01.237 INFO:tasks.rados.rados.0.smithi166.stdout:451: writing smithi16641208-451 from 763150 to 1490027 tid 1 2020-11-16T20:56:01.237 INFO:tasks.rados.rados.0.smithi166.stdout:451: writing smithi16641208-451 from 1982897 to 2597715 tid 2 2020-11-16T20:56:01.237 INFO:tasks.rados.rados.0.smithi166.stdout:451: writing smithi16641208-451 from 3024582 to 3499576 tid 3 2020-11-16T20:56:01.237 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.238 INFO:tasks.rados.rados.0.smithi166.stdout:436: finishing write tid 2 to smithi16641208-436 2020-11-16T20:56:01.238 INFO:tasks.rados.rados.0.smithi166.stdout:436: finishing write tid 3 to smithi16641208-436 2020-11-16T20:56:01.238 INFO:tasks.rados.rados.0.smithi166.stdout:436: finishing write tid 4 to smithi16641208-436 2020-11-16T20:56:01.238 INFO:tasks.rados.rados.0.smithi166.stdout:436: finishing write tid 5 to smithi16641208-436 2020-11-16T20:56:01.238 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 436 v 374 (ObjNum 435 snap 0 seq_num 435) dirty exists 2020-11-16T20:56:01.238 INFO:tasks.rados.rados.0.smithi166.stdout:436: left oid 436 (ObjNum 435 snap 0 seq_num 435) 2020-11-16T20:56:01.238 INFO:tasks.rados.rados.0.smithi166.stdout:437: finishing write tid 1 to smithi16641208-437 2020-11-16T20:56:01.239 INFO:tasks.rados.rados.0.smithi166.stdout:437: finishing write tid 2 to smithi16641208-437 2020-11-16T20:56:01.239 INFO:tasks.rados.rados.0.smithi166.stdout:437: finishing write tid 3 to smithi16641208-437 2020-11-16T20:56:01.239 INFO:tasks.rados.rados.0.smithi166.stdout:437: finishing write tid 4 to smithi16641208-437 2020-11-16T20:56:01.239 INFO:tasks.rados.rados.0.smithi166.stdout:437: finishing write tid 5 to smithi16641208-437 2020-11-16T20:56:01.239 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 437 v 330 (ObjNum 436 snap 0 seq_num 436) dirty exists 2020-11-16T20:56:01.239 INFO:tasks.rados.rados.0.smithi166.stdout:437: left oid 437 (ObjNum 436 snap 0 seq_num 436) 2020-11-16T20:56:01.239 INFO:tasks.rados.rados.0.smithi166.stdout:438: finishing write tid 1 to smithi16641208-438 2020-11-16T20:56:01.239 INFO:tasks.rados.rados.0.smithi166.stdout:438: finishing write tid 2 to smithi16641208-438 2020-11-16T20:56:01.240 INFO:tasks.rados.rados.0.smithi166.stdout:438: finishing write tid 3 to smithi16641208-438 2020-11-16T20:56:01.240 INFO:tasks.rados.rados.0.smithi166.stdout:438: finishing write tid 4 to smithi16641208-438 2020-11-16T20:56:01.240 INFO:tasks.rados.rados.0.smithi166.stdout:438: finishing write tid 5 to smithi16641208-438 2020-11-16T20:56:01.240 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 438 v 378 (ObjNum 437 snap 0 seq_num 437) dirty exists 2020-11-16T20:56:01.240 INFO:tasks.rados.rados.0.smithi166.stdout:438: left oid 438 (ObjNum 437 snap 0 seq_num 437) 2020-11-16T20:56:01.240 INFO:tasks.rados.rados.0.smithi166.stdout:436: done (15 left) 2020-11-16T20:56:01.240 INFO:tasks.rados.rados.0.smithi166.stdout:437: done (14 left) 2020-11-16T20:56:01.241 INFO:tasks.rados.rados.0.smithi166.stdout:438: done (13 left) 2020-11-16T20:56:01.241 INFO:tasks.rados.rados.0.smithi166.stdout:452: write initial oid 452 2020-11-16T20:56:01.241 INFO:tasks.rados.rados.0.smithi166.stdout:452: seq_num 451 ranges {779957=402126,1925026=758476,3335652=244305} 2020-11-16T20:56:01.241 INFO:tasks.rados.rados.0.smithi166.stdout:452: writing smithi16641208-452 from 779957 to 1182083 tid 1 2020-11-16T20:56:01.241 INFO:tasks.rados.rados.0.smithi166.stdout:452: writing smithi16641208-452 from 1925026 to 2683502 tid 2 2020-11-16T20:56:01.241 INFO:tasks.rados.rados.0.smithi166.stdout:452: writing smithi16641208-452 from 3335652 to 3579957 tid 3 2020-11-16T20:56:01.241 INFO:tasks.rados.rados.0.smithi166.stdout:453: write initial oid 453 2020-11-16T20:56:01.241 INFO:tasks.rados.rados.0.smithi166.stdout:453: seq_num 452 ranges {796764=477375,1983508=618487,3363075=233689} 2020-11-16T20:56:01.242 INFO:tasks.rados.rados.0.smithi166.stdout:453: writing smithi16641208-453 from 796764 to 1274139 tid 1 2020-11-16T20:56:01.242 INFO:tasks.rados.rados.0.smithi166.stdout:453: writing smithi16641208-453 from 1983508 to 2601995 tid 2 2020-11-16T20:56:01.242 INFO:tasks.rados.rados.0.smithi166.stdout:453: writing smithi16641208-453 from 3363075 to 3596764 tid 3 2020-11-16T20:56:01.242 INFO:tasks.rados.rados.0.smithi166.stdout:454: write initial oid 454 2020-11-16T20:56:01.242 INFO:tasks.rados.rados.0.smithi166.stdout:454: seq_num 453 ranges {413571=552624,1641990=762145,2990498=425163} 2020-11-16T20:56:01.242 INFO:tasks.rados.rados.0.smithi166.stdout:454: writing smithi16641208-454 from 413571 to 966195 tid 1 2020-11-16T20:56:01.242 INFO:tasks.rados.rados.0.smithi166.stdout:454: writing smithi16641208-454 from 1641990 to 2404135 tid 2 2020-11-16T20:56:01.243 INFO:tasks.rados.rados.0.smithi166.stdout:454: writing smithi16641208-454 from 2990498 to 3415661 tid 3 2020-11-16T20:56:01.243 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.243 INFO:tasks.rados.rados.0.smithi166.stdout:439: finishing write tid 1 to smithi16641208-439 2020-11-16T20:56:01.243 INFO:tasks.rados.rados.0.smithi166.stdout:439: finishing write tid 2 to smithi16641208-439 2020-11-16T20:56:01.243 INFO:tasks.rados.rados.0.smithi166.stdout:439: finishing write tid 3 to smithi16641208-439 2020-11-16T20:56:01.243 INFO:tasks.rados.rados.0.smithi166.stdout:439: finishing write tid 4 to smithi16641208-439 2020-11-16T20:56:01.243 INFO:tasks.rados.rados.0.smithi166.stdout:439: finishing write tid 5 to smithi16641208-439 2020-11-16T20:56:01.243 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 439 v 382 (ObjNum 438 snap 0 seq_num 438) dirty exists 2020-11-16T20:56:01.244 INFO:tasks.rados.rados.0.smithi166.stdout:439: left oid 439 (ObjNum 438 snap 0 seq_num 438) 2020-11-16T20:56:01.244 INFO:tasks.rados.rados.0.smithi166.stdout:440: finishing write tid 1 to smithi16641208-440 2020-11-16T20:56:01.244 INFO:tasks.rados.rados.0.smithi166.stdout:439: done (15 left) 2020-11-16T20:56:01.244 INFO:tasks.rados.rados.0.smithi166.stdout:455: write initial oid 455 2020-11-16T20:56:01.244 INFO:tasks.rados.rados.0.smithi166.stdout:455: seq_num 454 ranges {430378=627873,1700472=622156,3017921=612457} 2020-11-16T20:56:01.244 INFO:tasks.rados.rados.0.smithi166.stdout:455: writing smithi16641208-455 from 430378 to 1058251 tid 1 2020-11-16T20:56:01.244 INFO:tasks.rados.rados.0.smithi166.stdout:455: writing smithi16641208-455 from 1700472 to 2322628 tid 2 2020-11-16T20:56:01.244 INFO:tasks.rados.rados.0.smithi166.stdout:455: writing smithi16641208-455 from 3017921 to 3630378 tid 3 2020-11-16T20:56:01.245 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.245 INFO:tasks.rados.rados.0.smithi166.stdout:440: finishing write tid 2 to smithi16641208-440 2020-11-16T20:56:01.245 INFO:tasks.rados.rados.0.smithi166.stdout:440: finishing write tid 3 to smithi16641208-440 2020-11-16T20:56:01.245 INFO:tasks.rados.rados.0.smithi166.stdout:440: finishing write tid 4 to smithi16641208-440 2020-11-16T20:56:01.245 INFO:tasks.rados.rados.0.smithi166.stdout:440: finishing write tid 5 to smithi16641208-440 2020-11-16T20:56:01.245 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 440 v 318 (ObjNum 439 snap 0 seq_num 439) dirty exists 2020-11-16T20:56:01.245 INFO:tasks.rados.rados.0.smithi166.stdout:440: left oid 440 (ObjNum 439 snap 0 seq_num 439) 2020-11-16T20:56:01.246 INFO:tasks.rados.rados.0.smithi166.stdout:441: finishing write tid 1 to smithi16641208-441 2020-11-16T20:56:01.246 INFO:tasks.rados.rados.0.smithi166.stdout:441: finishing write tid 2 to smithi16641208-441 2020-11-16T20:56:01.246 INFO:tasks.rados.rados.0.smithi166.stdout:440: done (15 left) 2020-11-16T20:56:01.246 INFO:tasks.rados.rados.0.smithi166.stdout:456: write initial oid 456 2020-11-16T20:56:01.246 INFO:tasks.rados.rados.0.smithi166.stdout:441: finishing write tid 3 to smithi16641208-441 2020-11-16T20:56:01.246 INFO:tasks.rados.rados.0.smithi166.stdout:442: finishing write tid 1 to smithi16641208-442 2020-11-16T20:56:01.246 INFO:tasks.rados.rados.0.smithi166.stdout:456: seq_num 455 ranges {447185=703122,1642601=765814,2928991=447707} 2020-11-16T20:56:01.246 INFO:tasks.rados.rados.0.smithi166.stdout:456: writing smithi16641208-456 from 447185 to 1150307 tid 1 2020-11-16T20:56:01.247 INFO:tasks.rados.rados.0.smithi166.stdout:456: writing smithi16641208-456 from 1642601 to 2408415 tid 2 2020-11-16T20:56:01.247 INFO:tasks.rados.rados.0.smithi166.stdout:456: writing smithi16641208-456 from 2928991 to 3376698 tid 3 2020-11-16T20:56:01.247 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.247 INFO:tasks.rados.rados.0.smithi166.stdout:442: finishing write tid 2 to smithi16641208-442 2020-11-16T20:56:01.247 INFO:tasks.rados.rados.0.smithi166.stdout:442: finishing write tid 3 to smithi16641208-442 2020-11-16T20:56:01.247 INFO:tasks.rados.rados.0.smithi166.stdout:442: finishing write tid 4 to smithi16641208-442 2020-11-16T20:56:01.247 INFO:tasks.rados.rados.0.smithi166.stdout:441: finishing write tid 4 to smithi16641208-441 2020-11-16T20:56:01.248 INFO:tasks.rados.rados.0.smithi166.stdout:442: finishing write tid 5 to smithi16641208-442 2020-11-16T20:56:01.248 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 442 v 386 (ObjNum 441 snap 0 seq_num 441) dirty exists 2020-11-16T20:56:01.248 INFO:tasks.rados.rados.0.smithi166.stdout:442: left oid 442 (ObjNum 441 snap 0 seq_num 441) 2020-11-16T20:56:01.248 INFO:tasks.rados.rados.0.smithi166.stdout:441: finishing write tid 5 to smithi16641208-441 2020-11-16T20:56:01.248 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 441 v 322 (ObjNum 440 snap 0 seq_num 440) dirty exists 2020-11-16T20:56:01.248 INFO:tasks.rados.rados.0.smithi166.stdout:441: left oid 441 (ObjNum 440 snap 0 seq_num 440) 2020-11-16T20:56:01.248 INFO:tasks.rados.rados.0.smithi166.stdout:443: finishing write tid 1 to smithi16641208-443 2020-11-16T20:56:01.248 INFO:tasks.rados.rados.0.smithi166.stdout:443: finishing write tid 2 to smithi16641208-443 2020-11-16T20:56:01.249 INFO:tasks.rados.rados.0.smithi166.stdout:443: finishing write tid 3 to smithi16641208-443 2020-11-16T20:56:01.249 INFO:tasks.rados.rados.0.smithi166.stdout:443: finishing write tid 4 to smithi16641208-443 2020-11-16T20:56:01.249 INFO:tasks.rados.rados.0.smithi166.stdout:443: finishing write tid 5 to smithi16641208-443 2020-11-16T20:56:01.249 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 443 v 327 (ObjNum 442 snap 0 seq_num 442) dirty exists 2020-11-16T20:56:01.249 INFO:tasks.rados.rados.0.smithi166.stdout:443: left oid 443 (ObjNum 442 snap 0 seq_num 442) 2020-11-16T20:56:01.249 INFO:tasks.rados.rados.0.smithi166.stdout:444: finishing write tid 1 to smithi16641208-444 2020-11-16T20:56:01.249 INFO:tasks.rados.rados.0.smithi166.stdout:444: finishing write tid 2 to smithi16641208-444 2020-11-16T20:56:01.249 INFO:tasks.rados.rados.0.smithi166.stdout:444: finishing write tid 3 to smithi16641208-444 2020-11-16T20:56:01.250 INFO:tasks.rados.rados.0.smithi166.stdout:444: finishing write tid 4 to smithi16641208-444 2020-11-16T20:56:01.250 INFO:tasks.rados.rados.0.smithi166.stdout:444: finishing write tid 5 to smithi16641208-444 2020-11-16T20:56:01.250 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 444 v 390 (ObjNum 443 snap 0 seq_num 443) dirty exists 2020-11-16T20:56:01.250 INFO:tasks.rados.rados.0.smithi166.stdout:444: left oid 444 (ObjNum 443 snap 0 seq_num 443) 2020-11-16T20:56:01.250 INFO:tasks.rados.rados.0.smithi166.stdout:445: finishing write tid 1 to smithi16641208-445 2020-11-16T20:56:01.250 INFO:tasks.rados.rados.0.smithi166.stdout:445: finishing write tid 2 to smithi16641208-445 2020-11-16T20:56:01.250 INFO:tasks.rados.rados.0.smithi166.stdout:445: finishing write tid 3 to smithi16641208-445 2020-11-16T20:56:01.251 INFO:tasks.rados.rados.0.smithi166.stdout:445: finishing write tid 4 to smithi16641208-445 2020-11-16T20:56:01.251 INFO:tasks.rados.rados.0.smithi166.stdout:441: done (15 left) 2020-11-16T20:56:01.251 INFO:tasks.rados.rados.0.smithi166.stdout:442: done (14 left) 2020-11-16T20:56:01.251 INFO:tasks.rados.rados.0.smithi166.stdout:443: done (13 left) 2020-11-16T20:56:01.251 INFO:tasks.rados.rados.0.smithi166.stdout:444: done (12 left) 2020-11-16T20:56:01.251 INFO:tasks.rados.rados.0.smithi166.stdout:457: write initial oid 457 2020-11-16T20:56:01.251 INFO:tasks.rados.rados.0.smithi166.stdout:457: seq_num 456 ranges {463992=778371,1701083=625825,2956414=658979} 2020-11-16T20:56:01.251 INFO:tasks.rados.rados.0.smithi166.stdout:457: writing smithi16641208-457 from 463992 to 1242363 tid 1 2020-11-16T20:56:01.252 INFO:tasks.rados.rados.0.smithi166.stdout:457: writing smithi16641208-457 from 1701083 to 2326908 tid 2 2020-11-16T20:56:01.252 INFO:tasks.rados.rados.0.smithi166.stdout:457: writing smithi16641208-457 from 2956414 to 3615393 tid 3 2020-11-16T20:56:01.252 INFO:tasks.rados.rados.0.smithi166.stdout:458: write initial oid 458 2020-11-16T20:56:01.252 INFO:tasks.rados.rados.0.smithi166.stdout:458: seq_num 457 ranges {480799=569973,1475918=769483,2700190=586604} 2020-11-16T20:56:01.252 INFO:tasks.rados.rados.0.smithi166.stdout:458: writing smithi16641208-458 from 480799 to 1050772 tid 1 2020-11-16T20:56:01.252 INFO:tasks.rados.rados.0.smithi166.stdout:458: writing smithi16641208-458 from 1475918 to 2245401 tid 2 2020-11-16T20:56:01.252 INFO:tasks.rados.rados.0.smithi166.stdout:458: writing smithi16641208-458 from 2700190 to 3286794 tid 3 2020-11-16T20:56:01.252 INFO:tasks.rados.rados.0.smithi166.stdout:459: write initial oid 459 2020-11-16T20:56:01.253 INFO:tasks.rados.rados.0.smithi166.stdout:459: seq_num 458 ranges {497606=645222,1934400=629494,3243966=453640} 2020-11-16T20:56:01.253 INFO:tasks.rados.rados.0.smithi166.stdout:459: writing smithi16641208-459 from 497606 to 1142828 tid 1 2020-11-16T20:56:01.253 INFO:tasks.rados.rados.0.smithi166.stdout:459: writing smithi16641208-459 from 1934400 to 2563894 tid 2 2020-11-16T20:56:01.253 INFO:tasks.rados.rados.0.smithi166.stdout:459: writing smithi16641208-459 from 3243966 to 3697606 tid 3 2020-11-16T20:56:01.253 INFO:tasks.rados.rados.0.smithi166.stdout:460: write initial oid 460 2020-11-16T20:56:01.253 INFO:tasks.rados.rados.0.smithi166.stdout:460: seq_num 459 ranges {514413=720471,1876529=773152,3438683=275730} 2020-11-16T20:56:01.253 INFO:tasks.rados.rados.0.smithi166.stdout:460: writing smithi16641208-460 from 514413 to 1234884 tid 1 2020-11-16T20:56:01.254 INFO:tasks.rados.rados.0.smithi166.stdout:460: writing smithi16641208-460 from 1876529 to 2649681 tid 2 2020-11-16T20:56:01.254 INFO:tasks.rados.rados.0.smithi166.stdout:460: writing smithi16641208-460 from 3438683 to 3714413 tid 3 2020-11-16T20:56:01.254 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.254 INFO:tasks.rados.rados.0.smithi166.stdout:445: finishing write tid 5 to smithi16641208-445 2020-11-16T20:56:01.254 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 445 v 302 (ObjNum 444 snap 0 seq_num 444) dirty exists 2020-11-16T20:56:01.254 INFO:tasks.rados.rados.0.smithi166.stdout:445: left oid 445 (ObjNum 444 snap 0 seq_num 444) 2020-11-16T20:56:01.254 INFO:tasks.rados.rados.0.smithi166.stdout:445: done (15 left) 2020-11-16T20:56:01.254 INFO:tasks.rados.rados.0.smithi166.stdout:461: write initial oid 461 2020-11-16T20:56:01.255 INFO:tasks.rados.rados.0.smithi166.stdout:461: seq_num 460 ranges {531220=795720,1935011=516810,3066106=420420} 2020-11-16T20:56:01.255 INFO:tasks.rados.rados.0.smithi166.stdout:461: writing smithi16641208-461 from 531220 to 1326940 tid 1 2020-11-16T20:56:01.255 INFO:tasks.rados.rados.0.smithi166.stdout:461: writing smithi16641208-461 from 1935011 to 2451821 tid 2 2020-11-16T20:56:01.255 INFO:tasks.rados.rados.0.smithi166.stdout:461: writing smithi16641208-461 from 3066106 to 3486526 tid 3 2020-11-16T20:56:01.255 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.255 INFO:tasks.rados.rados.0.smithi166.stdout:446: finishing write tid 1 to smithi16641208-446 2020-11-16T20:56:01.256 INFO:tasks.rados.rados.0.smithi166.stdout:446: finishing write tid 2 to smithi16641208-446 2020-11-16T20:56:01.256 INFO:tasks.rados.rados.0.smithi166.stdout:446: finishing write tid 3 to smithi16641208-446 2020-11-16T20:56:01.256 INFO:tasks.rados.rados.0.smithi166.stdout:446: finishing write tid 4 to smithi16641208-446 2020-11-16T20:56:01.256 INFO:tasks.rados.rados.0.smithi166.stdout:446: finishing write tid 5 to smithi16641208-446 2020-11-16T20:56:01.256 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 446 v 331 (ObjNum 445 snap 0 seq_num 445) dirty exists 2020-11-16T20:56:01.256 INFO:tasks.rados.rados.0.smithi166.stdout:446: left oid 446 (ObjNum 445 snap 0 seq_num 445) 2020-11-16T20:56:01.256 INFO:tasks.rados.rados.0.smithi166.stdout:447: finishing write tid 1 to smithi16641208-447 2020-11-16T20:56:01.256 INFO:tasks.rados.rados.0.smithi166.stdout:447: finishing write tid 2 to smithi16641208-447 2020-11-16T20:56:01.257 INFO:tasks.rados.rados.0.smithi166.stdout:447: finishing write tid 3 to smithi16641208-447 2020-11-16T20:56:01.257 INFO:tasks.rados.rados.0.smithi166.stdout:447: finishing write tid 4 to smithi16641208-447 2020-11-16T20:56:01.257 INFO:tasks.rados.rados.0.smithi166.stdout:447: finishing write tid 5 to smithi16641208-447 2020-11-16T20:56:01.257 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 447 v 335 (ObjNum 446 snap 0 seq_num 446) dirty exists 2020-11-16T20:56:01.257 INFO:tasks.rados.rados.0.smithi166.stdout:447: left oid 447 (ObjNum 446 snap 0 seq_num 446) 2020-11-16T20:56:01.257 INFO:tasks.rados.rados.0.smithi166.stdout:448: finishing write tid 1 to smithi16641208-448 2020-11-16T20:56:01.257 INFO:tasks.rados.rados.0.smithi166.stdout:448: finishing write tid 2 to smithi16641208-448 2020-11-16T20:56:01.258 INFO:tasks.rados.rados.0.smithi166.stdout:449: finishing write tid 1 to smithi16641208-449 2020-11-16T20:56:01.258 INFO:tasks.rados.rados.0.smithi166.stdout:448: finishing write tid 3 to smithi16641208-448 2020-11-16T20:56:01.258 INFO:tasks.rados.rados.0.smithi166.stdout:448: finishing write tid 4 to smithi16641208-448 2020-11-16T20:56:01.258 INFO:tasks.rados.rados.0.smithi166.stdout:448: finishing write tid 5 to smithi16641208-448 2020-11-16T20:56:01.258 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 448 v 306 (ObjNum 447 snap 0 seq_num 447) dirty exists 2020-11-16T20:56:01.258 INFO:tasks.rados.rados.0.smithi166.stdout:448: left oid 448 (ObjNum 447 snap 0 seq_num 447) 2020-11-16T20:56:01.258 INFO:tasks.rados.rados.0.smithi166.stdout:446: done (15 left) 2020-11-16T20:56:01.258 INFO:tasks.rados.rados.0.smithi166.stdout:447: done (14 left) 2020-11-16T20:56:01.259 INFO:tasks.rados.rados.0.smithi166.stdout:448: done (13 left) 2020-11-16T20:56:01.259 INFO:tasks.rados.rados.0.smithi166.stdout:462: write initial oid 462 2020-11-16T20:56:01.259 INFO:tasks.rados.rados.0.smithi166.stdout:462: seq_num 461 ranges {548027=470969,1593493=776821,3093529=631692} 2020-11-16T20:56:01.259 INFO:tasks.rados.rados.0.smithi166.stdout:462: writing smithi16641208-462 from 548027 to 1018996 tid 1 2020-11-16T20:56:01.259 INFO:tasks.rados.rados.0.smithi166.stdout:462: writing smithi16641208-462 from 1593493 to 2370314 tid 2 2020-11-16T20:56:01.259 INFO:tasks.rados.rados.0.smithi166.stdout:462: writing smithi16641208-462 from 3093529 to 3725221 tid 3 2020-11-16T20:56:01.259 INFO:tasks.rados.rados.0.smithi166.stdout:463: write initial oid 463 2020-11-16T20:56:01.260 INFO:tasks.rados.rados.0.smithi166.stdout:463: seq_num 462 ranges {564834=546218,1651975=520479,2720952=559317} 2020-11-16T20:56:01.260 INFO:tasks.rados.rados.0.smithi166.stdout:463: writing smithi16641208-463 from 564834 to 1111052 tid 1 2020-11-16T20:56:01.260 INFO:tasks.rados.rados.0.smithi166.stdout:463: writing smithi16641208-463 from 1651975 to 2172454 tid 2 2020-11-16T20:56:01.260 INFO:tasks.rados.rados.0.smithi166.stdout:463: writing smithi16641208-463 from 2720952 to 3280269 tid 3 2020-11-16T20:56:01.260 INFO:tasks.rados.rados.0.smithi166.stdout:464: write initial oid 464 2020-11-16T20:56:01.260 INFO:tasks.rados.rados.0.smithi166.stdout:464: seq_num 463 ranges {581641=621467,1994104=780490,3432022=349619} 2020-11-16T20:56:01.260 INFO:tasks.rados.rados.0.smithi166.stdout:464: writing smithi16641208-464 from 581641 to 1203108 tid 1 2020-11-16T20:56:01.261 INFO:tasks.rados.rados.0.smithi166.stdout:464: writing smithi16641208-464 from 1994104 to 2774594 tid 2 2020-11-16T20:56:01.261 INFO:tasks.rados.rados.0.smithi166.stdout:464: writing smithi16641208-464 from 3432022 to 3781641 tid 3 2020-11-16T20:56:01.261 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.261 INFO:tasks.rados.rados.0.smithi166.stdout:449: finishing write tid 2 to smithi16641208-449 2020-11-16T20:56:01.261 INFO:tasks.rados.rados.0.smithi166.stdout:449: finishing write tid 3 to smithi16641208-449 2020-11-16T20:56:01.261 INFO:tasks.rados.rados.0.smithi166.stdout:449: finishing write tid 4 to smithi16641208-449 2020-11-16T20:56:01.261 INFO:tasks.rados.rados.0.smithi166.stdout:449: finishing write tid 5 to smithi16641208-449 2020-11-16T20:56:01.262 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 449 v 339 (ObjNum 448 snap 0 seq_num 448) dirty exists 2020-11-16T20:56:01.262 INFO:tasks.rados.rados.0.smithi166.stdout:449: left oid 449 (ObjNum 448 snap 0 seq_num 448) 2020-11-16T20:56:01.262 INFO:tasks.rados.rados.0.smithi166.stdout:450: finishing write tid 1 to smithi16641208-450 2020-11-16T20:56:01.262 INFO:tasks.rados.rados.0.smithi166.stdout:449: done (15 left) 2020-11-16T20:56:01.262 INFO:tasks.rados.rados.0.smithi166.stdout:465: write initial oid 465 2020-11-16T20:56:01.262 INFO:tasks.rados.rados.0.smithi166.stdout:465: seq_num 464 ranges {598448=413069,1768939=524148,2775798=581861,3781488=16960} 2020-11-16T20:56:01.262 INFO:tasks.rados.rados.0.smithi166.stdout:465: writing smithi16641208-465 from 598448 to 1011517 tid 1 2020-11-16T20:56:01.263 INFO:tasks.rados.rados.0.smithi166.stdout:465: writing smithi16641208-465 from 1768939 to 2293087 tid 2 2020-11-16T20:56:01.263 INFO:tasks.rados.rados.0.smithi166.stdout:465: writing smithi16641208-465 from 2775798 to 3357659 tid 3 2020-11-16T20:56:01.263 INFO:tasks.rados.rados.0.smithi166.stdout:465: writing smithi16641208-465 from 3781488 to 3798448 tid 4 2020-11-16T20:56:01.263 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.263 INFO:tasks.rados.rados.0.smithi166.stdout:450: finishing write tid 2 to smithi16641208-450 2020-11-16T20:56:01.263 INFO:tasks.rados.rados.0.smithi166.stdout:450: finishing write tid 3 to smithi16641208-450 2020-11-16T20:56:01.263 INFO:tasks.rados.rados.0.smithi166.stdout:450: finishing write tid 4 to smithi16641208-450 2020-11-16T20:56:01.264 INFO:tasks.rados.rados.0.smithi166.stdout:450: finishing write tid 5 to smithi16641208-450 2020-11-16T20:56:01.264 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 450 v 332 (ObjNum 449 snap 0 seq_num 449) dirty exists 2020-11-16T20:56:01.264 INFO:tasks.rados.rados.0.smithi166.stdout:450: left oid 450 (ObjNum 449 snap 0 seq_num 449) 2020-11-16T20:56:01.264 INFO:tasks.rados.rados.0.smithi166.stdout:451: finishing write tid 1 to smithi16641208-451 2020-11-16T20:56:01.264 INFO:tasks.rados.rados.0.smithi166.stdout:451: finishing write tid 2 to smithi16641208-451 2020-11-16T20:56:01.264 INFO:tasks.rados.rados.0.smithi166.stdout:451: finishing write tid 3 to smithi16641208-451 2020-11-16T20:56:01.264 INFO:tasks.rados.rados.0.smithi166.stdout:451: finishing write tid 4 to smithi16641208-451 2020-11-16T20:56:01.265 INFO:tasks.rados.rados.0.smithi166.stdout:452: finishing write tid 1 to smithi16641208-452 2020-11-16T20:56:01.265 INFO:tasks.rados.rados.0.smithi166.stdout:452: finishing write tid 2 to smithi16641208-452 2020-11-16T20:56:01.265 INFO:tasks.rados.rados.0.smithi166.stdout:451: finishing write tid 5 to smithi16641208-451 2020-11-16T20:56:01.265 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 451 v 308 (ObjNum 450 snap 0 seq_num 450) dirty exists 2020-11-16T20:56:01.265 INFO:tasks.rados.rados.0.smithi166.stdout:451: left oid 451 (ObjNum 450 snap 0 seq_num 450) 2020-11-16T20:56:01.265 INFO:tasks.rados.rados.0.smithi166.stdout:452: finishing write tid 3 to smithi16641208-452 2020-11-16T20:56:01.265 INFO:tasks.rados.rados.0.smithi166.stdout:452: finishing write tid 4 to smithi16641208-452 2020-11-16T20:56:01.265 INFO:tasks.rados.rados.0.smithi166.stdout:452: finishing write tid 5 to smithi16641208-452 2020-11-16T20:56:01.266 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 452 v 312 (ObjNum 451 snap 0 seq_num 451) dirty exists 2020-11-16T20:56:01.266 INFO:tasks.rados.rados.0.smithi166.stdout:452: left oid 452 (ObjNum 451 snap 0 seq_num 451) 2020-11-16T20:56:01.266 INFO:tasks.rados.rados.0.smithi166.stdout:453: finishing write tid 1 to smithi16641208-453 2020-11-16T20:56:01.266 INFO:tasks.rados.rados.0.smithi166.stdout:453: finishing write tid 2 to smithi16641208-453 2020-11-16T20:56:01.266 INFO:tasks.rados.rados.0.smithi166.stdout:453: finishing write tid 3 to smithi16641208-453 2020-11-16T20:56:01.266 INFO:tasks.rados.rados.0.smithi166.stdout:453: finishing write tid 4 to smithi16641208-453 2020-11-16T20:56:01.266 INFO:tasks.rados.rados.0.smithi166.stdout:453: finishing write tid 5 to smithi16641208-453 2020-11-16T20:56:01.267 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 453 v 343 (ObjNum 452 snap 0 seq_num 452) dirty exists 2020-11-16T20:56:01.267 INFO:tasks.rados.rados.0.smithi166.stdout:453: left oid 453 (ObjNum 452 snap 0 seq_num 452) 2020-11-16T20:56:01.267 INFO:tasks.rados.rados.0.smithi166.stdout:454: finishing write tid 1 to smithi16641208-454 2020-11-16T20:56:01.267 INFO:tasks.rados.rados.0.smithi166.stdout:454: finishing write tid 2 to smithi16641208-454 2020-11-16T20:56:01.267 INFO:tasks.rados.rados.0.smithi166.stdout:455: finishing write tid 1 to smithi16641208-455 2020-11-16T20:56:01.267 INFO:tasks.rados.rados.0.smithi166.stdout:454: finishing write tid 3 to smithi16641208-454 2020-11-16T20:56:01.267 INFO:tasks.rados.rados.0.smithi166.stdout:454: finishing write tid 4 to smithi16641208-454 2020-11-16T20:56:01.268 INFO:tasks.rados.rados.0.smithi166.stdout:455: finishing write tid 2 to smithi16641208-455 2020-11-16T20:56:01.268 INFO:tasks.rados.rados.0.smithi166.stdout:454: finishing write tid 5 to smithi16641208-454 2020-11-16T20:56:01.268 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 454 v 347 (ObjNum 453 snap 0 seq_num 453) dirty exists 2020-11-16T20:56:01.268 INFO:tasks.rados.rados.0.smithi166.stdout:454: left oid 454 (ObjNum 453 snap 0 seq_num 453) 2020-11-16T20:56:01.268 INFO:tasks.rados.rados.0.smithi166.stdout:450: done (15 left) 2020-11-16T20:56:01.268 INFO:tasks.rados.rados.0.smithi166.stdout:451: done (14 left) 2020-11-16T20:56:01.268 INFO:tasks.rados.rados.0.smithi166.stdout:452: done (13 left) 2020-11-16T20:56:01.269 INFO:tasks.rados.rados.0.smithi166.stdout:453: done (12 left) 2020-11-16T20:56:01.269 INFO:tasks.rados.rados.0.smithi166.stdout:454: done (11 left) 2020-11-16T20:56:01.269 INFO:tasks.rados.rados.0.smithi166.stdout:466: write initial oid 466 2020-11-16T20:56:01.269 INFO:tasks.rados.rados.0.smithi166.stdout:466: seq_num 465 ranges {615255=488318,1827421=784159,3203221=612034} 2020-11-16T20:56:01.269 INFO:tasks.rados.rados.0.smithi166.stdout:466: writing smithi16641208-466 from 615255 to 1103573 tid 1 2020-11-16T20:56:01.269 INFO:tasks.rados.rados.0.smithi166.stdout:466: writing smithi16641208-466 from 1827421 to 2611580 tid 2 2020-11-16T20:56:01.269 INFO:tasks.rados.rados.0.smithi166.stdout:466: writing smithi16641208-466 from 3203221 to 3815255 tid 3 2020-11-16T20:56:01.269 INFO:tasks.rados.rados.0.smithi166.stdout:467: write initial oid 467 2020-11-16T20:56:01.270 INFO:tasks.rados.rados.0.smithi166.stdout:467: seq_num 466 ranges {632062=563567,1885903=527817,2830644=720758} 2020-11-16T20:56:01.270 INFO:tasks.rados.rados.0.smithi166.stdout:467: writing smithi16641208-467 from 632062 to 1195629 tid 1 2020-11-16T20:56:01.270 INFO:tasks.rados.rados.0.smithi166.stdout:467: writing smithi16641208-467 from 1885903 to 2413720 tid 2 2020-11-16T20:56:01.270 INFO:tasks.rados.rados.0.smithi166.stdout:467: writing smithi16641208-467 from 2830644 to 3551402 tid 3 2020-11-16T20:56:01.270 INFO:tasks.rados.rados.0.smithi166.stdout:468: write initial oid 468 2020-11-16T20:56:01.270 INFO:tasks.rados.rados.0.smithi166.stdout:468: seq_num 467 ranges {648869=638816,1828032=787828,3141714=532030} 2020-11-16T20:56:01.270 INFO:tasks.rados.rados.0.smithi166.stdout:468: writing smithi16641208-468 from 648869 to 1287685 tid 1 2020-11-16T20:56:01.271 INFO:tasks.rados.rados.0.smithi166.stdout:468: writing smithi16641208-468 from 1828032 to 2615860 tid 2 2020-11-16T20:56:01.271 INFO:tasks.rados.rados.0.smithi166.stdout:468: writing smithi16641208-468 from 3141714 to 3673744 tid 3 2020-11-16T20:56:01.271 INFO:tasks.rados.rados.0.smithi166.stdout:469: write initial oid 469 2020-11-16T20:56:01.271 INFO:tasks.rados.rados.0.smithi166.stdout:469: seq_num 468 ranges {665676=714065,1886514=531486,3169137=696539} 2020-11-16T20:56:01.271 INFO:tasks.rados.rados.0.smithi166.stdout:469: writing smithi16641208-469 from 665676 to 1379741 tid 1 2020-11-16T20:56:01.271 INFO:tasks.rados.rados.0.smithi166.stdout:469: writing smithi16641208-469 from 1886514 to 2418000 tid 2 2020-11-16T20:56:01.271 INFO:tasks.rados.rados.0.smithi166.stdout:469: writing smithi16641208-469 from 3169137 to 3865676 tid 3 2020-11-16T20:56:01.271 INFO:tasks.rados.rados.0.smithi166.stdout:470: write initial oid 470 2020-11-16T20:56:01.272 INFO:tasks.rados.rados.0.smithi166.stdout:470: seq_num 469 ranges {682483=789314,1944996=791497,3196560=554574} 2020-11-16T20:56:01.272 INFO:tasks.rados.rados.0.smithi166.stdout:470: writing smithi16641208-470 from 682483 to 1471797 tid 1 2020-11-16T20:56:01.272 INFO:tasks.rados.rados.0.smithi166.stdout:470: writing smithi16641208-470 from 1944996 to 2736493 tid 2 2020-11-16T20:56:01.272 INFO:tasks.rados.rados.0.smithi166.stdout:470: writing smithi16641208-470 from 3196560 to 3751134 tid 3 2020-11-16T20:56:01.272 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.272 INFO:tasks.rados.rados.0.smithi166.stdout:455: finishing write tid 3 to smithi16641208-455 2020-11-16T20:56:01.272 INFO:tasks.rados.rados.0.smithi166.stdout:455: finishing write tid 4 to smithi16641208-455 2020-11-16T20:56:01.273 INFO:tasks.rados.rados.0.smithi166.stdout:455: finishing write tid 5 to smithi16641208-455 2020-11-16T20:56:01.273 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 455 v 394 (ObjNum 454 snap 0 seq_num 454) dirty exists 2020-11-16T20:56:01.273 INFO:tasks.rados.rados.0.smithi166.stdout:455: left oid 455 (ObjNum 454 snap 0 seq_num 454) 2020-11-16T20:56:01.273 INFO:tasks.rados.rados.0.smithi166.stdout:456: finishing write tid 1 to smithi16641208-456 2020-11-16T20:56:01.273 INFO:tasks.rados.rados.0.smithi166.stdout:456: finishing write tid 2 to smithi16641208-456 2020-11-16T20:56:01.273 INFO:tasks.rados.rados.0.smithi166.stdout:456: finishing write tid 3 to smithi16641208-456 2020-11-16T20:56:01.273 INFO:tasks.rados.rados.0.smithi166.stdout:456: finishing write tid 4 to smithi16641208-456 2020-11-16T20:56:01.273 INFO:tasks.rados.rados.0.smithi166.stdout:456: finishing write tid 5 to smithi16641208-456 2020-11-16T20:56:01.274 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 456 v 349 (ObjNum 455 snap 0 seq_num 455) dirty exists 2020-11-16T20:56:01.274 INFO:tasks.rados.rados.0.smithi166.stdout:456: left oid 456 (ObjNum 455 snap 0 seq_num 455) 2020-11-16T20:56:01.274 INFO:tasks.rados.rados.0.smithi166.stdout:457: finishing write tid 1 to smithi16641208-457 2020-11-16T20:56:01.274 INFO:tasks.rados.rados.0.smithi166.stdout:457: finishing write tid 2 to smithi16641208-457 2020-11-16T20:56:01.274 INFO:tasks.rados.rados.0.smithi166.stdout:457: finishing write tid 3 to smithi16641208-457 2020-11-16T20:56:01.274 INFO:tasks.rados.rados.0.smithi166.stdout:457: finishing write tid 4 to smithi16641208-457 2020-11-16T20:56:01.274 INFO:tasks.rados.rados.0.smithi166.stdout:457: finishing write tid 5 to smithi16641208-457 2020-11-16T20:56:01.275 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 457 v 398 (ObjNum 456 snap 0 seq_num 456) dirty exists 2020-11-16T20:56:01.275 INFO:tasks.rados.rados.0.smithi166.stdout:457: left oid 457 (ObjNum 456 snap 0 seq_num 456) 2020-11-16T20:56:01.275 INFO:tasks.rados.rados.0.smithi166.stdout:458: finishing write tid 1 to smithi16641208-458 2020-11-16T20:56:01.275 INFO:tasks.rados.rados.0.smithi166.stdout:458: finishing write tid 2 to smithi16641208-458 2020-11-16T20:56:01.275 INFO:tasks.rados.rados.0.smithi166.stdout:458: finishing write tid 3 to smithi16641208-458 2020-11-16T20:56:01.275 INFO:tasks.rados.rados.0.smithi166.stdout:458: finishing write tid 4 to smithi16641208-458 2020-11-16T20:56:01.275 INFO:tasks.rados.rados.0.smithi166.stdout:455: done (15 left) 2020-11-16T20:56:01.275 INFO:tasks.rados.rados.0.smithi166.stdout:456: done (14 left) 2020-11-16T20:56:01.276 INFO:tasks.rados.rados.0.smithi166.stdout:457: done (13 left) 2020-11-16T20:56:01.276 INFO:tasks.rados.rados.0.smithi166.stdout:471: write initial oid 471 2020-11-16T20:56:01.276 INFO:tasks.rados.rados.0.smithi166.stdout:471: seq_num 470 ranges {699290=464563,1603478=535155,2823983=765846} 2020-11-16T20:56:01.276 INFO:tasks.rados.rados.0.smithi166.stdout:471: writing smithi16641208-471 from 699290 to 1163853 tid 1 2020-11-16T20:56:01.276 INFO:tasks.rados.rados.0.smithi166.stdout:471: writing smithi16641208-471 from 1603478 to 2138633 tid 2 2020-11-16T20:56:01.276 INFO:tasks.rados.rados.0.smithi166.stdout:471: writing smithi16641208-471 from 2823983 to 3589829 tid 3 2020-11-16T20:56:01.276 INFO:tasks.rados.rados.0.smithi166.stdout:472: write initial oid 472 2020-11-16T20:56:01.276 INFO:tasks.rados.rados.0.smithi166.stdout:472: seq_num 471 ranges {716097=539812,1945607=795166,3535053=381044} 2020-11-16T20:56:01.277 INFO:tasks.rados.rados.0.smithi166.stdout:472: writing smithi16641208-472 from 716097 to 1255909 tid 1 2020-11-16T20:56:01.277 INFO:tasks.rados.rados.0.smithi166.stdout:472: writing smithi16641208-472 from 1945607 to 2740773 tid 2 2020-11-16T20:56:01.277 INFO:tasks.rados.rados.0.smithi166.stdout:472: writing smithi16641208-472 from 3535053 to 3916097 tid 3 2020-11-16T20:56:01.277 INFO:tasks.rados.rados.0.smithi166.stdout:473: write initial oid 473 2020-11-16T20:56:01.277 INFO:tasks.rados.rados.0.smithi166.stdout:473: seq_num 472 ranges {732904=731414,2120442=538824,3278829=504743} 2020-11-16T20:56:01.277 INFO:tasks.rados.rados.0.smithi166.stdout:473: writing smithi16641208-473 from 732904 to 1464318 tid 1 2020-11-16T20:56:01.277 INFO:tasks.rados.rados.0.smithi166.stdout:473: writing smithi16641208-473 from 2120442 to 2659266 tid 2 2020-11-16T20:56:01.278 INFO:tasks.rados.rados.0.smithi166.stdout:473: writing smithi16641208-473 from 3278829 to 3783572 tid 3 2020-11-16T20:56:01.278 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.278 INFO:tasks.rados.rados.0.smithi166.stdout:458: finishing write tid 5 to smithi16641208-458 2020-11-16T20:56:01.278 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 458 v 316 (ObjNum 457 snap 0 seq_num 457) dirty exists 2020-11-16T20:56:01.278 INFO:tasks.rados.rados.0.smithi166.stdout:458: left oid 458 (ObjNum 457 snap 0 seq_num 457) 2020-11-16T20:56:01.278 INFO:tasks.rados.rados.0.smithi166.stdout:459: finishing write tid 1 to smithi16641208-459 2020-11-16T20:56:01.278 INFO:tasks.rados.rados.0.smithi166.stdout:459: finishing write tid 2 to smithi16641208-459 2020-11-16T20:56:01.279 INFO:tasks.rados.rados.0.smithi166.stdout:459: finishing write tid 3 to smithi16641208-459 2020-11-16T20:56:01.279 INFO:tasks.rados.rados.0.smithi166.stdout:459: finishing write tid 4 to smithi16641208-459 2020-11-16T20:56:01.279 INFO:tasks.rados.rados.0.smithi166.stdout:458: done (15 left) 2020-11-16T20:56:01.279 INFO:tasks.rados.rados.0.smithi166.stdout:474: write initial oid 474 2020-11-16T20:56:01.279 INFO:tasks.rados.rados.0.smithi166.stdout:474: seq_num 473 ranges {749711=406663,1778924=682482,3189899=716015} 2020-11-16T20:56:01.279 INFO:tasks.rados.rados.0.smithi166.stdout:474: writing smithi16641208-474 from 749711 to 1156374 tid 1 2020-11-16T20:56:01.279 INFO:tasks.rados.rados.0.smithi166.stdout:474: writing smithi16641208-474 from 1778924 to 2461406 tid 2 2020-11-16T20:56:01.279 INFO:tasks.rados.rados.0.smithi166.stdout:474: writing smithi16641208-474 from 3189899 to 3905914 tid 3 2020-11-16T20:56:01.280 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.280 INFO:tasks.rados.rados.0.smithi166.stdout:459: finishing write tid 5 to smithi16641208-459 2020-11-16T20:56:01.280 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 459 v 336 (ObjNum 458 snap 0 seq_num 458) dirty exists 2020-11-16T20:56:01.280 INFO:tasks.rados.rados.0.smithi166.stdout:459: left oid 459 (ObjNum 458 snap 0 seq_num 458) 2020-11-16T20:56:01.280 INFO:tasks.rados.rados.0.smithi166.stdout:460: finishing write tid 1 to smithi16641208-460 2020-11-16T20:56:01.280 INFO:tasks.rados.rados.0.smithi166.stdout:460: finishing write tid 2 to smithi16641208-460 2020-11-16T20:56:01.280 INFO:tasks.rados.rados.0.smithi166.stdout:460: finishing write tid 3 to smithi16641208-460 2020-11-16T20:56:01.280 INFO:tasks.rados.rados.0.smithi166.stdout:460: finishing write tid 4 to smithi16641208-460 2020-11-16T20:56:01.281 INFO:tasks.rados.rados.0.smithi166.stdout:460: finishing write tid 5 to smithi16641208-460 2020-11-16T20:56:01.281 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 460 v 320 (ObjNum 459 snap 0 seq_num 459) dirty exists 2020-11-16T20:56:01.281 INFO:tasks.rados.rados.0.smithi166.stdout:460: left oid 460 (ObjNum 459 snap 0 seq_num 459) 2020-11-16T20:56:01.281 INFO:tasks.rados.rados.0.smithi166.stdout:461: finishing write tid 1 to smithi16641208-461 2020-11-16T20:56:01.281 INFO:tasks.rados.rados.0.smithi166.stdout:459: done (15 left) 2020-11-16T20:56:01.281 INFO:tasks.rados.rados.0.smithi166.stdout:460: done (14 left) 2020-11-16T20:56:01.281 INFO:tasks.rados.rados.0.smithi166.stdout:475: write initial oid 475 2020-11-16T20:56:01.282 INFO:tasks.rados.rados.0.smithi166.stdout:475: seq_num 474 ranges {766518=481912,1837406=542493,2933675=527287,3876584=89934} 2020-11-16T20:56:01.282 INFO:tasks.rados.rados.0.smithi166.stdout:475: writing smithi16641208-475 from 766518 to 1248430 tid 1 2020-11-16T20:56:01.282 INFO:tasks.rados.rados.0.smithi166.stdout:475: writing smithi16641208-475 from 1837406 to 2379899 tid 2 2020-11-16T20:56:01.282 INFO:tasks.rados.rados.0.smithi166.stdout:475: writing smithi16641208-475 from 2933675 to 3460962 tid 3 2020-11-16T20:56:01.282 INFO:tasks.rados.rados.0.smithi166.stdout:475: writing smithi16641208-475 from 3876584 to 3966518 tid 4 2020-11-16T20:56:01.282 INFO:tasks.rados.rados.0.smithi166.stdout:476: write initial oid 476 2020-11-16T20:56:01.282 INFO:tasks.rados.rados.0.smithi166.stdout:476: seq_num 475 ranges {783325=557161,1779535=686151,3244745=454912} 2020-11-16T20:56:01.282 INFO:tasks.rados.rados.0.smithi166.stdout:476: writing smithi16641208-476 from 783325 to 1340486 tid 1 2020-11-16T20:56:01.283 INFO:tasks.rados.rados.0.smithi166.stdout:476: writing smithi16641208-476 from 1779535 to 2465686 tid 2 2020-11-16T20:56:01.283 INFO:tasks.rados.rados.0.smithi166.stdout:476: writing smithi16641208-476 from 3244745 to 3699657 tid 3 2020-11-16T20:56:01.283 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.283 INFO:tasks.rados.rados.0.smithi166.stdout:461: finishing write tid 2 to smithi16641208-461 2020-11-16T20:56:01.283 INFO:tasks.rados.rados.0.smithi166.stdout:461: finishing write tid 3 to smithi16641208-461 2020-11-16T20:56:01.284 INFO:tasks.rados.rados.0.smithi166.stdout:461: finishing write tid 4 to smithi16641208-461 2020-11-16T20:56:01.284 INFO:tasks.rados.rados.0.smithi166.stdout:461: finishing write tid 5 to smithi16641208-461 2020-11-16T20:56:01.284 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 461 v 324 (ObjNum 460 snap 0 seq_num 460) dirty exists 2020-11-16T20:56:01.284 INFO:tasks.rados.rados.0.smithi166.stdout:461: left oid 461 (ObjNum 460 snap 0 seq_num 460) 2020-11-16T20:56:01.284 INFO:tasks.rados.rados.0.smithi166.stdout:462: finishing write tid 1 to smithi16641208-462 2020-11-16T20:56:01.284 INFO:tasks.rados.rados.0.smithi166.stdout:462: finishing write tid 2 to smithi16641208-462 2020-11-16T20:56:01.285 INFO:tasks.rados.rados.0.smithi166.stdout:462: finishing write tid 3 to smithi16641208-462 2020-11-16T20:56:01.285 INFO:tasks.rados.rados.0.smithi166.stdout:462: finishing write tid 4 to smithi16641208-462 2020-11-16T20:56:01.285 INFO:tasks.rados.rados.0.smithi166.stdout:462: finishing write tid 5 to smithi16641208-462 2020-11-16T20:56:01.285 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 462 v 340 (ObjNum 461 snap 0 seq_num 461) dirty exists 2020-11-16T20:56:01.285 INFO:tasks.rados.rados.0.smithi166.stdout:462: left oid 462 (ObjNum 461 snap 0 seq_num 461) 2020-11-16T20:56:01.285 INFO:tasks.rados.rados.0.smithi166.stdout:463: finishing write tid 1 to smithi16641208-463 2020-11-16T20:56:01.285 INFO:tasks.rados.rados.0.smithi166.stdout:463: finishing write tid 2 to smithi16641208-463 2020-11-16T20:56:01.286 INFO:tasks.rados.rados.0.smithi166.stdout:463: finishing write tid 3 to smithi16641208-463 2020-11-16T20:56:01.286 INFO:tasks.rados.rados.0.smithi166.stdout:461: done (15 left) 2020-11-16T20:56:01.286 INFO:tasks.rados.rados.0.smithi166.stdout:462: done (14 left) 2020-11-16T20:56:01.286 INFO:tasks.rados.rados.0.smithi166.stdout:477: write initial oid 477 2020-11-16T20:56:01.286 INFO:tasks.rados.rados.0.smithi166.stdout:477: seq_num 476 ranges {400132=632410,1438017=546162} 2020-11-16T20:56:01.286 INFO:tasks.rados.rados.0.smithi166.stdout:477: writing smithi16641208-477 from 400132 to 1032542 tid 1 2020-11-16T20:56:01.286 INFO:tasks.rados.rados.0.smithi166.stdout:477: writing smithi16641208-477 from 1438017 to 1984179 tid 2 2020-11-16T20:56:01.287 INFO:tasks.rados.rados.0.smithi166.stdout:478: write initial oid 478 2020-11-16T20:56:01.287 INFO:tasks.rados.rados.0.smithi166.stdout:478: seq_num 477 ranges {416939=707659,1896499=120440} 2020-11-16T20:56:01.287 INFO:tasks.rados.rados.0.smithi166.stdout:478: writing smithi16641208-478 from 416939 to 1124598 tid 1 2020-11-16T20:56:01.287 INFO:tasks.rados.rados.0.smithi166.stdout:478: writing smithi16641208-478 from 1896499 to 2016939 tid 2 2020-11-16T20:56:01.287 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.287 INFO:tasks.rados.rados.0.smithi166.stdout:464: finishing write tid 1 to smithi16641208-464 2020-11-16T20:56:01.287 INFO:tasks.rados.rados.0.smithi166.stdout:463: finishing write tid 4 to smithi16641208-463 2020-11-16T20:56:01.287 INFO:tasks.rados.rados.0.smithi166.stdout:463: finishing write tid 5 to smithi16641208-463 2020-11-16T20:56:01.288 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 463 v 402 (ObjNum 462 snap 0 seq_num 462) dirty exists 2020-11-16T20:56:01.288 INFO:tasks.rados.rados.0.smithi166.stdout:463: left oid 463 (ObjNum 462 snap 0 seq_num 462) 2020-11-16T20:56:01.288 INFO:tasks.rados.rados.0.smithi166.stdout:464: finishing write tid 2 to smithi16641208-464 2020-11-16T20:56:01.288 INFO:tasks.rados.rados.0.smithi166.stdout:463: done (15 left) 2020-11-16T20:56:01.288 INFO:tasks.rados.rados.0.smithi166.stdout:479: write initial oid 479 2020-11-16T20:56:01.288 INFO:tasks.rados.rados.0.smithi166.stdout:479: seq_num 478 ranges {433746=782908,1954981=78765} 2020-11-16T20:56:01.288 INFO:tasks.rados.rados.0.smithi166.stdout:479: writing smithi16641208-479 from 433746 to 1216654 tid 1 2020-11-16T20:56:01.289 INFO:tasks.rados.rados.0.smithi166.stdout:479: writing smithi16641208-479 from 1954981 to 2033746 tid 2 2020-11-16T20:56:01.289 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.289 INFO:tasks.rados.rados.0.smithi166.stdout:464: finishing write tid 3 to smithi16641208-464 2020-11-16T20:56:01.289 INFO:tasks.rados.rados.0.smithi166.stdout:465: finishing write tid 1 to smithi16641208-465 2020-11-16T20:56:01.289 INFO:tasks.rados.rados.0.smithi166.stdout:465: finishing write tid 2 to smithi16641208-465 2020-11-16T20:56:01.289 INFO:tasks.rados.rados.0.smithi166.stdout:464: finishing write tid 4 to smithi16641208-464 2020-11-16T20:56:01.289 INFO:tasks.rados.rados.0.smithi166.stdout:465: finishing write tid 3 to smithi16641208-465 2020-11-16T20:56:01.290 INFO:tasks.rados.rados.0.smithi166.stdout:464: finishing write tid 5 to smithi16641208-464 2020-11-16T20:56:01.290 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 464 v 405 (ObjNum 463 snap 0 seq_num 463) dirty exists 2020-11-16T20:56:01.290 INFO:tasks.rados.rados.0.smithi166.stdout:464: left oid 464 (ObjNum 463 snap 0 seq_num 463) 2020-11-16T20:56:01.290 INFO:tasks.rados.rados.0.smithi166.stdout:465: finishing write tid 4 to smithi16641208-465 2020-11-16T20:56:01.290 INFO:tasks.rados.rados.0.smithi166.stdout:464: done (15 left) 2020-11-16T20:56:01.290 INFO:tasks.rados.rados.0.smithi166.stdout:480: write initial oid 480 2020-11-16T20:56:01.290 INFO:tasks.rados.rados.0.smithi166.stdout:465: finishing write tid 5 to smithi16641208-465 2020-11-16T20:56:01.291 INFO:tasks.rados.rados.0.smithi166.stdout:465: finishing write tid 6 to smithi16641208-465 2020-11-16T20:56:01.291 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 465 v 345 (ObjNum 464 snap 0 seq_num 464) dirty exists 2020-11-16T20:56:01.291 INFO:tasks.rados.rados.0.smithi166.stdout:465: left oid 465 (ObjNum 464 snap 0 seq_num 464) 2020-11-16T20:56:01.291 INFO:tasks.rados.rados.0.smithi166.stdout:466: finishing write tid 1 to smithi16641208-466 2020-11-16T20:56:01.291 INFO:tasks.rados.rados.0.smithi166.stdout:466: finishing write tid 2 to smithi16641208-466 2020-11-16T20:56:01.291 INFO:tasks.rados.rados.0.smithi166.stdout:466: finishing write tid 3 to smithi16641208-466 2020-11-16T20:56:01.291 INFO:tasks.rados.rados.0.smithi166.stdout:480: seq_num 479 ranges {450553=574510,1613463=437090} 2020-11-16T20:56:01.291 INFO:tasks.rados.rados.0.smithi166.stdout:480: writing smithi16641208-480 from 450553 to 1025063 tid 1 2020-11-16T20:56:01.292 INFO:tasks.rados.rados.0.smithi166.stdout:480: writing smithi16641208-480 from 1613463 to 2050553 tid 2 2020-11-16T20:56:01.292 INFO:tasks.rados.rados.0.smithi166.stdout:465: done (15 left) 2020-11-16T20:56:01.292 INFO:tasks.rados.rados.0.smithi166.stdout:481: write initial oid 481 2020-11-16T20:56:01.292 INFO:tasks.rados.rados.0.smithi166.stdout:481: seq_num 480 ranges {467360=649759,1671945=395415} 2020-11-16T20:56:01.292 INFO:tasks.rados.rados.0.smithi166.stdout:481: writing smithi16641208-481 from 467360 to 1117119 tid 1 2020-11-16T20:56:01.292 INFO:tasks.rados.rados.0.smithi166.stdout:481: writing smithi16641208-481 from 1671945 to 2067360 tid 2 2020-11-16T20:56:01.292 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.293 INFO:tasks.rados.rados.0.smithi166.stdout:466: finishing write tid 4 to smithi16641208-466 2020-11-16T20:56:01.293 INFO:tasks.rados.rados.0.smithi166.stdout:466: finishing write tid 5 to smithi16641208-466 2020-11-16T20:56:01.293 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 466 v 349 (ObjNum 465 snap 0 seq_num 465) dirty exists 2020-11-16T20:56:01.293 INFO:tasks.rados.rados.0.smithi166.stdout:466: left oid 466 (ObjNum 465 snap 0 seq_num 465) 2020-11-16T20:56:01.293 INFO:tasks.rados.rados.0.smithi166.stdout:467: finishing write tid 1 to smithi16641208-467 2020-11-16T20:56:01.293 INFO:tasks.rados.rados.0.smithi166.stdout:466: done (15 left) 2020-11-16T20:56:01.293 INFO:tasks.rados.rados.0.smithi166.stdout:482: write initial oid 482 2020-11-16T20:56:01.293 INFO:tasks.rados.rados.0.smithi166.stdout:482: seq_num 481 ranges {484167=725008,1730427=353740} 2020-11-16T20:56:01.294 INFO:tasks.rados.rados.0.smithi166.stdout:482: writing smithi16641208-482 from 484167 to 1209175 tid 1 2020-11-16T20:56:01.294 INFO:tasks.rados.rados.0.smithi166.stdout:482: writing smithi16641208-482 from 1730427 to 2084167 tid 2 2020-11-16T20:56:01.294 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.294 INFO:tasks.rados.rados.0.smithi166.stdout:467: finishing write tid 2 to smithi16641208-467 2020-11-16T20:56:01.294 INFO:tasks.rados.rados.0.smithi166.stdout:467: finishing write tid 3 to smithi16641208-467 2020-11-16T20:56:01.294 INFO:tasks.rados.rados.0.smithi166.stdout:467: finishing write tid 4 to smithi16641208-467 2020-11-16T20:56:01.294 INFO:tasks.rados.rados.0.smithi166.stdout:467: finishing write tid 5 to smithi16641208-467 2020-11-16T20:56:01.295 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 467 v 328 (ObjNum 466 snap 0 seq_num 466) dirty exists 2020-11-16T20:56:01.295 INFO:tasks.rados.rados.0.smithi166.stdout:467: left oid 467 (ObjNum 466 snap 0 seq_num 466) 2020-11-16T20:56:01.295 INFO:tasks.rados.rados.0.smithi166.stdout:468: finishing write tid 1 to smithi16641208-468 2020-11-16T20:56:01.295 INFO:tasks.rados.rados.0.smithi166.stdout:468: finishing write tid 2 to smithi16641208-468 2020-11-16T20:56:01.295 INFO:tasks.rados.rados.0.smithi166.stdout:468: finishing write tid 3 to smithi16641208-468 2020-11-16T20:56:01.295 INFO:tasks.rados.rados.0.smithi166.stdout:468: finishing write tid 4 to smithi16641208-468 2020-11-16T20:56:01.295 INFO:tasks.rados.rados.0.smithi166.stdout:467: done (15 left) 2020-11-16T20:56:01.295 INFO:tasks.rados.rados.0.smithi166.stdout:483: write initial oid 483 2020-11-16T20:56:01.296 INFO:tasks.rados.rados.0.smithi166.stdout:483: seq_num 482 ranges {500974=400257,1388909=557169} 2020-11-16T20:56:01.296 INFO:tasks.rados.rados.0.smithi166.stdout:483: writing smithi16641208-483 from 500974 to 901231 tid 1 2020-11-16T20:56:01.296 INFO:tasks.rados.rados.0.smithi166.stdout:483: writing smithi16641208-483 from 1388909 to 1946078 tid 2 2020-11-16T20:56:01.296 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.296 INFO:tasks.rados.rados.0.smithi166.stdout:468: finishing write tid 5 to smithi16641208-468 2020-11-16T20:56:01.296 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 468 v 332 (ObjNum 467 snap 0 seq_num 467) dirty exists 2020-11-16T20:56:01.296 INFO:tasks.rados.rados.0.smithi166.stdout:468: left oid 468 (ObjNum 467 snap 0 seq_num 467) 2020-11-16T20:56:01.297 INFO:tasks.rados.rados.0.smithi166.stdout:469: finishing write tid 1 to smithi16641208-469 2020-11-16T20:56:01.297 INFO:tasks.rados.rados.0.smithi166.stdout:469: finishing write tid 2 to smithi16641208-469 2020-11-16T20:56:01.297 INFO:tasks.rados.rados.0.smithi166.stdout:469: finishing write tid 3 to smithi16641208-469 2020-11-16T20:56:01.297 INFO:tasks.rados.rados.0.smithi166.stdout:469: finishing write tid 4 to smithi16641208-469 2020-11-16T20:56:01.297 INFO:tasks.rados.rados.0.smithi166.stdout:469: finishing write tid 5 to smithi16641208-469 2020-11-16T20:56:01.297 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 469 v 408 (ObjNum 468 snap 0 seq_num 468) dirty exists 2020-11-16T20:56:01.297 INFO:tasks.rados.rados.0.smithi166.stdout:469: left oid 469 (ObjNum 468 snap 0 seq_num 468) 2020-11-16T20:56:01.297 INFO:tasks.rados.rados.0.smithi166.stdout:470: finishing write tid 1 to smithi16641208-470 2020-11-16T20:56:01.298 INFO:tasks.rados.rados.0.smithi166.stdout:470: finishing write tid 2 to smithi16641208-470 2020-11-16T20:56:01.298 INFO:tasks.rados.rados.0.smithi166.stdout:470: finishing write tid 3 to smithi16641208-470 2020-11-16T20:56:01.298 INFO:tasks.rados.rados.0.smithi166.stdout:470: finishing write tid 4 to smithi16641208-470 2020-11-16T20:56:01.298 INFO:tasks.rados.rados.0.smithi166.stdout:468: done (15 left) 2020-11-16T20:56:01.298 INFO:tasks.rados.rados.0.smithi166.stdout:469: done (14 left) 2020-11-16T20:56:01.298 INFO:tasks.rados.rados.0.smithi166.stdout:484: write initial oid 484 2020-11-16T20:56:01.298 INFO:tasks.rados.rados.0.smithi166.stdout:484: seq_num 483 ranges {517781=475506,1731038=386743} 2020-11-16T20:56:01.299 INFO:tasks.rados.rados.0.smithi166.stdout:484: writing smithi16641208-484 from 517781 to 993287 tid 1 2020-11-16T20:56:01.299 INFO:tasks.rados.rados.0.smithi166.stdout:484: writing smithi16641208-484 from 1731038 to 2117781 tid 2 2020-11-16T20:56:01.299 INFO:tasks.rados.rados.0.smithi166.stdout:485: write initial oid 485 2020-11-16T20:56:01.299 INFO:tasks.rados.rados.0.smithi166.stdout:485: seq_num 484 ranges {534588=550755,1789520=345068} 2020-11-16T20:56:01.299 INFO:tasks.rados.rados.0.smithi166.stdout:485: writing smithi16641208-485 from 534588 to 1085343 tid 1 2020-11-16T20:56:01.299 INFO:tasks.rados.rados.0.smithi166.stdout:485: writing smithi16641208-485 from 1789520 to 2134588 tid 2 2020-11-16T20:56:01.299 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.300 INFO:tasks.rados.rados.0.smithi166.stdout:470: finishing write tid 5 to smithi16641208-470 2020-11-16T20:56:01.300 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 470 v 336 (ObjNum 469 snap 0 seq_num 469) dirty exists 2020-11-16T20:56:01.300 INFO:tasks.rados.rados.0.smithi166.stdout:470: left oid 470 (ObjNum 469 snap 0 seq_num 469) 2020-11-16T20:56:01.300 INFO:tasks.rados.rados.0.smithi166.stdout:471: finishing write tid 1 to smithi16641208-471 2020-11-16T20:56:01.300 INFO:tasks.rados.rados.0.smithi166.stdout:470: done (15 left) 2020-11-16T20:56:01.300 INFO:tasks.rados.rados.0.smithi166.stdout:486: write initial oid 486 2020-11-16T20:56:01.300 INFO:tasks.rados.rados.0.smithi166.stdout:486: seq_num 485 ranges {551395=626004,1848002=303393} 2020-11-16T20:56:01.301 INFO:tasks.rados.rados.0.smithi166.stdout:486: writing smithi16641208-486 from 551395 to 1177399 tid 1 2020-11-16T20:56:01.301 INFO:tasks.rados.rados.0.smithi166.stdout:486: writing smithi16641208-486 from 1848002 to 2151395 tid 2 2020-11-16T20:56:01.301 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.301 INFO:tasks.rados.rados.0.smithi166.stdout:471: finishing write tid 2 to smithi16641208-471 2020-11-16T20:56:01.301 INFO:tasks.rados.rados.0.smithi166.stdout:471: finishing write tid 3 to smithi16641208-471 2020-11-16T20:56:01.301 INFO:tasks.rados.rados.0.smithi166.stdout:471: finishing write tid 4 to smithi16641208-471 2020-11-16T20:56:01.302 INFO:tasks.rados.rados.0.smithi166.stdout:471: finishing write tid 5 to smithi16641208-471 2020-11-16T20:56:01.302 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 471 v 412 (ObjNum 470 snap 0 seq_num 470) dirty exists 2020-11-16T20:56:01.302 INFO:tasks.rados.rados.0.smithi166.stdout:471: left oid 471 (ObjNum 470 snap 0 seq_num 470) 2020-11-16T20:56:01.302 INFO:tasks.rados.rados.0.smithi166.stdout:472: finishing write tid 1 to smithi16641208-472 2020-11-16T20:56:01.302 INFO:tasks.rados.rados.0.smithi166.stdout:471: done (15 left) 2020-11-16T20:56:01.302 INFO:tasks.rados.rados.0.smithi166.stdout:487: write initial oid 487 2020-11-16T20:56:01.302 INFO:tasks.rados.rados.0.smithi166.stdout:487: seq_num 486 ranges {568202=701253,1906484=261718} 2020-11-16T20:56:01.302 INFO:tasks.rados.rados.0.smithi166.stdout:487: writing smithi16641208-487 from 568202 to 1269455 tid 1 2020-11-16T20:56:01.303 INFO:tasks.rados.rados.0.smithi166.stdout:487: writing smithi16641208-487 from 1906484 to 2168202 tid 2 2020-11-16T20:56:01.303 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.303 INFO:tasks.rados.rados.0.smithi166.stdout:472: finishing write tid 2 to smithi16641208-472 2020-11-16T20:56:01.303 INFO:tasks.rados.rados.0.smithi166.stdout:472: finishing write tid 3 to smithi16641208-472 2020-11-16T20:56:01.303 INFO:tasks.rados.rados.0.smithi166.stdout:472: finishing write tid 4 to smithi16641208-472 2020-11-16T20:56:01.303 INFO:tasks.rados.rados.0.smithi166.stdout:472: finishing write tid 5 to smithi16641208-472 2020-11-16T20:56:01.303 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 472 v 414 (ObjNum 471 snap 0 seq_num 471) dirty exists 2020-11-16T20:56:01.304 INFO:tasks.rados.rados.0.smithi166.stdout:472: left oid 472 (ObjNum 471 snap 0 seq_num 471) 2020-11-16T20:56:01.304 INFO:tasks.rados.rados.0.smithi166.stdout:473: finishing write tid 1 to smithi16641208-473 2020-11-16T20:56:01.304 INFO:tasks.rados.rados.0.smithi166.stdout:473: finishing write tid 2 to smithi16641208-473 2020-11-16T20:56:01.304 INFO:tasks.rados.rados.0.smithi166.stdout:472: done (15 left) 2020-11-16T20:56:01.304 INFO:tasks.rados.rados.0.smithi166.stdout:488: write initial oid 488 2020-11-16T20:56:01.304 INFO:tasks.rados.rados.0.smithi166.stdout:488: seq_num 487 ranges {585009=492855,1564966=620043} 2020-11-16T20:56:01.304 INFO:tasks.rados.rados.0.smithi166.stdout:488: writing smithi16641208-488 from 585009 to 1077864 tid 1 2020-11-16T20:56:01.305 INFO:tasks.rados.rados.0.smithi166.stdout:488: writing smithi16641208-488 from 1564966 to 2185009 tid 2 2020-11-16T20:56:01.305 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.305 INFO:tasks.rados.rados.0.smithi166.stdout:473: finishing write tid 3 to smithi16641208-473 2020-11-16T20:56:01.305 INFO:tasks.rados.rados.0.smithi166.stdout:473: finishing write tid 4 to smithi16641208-473 2020-11-16T20:56:01.305 INFO:tasks.rados.rados.0.smithi166.stdout:473: finishing write tid 5 to smithi16641208-473 2020-11-16T20:56:01.305 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 473 v 353 (ObjNum 472 snap 0 seq_num 472) dirty exists 2020-11-16T20:56:01.305 INFO:tasks.rados.rados.0.smithi166.stdout:473: left oid 473 (ObjNum 472 snap 0 seq_num 472) 2020-11-16T20:56:01.305 INFO:tasks.rados.rados.0.smithi166.stdout:474: finishing write tid 1 to smithi16641208-474 2020-11-16T20:56:01.306 INFO:tasks.rados.rados.0.smithi166.stdout:474: finishing write tid 2 to smithi16641208-474 2020-11-16T20:56:01.306 INFO:tasks.rados.rados.0.smithi166.stdout:473: done (15 left) 2020-11-16T20:56:01.306 INFO:tasks.rados.rados.0.smithi166.stdout:489: write initial oid 489 2020-11-16T20:56:01.306 INFO:tasks.rados.rados.0.smithi166.stdout:489: seq_num 488 ranges {601816=568104,1623448=451823} 2020-11-16T20:56:01.306 INFO:tasks.rados.rados.0.smithi166.stdout:489: writing smithi16641208-489 from 601816 to 1169920 tid 1 2020-11-16T20:56:01.306 INFO:tasks.rados.rados.0.smithi166.stdout:489: writing smithi16641208-489 from 1623448 to 2075271 tid 2 2020-11-16T20:56:01.306 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.307 INFO:tasks.rados.rados.0.smithi166.stdout:474: finishing write tid 3 to smithi16641208-474 2020-11-16T20:56:01.307 INFO:tasks.rados.rados.0.smithi166.stdout:474: finishing write tid 4 to smithi16641208-474 2020-11-16T20:56:01.307 INFO:tasks.rados.rados.0.smithi166.stdout:474: finishing write tid 5 to smithi16641208-474 2020-11-16T20:56:01.307 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 474 v 418 (ObjNum 473 snap 0 seq_num 473) dirty exists 2020-11-16T20:56:01.307 INFO:tasks.rados.rados.0.smithi166.stdout:474: left oid 474 (ObjNum 473 snap 0 seq_num 473) 2020-11-16T20:56:01.307 INFO:tasks.rados.rados.0.smithi166.stdout:475: finishing write tid 1 to smithi16641208-475 2020-11-16T20:56:01.307 INFO:tasks.rados.rados.0.smithi166.stdout:474: done (15 left) 2020-11-16T20:56:01.308 INFO:tasks.rados.rados.0.smithi166.stdout:490: write initial oid 490 2020-11-16T20:56:01.308 INFO:tasks.rados.rados.0.smithi166.stdout:490: seq_num 489 ranges {618623=643353,1681930=536693} 2020-11-16T20:56:01.308 INFO:tasks.rados.rados.0.smithi166.stdout:490: writing smithi16641208-490 from 618623 to 1261976 tid 1 2020-11-16T20:56:01.308 INFO:tasks.rados.rados.0.smithi166.stdout:490: writing smithi16641208-490 from 1681930 to 2218623 tid 2 2020-11-16T20:56:01.308 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:01.308 INFO:tasks.rados.rados.0.smithi166.stdout:475: finishing write tid 2 to smithi16641208-475 2020-11-16T20:56:01.308 INFO:tasks.rados.rados.0.smithi166.stdout:475: finishing write tid 3 to smithi16641208-475 2020-11-16T20:56:01.308 INFO:tasks.rados.rados.0.smithi166.stdout:475: finishing write tid 4 to smithi16641208-475 2020-11-16T20:56:01.309 INFO:tasks.rados.rados.0.smithi166.stdout:475: finishing write tid 5 to smithi16641208-475 2020-11-16T20:56:01.309 INFO:tasks.rados.rados.0.smithi166.stdout:475: finishing write tid 6 to smithi16641208-475 2020-11-16T20:56:01.309 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 475 v 354 (ObjNum 474 snap 0 seq_num 474) dirty exists 2020-11-16T20:56:01.309 INFO:tasks.rados.rados.0.smithi166.stdout:475: left oid 475 (ObjNum 474 snap 0 seq_num 474) 2020-11-16T20:56:01.309 INFO:tasks.rados.rados.0.smithi166.stdout:476: finishing write tid 1 to smithi16641208-476 2020-11-16T20:56:01.309 INFO:tasks.rados.rados.0.smithi166.stdout:476: finishing write tid 2 to smithi16641208-476 2020-11-16T20:56:01.309 INFO:tasks.rados.rados.0.smithi166.stdout:476: finishing write tid 3 to smithi16641208-476 2020-11-16T20:56:01.310 INFO:tasks.rados.rados.0.smithi166.stdout:476: finishing write tid 4 to smithi16641208-476 2020-11-16T20:56:01.310 INFO:tasks.rados.rados.0.smithi166.stdout:476: finishing write tid 5 to smithi16641208-476 2020-11-16T20:56:01.310 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 476 v 422 (ObjNum 475 snap 0 seq_num 475) dirty exists 2020-11-16T20:56:01.310 INFO:tasks.rados.rados.0.smithi166.stdout:476: left oid 476 (ObjNum 475 snap 0 seq_num 475) 2020-11-16T20:56:01.310 INFO:tasks.rados.rados.0.smithi166.stdout:477: finishing write tid 1 to smithi16641208-477 2020-11-16T20:56:01.310 INFO:tasks.rados.rados.0.smithi166.stdout:477: finishing write tid 2 to smithi16641208-477 2020-11-16T20:56:01.310 INFO:tasks.rados.rados.0.smithi166.stdout:477: finishing write tid 3 to smithi16641208-477 2020-11-16T20:56:01.310 INFO:tasks.rados.rados.0.smithi166.stdout:477: finishing write tid 4 to smithi16641208-477 2020-11-16T20:56:01.311 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 477 v 357 (ObjNum 476 snap 0 seq_num 476) dirty exists 2020-11-16T20:56:01.311 INFO:tasks.rados.rados.0.smithi166.stdout:477: left oid 477 (ObjNum 476 snap 0 seq_num 476) 2020-11-16T20:56:01.311 INFO:tasks.rados.rados.0.smithi166.stdout:478: finishing write tid 1 to smithi16641208-478 2020-11-16T20:56:01.311 INFO:tasks.rados.rados.0.smithi166.stdout:478: finishing write tid 2 to smithi16641208-478 2020-11-16T20:56:01.311 INFO:tasks.rados.rados.0.smithi166.stdout:478: finishing write tid 3 to smithi16641208-478 2020-11-16T20:56:01.311 INFO:tasks.rados.rados.0.smithi166.stdout:478: finishing write tid 4 to smithi16641208-478 2020-11-16T20:56:01.311 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 478 v 360 (ObjNum 477 snap 0 seq_num 477) dirty exists 2020-11-16T20:56:01.312 INFO:tasks.rados.rados.0.smithi166.stdout:478: left oid 478 (ObjNum 477 snap 0 seq_num 477) 2020-11-16T20:56:01.312 INFO:tasks.rados.rados.0.smithi166.stdout:479: finishing write tid 1 to smithi16641208-479 2020-11-16T20:56:01.312 INFO:tasks.rados.rados.0.smithi166.stdout:479: finishing write tid 2 to smithi16641208-479 2020-11-16T20:56:01.312 INFO:tasks.rados.rados.0.smithi166.stdout:479: finishing write tid 3 to smithi16641208-479 2020-11-16T20:56:01.312 INFO:tasks.rados.rados.0.smithi166.stdout:479: finishing write tid 4 to smithi16641208-479 2020-11-16T20:56:01.312 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 479 v 425 (ObjNum 478 snap 0 seq_num 478) dirty exists 2020-11-16T20:56:01.312 INFO:tasks.rados.rados.0.smithi166.stdout:479: left oid 479 (ObjNum 478 snap 0 seq_num 478) 2020-11-16T20:56:01.312 INFO:tasks.rados.rados.0.smithi166.stdout:480: finishing write tid 1 to smithi16641208-480 2020-11-16T20:56:01.313 INFO:tasks.rados.rados.0.smithi166.stdout:480: finishing write tid 2 to smithi16641208-480 2020-11-16T20:56:01.313 INFO:tasks.rados.rados.0.smithi166.stdout:480: finishing write tid 3 to smithi16641208-480 2020-11-16T20:56:01.313 INFO:tasks.rados.rados.0.smithi166.stdout:480: finishing write tid 4 to smithi16641208-480 2020-11-16T20:56:01.313 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 480 v 363 (ObjNum 479 snap 0 seq_num 479) dirty exists 2020-11-16T20:56:01.313 INFO:tasks.rados.rados.0.smithi166.stdout:480: left oid 480 (ObjNum 479 snap 0 seq_num 479) 2020-11-16T20:56:01.313 INFO:tasks.rados.rados.0.smithi166.stdout:481: finishing write tid 1 to smithi16641208-481 2020-11-16T20:56:01.313 INFO:tasks.rados.rados.0.smithi166.stdout:481: finishing write tid 2 to smithi16641208-481 2020-11-16T20:56:01.314 INFO:tasks.rados.rados.0.smithi166.stdout:481: finishing write tid 3 to smithi16641208-481 2020-11-16T20:56:01.314 INFO:tasks.rados.rados.0.smithi166.stdout:481: finishing write tid 4 to smithi16641208-481 2020-11-16T20:56:01.314 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 481 v 356 (ObjNum 480 snap 0 seq_num 480) dirty exists 2020-11-16T20:56:01.314 INFO:tasks.rados.rados.0.smithi166.stdout:481: left oid 481 (ObjNum 480 snap 0 seq_num 480) 2020-11-16T20:56:01.314 INFO:tasks.rados.rados.0.smithi166.stdout:482: finishing write tid 1 to smithi16641208-482 2020-11-16T20:56:01.314 INFO:tasks.rados.rados.0.smithi166.stdout:482: finishing write tid 2 to smithi16641208-482 2020-11-16T20:56:01.314 INFO:tasks.rados.rados.0.smithi166.stdout:482: finishing write tid 3 to smithi16641208-482 2020-11-16T20:56:01.315 INFO:tasks.rados.rados.0.smithi166.stdout:482: finishing write tid 4 to smithi16641208-482 2020-11-16T20:56:01.315 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 482 v 428 (ObjNum 481 snap 0 seq_num 481) dirty exists 2020-11-16T20:56:01.315 INFO:tasks.rados.rados.0.smithi166.stdout:482: left oid 482 (ObjNum 481 snap 0 seq_num 481) 2020-11-16T20:56:01.315 INFO:tasks.rados.rados.0.smithi166.stdout:483: finishing write tid 1 to smithi16641208-483 2020-11-16T20:56:01.315 INFO:tasks.rados.rados.0.smithi166.stdout:483: finishing write tid 2 to smithi16641208-483 2020-11-16T20:56:01.315 INFO:tasks.rados.rados.0.smithi166.stdout:483: finishing write tid 3 to smithi16641208-483 2020-11-16T20:56:01.315 INFO:tasks.rados.rados.0.smithi166.stdout:483: finishing write tid 4 to smithi16641208-483 2020-11-16T20:56:01.315 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 483 v 339 (ObjNum 482 snap 0 seq_num 482) dirty exists 2020-11-16T20:56:01.316 INFO:tasks.rados.rados.0.smithi166.stdout:483: left oid 483 (ObjNum 482 snap 0 seq_num 482) 2020-11-16T20:56:01.316 INFO:tasks.rados.rados.0.smithi166.stdout:484: finishing write tid 1 to smithi16641208-484 2020-11-16T20:56:01.316 INFO:tasks.rados.rados.0.smithi166.stdout:484: finishing write tid 2 to smithi16641208-484 2020-11-16T20:56:01.316 INFO:tasks.rados.rados.0.smithi166.stdout:484: finishing write tid 3 to smithi16641208-484 2020-11-16T20:56:01.316 INFO:tasks.rados.rados.0.smithi166.stdout:484: finishing write tid 4 to smithi16641208-484 2020-11-16T20:56:01.316 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 484 v 359 (ObjNum 483 snap 0 seq_num 483) dirty exists 2020-11-16T20:56:01.316 INFO:tasks.rados.rados.0.smithi166.stdout:484: left oid 484 (ObjNum 483 snap 0 seq_num 483) 2020-11-16T20:56:01.317 INFO:tasks.rados.rados.0.smithi166.stdout:485: finishing write tid 1 to smithi16641208-485 2020-11-16T20:56:01.317 INFO:tasks.rados.rados.0.smithi166.stdout:485: finishing write tid 2 to smithi16641208-485 2020-11-16T20:56:01.317 INFO:tasks.rados.rados.0.smithi166.stdout:485: finishing write tid 3 to smithi16641208-485 2020-11-16T20:56:01.317 INFO:tasks.rados.rados.0.smithi166.stdout:485: finishing write tid 4 to smithi16641208-485 2020-11-16T20:56:01.317 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 485 v 366 (ObjNum 484 snap 0 seq_num 484) dirty exists 2020-11-16T20:56:01.317 INFO:tasks.rados.rados.0.smithi166.stdout:485: left oid 485 (ObjNum 484 snap 0 seq_num 484) 2020-11-16T20:56:01.317 INFO:tasks.rados.rados.0.smithi166.stdout:486: finishing write tid 1 to smithi16641208-486 2020-11-16T20:56:01.317 INFO:tasks.rados.rados.0.smithi166.stdout:486: finishing write tid 2 to smithi16641208-486 2020-11-16T20:56:01.318 INFO:tasks.rados.rados.0.smithi166.stdout:487: finishing write tid 1 to smithi16641208-487 2020-11-16T20:56:01.318 INFO:tasks.rados.rados.0.smithi166.stdout:486: finishing write tid 3 to smithi16641208-486 2020-11-16T20:56:01.318 INFO:tasks.rados.rados.0.smithi166.stdout:486: finishing write tid 4 to smithi16641208-486 2020-11-16T20:56:01.318 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 486 v 369 (ObjNum 485 snap 0 seq_num 485) dirty exists 2020-11-16T20:56:01.318 INFO:tasks.rados.rados.0.smithi166.stdout:486: left oid 486 (ObjNum 485 snap 0 seq_num 485) 2020-11-16T20:56:01.318 INFO:tasks.rados.rados.0.smithi166.stdout:487: finishing write tid 2 to smithi16641208-487 2020-11-16T20:56:01.318 INFO:tasks.rados.rados.0.smithi166.stdout:487: finishing write tid 3 to smithi16641208-487 2020-11-16T20:56:01.319 INFO:tasks.rados.rados.0.smithi166.stdout:487: finishing write tid 4 to smithi16641208-487 2020-11-16T20:56:01.319 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 487 v 362 (ObjNum 486 snap 0 seq_num 486) dirty exists 2020-11-16T20:56:01.319 INFO:tasks.rados.rados.0.smithi166.stdout:487: left oid 487 (ObjNum 486 snap 0 seq_num 486) 2020-11-16T20:56:01.319 INFO:tasks.rados.rados.0.smithi166.stdout:488: finishing write tid 1 to smithi16641208-488 2020-11-16T20:56:01.319 INFO:tasks.rados.rados.0.smithi166.stdout:489: finishing write tid 1 to smithi16641208-489 2020-11-16T20:56:01.319 INFO:tasks.rados.rados.0.smithi166.stdout:488: finishing write tid 2 to smithi16641208-488 2020-11-16T20:56:01.319 INFO:tasks.rados.rados.0.smithi166.stdout:488: finishing write tid 3 to smithi16641208-488 2020-11-16T20:56:01.320 INFO:tasks.rados.rados.0.smithi166.stdout:488: finishing write tid 4 to smithi16641208-488 2020-11-16T20:56:01.320 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 488 v 374 (ObjNum 487 snap 0 seq_num 487) dirty exists 2020-11-16T20:56:01.320 INFO:tasks.rados.rados.0.smithi166.stdout:488: left oid 488 (ObjNum 487 snap 0 seq_num 487) 2020-11-16T20:56:01.320 INFO:tasks.rados.rados.0.smithi166.stdout:490: finishing write tid 1 to smithi16641208-490 2020-11-16T20:56:01.320 INFO:tasks.rados.rados.0.smithi166.stdout:489: finishing write tid 2 to smithi16641208-489 2020-11-16T20:56:01.320 INFO:tasks.rados.rados.0.smithi166.stdout:489: finishing write tid 3 to smithi16641208-489 2020-11-16T20:56:01.320 INFO:tasks.rados.rados.0.smithi166.stdout:489: finishing write tid 4 to smithi16641208-489 2020-11-16T20:56:01.320 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 489 v 376 (ObjNum 488 snap 0 seq_num 488) dirty exists 2020-11-16T20:56:01.321 INFO:tasks.rados.rados.0.smithi166.stdout:489: left oid 489 (ObjNum 488 snap 0 seq_num 488) 2020-11-16T20:56:01.321 INFO:tasks.rados.rados.0.smithi166.stdout:475: done (15 left) 2020-11-16T20:56:01.321 INFO:tasks.rados.rados.0.smithi166.stdout:476: done (14 left) 2020-11-16T20:56:01.321 INFO:tasks.rados.rados.0.smithi166.stdout:477: done (13 left) 2020-11-16T20:56:01.321 INFO:tasks.rados.rados.0.smithi166.stdout:478: done (12 left) 2020-11-16T20:56:01.321 INFO:tasks.rados.rados.0.smithi166.stdout:479: done (11 left) 2020-11-16T20:56:01.321 INFO:tasks.rados.rados.0.smithi166.stdout:480: done (10 left) 2020-11-16T20:56:01.322 INFO:tasks.rados.rados.0.smithi166.stdout:481: done (9 left) 2020-11-16T20:56:01.322 INFO:tasks.rados.rados.0.smithi166.stdout:482: done (8 left) 2020-11-16T20:56:01.322 INFO:tasks.rados.rados.0.smithi166.stdout:483: done (7 left) 2020-11-16T20:56:01.322 INFO:tasks.rados.rados.0.smithi166.stdout:484: done (6 left) 2020-11-16T20:56:01.322 INFO:tasks.rados.rados.0.smithi166.stdout:485: done (5 left) 2020-11-16T20:56:01.322 INFO:tasks.rados.rados.0.smithi166.stdout:486: done (4 left) 2020-11-16T20:56:01.322 INFO:tasks.rados.rados.0.smithi166.stdout:487: done (3 left) 2020-11-16T20:56:01.323 INFO:tasks.rados.rados.0.smithi166.stdout:488: done (2 left) 2020-11-16T20:56:01.323 INFO:tasks.rados.rados.0.smithi166.stdout:489: done (1 left) 2020-11-16T20:56:01.323 INFO:tasks.rados.rados.0.smithi166.stdout:491: write initial oid 491 2020-11-16T20:56:01.323 INFO:tasks.rados.rados.0.smithi166.stdout:491: seq_num 490 ranges {635430=718602,2140412=95018} 2020-11-16T20:56:01.323 INFO:tasks.rados.rados.0.smithi166.stdout:491: writing smithi16641208-491 from 635430 to 1354032 tid 1 2020-11-16T20:56:01.323 INFO:tasks.rados.rados.0.smithi166.stdout:491: writing smithi16641208-491 from 2140412 to 2235430 tid 2 2020-11-16T20:56:01.323 INFO:tasks.rados.rados.0.smithi166.stdout:492: write initial oid 492 2020-11-16T20:56:01.323 INFO:tasks.rados.rados.0.smithi166.stdout:490: finishing write tid 2 to smithi16641208-490 2020-11-16T20:56:01.324 INFO:tasks.rados.rados.0.smithi166.stdout:492: seq_num 491 ranges {652237=793851,2198894=53343} 2020-11-16T20:56:01.324 INFO:tasks.rados.rados.0.smithi166.stdout:492: writing smithi16641208-492 from 652237 to 1446088 tid 1 2020-11-16T20:56:01.324 INFO:tasks.rados.rados.0.smithi166.stdout:492: writing smithi16641208-492 from 2198894 to 2252237 tid 2 2020-11-16T20:56:01.324 INFO:tasks.rados.rados.0.smithi166.stdout:493: write initial oid 493 2020-11-16T20:56:01.324 INFO:tasks.rados.rados.0.smithi166.stdout:493: seq_num 492 ranges {669044=469100,1741023=459161} 2020-11-16T20:56:01.324 INFO:tasks.rados.rados.0.smithi166.stdout:493: writing smithi16641208-493 from 669044 to 1138144 tid 1 2020-11-16T20:56:01.324 INFO:tasks.rados.rados.0.smithi166.stdout:493: writing smithi16641208-493 from 1741023 to 2200184 tid 2 2020-11-16T20:56:01.325 INFO:tasks.rados.rados.0.smithi166.stdout:494: write initial oid 494 2020-11-16T20:56:01.325 INFO:tasks.rados.rados.0.smithi166.stdout:494: seq_num 493 ranges {685851=544349,1799505=486346} 2020-11-16T20:56:01.325 INFO:tasks.rados.rados.0.smithi166.stdout:494: writing smithi16641208-494 from 685851 to 1230200 tid 1 2020-11-16T20:56:01.325 INFO:tasks.rados.rados.0.smithi166.stdout:494: writing smithi16641208-494 from 1799505 to 2285851 tid 2 2020-11-16T20:56:01.325 INFO:tasks.rados.rados.0.smithi166.stdout:495: write initial oid 495 2020-11-16T20:56:01.325 INFO:tasks.rados.rados.0.smithi166.stdout:495: seq_num 494 ranges {702658=619598,1857987=444671} 2020-11-16T20:56:01.325 INFO:tasks.rados.rados.0.smithi166.stdout:495: writing smithi16641208-495 from 702658 to 1322256 tid 1 2020-11-16T20:56:01.325 INFO:tasks.rados.rados.0.smithi166.stdout:495: writing smithi16641208-495 from 1857987 to 2302658 tid 2 2020-11-16T20:56:01.326 INFO:tasks.rados.rados.0.smithi166.stdout:496: write initial oid 496 2020-11-16T20:56:01.326 INFO:tasks.rados.rados.0.smithi166.stdout:496: seq_num 495 ranges {719465=411200,1632822=686643} 2020-11-16T20:56:01.326 INFO:tasks.rados.rados.0.smithi166.stdout:496: writing smithi16641208-496 from 719465 to 1130665 tid 1 2020-11-16T20:56:01.326 INFO:tasks.rados.rados.0.smithi166.stdout:496: writing smithi16641208-496 from 1632822 to 2319465 tid 2 2020-11-16T20:56:01.326 INFO:tasks.rados.rados.0.smithi166.stdout:497: write initial oid 497 2020-11-16T20:56:01.326 INFO:tasks.rados.rados.0.smithi166.stdout:497: seq_num 496 ranges {736272=486449,1974951=361321} 2020-11-16T20:56:01.326 INFO:tasks.rados.rados.0.smithi166.stdout:497: writing smithi16641208-497 from 736272 to 1222721 tid 1 2020-11-16T20:56:01.327 INFO:tasks.rados.rados.0.smithi166.stdout:497: writing smithi16641208-497 from 1974951 to 2336272 tid 2 2020-11-16T20:56:01.327 INFO:tasks.rados.rados.0.smithi166.stdout:498: write initial oid 498 2020-11-16T20:56:01.327 INFO:tasks.rados.rados.0.smithi166.stdout:498: seq_num 497 ranges {753079=561698,2033433=319646} 2020-11-16T20:56:01.327 INFO:tasks.rados.rados.0.smithi166.stdout:498: writing smithi16641208-498 from 753079 to 1314777 tid 1 2020-11-16T20:56:01.327 INFO:tasks.rados.rados.0.smithi166.stdout:498: writing smithi16641208-498 from 2033433 to 2353079 tid 2 2020-11-16T20:56:01.327 INFO:tasks.rados.rados.0.smithi166.stdout:499: write initial oid 499 2020-11-16T20:56:01.327 INFO:tasks.rados.rados.0.smithi166.stdout:490: finishing write tid 3 to smithi16641208-490 2020-11-16T20:56:01.327 INFO:tasks.rados.rados.0.smithi166.stdout:499: seq_num 498 ranges {769886=636947,2091915=277971} 2020-11-16T20:56:01.328 INFO:tasks.rados.rados.0.smithi166.stdout:499: writing smithi16641208-499 from 769886 to 1406833 tid 1 2020-11-16T20:56:01.328 INFO:tasks.rados.rados.0.smithi166.stdout:499: writing smithi16641208-499 from 2091915 to 2369886 tid 2 2020-11-16T20:56:01.328 INFO:tasks.rados.rados.0.smithi166.stdout:500: write initial oid 500 2020-11-16T20:56:01.328 INFO:tasks.rados.rados.0.smithi166.stdout:490: finishing write tid 4 to smithi16641208-490 2020-11-16T20:56:01.328 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 490 v 342 (ObjNum 489 snap 0 seq_num 489) dirty exists 2020-11-16T20:56:01.328 INFO:tasks.rados.rados.0.smithi166.stdout:490: left oid 490 (ObjNum 489 snap 0 seq_num 489) 2020-11-16T20:56:01.328 INFO:tasks.rados.rados.0.smithi166.stdout:491: finishing write tid 1 to smithi16641208-491 2020-11-16T20:56:01.329 INFO:tasks.rados.rados.0.smithi166.stdout:491: finishing write tid 2 to smithi16641208-491 2020-11-16T20:56:01.329 INFO:tasks.rados.rados.0.smithi166.stdout:491: finishing write tid 3 to smithi16641208-491 2020-11-16T20:56:01.329 INFO:tasks.rados.rados.0.smithi166.stdout:491: finishing write tid 4 to smithi16641208-491 2020-11-16T20:56:01.329 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 491 v 365 (ObjNum 490 snap 0 seq_num 490) dirty exists 2020-11-16T20:56:01.329 INFO:tasks.rados.rados.0.smithi166.stdout:491: left oid 491 (ObjNum 490 snap 0 seq_num 490) 2020-11-16T20:56:01.329 INFO:tasks.rados.rados.0.smithi166.stdout:492: finishing write tid 1 to smithi16641208-492 2020-11-16T20:56:01.329 INFO:tasks.rados.rados.0.smithi166.stdout:492: finishing write tid 2 to smithi16641208-492 2020-11-16T20:56:01.330 INFO:tasks.rados.rados.0.smithi166.stdout:492: finishing write tid 3 to smithi16641208-492 2020-11-16T20:56:01.330 INFO:tasks.rados.rados.0.smithi166.stdout:492: finishing write tid 4 to smithi16641208-492 2020-11-16T20:56:01.330 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 492 v 367 (ObjNum 491 snap 0 seq_num 491) dirty exists 2020-11-16T20:56:01.330 INFO:tasks.rados.rados.0.smithi166.stdout:492: left oid 492 (ObjNum 491 snap 0 seq_num 491) 2020-11-16T20:56:01.330 INFO:tasks.rados.rados.0.smithi166.stdout:493: finishing write tid 1 to smithi16641208-493 2020-11-16T20:56:01.330 INFO:tasks.rados.rados.0.smithi166.stdout:493: finishing write tid 2 to smithi16641208-493 2020-11-16T20:56:01.330 INFO:tasks.rados.rados.0.smithi166.stdout:493: finishing write tid 3 to smithi16641208-493 2020-11-16T20:56:01.331 INFO:tasks.rados.rados.0.smithi166.stdout:500: seq_num 499 ranges {786693=712196,2150397=236296} 2020-11-16T20:56:01.331 INFO:tasks.rados.rados.0.smithi166.stdout:500: writing smithi16641208-500 from 786693 to 1498889 tid 1 2020-11-16T20:56:01.331 INFO:tasks.rados.rados.0.smithi166.stdout:500: writing smithi16641208-500 from 2150397 to 2386693 tid 2 2020-11-16T20:56:01.331 INFO:tasks.rados.rados.0.smithi166.stdout:490: done (10 left) 2020-11-16T20:56:01.331 INFO:tasks.rados.rados.0.smithi166.stdout:491: done (9 left) 2020-11-16T20:56:01.331 INFO:tasks.rados.rados.0.smithi166.stdout:492: done (8 left) 2020-11-16T20:56:01.331 INFO:tasks.rados.rados.0.smithi166.stdout:501: snap_create 2020-11-16T20:56:01.331 INFO:tasks.rados.rados.0.smithi166.stdout:494: finishing write tid 1 to smithi16641208-494 2020-11-16T20:56:01.332 INFO:tasks.rados.rados.0.smithi166.stdout:494: finishing write tid 2 to smithi16641208-494 2020-11-16T20:56:01.332 INFO:tasks.rados.rados.0.smithi166.stdout:494: finishing write tid 3 to smithi16641208-494 2020-11-16T20:56:01.332 INFO:tasks.rados.rados.0.smithi166.stdout:494: finishing write tid 4 to smithi16641208-494 2020-11-16T20:56:01.332 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 494 v 345 (ObjNum 493 snap 0 seq_num 493) dirty exists 2020-11-16T20:56:01.332 INFO:tasks.rados.rados.0.smithi166.stdout:494: left oid 494 (ObjNum 493 snap 0 seq_num 493) 2020-11-16T20:56:01.332 INFO:tasks.rados.rados.0.smithi166.stdout:493: finishing write tid 4 to smithi16641208-493 2020-11-16T20:56:01.332 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 493 v 380 (ObjNum 492 snap 0 seq_num 492) dirty exists 2020-11-16T20:56:01.333 INFO:tasks.rados.rados.0.smithi166.stdout:493: left oid 493 (ObjNum 492 snap 0 seq_num 492) 2020-11-16T20:56:01.333 INFO:tasks.rados.rados.0.smithi166.stdout:495: finishing write tid 1 to smithi16641208-495 2020-11-16T20:56:01.333 INFO:tasks.rados.rados.0.smithi166.stdout:495: finishing write tid 2 to smithi16641208-495 2020-11-16T20:56:01.333 INFO:tasks.rados.rados.0.smithi166.stdout:495: finishing write tid 3 to smithi16641208-495 2020-11-16T20:56:01.333 INFO:tasks.rados.rados.0.smithi166.stdout:495: finishing write tid 4 to smithi16641208-495 2020-11-16T20:56:01.333 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 495 v 431 (ObjNum 494 snap 0 seq_num 494) dirty exists 2020-11-16T20:56:01.333 INFO:tasks.rados.rados.0.smithi166.stdout:495: left oid 495 (ObjNum 494 snap 0 seq_num 494) 2020-11-16T20:56:01.334 INFO:tasks.rados.rados.0.smithi166.stdout:496: finishing write tid 1 to smithi16641208-496 2020-11-16T20:56:01.334 INFO:tasks.rados.rados.0.smithi166.stdout:496: finishing write tid 2 to smithi16641208-496 2020-11-16T20:56:01.334 INFO:tasks.rados.rados.0.smithi166.stdout:496: finishing write tid 3 to smithi16641208-496 2020-11-16T20:56:01.334 INFO:tasks.rados.rados.0.smithi166.stdout:496: finishing write tid 4 to smithi16641208-496 2020-11-16T20:56:01.334 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 496 v 348 (ObjNum 495 snap 0 seq_num 495) dirty exists 2020-11-16T20:56:01.334 INFO:tasks.rados.rados.0.smithi166.stdout:496: left oid 496 (ObjNum 495 snap 0 seq_num 495) 2020-11-16T20:56:01.334 INFO:tasks.rados.rados.0.smithi166.stdout:497: finishing write tid 1 to smithi16641208-497 2020-11-16T20:56:01.334 INFO:tasks.rados.rados.0.smithi166.stdout:497: finishing write tid 2 to smithi16641208-497 2020-11-16T20:56:01.335 INFO:tasks.rados.rados.0.smithi166.stdout:497: finishing write tid 3 to smithi16641208-497 2020-11-16T20:56:01.335 INFO:tasks.rados.rados.0.smithi166.stdout:497: finishing write tid 4 to smithi16641208-497 2020-11-16T20:56:01.335 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 497 v 370 (ObjNum 496 snap 0 seq_num 496) dirty exists 2020-11-16T20:56:01.335 INFO:tasks.rados.rados.0.smithi166.stdout:497: left oid 497 (ObjNum 496 snap 0 seq_num 496) 2020-11-16T20:56:01.335 INFO:tasks.rados.rados.0.smithi166.stdout:498: finishing write tid 1 to smithi16641208-498 2020-11-16T20:56:01.335 INFO:tasks.rados.rados.0.smithi166.stdout:498: finishing write tid 2 to smithi16641208-498 2020-11-16T20:56:01.335 INFO:tasks.rados.rados.0.smithi166.stdout:498: finishing write tid 3 to smithi16641208-498 2020-11-16T20:56:01.336 INFO:tasks.rados.rados.0.smithi166.stdout:498: finishing write tid 4 to smithi16641208-498 2020-11-16T20:56:01.336 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 498 v 351 (ObjNum 497 snap 0 seq_num 497) dirty exists 2020-11-16T20:56:01.336 INFO:tasks.rados.rados.0.smithi166.stdout:498: left oid 498 (ObjNum 497 snap 0 seq_num 497) 2020-11-16T20:56:01.336 INFO:tasks.rados.rados.0.smithi166.stdout:499: finishing write tid 1 to smithi16641208-499 2020-11-16T20:56:01.336 INFO:tasks.rados.rados.0.smithi166.stdout:499: finishing write tid 2 to smithi16641208-499 2020-11-16T20:56:01.336 INFO:tasks.rados.rados.0.smithi166.stdout:499: finishing write tid 3 to smithi16641208-499 2020-11-16T20:56:01.336 INFO:tasks.rados.rados.0.smithi166.stdout:499: finishing write tid 4 to smithi16641208-499 2020-11-16T20:56:01.336 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 499 v 383 (ObjNum 498 snap 0 seq_num 498) dirty exists 2020-11-16T20:56:01.337 INFO:tasks.rados.rados.0.smithi166.stdout:499: left oid 499 (ObjNum 498 snap 0 seq_num 498) 2020-11-16T20:56:01.337 INFO:tasks.rados.rados.0.smithi166.stdout:500: finishing write tid 1 to smithi16641208-500 2020-11-16T20:56:01.337 INFO:tasks.rados.rados.0.smithi166.stdout:500: finishing write tid 2 to smithi16641208-500 2020-11-16T20:56:01.337 INFO:tasks.rados.rados.0.smithi166.stdout:500: finishing write tid 3 to smithi16641208-500 2020-11-16T20:56:01.337 INFO:tasks.rados.rados.0.smithi166.stdout:500: finishing write tid 4 to smithi16641208-500 2020-11-16T20:56:01.337 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 500 v 386 (ObjNum 499 snap 0 seq_num 499) dirty exists 2020-11-16T20:56:01.337 INFO:tasks.rados.rados.0.smithi166.stdout:500: left oid 500 (ObjNum 499 snap 0 seq_num 499) 2020-11-16T20:56:01.338 INFO:tasks.rados.rados.0.smithi166.stdout:493: done (8 left) 2020-11-16T20:56:01.338 INFO:tasks.rados.rados.0.smithi166.stdout:494: done (7 left) 2020-11-16T20:56:01.338 INFO:tasks.rados.rados.0.smithi166.stdout:495: done (6 left) 2020-11-16T20:56:01.338 INFO:tasks.rados.rados.0.smithi166.stdout:496: done (5 left) 2020-11-16T20:56:01.338 INFO:tasks.rados.rados.0.smithi166.stdout:497: done (4 left) 2020-11-16T20:56:01.338 INFO:tasks.rados.rados.0.smithi166.stdout:498: done (3 left) 2020-11-16T20:56:01.338 INFO:tasks.rados.rados.0.smithi166.stdout:499: done (2 left) 2020-11-16T20:56:01.338 INFO:tasks.rados.rados.0.smithi166.stdout:500: done (1 left) 2020-11-16T20:56:01.339 INFO:tasks.rados.rados.0.smithi166.stdout:501: done (0 left) 2020-11-16T20:56:01.339 INFO:tasks.rados.rados.0.smithi166.stdout:502: cache_evict oid 231 snap 0 2020-11-16T20:56:01.339 INFO:tasks.rados.rados.0.smithi166.stdout:503: cache_try_flush oid 482 snap 0 2020-11-16T20:56:01.339 INFO:tasks.rados.rados.0.smithi166.stdout:504: cache_flush oid 95 snap 0 2020-11-16T20:56:01.339 INFO:tasks.rados.rados.0.smithi166.stdout:505: write (excl) oid 357 current snap is 1 2020-11-16T20:56:01.339 INFO:tasks.rados.rados.0.smithi166.stdout:505: seq_num 500 ranges {403500=787445,1692526=473837} 2020-11-16T20:56:01.339 INFO:tasks.rados.rados.0.smithi166.stdout:505: writing smithi16641208-357 from 403500 to 1190945 tid 1 2020-11-16T20:56:01.340 INFO:tasks.rados.rados.0.smithi166.stdout:505: writing smithi16641208-357 from 1692526 to 2166363 tid 2 2020-11-16T20:56:01.340 INFO:tasks.rados.rados.0.smithi166.stdout:506: read oid 32 snap -1 2020-11-16T20:56:01.340 INFO:tasks.rados.rados.0.smithi166.stdout:506: expect (ObjNum 31 snap 0 seq_num 31) 2020-11-16T20:56:01.340 INFO:tasks.rados.rados.0.smithi166.stdout:507: read oid 193 snap 0 2020-11-16T20:56:01.340 INFO:tasks.rados.rados.0.smithi166.stdout:507: expect (ObjNum 192 snap 0 seq_num 192) 2020-11-16T20:56:01.340 INFO:tasks.rados.rados.0.smithi166.stdout:508: cache_evict oid 317 snap -1 2020-11-16T20:56:01.340 INFO:tasks.rados.rados.0.smithi166.stdout:502: got (2) No such file or directory 2020-11-16T20:56:01.340 INFO:tasks.rados.rados.0.smithi166.stdout:502: done (6 left) 2020-11-16T20:56:01.341 INFO:tasks.rados.rados.0.smithi166.stdout:509: delete oid 3 current snap is 1 2020-11-16T20:56:01.341 INFO:tasks.rados.rados.0.smithi166.stdout:503: got (2) No such file or directory 2020-11-16T20:56:01.341 INFO:tasks.rados.rados.0.smithi166.stdout:505: finishing write tid 1 to smithi16641208-357 2020-11-16T20:56:01.341 INFO:tasks.rados.rados.0.smithi166.stdout:508: got (0) Success 2020-11-16T20:56:01.341 INFO:tasks.rados.rados.0.smithi166.stdout:503: done (6 left) 2020-11-16T20:56:01.341 INFO:tasks.rados.rados.0.smithi166.stdout:508: done (5 left) 2020-11-16T20:56:01.341 INFO:tasks.rados.rados.0.smithi166.stdout:509: done (4 left) 2020-11-16T20:56:01.342 INFO:tasks.rados.rados.0.smithi166.stdout:510: write (excl) oid 416 current snap is 1 2020-11-16T20:56:01.342 INFO:tasks.rados.rados.0.smithi166.stdout:510: seq_num 502 ranges {437114=654296,1525843=477506} 2020-11-16T20:56:01.342 INFO:tasks.rados.rados.0.smithi166.stdout:510: writing smithi16641208-416 from 437114 to 1091410 tid 1 2020-11-16T20:56:01.342 INFO:tasks.rados.rados.0.smithi166.stdout:510: writing smithi16641208-416 from 1525843 to 2003349 tid 2 2020-11-16T20:56:01.342 INFO:tasks.rados.rados.0.smithi166.stdout:511: snap_create 2020-11-16T20:56:01.342 INFO:tasks.rados.rados.0.smithi166.stdout:504: got (0) Success 2020-11-16T20:56:01.342 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 95 v 0 (ObjNum 94 snap 0 seq_num 94) dirty exists 2020-11-16T20:56:01.343 INFO:tasks.rados.rados.0.smithi166.stdout:506: expect (ObjNum 31 snap 0 seq_num 31) 2020-11-16T20:56:01.343 INFO:tasks.rados.rados.0.smithi166.stdout:505: finishing write tid 2 to smithi16641208-357 2020-11-16T20:56:01.343 INFO:tasks.rados.rados.0.smithi166.stdout:505: finishing write tid 3 to smithi16641208-357 2020-11-16T20:56:01.343 INFO:tasks.rados.rados.0.smithi166.stdout:505: finishing write tid 4 to smithi16641208-357 2020-11-16T20:56:01.343 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 357 v 355 (ObjNum 500 snap 1 seq_num 500) dirty exists 2020-11-16T20:56:01.343 INFO:tasks.rados.rados.0.smithi166.stdout:505: left oid 357 (ObjNum 500 snap 1 seq_num 500) 2020-11-16T20:56:01.343 INFO:tasks.rados.rados.0.smithi166.stdout:510: finishing write tid 1 to smithi16641208-416 2020-11-16T20:56:01.343 INFO:tasks.rados.rados.0.smithi166.stdout:510: finishing write tid 2 to smithi16641208-416 2020-11-16T20:56:01.344 INFO:tasks.rados.rados.0.smithi166.stdout:507: expect (ObjNum 192 snap 0 seq_num 192) 2020-11-16T20:56:01.344 INFO:tasks.rados.rados.0.smithi166.stdout:510: finishing write tid 3 to smithi16641208-416 2020-11-16T20:56:01.344 INFO:tasks.rados.rados.0.smithi166.stdout:510: finishing write tid 4 to smithi16641208-416 2020-11-16T20:56:01.344 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 416 v 359 (ObjNum 502 snap 1 seq_num 502) dirty exists 2020-11-16T20:56:01.344 INFO:tasks.rados.rados.0.smithi166.stdout:510: left oid 416 (ObjNum 502 snap 1 seq_num 502) 2020-11-16T20:56:01.344 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:56:01.345 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:56:01.345 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:56:01.345 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:56:01.345 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:56:01.345 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:56:01.345 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:56:01.345 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:56:01.346 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:56:01.346 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:56:01.346 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:56:01.346 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:56:01.346 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:56:01.349 INFO:tasks.rados.rados.0.smithi166.stdout:504: done (5 left) 2020-11-16T20:56:01.349 INFO:tasks.rados.rados.0.smithi166.stdout:505: done (4 left) 2020-11-16T20:56:01.349 INFO:tasks.rados.rados.0.smithi166.stdout:506: done (3 left) 2020-11-16T20:56:01.350 INFO:tasks.rados.rados.0.smithi166.stdout:507: done (2 left) 2020-11-16T20:56:01.350 INFO:tasks.rados.rados.0.smithi166.stdout:510: done (1 left) 2020-11-16T20:56:01.350 INFO:tasks.rados.rados.0.smithi166.stdout:511: done (0 left) 2020-11-16T20:56:01.350 INFO:tasks.rados.rados.0.smithi166.stdout:512: delete oid 282 current snap is 2 2020-11-16T20:56:01.350 INFO:tasks.rados.rados.0.smithi166.stdout:512: done (0 left) 2020-11-16T20:56:01.350 INFO:tasks.rados.rados.0.smithi166.stdout:513: write (excl) oid 342 current snap is 2 2020-11-16T20:56:01.351 INFO:tasks.rados.rados.0.smithi166.stdout:513: seq_num 504 ranges {470728=404794,1526454=481175} 2020-11-16T20:56:01.351 INFO:tasks.rados.rados.0.smithi166.stdout:513: writing smithi16641208-342 from 470728 to 875522 tid 1 2020-11-16T20:56:01.351 INFO:tasks.rados.rados.0.smithi166.stdout:513: writing smithi16641208-342 from 1526454 to 2007629 tid 2 2020-11-16T20:56:01.351 INFO:tasks.rados.rados.0.smithi166.stdout:514: delete oid 203 current snap is 2 2020-11-16T20:56:01.351 INFO:tasks.rados.rados.0.smithi166.stdout:513: finishing write tid 1 to smithi16641208-342 2020-11-16T20:56:01.351 INFO:tasks.rados.rados.0.smithi166.stdout:513: finishing write tid 2 to smithi16641208-342 2020-11-16T20:56:01.351 INFO:tasks.rados.rados.0.smithi166.stdout:514: done (1 left) 2020-11-16T20:56:01.352 INFO:tasks.rados.rados.0.smithi166.stdout:515: snap_create 2020-11-16T20:56:01.352 INFO:tasks.rados.rados.0.smithi166.stdout:513: finishing write tid 3 to smithi16641208-342 2020-11-16T20:56:01.352 INFO:tasks.rados.rados.0.smithi166.stdout:513: finishing write tid 4 to smithi16641208-342 2020-11-16T20:56:01.352 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 342 v 367 (ObjNum 504 snap 2 seq_num 504) dirty exists 2020-11-16T20:56:01.352 INFO:tasks.rados.rados.0.smithi166.stdout:513: left oid 342 (ObjNum 504 snap 2 seq_num 504) 2020-11-16T20:56:01.352 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:01.353+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:01.353 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:01.353 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2020-11-16T20:56:01.353 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:01.448 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:01.452+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:01.526 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:01.526 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:01.535 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:56:01.549 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:01.554+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:01.650 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:01.653+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:01.711 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:01.711 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:01.721 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:56:01.761 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:01.766+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:01.851 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:01.855+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:01.895 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:01.895 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:01.905 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:56:01.952 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:01.957+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:01.953 INFO:tasks.rados.rados.0.smithi166.stdout:513: done (1 left) 2020-11-16T20:56:01.953 INFO:tasks.rados.rados.0.smithi166.stdout:515: done (0 left) 2020-11-16T20:56:01.954 INFO:tasks.rados.rados.0.smithi166.stdout:516: read oid 332 snap -1 2020-11-16T20:56:01.954 INFO:tasks.rados.rados.0.smithi166.stdout:516: expect (ObjNum 331 snap 0 seq_num 331) 2020-11-16T20:56:01.954 INFO:tasks.rados.rados.0.smithi166.stdout:517: read oid 189 snap 0 2020-11-16T20:56:01.954 INFO:tasks.rados.rados.0.smithi166.stdout:517: expect (ObjNum 188 snap 0 seq_num 188) 2020-11-16T20:56:01.954 INFO:tasks.rados.rados.0.smithi166.stdout:518: delete oid 275 current snap is 3 2020-11-16T20:56:01.956 INFO:teuthology.orchestra.run.smithi166.stderr:nodeep-scrub is unset 2020-11-16T20:56:01.961 INFO:tasks.rados.rados.0.smithi166.stdout:518: done (2 left) 2020-11-16T20:56:01.961 INFO:tasks.rados.rados.0.smithi166.stdout:519: write oid 226 current snap is 3 2020-11-16T20:56:01.961 INFO:tasks.rados.rados.0.smithi166.stdout:519: seq_num 507 ranges {521149=630541,1701900=628502} 2020-11-16T20:56:01.968 INFO:tasks.rados.rados.0.smithi166.stdout:519: writing smithi16641208-226 from 521149 to 1151690 tid 1 2020-11-16T20:56:01.976 INFO:tasks.rados.rados.0.smithi166.stdout:519: writing smithi16641208-226 from 1701900 to 2330402 tid 2 2020-11-16T20:56:01.976 INFO:tasks.rados.rados.0.smithi166.stdout:520: rollback oid 320 current snap is 3 2020-11-16T20:56:01.976 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 320 to 0 2020-11-16T20:56:01.976 INFO:tasks.rados.rados.0.smithi166.stdout:521: write oid 402 current snap is 3 2020-11-16T20:56:01.976 INFO:tasks.rados.rados.0.smithi166.stdout:521: seq_num 508 ranges {537956=705790,1644029=772160} 2020-11-16T20:56:01.984 INFO:tasks.rados.rados.0.smithi166.stdout:521: writing smithi16641208-402 from 537956 to 1243746 tid 1 2020-11-16T20:56:01.992 INFO:tasks.rados.rados.0.smithi166.stdout:521: writing smithi16641208-402 from 1644029 to 2416189 tid 2 2020-11-16T20:56:01.992 INFO:tasks.rados.rados.0.smithi166.stdout:522: rollback oid 247 current snap is 3 2020-11-16T20:56:01.992 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 247 to 1 2020-11-16T20:56:01.992 INFO:tasks.rados.rados.0.smithi166.stdout:523: copy_from oid 467 from oid 325 current snap is 3 2020-11-16T20:56:01.992 INFO:tasks.rados.rados.0.smithi166.stdout:516: expect (ObjNum 331 snap 0 seq_num 331) 2020-11-16T20:56:02.053 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:02.058+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:02.097 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:02.098 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:02.107 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:56:02.116 INFO:tasks.rados.rados.0.smithi166.stdout:519: finishing write tid 1 to smithi16641208-226 2020-11-16T20:56:02.116 INFO:tasks.rados.rados.0.smithi166.stdout:517: expect (ObjNum 188 snap 0 seq_num 188) 2020-11-16T20:56:02.153 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:02.158+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:02.220 INFO:tasks.rados.rados.0.smithi166.stdout:520: finishing rollback tid 0 to smithi16641208-320 2020-11-16T20:56:02.220 INFO:tasks.rados.rados.0.smithi166.stdout:519: finishing write tid 2 to smithi16641208-226 2020-11-16T20:56:02.220 INFO:tasks.rados.rados.0.smithi166.stdout:519: finishing write tid 3 to smithi16641208-226 2020-11-16T20:56:02.220 INFO:tasks.rados.rados.0.smithi166.stdout:519: finishing write tid 4 to smithi16641208-226 2020-11-16T20:56:02.220 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 226 v 437 (ObjNum 507 snap 3 seq_num 507) dirty exists 2020-11-16T20:56:02.221 INFO:tasks.rados.rados.0.smithi166.stdout:519: left oid 226 (ObjNum 507 snap 3 seq_num 507) 2020-11-16T20:56:02.221 INFO:tasks.rados.rados.0.smithi166.stdout:516: done (6 left) 2020-11-16T20:56:02.221 INFO:tasks.rados.rados.0.smithi166.stdout:517: done (5 left) 2020-11-16T20:56:02.221 INFO:tasks.rados.rados.0.smithi166.stdout:519: done (4 left) 2020-11-16T20:56:02.221 INFO:tasks.rados.rados.0.smithi166.stdout:524: read oid 318 snap -1 2020-11-16T20:56:02.221 INFO:tasks.rados.rados.0.smithi166.stdout:524: expect (ObjNum 317 snap 0 seq_num 317) 2020-11-16T20:56:02.221 INFO:tasks.rados.rados.0.smithi166.stdout:525: read oid 307 snap -1 2020-11-16T20:56:02.221 INFO:tasks.rados.rados.0.smithi166.stdout:525: expect (ObjNum 306 snap 0 seq_num 306) 2020-11-16T20:56:02.222 INFO:tasks.rados.rados.0.smithi166.stdout:526: delete oid 446 current snap is 3 2020-11-16T20:56:02.222 INFO:tasks.rados.rados.0.smithi166.stdout:520: finishing rollback tid 1 to smithi16641208-320 2020-11-16T20:56:02.222 INFO:tasks.rados.rados.0.smithi166.stdout:520: finishing rollback tid 2 to smithi16641208-320 2020-11-16T20:56:02.222 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 320 v 368 (ObjNum 319 snap 0 seq_num 319) dirty exists 2020-11-16T20:56:02.223 INFO:tasks.rados.rados.0.smithi166.stdout:522: finishing rollback tid 0 to smithi16641208-247 2020-11-16T20:56:02.223 INFO:tasks.rados.rados.0.smithi166.stdout:522: finishing rollback tid 1 to smithi16641208-247 2020-11-16T20:56:02.223 INFO:tasks.rados.rados.0.smithi166.stdout:522: finishing rollback tid 2 to smithi16641208-247 2020-11-16T20:56:02.223 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 247 v 363 (ObjNum 246 snap 0 seq_num 246) dirty exists 2020-11-16T20:56:02.223 INFO:tasks.rados.rados.0.smithi166.stdout:521: finishing write tid 1 to smithi16641208-402 2020-11-16T20:56:02.224 INFO:tasks.rados.rados.0.smithi166.stdout:521: finishing write tid 2 to smithi16641208-402 2020-11-16T20:56:02.224 INFO:tasks.rados.rados.0.smithi166.stdout:521: finishing write tid 3 to smithi16641208-402 2020-11-16T20:56:02.224 INFO:tasks.rados.rados.0.smithi166.stdout:521: finishing write tid 4 to smithi16641208-402 2020-11-16T20:56:02.224 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 402 v 371 (ObjNum 508 snap 3 seq_num 508) dirty exists 2020-11-16T20:56:02.224 INFO:tasks.rados.rados.0.smithi166.stdout:521: left oid 402 (ObjNum 508 snap 3 seq_num 508) 2020-11-16T20:56:02.224 INFO:tasks.rados.rados.0.smithi166.stdout:523: finishing copy_from to smithi16641208-467 2020-11-16T20:56:02.224 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 467 v 283 (ObjNum 324 snap 0 seq_num 324) dirty exists 2020-11-16T20:56:02.224 INFO:tasks.rados.rados.0.smithi166.stdout:523: finishing copy_from racing read to smithi16641208-467 2020-11-16T20:56:02.225 INFO:tasks.rados.rados.0.smithi166.stdout:520: done (6 left) 2020-11-16T20:56:02.225 INFO:tasks.rados.rados.0.smithi166.stdout:521: done (5 left) 2020-11-16T20:56:02.225 INFO:tasks.rados.rados.0.smithi166.stdout:522: done (4 left) 2020-11-16T20:56:02.225 INFO:tasks.rados.rados.0.smithi166.stdout:523: done (3 left) 2020-11-16T20:56:02.226 INFO:tasks.rados.rados.0.smithi166.stdout:526: done (2 left) 2020-11-16T20:56:02.226 INFO:tasks.rados.rados.0.smithi166.stdout:527: delete oid 417 current snap is 3 2020-11-16T20:56:02.229 INFO:tasks.rados.rados.0.smithi166.stdout:524: expect (ObjNum 317 snap 0 seq_num 317) 2020-11-16T20:56:02.246 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:02.246 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:02.254 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:02.258+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:02.256 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:56:02.333 INFO:tasks.rados.rados.0.smithi166.stdout:525: expect (ObjNum 306 snap 0 seq_num 306) 2020-11-16T20:56:02.354 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:02.358+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:02.430 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:02.430 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:02.437 INFO:tasks.rados.rados.0.smithi166.stdout:524: done (2 left) 2020-11-16T20:56:02.437 INFO:tasks.rados.rados.0.smithi166.stdout:525: done (1 left) 2020-11-16T20:56:02.437 INFO:tasks.rados.rados.0.smithi166.stdout:527: done (0 left) 2020-11-16T20:56:02.437 INFO:tasks.rados.rados.0.smithi166.stdout:528: cache_flush oid 245 snap -1 2020-11-16T20:56:02.437 INFO:tasks.rados.rados.0.smithi166.stdout:529: write (excl) oid 438 current snap is 3 2020-11-16T20:56:02.438 INFO:tasks.rados.rados.0.smithi166.stdout:529: seq_num 511 ranges {588377=647890,1935828=635840} 2020-11-16T20:56:02.439 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:56:02.443 INFO:tasks.rados.rados.0.smithi166.stdout:529: writing smithi16641208-438 from 588377 to 1236267 tid 1 2020-11-16T20:56:02.451 INFO:tasks.rados.rados.0.smithi166.stdout:529: writing smithi16641208-438 from 1935828 to 2571668 tid 2 2020-11-16T20:56:02.451 INFO:tasks.rados.rados.0.smithi166.stdout:530: rollback oid 32 current snap is 3 2020-11-16T20:56:02.452 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 32 to 0 2020-11-16T20:56:02.452 INFO:tasks.rados.rados.0.smithi166.stdout:528: got (2) No such file or directory 2020-11-16T20:56:02.452 INFO:tasks.rados.rados.0.smithi166.stdout:528: done (2 left) 2020-11-16T20:56:02.452 INFO:tasks.rados.rados.0.smithi166.stdout:531: cache_try_flush oid 151 snap -1 2020-11-16T20:56:02.452 INFO:tasks.rados.rados.0.smithi166.stdout:529: finishing write tid 1 to smithi16641208-438 2020-11-16T20:56:02.452 INFO:tasks.rados.rados.0.smithi166.stdout:532: read oid 84 snap -1 2020-11-16T20:56:02.452 INFO:tasks.rados.rados.0.smithi166.stdout:532: expect (ObjNum 83 snap 0 seq_num 83) 2020-11-16T20:56:02.453 INFO:tasks.rados.rados.0.smithi166.stdout:533: snap_create 2020-11-16T20:56:02.453 INFO:tasks.rados.rados.0.smithi166.stdout:531: got (2) No such file or directory 2020-11-16T20:56:02.455 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:02.460+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:02.457 INFO:tasks.rados.rados.0.smithi166.stdout:530: finishing rollback tid 0 to smithi16641208-32 2020-11-16T20:56:02.462 INFO:tasks.rados.rados.0.smithi166.stdout:530: finishing rollback tid 1 to smithi16641208-32 2020-11-16T20:56:02.465 INFO:tasks.rados.rados.0.smithi166.stdout:530: finishing rollback tid 2 to smithi16641208-32 2020-11-16T20:56:02.466 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 32 v 415 (ObjNum 31 snap 0 seq_num 31) dirty exists 2020-11-16T20:56:02.466 INFO:tasks.rados.rados.0.smithi166.stdout:529: finishing write tid 2 to smithi16641208-438 2020-11-16T20:56:02.466 INFO:tasks.rados.rados.0.smithi166.stdout:529: finishing write tid 3 to smithi16641208-438 2020-11-16T20:56:02.474 INFO:tasks.rados.rados.0.smithi166.stdout:532: expect (ObjNum 83 snap 0 seq_num 83) 2020-11-16T20:56:02.556 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:02.560+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:02.585 INFO:tasks.rados.rados.0.smithi166.stdout:529: finishing write tid 4 to smithi16641208-438 2020-11-16T20:56:02.585 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 438 v 441 (ObjNum 511 snap 3 seq_num 511) dirty exists 2020-11-16T20:56:02.585 INFO:tasks.rados.rados.0.smithi166.stdout:529: left oid 438 (ObjNum 511 snap 3 seq_num 511) 2020-11-16T20:56:02.618 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:02.618 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:02.628 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:56:02.656 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:02.661+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:02.757 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:02.761+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:02.802 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:02.802 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:02.811 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:56:02.858 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:02.863+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:02.955 INFO:tasks.rados.rados.0.smithi166.stdout:529: done (4 left) 2020-11-16T20:56:02.956 INFO:tasks.rados.rados.0.smithi166.stdout:530: done (3 left) 2020-11-16T20:56:02.956 INFO:tasks.rados.rados.0.smithi166.stdout:531: done (2 left) 2020-11-16T20:56:02.956 INFO:tasks.rados.rados.0.smithi166.stdout:532: done (1 left) 2020-11-16T20:56:02.956 INFO:tasks.rados.rados.0.smithi166.stdout:533: done (0 left) 2020-11-16T20:56:02.956 INFO:tasks.rados.rados.0.smithi166.stdout:534: write (excl) oid 126 current snap is 4 2020-11-16T20:56:02.956 INFO:tasks.rados.rados.0.smithi166.stdout:534: seq_num 512 ranges {605184=723139,1877957=727227} 2020-11-16T20:56:02.958 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:02.963+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:02.962 INFO:tasks.rados.rados.0.smithi166.stdout:534: writing smithi16641208-126 from 605184 to 1328323 tid 1 2020-11-16T20:56:02.970 INFO:tasks.rados.rados.0.smithi166.stdout:534: writing smithi16641208-126 from 1877957 to 2605184 tid 2 2020-11-16T20:56:02.971 INFO:tasks.rados.rados.0.smithi166.stdout:535: cache_flush oid 456 snap -1 2020-11-16T20:56:02.971 INFO:tasks.rados.rados.0.smithi166.stdout:536: copy_from oid 333 from oid 226 current snap is 4 2020-11-16T20:56:02.971 INFO:tasks.rados.rados.0.smithi166.stdout:537: cache_evict oid 249 snap -1 2020-11-16T20:56:02.971 INFO:tasks.rados.rados.0.smithi166.stdout:538: cache_flush oid 15 snap -1 2020-11-16T20:56:02.971 INFO:tasks.rados.rados.0.smithi166.stdout:539: read oid 267 snap -1 2020-11-16T20:56:02.971 INFO:tasks.rados.rados.0.smithi166.stdout:539: expect (ObjNum 266 snap 0 seq_num 266) 2020-11-16T20:56:02.971 INFO:tasks.rados.rados.0.smithi166.stdout:540: snap_create 2020-11-16T20:56:02.972 INFO:tasks.rados.rados.0.smithi166.stdout:535: got (0) Success 2020-11-16T20:56:02.972 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 456 v 0 (ObjNum 455 snap 0 seq_num 455) dirty exists 2020-11-16T20:56:02.972 INFO:tasks.rados.rados.0.smithi166.stdout:537: got (2) No such file or directory 2020-11-16T20:56:02.972 INFO:tasks.rados.rados.0.smithi166.stdout:534: finishing write tid 1 to smithi16641208-126 2020-11-16T20:56:02.989 INFO:tasks.rados.rados.0.smithi166.stdout:534: finishing write tid 2 to smithi16641208-126 2020-11-16T20:56:02.991 INFO:tasks.rados.rados.0.smithi166.stdout:539: expect (ObjNum 266 snap 0 seq_num 266) 2020-11-16T20:56:02.999 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:03.000 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:03.011 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:56:03.059 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:03.063+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:03.076 INFO:tasks.rados.rados.0.smithi166.stdout:534: finishing write tid 3 to smithi16641208-126 2020-11-16T20:56:03.076 INFO:tasks.rados.rados.0.smithi166.stdout:534: finishing write tid 4 to smithi16641208-126 2020-11-16T20:56:03.076 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 126 v 448 (ObjNum 512 snap 4 seq_num 512) dirty exists 2020-11-16T20:56:03.077 INFO:tasks.rados.rados.0.smithi166.stdout:534: left oid 126 (ObjNum 512 snap 4 seq_num 512) 2020-11-16T20:56:03.077 INFO:tasks.rados.rados.0.smithi166.stdout:538: got (0) Success 2020-11-16T20:56:03.077 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 15 v 0 (ObjNum 14 snap 0 seq_num 14) dirty exists 2020-11-16T20:56:03.077 INFO:tasks.rados.rados.0.smithi166.stdout:536: finishing copy_from to smithi16641208-333 2020-11-16T20:56:03.077 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 333 v 437 (ObjNum 507 snap 3 seq_num 507) dirty exists 2020-11-16T20:56:03.077 INFO:tasks.rados.rados.0.smithi166.stdout:536: finishing copy_from racing read to smithi16641208-333 2020-11-16T20:56:03.141 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:03.141 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:03.150 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:56:03.194 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:03.199+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:03.261 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:03.266+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:03.276 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:03.277 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:03.286 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:56:03.347 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:56:03.369 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:03.374+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:03.456 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:03.456 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:03.462 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:03.467+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:03.466 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:56:03.513 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:56:03.534 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:56:03.554 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:56:03.563 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:03.568+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:03.575 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:56:03.595 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:56:03.617 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:56:03.638 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:03.638 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:03.638 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:56:03.638 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:03.648 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:56:03.689 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:03.694+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:03.765 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:03.770+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:03.813 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:03.813 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:03.814 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:56:03.814 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:56:03.814 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:03.824 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:56:03.840 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:56:03.862 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:56:03.863 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:56:03.863 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:56:03.863 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:56:03.864 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:56:03.864 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:56:03.864 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:56:03.864 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:56:03.864 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:56:03.866 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:03.871+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:03.967 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:03.972+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:03.968 INFO:tasks.rados.rados.0.smithi166.stdout:534: done (6 left) 2020-11-16T20:56:03.968 INFO:tasks.rados.rados.0.smithi166.stdout:535: done (5 left) 2020-11-16T20:56:03.968 INFO:tasks.rados.rados.0.smithi166.stdout:536: done (4 left) 2020-11-16T20:56:03.968 INFO:tasks.rados.rados.0.smithi166.stdout:537: done (3 left) 2020-11-16T20:56:03.968 INFO:tasks.rados.rados.0.smithi166.stdout:538: done (2 left) 2020-11-16T20:56:03.969 INFO:tasks.rados.rados.0.smithi166.stdout:539: done (1 left) 2020-11-16T20:56:03.969 INFO:tasks.rados.rados.0.smithi166.stdout:540: done (0 left) 2020-11-16T20:56:03.969 INFO:tasks.rados.rados.0.smithi166.stdout:541: delete oid 423 current snap is 5 2020-11-16T20:56:03.973 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:03.973 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:56:03.973 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:56:03.974 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:56:03.974 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.974 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:8 4.2 4:6173e90a:::smithi16641208-2:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:56:03.974 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:50.921386+0000", 2020-11-16T20:56:03.974 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 13.055216617999999, 2020-11-16T20:56:03.974 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015084947, 2020-11-16T20:56:03.974 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:03.975 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:03.975 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:03.975 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:03.975 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:03.975 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 8 2020-11-16T20:56:03.975 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.975 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:03.976 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.976 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:03.976 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921386+0000", 2020-11-16T20:56:03.976 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:03.976 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.976 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.976 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:03.977 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921386+0000", 2020-11-16T20:56:03.977 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6447999999999999e-05 2020-11-16T20:56:03.977 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.977 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.977 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:03.977 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921403+0000", 2020-11-16T20:56:03.977 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.467e-06 2020-11-16T20:56:03.977 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.978 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.978 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:03.978 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921406+0000", 2020-11-16T20:56:03.978 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8939999999999998e-06 2020-11-16T20:56:03.978 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.978 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.978 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:03.979 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921412+0000", 2020-11-16T20:56:03.979 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.455e-06 2020-11-16T20:56:03.979 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.979 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.979 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:03.979 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921416+0000", 2020-11-16T20:56:03.979 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.067e-05 2020-11-16T20:56:03.980 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.980 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.980 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:03.980 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921476+0000", 2020-11-16T20:56:03.980 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3448999999999999e-05 2020-11-16T20:56:03.980 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.980 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.980 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:03.981 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.921500+0000", 2020-11-16T20:56:03.981 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0080803209999999997 2020-11-16T20:56:03.981 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.981 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.981 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:03.981 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.929580+0000", 2020-11-16T20:56:03.981 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7507000000000003e-05 2020-11-16T20:56:03.981 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.982 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.982 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:03.982 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.929648+0000", 2020-11-16T20:56:03.982 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0065208130000000003 2020-11-16T20:56:03.982 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.982 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.982 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:03.983 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.936168+0000", 2020-11-16T20:56:03.983 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8515000000000004e-05 2020-11-16T20:56:03.983 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.983 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.983 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:03.983 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.936237+0000", 2020-11-16T20:56:03.983 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000234408 2020-11-16T20:56:03.984 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.984 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.984 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:03.984 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.936471+0000", 2020-11-16T20:56:03.984 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015084947 2020-11-16T20:56:03.984 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:03.984 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:03.984 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:03.985 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.985 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.985 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:10 4.2 4:5ad6a7de:::smithi16641208-3:head [write 1600611~433003] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:56:03.985 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:50.932929+0000", 2020-11-16T20:56:03.985 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 13.043673858, 2020-11-16T20:56:03.985 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017104389000000001, 2020-11-16T20:56:03.985 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:03.986 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:03.986 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:03.986 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:03.986 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:03.986 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 10 2020-11-16T20:56:03.986 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.986 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:03.986 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.987 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:03.987 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.932929+0000", 2020-11-16T20:56:03.987 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:03.987 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.987 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.987 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:03.987 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.932929+0000", 2020-11-16T20:56:03.988 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00021076600000000001 2020-11-16T20:56:03.988 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.988 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.988 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:03.988 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933140+0000", 2020-11-16T20:56:03.988 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7219999999999996e-06 2020-11-16T20:56:03.988 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.988 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.989 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:03.989 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933146+0000", 2020-11-16T20:56:03.989 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9820000000000003e-06 2020-11-16T20:56:03.989 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.989 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.989 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:03.989 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933156+0000", 2020-11-16T20:56:03.990 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5419999999999999e-06 2020-11-16T20:56:03.990 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.990 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.990 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:03.990 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933160+0000", 2020-11-16T20:56:03.990 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1328000000000002e-05 2020-11-16T20:56:03.990 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.990 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.991 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:03.991 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933192+0000", 2020-11-16T20:56:03.991 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3809000000000001e-05 2020-11-16T20:56:03.991 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.991 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.991 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:03.991 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933225+0000", 2020-11-16T20:56:03.992 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010974360000000001 2020-11-16T20:56:03.992 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.992 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.992 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:03.992 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.944200+0000", 2020-11-16T20:56:03.992 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0456000000000003e-05 2020-11-16T20:56:03.992 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.992 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.993 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:03.993 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.944290+0000", 2020-11-16T20:56:03.993 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012946999999999999 2020-11-16T20:56:03.993 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.993 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.993 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:03.993 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.944420+0000", 2020-11-16T20:56:03.994 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0015868869999999999 2020-11-16T20:56:03.994 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.994 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.994 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:03.994 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.946007+0000", 2020-11-16T20:56:03.994 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030165180000000002 2020-11-16T20:56:03.994 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.994 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.995 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:03.995 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.949023+0000", 2020-11-16T20:56:03.995 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00091041899999999999 2020-11-16T20:56:03.995 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.995 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.995 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:03.995 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.949933+0000", 2020-11-16T20:56:03.996 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3227999999999998e-05 2020-11-16T20:56:03.996 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.996 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.996 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:03.996 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.949997+0000", 2020-11-16T20:56:03.996 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6902e-05 2020-11-16T20:56:03.996 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.996 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.997 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:03.997 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.950034+0000", 2020-11-16T20:56:03.997 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017104389000000001 2020-11-16T20:56:03.997 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:03.997 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:03.997 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:03.997 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.998 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.998 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:11 4.2 4:5ad6a7de:::smithi16641208-3:head [setxattr _header (55) in=7b,truncate 2033614] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:56:03.998 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:50.933183+0000", 2020-11-16T20:56:03.998 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 13.043420252000001, 2020-11-16T20:56:03.998 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017012756, 2020-11-16T20:56:03.998 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:03.998 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:03.998 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:03.999 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:03.999 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:03.999 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 11 2020-11-16T20:56:03.999 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:03.999 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:03.999 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:03.999 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.000 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933183+0000", 2020-11-16T20:56:04.000 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.000 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.000 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.000 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.000 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933183+0000", 2020-11-16T20:56:04.000 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4416000000000001e-05 2020-11-16T20:56:04.000 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.001 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.001 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.001 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933207+0000", 2020-11-16T20:56:04.001 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2729999999999998e-06 2020-11-16T20:56:04.001 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.001 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.001 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.002 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933211+0000", 2020-11-16T20:56:04.002 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5659999999999997e-06 2020-11-16T20:56:04.002 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.002 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.002 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.002 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933216+0000", 2020-11-16T20:56:04.002 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8080000000000001e-06 2020-11-16T20:56:04.002 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.003 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.003 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.003 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933219+0000", 2020-11-16T20:56:04.003 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0898999999999997e-05 2020-11-16T20:56:04.003 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.003 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.003 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.004 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933250+0000", 2020-11-16T20:56:04.004 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6498000000000002e-05 2020-11-16T20:56:04.004 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.004 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.004 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:04.004 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933286+0000", 2020-11-16T20:56:04.004 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011919791000000001 2020-11-16T20:56:04.005 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.005 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.005 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.005 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945206+0000", 2020-11-16T20:56:04.005 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015679499999999999 2020-11-16T20:56:04.005 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.005 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.005 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.006 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945363+0000", 2020-11-16T20:56:04.006 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016523899999999999 2020-11-16T20:56:04.006 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.006 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.006 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:04.006 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945528+0000", 2020-11-16T20:56:04.006 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00067981699999999999 2020-11-16T20:56:04.007 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.007 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.007 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:04.007 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.946208+0000", 2020-11-16T20:56:04.007 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028874249999999999 2020-11-16T20:56:04.007 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.007 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.007 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:04.008 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.949095+0000", 2020-11-16T20:56:04.008 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00097101200000000005 2020-11-16T20:56:04.008 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.008 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.008 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:04.008 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.950066+0000", 2020-11-16T20:56:04.008 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3769000000000006e-05 2020-11-16T20:56:04.009 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.009 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.009 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.009 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.950130+0000", 2020-11-16T20:56:04.009 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5448000000000001e-05 2020-11-16T20:56:04.009 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.009 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.009 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.010 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.950196+0000", 2020-11-16T20:56:04.010 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017012756 2020-11-16T20:56:04.010 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.010 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.010 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.010 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.010 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.011 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:12 4.2 4:5ad6a7de:::smithi16641208-3:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:56:04.011 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:50.933238+0000", 2020-11-16T20:56:04.011 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 13.043364873, 2020-11-16T20:56:04.011 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01743347, 2020-11-16T20:56:04.011 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.011 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:04.011 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:04.011 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:04.012 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:04.012 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 12 2020-11-16T20:56:04.012 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.012 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.012 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.012 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.012 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933238+0000", 2020-11-16T20:56:04.013 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.013 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.013 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.013 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.013 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933238+0000", 2020-11-16T20:56:04.013 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5231999999999999e-05 2020-11-16T20:56:04.013 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.013 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.014 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.014 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933253+0000", 2020-11-16T20:56:04.014 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1020000000000001e-06 2020-11-16T20:56:04.014 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.014 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.014 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.014 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933257+0000", 2020-11-16T20:56:04.015 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9179999999999999e-06 2020-11-16T20:56:04.015 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.015 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.015 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.015 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933262+0000", 2020-11-16T20:56:04.015 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3999999999999999e-06 2020-11-16T20:56:04.015 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.015 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.016 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.016 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933265+0000", 2020-11-16T20:56:04.016 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5132000000000002e-05 2020-11-16T20:56:04.016 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.016 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.016 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933300+0000", 2020-11-16T20:56:04.016 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7764999999999999e-05 2020-11-16T20:56:04.017 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.017 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.017 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:04.017 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.933328+0000", 2020-11-16T20:56:04.017 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012567474 2020-11-16T20:56:04.017 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.017 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.018 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.018 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945895+0000", 2020-11-16T20:56:04.018 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3967000000000003e-05 2020-11-16T20:56:04.018 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.018 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.018 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:04.018 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.945989+0000", 2020-11-16T20:56:04.019 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042421170000000001 2020-11-16T20:56:04.019 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.019 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.019 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.019 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.950231+0000", 2020-11-16T20:56:04.019 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000126468 2020-11-16T20:56:04.019 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.019 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.020 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.020 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.950358+0000", 2020-11-16T20:56:04.020 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00031389500000000002 2020-11-16T20:56:04.020 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.020 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.020 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.020 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.950672+0000", 2020-11-16T20:56:04.020 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01743347 2020-11-16T20:56:04.021 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.021 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.021 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.021 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.021 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.021 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:56 4.2 4:4d074942:::smithi16641208-14:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:56:04.021 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.068419+0000", 2020-11-16T20:56:04.022 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 12.90818432, 2020-11-16T20:56:04.022 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015157009000000001, 2020-11-16T20:56:04.022 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.022 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:04.022 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:04.022 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:04.022 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:04.023 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 56 2020-11-16T20:56:04.023 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.023 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.023 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.023 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.023 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068419+0000", 2020-11-16T20:56:04.023 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.023 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.024 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.024 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.024 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068419+0000", 2020-11-16T20:56:04.024 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8451e-05 2020-11-16T20:56:04.024 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.024 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.024 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.025 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068437+0000", 2020-11-16T20:56:04.025 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2359999999999998e-06 2020-11-16T20:56:04.025 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.025 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.025 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.025 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068441+0000", 2020-11-16T20:56:04.025 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3419999999999996e-06 2020-11-16T20:56:04.025 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.026 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.026 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.026 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068448+0000", 2020-11-16T20:56:04.026 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7240000000000001e-06 2020-11-16T20:56:04.026 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.026 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.026 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.027 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068450+0000", 2020-11-16T20:56:04.027 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0448000000000001e-05 2020-11-16T20:56:04.027 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.027 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.027 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.027 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068511+0000", 2020-11-16T20:56:04.027 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4044000000000001e-05 2020-11-16T20:56:04.028 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.028 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.028 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:04.028 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.068545+0000", 2020-11-16T20:56:04.028 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010468658 2020-11-16T20:56:04.028 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.028 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.028 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.029 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.079014+0000", 2020-11-16T20:56:04.029 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000210347 2020-11-16T20:56:04.029 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.029 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.029 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:04.029 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.079224+0000", 2020-11-16T20:56:04.029 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003594767 2020-11-16T20:56:04.030 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.030 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.030 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.030 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.082819+0000", 2020-11-16T20:56:04.030 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.1457000000000003e-05 2020-11-16T20:56:04.030 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.030 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.030 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.031 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.082900+0000", 2020-11-16T20:56:04.031 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000675535 2020-11-16T20:56:04.031 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.031 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.031 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.031 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.083576+0000", 2020-11-16T20:56:04.031 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015157009000000001 2020-11-16T20:56:04.032 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.032 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.032 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.032 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.032 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.032 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:76 4.2 4:745e23d0:::smithi16641208-19:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:56:04.032 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.133665+0000", 2020-11-16T20:56:04.032 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 12.842937611, 2020-11-16T20:56:04.033 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015245811, 2020-11-16T20:56:04.033 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.033 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:04.033 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:04.033 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:04.033 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:04.033 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 76 2020-11-16T20:56:04.034 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.034 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.034 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.034 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.034 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133665+0000", 2020-11-16T20:56:04.034 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.034 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.034 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.035 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.035 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133665+0000", 2020-11-16T20:56:04.035 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5531000000000001e-05 2020-11-16T20:56:04.035 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.035 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.035 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.035 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133681+0000", 2020-11-16T20:56:04.036 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.926e-06 2020-11-16T20:56:04.036 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.036 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.036 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.036 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133684+0000", 2020-11-16T20:56:04.036 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.772e-06 2020-11-16T20:56:04.036 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.036 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.037 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.037 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133690+0000", 2020-11-16T20:56:04.037 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.441e-06 2020-11-16T20:56:04.037 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.037 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.037 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.037 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133692+0000", 2020-11-16T20:56:04.038 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000110321 2020-11-16T20:56:04.038 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.038 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.038 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.038 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133802+0000", 2020-11-16T20:56:04.038 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6947000000000003e-05 2020-11-16T20:56:04.038 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.038 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.039 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:04.039 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.133849+0000", 2020-11-16T20:56:04.039 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0060542399999999998 2020-11-16T20:56:04.039 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.039 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.039 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.039 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.139904+0000", 2020-11-16T20:56:04.040 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9409e-05 2020-11-16T20:56:04.040 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.040 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.040 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:04.040 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.139963+0000", 2020-11-16T20:56:04.040 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0086500080000000007 2020-11-16T20:56:04.040 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.040 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.041 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.041 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.148613+0000", 2020-11-16T20:56:04.041 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2390000000000001e-05 2020-11-16T20:56:04.041 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.041 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.041 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.041 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.148705+0000", 2020-11-16T20:56:04.041 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020582599999999999 2020-11-16T20:56:04.042 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.042 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.042 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.042 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.148911+0000", 2020-11-16T20:56:04.042 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015245811 2020-11-16T20:56:04.042 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.042 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.043 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.043 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.043 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.043 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:937 4.2 4:5723fd94:::smithi16641208-211:head [write 2900946~403005] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:04.043 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.268086+0000", 2020-11-16T20:56:04.043 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.7085170099999996, 2020-11-16T20:56:04.043 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015304722999999999, 2020-11-16T20:56:04.044 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.044 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.044 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:04.044 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:04.044 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:04.044 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 937 2020-11-16T20:56:04.044 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.044 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.045 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.045 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.045 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.268086+0000", 2020-11-16T20:56:04.045 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.045 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.045 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.045 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.045 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.268086+0000", 2020-11-16T20:56:04.046 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000138524 2020-11-16T20:56:04.046 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.046 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.046 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.046 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.268225+0000", 2020-11-16T20:56:04.046 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9449999999999993e-06 2020-11-16T20:56:04.046 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.047 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.047 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.047 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.268233+0000", 2020-11-16T20:56:04.047 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2292e-05 2020-11-16T20:56:04.047 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.047 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.047 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.047 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.268245+0000", 2020-11-16T20:56:04.048 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2860000000000002e-06 2020-11-16T20:56:04.048 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.048 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.048 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.048 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.268252+0000", 2020-11-16T20:56:04.048 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8924e-05 2020-11-16T20:56:04.048 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.049 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.049 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.049 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.268311+0000", 2020-11-16T20:56:04.049 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7959000000000004e-05 2020-11-16T20:56:04.049 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.049 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.049 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:04.049 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.268379+0000", 2020-11-16T20:56:04.050 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0031485480000000001 2020-11-16T20:56:04.050 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.050 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.050 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.050 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.271528+0000", 2020-11-16T20:56:04.050 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000131011 2020-11-16T20:56:04.050 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.051 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.051 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.051 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.271659+0000", 2020-11-16T20:56:04.051 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000171464 2020-11-16T20:56:04.051 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.051 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.051 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:04.052 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.271830+0000", 2020-11-16T20:56:04.052 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0013933490000000001 2020-11-16T20:56:04.052 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.052 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.052 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:04.052 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.273223+0000", 2020-11-16T20:56:04.052 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0097359460000000005 2020-11-16T20:56:04.052 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.053 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.053 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:04.053 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.282959+0000", 2020-11-16T20:56:04.053 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000299265 2020-11-16T20:56:04.053 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.053 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.053 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:04.054 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.283259+0000", 2020-11-16T20:56:04.054 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6260999999999994e-05 2020-11-16T20:56:04.054 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.054 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.054 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.054 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.283335+0000", 2020-11-16T20:56:04.054 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5949000000000003e-05 2020-11-16T20:56:04.054 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.055 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.055 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.055 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.283391+0000", 2020-11-16T20:56:04.055 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015304722999999999 2020-11-16T20:56:04.055 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.055 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.055 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.056 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.056 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.056 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:938 4.2 4:5723fd94:::smithi16641208-211:head [setxattr _header (57) in=7b,truncate 3529470] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:04.056 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.268290+0000", 2020-11-16T20:56:04.056 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.7083132180000007, 2020-11-16T20:56:04.056 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015283947000000001, 2020-11-16T20:56:04.056 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.056 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.057 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:04.057 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:04.057 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:04.057 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 938 2020-11-16T20:56:04.057 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.057 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.057 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.057 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.058 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.268290+0000", 2020-11-16T20:56:04.058 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.058 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.058 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.058 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.058 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.268290+0000", 2020-11-16T20:56:04.058 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2409e-05 2020-11-16T20:56:04.059 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.059 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.059 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.059 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.268332+0000", 2020-11-16T20:56:04.059 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1499999999999998e-06 2020-11-16T20:56:04.059 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.059 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.060 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.060 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.268337+0000", 2020-11-16T20:56:04.060 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1859999999999998e-06 2020-11-16T20:56:04.060 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.060 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.060 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.060 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.268347+0000", 2020-11-16T20:56:04.060 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.155e-06 2020-11-16T20:56:04.061 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.061 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.061 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.061 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.268351+0000", 2020-11-16T20:56:04.061 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3176e-05 2020-11-16T20:56:04.061 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.061 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.061 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.062 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.268404+0000", 2020-11-16T20:56:04.062 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4546999999999998e-05 2020-11-16T20:56:04.062 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.062 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.062 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:04.062 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.268458+0000", 2020-11-16T20:56:04.062 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041377690000000003 2020-11-16T20:56:04.063 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.063 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.063 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.063 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.272596+0000", 2020-11-16T20:56:04.063 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8993000000000007e-05 2020-11-16T20:56:04.063 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.063 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.063 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.064 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.272685+0000", 2020-11-16T20:56:04.064 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000149443 2020-11-16T20:56:04.064 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.064 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.064 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:04.064 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.272835+0000", 2020-11-16T20:56:04.064 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000542527 2020-11-16T20:56:04.065 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:04.065 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.273377+0000", 2020-11-16T20:56:04.065 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0096673939999999993 2020-11-16T20:56:04.065 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:04.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.283045+0000", 2020-11-16T20:56:04.066 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00039733800000000001 2020-11-16T20:56:04.066 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.066 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.066 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:04.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.283442+0000", 2020-11-16T20:56:04.066 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4388999999999996e-05 2020-11-16T20:56:04.067 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.067 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.067 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.067 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.283506+0000", 2020-11-16T20:56:04.067 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7471000000000005e-05 2020-11-16T20:56:04.067 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.067 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.067 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.068 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.283574+0000", 2020-11-16T20:56:04.068 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015283947000000001 2020-11-16T20:56:04.068 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.068 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.068 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.068 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.068 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.069 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:939 4.2 4:5723fd94:::smithi16641208-211:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:56:04.069 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.268380+0000", 2020-11-16T20:56:04.069 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.7082229019999993, 2020-11-16T20:56:04.069 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015607895, 2020-11-16T20:56:04.069 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.069 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:04.069 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:04.069 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:04.070 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:04.070 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 939 2020-11-16T20:56:04.070 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.070 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.070 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.070 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.070 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.268380+0000", 2020-11-16T20:56:04.071 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.071 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.071 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.071 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.071 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.268380+0000", 2020-11-16T20:56:04.071 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6897999999999999e-05 2020-11-16T20:56:04.071 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.071 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.072 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.072 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.268407+0000", 2020-11-16T20:56:04.072 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6120000000000001e-06 2020-11-16T20:56:04.072 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.072 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.072 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.072 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.268412+0000", 2020-11-16T20:56:04.072 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0310000000000004e-06 2020-11-16T20:56:04.073 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.073 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.073 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.073 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.268421+0000", 2020-11-16T20:56:04.073 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.608e-06 2020-11-16T20:56:04.073 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.073 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.074 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.074 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.268424+0000", 2020-11-16T20:56:04.074 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2255999999999995e-05 2020-11-16T20:56:04.074 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.074 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.074 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.074 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.268487+0000", 2020-11-16T20:56:04.074 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9134e-05 2020-11-16T20:56:04.075 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.075 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.075 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:04.075 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.268546+0000", 2020-11-16T20:56:04.075 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0045569460000000001 2020-11-16T20:56:04.075 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.075 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.076 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.076 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.273103+0000", 2020-11-16T20:56:04.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000102515 2020-11-16T20:56:04.076 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.076 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.076 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:04.076 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.273205+0000", 2020-11-16T20:56:04.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010396849999999999 2020-11-16T20:56:04.077 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.077 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.077 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.077 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.283602+0000", 2020-11-16T20:56:04.077 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114257 2020-11-16T20:56:04.077 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.077 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.078 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.078 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.283716+0000", 2020-11-16T20:56:04.078 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00027178800000000002 2020-11-16T20:56:04.078 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.078 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.078 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.078 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.283988+0000", 2020-11-16T20:56:04.078 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015607895 2020-11-16T20:56:04.079 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.079 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.079 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.079 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.079 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.079 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1115 4.2 4:5a2aa7df:::smithi16641208-248:head [setxattr _header (57) in=7b,truncate 2151329] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:04.079 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.954978+0000", 2020-11-16T20:56:04.080 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.0216255089999997, 2020-11-16T20:56:04.080 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023396486000000001, 2020-11-16T20:56:04.080 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.080 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.080 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:04.080 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:04.080 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:04.080 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1115 2020-11-16T20:56:04.081 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.081 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.081 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.081 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.081 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.954978+0000", 2020-11-16T20:56:04.081 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.081 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.082 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.082 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.082 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.954978+0000", 2020-11-16T20:56:04.082 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2381000000000001e-05 2020-11-16T20:56:04.082 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.082 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.082 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.082 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955000+0000", 2020-11-16T20:56:04.083 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3979999999999999e-06 2020-11-16T20:56:04.083 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.083 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.083 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.083 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955003+0000", 2020-11-16T20:56:04.083 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1510000000000001e-06 2020-11-16T20:56:04.083 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.084 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.084 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.084 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955009+0000", 2020-11-16T20:56:04.084 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6690000000000002e-06 2020-11-16T20:56:04.084 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.084 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.084 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.084 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955012+0000", 2020-11-16T20:56:04.085 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000317423 2020-11-16T20:56:04.085 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.085 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.085 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.085 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955330+0000", 2020-11-16T20:56:04.085 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3217000000000002e-05 2020-11-16T20:56:04.085 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.085 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.086 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:04.086 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955383+0000", 2020-11-16T20:56:04.086 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011320966 2020-11-16T20:56:04.086 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.086 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.086 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.086 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.966704+0000", 2020-11-16T20:56:04.087 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015513500000000001 2020-11-16T20:56:04.087 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.087 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.087 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.087 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.966859+0000", 2020-11-16T20:56:04.087 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018944 2020-11-16T20:56:04.087 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.087 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.088 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:04.088 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.967048+0000", 2020-11-16T20:56:04.088 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0062409930000000002 2020-11-16T20:56:04.088 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.088 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.088 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:04.088 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.973289+0000", 2020-11-16T20:56:04.089 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0049529889999999997 2020-11-16T20:56:04.089 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.089 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.089 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:04.089 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978242+0000", 2020-11-16T20:56:04.089 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1761999999999999e-05 2020-11-16T20:56:04.089 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.089 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.090 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:04.090 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978264+0000", 2020-11-16T20:56:04.090 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9797999999999999e-05 2020-11-16T20:56:04.090 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.090 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.090 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.090 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978324+0000", 2020-11-16T20:56:04.091 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0164000000000003e-05 2020-11-16T20:56:04.091 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.091 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.091 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.091 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978374+0000", 2020-11-16T20:56:04.091 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023396486000000001 2020-11-16T20:56:04.091 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.091 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.092 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.092 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.092 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.092 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1116 4.2 4:5a2aa7df:::smithi16641208-248:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:56:04.092 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.955031+0000", 2020-11-16T20:56:04.092 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.0215721890000005, 2020-11-16T20:56:04.092 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023838986999999999, 2020-11-16T20:56:04.093 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.093 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:04.093 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:04.093 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:04.093 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:04.093 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1116 2020-11-16T20:56:04.093 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.093 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.094 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.094 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.094 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955031+0000", 2020-11-16T20:56:04.094 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.094 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.094 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.095 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.095 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955031+0000", 2020-11-16T20:56:04.095 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5029e-05 2020-11-16T20:56:04.095 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.095 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.095 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.095 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955046+0000", 2020-11-16T20:56:04.095 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8770000000000002e-06 2020-11-16T20:56:04.096 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.096 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.096 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.096 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955049+0000", 2020-11-16T20:56:04.096 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7219999999999996e-06 2020-11-16T20:56:04.096 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.096 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.096 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.097 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955055+0000", 2020-11-16T20:56:04.097 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4109999999999999e-06 2020-11-16T20:56:04.097 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.097 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.097 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.097 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955057+0000", 2020-11-16T20:56:04.097 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00035397299999999999 2020-11-16T20:56:04.098 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.098 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.098 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.098 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955411+0000", 2020-11-16T20:56:04.098 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4848000000000001e-05 2020-11-16T20:56:04.098 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.098 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.098 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:04.099 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955466+0000", 2020-11-16T20:56:04.099 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012080844 2020-11-16T20:56:04.099 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.099 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.099 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.099 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.967547+0000", 2020-11-16T20:56:04.099 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015558100000000001 2020-11-16T20:56:04.100 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.100 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.100 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:04.100 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.967702+0000", 2020-11-16T20:56:04.100 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010726072999999999 2020-11-16T20:56:04.100 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.100 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.100 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.101 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978428+0000", 2020-11-16T20:56:04.101 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013814900000000001 2020-11-16T20:56:04.101 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.101 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.101 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.101 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978566+0000", 2020-11-16T20:56:04.101 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030348000000000001 2020-11-16T20:56:04.102 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.102 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.102 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.102 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978870+0000", 2020-11-16T20:56:04.102 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023838986999999999 2020-11-16T20:56:04.102 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.102 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.102 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.103 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.103 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.103 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1121 4.2 4:7ef90409:::smithi16641208-250:head [write 584943~460297,stat] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:04.103 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.974149+0000", 2020-11-16T20:56:04.103 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.0024539049999994, 2020-11-16T20:56:04.103 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025650249999999999, 2020-11-16T20:56:04.103 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.104 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.104 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:04.104 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:04.104 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:04.104 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1121 2020-11-16T20:56:04.104 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.104 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.104 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.105 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.105 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.974149+0000", 2020-11-16T20:56:04.105 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.105 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.105 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.105 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.105 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.974149+0000", 2020-11-16T20:56:04.106 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000117531 2020-11-16T20:56:04.106 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.106 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.106 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.106 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.974267+0000", 2020-11-16T20:56:04.106 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.618e-06 2020-11-16T20:56:04.106 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.106 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.107 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.107 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.974273+0000", 2020-11-16T20:56:04.107 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.343e-05 2020-11-16T20:56:04.107 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.107 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.107 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.107 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.974287+0000", 2020-11-16T20:56:04.107 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8980000000000001e-06 2020-11-16T20:56:04.108 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.108 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.108 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.108 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.974293+0000", 2020-11-16T20:56:04.108 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0046077069999999999 2020-11-16T20:56:04.108 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.108 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.109 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.109 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978900+0000", 2020-11-16T20:56:04.109 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020897138999999999 2020-11-16T20:56:04.109 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.109 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.109 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.109 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.999797+0000", 2020-11-16T20:56:04.109 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9269999999999999e-06 2020-11-16T20:56:04.110 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.110 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.110 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.110 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.999799+0000", 2020-11-16T20:56:04.110 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025650249999999999 2020-11-16T20:56:04.110 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.110 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.111 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.111 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.111 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.111 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1122 4.2 4:7ef90409:::smithi16641208-250:head [write 1587781~597162] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:04.111 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.982754+0000", 2020-11-16T20:56:04.111 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.9938494680000005, 2020-11-16T20:56:04.111 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020140918000000001, 2020-11-16T20:56:04.111 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.112 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.112 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:04.112 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:04.112 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:04.112 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1122 2020-11-16T20:56:04.112 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.112 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.112 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.113 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.982754+0000", 2020-11-16T20:56:04.113 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.113 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.113 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.113 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.982754+0000", 2020-11-16T20:56:04.114 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019379 2020-11-16T20:56:04.114 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.114 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.114 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.114 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.982947+0000", 2020-11-16T20:56:04.114 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2900000000000008e-06 2020-11-16T20:56:04.114 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.114 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.115 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.115 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.982957+0000", 2020-11-16T20:56:04.115 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6120000000000002e-05 2020-11-16T20:56:04.115 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.115 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.115 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.115 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.982973+0000", 2020-11-16T20:56:04.116 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.5219999999999996e-06 2020-11-16T20:56:04.116 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.116 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.116 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.116 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.982982+0000", 2020-11-16T20:56:04.116 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5333e-05 2020-11-16T20:56:04.116 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.116 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.117 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.117 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983038+0000", 2020-11-16T20:56:04.117 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019854133999999999 2020-11-16T20:56:04.117 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.117 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.117 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.117 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002892+0000", 2020-11-16T20:56:04.117 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.729e-06 2020-11-16T20:56:04.118 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.118 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.118 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.118 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002895+0000", 2020-11-16T20:56:04.118 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020140918000000001 2020-11-16T20:56:04.118 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.118 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.119 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.119 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.119 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.119 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1123 4.2 4:7ef90409:::smithi16641208-250:head [setxattr _header (57) in=7b,truncate 2184943] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:04.119 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.983026+0000", 2020-11-16T20:56:04.119 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.9935767539999993, 2020-11-16T20:56:04.119 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020255397000000001, 2020-11-16T20:56:04.119 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.120 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.120 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:04.120 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:04.120 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:04.120 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1123 2020-11-16T20:56:04.120 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.120 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.121 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.121 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.121 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983026+0000", 2020-11-16T20:56:04.121 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.121 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.121 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.121 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.121 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983026+0000", 2020-11-16T20:56:04.122 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9609e-05 2020-11-16T20:56:04.122 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.122 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.122 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.122 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983066+0000", 2020-11-16T20:56:04.122 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0859999999999998e-06 2020-11-16T20:56:04.122 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.123 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.123 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.123 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983072+0000", 2020-11-16T20:56:04.123 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00043611499999999999 2020-11-16T20:56:04.123 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.123 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.123 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.123 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983508+0000", 2020-11-16T20:56:04.124 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4060000000000005e-06 2020-11-16T20:56:04.124 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.124 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.124 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.124 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983517+0000", 2020-11-16T20:56:04.124 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9840999999999998e-05 2020-11-16T20:56:04.124 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.124 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.125 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.125 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983586+0000", 2020-11-16T20:56:04.125 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019692405 2020-11-16T20:56:04.125 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.125 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.125 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.125 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003279+0000", 2020-11-16T20:56:04.126 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9349999999999999e-06 2020-11-16T20:56:04.126 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.126 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.126 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.126 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003282+0000", 2020-11-16T20:56:04.126 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020255397000000001 2020-11-16T20:56:04.126 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.126 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.127 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.127 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.127 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.131 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1124 4.2 4:7ef90409:::smithi16641208-250:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:56:04.131 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.983558+0000", 2020-11-16T20:56:04.131 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.9930445670000001, 2020-11-16T20:56:04.131 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019806648999999999, 2020-11-16T20:56:04.131 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.132 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:56:04.132 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:04.132 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:04.132 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:04.132 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1124 2020-11-16T20:56:04.132 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.132 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.133 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.133 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.133 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983558+0000", 2020-11-16T20:56:04.133 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.133 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.133 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.133 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.133 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983558+0000", 2020-11-16T20:56:04.134 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4308999999999999e-05 2020-11-16T20:56:04.134 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.134 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.134 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.134 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983603+0000", 2020-11-16T20:56:04.134 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8070000000000006e-06 2020-11-16T20:56:04.134 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.135 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.135 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.135 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983612+0000", 2020-11-16T20:56:04.135 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8104000000000001e-05 2020-11-16T20:56:04.135 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.135 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.135 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.135 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983630+0000", 2020-11-16T20:56:04.136 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5259999999999999e-06 2020-11-16T20:56:04.136 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.136 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.136 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.136 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983636+0000", 2020-11-16T20:56:04.136 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020975 2020-11-16T20:56:04.136 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.136 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.137 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.137 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983846+0000", 2020-11-16T20:56:04.137 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019519153000000001 2020-11-16T20:56:04.137 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.137 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.137 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.137 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003365+0000", 2020-11-16T20:56:04.138 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019806648999999999 2020-11-16T20:56:04.138 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.138 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.138 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.138 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.138 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.138 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1406 4.2 4:6c6ed246:::smithi16641208-316:head [setxattr _header (57) in=7b,truncate 3294205] snapc 0=[] ondisk+write+known_if_redirected e36)", 2020-11-16T20:56:04.138 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.968144+0000", 2020-11-16T20:56:04.139 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.0084588100000005, 2020-11-16T20:56:04.139 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026933623, 2020-11-16T20:56:04.139 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.139 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.139 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:04.139 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:04.139 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:04.140 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1406 2020-11-16T20:56:04.140 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.140 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.140 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.140 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.140 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968144+0000", 2020-11-16T20:56:04.140 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.140 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.141 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.141 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.141 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968144+0000", 2020-11-16T20:56:04.141 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3442999999999999e-05 2020-11-16T20:56:04.141 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.141 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.141 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.142 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968168+0000", 2020-11-16T20:56:04.142 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3569999999999998e-06 2020-11-16T20:56:04.142 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.142 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.142 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.142 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968171+0000", 2020-11-16T20:56:04.142 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.728e-06 2020-11-16T20:56:04.142 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.143 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.143 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.143 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968177+0000", 2020-11-16T20:56:04.143 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.943e-06 2020-11-16T20:56:04.143 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.143 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.143 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.143 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968180+0000", 2020-11-16T20:56:04.144 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018267500000000001 2020-11-16T20:56:04.144 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.144 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.144 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.144 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968362+0000", 2020-11-16T20:56:04.144 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3270000000000003e-05 2020-11-16T20:56:04.144 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.145 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.145 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:04.145 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968416+0000", 2020-11-16T20:56:04.145 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011050572999999999 2020-11-16T20:56:04.145 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.145 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.145 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.145 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.979466+0000", 2020-11-16T20:56:04.146 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8349000000000005e-05 2020-11-16T20:56:04.146 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.146 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.146 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.146 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.979545+0000", 2020-11-16T20:56:04.146 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010998299999999999 2020-11-16T20:56:04.146 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.147 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.147 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:04.147 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.979655+0000", 2020-11-16T20:56:04.147 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00092610999999999995 2020-11-16T20:56:04.147 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.147 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.147 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:04.147 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.980581+0000", 2020-11-16T20:56:04.148 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0068293140000000004 2020-11-16T20:56:04.148 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.148 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.148 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:04.148 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.987410+0000", 2020-11-16T20:56:04.148 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0075214959999999999 2020-11-16T20:56:04.148 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.148 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.149 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:04.149 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.994931+0000", 2020-11-16T20:56:04.149 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5657e-05 2020-11-16T20:56:04.149 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.149 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.149 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.149 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.994977+0000", 2020-11-16T20:56:04.150 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000100725 2020-11-16T20:56:04.150 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.150 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.150 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.150 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.995078+0000", 2020-11-16T20:56:04.150 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026933623 2020-11-16T20:56:04.150 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.150 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.151 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.151 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.151 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.151 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1407 4.2 4:6c6ed246:::smithi16641208-316:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e36)", 2020-11-16T20:56:04.151 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.968204+0000", 2020-11-16T20:56:04.151 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.0083993820000003, 2020-11-16T20:56:04.151 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027229834000000001, 2020-11-16T20:56:04.152 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.152 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:04.152 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:04.152 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:04.152 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:04.152 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1407 2020-11-16T20:56:04.152 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.152 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.153 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.153 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.153 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968204+0000", 2020-11-16T20:56:04.153 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.153 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.153 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.153 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.153 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968204+0000", 2020-11-16T20:56:04.154 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6412000000000001e-05 2020-11-16T20:56:04.154 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.154 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.154 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.154 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968220+0000", 2020-11-16T20:56:04.154 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0060000000000001e-06 2020-11-16T20:56:04.154 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.155 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.155 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.155 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968223+0000", 2020-11-16T20:56:04.155 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7660000000000004e-06 2020-11-16T20:56:04.155 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.155 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.155 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.155 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968229+0000", 2020-11-16T20:56:04.156 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6979999999999998e-06 2020-11-16T20:56:04.156 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.156 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.156 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.156 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968232+0000", 2020-11-16T20:56:04.156 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000199786 2020-11-16T20:56:04.156 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.157 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.157 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.157 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968431+0000", 2020-11-16T20:56:04.157 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7841999999999999e-05 2020-11-16T20:56:04.157 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.157 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.157 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:04.158 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968459+0000", 2020-11-16T20:56:04.158 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011510038 2020-11-16T20:56:04.158 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.158 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.158 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.158 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.979969+0000", 2020-11-16T20:56:04.158 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7645000000000006e-05 2020-11-16T20:56:04.158 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.159 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.159 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:04.159 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.980047+0000", 2020-11-16T20:56:04.159 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015060982000000001 2020-11-16T20:56:04.159 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.159 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.159 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.160 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.995108+0000", 2020-11-16T20:56:04.160 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4376999999999997e-05 2020-11-16T20:56:04.160 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.160 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.160 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.160 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.995172+0000", 2020-11-16T20:56:04.160 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000261282 2020-11-16T20:56:04.160 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.161 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.161 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.161 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.995434+0000", 2020-11-16T20:56:04.161 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027229834000000001 2020-11-16T20:56:04.161 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.161 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.161 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.161 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.162 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.162 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1445 4.2 4:59c20b01:::smithi16641208-324:head [write 3403509~25152] snapc 0=[] ondisk+write+known_if_redirected e36)", 2020-11-16T20:56:04.162 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.121514+0000", 2020-11-16T20:56:04.162 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 7.8550893940000002, 2020-11-16T20:56:04.162 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019332254, 2020-11-16T20:56:04.162 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.162 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.163 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:04.163 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:04.163 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:04.163 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1445 2020-11-16T20:56:04.163 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.163 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.163 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.163 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.164 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121514+0000", 2020-11-16T20:56:04.164 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.164 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.164 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.164 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.164 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121514+0000", 2020-11-16T20:56:04.164 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1333e-05 2020-11-16T20:56:04.165 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.165 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.165 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.165 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121545+0000", 2020-11-16T20:56:04.165 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4959999999999998e-06 2020-11-16T20:56:04.165 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.165 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.165 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.166 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121549+0000", 2020-11-16T20:56:04.166 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.011e-06 2020-11-16T20:56:04.166 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.166 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.166 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.166 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121558+0000", 2020-11-16T20:56:04.166 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6809999999999997e-06 2020-11-16T20:56:04.166 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.167 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.167 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.167 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121562+0000", 2020-11-16T20:56:04.167 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5099999999999999e-05 2020-11-16T20:56:04.167 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.167 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.167 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.168 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121597+0000", 2020-11-16T20:56:04.168 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7240999999999998e-05 2020-11-16T20:56:04.168 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.168 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.168 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:04.168 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121635+0000", 2020-11-16T20:56:04.168 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0084021029999999993 2020-11-16T20:56:04.168 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.169 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.169 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.169 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.130037+0000", 2020-11-16T20:56:04.169 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000121814 2020-11-16T20:56:04.169 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.169 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.169 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.170 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.130158+0000", 2020-11-16T20:56:04.170 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014279200000000001 2020-11-16T20:56:04.170 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.170 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.170 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:04.170 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.130301+0000", 2020-11-16T20:56:04.170 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0022848970000000001 2020-11-16T20:56:04.170 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.171 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.171 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:04.171 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.132586+0000", 2020-11-16T20:56:04.171 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078745949999999999 2020-11-16T20:56:04.171 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.171 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.171 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:04.172 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.140461+0000", 2020-11-16T20:56:04.172 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00026870600000000001 2020-11-16T20:56:04.172 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.172 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.172 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:04.172 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.140729+0000", 2020-11-16T20:56:04.172 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7345e-05 2020-11-16T20:56:04.172 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.173 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.173 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.173 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.140797+0000", 2020-11-16T20:56:04.173 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.914e-05 2020-11-16T20:56:04.173 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.173 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.173 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.173 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.140846+0000", 2020-11-16T20:56:04.174 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019332254 2020-11-16T20:56:04.174 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.174 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.174 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.174 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.174 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.174 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1446 4.2 4:59c20b01:::smithi16641208-324:head [setxattr _header (57) in=7b,truncate 3428661] snapc 0=[] ondisk+write+known_if_redirected e36)", 2020-11-16T20:56:04.175 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.121586+0000", 2020-11-16T20:56:04.175 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 7.8550172869999999, 2020-11-16T20:56:04.175 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019371455999999999, 2020-11-16T20:56:04.175 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.175 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.175 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:04.175 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:04.175 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:04.176 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1446 2020-11-16T20:56:04.176 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.176 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.176 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.176 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.176 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121586+0000", 2020-11-16T20:56:04.176 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.177 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.177 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.177 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.177 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121586+0000", 2020-11-16T20:56:04.177 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3504000000000001e-05 2020-11-16T20:56:04.177 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.177 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.177 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.178 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121609+0000", 2020-11-16T20:56:04.178 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2349999999999999e-06 2020-11-16T20:56:04.178 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.178 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.178 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.178 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121613+0000", 2020-11-16T20:56:04.178 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0730000000000001e-06 2020-11-16T20:56:04.179 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.179 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.179 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.179 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121619+0000", 2020-11-16T20:56:04.179 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.638e-06 2020-11-16T20:56:04.179 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.179 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.179 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.180 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121621+0000", 2020-11-16T20:56:04.180 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4952e-05 2020-11-16T20:56:04.180 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.180 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.180 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.180 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121656+0000", 2020-11-16T20:56:04.180 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4751e-05 2020-11-16T20:56:04.180 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.181 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.181 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:04.181 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121691+0000", 2020-11-16T20:56:04.181 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092352010000000002 2020-11-16T20:56:04.181 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.181 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.181 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.182 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.130926+0000", 2020-11-16T20:56:04.182 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012516799999999999 2020-11-16T20:56:04.182 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.182 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.182 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.182 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.131051+0000", 2020-11-16T20:56:04.182 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013914099999999999 2020-11-16T20:56:04.182 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.183 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.183 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:04.183 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.131190+0000", 2020-11-16T20:56:04.183 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0015892619999999999 2020-11-16T20:56:04.183 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.183 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.183 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:04.184 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.132780+0000", 2020-11-16T20:56:04.184 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0077578769999999998 2020-11-16T20:56:04.184 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.184 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.184 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:04.184 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.140538+0000", 2020-11-16T20:56:04.184 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034462300000000001 2020-11-16T20:56:04.184 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.185 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.185 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:04.185 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.140882+0000", 2020-11-16T20:56:04.185 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9279000000000001e-05 2020-11-16T20:56:04.185 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.185 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.185 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.186 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.140921+0000", 2020-11-16T20:56:04.186 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5751999999999999e-05 2020-11-16T20:56:04.186 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.186 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.186 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.186 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.140957+0000", 2020-11-16T20:56:04.186 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019371455999999999 2020-11-16T20:56:04.186 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.187 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.187 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.187 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.187 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.187 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1447 4.2 4:59c20b01:::smithi16641208-324:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e36)", 2020-11-16T20:56:04.187 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.121644+0000", 2020-11-16T20:56:04.187 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 7.8549593629999999, 2020-11-16T20:56:04.188 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019680626, 2020-11-16T20:56:04.188 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.188 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:04.188 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:04.188 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:04.188 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:04.188 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1447 2020-11-16T20:56:04.188 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.189 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.189 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.189 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.189 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121644+0000", 2020-11-16T20:56:04.189 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.189 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.189 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.190 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.190 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121644+0000", 2020-11-16T20:56:04.190 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5140000000000001e-05 2020-11-16T20:56:04.190 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.190 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.190 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.190 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121659+0000", 2020-11-16T20:56:04.190 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3369999999999996e-06 2020-11-16T20:56:04.191 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.191 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.191 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.191 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121665+0000", 2020-11-16T20:56:04.191 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6899999999999997e-06 2020-11-16T20:56:04.191 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.191 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.191 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.192 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121671+0000", 2020-11-16T20:56:04.192 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.418e-06 2020-11-16T20:56:04.192 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.192 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.192 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.192 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121673+0000", 2020-11-16T20:56:04.192 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1782000000000002e-05 2020-11-16T20:56:04.193 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.193 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.193 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.193 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121705+0000", 2020-11-16T20:56:04.193 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3116e-05 2020-11-16T20:56:04.193 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.193 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.193 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:04.194 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121728+0000", 2020-11-16T20:56:04.194 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0097798739999999992 2020-11-16T20:56:04.194 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.194 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.194 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.194 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.131508+0000", 2020-11-16T20:56:04.194 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011847500000000001 2020-11-16T20:56:04.194 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.195 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.195 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:04.195 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.131627+0000", 2020-11-16T20:56:04.195 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.009370817 2020-11-16T20:56:04.195 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.195 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.195 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.196 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.140997+0000", 2020-11-16T20:56:04.196 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8214999999999996e-05 2020-11-16T20:56:04.196 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.196 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.196 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.196 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.141076+0000", 2020-11-16T20:56:04.196 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024876199999999997 2020-11-16T20:56:04.196 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.197 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.197 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.197 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.141324+0000", 2020-11-16T20:56:04.197 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019680626 2020-11-16T20:56:04.197 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.197 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.197 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.197 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.198 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.198 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:04.198 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2020-11-16T20:56:04.200 INFO:tasks.rados.rados.0.smithi166.stdout:541: done (0 left) 2020-11-16T20:56:04.201 INFO:tasks.rados.rados.0.smithi166.stdout:542: delete oid 135 current snap is 5 2020-11-16T20:56:04.201 INFO:tasks.rados.rados.0.smithi166.stdout:542: done (0 left) 2020-11-16T20:56:04.201 INFO:tasks.rados.rados.0.smithi166.stdout:543: read oid 344 snap 3 2020-11-16T20:56:04.201 INFO:tasks.rados.rados.0.smithi166.stdout:543: expect (ObjNum 343 snap 0 seq_num 343) 2020-11-16T20:56:04.201 INFO:tasks.rados.rados.0.smithi166.stdout:544: write (excl) oid 283 current snap is 5 2020-11-16T20:56:04.201 INFO:tasks.rados.rados.0.smithi166.stdout:544: seq_num 515 ranges {655605=548886,1653403=643178} 2020-11-16T20:56:04.201 INFO:tasks.rados.rados.0.smithi166.stdout:544: writing smithi16641208-283 from 655605 to 1204491 tid 1 2020-11-16T20:56:04.202 INFO:tasks.rados.rados.0.smithi166.stdout:544: writing smithi16641208-283 from 1653403 to 2296581 tid 2 2020-11-16T20:56:04.202 INFO:tasks.rados.rados.0.smithi166.stdout:545: delete oid 92 current snap is 5 2020-11-16T20:56:04.202 INFO:tasks.rados.rados.0.smithi166.stdout:543: expect (ObjNum 343 snap 0 seq_num 343) 2020-11-16T20:56:04.202 INFO:tasks.rados.rados.0.smithi166.stdout:544: finishing write tid 1 to smithi16641208-283 2020-11-16T20:56:04.202 INFO:tasks.rados.rados.0.smithi166.stdout:544: finishing write tid 2 to smithi16641208-283 2020-11-16T20:56:04.202 INFO:tasks.rados.rados.0.smithi166.stdout:544: finishing write tid 3 to smithi16641208-283 2020-11-16T20:56:04.202 INFO:tasks.rados.rados.0.smithi166.stdout:544: finishing write tid 4 to smithi16641208-283 2020-11-16T20:56:04.203 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 283 v 395 (ObjNum 515 snap 5 seq_num 515) dirty exists 2020-11-16T20:56:04.203 INFO:tasks.rados.rados.0.smithi166.stdout:544: left oid 283 (ObjNum 515 snap 5 seq_num 515) 2020-11-16T20:56:04.203 INFO:tasks.rados.rados.0.smithi166.stdout:543: done (2 left) 2020-11-16T20:56:04.203 INFO:tasks.rados.rados.0.smithi166.stdout:544: done (1 left) 2020-11-16T20:56:04.203 INFO:tasks.rados.rados.0.smithi166.stdout:545: done (0 left) 2020-11-16T20:56:04.203 INFO:tasks.rados.rados.0.smithi166.stdout:546: rollback oid 411 current snap is 5 2020-11-16T20:56:04.203 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 411 to 3 2020-11-16T20:56:04.204 INFO:tasks.rados.rados.0.smithi166.stdout:547: snap_create 2020-11-16T20:56:04.204 INFO:tasks.rados.rados.0.smithi166.stdout:546: finishing rollback tid 0 to smithi16641208-411 2020-11-16T20:56:04.204 INFO:tasks.rados.rados.0.smithi166.stdout:546: finishing rollback tid 1 to smithi16641208-411 2020-11-16T20:56:04.204 INFO:tasks.rados.rados.0.smithi166.stdout:546: finishing rollback tid 2 to smithi16641208-411 2020-11-16T20:56:04.204 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 411 v 399 (ObjNum 410 snap 0 seq_num 410) dirty exists 2020-11-16T20:56:04.204 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:56:04.205 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:04.204+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:04.300 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:04.305+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:04.372 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:04.373 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:04.373 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:56:04.373 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:04.383 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:56:04.426 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:04.431+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:04.503 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:04.508+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:04.511 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:04.512 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:04.512 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:56:04.512 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:56:04.512 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:04.521 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:56:04.604 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:04.608+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:04.688 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:04.689 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:56:04.689 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:56:04.689 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:56:04.689 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.689 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:170 3.0 e33/19 3:1e260d0e:::smithi16641208-43:head v 33'12, mlcod=33'10)", 2020-11-16T20:56:04.690 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.458057+0000", 2020-11-16T20:56:04.690 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 13.234347183000001, 2020-11-16T20:56:04.690 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040611839999999998, 2020-11-16T20:56:04.690 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.690 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.690 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.690 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.691 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.691 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458057+0000", 2020-11-16T20:56:04.691 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.691 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.691 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.691 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.691 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458057+0000", 2020-11-16T20:56:04.691 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000227333 2020-11-16T20:56:04.692 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.692 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.692 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.692 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458284+0000", 2020-11-16T20:56:04.692 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8389999999999996e-06 2020-11-16T20:56:04.692 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.692 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.693 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.693 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458293+0000", 2020-11-16T20:56:04.693 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9907999999999998e-05 2020-11-16T20:56:04.693 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.693 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.693 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.693 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458333+0000", 2020-11-16T20:56:04.694 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2132e-05 2020-11-16T20:56:04.694 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.694 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.694 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.694 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458345+0000", 2020-11-16T20:56:04.694 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0157000000000001e-05 2020-11-16T20:56:04.694 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.695 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.695 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.695 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458395+0000", 2020-11-16T20:56:04.695 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6659e-05 2020-11-16T20:56:04.695 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.695 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.695 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.695 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458422+0000", 2020-11-16T20:56:04.696 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0036338049999999999 2020-11-16T20:56:04.696 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.696 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.696 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.696 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.462056+0000", 2020-11-16T20:56:04.696 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2351e-05 2020-11-16T20:56:04.696 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.697 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.697 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.697 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.462118+0000", 2020-11-16T20:56:04.697 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040611839999999998 2020-11-16T20:56:04.697 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.697 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.697 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.697 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.698 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.698 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:890 3.0 e35/19 3:2209b6da:::smithi16641208-202:head v 35'131, mlcod=35'129)", 2020-11-16T20:56:04.698 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.078620+0000", 2020-11-16T20:56:04.698 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.613784138, 2020-11-16T20:56:04.698 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039687519999999999, 2020-11-16T20:56:04.698 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.698 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.699 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.699 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.699 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.699 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078620+0000", 2020-11-16T20:56:04.699 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.699 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.699 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.699 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.700 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078620+0000", 2020-11-16T20:56:04.700 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018733000000000001 2020-11-16T20:56:04.700 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.700 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.700 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.700 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078807+0000", 2020-11-16T20:56:04.700 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9799999999999993e-06 2020-11-16T20:56:04.701 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.701 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.701 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.701 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078817+0000", 2020-11-16T20:56:04.701 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5116000000000001e-05 2020-11-16T20:56:04.701 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.701 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.702 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.702 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078832+0000", 2020-11-16T20:56:04.702 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2634e-05 2020-11-16T20:56:04.702 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.702 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.702 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.702 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078845+0000", 2020-11-16T20:56:04.703 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1001999999999997e-05 2020-11-16T20:56:04.703 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.703 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.703 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.703 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078896+0000", 2020-11-16T20:56:04.703 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5238000000000001e-05 2020-11-16T20:56:04.703 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.703 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.704 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.704 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078921+0000", 2020-11-16T20:56:04.704 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035949210000000001 2020-11-16T20:56:04.704 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.704 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.704 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.704 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.082516+0000", 2020-11-16T20:56:04.705 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2531000000000001e-05 2020-11-16T20:56:04.705 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.705 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.705 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.705 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.082588+0000", 2020-11-16T20:56:04.705 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039687519999999999 2020-11-16T20:56:04.705 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.705 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.706 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.706 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.706 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.706 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:901 3.0 e35/19 3:29e07ad2:::smithi16641208-204:head v 35'134, mlcod=35'132)", 2020-11-16T20:56:04.706 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.128152+0000", 2020-11-16T20:56:04.706 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.564251925000001, 2020-11-16T20:56:04.706 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042710120000000002, 2020-11-16T20:56:04.707 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.707 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.707 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.707 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.707 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.707 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128152+0000", 2020-11-16T20:56:04.707 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.707 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.708 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.708 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.708 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128152+0000", 2020-11-16T20:56:04.708 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019783600000000001 2020-11-16T20:56:04.708 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.708 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.708 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.709 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128350+0000", 2020-11-16T20:56:04.709 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6030000000000005e-06 2020-11-16T20:56:04.709 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.709 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.709 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.709 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128358+0000", 2020-11-16T20:56:04.709 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2595999999999999e-05 2020-11-16T20:56:04.709 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.710 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.710 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.710 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128371+0000", 2020-11-16T20:56:04.710 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3209999999999999e-06 2020-11-16T20:56:04.710 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.710 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.710 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.711 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128378+0000", 2020-11-16T20:56:04.711 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4047e-05 2020-11-16T20:56:04.711 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.711 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.711 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.711 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128422+0000", 2020-11-16T20:56:04.711 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9796000000000001e-05 2020-11-16T20:56:04.711 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.712 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.712 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.712 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128452+0000", 2020-11-16T20:56:04.712 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039150929999999997 2020-11-16T20:56:04.712 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.712 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.712 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.712 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.132367+0000", 2020-11-16T20:56:04.713 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5720000000000002e-05 2020-11-16T20:56:04.713 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.713 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.713 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.713 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.132423+0000", 2020-11-16T20:56:04.713 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042710120000000002 2020-11-16T20:56:04.713 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.714 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.714 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.714 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.714 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.714 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:945 3.0 e35/19 3:0893b5ca:::smithi16641208-213:head v 35'145, mlcod=35'143)", 2020-11-16T20:56:04.714 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.298660+0000", 2020-11-16T20:56:04.714 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.393744361, 2020-11-16T20:56:04.714 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003872028, 2020-11-16T20:56:04.715 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.715 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.715 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.715 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.715 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.715 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298660+0000", 2020-11-16T20:56:04.715 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.716 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.716 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.716 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.716 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298660+0000", 2020-11-16T20:56:04.716 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000217042 2020-11-16T20:56:04.716 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.716 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.716 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.717 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298877+0000", 2020-11-16T20:56:04.717 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1629e-05 2020-11-16T20:56:04.717 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.717 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.717 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.717 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298888+0000", 2020-11-16T20:56:04.717 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7003999999999998e-05 2020-11-16T20:56:04.718 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.718 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.718 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.718 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298905+0000", 2020-11-16T20:56:04.718 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.5119999999999997e-06 2020-11-16T20:56:04.718 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.718 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.718 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.719 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298915+0000", 2020-11-16T20:56:04.719 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1298999999999997e-05 2020-11-16T20:56:04.719 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.719 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.719 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.719 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298976+0000", 2020-11-16T20:56:04.719 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1288000000000003e-05 2020-11-16T20:56:04.720 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.720 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.720 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.720 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.299007+0000", 2020-11-16T20:56:04.720 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0034819920000000002 2020-11-16T20:56:04.720 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.720 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.720 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.721 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.302489+0000", 2020-11-16T20:56:04.721 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2262000000000003e-05 2020-11-16T20:56:04.721 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.721 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.721 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.721 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.302532+0000", 2020-11-16T20:56:04.721 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003872028 2020-11-16T20:56:04.722 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.722 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.722 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.722 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.722 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.722 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1027 3.0 e35/19 3:2e3eb594:::smithi16641208-229:head v 35'158, mlcod=35'156)", 2020-11-16T20:56:04.722 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.628775+0000", 2020-11-16T20:56:04.723 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.063629058, 2020-11-16T20:56:04.723 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037889909999999998, 2020-11-16T20:56:04.723 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.723 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.723 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.723 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.723 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.723 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.628775+0000", 2020-11-16T20:56:04.724 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.724 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.724 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.724 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.724 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.628775+0000", 2020-11-16T20:56:04.724 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013695999999999999 2020-11-16T20:56:04.724 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.725 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.725 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.725 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.628912+0000", 2020-11-16T20:56:04.725 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3069999999999997e-06 2020-11-16T20:56:04.725 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.725 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.725 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.725 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.628919+0000", 2020-11-16T20:56:04.726 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3563e-05 2020-11-16T20:56:04.726 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.726 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.726 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.726 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.628933+0000", 2020-11-16T20:56:04.726 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1379999999999999e-05 2020-11-16T20:56:04.726 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.727 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.727 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.727 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.628944+0000", 2020-11-16T20:56:04.727 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5838000000000003e-05 2020-11-16T20:56:04.727 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.727 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.727 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.727 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.629000+0000", 2020-11-16T20:56:04.728 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7489000000000001e-05 2020-11-16T20:56:04.728 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.728 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.728 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.728 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.629027+0000", 2020-11-16T20:56:04.728 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0034656069999999999 2020-11-16T20:56:04.728 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.729 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.729 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.729 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.632493+0000", 2020-11-16T20:56:04.729 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0846999999999994e-05 2020-11-16T20:56:04.729 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.729 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.729 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.729 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.632564+0000", 2020-11-16T20:56:04.730 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037889909999999998 2020-11-16T20:56:04.730 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.730 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.730 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.730 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.730 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.730 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1028 3.0 e35/19 3:2e3eb594:::smithi16641208-229:head v 35'159, mlcod=35'157)", 2020-11-16T20:56:04.731 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.635550+0000", 2020-11-16T20:56:04.731 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.056853482999999, 2020-11-16T20:56:04.731 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042338380000000002, 2020-11-16T20:56:04.731 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.731 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.731 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.731 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.731 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.732 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635550+0000", 2020-11-16T20:56:04.732 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.732 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.732 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.732 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.732 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635550+0000", 2020-11-16T20:56:04.732 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018653699999999999 2020-11-16T20:56:04.733 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.733 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.733 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.733 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635737+0000", 2020-11-16T20:56:04.733 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.037e-06 2020-11-16T20:56:04.733 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.733 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.733 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.734 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635746+0000", 2020-11-16T20:56:04.734 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3001e-05 2020-11-16T20:56:04.734 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.734 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.734 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.734 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635759+0000", 2020-11-16T20:56:04.734 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7740000000000004e-06 2020-11-16T20:56:04.735 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.735 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.735 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.735 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635767+0000", 2020-11-16T20:56:04.735 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1385999999999999e-05 2020-11-16T20:56:04.735 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.735 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.735 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.736 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635818+0000", 2020-11-16T20:56:04.736 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6427e-05 2020-11-16T20:56:04.736 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.736 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.736 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.736 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635845+0000", 2020-11-16T20:56:04.736 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003885164 2020-11-16T20:56:04.736 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.737 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.737 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.737 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.639730+0000", 2020-11-16T20:56:04.737 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4512000000000003e-05 2020-11-16T20:56:04.737 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.737 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.737 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.738 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.639784+0000", 2020-11-16T20:56:04.738 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042338380000000002 2020-11-16T20:56:04.738 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.738 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.738 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.738 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.738 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.739 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1037 3.0 e35/19 3:0fda7169:::smithi16641208-231:head v 35'162, mlcod=35'160)", 2020-11-16T20:56:04.739 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.671040+0000", 2020-11-16T20:56:04.739 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.021363994, 2020-11-16T20:56:04.739 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040297739999999999, 2020-11-16T20:56:04.739 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.739 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.739 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.739 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.740 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.740 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671040+0000", 2020-11-16T20:56:04.740 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.740 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.740 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.740 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.740 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671040+0000", 2020-11-16T20:56:04.740 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012993299999999999 2020-11-16T20:56:04.741 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.741 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.741 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.741 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671170+0000", 2020-11-16T20:56:04.741 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9879999999999999e-06 2020-11-16T20:56:04.741 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.741 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.742 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.742 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671180+0000", 2020-11-16T20:56:04.742 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0243e-05 2020-11-16T20:56:04.742 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.742 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.742 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.742 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671190+0000", 2020-11-16T20:56:04.743 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4890000000000003e-06 2020-11-16T20:56:04.743 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.743 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.743 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.743 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671196+0000", 2020-11-16T20:56:04.743 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9298999999999997e-05 2020-11-16T20:56:04.743 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.743 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.744 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.744 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671245+0000", 2020-11-16T20:56:04.744 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4561000000000001e-05 2020-11-16T20:56:04.744 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.744 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.744 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.744 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671269+0000", 2020-11-16T20:56:04.745 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037448540000000002 2020-11-16T20:56:04.745 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.745 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.745 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.745 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.675014+0000", 2020-11-16T20:56:04.745 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5407e-05 2020-11-16T20:56:04.745 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.745 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.746 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.746 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.675070+0000", 2020-11-16T20:56:04.746 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040297739999999999 2020-11-16T20:56:04.746 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.746 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.746 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.746 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.747 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.747 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1102 3.0 e35/19 3:1c1ecb34:::smithi16641208-245:head v 35'172, mlcod=35'170)", 2020-11-16T20:56:04.747 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.920148+0000", 2020-11-16T20:56:04.747 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.7722555979999992, 2020-11-16T20:56:04.747 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053854699999999998, 2020-11-16T20:56:04.747 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.747 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.748 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.748 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.748 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.748 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920148+0000", 2020-11-16T20:56:04.748 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.748 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.748 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.748 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.749 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920148+0000", 2020-11-16T20:56:04.749 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019421400000000001 2020-11-16T20:56:04.749 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.749 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.749 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.749 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920342+0000", 2020-11-16T20:56:04.749 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6169999999999996e-06 2020-11-16T20:56:04.750 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.750 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.750 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.750 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920352+0000", 2020-11-16T20:56:04.750 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3684e-05 2020-11-16T20:56:04.750 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.750 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.751 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.751 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920366+0000", 2020-11-16T20:56:04.751 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7789999999999996e-06 2020-11-16T20:56:04.751 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.751 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.751 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.751 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920374+0000", 2020-11-16T20:56:04.751 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8783999999999995e-05 2020-11-16T20:56:04.752 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.752 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.752 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.752 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920472+0000", 2020-11-16T20:56:04.752 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6865000000000001e-05 2020-11-16T20:56:04.752 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.752 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.753 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.753 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920499+0000", 2020-11-16T20:56:04.753 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004975246 2020-11-16T20:56:04.753 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.753 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.753 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.753 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.925474+0000", 2020-11-16T20:56:04.753 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9280999999999997e-05 2020-11-16T20:56:04.754 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.754 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.754 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.754 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.925534+0000", 2020-11-16T20:56:04.754 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053854699999999998 2020-11-16T20:56:04.754 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.754 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.755 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.755 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.755 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.755 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1198 3.0 e35/19 3:1b4407ea:::smithi16641208-269:head v 35'184, mlcod=35'182)", 2020-11-16T20:56:04.755 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.231667+0000", 2020-11-16T20:56:04.755 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.4607364399999998, 2020-11-16T20:56:04.755 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041081770000000002, 2020-11-16T20:56:04.756 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.756 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.756 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.756 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.756 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.756 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231667+0000", 2020-11-16T20:56:04.756 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.756 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.757 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.757 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.757 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231667+0000", 2020-11-16T20:56:04.757 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018666399999999999 2020-11-16T20:56:04.757 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.757 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.757 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.758 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231854+0000", 2020-11-16T20:56:04.758 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.152e-05 2020-11-16T20:56:04.758 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.758 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.758 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.758 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231866+0000", 2020-11-16T20:56:04.758 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2456000000000002e-05 2020-11-16T20:56:04.758 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.759 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.759 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.759 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231898+0000", 2020-11-16T20:56:04.759 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6789999999999994e-06 2020-11-16T20:56:04.759 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.759 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.759 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.760 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231907+0000", 2020-11-16T20:56:04.760 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0732999999999997e-05 2020-11-16T20:56:04.760 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.760 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.760 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.760 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231957+0000", 2020-11-16T20:56:04.760 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9028000000000001e-05 2020-11-16T20:56:04.760 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.761 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.761 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.761 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231987+0000", 2020-11-16T20:56:04.761 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037323830000000001 2020-11-16T20:56:04.761 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.761 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.761 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.762 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.235719+0000", 2020-11-16T20:56:04.762 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6713999999999999e-05 2020-11-16T20:56:04.762 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.762 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.762 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.762 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.235776+0000", 2020-11-16T20:56:04.762 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041081770000000002 2020-11-16T20:56:04.762 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.763 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.763 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.763 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.763 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.763 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1234 3.0 e35/19 3:2294fced:::smithi16641208-278:head v 35'187, mlcod=35'185)", 2020-11-16T20:56:04.763 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.353572+0000", 2020-11-16T20:56:04.763 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.3388321990000005, 2020-11-16T20:56:04.764 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003816182, 2020-11-16T20:56:04.764 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.764 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.764 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.764 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.764 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.764 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.353572+0000", 2020-11-16T20:56:04.764 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.765 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.765 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.765 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.765 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.353572+0000", 2020-11-16T20:56:04.765 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000142526 2020-11-16T20:56:04.765 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.765 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.765 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.766 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.353714+0000", 2020-11-16T20:56:04.766 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9410000000000001e-06 2020-11-16T20:56:04.766 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.766 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.766 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.766 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.353721+0000", 2020-11-16T20:56:04.766 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7479999999999999e-06 2020-11-16T20:56:04.767 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.767 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.767 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.767 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.353730+0000", 2020-11-16T20:56:04.767 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3039999999999999e-06 2020-11-16T20:56:04.767 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.767 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.768 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.768 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.353737+0000", 2020-11-16T20:56:04.768 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4474000000000001e-05 2020-11-16T20:56:04.768 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.768 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.768 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.768 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.353792+0000", 2020-11-16T20:56:04.768 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8490999999999999e-05 2020-11-16T20:56:04.769 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.769 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.769 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.769 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.353820+0000", 2020-11-16T20:56:04.769 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035076360000000002 2020-11-16T20:56:04.769 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.769 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.770 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.770 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.357328+0000", 2020-11-16T20:56:04.770 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0062000000000002e-05 2020-11-16T20:56:04.770 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.770 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.770 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.770 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.357388+0000", 2020-11-16T20:56:04.771 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003816182 2020-11-16T20:56:04.771 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.771 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.771 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.771 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.771 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.771 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1235 3.0 e35/19 3:2294fced:::smithi16641208-278:head v 35'188, mlcod=35'185)", 2020-11-16T20:56:04.771 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.354799+0000", 2020-11-16T20:56:04.772 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.337604485, 2020-11-16T20:56:04.772 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050791389999999999, 2020-11-16T20:56:04.772 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.772 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.772 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.772 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.772 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.773 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354799+0000", 2020-11-16T20:56:04.773 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.773 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.773 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.773 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.773 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354799+0000", 2020-11-16T20:56:04.773 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2141000000000002e-05 2020-11-16T20:56:04.773 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.774 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.774 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.774 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354842+0000", 2020-11-16T20:56:04.774 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.601e-06 2020-11-16T20:56:04.774 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.774 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.774 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.775 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354848+0000", 2020-11-16T20:56:04.775 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.028e-05 2020-11-16T20:56:04.775 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.775 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.775 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.775 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354858+0000", 2020-11-16T20:56:04.775 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2959999999999998e-06 2020-11-16T20:56:04.775 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.776 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.776 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.776 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354864+0000", 2020-11-16T20:56:04.776 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3279999999999999e-05 2020-11-16T20:56:04.776 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.776 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.776 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.777 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354907+0000", 2020-11-16T20:56:04.777 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3655e-05 2020-11-16T20:56:04.777 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.777 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.777 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.777 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354931+0000", 2020-11-16T20:56:04.777 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004888875 2020-11-16T20:56:04.777 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.778 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.778 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.778 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.359820+0000", 2020-11-16T20:56:04.778 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9011000000000001e-05 2020-11-16T20:56:04.778 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.778 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.778 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.779 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.359879+0000", 2020-11-16T20:56:04.779 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050791389999999999 2020-11-16T20:56:04.779 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.779 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.779 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.779 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.779 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.779 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1237 3.0 e35/19 3:0b7cd9c0:::smithi16641208-279:head v 35'189, mlcod=35'187)", 2020-11-16T20:56:04.780 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.361967+0000", 2020-11-16T20:56:04.780 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.3304372430000004, 2020-11-16T20:56:04.780 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041733320000000001, 2020-11-16T20:56:04.780 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.780 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.780 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.780 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.780 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.781 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.361967+0000", 2020-11-16T20:56:04.781 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.781 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.781 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.781 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.781 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.361967+0000", 2020-11-16T20:56:04.781 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045453300000000002 2020-11-16T20:56:04.782 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.782 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.782 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.782 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362421+0000", 2020-11-16T20:56:04.782 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1178999999999999e-05 2020-11-16T20:56:04.782 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.782 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.783 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.783 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362432+0000", 2020-11-16T20:56:04.783 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5865000000000001e-05 2020-11-16T20:56:04.783 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.783 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.783 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.783 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362448+0000", 2020-11-16T20:56:04.783 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9809999999999992e-06 2020-11-16T20:56:04.784 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.784 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.784 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.784 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362457+0000", 2020-11-16T20:56:04.784 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9304e-05 2020-11-16T20:56:04.784 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.784 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.785 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.785 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362516+0000", 2020-11-16T20:56:04.785 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2886000000000003e-05 2020-11-16T20:56:04.785 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.785 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.785 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.785 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362549+0000", 2020-11-16T20:56:04.785 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035249809999999999 2020-11-16T20:56:04.786 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.786 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.786 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.786 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.366074+0000", 2020-11-16T20:56:04.786 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5603000000000002e-05 2020-11-16T20:56:04.786 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.786 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.786 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.787 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.366140+0000", 2020-11-16T20:56:04.787 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041733320000000001 2020-11-16T20:56:04.787 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.787 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.787 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.787 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.787 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.788 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1261 3.0 e35/19 3:393883c7:::smithi16641208-285:head v 35'195, mlcod=35'193)", 2020-11-16T20:56:04.788 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.447335+0000", 2020-11-16T20:56:04.788 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.2450689060000002, 2020-11-16T20:56:04.788 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0038521330000000002, 2020-11-16T20:56:04.788 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.788 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.788 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.788 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.789 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.789 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.447335+0000", 2020-11-16T20:56:04.789 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.789 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.789 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.789 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.789 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.447335+0000", 2020-11-16T20:56:04.790 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016204500000000001 2020-11-16T20:56:04.790 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.790 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.790 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.790 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.447497+0000", 2020-11-16T20:56:04.790 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0059e-05 2020-11-16T20:56:04.790 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.790 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.791 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.791 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.447507+0000", 2020-11-16T20:56:04.791 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3206e-05 2020-11-16T20:56:04.791 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.791 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.791 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.791 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.447520+0000", 2020-11-16T20:56:04.792 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7039999999999994e-06 2020-11-16T20:56:04.792 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.792 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.792 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.792 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.447528+0000", 2020-11-16T20:56:04.792 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1130999999999995e-05 2020-11-16T20:56:04.792 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.792 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.793 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.793 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.447589+0000", 2020-11-16T20:56:04.793 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0258e-05 2020-11-16T20:56:04.793 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.793 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.793 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.793 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.447629+0000", 2020-11-16T20:56:04.794 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003512018 2020-11-16T20:56:04.794 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.794 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.794 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.794 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.451141+0000", 2020-11-16T20:56:04.794 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5711999999999999e-05 2020-11-16T20:56:04.794 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.794 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.795 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.795 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.451187+0000", 2020-11-16T20:56:04.795 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0038521330000000002 2020-11-16T20:56:04.795 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.795 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.795 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.795 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.796 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.796 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1262 3.0 e35/19 3:393883c7:::smithi16641208-285:head v 35'196, mlcod=35'194)", 2020-11-16T20:56:04.796 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.455617+0000", 2020-11-16T20:56:04.796 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.2367872050000006, 2020-11-16T20:56:04.796 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039170029999999996, 2020-11-16T20:56:04.796 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.796 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.796 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.797 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.797 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.797 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455617+0000", 2020-11-16T20:56:04.797 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.797 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.797 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.797 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.798 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455617+0000", 2020-11-16T20:56:04.798 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00021765099999999999 2020-11-16T20:56:04.798 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.798 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.798 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455834+0000", 2020-11-16T20:56:04.798 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.296e-05 2020-11-16T20:56:04.798 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.799 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.799 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.799 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455847+0000", 2020-11-16T20:56:04.799 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2149e-05 2020-11-16T20:56:04.799 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.799 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.799 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.800 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455859+0000", 2020-11-16T20:56:04.800 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7663e-05 2020-11-16T20:56:04.800 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.800 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.800 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.800 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455877+0000", 2020-11-16T20:56:04.800 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6128000000000003e-05 2020-11-16T20:56:04.800 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.801 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.801 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.801 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455923+0000", 2020-11-16T20:56:04.801 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8368999999999999e-05 2020-11-16T20:56:04.801 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.801 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.801 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.802 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455952+0000", 2020-11-16T20:56:04.802 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035271780000000002 2020-11-16T20:56:04.802 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.802 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.802 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.802 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.459479+0000", 2020-11-16T20:56:04.802 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4904999999999997e-05 2020-11-16T20:56:04.802 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.803 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.803 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.803 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.459534+0000", 2020-11-16T20:56:04.803 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039170029999999996 2020-11-16T20:56:04.803 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.803 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.803 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.804 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.804 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.804 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1273 3.0 e35/19 3:2e8bdc7f:::smithi16641208-288:head v 35'198, mlcod=35'196)", 2020-11-16T20:56:04.804 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.489833+0000", 2020-11-16T20:56:04.804 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.2025709710000001, 2020-11-16T20:56:04.804 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039382189999999997, 2020-11-16T20:56:04.804 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.804 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.805 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.805 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.805 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.805 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.489833+0000", 2020-11-16T20:56:04.805 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.805 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.805 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.806 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.806 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.489833+0000", 2020-11-16T20:56:04.806 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000194852 2020-11-16T20:56:04.806 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.806 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.806 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.806 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.490028+0000", 2020-11-16T20:56:04.806 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1319e-05 2020-11-16T20:56:04.807 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.807 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.807 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.807 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.490039+0000", 2020-11-16T20:56:04.807 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5579000000000001e-05 2020-11-16T20:56:04.807 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.807 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.808 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.808 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.490055+0000", 2020-11-16T20:56:04.808 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9619999999999999e-06 2020-11-16T20:56:04.808 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.808 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.808 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.808 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.490064+0000", 2020-11-16T20:56:04.808 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5654e-05 2020-11-16T20:56:04.809 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.809 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.809 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.809 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.490109+0000", 2020-11-16T20:56:04.809 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.472e-05 2020-11-16T20:56:04.809 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.809 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.810 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.810 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.490134+0000", 2020-11-16T20:56:04.810 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035931819999999999 2020-11-16T20:56:04.810 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.810 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.810 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.810 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.493727+0000", 2020-11-16T20:56:04.811 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3951e-05 2020-11-16T20:56:04.811 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.811 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.811 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.811 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.493771+0000", 2020-11-16T20:56:04.811 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039382189999999997 2020-11-16T20:56:04.811 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.811 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.812 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.812 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.812 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.812 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1311 3.0 e35/19 3:2e3f435b:::smithi16641208-296:head v 35'211, mlcod=35'209)", 2020-11-16T20:56:04.812 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.626771+0000", 2020-11-16T20:56:04.812 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.0656327310000009, 2020-11-16T20:56:04.812 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0038662929999999998, 2020-11-16T20:56:04.813 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.813 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.813 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.813 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.813 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.813 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.626771+0000", 2020-11-16T20:56:04.813 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.813 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.814 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.814 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.814 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.626771+0000", 2020-11-16T20:56:04.814 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000138097 2020-11-16T20:56:04.814 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.814 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.814 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.815 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.626909+0000", 2020-11-16T20:56:04.815 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7810000000000002e-06 2020-11-16T20:56:04.815 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.815 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.815 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.815 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.626915+0000", 2020-11-16T20:56:04.815 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0280000000000003e-06 2020-11-16T20:56:04.815 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.816 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.816 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.816 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.626922+0000", 2020-11-16T20:56:04.816 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4429999999999996e-06 2020-11-16T20:56:04.816 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.816 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.816 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.817 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.626926+0000", 2020-11-16T20:56:04.817 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9570000000000002e-05 2020-11-16T20:56:04.817 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.817 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.817 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.817 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.626966+0000", 2020-11-16T20:56:04.817 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4292000000000001e-05 2020-11-16T20:56:04.817 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.818 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.818 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.818 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.626990+0000", 2020-11-16T20:56:04.818 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0036085119999999999 2020-11-16T20:56:04.818 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.818 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.818 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.819 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.630599+0000", 2020-11-16T20:56:04.819 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8569999999999998e-05 2020-11-16T20:56:04.819 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.819 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.819 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.819 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.630637+0000", 2020-11-16T20:56:04.819 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0038662929999999998 2020-11-16T20:56:04.819 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.820 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.820 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.820 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.820 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.820 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1423 3.0 e36/19 3:1e5364a0:::smithi16641208-320:head v 36'221, mlcod=35'219)", 2020-11-16T20:56:04.820 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.033789+0000", 2020-11-16T20:56:04.820 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.6586148529999996, 2020-11-16T20:56:04.821 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041251339999999999, 2020-11-16T20:56:04.821 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.821 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.821 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.821 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.821 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.821 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033789+0000", 2020-11-16T20:56:04.821 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.822 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.822 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.822 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.822 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033789+0000", 2020-11-16T20:56:04.822 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015644000000000001 2020-11-16T20:56:04.822 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.822 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.823 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.823 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033945+0000", 2020-11-16T20:56:04.823 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0270000000000003e-06 2020-11-16T20:56:04.823 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.823 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.823 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.823 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033950+0000", 2020-11-16T20:56:04.824 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6420000000000007e-06 2020-11-16T20:56:04.824 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.824 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.824 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.824 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033958+0000", 2020-11-16T20:56:04.824 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.477e-06 2020-11-16T20:56:04.824 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.824 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.825 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.825 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033965+0000", 2020-11-16T20:56:04.825 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9178999999999998e-05 2020-11-16T20:56:04.825 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.825 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.825 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.825 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.034014+0000", 2020-11-16T20:56:04.825 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2172e-05 2020-11-16T20:56:04.826 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.826 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.826 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.826 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.034036+0000", 2020-11-16T20:56:04.826 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0038237190000000002 2020-11-16T20:56:04.826 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.826 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.827 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.827 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.037860+0000", 2020-11-16T20:56:04.827 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4478000000000003e-05 2020-11-16T20:56:04.827 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.827 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.827 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.827 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.037914+0000", 2020-11-16T20:56:04.827 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041251339999999999 2020-11-16T20:56:04.828 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.828 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.828 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.828 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.828 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.828 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1468 3.0 e36/19 3:1852173c:::smithi16641208-329:head v 36'238, mlcod=36'236)", 2020-11-16T20:56:04.828 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.208167+0000", 2020-11-16T20:56:04.829 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.4842370789999997, 2020-11-16T20:56:04.829 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052481979999999999, 2020-11-16T20:56:04.829 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.829 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.829 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.829 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.829 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.829 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208167+0000", 2020-11-16T20:56:04.830 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.830 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.830 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.830 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.830 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208167+0000", 2020-11-16T20:56:04.830 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013521900000000001 2020-11-16T20:56:04.830 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.831 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.831 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.831 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208302+0000", 2020-11-16T20:56:04.831 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1307e-05 2020-11-16T20:56:04.831 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.831 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.831 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.832 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208313+0000", 2020-11-16T20:56:04.832 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2828e-05 2020-11-16T20:56:04.832 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.832 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.832 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.832 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208326+0000", 2020-11-16T20:56:04.832 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8889999999999996e-06 2020-11-16T20:56:04.833 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.833 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.833 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.833 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208333+0000", 2020-11-16T20:56:04.833 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2843999999999999e-05 2020-11-16T20:56:04.833 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.833 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.833 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.834 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208366+0000", 2020-11-16T20:56:04.834 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4986e-05 2020-11-16T20:56:04.834 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.834 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.834 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.834 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208381+0000", 2020-11-16T20:56:04.834 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0049810990000000001 2020-11-16T20:56:04.835 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.835 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.835 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.835 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.213362+0000", 2020-11-16T20:56:04.835 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3025999999999997e-05 2020-11-16T20:56:04.835 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.835 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.836 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.836 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.213415+0000", 2020-11-16T20:56:04.836 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052481979999999999 2020-11-16T20:56:04.836 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.836 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.836 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.836 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.837 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.837 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1490 3.0 e36/19 3:10845e0e:::smithi16641208-333:head v 36'252, mlcod=36'250)", 2020-11-16T20:56:04.837 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.301912+0000", 2020-11-16T20:56:04.837 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.3904920769999993, 2020-11-16T20:56:04.837 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044835179999999997, 2020-11-16T20:56:04.837 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.837 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.837 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.838 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.838 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.838 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.301912+0000", 2020-11-16T20:56:04.838 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.838 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.838 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.838 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.839 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.301912+0000", 2020-11-16T20:56:04.839 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114265 2020-11-16T20:56:04.839 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.839 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.839 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.839 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302026+0000", 2020-11-16T20:56:04.839 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7940000000000008e-06 2020-11-16T20:56:04.839 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.840 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.840 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.840 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302035+0000", 2020-11-16T20:56:04.840 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5187e-05 2020-11-16T20:56:04.840 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.840 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.840 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.841 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302050+0000", 2020-11-16T20:56:04.841 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.653e-06 2020-11-16T20:56:04.841 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.841 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.841 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.841 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302059+0000", 2020-11-16T20:56:04.841 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8010000000000003e-05 2020-11-16T20:56:04.841 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.842 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.842 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.842 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302107+0000", 2020-11-16T20:56:04.842 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5335000000000001e-05 2020-11-16T20:56:04.842 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.842 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.842 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.843 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302132+0000", 2020-11-16T20:56:04.843 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042049239999999996 2020-11-16T20:56:04.843 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.843 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.843 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.843 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.306337+0000", 2020-11-16T20:56:04.843 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8350000000000002e-05 2020-11-16T20:56:04.843 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.844 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.844 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.844 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.306395+0000", 2020-11-16T20:56:04.844 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044835179999999997 2020-11-16T20:56:04.844 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.844 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.844 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.845 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.845 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.845 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1491 3.0 e36/19 3:10845e0e:::smithi16641208-333:head v 36'253, mlcod=36'250)", 2020-11-16T20:56:04.845 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.302814+0000", 2020-11-16T20:56:04.845 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.3895899160000003, 2020-11-16T20:56:04.845 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039006700000000002, 2020-11-16T20:56:04.845 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:04.845 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:04.846 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:04.846 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.846 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:04.846 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302814+0000", 2020-11-16T20:56:04.846 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:04.846 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.846 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.847 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:04.847 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302814+0000", 2020-11-16T20:56:04.847 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5510999999999998e-05 2020-11-16T20:56:04.847 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.847 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.847 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:04.847 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302859+0000", 2020-11-16T20:56:04.847 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3980000000000002e-06 2020-11-16T20:56:04.848 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.848 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.848 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:04.848 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302867+0000", 2020-11-16T20:56:04.848 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0713999999999999e-05 2020-11-16T20:56:04.848 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.848 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.849 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:04.849 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302878+0000", 2020-11-16T20:56:04.849 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7679999999999997e-06 2020-11-16T20:56:04.849 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.849 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.849 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:04.849 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302883+0000", 2020-11-16T20:56:04.849 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0617000000000001e-05 2020-11-16T20:56:04.850 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.850 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.850 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:04.850 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302924+0000", 2020-11-16T20:56:04.850 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4732999999999999e-05 2020-11-16T20:56:04.850 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.850 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.851 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:04.851 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302949+0000", 2020-11-16T20:56:04.851 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037127919999999999 2020-11-16T20:56:04.851 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.851 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.851 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:04.851 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.306661+0000", 2020-11-16T20:56:04.851 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3137000000000003e-05 2020-11-16T20:56:04.852 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:04.852 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:04.852 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:04.852 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.306715+0000", 2020-11-16T20:56:04.852 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039006700000000002 2020-11-16T20:56:04.852 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.852 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.853 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.853 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:04.853 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:04.853 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:04.854 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:56:04.855 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:04.859+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:04.955 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:04.960+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:04.976 INFO:tasks.rados.rados.0.smithi166.stdout:546: done (1 left) 2020-11-16T20:56:04.976 INFO:tasks.rados.rados.0.smithi166.stdout:547: done (0 left) 2020-11-16T20:56:04.977 INFO:tasks.rados.rados.0.smithi166.stdout:548: write (excl) oid 369 current snap is 6 2020-11-16T20:56:04.977 INFO:tasks.rados.rados.0.smithi166.stdout:548: seq_num 517 ranges {689219=415737,1770367=646847} 2020-11-16T20:56:04.978 INFO:teuthology.orchestra.run.smithi166.stderr:noscrub is set 2020-11-16T20:56:04.982 INFO:tasks.rados.rados.0.smithi166.stdout:548: writing smithi16641208-369 from 689219 to 1104956 tid 1 2020-11-16T20:56:04.983 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:04.983 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:04.983 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:56:04.984 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:04.990 INFO:tasks.rados.rados.0.smithi166.stdout:548: writing smithi16641208-369 from 1770367 to 2417214 tid 2 2020-11-16T20:56:04.990 INFO:tasks.rados.rados.0.smithi166.stdout:549: delete oid 223 current snap is 6 2020-11-16T20:56:04.995 INFO:tasks.rados.rados.0.smithi166.stdout:548: finishing write tid 1 to smithi16641208-369 2020-11-16T20:56:04.997 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:56:04.998 INFO:tasks.rados.rados.0.smithi166.stdout:549: done (1 left) 2020-11-16T20:56:04.998 INFO:tasks.rados.rados.0.smithi166.stdout:550: read oid 3 snap -1 2020-11-16T20:56:04.998 INFO:tasks.rados.rados.0.smithi166.stdout:550: expect deleted 2020-11-16T20:56:04.998 INFO:tasks.rados.rados.0.smithi166.stdout:551: cache_flush oid 154 snap -1 2020-11-16T20:56:04.999 INFO:tasks.rados.rados.0.smithi166.stdout:552: cache_evict oid 27 snap 3 2020-11-16T20:56:04.999 INFO:tasks.rados.rados.0.smithi166.stdout:553: delete oid 400 current snap is 6 2020-11-16T20:56:04.999 INFO:tasks.rados.rados.0.smithi166.stdout:551: got (2) No such file or directory 2020-11-16T20:56:05.001 INFO:tasks.rados.rados.0.smithi166.stdout:552: got (0) Success 2020-11-16T20:56:05.001 INFO:tasks.rados.rados.0.smithi166.stdout:548: finishing write tid 2 to smithi16641208-369 2020-11-16T20:56:05.002 INFO:tasks.rados.rados.0.smithi166.stdout:550: done (4 left) 2020-11-16T20:56:05.002 INFO:tasks.rados.rados.0.smithi166.stdout:551: done (3 left) 2020-11-16T20:56:05.002 INFO:tasks.rados.rados.0.smithi166.stdout:552: done (2 left) 2020-11-16T20:56:05.002 INFO:tasks.rados.rados.0.smithi166.stdout:553: done (1 left) 2020-11-16T20:56:05.002 INFO:tasks.rados.rados.0.smithi166.stdout:554: write (excl) oid 283 current snap is 6 2020-11-16T20:56:05.002 INFO:tasks.rados.rados.0.smithi166.stdout:554: seq_num 520 ranges {739640=641484,1829460=794174} 2020-11-16T20:56:05.010 INFO:tasks.rados.rados.0.smithi166.stdout:554: writing smithi16641208-283 from 739640 to 1381124 tid 1 2020-11-16T20:56:05.017 INFO:tasks.rados.rados.0.smithi166.stdout:554: writing smithi16641208-283 from 1829460 to 2623634 tid 2 2020-11-16T20:56:05.017 INFO:tasks.rados.rados.0.smithi166.stdout:555: write (excl) oid 407 current snap is 6 2020-11-16T20:56:05.017 INFO:tasks.rados.rados.0.smithi166.stdout:555: seq_num 521 ranges {756447=716733,1887942=537832} 2020-11-16T20:56:05.026 INFO:tasks.rados.rados.0.smithi166.stdout:555: writing smithi16641208-407 from 756447 to 1473180 tid 1 2020-11-16T20:56:05.033 INFO:tasks.rados.rados.0.smithi166.stdout:555: writing smithi16641208-407 from 1887942 to 2425774 tid 2 2020-11-16T20:56:05.033 INFO:tasks.rados.rados.0.smithi166.stdout:556: copy_from oid 124 from oid 74 current snap is 6 2020-11-16T20:56:05.033 INFO:tasks.rados.rados.0.smithi166.stdout:554: finishing write tid 1 to smithi16641208-283 2020-11-16T20:56:05.033 INFO:tasks.rados.rados.0.smithi166.stdout:548: finishing write tid 3 to smithi16641208-369 2020-11-16T20:56:05.033 INFO:tasks.rados.rados.0.smithi166.stdout:548: finishing write tid 4 to smithi16641208-369 2020-11-16T20:56:05.033 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 369 v 381 (ObjNum 517 snap 6 seq_num 517) dirty exists 2020-11-16T20:56:05.034 INFO:tasks.rados.rados.0.smithi166.stdout:548: left oid 369 (ObjNum 517 snap 6 seq_num 517) 2020-11-16T20:56:05.034 INFO:tasks.rados.rados.0.smithi166.stdout:554: finishing write tid 2 to smithi16641208-283 2020-11-16T20:56:05.034 INFO:tasks.rados.rados.0.smithi166.stdout:554: finishing write tid 3 to smithi16641208-283 2020-11-16T20:56:05.034 INFO:tasks.rados.rados.0.smithi166.stdout:554: finishing write tid 4 to smithi16641208-283 2020-11-16T20:56:05.034 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 283 v 402 (ObjNum 520 snap 6 seq_num 520) dirty exists 2020-11-16T20:56:05.034 INFO:tasks.rados.rados.0.smithi166.stdout:554: left oid 283 (ObjNum 520 snap 6 seq_num 520) 2020-11-16T20:56:05.034 INFO:tasks.rados.rados.0.smithi166.stdout:548: done (3 left) 2020-11-16T20:56:05.035 INFO:tasks.rados.rados.0.smithi166.stdout:554: done (2 left) 2020-11-16T20:56:05.035 INFO:tasks.rados.rados.0.smithi166.stdout:557: write oid 101 current snap is 6 2020-11-16T20:56:05.035 INFO:tasks.rados.rados.0.smithi166.stdout:557: seq_num 522 ranges {773254=791982,2346424=426830} 2020-11-16T20:56:05.041 INFO:tasks.rados.rados.0.smithi166.stdout:557: writing smithi16641208-101 from 773254 to 1565236 tid 1 2020-11-16T20:56:05.048 INFO:tasks.rados.rados.0.smithi166.stdout:557: writing smithi16641208-101 from 2346424 to 2773254 tid 2 2020-11-16T20:56:05.049 INFO:tasks.rados.rados.0.smithi166.stdout:558: cache_try_flush oid 291 snap -1 2020-11-16T20:56:05.049 INFO:tasks.rados.rados.0.smithi166.stdout:559: write oid 369 current snap is 6 2020-11-16T20:56:05.049 INFO:tasks.rados.rados.0.smithi166.stdout:555: finishing write tid 1 to smithi16641208-407 2020-11-16T20:56:05.049 INFO:tasks.rados.rados.0.smithi166.stdout:559: seq_num 523 ranges {790061=467231,2004906=541501} 2020-11-16T20:56:05.055 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:05.060+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:05.056 INFO:tasks.rados.rados.0.smithi166.stdout:559: writing smithi16641208-369 from 790061 to 1257292 tid 1 2020-11-16T20:56:05.063 INFO:tasks.rados.rados.0.smithi166.stdout:559: writing smithi16641208-369 from 2004906 to 2546407 tid 2 2020-11-16T20:56:05.063 INFO:tasks.rados.rados.0.smithi166.stdout:560: snap_remove snap 4 2020-11-16T20:56:05.152 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:05.152 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:05.152 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:56:05.152 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:56:05.152 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:05.157 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:05.161+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:05.161 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:56:05.258 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:05.263+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:05.329 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:05.329 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:56:05.329 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:56:05.329 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:56:05.330 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.330 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1100 4.0 4:1e86053b:::smithi16641208-244:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:56:05.330 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.904112+0000", 2020-11-16T20:56:05.330 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.428222976000001, 2020-11-16T20:56:05.330 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021275207000000001, 2020-11-16T20:56:05.330 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:05.330 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:05.331 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:05.331 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:05.331 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:05.331 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1100 2020-11-16T20:56:05.331 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.331 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:05.331 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.332 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:05.332 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904112+0000", 2020-11-16T20:56:05.332 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:05.332 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.332 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.332 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:05.332 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904112+0000", 2020-11-16T20:56:05.333 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2320999999999998e-05 2020-11-16T20:56:05.333 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.333 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.333 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:05.333 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904144+0000", 2020-11-16T20:56:05.333 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8300000000000001e-06 2020-11-16T20:56:05.333 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.333 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.334 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:05.334 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904150+0000", 2020-11-16T20:56:05.334 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2289999999999999e-05 2020-11-16T20:56:05.334 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.334 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.334 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:05.334 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904162+0000", 2020-11-16T20:56:05.335 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1189999999999999e-06 2020-11-16T20:56:05.335 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:05.335 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904166+0000", 2020-11-16T20:56:05.335 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00041665099999999998 2020-11-16T20:56:05.335 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.336 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.336 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.336 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904583+0000", 2020-11-16T20:56:05.336 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4852999999999999e-05 2020-11-16T20:56:05.336 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.336 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.336 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:05.336 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904628+0000", 2020-11-16T20:56:05.337 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012226348999999999 2020-11-16T20:56:05.337 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.337 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.337 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.337 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.916854+0000", 2020-11-16T20:56:05.337 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000130242 2020-11-16T20:56:05.337 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.338 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.338 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:05.338 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.916984+0000", 2020-11-16T20:56:05.338 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078369049999999999 2020-11-16T20:56:05.338 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.338 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.338 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.338 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.924821+0000", 2020-11-16T20:56:05.339 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9945999999999997e-05 2020-11-16T20:56:05.339 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.339 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.339 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:05.339 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.924901+0000", 2020-11-16T20:56:05.339 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000485701 2020-11-16T20:56:05.339 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.340 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.340 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:05.340 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.925387+0000", 2020-11-16T20:56:05.340 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021275207000000001 2020-11-16T20:56:05.340 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.340 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:05.340 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.340 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.341 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.341 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:201 3.2 3:515e6cf6:::smithi16641208-22:head [copy-from ver 21] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e35)", 2020-11-16T20:56:05.341 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.969037+0000", 2020-11-16T20:56:05.341 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.363297427999999, 2020-11-16T20:56:05.341 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021703407000000001, 2020-11-16T20:56:05.341 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:05.341 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:05.342 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:05.342 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.342 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:05.342 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969037+0000", 2020-11-16T20:56:05.342 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:05.342 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.342 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.342 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:05.343 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969037+0000", 2020-11-16T20:56:05.343 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1260000000000006e-05 2020-11-16T20:56:05.343 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.343 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.343 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:05.343 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969099+0000", 2020-11-16T20:56:05.343 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8179999999999993e-06 2020-11-16T20:56:05.344 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.344 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.344 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:05.344 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969107+0000", 2020-11-16T20:56:05.344 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.428e-05 2020-11-16T20:56:05.344 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.344 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.344 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:05.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969122+0000", 2020-11-16T20:56:05.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9359999999999999e-06 2020-11-16T20:56:05.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.345 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.345 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:05.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969130+0000", 2020-11-16T20:56:05.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000117713 2020-11-16T20:56:05.346 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.346 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.346 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.346 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969247+0000", 2020-11-16T20:56:05.346 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014414199999999999 2020-11-16T20:56:05.346 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.346 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.346 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:05.347 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969391+0000", 2020-11-16T20:56:05.347 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.005648737 2020-11-16T20:56:05.347 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.347 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.347 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:05.347 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.975040+0000", 2020-11-16T20:56:05.347 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011700868999999999 2020-11-16T20:56:05.348 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.348 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.348 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:05.348 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.986741+0000", 2020-11-16T20:56:05.348 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00078654400000000002 2020-11-16T20:56:05.348 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.348 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.348 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.349 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987528+0000", 2020-11-16T20:56:05.349 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030922979999999998 2020-11-16T20:56:05.349 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.349 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.349 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.349 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.990620+0000", 2020-11-16T20:56:05.349 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9068999999999999e-05 2020-11-16T20:56:05.350 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.350 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:05.350 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.990689+0000", 2020-11-16T20:56:05.350 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1740999999999998e-05 2020-11-16T20:56:05.350 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.350 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:05.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.990741+0000", 2020-11-16T20:56:05.351 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021703407000000001 2020-11-16T20:56:05.351 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.351 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:05.351 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.351 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.351 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.351 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:202 3.2 3:5723fd94:::smithi16641208-211:head [copy-from ver 110] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e35)", 2020-11-16T20:56:05.352 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:56:05.352 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.363154212, 2020-11-16T20:56:05.352 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027790216999999999, 2020-11-16T20:56:05.352 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:05.352 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:05.352 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:05.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.353 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:05.353 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:56:05.353 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:05.353 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.353 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.353 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:05.353 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:56:05.354 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1907999999999998e-05 2020-11-16T20:56:05.354 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.354 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.354 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:05.354 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969232+0000", 2020-11-16T20:56:05.354 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5270000000000004e-06 2020-11-16T20:56:05.354 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.355 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.355 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:05.355 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969239+0000", 2020-11-16T20:56:05.355 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3062e-05 2020-11-16T20:56:05.355 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.355 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.355 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:05.356 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969252+0000", 2020-11-16T20:56:05.356 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8919999999999997e-06 2020-11-16T20:56:05.356 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.356 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.356 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:05.356 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969258+0000", 2020-11-16T20:56:05.356 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00040859799999999998 2020-11-16T20:56:05.356 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.357 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.357 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.357 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969666+0000", 2020-11-16T20:56:05.357 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0932000000000003e-05 2020-11-16T20:56:05.357 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.357 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.357 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:05.358 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969757+0000", 2020-11-16T20:56:05.358 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010999395 2020-11-16T20:56:05.358 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.358 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.358 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:05.358 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.980757+0000", 2020-11-16T20:56:05.358 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006260659 2020-11-16T20:56:05.358 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.359 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.359 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:05.359 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987017+0000", 2020-11-16T20:56:05.359 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0080836880000000003 2020-11-16T20:56:05.359 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.359 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.360 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.360 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995101+0000", 2020-11-16T20:56:05.360 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001796829 2020-11-16T20:56:05.360 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.360 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.360 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.360 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996898+0000", 2020-11-16T20:56:05.360 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2086000000000003e-05 2020-11-16T20:56:05.361 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.361 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.361 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:05.361 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996940+0000", 2020-11-16T20:56:05.361 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0641e-05 2020-11-16T20:56:05.361 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.361 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.362 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:05.362 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996971+0000", 2020-11-16T20:56:05.362 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027790216999999999 2020-11-16T20:56:05.362 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.362 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:05.362 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.362 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.362 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.363 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1121 3.2 3:7ef90409:::smithi16641208-250:head [write 584943~460297,stat] snapc 0=[] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e35)", 2020-11-16T20:56:05.363 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.979302+0000", 2020-11-16T20:56:05.363 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.353032646999999, 2020-11-16T20:56:05.363 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018294922000000002, 2020-11-16T20:56:05.363 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:05.363 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:05.363 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:05.364 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.364 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:05.364 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.979302+0000", 2020-11-16T20:56:05.364 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:05.364 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.364 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.364 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:05.365 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.979302+0000", 2020-11-16T20:56:05.365 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016355300000000001 2020-11-16T20:56:05.365 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.365 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.365 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:05.365 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.979466+0000", 2020-11-16T20:56:05.365 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9299999999999998e-06 2020-11-16T20:56:05.365 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.366 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.366 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:05.366 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.979476+0000", 2020-11-16T20:56:05.366 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7201999999999999e-05 2020-11-16T20:56:05.366 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.366 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.366 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:05.367 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.979493+0000", 2020-11-16T20:56:05.367 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8890000000000008e-06 2020-11-16T20:56:05.367 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.367 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.367 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:05.367 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.979502+0000", 2020-11-16T20:56:05.367 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0060374069999999998 2020-11-16T20:56:05.367 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.368 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.368 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.368 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.985539+0000", 2020-11-16T20:56:05.368 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000144306 2020-11-16T20:56:05.368 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.368 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.368 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:05.368 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.985683+0000", 2020-11-16T20:56:05.369 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015322099999999999 2020-11-16T20:56:05.369 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.369 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.369 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:05.369 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.985837+0000", 2020-11-16T20:56:05.369 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001516189 2020-11-16T20:56:05.369 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.370 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.370 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:05.370 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987353+0000", 2020-11-16T20:56:05.370 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010080207000000001 2020-11-16T20:56:05.370 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.370 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.370 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.370 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.997433+0000", 2020-11-16T20:56:05.371 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9851000000000001e-05 2020-11-16T20:56:05.371 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.371 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.371 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.371 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.997483+0000", 2020-11-16T20:56:05.371 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7873000000000001e-05 2020-11-16T20:56:05.371 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.372 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.372 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:05.372 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.997521+0000", 2020-11-16T20:56:05.372 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6293999999999998e-05 2020-11-16T20:56:05.372 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.372 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.372 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:05.372 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.997597+0000", 2020-11-16T20:56:05.373 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018294922000000002 2020-11-16T20:56:05.373 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.373 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:05.373 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.373 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.373 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.373 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1122 3.2 3:7ef90409:::smithi16641208-250:head [write 1587781~597162] snapc 0=[] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e35)", 2020-11-16T20:56:05.374 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.983325+0000", 2020-11-16T20:56:05.374 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.34900931, 2020-11-16T20:56:05.374 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019229049000000002, 2020-11-16T20:56:05.374 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:05.374 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:05.374 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:05.374 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.374 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:05.375 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983325+0000", 2020-11-16T20:56:05.375 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:05.375 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.375 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.375 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:05.375 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983325+0000", 2020-11-16T20:56:05.375 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015493500000000001 2020-11-16T20:56:05.376 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.376 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.376 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:05.376 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983480+0000", 2020-11-16T20:56:05.376 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4990000000000002e-06 2020-11-16T20:56:05.376 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.376 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.376 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:05.377 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983486+0000", 2020-11-16T20:56:05.377 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7037e-05 2020-11-16T20:56:05.377 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.377 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.377 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:05.377 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983503+0000", 2020-11-16T20:56:05.377 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6639999999999998e-06 2020-11-16T20:56:05.378 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.378 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.378 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:05.378 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983511+0000", 2020-11-16T20:56:05.378 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003260757 2020-11-16T20:56:05.378 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.378 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.378 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.379 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.986771+0000", 2020-11-16T20:56:05.379 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000136346 2020-11-16T20:56:05.379 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.379 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.379 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:05.379 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.986908+0000", 2020-11-16T20:56:05.379 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010723052 2020-11-16T20:56:05.380 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.380 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.380 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.380 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.997631+0000", 2020-11-16T20:56:05.380 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5947999999999998e-05 2020-11-16T20:56:05.380 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.380 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.381 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:05.381 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.997717+0000", 2020-11-16T20:56:05.381 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016206200000000001 2020-11-16T20:56:05.381 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.381 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.381 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:05.381 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.997879+0000", 2020-11-16T20:56:05.381 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003597205 2020-11-16T20:56:05.382 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.382 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.382 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.001476+0000", 2020-11-16T20:56:05.382 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1767000000000001e-05 2020-11-16T20:56:05.382 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.383 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.383 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.001528+0000", 2020-11-16T20:56:05.383 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00085415100000000004 2020-11-16T20:56:05.383 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.383 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.383 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:05.383 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002382+0000", 2020-11-16T20:56:05.383 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000102564 2020-11-16T20:56:05.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.384 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:05.384 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002484+0000", 2020-11-16T20:56:05.384 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0061999999999994e-05 2020-11-16T20:56:05.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.385 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:05.385 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002554+0000", 2020-11-16T20:56:05.385 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019229049000000002 2020-11-16T20:56:05.385 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.385 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:05.385 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.385 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.385 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.386 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1123 3.2 3:7ef90409:::smithi16641208-250:head [setxattr _header (57) in=7b,truncate 2184943] snapc 0=[] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e35)", 2020-11-16T20:56:05.386 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.983910+0000", 2020-11-16T20:56:05.386 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.348424565, 2020-11-16T20:56:05.386 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018919126000000001, 2020-11-16T20:56:05.386 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:05.386 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:05.386 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:05.387 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.387 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:05.387 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983910+0000", 2020-11-16T20:56:05.387 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:05.387 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.387 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.387 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:05.387 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983910+0000", 2020-11-16T20:56:05.388 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6406999999999998e-05 2020-11-16T20:56:05.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.388 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.388 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:05.388 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983957+0000", 2020-11-16T20:56:05.388 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0913999999999999e-05 2020-11-16T20:56:05.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.389 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:05.389 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983967+0000", 2020-11-16T20:56:05.389 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4635e-05 2020-11-16T20:56:05.389 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.389 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:05.389 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983982+0000", 2020-11-16T20:56:05.390 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8420000000000005e-06 2020-11-16T20:56:05.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.390 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.390 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:05.390 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983990+0000", 2020-11-16T20:56:05.390 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029550890000000002 2020-11-16T20:56:05.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.391 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.391 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.986945+0000", 2020-11-16T20:56:05.391 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5418000000000003e-05 2020-11-16T20:56:05.391 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.391 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:05.392 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987010+0000", 2020-11-16T20:56:05.392 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011737546 2020-11-16T20:56:05.392 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.392 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.392 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.392 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.998748+0000", 2020-11-16T20:56:05.392 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000104208 2020-11-16T20:56:05.392 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.393 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.393 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:05.393 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.998852+0000", 2020-11-16T20:56:05.393 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015971400000000001 2020-11-16T20:56:05.393 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.393 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.393 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:05.393 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.999012+0000", 2020-11-16T20:56:05.394 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0025627029999999999 2020-11-16T20:56:05.394 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.394 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.394 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.394 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.001575+0000", 2020-11-16T20:56:05.394 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0382000000000001e-05 2020-11-16T20:56:05.394 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.395 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.395 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.395 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.001615+0000", 2020-11-16T20:56:05.395 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001134216 2020-11-16T20:56:05.395 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.395 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.395 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:05.395 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002749+0000", 2020-11-16T20:56:05.396 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2852000000000002e-05 2020-11-16T20:56:05.396 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.396 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.396 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:05.396 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002792+0000", 2020-11-16T20:56:05.396 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7200000000000003e-05 2020-11-16T20:56:05.396 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.397 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.397 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:05.397 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002829+0000", 2020-11-16T20:56:05.397 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018919126000000001 2020-11-16T20:56:05.397 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.397 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:05.397 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.397 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.398 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.398 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:206 3.2 3:7ef90409:::smithi16641208-250:head [read 0~1] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+known_if_redirected e35)", 2020-11-16T20:56:05.398 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.984112+0000", 2020-11-16T20:56:05.398 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.348223047999999, 2020-11-16T20:56:05.398 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018870285000000001, 2020-11-16T20:56:05.398 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:05.398 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:05.399 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:05.399 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.399 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:05.399 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.984112+0000", 2020-11-16T20:56:05.399 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:05.399 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.399 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.399 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:05.400 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.984112+0000", 2020-11-16T20:56:05.400 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2836000000000002e-05 2020-11-16T20:56:05.400 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.400 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.400 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:05.400 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.984144+0000", 2020-11-16T20:56:05.400 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7229999999999998e-06 2020-11-16T20:56:05.401 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.401 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.401 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:05.401 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.984151+0000", 2020-11-16T20:56:05.401 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5872e-05 2020-11-16T20:56:05.401 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.401 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.401 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:05.402 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.984167+0000", 2020-11-16T20:56:05.402 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3956e-05 2020-11-16T20:56:05.402 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.402 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.402 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:05.402 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.984181+0000", 2020-11-16T20:56:05.402 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002868916 2020-11-16T20:56:05.403 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.403 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.403 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.403 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987050+0000", 2020-11-16T20:56:05.403 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000100128 2020-11-16T20:56:05.403 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.403 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.407 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:05.407 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987150+0000", 2020-11-16T20:56:05.407 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012240048 2020-11-16T20:56:05.407 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.407 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.407 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.407 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.999390+0000", 2020-11-16T20:56:05.408 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8245999999999997e-05 2020-11-16T20:56:05.408 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.408 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.408 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:05.408 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.999458+0000", 2020-11-16T20:56:05.408 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003399507 2020-11-16T20:56:05.408 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.408 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.409 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.409 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002858+0000", 2020-11-16T20:56:05.409 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4651000000000002e-05 2020-11-16T20:56:05.409 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.409 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.409 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:05.409 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002913+0000", 2020-11-16T20:56:05.410 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9401999999999997e-05 2020-11-16T20:56:05.410 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.410 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.410 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:05.410 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002982+0000", 2020-11-16T20:56:05.410 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018870285000000001 2020-11-16T20:56:05.410 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.411 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:05.411 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.411 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.411 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.411 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:207 3.2 3:5c36260c:::smithi16641208-128:head [copy-from ver 65] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e35)", 2020-11-16T20:56:05.411 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.995515+0000", 2020-11-16T20:56:05.411 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.336819755, 2020-11-16T20:56:05.411 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015181605000000001, 2020-11-16T20:56:05.412 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:05.412 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:05.412 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:05.412 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.412 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:05.412 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995515+0000", 2020-11-16T20:56:05.412 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:05.413 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.413 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.413 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:05.413 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995515+0000", 2020-11-16T20:56:05.413 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3939000000000001e-05 2020-11-16T20:56:05.413 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.413 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.414 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:05.414 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995559+0000", 2020-11-16T20:56:05.414 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3459999999999996e-06 2020-11-16T20:56:05.414 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.414 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.414 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:05.414 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995566+0000", 2020-11-16T20:56:05.415 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5123000000000001e-05 2020-11-16T20:56:05.415 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.415 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.415 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:05.415 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995581+0000", 2020-11-16T20:56:05.415 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8569999999999995e-06 2020-11-16T20:56:05.415 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.415 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.416 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:05.416 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995589+0000", 2020-11-16T20:56:05.416 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6199000000000002e-05 2020-11-16T20:56:05.416 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.416 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.416 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.416 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995645+0000", 2020-11-16T20:56:05.417 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000102872 2020-11-16T20:56:05.417 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.417 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.417 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:05.417 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995748+0000", 2020-11-16T20:56:05.417 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040666239999999996 2020-11-16T20:56:05.417 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.417 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.418 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:05.418 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.999815+0000", 2020-11-16T20:56:05.418 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030237390000000001 2020-11-16T20:56:05.418 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.418 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.418 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:05.418 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002839+0000", 2020-11-16T20:56:05.419 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0076955519999999996 2020-11-16T20:56:05.419 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.419 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.419 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.419 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.010534+0000", 2020-11-16T20:56:05.419 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0246000000000001e-05 2020-11-16T20:56:05.419 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.419 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.420 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.420 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.010564+0000", 2020-11-16T20:56:05.420 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1739e-05 2020-11-16T20:56:05.420 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.420 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.420 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:05.420 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.010626+0000", 2020-11-16T20:56:05.420 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0369000000000003e-05 2020-11-16T20:56:05.421 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.421 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.421 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:05.421 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.010697+0000", 2020-11-16T20:56:05.421 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015181605000000001 2020-11-16T20:56:05.421 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.421 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:05.422 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.422 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.422 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.422 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:208 3.2 3:762d577a:::smithi16641208-195:head [copy-from ver 102] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e35)", 2020-11-16T20:56:05.422 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.003022+0000", 2020-11-16T20:56:05.422 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.329312576, 2020-11-16T20:56:05.422 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017627352999999998, 2020-11-16T20:56:05.422 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:05.423 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:05.423 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:05.423 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.423 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:05.423 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003022+0000", 2020-11-16T20:56:05.423 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:05.423 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.424 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.424 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:05.424 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003022+0000", 2020-11-16T20:56:05.424 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3676e-05 2020-11-16T20:56:05.424 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.424 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.424 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:05.424 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003066+0000", 2020-11-16T20:56:05.425 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2129999999999999e-06 2020-11-16T20:56:05.425 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.425 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.425 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:05.425 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003071+0000", 2020-11-16T20:56:05.425 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2689999999999999e-06 2020-11-16T20:56:05.425 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.426 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.426 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:05.426 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003079+0000", 2020-11-16T20:56:05.426 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6480000000000002e-06 2020-11-16T20:56:05.426 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.426 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.426 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:05.426 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003084+0000", 2020-11-16T20:56:05.427 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9362000000000001e-05 2020-11-16T20:56:05.427 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.427 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.427 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.427 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003113+0000", 2020-11-16T20:56:05.427 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1527999999999999e-05 2020-11-16T20:56:05.427 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.428 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.428 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:05.428 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003165+0000", 2020-11-16T20:56:05.428 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042510660000000004 2020-11-16T20:56:05.428 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.428 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.428 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:05.428 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.007416+0000", 2020-11-16T20:56:05.429 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0043608070000000004 2020-11-16T20:56:05.429 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.429 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.429 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:05.429 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.011777+0000", 2020-11-16T20:56:05.429 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0086685419999999996 2020-11-16T20:56:05.429 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.430 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.430 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.430 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.020445+0000", 2020-11-16T20:56:05.430 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8176000000000004e-05 2020-11-16T20:56:05.430 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.430 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.430 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.430 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.020533+0000", 2020-11-16T20:56:05.431 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9265999999999997e-05 2020-11-16T20:56:05.431 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.431 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.431 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:05.431 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.020603+0000", 2020-11-16T20:56:05.431 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6799999999999999e-05 2020-11-16T20:56:05.431 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.432 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.432 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:05.432 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.020649+0000", 2020-11-16T20:56:05.432 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017627352999999998 2020-11-16T20:56:05.432 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.432 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:05.432 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.432 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.433 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.433 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1148 4.0 4:0285a053:::smithi16641208-256:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:56:05.433 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.060859+0000", 2020-11-16T20:56:05.433 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.271475218000001, 2020-11-16T20:56:05.433 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018754663000000001, 2020-11-16T20:56:05.433 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:05.433 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:05.433 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:05.434 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:05.434 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:05.434 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1148 2020-11-16T20:56:05.434 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.434 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:05.434 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.434 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:05.435 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.060859+0000", 2020-11-16T20:56:05.435 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:05.435 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.435 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.435 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:05.435 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.060859+0000", 2020-11-16T20:56:05.435 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9090000000000001e-05 2020-11-16T20:56:05.436 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.436 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.436 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:05.436 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.060889+0000", 2020-11-16T20:56:05.436 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2449999999999998e-06 2020-11-16T20:56:05.436 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.436 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.437 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:05.437 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.060894+0000", 2020-11-16T20:56:05.437 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0559e-05 2020-11-16T20:56:05.437 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.437 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.437 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:05.437 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.060904+0000", 2020-11-16T20:56:05.437 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4089999999999996e-06 2020-11-16T20:56:05.438 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.438 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.438 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:05.438 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.060909+0000", 2020-11-16T20:56:05.438 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00040223899999999998 2020-11-16T20:56:05.438 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.438 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.439 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.439 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.061311+0000", 2020-11-16T20:56:05.439 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4712000000000001e-05 2020-11-16T20:56:05.439 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.439 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.439 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:05.439 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.061366+0000", 2020-11-16T20:56:05.440 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012445941 2020-11-16T20:56:05.440 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.440 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.440 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.440 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.073812+0000", 2020-11-16T20:56:05.440 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015803799999999999 2020-11-16T20:56:05.440 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.440 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.441 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:05.441 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.073970+0000", 2020-11-16T20:56:05.441 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0048616500000000003 2020-11-16T20:56:05.441 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.441 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.441 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.441 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.078831+0000", 2020-11-16T20:56:05.441 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1623000000000002e-05 2020-11-16T20:56:05.442 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.442 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.442 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:05.442 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.078903+0000", 2020-11-16T20:56:05.442 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00071115700000000002 2020-11-16T20:56:05.442 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.442 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.443 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:05.443 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.079614+0000", 2020-11-16T20:56:05.443 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018754663000000001 2020-11-16T20:56:05.443 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.443 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:05.443 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.443 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.444 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.444 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1432 4.0 4:3dccbd44:::smithi16641208-321:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e36)", 2020-11-16T20:56:05.444 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.063349+0000", 2020-11-16T20:56:05.444 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.2689852619999993, 2020-11-16T20:56:05.444 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020415261000000001, 2020-11-16T20:56:05.444 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:05.444 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:05.444 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:05.445 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:05.445 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:05.445 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1432 2020-11-16T20:56:05.445 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.445 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:05.445 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.445 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:05.446 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.063349+0000", 2020-11-16T20:56:05.446 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:05.446 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.446 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.446 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:05.446 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.063349+0000", 2020-11-16T20:56:05.446 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5721000000000001e-05 2020-11-16T20:56:05.447 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.447 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.447 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:05.447 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.063365+0000", 2020-11-16T20:56:05.447 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8200000000000001e-06 2020-11-16T20:56:05.447 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.447 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.447 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:05.448 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.063368+0000", 2020-11-16T20:56:05.448 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8499999999999999e-06 2020-11-16T20:56:05.448 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.448 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.448 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:05.448 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.063374+0000", 2020-11-16T20:56:05.448 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3489999999999999e-06 2020-11-16T20:56:05.449 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.449 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.449 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:05.449 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.063376+0000", 2020-11-16T20:56:05.449 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045649699999999999 2020-11-16T20:56:05.449 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.449 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.449 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.450 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.063833+0000", 2020-11-16T20:56:05.450 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6248000000000001e-05 2020-11-16T20:56:05.450 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.450 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.450 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:05.450 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.063889+0000", 2020-11-16T20:56:05.450 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012858675999999999 2020-11-16T20:56:05.451 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.451 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.451 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.451 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.076748+0000", 2020-11-16T20:56:05.451 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012343099999999999 2020-11-16T20:56:05.451 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.451 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.451 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:05.452 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.076871+0000", 2020-11-16T20:56:05.452 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0065606579999999996 2020-11-16T20:56:05.452 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.452 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.452 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.452 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.083432+0000", 2020-11-16T20:56:05.452 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9738000000000003e-05 2020-11-16T20:56:05.452 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.453 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.453 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:05.453 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.083491+0000", 2020-11-16T20:56:05.453 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00027327299999999998 2020-11-16T20:56:05.453 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.453 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.453 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:05.454 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.083765+0000", 2020-11-16T20:56:05.454 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020415261000000001 2020-11-16T20:56:05.454 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.454 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:05.454 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.454 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.454 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.454 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1437 4.0 4:3729c5f0:::smithi16641208-322:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e36)", 2020-11-16T20:56:05.455 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.082908+0000", 2020-11-16T20:56:05.455 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.2494266120000006, 2020-11-16T20:56:05.455 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01873671, 2020-11-16T20:56:05.455 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:05.455 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:05.455 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:05.455 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:05.456 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:05.456 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1437 2020-11-16T20:56:05.456 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.456 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:05.456 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.456 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:05.456 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.082908+0000", 2020-11-16T20:56:05.456 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:05.457 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.457 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.457 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:05.457 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.082908+0000", 2020-11-16T20:56:05.457 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5228999999999999e-05 2020-11-16T20:56:05.457 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.457 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.458 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:05.458 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.082923+0000", 2020-11-16T20:56:05.458 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9790000000000002e-06 2020-11-16T20:56:05.458 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.458 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.458 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:05.458 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.082926+0000", 2020-11-16T20:56:05.458 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9599999999999997e-06 2020-11-16T20:56:05.459 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.459 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.459 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:05.459 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.082932+0000", 2020-11-16T20:56:05.459 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5890000000000001e-06 2020-11-16T20:56:05.459 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.459 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.460 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:05.460 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.082935+0000", 2020-11-16T20:56:05.460 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000366616 2020-11-16T20:56:05.460 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.460 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.460 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.460 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.083301+0000", 2020-11-16T20:56:05.460 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0166999999999997e-05 2020-11-16T20:56:05.461 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.461 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.461 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:05.461 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.083342+0000", 2020-11-16T20:56:05.461 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.009997878 2020-11-16T20:56:05.461 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.461 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.462 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.462 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.093340+0000", 2020-11-16T20:56:05.462 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000144334 2020-11-16T20:56:05.462 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.462 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.462 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:05.462 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.093484+0000", 2020-11-16T20:56:05.463 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078439579999999998 2020-11-16T20:56:05.463 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.463 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.463 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.463 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.101328+0000", 2020-11-16T20:56:05.463 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7257999999999999e-05 2020-11-16T20:56:05.463 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.463 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.464 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:05.464 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.101395+0000", 2020-11-16T20:56:05.464 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024974200000000001 2020-11-16T20:56:05.464 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.464 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.464 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:05.464 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.101645+0000", 2020-11-16T20:56:05.464 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01873671 2020-11-16T20:56:05.465 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.465 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:05.465 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.465 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.465 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.465 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:547 3.2 3:5f250a2b:::smithi16641208-75:head [copy-from ver 38] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:05.465 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:56:05.466 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.31476690899999998, 2020-11-16T20:56:05.466 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027400430999999999, 2020-11-16T20:56:05.466 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:05.466 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:05.466 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:05.466 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.466 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:05.466 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:56:05.467 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:05.467 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.467 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.467 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:05.467 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:56:05.467 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5093999999999999e-05 2020-11-16T20:56:05.467 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.468 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.468 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:05.468 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017613+0000", 2020-11-16T20:56:05.468 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6150000000000003e-06 2020-11-16T20:56:05.468 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.468 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.468 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:05.468 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017623+0000", 2020-11-16T20:56:05.469 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6934000000000001e-05 2020-11-16T20:56:05.469 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.469 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.469 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:05.469 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017639+0000", 2020-11-16T20:56:05.469 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1892000000000001e-05 2020-11-16T20:56:05.469 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.470 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.470 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:05.470 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017651+0000", 2020-11-16T20:56:05.470 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2955999999999998e-05 2020-11-16T20:56:05.470 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.470 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.470 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.470 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017714+0000", 2020-11-16T20:56:05.471 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019352400000000001 2020-11-16T20:56:05.471 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.471 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.471 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:05.471 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017908+0000", 2020-11-16T20:56:05.471 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0073901349999999999 2020-11-16T20:56:05.471 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.472 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.472 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:05.472 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025298+0000", 2020-11-16T20:56:05.472 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0082133799999999993 2020-11-16T20:56:05.472 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.472 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.472 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:05.472 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033511+0000", 2020-11-16T20:56:05.473 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0074347629999999996 2020-11-16T20:56:05.473 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.473 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.473 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.473 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.040946+0000", 2020-11-16T20:56:05.473 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039404669999999996 2020-11-16T20:56:05.473 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.473 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.474 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.474 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044887+0000", 2020-11-16T20:56:05.474 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7098000000000002e-05 2020-11-16T20:56:05.474 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.474 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.474 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:05.474 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044934+0000", 2020-11-16T20:56:05.475 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4573000000000003e-05 2020-11-16T20:56:05.475 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.475 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.475 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:05.475 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044968+0000", 2020-11-16T20:56:05.475 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027400430999999999 2020-11-16T20:56:05.475 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.476 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:05.476 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.476 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.476 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.476 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:548 3.2 3:6173e90a:::smithi16641208-2:head [copy-from ver 3] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:05.476 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:56:05.476 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.31463557599999997, 2020-11-16T20:56:05.476 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029556911000000002, 2020-11-16T20:56:05.477 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:05.477 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:05.477 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:05.477 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.477 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:05.477 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:56:05.477 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:05.477 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.478 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.478 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:05.478 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:56:05.478 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2478000000000002e-05 2020-11-16T20:56:05.478 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.478 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.478 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:05.479 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017742+0000", 2020-11-16T20:56:05.479 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3060000000000003e-06 2020-11-16T20:56:05.479 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.479 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.479 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:05.479 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017748+0000", 2020-11-16T20:56:05.479 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1102e-05 2020-11-16T20:56:05.479 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.480 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.480 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:05.480 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017759+0000", 2020-11-16T20:56:05.480 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.118e-06 2020-11-16T20:56:05.480 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.480 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.480 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:05.481 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017764+0000", 2020-11-16T20:56:05.481 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032233700000000001 2020-11-16T20:56:05.481 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.481 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.481 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.481 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.018086+0000", 2020-11-16T20:56:05.481 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000128374 2020-11-16T20:56:05.481 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.482 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.482 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:05.482 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.018215+0000", 2020-11-16T20:56:05.482 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012971355 2020-11-16T20:56:05.482 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.482 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.482 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:05.483 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.031186+0000", 2020-11-16T20:56:05.483 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044142890000000001 2020-11-16T20:56:05.483 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.483 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.483 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:05.483 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.035600+0000", 2020-11-16T20:56:05.483 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092372719999999995 2020-11-16T20:56:05.483 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.484 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.484 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.484 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044838+0000", 2020-11-16T20:56:05.484 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0023022049999999999 2020-11-16T20:56:05.484 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.484 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.484 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.485 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047140+0000", 2020-11-16T20:56:05.485 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0380999999999997e-05 2020-11-16T20:56:05.485 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.485 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.485 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:05.485 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047200+0000", 2020-11-16T20:56:05.485 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5693999999999999e-05 2020-11-16T20:56:05.485 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.486 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.486 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:05.486 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047256+0000", 2020-11-16T20:56:05.486 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029556911000000002 2020-11-16T20:56:05.486 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.486 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:05.486 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.487 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.487 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.487 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:550 3.2 3:646fee8a:::smithi16641208-407:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e42)", 2020-11-16T20:56:05.487 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.033001+0000", 2020-11-16T20:56:05.487 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.29933373800000002, 2020-11-16T20:56:05.487 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015129889000000001, 2020-11-16T20:56:05.487 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:05.487 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:05.488 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:05.488 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.488 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:05.488 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033001+0000", 2020-11-16T20:56:05.488 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:05.488 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.488 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.489 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:05.489 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033001+0000", 2020-11-16T20:56:05.489 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0469e-05 2020-11-16T20:56:05.489 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.489 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.489 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:05.489 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033021+0000", 2020-11-16T20:56:05.489 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.676e-06 2020-11-16T20:56:05.490 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.490 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.490 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:05.490 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033025+0000", 2020-11-16T20:56:05.490 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.956e-06 2020-11-16T20:56:05.490 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.490 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.491 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:05.491 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033032+0000", 2020-11-16T20:56:05.491 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.275e-06 2020-11-16T20:56:05.491 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.491 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.491 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:05.491 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033035+0000", 2020-11-16T20:56:05.491 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0024579269999999999 2020-11-16T20:56:05.492 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.492 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.492 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.492 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.035493+0000", 2020-11-16T20:56:05.492 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0771000000000002e-05 2020-11-16T20:56:05.492 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.492 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.493 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:05.493 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.035584+0000", 2020-11-16T20:56:05.493 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012320238000000001 2020-11-16T20:56:05.493 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.493 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.493 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.493 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047904+0000", 2020-11-16T20:56:05.493 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010573600000000001 2020-11-16T20:56:05.494 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.494 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.494 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:05.494 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.048010+0000", 2020-11-16T20:56:05.494 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000120841 2020-11-16T20:56:05.494 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.494 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.495 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:05.495 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.048131+0000", 2020-11-16T20:56:05.495 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015129889000000001 2020-11-16T20:56:05.495 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.495 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:05.495 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.495 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.495 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.496 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:551 3.2 3:646fee8a:::smithi16641208-407:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e42)", 2020-11-16T20:56:05.496 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.033053+0000", 2020-11-16T20:56:05.496 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.299282139, 2020-11-16T20:56:05.496 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018118614000000002, 2020-11-16T20:56:05.496 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:05.496 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:05.496 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:05.496 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.497 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:05.497 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033053+0000", 2020-11-16T20:56:05.497 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:05.497 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.497 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.497 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:05.497 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033053+0000", 2020-11-16T20:56:05.498 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0894e-05 2020-11-16T20:56:05.498 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.498 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.498 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:05.498 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033073+0000", 2020-11-16T20:56:05.498 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.903e-06 2020-11-16T20:56:05.498 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.498 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.499 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:05.499 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033076+0000", 2020-11-16T20:56:05.499 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.417e-06 2020-11-16T20:56:05.499 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.499 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.499 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:05.499 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033082+0000", 2020-11-16T20:56:05.500 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4449999999999999e-06 2020-11-16T20:56:05.500 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.500 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.500 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:05.500 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033084+0000", 2020-11-16T20:56:05.500 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0025466 2020-11-16T20:56:05.500 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.500 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.501 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.501 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.035631+0000", 2020-11-16T20:56:05.501 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6619000000000006e-05 2020-11-16T20:56:05.501 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.501 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.501 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:05.501 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.035707+0000", 2020-11-16T20:56:05.501 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012470798 2020-11-16T20:56:05.502 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.502 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.502 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.502 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.048178+0000", 2020-11-16T20:56:05.502 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3502000000000001e-05 2020-11-16T20:56:05.502 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.502 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.503 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:05.503 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.048262+0000", 2020-11-16T20:56:05.503 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029094360000000001 2020-11-16T20:56:05.503 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.503 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.503 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:05.503 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.051171+0000", 2020-11-16T20:56:05.503 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018118614000000002 2020-11-16T20:56:05.504 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.504 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:05.504 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.504 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.504 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.504 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:554 3.2 3:769099fd:::smithi16641208-247:head [copy-from ver 123] snapc 1=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:05.505 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:56:05.505 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.28223225800000001, 2020-11-16T20:56:05.505 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998, 2020-11-16T20:56:05.505 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:05.505 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:05.505 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:05.505 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.505 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:05.506 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:56:05.506 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:05.506 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.506 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.506 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:05.506 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:56:05.506 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6705999999999997e-05 2020-11-16T20:56:05.507 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.507 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.507 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:05.507 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050139+0000", 2020-11-16T20:56:05.507 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6199999999999998e-06 2020-11-16T20:56:05.507 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.507 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.507 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:05.508 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050144+0000", 2020-11-16T20:56:05.508 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.944e-06 2020-11-16T20:56:05.508 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.508 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.508 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:05.508 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050154+0000", 2020-11-16T20:56:05.508 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4043999999999999e-05 2020-11-16T20:56:05.509 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.509 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.509 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:05.509 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050178+0000", 2020-11-16T20:56:05.509 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078971409999999999 2020-11-16T20:56:05.509 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.509 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.510 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.510 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058075+0000", 2020-11-16T20:56:05.510 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012776500000000001 2020-11-16T20:56:05.510 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.510 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.510 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:05.510 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058203+0000", 2020-11-16T20:56:05.511 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011807013 2020-11-16T20:56:05.511 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.511 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.511 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:05.511 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070010+0000", 2020-11-16T20:56:05.511 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029522160000000001 2020-11-16T20:56:05.511 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.511 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.512 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:05.512 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.072962+0000", 2020-11-16T20:56:05.512 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017845006 2020-11-16T20:56:05.512 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.512 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.512 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.512 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.090807+0000", 2020-11-16T20:56:05.512 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.009301808 2020-11-16T20:56:05.513 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.513 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.513 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.513 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100109+0000", 2020-11-16T20:56:05.513 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7076999999999995e-05 2020-11-16T20:56:05.513 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.513 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.514 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:05.514 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100176+0000", 2020-11-16T20:56:05.514 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9790999999999999e-05 2020-11-16T20:56:05.514 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.514 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.514 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:05.514 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100216+0000", 2020-11-16T20:56:05.515 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998 2020-11-16T20:56:05.515 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.515 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:05.515 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.515 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.515 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.515 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:555 3.2 3:590e6edd:::smithi16641208-203:head [delete] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:05.515 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.076366+0000", 2020-11-16T20:56:05.516 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.25596840100000001, 2020-11-16T20:56:05.516 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024009968, 2020-11-16T20:56:05.516 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:05.516 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:05.516 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:05.516 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.516 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:05.516 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076366+0000", 2020-11-16T20:56:05.517 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:05.517 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.517 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.517 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:05.517 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076366+0000", 2020-11-16T20:56:05.517 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2963999999999998e-05 2020-11-16T20:56:05.517 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.518 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.518 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:05.518 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076399+0000", 2020-11-16T20:56:05.518 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6879999999999999e-06 2020-11-16T20:56:05.518 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.518 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.518 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:05.518 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076407+0000", 2020-11-16T20:56:05.519 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4088999999999999e-05 2020-11-16T20:56:05.519 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.519 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.519 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:05.519 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076431+0000", 2020-11-16T20:56:05.519 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.4280000000000002e-06 2020-11-16T20:56:05.519 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.520 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.520 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:05.520 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076440+0000", 2020-11-16T20:56:05.520 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3467999999999998e-05 2020-11-16T20:56:05.520 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.520 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.520 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.520 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076484+0000", 2020-11-16T20:56:05.521 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011613 2020-11-16T20:56:05.521 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.521 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.521 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:05.521 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076600+0000", 2020-11-16T20:56:05.521 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8172999999999998e-05 2020-11-16T20:56:05.521 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.522 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.522 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:05.522 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076678+0000", 2020-11-16T20:56:05.522 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0009822749999999999 2020-11-16T20:56:05.522 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.522 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.522 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:05.522 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.077661+0000", 2020-11-16T20:56:05.523 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018605739999999999 2020-11-16T20:56:05.523 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.523 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.523 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.523 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.096266+0000", 2020-11-16T20:56:05.523 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039876709999999999 2020-11-16T20:56:05.523 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.523 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.524 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.524 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100254+0000", 2020-11-16T20:56:05.524 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4382999999999996e-05 2020-11-16T20:56:05.524 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.524 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.524 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:05.524 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100328+0000", 2020-11-16T20:56:05.525 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7958999999999999e-05 2020-11-16T20:56:05.525 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.525 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.525 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:05.525 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100376+0000", 2020-11-16T20:56:05.525 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024009968 2020-11-16T20:56:05.525 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.525 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:05.526 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.526 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.526 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.526 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:556 3.2 3:590e6edd:::smithi16641208-203:head [copy-from ver 105] snapc 1=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:05.526 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.076482+0000", 2020-11-16T20:56:05.526 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.255852951, 2020-11-16T20:56:05.526 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025150006999999999, 2020-11-16T20:56:05.527 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:05.527 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:05.527 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:05.527 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.527 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:05.527 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076482+0000", 2020-11-16T20:56:05.527 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:05.527 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.528 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.528 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:05.528 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076482+0000", 2020-11-16T20:56:05.528 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0086000000000006e-05 2020-11-16T20:56:05.528 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.528 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.528 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:05.529 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076552+0000", 2020-11-16T20:56:05.529 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7299999999999999e-06 2020-11-16T20:56:05.529 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.529 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.529 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:05.529 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076559+0000", 2020-11-16T20:56:05.529 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5905000000000001e-05 2020-11-16T20:56:05.529 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.530 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.530 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:05.530 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076574+0000", 2020-11-16T20:56:05.530 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9369999999999993e-06 2020-11-16T20:56:05.530 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.530 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.530 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:05.530 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076583+0000", 2020-11-16T20:56:05.531 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00064848599999999998 2020-11-16T20:56:05.531 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.531 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.531 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.531 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.077232+0000", 2020-11-16T20:56:05.531 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8629999999999999e-05 2020-11-16T20:56:05.531 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.532 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.532 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:05.532 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.077291+0000", 2020-11-16T20:56:05.532 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003820773 2020-11-16T20:56:05.532 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.532 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.532 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:05.532 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.081111+0000", 2020-11-16T20:56:05.533 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033171849999999998 2020-11-16T20:56:05.533 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.533 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.533 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:05.533 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.084428+0000", 2020-11-16T20:56:05.533 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016400174 2020-11-16T20:56:05.533 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.533 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.534 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.534 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100829+0000", 2020-11-16T20:56:05.534 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00071628499999999999 2020-11-16T20:56:05.534 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.534 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.534 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.534 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.101545+0000", 2020-11-16T20:56:05.535 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7249e-05 2020-11-16T20:56:05.535 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.535 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.535 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:05.535 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.101602+0000", 2020-11-16T20:56:05.535 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9567e-05 2020-11-16T20:56:05.535 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.536 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.536 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:05.536 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.101632+0000", 2020-11-16T20:56:05.536 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025150006999999999 2020-11-16T20:56:05.536 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.536 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:05.536 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.536 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.537 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.537 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:557 3.2 3:5d1acb82:::smithi16641208-21:head [copy-from ver 18] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:05.537 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.102410+0000", 2020-11-16T20:56:05.537 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.229924716, 2020-11-16T20:56:05.537 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015444329999999999, 2020-11-16T20:56:05.537 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:05.537 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:05.537 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:05.538 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.538 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:05.538 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.102410+0000", 2020-11-16T20:56:05.538 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:05.538 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.538 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.538 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:05.539 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.102410+0000", 2020-11-16T20:56:05.539 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3955999999999997e-05 2020-11-16T20:56:05.539 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.539 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.539 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:05.539 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.102454+0000", 2020-11-16T20:56:05.539 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7989999999999996e-06 2020-11-16T20:56:05.539 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.540 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.540 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:05.540 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.102461+0000", 2020-11-16T20:56:05.540 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.624e-05 2020-11-16T20:56:05.540 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.540 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.540 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:05.541 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.102477+0000", 2020-11-16T20:56:05.541 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8589999999999999e-06 2020-11-16T20:56:05.541 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.541 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.541 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:05.541 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.102484+0000", 2020-11-16T20:56:05.541 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3903999999999998e-05 2020-11-16T20:56:05.541 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.542 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.542 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:05.542 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.102528+0000", 2020-11-16T20:56:05.542 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000162258 2020-11-16T20:56:05.542 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.542 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.542 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:05.543 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.102690+0000", 2020-11-16T20:56:05.543 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029260029999999999 2020-11-16T20:56:05.543 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.543 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.543 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:05.543 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.105616+0000", 2020-11-16T20:56:05.543 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0026125829999999999 2020-11-16T20:56:05.543 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.544 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.544 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:05.544 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.108229+0000", 2020-11-16T20:56:05.544 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.009507082 2020-11-16T20:56:05.544 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.544 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.544 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.544 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.117736+0000", 2020-11-16T20:56:05.545 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4065e-05 2020-11-16T20:56:05.545 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.545 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.545 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:05.545 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.117770+0000", 2020-11-16T20:56:05.545 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0015999999999997e-05 2020-11-16T20:56:05.545 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.546 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.546 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:05.546 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.117820+0000", 2020-11-16T20:56:05.546 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4564999999999999e-05 2020-11-16T20:56:05.546 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:05.546 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:05.546 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:05.546 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.117854+0000", 2020-11-16T20:56:05.547 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015444329999999999 2020-11-16T20:56:05.547 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.547 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:05.547 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.547 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:05.547 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:05.547 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:05.549 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:56:05.549 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:05.553+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:05.650 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:05.654+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:05.696 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:05.697 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:05.697 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:56:05.697 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:05.706 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:56:05.750 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:05.756+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:05.851 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:05.856+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:05.875 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:56:05.880 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:05.880 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:05.880 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:56:05.881 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:56:05.881 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:05.890 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:56:05.972 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:05.977+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:05.983 INFO:tasks.rados.rados.0.smithi166.stdout:560: done (5 left) 2020-11-16T20:56:05.983 INFO:tasks.rados.rados.0.smithi166.stdout:561: cache_flush oid 450 snap 2 2020-11-16T20:56:05.984 INFO:tasks.rados.rados.0.smithi166.stdout:558: got (0) Success 2020-11-16T20:56:05.984 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 291 v 0 (ObjNum 290 snap 0 seq_num 290) dirty exists 2020-11-16T20:56:05.984 INFO:tasks.rados.rados.0.smithi166.stdout:557: finishing write tid 1 to smithi16641208-101 2020-11-16T20:56:05.984 INFO:tasks.rados.rados.0.smithi166.stdout:556: finishing copy_from to smithi16641208-124 2020-11-16T20:56:05.984 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 124 v 55 (ObjNum 73 snap 0 seq_num 73) dirty exists 2020-11-16T20:56:05.984 INFO:tasks.rados.rados.0.smithi166.stdout:556: finishing copy_from racing read to smithi16641208-124 2020-11-16T20:56:05.984 INFO:tasks.rados.rados.0.smithi166.stdout:555: finishing write tid 2 to smithi16641208-407 2020-11-16T20:56:05.985 INFO:tasks.rados.rados.0.smithi166.stdout:556: done (5 left) 2020-11-16T20:56:05.985 INFO:tasks.rados.rados.0.smithi166.stdout:558: done (4 left) 2020-11-16T20:56:05.985 INFO:tasks.rados.rados.0.smithi166.stdout:562: snap_remove snap 1 2020-11-16T20:56:06.027 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:56:06.053 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:06.057+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:06.072 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:06.073 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:56:06.073 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:56:06.073 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:56:06.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.073 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2 4.1 4:9ab04c4a:::smithi16641208-1:head [write 1542129~474678] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:56:06.073 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:50.908568+0000", 2020-11-16T20:56:06.074 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.167131093, 2020-11-16T20:56:06.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021914067999999998, 2020-11-16T20:56:06.074 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:06.074 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:06.074 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:06.074 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:06.075 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:06.075 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2 2020-11-16T20:56:06.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.075 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:06.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.075 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:06.075 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.908568+0000", 2020-11-16T20:56:06.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:06.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.076 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:06.076 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.908568+0000", 2020-11-16T20:56:06.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00088228000000000004 2020-11-16T20:56:06.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:06.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909450+0000", 2020-11-16T20:56:06.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3519999999999999e-05 2020-11-16T20:56:06.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:06.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909463+0000", 2020-11-16T20:56:06.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7048e-05 2020-11-16T20:56:06.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.078 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:06.078 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909481+0000", 2020-11-16T20:56:06.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9990000000000002e-06 2020-11-16T20:56:06.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:06.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909488+0000", 2020-11-16T20:56:06.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3529000000000003e-05 2020-11-16T20:56:06.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909531+0000", 2020-11-16T20:56:06.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3068000000000001e-05 2020-11-16T20:56:06.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.080 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:06.080 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909584+0000", 2020-11-16T20:56:06.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014302456999999999 2020-11-16T20:56:06.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.081 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.081 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.923887+0000", 2020-11-16T20:56:06.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000106143 2020-11-16T20:56:06.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.081 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:06.081 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.923993+0000", 2020-11-16T20:56:06.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013497100000000001 2020-11-16T20:56:06.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:06.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.924128+0000", 2020-11-16T20:56:06.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004911655 2020-11-16T20:56:06.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:06.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.929039+0000", 2020-11-16T20:56:06.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010511899999999999 2020-11-16T20:56:06.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:06.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.929144+0000", 2020-11-16T20:56:06.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012105729999999999 2020-11-16T20:56:06.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:06.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.930355+0000", 2020-11-16T20:56:06.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0148000000000007e-05 2020-11-16T20:56:06.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.085 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:06.085 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.930425+0000", 2020-11-16T20:56:06.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6558000000000003e-05 2020-11-16T20:56:06.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.085 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:06.085 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.930482+0000", 2020-11-16T20:56:06.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021914067999999998 2020-11-16T20:56:06.086 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.086 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:06.086 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.086 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3 4.1 4:9ab04c4a:::smithi16641208-1:head [setxattr _header (55) in=7b,truncate 2016807] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:56:06.086 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:50.909532+0000", 2020-11-16T20:56:06.087 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.166167006, 2020-11-16T20:56:06.087 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021063467999999998, 2020-11-16T20:56:06.087 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:06.087 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:06.087 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:06.087 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:06.087 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:06.088 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3 2020-11-16T20:56:06.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.088 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:06.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:06.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909532+0000", 2020-11-16T20:56:06.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:06.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.089 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.089 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:06.089 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909532+0000", 2020-11-16T20:56:06.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4731000000000003e-05 2020-11-16T20:56:06.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.089 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.089 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:06.089 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909577+0000", 2020-11-16T20:56:06.090 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4577e-05 2020-11-16T20:56:06.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.090 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.090 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:06.090 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909591+0000", 2020-11-16T20:56:06.090 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1420000000000001e-05 2020-11-16T20:56:06.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.091 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.091 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:06.091 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909603+0000", 2020-11-16T20:56:06.091 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7830000000000004e-06 2020-11-16T20:56:06.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.091 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.091 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:06.091 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909608+0000", 2020-11-16T20:56:06.092 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000192685 2020-11-16T20:56:06.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.092 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.092 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.092 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909801+0000", 2020-11-16T20:56:06.092 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0266000000000003e-05 2020-11-16T20:56:06.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.093 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.093 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:06.093 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909851+0000", 2020-11-16T20:56:06.093 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015280820000000001 2020-11-16T20:56:06.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.093 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.093 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.093 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.925132+0000", 2020-11-16T20:56:06.094 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3510999999999995e-05 2020-11-16T20:56:06.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.094 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.094 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:06.094 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.925206+0000", 2020-11-16T20:56:06.094 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5099999999999994e-05 2020-11-16T20:56:06.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.095 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.095 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:06.095 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.925301+0000", 2020-11-16T20:56:06.095 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0038318240000000002 2020-11-16T20:56:06.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.095 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.095 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:06.095 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.929132+0000", 2020-11-16T20:56:06.096 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8430000000000001e-05 2020-11-16T20:56:06.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.096 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.096 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:06.096 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.929151+0000", 2020-11-16T20:56:06.096 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0013663670000000001 2020-11-16T20:56:06.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.097 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.097 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:06.097 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.930517+0000", 2020-11-16T20:56:06.097 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6217999999999998e-05 2020-11-16T20:56:06.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.097 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.097 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:06.097 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.930554+0000", 2020-11-16T20:56:06.098 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1736000000000002e-05 2020-11-16T20:56:06.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.098 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.098 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:06.098 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.930595+0000", 2020-11-16T20:56:06.098 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021063467999999998 2020-11-16T20:56:06.098 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.099 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:06.099 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.099 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.099 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.099 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:4 4.1 4:9ab04c4a:::smithi16641208-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:56:06.099 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:50.909649+0000", 2020-11-16T20:56:06.099 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.16604974, 2020-11-16T20:56:06.099 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023768465999999999, 2020-11-16T20:56:06.100 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:06.100 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:06.100 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:06.100 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:06.100 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:06.100 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 4 2020-11-16T20:56:06.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.101 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:06.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.101 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:06.101 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909649+0000", 2020-11-16T20:56:06.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:06.101 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.101 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:06.102 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909649+0000", 2020-11-16T20:56:06.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0568000000000003e-05 2020-11-16T20:56:06.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.102 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.102 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:06.102 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909680+0000", 2020-11-16T20:56:06.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1929999999999998e-06 2020-11-16T20:56:06.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.103 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:06.103 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909686+0000", 2020-11-16T20:56:06.103 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2179e-05 2020-11-16T20:56:06.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.103 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:06.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909698+0000", 2020-11-16T20:56:06.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2190000000000003e-06 2020-11-16T20:56:06.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:06.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.909703+0000", 2020-11-16T20:56:06.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030855599999999998 2020-11-16T20:56:06.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.105 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.105 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.910012+0000", 2020-11-16T20:56:06.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5745000000000003e-05 2020-11-16T20:56:06.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.105 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.910058+0000", 2020-11-16T20:56:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015477383000000001 2020-11-16T20:56:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.925535+0000", 2020-11-16T20:56:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012808700000000001 2020-11-16T20:56:06.107 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.107 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.107 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:06.107 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.925663+0000", 2020-11-16T20:56:06.107 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049709960000000001 2020-11-16T20:56:06.107 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.107 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.107 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.108 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.930634+0000", 2020-11-16T20:56:06.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022177000000000001 2020-11-16T20:56:06.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.108 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.108 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:06.108 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.930856+0000", 2020-11-16T20:56:06.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0025617700000000001 2020-11-16T20:56:06.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.109 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.109 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:06.109 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.933418+0000", 2020-11-16T20:56:06.109 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023768465999999999 2020-11-16T20:56:06.109 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.109 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:06.109 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.110 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.110 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:183 4.1 4:b6545a47:::smithi16641208-46:head [setxattr _header (56) in=7b,truncate 2756315] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:56:06.110 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.502988+0000", 2020-11-16T20:56:06.110 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.572710347999999, 2020-11-16T20:56:06.110 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029750506999999999, 2020-11-16T20:56:06.110 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:06.111 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:06.111 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:06.111 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:06.111 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:06.111 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 183 2020-11-16T20:56:06.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.111 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:06.111 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.112 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:06.112 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.502988+0000", 2020-11-16T20:56:06.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:06.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.112 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.112 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:06.112 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.502988+0000", 2020-11-16T20:56:06.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4046e-05 2020-11-16T20:56:06.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:06.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503012+0000", 2020-11-16T20:56:06.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1219999999999999e-06 2020-11-16T20:56:06.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.114 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:06.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503016+0000", 2020-11-16T20:56:06.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8220000000000003e-06 2020-11-16T20:56:06.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.114 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:06.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503021+0000", 2020-11-16T20:56:06.115 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.689e-06 2020-11-16T20:56:06.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.115 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.115 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:06.115 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503024+0000", 2020-11-16T20:56:06.115 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024917599999999999 2020-11-16T20:56:06.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.115 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503273+0000", 2020-11-16T20:56:06.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2070999999999998e-05 2020-11-16T20:56:06.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.116 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:06.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503315+0000", 2020-11-16T20:56:06.117 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015620333 2020-11-16T20:56:06.117 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.117 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.117 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.117 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518936+0000", 2020-11-16T20:56:06.117 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014316700000000001 2020-11-16T20:56:06.117 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.117 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.118 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:06.118 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519079+0000", 2020-11-16T20:56:06.118 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000106921 2020-11-16T20:56:06.118 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.118 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.118 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:06.118 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519186+0000", 2020-11-16T20:56:06.119 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01291979 2020-11-16T20:56:06.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.119 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:06.119 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532106+0000", 2020-11-16T20:56:06.119 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00037033699999999999 2020-11-16T20:56:06.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:06.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532476+0000", 2020-11-16T20:56:06.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018681700000000001 2020-11-16T20:56:06.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:06.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532663+0000", 2020-11-16T20:56:06.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0011e-05 2020-11-16T20:56:06.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:06.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532703+0000", 2020-11-16T20:56:06.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6205000000000003e-05 2020-11-16T20:56:06.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.122 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:06.122 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532739+0000", 2020-11-16T20:56:06.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029750506999999999 2020-11-16T20:56:06.122 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.122 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:06.122 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.123 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:184 4.1 4:b6545a47:::smithi16641208-46:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:56:06.123 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.503052+0000", 2020-11-16T20:56:06.123 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.57264674, 2020-11-16T20:56:06.123 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032452030999999999, 2020-11-16T20:56:06.123 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:06.123 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:06.123 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:06.124 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:06.124 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:06.124 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 184 2020-11-16T20:56:06.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.124 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:06.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.124 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:06.124 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503052+0000", 2020-11-16T20:56:06.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:06.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:06.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503052+0000", 2020-11-16T20:56:06.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7108999999999998e-05 2020-11-16T20:56:06.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.126 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:06.126 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503069+0000", 2020-11-16T20:56:06.126 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2590000000000001e-06 2020-11-16T20:56:06.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.126 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:06.126 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503072+0000", 2020-11-16T20:56:06.127 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3119999999999999e-06 2020-11-16T20:56:06.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.127 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.127 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:06.127 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503079+0000", 2020-11-16T20:56:06.127 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6520000000000002e-06 2020-11-16T20:56:06.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.128 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.128 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:06.128 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503081+0000", 2020-11-16T20:56:06.128 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000263331 2020-11-16T20:56:06.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.128 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.128 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.128 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503345+0000", 2020-11-16T20:56:06.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9370000000000002e-05 2020-11-16T20:56:06.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:06.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503404+0000", 2020-11-16T20:56:06.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016025681999999999 2020-11-16T20:56:06.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519430+0000", 2020-11-16T20:56:06.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114862 2020-11-16T20:56:06.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:06.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519545+0000", 2020-11-16T20:56:06.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013224174 2020-11-16T20:56:06.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.131 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.131 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.131 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532769+0000", 2020-11-16T20:56:06.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5945000000000006e-05 2020-11-16T20:56:06.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:06.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532845+0000", 2020-11-16T20:56:06.132 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0026593350000000001 2020-11-16T20:56:06.132 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:06.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.535504+0000", 2020-11-16T20:56:06.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032452030999999999 2020-11-16T20:56:06.133 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.133 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:06.133 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.133 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:186 4.1 4:81558809:::smithi16641208-47:head [write 1992054~651681] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:56:06.133 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.517420+0000", 2020-11-16T20:56:06.134 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.558278668, 2020-11-16T20:56:06.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020789111999999998, 2020-11-16T20:56:06.134 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:06.134 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:06.134 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:06.134 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:06.134 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:06.135 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 186 2020-11-16T20:56:06.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.135 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:06.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.135 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:06.135 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.517420+0000", 2020-11-16T20:56:06.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.517420+0000", 2020-11-16T20:56:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00095766700000000005 2020-11-16T20:56:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518378+0000", 2020-11-16T20:56:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5520000000000005e-06 2020-11-16T20:56:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518386+0000", 2020-11-16T20:56:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6719e-05 2020-11-16T20:56:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518403+0000", 2020-11-16T20:56:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1780000000000001e-05 2020-11-16T20:56:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518415+0000", 2020-11-16T20:56:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0065288209999999998 2020-11-16T20:56:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.524944+0000", 2020-11-16T20:56:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8589000000000001e-05 2020-11-16T20:56:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.525042+0000", 2020-11-16T20:56:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011179300000000001 2020-11-16T20:56:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.525154+0000", 2020-11-16T20:56:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010486807000000001 2020-11-16T20:56:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.535641+0000", 2020-11-16T20:56:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002288478 2020-11-16T20:56:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.537929+0000", 2020-11-16T20:56:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017148 2020-11-16T20:56:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.538101+0000", 2020-11-16T20:56:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2397999999999994e-05 2020-11-16T20:56:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.538163+0000", 2020-11-16T20:56:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6028e-05 2020-11-16T20:56:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.538209+0000", 2020-11-16T20:56:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020789111999999998 2020-11-16T20:56:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:187 4.1 4:81558809:::smithi16641208-47:head [setxattr _header (56) in=7b,truncate 2773122] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:56:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.518465+0000", 2020-11-16T20:56:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.557233708, 2020-11-16T20:56:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019854842000000001, 2020-11-16T20:56:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 187 2020-11-16T20:56:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518465+0000", 2020-11-16T20:56:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518465+0000", 2020-11-16T20:56:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4765999999999998e-05 2020-11-16T20:56:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518510+0000", 2020-11-16T20:56:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2600000000000002e-06 2020-11-16T20:56:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518516+0000", 2020-11-16T20:56:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1122e-05 2020-11-16T20:56:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518527+0000", 2020-11-16T20:56:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.041e-06 2020-11-16T20:56:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518534+0000", 2020-11-16T20:56:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01181623 2020-11-16T20:56:06.153 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.153 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.153 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.153 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.530350+0000", 2020-11-16T20:56:06.153 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000122574 2020-11-16T20:56:06.153 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.153 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.530473+0000", 2020-11-16T20:56:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013381499999999999 2020-11-16T20:56:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.530607+0000", 2020-11-16T20:56:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050979880000000003 2020-11-16T20:56:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.535705+0000", 2020-11-16T20:56:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0022644829999999999 2020-11-16T20:56:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.537969+0000", 2020-11-16T20:56:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027665600000000002 2020-11-16T20:56:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.538246+0000", 2020-11-16T20:56:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6341000000000003e-05 2020-11-16T20:56:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.538282+0000", 2020-11-16T20:56:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7565999999999999e-05 2020-11-16T20:56:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.158 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:06.158 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.538320+0000", 2020-11-16T20:56:06.158 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019854842000000001 2020-11-16T20:56:06.158 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.158 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:06.158 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.158 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.158 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.159 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:188 4.1 4:81558809:::smithi16641208-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:56:06.159 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.518571+0000", 2020-11-16T20:56:06.159 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.557127862, 2020-11-16T20:56:06.159 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020188205000000001, 2020-11-16T20:56:06.159 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:06.159 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:06.159 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:06.160 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:06.160 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:06.160 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 188 2020-11-16T20:56:06.160 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.160 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:06.160 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.160 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:06.160 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518571+0000", 2020-11-16T20:56:06.161 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:06.161 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.161 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.161 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:06.161 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518571+0000", 2020-11-16T20:56:06.161 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0468999999999999e-05 2020-11-16T20:56:06.161 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.162 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:06.162 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518601+0000", 2020-11-16T20:56:06.162 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8640000000000001e-06 2020-11-16T20:56:06.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.162 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:06.162 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518607+0000", 2020-11-16T20:56:06.163 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0756e-05 2020-11-16T20:56:06.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.163 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.163 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:06.163 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518618+0000", 2020-11-16T20:56:06.163 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.707e-06 2020-11-16T20:56:06.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.164 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.164 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:06.164 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.518623+0000", 2020-11-16T20:56:06.164 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012452283 2020-11-16T20:56:06.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.164 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.164 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.164 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.531075+0000", 2020-11-16T20:56:06.165 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3591999999999995e-05 2020-11-16T20:56:06.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.165 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.165 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:06.165 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.531159+0000", 2020-11-16T20:56:06.165 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0071979870000000003 2020-11-16T20:56:06.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.166 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.166 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.166 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.538357+0000", 2020-11-16T20:56:06.166 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000130765 2020-11-16T20:56:06.166 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.166 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.166 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:06.166 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.538487+0000", 2020-11-16T20:56:06.167 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027178199999999998 2020-11-16T20:56:06.167 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.167 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.167 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:06.167 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.538759+0000", 2020-11-16T20:56:06.167 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020188205000000001 2020-11-16T20:56:06.167 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.168 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:06.168 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.168 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.168 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.168 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:190 4.1 4:9bd9f31d:::smithi16641208-48:head [write 2050536~739393] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:56:06.168 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.533224+0000", 2020-11-16T20:56:06.168 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.542474873, 2020-11-16T20:56:06.168 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020522064999999999, 2020-11-16T20:56:06.169 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:06.169 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:06.169 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:06.169 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:06.169 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:06.169 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 190 2020-11-16T20:56:06.169 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.170 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:06.170 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.170 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:06.170 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.533224+0000", 2020-11-16T20:56:06.170 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:06.170 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.170 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.170 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:06.171 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.533224+0000", 2020-11-16T20:56:06.171 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00081165199999999995 2020-11-16T20:56:06.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.171 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.171 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:06.171 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534036+0000", 2020-11-16T20:56:06.171 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1900000000000003e-06 2020-11-16T20:56:06.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.172 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.172 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:06.172 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534041+0000", 2020-11-16T20:56:06.172 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.696e-06 2020-11-16T20:56:06.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.172 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.173 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:06.173 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534050+0000", 2020-11-16T20:56:06.173 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.553e-06 2020-11-16T20:56:06.173 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.173 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.173 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:06.173 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534056+0000", 2020-11-16T20:56:06.173 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014711769999999999 2020-11-16T20:56:06.174 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.174 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.174 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.174 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.535527+0000", 2020-11-16T20:56:06.174 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5160000000000002e-05 2020-11-16T20:56:06.174 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.174 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.175 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:06.175 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.535562+0000", 2020-11-16T20:56:06.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0093947040000000002 2020-11-16T20:56:06.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.175 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.175 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.544957+0000", 2020-11-16T20:56:06.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0178000000000003e-05 2020-11-16T20:56:06.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:06.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.545047+0000", 2020-11-16T20:56:06.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000111687 2020-11-16T20:56:06.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:06.177 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.545159+0000", 2020-11-16T20:56:06.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008033419 2020-11-16T20:56:06.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:06.177 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.553192+0000", 2020-11-16T20:56:06.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000232372 2020-11-16T20:56:06.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.178 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:06.178 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.553425+0000", 2020-11-16T20:56:06.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024492399999999999 2020-11-16T20:56:06.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.179 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:06.179 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.553670+0000", 2020-11-16T20:56:06.179 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8164000000000002e-05 2020-11-16T20:56:06.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.179 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.179 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:06.179 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.553718+0000", 2020-11-16T20:56:06.179 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8189000000000001e-05 2020-11-16T20:56:06.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:06.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.553746+0000", 2020-11-16T20:56:06.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020522064999999999 2020-11-16T20:56:06.180 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.180 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:06.181 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.181 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.181 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:191 4.1 4:9bd9f31d:::smithi16641208-48:head [setxattr _header (56) in=7b,truncate 2789929] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:56:06.181 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.534076+0000", 2020-11-16T20:56:06.181 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.541622988, 2020-11-16T20:56:06.181 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019848184000000001, 2020-11-16T20:56:06.181 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:06.182 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:06.182 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:06.182 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:06.182 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:06.182 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 191 2020-11-16T20:56:06.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.182 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:06.183 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.183 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:06.183 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534076+0000", 2020-11-16T20:56:06.183 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:06.183 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.183 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.183 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:06.183 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534076+0000", 2020-11-16T20:56:06.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2396999999999999e-05 2020-11-16T20:56:06.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.184 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:06.184 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534098+0000", 2020-11-16T20:56:06.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2200000000000001e-06 2020-11-16T20:56:06.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.185 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:06.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534101+0000", 2020-11-16T20:56:06.185 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4469999999999997e-06 2020-11-16T20:56:06.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.185 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:06.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534107+0000", 2020-11-16T20:56:06.186 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6110000000000001e-06 2020-11-16T20:56:06.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.186 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.186 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:06.186 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534109+0000", 2020-11-16T20:56:06.186 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0016345800000000001 2020-11-16T20:56:06.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.187 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.187 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.187 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.535744+0000", 2020-11-16T20:56:06.187 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2768e-05 2020-11-16T20:56:06.187 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.187 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.187 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:06.187 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.535797+0000", 2020-11-16T20:56:06.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010322687000000001 2020-11-16T20:56:06.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.188 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.546120+0000", 2020-11-16T20:56:06.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7729000000000001e-05 2020-11-16T20:56:06.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:06.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.546197+0000", 2020-11-16T20:56:06.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010100800000000001 2020-11-16T20:56:06.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:06.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.546298+0000", 2020-11-16T20:56:06.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070115330000000003 2020-11-16T20:56:06.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.190 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:06.190 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.553310+0000", 2020-11-16T20:56:06.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019339300000000001 2020-11-16T20:56:06.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.191 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.191 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:06.191 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.553503+0000", 2020-11-16T20:56:06.191 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027218199999999999 2020-11-16T20:56:06.191 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.191 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.191 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:06.191 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.553775+0000", 2020-11-16T20:56:06.192 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1480000000000002e-05 2020-11-16T20:56:06.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.192 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:06.192 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.553827+0000", 2020-11-16T20:56:06.192 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7149000000000001e-05 2020-11-16T20:56:06.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:06.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.553924+0000", 2020-11-16T20:56:06.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019848184000000001 2020-11-16T20:56:06.193 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.193 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:06.193 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.194 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:192 4.1 4:9bd9f31d:::smithi16641208-48:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:56:06.194 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.534127+0000", 2020-11-16T20:56:06.194 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.541572113000001, 2020-11-16T20:56:06.194 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020369108, 2020-11-16T20:56:06.194 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:06.194 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:06.194 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:06.195 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:06.195 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:06.195 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 192 2020-11-16T20:56:06.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.195 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:06.195 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.195 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:06.196 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534127+0000", 2020-11-16T20:56:06.196 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:06.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.196 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.196 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:06.196 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534127+0000", 2020-11-16T20:56:06.196 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4786e-05 2020-11-16T20:56:06.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:06.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534141+0000", 2020-11-16T20:56:06.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9780000000000001e-06 2020-11-16T20:56:06.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:06.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534144+0000", 2020-11-16T20:56:06.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8170000000000004e-06 2020-11-16T20:56:06.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:06.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534150+0000", 2020-11-16T20:56:06.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.277e-06 2020-11-16T20:56:06.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.199 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:06.199 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534153+0000", 2020-11-16T20:56:06.199 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001673892 2020-11-16T20:56:06.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.199 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.200 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.535826+0000", 2020-11-16T20:56:06.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9031e-05 2020-11-16T20:56:06.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.200 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.200 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:06.200 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.535855+0000", 2020-11-16T20:56:06.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010653924 2020-11-16T20:56:06.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.546509+0000", 2020-11-16T20:56:06.201 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0140000000000002e-05 2020-11-16T20:56:06.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:06.202 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.546590+0000", 2020-11-16T20:56:06.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073883509999999996 2020-11-16T20:56:06.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.202 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.553978+0000", 2020-11-16T20:56:06.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000133027 2020-11-16T20:56:06.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.203 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.203 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:06.203 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.554111+0000", 2020-11-16T20:56:06.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00038488500000000001 2020-11-16T20:56:06.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.203 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.203 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:06.204 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.554496+0000", 2020-11-16T20:56:06.204 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020369108 2020-11-16T20:56:06.204 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.204 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:06.204 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.204 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.204 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.204 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:1004 4.1 4:be507de1:::smithi16641208-224:head [setxattr _header (57) in=7b,truncate 3747961] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:06.205 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.532969+0000", 2020-11-16T20:56:06.205 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.542730167, 2020-11-16T20:56:06.205 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024559619000000001, 2020-11-16T20:56:06.205 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:06.205 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:06.205 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:06.205 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:06.206 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:06.206 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1004 2020-11-16T20:56:06.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.206 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:06.206 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.206 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:06.206 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.532969+0000", 2020-11-16T20:56:06.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:06.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:06.207 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.532969+0000", 2020-11-16T20:56:06.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2059999999999999e-05 2020-11-16T20:56:06.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:06.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.532991+0000", 2020-11-16T20:56:06.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1200000000000002e-06 2020-11-16T20:56:06.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:06.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.532994+0000", 2020-11-16T20:56:06.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4489999999999998e-06 2020-11-16T20:56:06.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:06.209 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.532999+0000", 2020-11-16T20:56:06.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6879999999999999e-06 2020-11-16T20:56:06.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:06.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.533002+0000", 2020-11-16T20:56:06.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030528899999999998 2020-11-16T20:56:06.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.533307+0000", 2020-11-16T20:56:06.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0117000000000006e-05 2020-11-16T20:56:06.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.211 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:06.211 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.533387+0000", 2020-11-16T20:56:06.211 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016762563000000001 2020-11-16T20:56:06.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.211 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.550150+0000", 2020-11-16T20:56:06.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000167782 2020-11-16T20:56:06.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.212 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:06.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.550318+0000", 2020-11-16T20:56:06.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000200127 2020-11-16T20:56:06.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.213 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:06.213 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.550518+0000", 2020-11-16T20:56:06.213 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060820880000000003 2020-11-16T20:56:06.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.213 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:06.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.556600+0000", 2020-11-16T20:56:06.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00076796999999999998 2020-11-16T20:56:06.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:06.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.557368+0000", 2020-11-16T20:56:06.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5091e-05 2020-11-16T20:56:06.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.215 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.215 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:06.215 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.557403+0000", 2020-11-16T20:56:06.215 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1698000000000003e-05 2020-11-16T20:56:06.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.215 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.215 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:06.216 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.557485+0000", 2020-11-16T20:56:06.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3577e-05 2020-11-16T20:56:06.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:06.216 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.557528+0000", 2020-11-16T20:56:06.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024559619000000001 2020-11-16T20:56:06.217 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.217 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:06.217 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.217 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:1005 4.1 4:be507de1:::smithi16641208-224:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:56:06.217 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.533021+0000", 2020-11-16T20:56:06.217 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.542677291, 2020-11-16T20:56:06.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026389474, 2020-11-16T20:56:06.218 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:06.218 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:06.218 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:06.218 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:06.218 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:06.218 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1005 2020-11-16T20:56:06.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.219 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:06.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.219 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:06.219 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.533021+0000", 2020-11-16T20:56:06.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:06.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:06.220 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.533021+0000", 2020-11-16T20:56:06.220 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4973e-05 2020-11-16T20:56:06.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:06.220 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.533036+0000", 2020-11-16T20:56:06.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.005e-06 2020-11-16T20:56:06.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:06.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.533039+0000", 2020-11-16T20:56:06.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8259999999999998e-06 2020-11-16T20:56:06.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:06.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.533045+0000", 2020-11-16T20:56:06.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.599e-06 2020-11-16T20:56:06.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:06.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.533048+0000", 2020-11-16T20:56:06.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000366127 2020-11-16T20:56:06.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.533414+0000", 2020-11-16T20:56:06.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6974999999999998e-05 2020-11-16T20:56:06.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.224 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:06.224 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.533451+0000", 2020-11-16T20:56:06.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017437446999999998 2020-11-16T20:56:06.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.224 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.224 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.550888+0000", 2020-11-16T20:56:06.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000125792 2020-11-16T20:56:06.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:06.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.551014+0000", 2020-11-16T20:56:06.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0065486909999999997 2020-11-16T20:56:06.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.557563+0000", 2020-11-16T20:56:06.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9114000000000002e-05 2020-11-16T20:56:06.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:06.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.557642+0000", 2020-11-16T20:56:06.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001768925 2020-11-16T20:56:06.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:06.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.559411+0000", 2020-11-16T20:56:06.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026389474 2020-11-16T20:56:06.227 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.227 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:06.228 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.228 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:1010 4.1 4:b0e01256:::smithi16641208-225:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:56:06.228 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.553023+0000", 2020-11-16T20:56:06.228 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.522676152000001, 2020-11-16T20:56:06.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027571351000000001, 2020-11-16T20:56:06.229 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:06.229 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:06.229 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:06.229 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:06.229 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:06.229 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1010 2020-11-16T20:56:06.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.229 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:06.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.230 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:06.230 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.553023+0000", 2020-11-16T20:56:06.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:06.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.230 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:06.231 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.553023+0000", 2020-11-16T20:56:06.231 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5097e-05 2020-11-16T20:56:06.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.231 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:06.231 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.553038+0000", 2020-11-16T20:56:06.231 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7530000000000002e-06 2020-11-16T20:56:06.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.232 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:06.232 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.553040+0000", 2020-11-16T20:56:06.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5899999999999998e-06 2020-11-16T20:56:06.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.232 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:06.232 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.553046+0000", 2020-11-16T20:56:06.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4040000000000002e-06 2020-11-16T20:56:06.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:06.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.553048+0000", 2020-11-16T20:56:06.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000325762 2020-11-16T20:56:06.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.234 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.234 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.553374+0000", 2020-11-16T20:56:06.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2778999999999999e-05 2020-11-16T20:56:06.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.234 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:06.235 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.553407+0000", 2020-11-16T20:56:06.235 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016312167999999998 2020-11-16T20:56:06.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.235 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.235 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.569719+0000", 2020-11-16T20:56:06.235 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016948000000000001 2020-11-16T20:56:06.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.236 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:06.236 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.569889+0000", 2020-11-16T20:56:06.236 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0092219190000000003 2020-11-16T20:56:06.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.236 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.236 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.579111+0000", 2020-11-16T20:56:06.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3689999999999994e-05 2020-11-16T20:56:06.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:06.237 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.579184+0000", 2020-11-16T20:56:06.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014097090000000001 2020-11-16T20:56:06.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:06.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.580594+0000", 2020-11-16T20:56:06.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027571351000000001 2020-11-16T20:56:06.238 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.238 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:06.238 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.239 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:1395 4.1 4:90f27223:::smithi16641208-314:head [write 2729279~440140] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:06.239 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:55.932164+0000", 2020-11-16T20:56:06.239 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.143534834, 2020-11-16T20:56:06.239 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020447857999999999, 2020-11-16T20:56:06.239 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:06.239 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:06.240 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:06.240 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:06.240 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:06.240 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1395 2020-11-16T20:56:06.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.240 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:06.240 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.240 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:06.241 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932164+0000", 2020-11-16T20:56:06.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:06.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.241 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:06.241 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932164+0000", 2020-11-16T20:56:06.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00040945199999999998 2020-11-16T20:56:06.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:06.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932573+0000", 2020-11-16T20:56:06.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2610000000000001e-06 2020-11-16T20:56:06.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:06.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932579+0000", 2020-11-16T20:56:06.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2048999999999999e-05 2020-11-16T20:56:06.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.243 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:06.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932591+0000", 2020-11-16T20:56:06.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1419999999999998e-06 2020-11-16T20:56:06.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.244 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:06.244 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932597+0000", 2020-11-16T20:56:06.244 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6355e-05 2020-11-16T20:56:06.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.244 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.245 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932633+0000", 2020-11-16T20:56:06.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9140999999999997e-05 2020-11-16T20:56:06.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.245 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.245 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:06.245 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932672+0000", 2020-11-16T20:56:06.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012168481 2020-11-16T20:56:06.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.246 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.944841+0000", 2020-11-16T20:56:06.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000151595 2020-11-16T20:56:06.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:06.246 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.944992+0000", 2020-11-16T20:56:06.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000181187 2020-11-16T20:56:06.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:06.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.945174+0000", 2020-11-16T20:56:06.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0065972560000000001 2020-11-16T20:56:06.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.248 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:06.248 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.951771+0000", 2020-11-16T20:56:06.248 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000478849 2020-11-16T20:56:06.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.248 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:06.248 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.952250+0000", 2020-11-16T20:56:06.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023924100000000001 2020-11-16T20:56:06.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.249 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:06.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.952489+0000", 2020-11-16T20:56:06.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7015999999999997e-05 2020-11-16T20:56:06.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:06.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.952556+0000", 2020-11-16T20:56:06.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5832999999999999e-05 2020-11-16T20:56:06.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:06.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.952612+0000", 2020-11-16T20:56:06.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020447857999999999 2020-11-16T20:56:06.251 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.251 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:06.251 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.251 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:1396 4.1 4:90f27223:::smithi16641208-314:head [setxattr _header (57) in=7b,truncate 3260591] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:06.252 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:55.932620+0000", 2020-11-16T20:56:06.252 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.143078906, 2020-11-16T20:56:06.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020116397000000001, 2020-11-16T20:56:06.252 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:06.252 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:06.252 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:06.252 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:06.252 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:06.253 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1396 2020-11-16T20:56:06.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.253 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:06.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.253 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:06.253 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932620+0000", 2020-11-16T20:56:06.253 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:06.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:06.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932620+0000", 2020-11-16T20:56:06.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4824000000000002e-05 2020-11-16T20:56:06.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:06.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932645+0000", 2020-11-16T20:56:06.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.241e-06 2020-11-16T20:56:06.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:06.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932648+0000", 2020-11-16T20:56:06.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6099999999999997e-06 2020-11-16T20:56:06.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:06.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932654+0000", 2020-11-16T20:56:06.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.405e-06 2020-11-16T20:56:06.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:06.257 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932657+0000", 2020-11-16T20:56:06.257 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2293000000000003e-05 2020-11-16T20:56:06.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.257 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.257 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.257 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932699+0000", 2020-11-16T20:56:06.257 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2019000000000003e-05 2020-11-16T20:56:06.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.258 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:06.258 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932771+0000", 2020-11-16T20:56:06.258 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01338723 2020-11-16T20:56:06.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.258 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.259 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.946158+0000", 2020-11-16T20:56:06.259 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016052699999999999 2020-11-16T20:56:06.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.259 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:06.259 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.946319+0000", 2020-11-16T20:56:06.259 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000182404 2020-11-16T20:56:06.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:06.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.946501+0000", 2020-11-16T20:56:06.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053645849999999998 2020-11-16T20:56:06.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:06.261 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.951866+0000", 2020-11-16T20:56:06.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00042421599999999999 2020-11-16T20:56:06.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:06.261 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.952290+0000", 2020-11-16T20:56:06.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00036755700000000002 2020-11-16T20:56:06.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.262 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:06.262 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.952658+0000", 2020-11-16T20:56:06.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1888999999999998e-05 2020-11-16T20:56:06.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.262 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:06.263 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.952700+0000", 2020-11-16T20:56:06.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6597000000000002e-05 2020-11-16T20:56:06.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.263 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:06.263 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.952736+0000", 2020-11-16T20:56:06.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020116397000000001 2020-11-16T20:56:06.263 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.264 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:06.264 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.264 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:1397 4.1 4:90f27223:::smithi16641208-314:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:56:06.264 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:55.932676+0000", 2020-11-16T20:56:06.264 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.143023092, 2020-11-16T20:56:06.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020566254999999999, 2020-11-16T20:56:06.265 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:06.265 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:06.265 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:06.265 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:06.265 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:06.265 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1397 2020-11-16T20:56:06.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.266 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:06.266 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.266 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:06.266 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932676+0000", 2020-11-16T20:56:06.266 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:06.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.266 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.267 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:06.267 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932676+0000", 2020-11-16T20:56:06.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5418e-05 2020-11-16T20:56:06.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.267 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.267 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:06.267 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932691+0000", 2020-11-16T20:56:06.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4599999999999999e-06 2020-11-16T20:56:06.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.268 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:06.268 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932695+0000", 2020-11-16T20:56:06.268 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8589999999999994e-06 2020-11-16T20:56:06.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.269 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:06.269 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932703+0000", 2020-11-16T20:56:06.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9999999999999998e-06 2020-11-16T20:56:06.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.269 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:06.269 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932707+0000", 2020-11-16T20:56:06.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2159999999999999e-05 2020-11-16T20:56:06.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.270 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.270 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932800+0000", 2020-11-16T20:56:06.270 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4050000000000001e-05 2020-11-16T20:56:06.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.270 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:06.271 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.932834+0000", 2020-11-16T20:56:06.271 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014268094 2020-11-16T20:56:06.271 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.271 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.271 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.271 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.947102+0000", 2020-11-16T20:56:06.271 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011844 2020-11-16T20:56:06.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.272 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.272 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:06.272 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.947220+0000", 2020-11-16T20:56:06.272 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055706100000000001 2020-11-16T20:56:06.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.272 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.272 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.273 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.952791+0000", 2020-11-16T20:56:06.273 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000143843 2020-11-16T20:56:06.273 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.273 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.273 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:06.273 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.952935+0000", 2020-11-16T20:56:06.273 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030732099999999999 2020-11-16T20:56:06.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.274 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.274 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:06.274 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:55.953242+0000", 2020-11-16T20:56:06.274 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020566254999999999 2020-11-16T20:56:06.274 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.274 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:06.274 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.275 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.275 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2370 4.1 4:82bb0fe7:::smithi16641208-101:head [write 2346424~426830] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:06.275 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:56:06.275 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.0214155170000001, 2020-11-16T20:56:06.275 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04706581, 2020-11-16T20:56:06.275 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:06.275 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:06.276 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:06.276 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:06.276 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:06.276 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2370 2020-11-16T20:56:06.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.276 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:06.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.277 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:06.277 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:56:06.277 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:06.277 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.277 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.277 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:06.277 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:56:06.277 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011081520000000001 2020-11-16T20:56:06.278 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.278 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.278 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:06.278 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055391+0000", 2020-11-16T20:56:06.278 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8289999999999996e-06 2020-11-16T20:56:06.278 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.278 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.279 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:06.279 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055397+0000", 2020-11-16T20:56:06.279 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7599999999999997e-06 2020-11-16T20:56:06.279 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.279 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.279 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:06.279 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055407+0000", 2020-11-16T20:56:06.279 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4180000000000002e-06 2020-11-16T20:56:06.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.280 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.280 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:06.280 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055413+0000", 2020-11-16T20:56:06.280 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1767000000000001e-05 2020-11-16T20:56:06.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.280 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.281 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.281 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055465+0000", 2020-11-16T20:56:06.281 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1916999999999998e-05 2020-11-16T20:56:06.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.281 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.281 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:06.281 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055517+0000", 2020-11-16T20:56:06.281 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027302192999999999 2020-11-16T20:56:06.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.282 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.282 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.282 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.082819+0000", 2020-11-16T20:56:06.282 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013272199999999999 2020-11-16T20:56:06.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.282 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.283 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:06.283 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.082952+0000", 2020-11-16T20:56:06.283 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000218574 2020-11-16T20:56:06.283 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.283 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.283 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:06.283 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083171+0000", 2020-11-16T20:56:06.283 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016037374 2020-11-16T20:56:06.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.284 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.284 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:06.284 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099208+0000", 2020-11-16T20:56:06.284 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001621248 2020-11-16T20:56:06.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.284 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.284 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:06.285 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100829+0000", 2020-11-16T20:56:06.285 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039884700000000003 2020-11-16T20:56:06.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.285 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:06.285 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101228+0000", 2020-11-16T20:56:06.285 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1977000000000006e-05 2020-11-16T20:56:06.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.286 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:06.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101300+0000", 2020-11-16T20:56:06.286 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9032000000000001e-05 2020-11-16T20:56:06.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.286 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:06.287 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101349+0000", 2020-11-16T20:56:06.287 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04706581 2020-11-16T20:56:06.287 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.287 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:06.287 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.287 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.288 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2371 4.1 4:82bb0fe7:::smithi16641208-101:head [setxattr _header (57) in=7b,truncate 2773254] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:06.288 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.055441+0000", 2020-11-16T20:56:06.288 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.0202576000000001, 2020-11-16T20:56:06.288 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046178253000000002, 2020-11-16T20:56:06.288 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:06.288 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:06.288 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:06.288 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:06.289 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:06.289 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2371 2020-11-16T20:56:06.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.289 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:06.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:06.289 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055441+0000", 2020-11-16T20:56:06.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:06.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.290 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:06.290 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055441+0000", 2020-11-16T20:56:06.290 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4688999999999999e-05 2020-11-16T20:56:06.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.291 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:06.291 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055476+0000", 2020-11-16T20:56:06.291 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8220000000000003e-06 2020-11-16T20:56:06.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.291 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.291 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:06.291 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055482+0000", 2020-11-16T20:56:06.291 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0340000000000002e-06 2020-11-16T20:56:06.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.292 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.292 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:06.292 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055488+0000", 2020-11-16T20:56:06.292 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.49e-06 2020-11-16T20:56:06.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.292 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.293 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:06.293 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055491+0000", 2020-11-16T20:56:06.293 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6255999999999998e-05 2020-11-16T20:56:06.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.293 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.293 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055547+0000", 2020-11-16T20:56:06.293 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6068000000000005e-05 2020-11-16T20:56:06.294 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.294 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.294 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:06.294 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055614+0000", 2020-11-16T20:56:06.294 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.028667674000000001 2020-11-16T20:56:06.294 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.294 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.295 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.295 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084281+0000", 2020-11-16T20:56:06.295 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000104868 2020-11-16T20:56:06.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.295 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.295 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:06.295 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084386+0000", 2020-11-16T20:56:06.295 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015165799999999999 2020-11-16T20:56:06.296 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.296 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.296 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:06.296 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084538+0000", 2020-11-16T20:56:06.296 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014678207 2020-11-16T20:56:06.296 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.296 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.297 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:06.297 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099216+0000", 2020-11-16T20:56:06.297 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0016622550000000001 2020-11-16T20:56:06.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.297 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.297 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:06.297 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100878+0000", 2020-11-16T20:56:06.297 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00061087000000000001 2020-11-16T20:56:06.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.298 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.298 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:06.298 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101489+0000", 2020-11-16T20:56:06.298 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0320000000000004e-05 2020-11-16T20:56:06.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.298 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.298 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:06.299 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101559+0000", 2020-11-16T20:56:06.299 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0041999999999999e-05 2020-11-16T20:56:06.299 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.299 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.299 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:06.299 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101619+0000", 2020-11-16T20:56:06.299 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046178253000000002 2020-11-16T20:56:06.300 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.300 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:06.300 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.300 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.300 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.300 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2372 4.1 4:82bb0fe7:::smithi16641208-101:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e42)", 2020-11-16T20:56:06.300 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:56:06.300 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.020186571, 2020-11-16T20:56:06.301 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046557016999999999, 2020-11-16T20:56:06.301 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:06.301 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:06.301 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:06.301 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:06.301 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:06.301 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2372 2020-11-16T20:56:06.302 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.302 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:06.302 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.302 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:06.302 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:56:06.302 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:06.302 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.302 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.303 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:06.303 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:56:06.303 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9907000000000001e-05 2020-11-16T20:56:06.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.303 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.303 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:06.303 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055532+0000", 2020-11-16T20:56:06.303 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0599999999999999e-06 2020-11-16T20:56:06.304 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.304 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.304 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:06.304 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055535+0000", 2020-11-16T20:56:06.304 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1430000000000003e-06 2020-11-16T20:56:06.304 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.304 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.305 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:06.305 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055541+0000", 2020-11-16T20:56:06.305 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6819999999999999e-06 2020-11-16T20:56:06.305 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.305 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.305 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:06.305 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055544+0000", 2020-11-16T20:56:06.305 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000102643 2020-11-16T20:56:06.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.306 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.306 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.306 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055647+0000", 2020-11-16T20:56:06.306 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7197000000000003e-05 2020-11-16T20:56:06.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.306 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.307 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:06.307 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055684+0000", 2020-11-16T20:56:06.307 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029347807 2020-11-16T20:56:06.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.307 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.307 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.085032+0000", 2020-11-16T20:56:06.307 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6130000000000005e-05 2020-11-16T20:56:06.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.308 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:06.308 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.085108+0000", 2020-11-16T20:56:06.308 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016542980999999998 2020-11-16T20:56:06.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.309 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:06.309 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101651+0000", 2020-11-16T20:56:06.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000118733 2020-11-16T20:56:06.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.309 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.309 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:06.309 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101769+0000", 2020-11-16T20:56:06.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029973400000000001 2020-11-16T20:56:06.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:06.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:06.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:06.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.102069+0000", 2020-11-16T20:56:06.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046557016999999999 2020-11-16T20:56:06.310 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.310 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:06.311 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.311 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:06.311 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:06.311 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:06.312 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:56:06.313 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:56:06.313 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:56:06.313 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:56:06.313 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:06.317+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:06.314 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:56:06.324 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:56:06.344 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:56:06.354 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:56:06.354 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:56:06.355 INFO:tasks.thrashosds.thrasher:Shrinking pool device_health_metrics 2020-11-16T20:56:06.355 INFO:tasks.ceph.ceph_manager.ceph:contract_pool device_health_metrics by 10 min 8 2020-11-16T20:56:06.355 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-16T20:56:06.363 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:56:06.364 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:56:06.365 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:56:06.365 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:56:06.365 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:56:06.365 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:56:06.365 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:56:06.366 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:56:06.366 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:56:06.412 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:06.417+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:06.488 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:06.489 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:06.498 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:56:06.514 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:06.519+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:06.615 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:06.619+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:06.647 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:56:06.648 INFO:teuthology.orchestra.run.smithi166.stderr:dumped all 2020-11-16T20:56:06.659 INFO:teuthology.orchestra.run.smithi166.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2020-11-16T20:56:05.986130+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1742243909,"num_objects":643,"num_object_clones":14,"num_object_copies":1929,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":607,"num_whiteouts":4,"num_read":1207,"num_read_kb":90535,"num_write":2310,"num_write_kb":738420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":21,"num_flush_kb":58983,"num_evict":0,"num_evict_kb":0,"num_promote":128,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1969,"ondisk_log_size":1969,"up":81,"acting":81,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2844828,"kb_used_data":2775452,"kb_used_omap":0,"kb_used_meta":69312,"kb_avail":752129892,"statfs":{"total":773094113280,"available":770181009408,"internally_reserved":0,"allocated":2842062848,"data_stored":2835902434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":70975488},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":378885954,"num_objects":132,"num_object_clones":14,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":4,"num_read":301,"num_read_kb":90136,"num_write":517,"num_write_kb":197000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":10,"num_flush_kb":30467,"num_evict":0,"num_evict_kb":0,"num_promote":17,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.030549"},"pg_stats":[{"pgid":"2.11","version":"0'0","reported_seq":"14","reported_epoch":"38","state":"active+clean","last_fresh":"2020-11-16T20:56:00.954189+0000","last_change":"2020-11-16T20:55:52.916697+0000","last_active":"2020-11-16T20:56:00.954189+0000","last_peered":"2020-11-16T20:56:00.954189+0000","last_clean":"2020-11-16T20:56:00.954189+0000","last_became_active":"2020-11-16T20:55:52.916223+0000","last_became_peered":"2020-11-16T20:55:52.916223+0000","last_unstale":"2020-11-16T20:56:00.954189+0000","last_undegraded":"2020-11-16T20:56:00.954189+0000","last_fullsized":"2020-11-16T20:56:00.954189+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"17","reported_epoch":"38","state":"active+clean","last_fresh":"2020-11-16T20:56:01.009293+0000","last_change":"2020-11-16T20:55:59.416734+0000","last_active":"2020-11-16T20:56:01.009293+0000","last_peered":"2020-11-16T20:56:01.009293+0000","last_clean":"2020-11-16T20:56:01.009293+0000","last_became_active":"2020-11-16T20:55:52.921860+0000","last_became_peered":"2020-11-16T20:55:52.921860+0000","last_unstale":"2020-11-16T20:56:01.009293+0000","last_undegraded":"2020-11-16T20:56:01.009293+0000","last_fullsized":"2020-11-16T20:56:01.009293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.416654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.416654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":"17","reported_epoch":"38","state":"active+clean","last_fresh":"2020-11-16T20:56:00.970934+0000","last_change":"2020-11-16T20:55:56.438524+0000","last_active":"2020-11-16T20:56:00.970934+0000","last_peered":"2020-11-16T20:56:00.970934+0000","last_clean":"2020-11-16T20:56:00.970934+0000","last_became_active":"2020-11-16T20:55:52.922023+0000","last_became_peered":"2020-11-16T20:55:52.922023+0000","last_unstale":"2020-11-16T20:56:00.970934+0000","last_undegraded":"2020-11-16T20:56:00.970934+0000","last_fullsized":"2020-11-16T20:56:00.970934+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:56.438428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:56.438428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":"14","reported_epoch":"38","state":"active+clean","last_fresh":"2020-11-16T20:56:01.009318+0000","last_change":"2020-11-16T20:55:52.921644+0000","last_active":"2020-11-16T20:56:01.009318+0000","last_peered":"2020-11-16T20:56:01.009318+0000","last_clean":"2020-11-16T20:56:01.009318+0000","last_became_active":"2020-11-16T20:55:52.921111+0000","last_became_peered":"2020-11-16T20:55:52.921111+0000","last_unstale":"2020-11-16T20:56:01.009318+0000","last_undegraded":"2020-11-16T20:56:01.009318+0000","last_fullsized":"2020-11-16T20:56:01.009318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"14","reported_epoch":"38","state":"active+clean","last_fresh":"2020-11-16T20:56:00.946565+0000","last_change":"2020-11-16T20:55:52.923475+0000","last_active":"2020-11-16T20:56:00.946565+0000","last_peered":"2020-11-16T20:56:00.946565+0000","last_clean":"2020-11-16T20:56:00.946565+0000","last_became_active":"2020-11-16T20:55:52.922134+0000","last_became_peered":"2020-11-16T20:55:52.922134+0000","last_unstale":"2020-11-16T20:56:00.946565+0000","last_undegraded":"2020-11-16T20:56:00.946565+0000","last_fullsized":"2020-11-16T20:56:00.946565+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"14","reported_epoch":"38","state":"active+clean","last_fresh":"2020-11-16T20:56:01.009308+0000","last_change":"2020-11-16T20:55:52.920956+0000","last_active":"2020-11-16T20:56:01.009308+0000","last_peered":"2020-11-16T20:56:01.009308+0000","last_clean":"2020-11-16T20:56:01.009308+0000","last_became_active":"2020-11-16T20:55:52.920496+0000","last_became_peered":"2020-11-16T20:55:52.920496+0000","last_unstale":"2020-11-16T20:56:01.009308+0000","last_undegraded":"2020-11-16T20:56:01.009308+0000","last_fullsized":"2020-11-16T20:56:01.009308+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"40","reported_epoch":"38","state":"active+clean","last_fresh":"2020-11-16T20:56:00.944230+0000","last_change":"2020-11-16T20:55:52.918053+0000","last_active":"2020-11-16T20:56:00.944230+0000","last_peered":"2020-11-16T20:56:00.944230+0000","last_clean":"2020-11-16T20:56:00.944230+0000","last_became_active":"2020-11-16T20:55:52.917496+0000","last_became_peered":"2020-11-16T20:55:52.917496+0000","last_unstale":"2020-11-16T20:56:00.944230+0000","last_undegraded":"2020-11-16T20:56:00.944230+0000","last_fullsized":"2020-11-16T20:56:00.944230+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"43","reported_epoch":"38","state":"active+clean","last_fresh":"2020-11-16T20:56:01.955760+0000","last_change":"2020-11-16T20:56:01.955760+0000","last_active":"2020-11-16T20:56:01.955760+0000","last_peered":"2020-11-16T20:56:01.955760+0000","last_clean":"2020-11-16T20:56:01.955760+0000","last_became_active":"2020-11-16T20:55:52.922447+0000","last_became_peered":"2020-11-16T20:55:52.922447+0000","last_unstale":"2020-11-16T20:56:01.955760+0000","last_undegraded":"2020-11-16T20:56:01.955760+0000","last_fullsized":"2020-11-16T20:56:01.955760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:01.955691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:01.955691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"17","reported_epoch":"38","state":"active+clean","last_fresh":"2020-11-16T20:56:00.967620+0000","last_change":"2020-11-16T20:56:00.967620+0000","last_active":"2020-11-16T20:56:00.967620+0000","last_peered":"2020-11-16T20:56:00.967620+0000","last_clean":"2020-11-16T20:56:00.967620+0000","last_became_active":"2020-11-16T20:55:52.926407+0000","last_became_peered":"2020-11-16T20:55:52.926407+0000","last_unstale":"2020-11-16T20:56:00.967620+0000","last_undegraded":"2020-11-16T20:56:00.967620+0000","last_fullsized":"2020-11-16T20:56:00.967620+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:00.967553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:00.967553+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"52","reported_epoch":"38","state":"active+clean","last_fresh":"2020-11-16T20:56:01.528273+0000","last_change":"2020-11-16T20:56:01.528273+0000","last_active":"2020-11-16T20:56:01.528273+0000","last_peered":"2020-11-16T20:56:01.528273+0000","last_clean":"2020-11-16T20:56:01.528273+0000","last_became_active":"2020-11-16T20:55:52.922303+0000","last_became_peered":"2020-11-16T20:55:52.922303+0000","last_unstale":"2020-11-16T20:56:01.528273+0000","last_undegraded":"2020-11-16T20:56:01.528273+0000","last_fullsized":"2020-11-16T20:56:01.528273+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:01.528217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:01.528217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"43","reported_epoch":"38","state":"active+clean","last_fresh":"2020-11-16T20:56:00.946501+0000","last_change":"2020-11-16T20:55:57.905062+0000","last_active":"2020-11-16T20:56:00.946501+0000","last_peered":"2020-11-16T20:56:00.946501+0000","last_clean":"2020-11-16T20:56:00.946501+0000","last_became_active":"2020-11-16T20:55:50.904146+0000","last_became_peered":"2020-11-16T20:55:50.904146+0000","last_unstale":"2020-11-16T20:56:00.946501+0000","last_undegraded":"2020-11-16T20:56:00.946501+0000","last_fullsized":"2020-11-16T20:56:00.946501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:57.905004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:57.905004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"39'129","reported_seq":"198","reported_epoch":"39","state":"active+clean","last_fresh":"2020-11-16T20:56:02.060337+0000","last_change":"2020-11-16T20:55:30.829098+0000","last_active":"2020-11-16T20:56:02.060337+0000","last_peered":"2020-11-16T20:56:02.060337+0000","last_clean":"2020-11-16T20:56:02.060337+0000","last_became_active":"2020-11-16T20:55:30.828637+0000","last_became_peered":"2020-11-16T20:55:30.828637+0000","last_unstale":"2020-11-16T20:56:02.060337+0000","last_undegraded":"2020-11-16T20:56:02.060337+0000","last_fullsized":"2020-11-16T20:56:02.060337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":129,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94640415,"num_objects":38,"num_object_clones":3,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":2,"num_read":38,"num_read_kb":35,"num_write":111,"num_write_kb":15109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":12,"num_flush_kb":32586,"num_evict":0,"num_evict_kb":0,"num_promote":36,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"44","reported_epoch":"39","state":"active+clean","last_fresh":"2020-11-16T20:56:01.994012+0000","last_change":"2020-11-16T20:55:57.606554+0000","last_active":"2020-11-16T20:56:01.994012+0000","last_peered":"2020-11-16T20:56:01.994012+0000","last_clean":"2020-11-16T20:56:01.994012+0000","last_became_active":"2020-11-16T20:55:50.906585+0000","last_became_peered":"2020-11-16T20:55:50.906585+0000","last_unstale":"2020-11-16T20:56:01.994012+0000","last_undegraded":"2020-11-16T20:56:01.994012+0000","last_fullsized":"2020-11-16T20:56:01.994012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:57.606500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:57.606500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"37'387","reported_seq":"572","reported_epoch":"38","state":"active+clean","last_fresh":"2020-11-16T20:56:00.970938+0000","last_change":"2020-11-16T20:55:25.104497+0000","last_active":"2020-11-16T20:56:00.970938+0000","last_peered":"2020-11-16T20:56:00.970938+0000","last_clean":"2020-11-16T20:56:00.970938+0000","last_became_active":"2020-11-16T20:55:25.103851+0000","last_became_peered":"2020-11-16T20:55:25.103851+0000","last_unstale":"2020-11-16T20:56:00.970938+0000","last_undegraded":"2020-11-16T20:56:00.970938+0000","last_fullsized":"2020-11-16T20:56:00.970938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":387,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":339809707,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":0,"num_read":251,"num_read_kb":94,"num_write":484,"num_write_kb":166205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"43","reported_epoch":"38","state":"active+clean","last_fresh":"2020-11-16T20:56:01.009298+0000","last_change":"2020-11-16T20:55:58.465447+0000","last_active":"2020-11-16T20:56:01.009298+0000","last_peered":"2020-11-16T20:56:01.009298+0000","last_clean":"2020-11-16T20:56:01.009298+0000","last_became_active":"2020-11-16T20:55:50.905925+0000","last_became_peered":"2020-11-16T20:55:50.905925+0000","last_unstale":"2020-11-16T20:56:01.009298+0000","last_undegraded":"2020-11-16T20:56:01.009298+0000","last_fullsized":"2020-11-16T20:56:01.009298+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:58.465384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:58.465384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"39'373","reported_seq":"550","reported_epoch":"39","state":"active+clean","last_fresh":"2020-11-16T20:56:02.017266+0000","last_change":"2020-11-16T20:55:25.104413+0000","last_active":"2020-11-16T20:56:02.017266+0000","last_peered":"2020-11-16T20:56:02.017266+0000","last_clean":"2020-11-16T20:56:02.017266+0000","last_became_active":"2020-11-16T20:55:25.103928+0000","last_became_peered":"2020-11-16T20:55:25.103928+0000","last_unstale":"2020-11-16T20:56:02.017266+0000","last_undegraded":"2020-11-16T20:56:02.017266+0000","last_fullsized":"2020-11-16T20:56:02.017266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":373,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":324338396,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":119,"num_whiteouts":0,"num_read":238,"num_read_kb":88,"num_write":467,"num_write_kb":153643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"44","reported_epoch":"39","state":"active+clean","last_fresh":"2020-11-16T20:56:01.993857+0000","last_change":"2020-11-16T20:55:59.611811+0000","last_active":"2020-11-16T20:56:01.993857+0000","last_peered":"2020-11-16T20:56:01.993857+0000","last_clean":"2020-11-16T20:56:01.993857+0000","last_became_active":"2020-11-16T20:55:50.903578+0000","last_became_peered":"2020-11-16T20:55:50.903578+0000","last_unstale":"2020-11-16T20:56:01.993857+0000","last_undegraded":"2020-11-16T20:56:01.993857+0000","last_fullsized":"2020-11-16T20:56:01.993857+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.611727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.611727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"36","reported_epoch":"38","state":"active+clean","last_fresh":"2020-11-16T20:56:00.944302+0000","last_change":"2020-11-16T20:54:53.112612+0000","last_active":"2020-11-16T20:56:00.944302+0000","last_peered":"2020-11-16T20:56:00.944302+0000","last_clean":"2020-11-16T20:56:00.944302+0000","last_became_active":"2020-11-16T20:54:53.112038+0000","last_became_peered":"2020-11-16T20:54:53.112038+0000","last_unstale":"2020-11-16T20:56:00.944302+0000","last_undegraded":"2020-11-16T20:56:00.944302+0000","last_fullsized":"2020-11-16T20:56:00.944302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:50.068882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:50.068882+0000","last_clean_scrub_stamp":"2020-11-16T20:54:50.068882+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"39'373","reported_seq":"561","reported_epoch":"39","state":"active+clean","last_fresh":"2020-11-16T20:56:02.042648+0000","last_change":"2020-11-16T20:55:25.106625+0000","last_active":"2020-11-16T20:56:02.042648+0000","last_peered":"2020-11-16T20:56:02.042648+0000","last_clean":"2020-11-16T20:56:02.042648+0000","last_became_active":"2020-11-16T20:55:25.106302+0000","last_became_peered":"2020-11-16T20:55:25.106302+0000","last_unstale":"2020-11-16T20:56:02.042648+0000","last_undegraded":"2020-11-16T20:56:02.042648+0000","last_fullsized":"2020-11-16T20:56:02.042648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":373,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":331227584,"num_objects":125,"num_object_clones":6,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":1,"num_read":264,"num_read_kb":29054,"num_write":456,"num_write_kb":181059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"44","reported_epoch":"38","state":"active+clean","last_fresh":"2020-11-16T20:56:00.944353+0000","last_change":"2020-11-16T20:55:56.657297+0000","last_active":"2020-11-16T20:56:00.944353+0000","last_peered":"2020-11-16T20:56:00.944353+0000","last_clean":"2020-11-16T20:56:00.944353+0000","last_became_active":"2020-11-16T20:55:50.908710+0000","last_became_peered":"2020-11-16T20:55:50.908710+0000","last_unstale":"2020-11-16T20:56:00.944353+0000","last_undegraded":"2020-11-16T20:56:00.944353+0000","last_fullsized":"2020-11-16T20:56:00.944353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:56.657242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:56.657242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"40'447","reported_seq":"658","reported_epoch":"40","state":"active+clean","last_fresh":"2020-11-16T20:56:02.994588+0000","last_change":"2020-11-16T20:55:24.803143+0000","last_active":"2020-11-16T20:56:02.994588+0000","last_peered":"2020-11-16T20:56:02.994588+0000","last_clean":"2020-11-16T20:56:02.994588+0000","last_became_active":"2020-11-16T20:55:24.802649+0000","last_became_peered":"2020-11-16T20:55:24.802649+0000","last_unstale":"2020-11-16T20:56:02.994588+0000","last_undegraded":"2020-11-16T20:56:02.994588+0000","last_fullsized":"2020-11-16T20:56:02.994588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":447,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389433357,"num_objects":141,"num_object_clones":4,"num_object_copies":423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":1,"num_read":314,"num_read_kb":46396,"num_write":557,"num_write_kb":185580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'93","reported_seq":"159","reported_epoch":"40","state":"active+clean","last_fresh":"2020-11-16T20:56:02.958214+0000","last_change":"2020-11-16T20:55:30.830279+0000","last_active":"2020-11-16T20:56:02.958214+0000","last_peered":"2020-11-16T20:56:02.958214+0000","last_clean":"2020-11-16T20:56:02.958214+0000","last_became_active":"2020-11-16T20:55:30.829833+0000","last_became_peered":"2020-11-16T20:55:30.829833+0000","last_unstale":"2020-11-16T20:56:02.958214+0000","last_undegraded":"2020-11-16T20:56:02.958214+0000","last_fullsized":"2020-11-16T20:56:02.958214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":93,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":88640316,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":83,"num_write_kb":12617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":6,"num_flush_kb":16876,"num_evict":0,"num_evict_kb":0,"num_promote":32,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"44","reported_epoch":"38","state":"active+clean","last_fresh":"2020-11-16T20:56:00.944404+0000","last_change":"2020-11-16T20:55:59.571968+0000","last_active":"2020-11-16T20:56:00.944404+0000","last_peered":"2020-11-16T20:56:00.944404+0000","last_clean":"2020-11-16T20:56:00.944404+0000","last_became_active":"2020-11-16T20:55:50.901014+0000","last_became_peered":"2020-11-16T20:55:50.901014+0000","last_unstale":"2020-11-16T20:56:00.944404+0000","last_undegraded":"2020-11-16T20:56:00.944404+0000","last_fullsized":"2020-11-16T20:56:00.944404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.571892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.571892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"43","reported_epoch":"38","state":"active+clean","last_fresh":"2020-11-16T20:56:00.946568+0000","last_change":"2020-11-16T20:55:59.950321+0000","last_active":"2020-11-16T20:56:00.946568+0000","last_peered":"2020-11-16T20:56:00.946568+0000","last_clean":"2020-11-16T20:56:00.946568+0000","last_became_active":"2020-11-16T20:55:50.905408+0000","last_became_peered":"2020-11-16T20:55:50.905408+0000","last_unstale":"2020-11-16T20:56:00.946568+0000","last_undegraded":"2020-11-16T20:56:00.946568+0000","last_fullsized":"2020-11-16T20:56:00.946568+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.950219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.950219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"39'86","reported_seq":"144","reported_epoch":"39","state":"active+clean","last_fresh":"2020-11-16T20:56:02.021144+0000","last_change":"2020-11-16T20:55:30.827982+0000","last_active":"2020-11-16T20:56:02.021144+0000","last_peered":"2020-11-16T20:56:02.021144+0000","last_clean":"2020-11-16T20:56:02.021144+0000","last_became_active":"2020-11-16T20:55:30.827526+0000","last_became_peered":"2020-11-16T20:55:30.827526+0000","last_unstale":"2020-11-16T20:56:02.021144+0000","last_undegraded":"2020-11-16T20:56:02.021144+0000","last_fullsized":"2020-11-16T20:56:02.021144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":86,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85211589,"num_objects":32,"num_object_clones":1,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":75,"num_write_kb":11364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":3,"num_flush_kb":9521,"num_evict":0,"num_evict_kb":0,"num_promote":31,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"43","reported_epoch":"38","state":"active+clean","last_fresh":"2020-11-16T20:56:00.954425+0000","last_change":"2020-11-16T20:55:59.645073+0000","last_active":"2020-11-16T20:56:00.954425+0000","last_peered":"2020-11-16T20:56:00.954425+0000","last_clean":"2020-11-16T20:56:00.954425+0000","last_became_active":"2020-11-16T20:55:50.905649+0000","last_became_peered":"2020-11-16T20:55:50.905649+0000","last_unstale":"2020-11-16T20:56:00.954425+0000","last_undegraded":"2020-11-16T20:56:00.954425+0000","last_fullsized":"2020-11-16T20:56:00.954425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.644996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.644996+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"36'79","reported_seq":"135","reported_epoch":"38","state":"active+clean","last_fresh":"2020-11-16T20:56:00.971489+0000","last_change":"2020-11-16T20:55:31.121139+0000","last_active":"2020-11-16T20:56:00.971489+0000","last_peered":"2020-11-16T20:56:00.971489+0000","last_clean":"2020-11-16T20:56:00.971489+0000","last_became_active":"2020-11-16T20:55:31.120583+0000","last_became_peered":"2020-11-16T20:55:31.120583+0000","last_unstale":"2020-11-16T20:56:00.971489+0000","last_undegraded":"2020-11-16T20:56:00.971489+0000","last_fullsized":"2020-11-16T20:56:00.971489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":79,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":88942545,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":39,"num_read_kb":14805,"num_write":75,"num_write_kb":12833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":29,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":357434865,"num_objects":131,"num_object_clones":4,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":2,"num_read":140,"num_read_kb":14903,"num_write":344,"num_write_kb":51923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":21,"num_flush_kb":58983,"num_evict":0,"num_evict_kb":0,"num_promote":128,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":843108352,"data_stored":854269974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":12,"acting":12,"num_store_stats":7},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":1384809044,"num_objects":510,"num_object_clones":10,"num_object_copies":1530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":510,"num_whiteouts":2,"num_read":1067,"num_read_kb":75632,"num_write":1964,"num_write_kb":686487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2042380288,"data_stored":2036155489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1580,"ondisk_log_size":1580,"up":12,"acting":12,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":18,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140548,"kb_used_data":134972,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":94231292,"statfs":{"total":96636764160,"available":96492843008,"internally_reserved":0,"allocated":138211328,"data_stored":137657908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":1.3280000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.66600000000000004}]},{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.55},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.843}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.78800000000000003}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.6910000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.98599999999999999}]},{"osd":4,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":2}]},{"osd":5,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":1.0149999999999999}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":2.1509999999999998},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.276}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":556104,"kb_used_data":544448,"kb_used_omap":0,"kb_used_meta":11648,"kb_avail":93815736,"statfs":{"total":96636764160,"available":96067313664,"internally_reserved":0,"allocated":557514752,"data_stored":555597366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11927552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.80500000000000005}]},{"osd":1,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.2689999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.67500000000000004}]},{"osd":2,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.96099999999999997}]},{"osd":3,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.417}]},{"osd":4,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.91900000000000004}]},{"osd":5,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.296},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.393}]},{"osd":7,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.073},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.794}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217400,"kb_used_data":211312,"kb_used_omap":0,"kb_used_meta":6080,"kb_avail":94154440,"statfs":{"total":96636764160,"available":96414146560,"internally_reserved":0,"allocated":216383488,"data_stored":214794780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6225920},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.80300000000000005}]},{"osd":2,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.82499999999999996}]},{"osd":3,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.677,"5min":2.677,"15min":2.677},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.71499999999999997}]},{"osd":4,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.872},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.92100000000000004}]},{"osd":5,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.036}]},{"osd":6,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.389},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.006}]},{"osd":7,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"max":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":1.157},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.3140000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":491292,"kb_used_data":479892,"kb_used_omap":0,"kb_used_meta":11392,"kb_avail":93880548,"statfs":{"total":96636764160,"available":96133681152,"internally_reserved":0,"allocated":491409408,"data_stored":491205169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11665408},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.80300000000000005}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.60599999999999998}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.498},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.69699999999999995}]},{"osd":4,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.88400000000000001}]},{"osd":5,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.85399999999999998}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":1.052}]},{"osd":7,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"max":{"1min":1.954,"5min":1.954,"15min":1.954},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.0069999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151252,"kb_used_data":145484,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":94220588,"statfs":{"total":96636764160,"available":96481882112,"internally_reserved":0,"allocated":148975616,"data_stored":147600796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.93500000000000005}]},{"osd":1,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":1.048}]},{"osd":3,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.85199999999999998}]},{"osd":4,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.3480000000000001}]},{"osd":5,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.153}]},{"osd":6,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.292},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.1160000000000001}]},{"osd":7,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.198}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":419360,"kb_used_data":408408,"kb_used_omap":0,"kb_used_meta":10944,"kb_avail":93952480,"statfs":{"total":96636764160,"available":96207339520,"internally_reserved":0,"allocated":418209792,"data_stored":417327573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11206656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.64700000000000002}]},{"osd":1,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.82499999999999996}]},{"osd":2,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.1539999999999999}]},{"osd":4,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.923,"5min":2.923,"15min":2.923},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.968,"5min":2.968,"15min":2.968},"last":1.2070000000000001}]},{"osd":5,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.8479999999999999,"5min":2.8479999999999999,"15min":2.8479999999999999},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.3620000000000001}]},{"osd":6,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.859,"5min":2.859,"15min":2.859},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":3.5390000000000001,"5min":3.5390000000000001,"15min":3.5390000000000001},"last":1.3859999999999999}]},{"osd":7,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.9780000000000002,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":1.2689999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":481304,"kb_used_data":470032,"kb_used_omap":0,"kb_used_meta":11264,"kb_avail":93890536,"statfs":{"total":96636764160,"available":96143908864,"internally_reserved":0,"allocated":481312768,"data_stored":478199153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11534336},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.438},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.85299999999999998}]},{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":1.0469999999999999}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":1.1299999999999999}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.01},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.57399999999999995}]},{"osd":5,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.252},{"interface":"front","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.5009999999999999}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.3440000000000001}]},{"osd":7,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":2.4369999999999998,"5min":2.4369999999999998,"15min":2.4369999999999998},"last":1.159},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.90900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":387568,"kb_used_data":380904,"kb_used_omap":0,"kb_used_meta":6656,"kb_avail":93984272,"statfs":{"total":96636764160,"available":96239894528,"internally_reserved":0,"allocated":390045696,"data_stored":393519689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6815744},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.81000000000000005}]},{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.012}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.1799999999999999}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.875}]},{"osd":4,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.1579999999999999}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.345},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.1419999999999999}]},{"osd":7,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.22},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":1.107,"5min":1.107,"15min":1.107},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.2430000000000001}]}]}]}} 2020-11-16T20:56:06.662 INFO:tasks.ceph.ceph_manager.ceph:would drop below min_pgs, proj -9, currently 1 2020-11-16T20:56:06.672 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:06.673 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:06.682 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:56:06.716 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:06.721+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:06.817 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:06.821+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:06.857 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:06.857 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:06.866 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:56:06.949 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:06.954+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:06.986 INFO:tasks.rados.rados.0.smithi166.stdout:562: done (4 left) 2020-11-16T20:56:06.987 INFO:tasks.rados.rados.0.smithi166.stdout:563: copy_from oid 155 from oid 271 current snap is 6 2020-11-16T20:56:06.987 INFO:tasks.rados.rados.0.smithi166.stdout:564: write (excl) oid 149 current snap is 6 2020-11-16T20:56:06.987 INFO:tasks.rados.rados.0.smithi166.stdout:564: seq_num 524 ranges {406868=542480,1547035=401512,2690354=116514} 2020-11-16T20:56:06.991 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2020-11-16T20:56:06.992 INFO:tasks.rados.rados.0.smithi166.stdout:564: writing smithi16641208-149 from 406868 to 949348 tid 1 2020-11-16T20:56:06.997 INFO:tasks.rados.rados.0.smithi166.stdout:564: writing smithi16641208-149 from 1547035 to 1948547 tid 2 2020-11-16T20:56:07.002 INFO:tasks.rados.rados.0.smithi166.stdout:564: writing smithi16641208-149 from 2690354 to 2806868 tid 3 2020-11-16T20:56:07.002 INFO:tasks.rados.rados.0.smithi166.stdout:565: rollback oid 397 current snap is 6 2020-11-16T20:56:07.002 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 397 to 3 2020-11-16T20:56:07.003 INFO:tasks.rados.rados.0.smithi166.stdout:555: finishing write tid 3 to smithi16641208-407 2020-11-16T20:56:07.003 INFO:tasks.rados.rados.0.smithi166.stdout:566: read oid 187 snap -1 2020-11-16T20:56:07.003 INFO:tasks.rados.rados.0.smithi166.stdout:566: expect (ObjNum 186 snap 0 seq_num 186) 2020-11-16T20:56:07.003 INFO:tasks.rados.rados.0.smithi166.stdout:567: snap_remove snap 0 2020-11-16T20:56:07.018 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:07.023+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:07.066 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:07.067 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:07.076 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:56:07.119 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:07.124+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:07.219 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:07.224+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:07.251 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:07.252 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:07.261 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:56:07.343 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:07.348+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:07.422 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:07.427+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:07.435 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:07.435 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:07.444 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:56:07.528 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:07.533+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:07.621 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:07.621 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:07.623 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:07.627+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:07.630 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:56:07.724 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:07.729+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:07.806 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:07.807 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:07.816 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:56:07.824 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:07.829+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:07.925 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:07.930+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:07.950 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:07.951 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:07.960 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:56:07.996 INFO:tasks.rados.rados.0.smithi166.stdout:567: done (8 left) 2020-11-16T20:56:07.996 INFO:tasks.rados.rados.0.smithi166.stdout:568: copy_from oid 115 from oid 87 current snap is 6 2020-11-16T20:56:07.996 INFO:tasks.rados.rados.0.smithi166.stdout:555: finishing write tid 4 to smithi16641208-407 2020-11-16T20:56:07.996 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 407 v 386 (ObjNum 521 snap 6 seq_num 521) dirty exists 2020-11-16T20:56:07.997 INFO:tasks.rados.rados.0.smithi166.stdout:555: left oid 407 (ObjNum 521 snap 6 seq_num 521) 2020-11-16T20:56:07.997 INFO:tasks.rados.rados.0.smithi166.stdout:559: finishing write tid 1 to smithi16641208-369 2020-11-16T20:56:07.997 INFO:tasks.rados.rados.0.smithi166.stdout:559: finishing write tid 2 to smithi16641208-369 2020-11-16T20:56:07.997 INFO:tasks.rados.rados.0.smithi166.stdout:559: finishing write tid 3 to smithi16641208-369 2020-11-16T20:56:07.997 INFO:tasks.rados.rados.0.smithi166.stdout:559: finishing write tid 4 to smithi16641208-369 2020-11-16T20:56:07.997 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 369 v 389 (ObjNum 523 snap 6 seq_num 523) dirty exists 2020-11-16T20:56:07.997 INFO:tasks.rados.rados.0.smithi166.stdout:559: left oid 369 (ObjNum 523 snap 6 seq_num 523) 2020-11-16T20:56:07.998 INFO:tasks.rados.rados.0.smithi166.stdout:557: finishing write tid 2 to smithi16641208-101 2020-11-16T20:56:07.998 INFO:tasks.rados.rados.0.smithi166.stdout:557: finishing write tid 3 to smithi16641208-101 2020-11-16T20:56:07.998 INFO:tasks.rados.rados.0.smithi166.stdout:557: finishing write tid 4 to smithi16641208-101 2020-11-16T20:56:07.998 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 101 v 455 (ObjNum 522 snap 6 seq_num 522) dirty exists 2020-11-16T20:56:07.998 INFO:tasks.rados.rados.0.smithi166.stdout:557: left oid 101 (ObjNum 522 snap 6 seq_num 522) 2020-11-16T20:56:07.998 INFO:tasks.rados.rados.0.smithi166.stdout:561: got (2) No such file or directory 2020-11-16T20:56:07.998 INFO:tasks.rados.rados.0.smithi166.stdout:564: finishing write tid 1 to smithi16641208-149 2020-11-16T20:56:07.999 INFO:tasks.rados.rados.0.smithi166.stdout:555: done (8 left) 2020-11-16T20:56:07.999 INFO:tasks.rados.rados.0.smithi166.stdout:557: done (7 left) 2020-11-16T20:56:07.999 INFO:tasks.rados.rados.0.smithi166.stdout:559: done (6 left) 2020-11-16T20:56:07.999 INFO:tasks.rados.rados.0.smithi166.stdout:561: done (5 left) 2020-11-16T20:56:07.999 INFO:tasks.rados.rados.0.smithi166.stdout:569: write (excl) oid 140 current snap is 6 2020-11-16T20:56:07.999 INFO:tasks.rados.rados.0.smithi166.stdout:566: expect (ObjNum 186 snap 0 seq_num 186) 2020-11-16T20:56:08.006 INFO:teuthology.orchestra.run.smithi166.stderr:nodeep-scrub is set 2020-11-16T20:56:08.026 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:08.031+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:08.037 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:08.041+0000 7f1d7a7ed700 -1 osd.3 pg_epoch: 45 pg[3.2( v 45'429 (0'0,45'429] local-lis/les=19/20 n=126 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [3,5,6] r=0 lpr=19 luod=45'427 crt=45'429 lcod 45'425 mlcod 45'425 active+clean+snaptrim trimq=[2~1] ps=[3~1,6~1]] removing snap head 2020-11-16T20:56:08.107 INFO:tasks.rados.rados.0.smithi166.stdout:563: finishing copy_from to smithi16641208-155 2020-11-16T20:56:08.108 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 155 v 244 (ObjNum 270 snap 0 seq_num 270) dirty exists 2020-11-16T20:56:08.108 INFO:tasks.rados.rados.0.smithi166.stdout:564: finishing write tid 2 to smithi16641208-149 2020-11-16T20:56:08.108 INFO:tasks.rados.rados.0.smithi166.stdout:564: finishing write tid 3 to smithi16641208-149 2020-11-16T20:56:08.108 INFO:tasks.rados.rados.0.smithi166.stdout:564: finishing write tid 4 to smithi16641208-149 2020-11-16T20:56:08.108 INFO:tasks.rados.rados.0.smithi166.stdout:564: finishing write tid 5 to smithi16641208-149 2020-11-16T20:56:08.108 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 149 v 468 (ObjNum 524 snap 6 seq_num 524) dirty exists 2020-11-16T20:56:08.108 INFO:tasks.rados.rados.0.smithi166.stdout:564: left oid 149 (ObjNum 524 snap 6 seq_num 524) 2020-11-16T20:56:08.109 INFO:tasks.rados.rados.0.smithi166.stdout:565: finishing rollback tid 0 to smithi16641208-397 2020-11-16T20:56:08.109 INFO:tasks.rados.rados.0.smithi166.stdout:563: finishing copy_from racing read to smithi16641208-155 2020-11-16T20:56:08.109 INFO:tasks.rados.rados.0.smithi166.stdout:565: finishing rollback tid 1 to smithi16641208-397 2020-11-16T20:56:08.109 INFO:tasks.rados.rados.0.smithi166.stdout:565: finishing rollback tid 2 to smithi16641208-397 2020-11-16T20:56:08.109 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 397 v 413 (ObjNum 396 snap 0 seq_num 396) dirty exists 2020-11-16T20:56:08.109 INFO:tasks.rados.rados.0.smithi166.stdout:569: seq_num 525 ranges {423675=734082,1721870=545170,2717777=105898} 2020-11-16T20:56:08.109 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:08.110 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:08.113 INFO:tasks.rados.rados.0.smithi166.stdout:569: writing smithi16641208-140 from 423675 to 1157757 tid 1 2020-11-16T20:56:08.117 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:56:08.120 INFO:tasks.rados.rados.0.smithi166.stdout:569: writing smithi16641208-140 from 1721870 to 2267040 tid 2 2020-11-16T20:56:08.124 INFO:tasks.rados.rados.0.smithi166.stdout:569: writing smithi16641208-140 from 2717777 to 2823675 tid 3 2020-11-16T20:56:08.124 INFO:tasks.rados.rados.0.smithi166.stdout:563: done (5 left) 2020-11-16T20:56:08.124 INFO:tasks.rados.rados.0.smithi166.stdout:564: done (4 left) 2020-11-16T20:56:08.124 INFO:tasks.rados.rados.0.smithi166.stdout:565: done (3 left) 2020-11-16T20:56:08.124 INFO:tasks.rados.rados.0.smithi166.stdout:566: done (2 left) 2020-11-16T20:56:08.124 INFO:tasks.rados.rados.0.smithi166.stdout:570: cache_flush oid 183 snap 5 2020-11-16T20:56:08.124 INFO:tasks.rados.rados.0.smithi166.stdout:568: finishing copy_from to smithi16641208-115 2020-11-16T20:56:08.125 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 115 v 45 (ObjNum 86 snap 0 seq_num 86) dirty exists 2020-11-16T20:56:08.125 INFO:tasks.rados.rados.0.smithi166.stdout:568: finishing copy_from racing read to smithi16641208-115 2020-11-16T20:56:08.125 INFO:tasks.rados.rados.0.smithi166.stdout:569: finishing write tid 1 to smithi16641208-140 2020-11-16T20:56:08.125 INFO:tasks.rados.rados.0.smithi166.stdout:568: done (2 left) 2020-11-16T20:56:08.125 INFO:tasks.rados.rados.0.smithi166.stdout:571: cache_evict oid 407 snap 5 2020-11-16T20:56:08.125 INFO:tasks.rados.rados.0.smithi166.stdout:572: write (excl) oid 317 current snap is 6 2020-11-16T20:56:08.125 INFO:tasks.rados.rados.0.smithi166.stdout:572: seq_num 526 ranges {440482=409331,1380352=405181,2461553=378929} 2020-11-16T20:56:08.128 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:08.133+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:08.128 INFO:tasks.rados.rados.0.smithi166.stdout:572: writing smithi16641208-317 from 440482 to 849813 tid 1 2020-11-16T20:56:08.134 INFO:tasks.rados.rados.0.smithi166.stdout:572: writing smithi16641208-317 from 1380352 to 1785533 tid 2 2020-11-16T20:56:08.141 INFO:tasks.rados.rados.0.smithi166.stdout:572: writing smithi16641208-317 from 2461553 to 2840482 tid 3 2020-11-16T20:56:08.141 INFO:tasks.rados.rados.0.smithi166.stdout:573: cache_try_flush oid 57 snap 3 2020-11-16T20:56:08.141 INFO:tasks.rados.rados.0.smithi166.stdout:570: got (2) No such file or directory 2020-11-16T20:56:08.141 INFO:tasks.rados.rados.0.smithi166.stdout:570: done (4 left) 2020-11-16T20:56:08.141 INFO:tasks.rados.rados.0.smithi166.stdout:574: copy_from oid 252 from oid 294 current snap is 6 2020-11-16T20:56:08.141 INFO:tasks.rados.rados.0.smithi166.stdout:575: snap_remove snap 2 2020-11-16T20:56:08.229 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:08.233+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:08.267 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:08.267 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:08.276 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:56:08.329 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:08.334+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:08.376 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:56:08.430 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:08.435+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:08.447 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:08.447 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:08.457 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:56:08.521 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:56:08.531 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:08.535+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:08.542 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:56:08.562 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:56:08.582 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:56:08.603 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:56:08.623 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:56:08.627 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:08.628 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:08.628 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:56:08.628 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:08.631 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:08.636+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:08.638 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:56:08.644 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:56:08.664 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:56:08.666 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:56:08.666 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:56:08.666 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:56:08.666 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:56:08.667 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:56:08.667 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:56:08.667 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:56:08.667 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:56:08.733 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:08.738+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:08.772 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:08.772 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:08.772 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:56:08.773 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:56:08.773 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:08.781 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:56:08.865 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:08.870+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:08.934 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:08.939+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:08.951 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:08.951 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:56:08.951 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:56:08.951 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:56:08.951 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.951 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1115 4.2 4:5a2aa7df:::smithi16641208-248:head [setxattr _header (57) in=7b,truncate 2151329] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:08.952 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.954978+0000", 2020-11-16T20:56:08.952 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 13.999010708, 2020-11-16T20:56:08.952 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023396486000000001, 2020-11-16T20:56:08.952 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:08.952 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:08.952 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:08.952 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:08.953 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:08.953 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1115 2020-11-16T20:56:08.953 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.953 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:08.953 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.953 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:08.953 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.954978+0000", 2020-11-16T20:56:08.954 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:08.954 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.954 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.954 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:08.954 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.954978+0000", 2020-11-16T20:56:08.954 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2381000000000001e-05 2020-11-16T20:56:08.954 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.955 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.955 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:08.955 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955000+0000", 2020-11-16T20:56:08.955 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3979999999999999e-06 2020-11-16T20:56:08.955 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.955 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.955 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:08.956 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955003+0000", 2020-11-16T20:56:08.956 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1510000000000001e-06 2020-11-16T20:56:08.956 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.956 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.956 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:08.956 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955009+0000", 2020-11-16T20:56:08.956 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6690000000000002e-06 2020-11-16T20:56:08.956 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.957 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.957 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:08.957 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955012+0000", 2020-11-16T20:56:08.957 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000317423 2020-11-16T20:56:08.957 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.957 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.957 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:08.958 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955330+0000", 2020-11-16T20:56:08.958 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3217000000000002e-05 2020-11-16T20:56:08.958 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.958 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.958 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:08.958 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955383+0000", 2020-11-16T20:56:08.958 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011320966 2020-11-16T20:56:08.959 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.959 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.959 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:08.959 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.966704+0000", 2020-11-16T20:56:08.959 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015513500000000001 2020-11-16T20:56:08.959 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.959 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.959 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:08.960 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.966859+0000", 2020-11-16T20:56:08.960 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018944 2020-11-16T20:56:08.960 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.960 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.960 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:08.960 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.967048+0000", 2020-11-16T20:56:08.960 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0062409930000000002 2020-11-16T20:56:08.961 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.961 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.961 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:08.961 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.973289+0000", 2020-11-16T20:56:08.961 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0049529889999999997 2020-11-16T20:56:08.961 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.961 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.961 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:08.962 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978242+0000", 2020-11-16T20:56:08.962 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1761999999999999e-05 2020-11-16T20:56:08.962 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.962 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.962 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:08.962 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978264+0000", 2020-11-16T20:56:08.962 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9797999999999999e-05 2020-11-16T20:56:08.963 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.963 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.963 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:08.963 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978324+0000", 2020-11-16T20:56:08.963 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0164000000000003e-05 2020-11-16T20:56:08.963 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.963 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.963 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:08.964 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978374+0000", 2020-11-16T20:56:08.964 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023396486000000001 2020-11-16T20:56:08.964 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:08.964 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:08.964 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:08.964 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.964 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.965 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1116 4.2 4:5a2aa7df:::smithi16641208-248:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:56:08.965 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.955031+0000", 2020-11-16T20:56:08.965 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 13.998957387999999, 2020-11-16T20:56:08.965 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023838986999999999, 2020-11-16T20:56:08.965 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:08.965 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:08.965 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:08.965 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:08.966 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:08.966 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1116 2020-11-16T20:56:08.966 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.966 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:08.966 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.966 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:08.966 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955031+0000", 2020-11-16T20:56:08.967 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:08.967 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.967 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.967 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:08.967 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955031+0000", 2020-11-16T20:56:08.967 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5029e-05 2020-11-16T20:56:08.967 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.967 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.968 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:08.968 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955046+0000", 2020-11-16T20:56:08.968 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8770000000000002e-06 2020-11-16T20:56:08.968 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.968 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.968 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:08.968 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955049+0000", 2020-11-16T20:56:08.969 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7219999999999996e-06 2020-11-16T20:56:08.969 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.969 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.969 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:08.969 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955055+0000", 2020-11-16T20:56:08.969 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4109999999999999e-06 2020-11-16T20:56:08.969 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.969 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.970 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:08.970 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955057+0000", 2020-11-16T20:56:08.970 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00035397299999999999 2020-11-16T20:56:08.970 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.970 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.970 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:08.970 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955411+0000", 2020-11-16T20:56:08.971 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4848000000000001e-05 2020-11-16T20:56:08.971 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.971 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.971 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:08.971 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955466+0000", 2020-11-16T20:56:08.971 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012080844 2020-11-16T20:56:08.971 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.971 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.972 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:08.972 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.967547+0000", 2020-11-16T20:56:08.972 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015558100000000001 2020-11-16T20:56:08.972 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.972 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.972 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:08.972 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.967702+0000", 2020-11-16T20:56:08.973 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010726072999999999 2020-11-16T20:56:08.973 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.973 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.973 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:08.973 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978428+0000", 2020-11-16T20:56:08.973 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013814900000000001 2020-11-16T20:56:08.973 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.973 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.974 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:08.974 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978566+0000", 2020-11-16T20:56:08.974 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030348000000000001 2020-11-16T20:56:08.974 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.974 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.974 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:08.974 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978870+0000", 2020-11-16T20:56:08.975 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023838986999999999 2020-11-16T20:56:08.975 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:08.975 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:08.975 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:08.975 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.975 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.975 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1121 4.2 4:7ef90409:::smithi16641208-250:head [write 584943~460297,stat] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:08.976 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.974149+0000", 2020-11-16T20:56:08.976 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 13.979839104, 2020-11-16T20:56:08.976 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025650249999999999, 2020-11-16T20:56:08.976 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:08.976 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:08.976 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:08.976 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:08.976 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:08.977 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1121 2020-11-16T20:56:08.977 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.977 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:08.977 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.977 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:08.977 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.974149+0000", 2020-11-16T20:56:08.977 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:08.978 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.978 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.978 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:08.978 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.974149+0000", 2020-11-16T20:56:08.978 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000117531 2020-11-16T20:56:08.978 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.978 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.979 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:08.979 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.974267+0000", 2020-11-16T20:56:08.979 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.618e-06 2020-11-16T20:56:08.979 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.979 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.979 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:08.979 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.974273+0000", 2020-11-16T20:56:08.979 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.343e-05 2020-11-16T20:56:08.980 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.980 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.980 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:08.980 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.974287+0000", 2020-11-16T20:56:08.980 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8980000000000001e-06 2020-11-16T20:56:08.980 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.980 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.981 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:08.981 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.974293+0000", 2020-11-16T20:56:08.981 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0046077069999999999 2020-11-16T20:56:08.981 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.981 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.981 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:08.981 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978900+0000", 2020-11-16T20:56:08.981 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020897138999999999 2020-11-16T20:56:08.982 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.982 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.982 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:08.982 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.999797+0000", 2020-11-16T20:56:08.982 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9269999999999999e-06 2020-11-16T20:56:08.982 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.982 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.983 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:08.983 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.999799+0000", 2020-11-16T20:56:08.983 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025650249999999999 2020-11-16T20:56:08.983 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:08.983 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:08.983 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:08.983 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.983 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.984 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1122 4.2 4:7ef90409:::smithi16641208-250:head [write 1587781~597162] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:08.984 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.982754+0000", 2020-11-16T20:56:08.984 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 13.971234666999999, 2020-11-16T20:56:08.984 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020140918000000001, 2020-11-16T20:56:08.984 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:08.984 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:08.984 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:08.985 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:08.985 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:08.985 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1122 2020-11-16T20:56:08.985 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.985 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:08.985 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.985 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:08.986 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.982754+0000", 2020-11-16T20:56:08.986 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:08.986 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.986 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.986 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:08.986 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.982754+0000", 2020-11-16T20:56:08.986 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019379 2020-11-16T20:56:08.986 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.987 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.987 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:08.987 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.982947+0000", 2020-11-16T20:56:08.987 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2900000000000008e-06 2020-11-16T20:56:08.987 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.987 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.987 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:08.988 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.982957+0000", 2020-11-16T20:56:08.988 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6120000000000002e-05 2020-11-16T20:56:08.988 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.988 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.988 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:08.988 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.982973+0000", 2020-11-16T20:56:08.988 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.5219999999999996e-06 2020-11-16T20:56:08.988 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.989 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.989 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:08.989 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.982982+0000", 2020-11-16T20:56:08.989 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5333e-05 2020-11-16T20:56:08.989 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.989 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.989 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:08.990 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983038+0000", 2020-11-16T20:56:08.990 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019854133999999999 2020-11-16T20:56:08.990 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.990 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.990 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:08.990 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002892+0000", 2020-11-16T20:56:08.990 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.729e-06 2020-11-16T20:56:08.990 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.991 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.991 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:08.991 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002895+0000", 2020-11-16T20:56:08.991 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020140918000000001 2020-11-16T20:56:08.991 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:08.991 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:08.991 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:08.992 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.992 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.992 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1123 4.2 4:7ef90409:::smithi16641208-250:head [setxattr _header (57) in=7b,truncate 2184943] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:08.992 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.983026+0000", 2020-11-16T20:56:08.992 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 13.970961953, 2020-11-16T20:56:08.992 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020255397000000001, 2020-11-16T20:56:08.992 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:08.992 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:08.993 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:08.993 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:08.993 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:08.993 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1123 2020-11-16T20:56:08.993 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.993 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:08.993 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.994 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:08.994 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983026+0000", 2020-11-16T20:56:08.994 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:08.994 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.994 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.994 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:08.994 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983026+0000", 2020-11-16T20:56:08.995 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9609e-05 2020-11-16T20:56:08.995 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.995 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.995 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:08.995 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983066+0000", 2020-11-16T20:56:08.995 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0859999999999998e-06 2020-11-16T20:56:08.995 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.995 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.996 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:08.996 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983072+0000", 2020-11-16T20:56:08.996 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00043611499999999999 2020-11-16T20:56:08.996 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.996 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.996 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:08.996 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983508+0000", 2020-11-16T20:56:08.997 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4060000000000005e-06 2020-11-16T20:56:08.997 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.997 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.997 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:08.997 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983517+0000", 2020-11-16T20:56:08.997 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9840999999999998e-05 2020-11-16T20:56:08.997 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.997 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.998 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:08.998 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983586+0000", 2020-11-16T20:56:08.998 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019692405 2020-11-16T20:56:08.998 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.998 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.998 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:08.998 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003279+0000", 2020-11-16T20:56:08.999 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9349999999999999e-06 2020-11-16T20:56:08.999 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:08.999 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:08.999 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:08.999 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003282+0000", 2020-11-16T20:56:08.999 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020255397000000001 2020-11-16T20:56:08.999 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:08.999 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.000 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.000 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.000 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.000 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1124 4.2 4:7ef90409:::smithi16641208-250:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:56:09.000 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.983558+0000", 2020-11-16T20:56:09.000 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 13.970429766000001, 2020-11-16T20:56:09.000 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019806648999999999, 2020-11-16T20:56:09.000 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.001 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:56:09.001 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:09.001 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:09.001 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:09.001 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1124 2020-11-16T20:56:09.001 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.001 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.002 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.002 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.002 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983558+0000", 2020-11-16T20:56:09.002 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.002 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.002 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.002 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.003 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983558+0000", 2020-11-16T20:56:09.003 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4308999999999999e-05 2020-11-16T20:56:09.003 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.003 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.003 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.003 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983603+0000", 2020-11-16T20:56:09.003 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8070000000000006e-06 2020-11-16T20:56:09.003 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.004 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.004 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.004 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983612+0000", 2020-11-16T20:56:09.004 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8104000000000001e-05 2020-11-16T20:56:09.004 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.004 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.004 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.005 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983630+0000", 2020-11-16T20:56:09.005 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5259999999999999e-06 2020-11-16T20:56:09.005 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.005 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.005 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.005 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983636+0000", 2020-11-16T20:56:09.005 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020975 2020-11-16T20:56:09.005 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.006 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.006 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.006 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983846+0000", 2020-11-16T20:56:09.006 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019519153000000001 2020-11-16T20:56:09.006 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.006 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.006 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.007 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003365+0000", 2020-11-16T20:56:09.007 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019806648999999999 2020-11-16T20:56:09.007 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.007 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.007 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.007 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.007 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.007 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1406 4.2 4:6c6ed246:::smithi16641208-316:head [setxattr _header (57) in=7b,truncate 3294205] snapc 0=[] ondisk+write+known_if_redirected e36)", 2020-11-16T20:56:09.008 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.968144+0000", 2020-11-16T20:56:09.008 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 12.985844008999999, 2020-11-16T20:56:09.008 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026933623, 2020-11-16T20:56:09.008 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.008 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.008 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:09.008 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:09.009 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:09.009 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1406 2020-11-16T20:56:09.009 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.009 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.009 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.009 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.009 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968144+0000", 2020-11-16T20:56:09.009 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.010 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.010 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.010 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.010 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968144+0000", 2020-11-16T20:56:09.010 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3442999999999999e-05 2020-11-16T20:56:09.010 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.010 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.011 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.011 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968168+0000", 2020-11-16T20:56:09.011 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3569999999999998e-06 2020-11-16T20:56:09.011 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.011 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.011 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.011 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968171+0000", 2020-11-16T20:56:09.012 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.728e-06 2020-11-16T20:56:09.012 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.012 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.012 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.012 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968177+0000", 2020-11-16T20:56:09.012 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.943e-06 2020-11-16T20:56:09.012 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.012 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.013 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.013 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968180+0000", 2020-11-16T20:56:09.013 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018267500000000001 2020-11-16T20:56:09.013 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.013 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.013 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.013 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968362+0000", 2020-11-16T20:56:09.014 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3270000000000003e-05 2020-11-16T20:56:09.014 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.014 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.014 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:09.014 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968416+0000", 2020-11-16T20:56:09.014 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011050572999999999 2020-11-16T20:56:09.014 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.014 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.015 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.015 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.979466+0000", 2020-11-16T20:56:09.015 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8349000000000005e-05 2020-11-16T20:56:09.015 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.015 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.015 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.015 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.979545+0000", 2020-11-16T20:56:09.016 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010998299999999999 2020-11-16T20:56:09.016 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.016 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:09.016 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.979655+0000", 2020-11-16T20:56:09.016 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00092610999999999995 2020-11-16T20:56:09.016 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.017 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:09.017 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.980581+0000", 2020-11-16T20:56:09.017 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0068293140000000004 2020-11-16T20:56:09.017 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.017 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.017 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:09.017 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.987410+0000", 2020-11-16T20:56:09.018 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0075214959999999999 2020-11-16T20:56:09.018 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.018 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.018 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:09.018 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.994931+0000", 2020-11-16T20:56:09.018 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5657e-05 2020-11-16T20:56:09.018 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.019 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.019 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.019 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.994977+0000", 2020-11-16T20:56:09.019 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000100725 2020-11-16T20:56:09.019 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.019 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.019 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.019 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.995078+0000", 2020-11-16T20:56:09.020 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026933623 2020-11-16T20:56:09.020 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.020 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.020 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.020 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.020 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.020 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1407 4.2 4:6c6ed246:::smithi16641208-316:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e36)", 2020-11-16T20:56:09.020 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.968204+0000", 2020-11-16T20:56:09.021 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 12.985784581000001, 2020-11-16T20:56:09.021 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027229834000000001, 2020-11-16T20:56:09.021 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.021 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:09.021 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:09.021 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:09.021 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:09.022 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1407 2020-11-16T20:56:09.022 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.022 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.022 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.022 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.022 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968204+0000", 2020-11-16T20:56:09.022 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.023 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.023 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.023 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.023 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968204+0000", 2020-11-16T20:56:09.023 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6412000000000001e-05 2020-11-16T20:56:09.023 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.023 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.023 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.024 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968220+0000", 2020-11-16T20:56:09.024 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0060000000000001e-06 2020-11-16T20:56:09.024 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.024 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.024 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.024 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968223+0000", 2020-11-16T20:56:09.024 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7660000000000004e-06 2020-11-16T20:56:09.024 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.025 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.025 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.025 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968229+0000", 2020-11-16T20:56:09.025 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6979999999999998e-06 2020-11-16T20:56:09.025 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.025 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.025 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.026 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968232+0000", 2020-11-16T20:56:09.026 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000199786 2020-11-16T20:56:09.026 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.026 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.026 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.026 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968431+0000", 2020-11-16T20:56:09.026 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7841999999999999e-05 2020-11-16T20:56:09.026 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.027 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.027 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:09.027 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968459+0000", 2020-11-16T20:56:09.027 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011510038 2020-11-16T20:56:09.027 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.027 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.027 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.028 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.979969+0000", 2020-11-16T20:56:09.028 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7645000000000006e-05 2020-11-16T20:56:09.028 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.028 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.028 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:09.028 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.980047+0000", 2020-11-16T20:56:09.028 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015060982000000001 2020-11-16T20:56:09.029 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.029 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.029 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.029 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.995108+0000", 2020-11-16T20:56:09.029 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4376999999999997e-05 2020-11-16T20:56:09.029 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.029 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.029 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.030 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.995172+0000", 2020-11-16T20:56:09.030 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000261282 2020-11-16T20:56:09.030 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.030 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.030 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.030 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.995434+0000", 2020-11-16T20:56:09.030 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027229834000000001 2020-11-16T20:56:09.031 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.031 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.031 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.031 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.031 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.031 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1445 4.2 4:59c20b01:::smithi16641208-324:head [write 3403509~25152] snapc 0=[] ondisk+write+known_if_redirected e36)", 2020-11-16T20:56:09.031 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.121514+0000", 2020-11-16T20:56:09.031 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 12.832474593000001, 2020-11-16T20:56:09.032 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019332254, 2020-11-16T20:56:09.032 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.032 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.032 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:09.032 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:09.032 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:09.032 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1445 2020-11-16T20:56:09.033 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.033 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.033 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.033 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.033 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121514+0000", 2020-11-16T20:56:09.033 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.033 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.033 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.034 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.034 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121514+0000", 2020-11-16T20:56:09.034 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1333e-05 2020-11-16T20:56:09.034 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.034 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.034 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.034 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121545+0000", 2020-11-16T20:56:09.035 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4959999999999998e-06 2020-11-16T20:56:09.035 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.035 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.035 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.035 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121549+0000", 2020-11-16T20:56:09.035 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.011e-06 2020-11-16T20:56:09.035 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.035 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.036 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.036 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121558+0000", 2020-11-16T20:56:09.036 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6809999999999997e-06 2020-11-16T20:56:09.036 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.036 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.036 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.036 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121562+0000", 2020-11-16T20:56:09.036 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5099999999999999e-05 2020-11-16T20:56:09.037 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.037 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.037 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.037 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121597+0000", 2020-11-16T20:56:09.037 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7240999999999998e-05 2020-11-16T20:56:09.037 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.037 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.038 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:09.038 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121635+0000", 2020-11-16T20:56:09.038 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0084021029999999993 2020-11-16T20:56:09.038 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.038 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.038 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.038 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.130037+0000", 2020-11-16T20:56:09.038 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000121814 2020-11-16T20:56:09.039 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.039 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.039 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.039 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.130158+0000", 2020-11-16T20:56:09.039 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014279200000000001 2020-11-16T20:56:09.039 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.039 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.040 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:09.040 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.130301+0000", 2020-11-16T20:56:09.040 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0022848970000000001 2020-11-16T20:56:09.040 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.040 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.040 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:09.040 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.132586+0000", 2020-11-16T20:56:09.040 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078745949999999999 2020-11-16T20:56:09.041 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.041 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.041 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:09.041 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.140461+0000", 2020-11-16T20:56:09.041 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00026870600000000001 2020-11-16T20:56:09.041 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.041 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.042 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:09.042 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.140729+0000", 2020-11-16T20:56:09.042 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7345e-05 2020-11-16T20:56:09.042 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.042 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.042 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.042 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.140797+0000", 2020-11-16T20:56:09.042 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.914e-05 2020-11-16T20:56:09.043 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.043 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.043 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.043 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.140846+0000", 2020-11-16T20:56:09.043 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019332254 2020-11-16T20:56:09.043 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.043 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.044 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.044 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.044 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.044 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1446 4.2 4:59c20b01:::smithi16641208-324:head [setxattr _header (57) in=7b,truncate 3428661] snapc 0=[] ondisk+write+known_if_redirected e36)", 2020-11-16T20:56:09.044 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.121586+0000", 2020-11-16T20:56:09.044 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 12.832402485999999, 2020-11-16T20:56:09.044 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019371455999999999, 2020-11-16T20:56:09.044 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.045 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.045 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:09.045 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:09.045 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:09.045 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1446 2020-11-16T20:56:09.045 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.045 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.046 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.046 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.046 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121586+0000", 2020-11-16T20:56:09.046 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.046 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.046 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.046 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.047 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121586+0000", 2020-11-16T20:56:09.047 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3504000000000001e-05 2020-11-16T20:56:09.047 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.047 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.047 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.047 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121609+0000", 2020-11-16T20:56:09.047 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2349999999999999e-06 2020-11-16T20:56:09.047 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.048 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.048 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.048 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121613+0000", 2020-11-16T20:56:09.048 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0730000000000001e-06 2020-11-16T20:56:09.048 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.048 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.048 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.049 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121619+0000", 2020-11-16T20:56:09.049 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.638e-06 2020-11-16T20:56:09.049 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.049 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.049 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.049 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121621+0000", 2020-11-16T20:56:09.049 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4952e-05 2020-11-16T20:56:09.049 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.050 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.050 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.050 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121656+0000", 2020-11-16T20:56:09.050 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4751e-05 2020-11-16T20:56:09.050 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.050 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.050 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:09.051 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121691+0000", 2020-11-16T20:56:09.051 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092352010000000002 2020-11-16T20:56:09.051 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.051 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.051 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.051 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.130926+0000", 2020-11-16T20:56:09.051 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012516799999999999 2020-11-16T20:56:09.051 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.052 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.052 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.052 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.131051+0000", 2020-11-16T20:56:09.052 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013914099999999999 2020-11-16T20:56:09.052 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.052 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.052 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:09.053 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.131190+0000", 2020-11-16T20:56:09.053 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0015892619999999999 2020-11-16T20:56:09.053 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.053 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.053 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:09.053 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.132780+0000", 2020-11-16T20:56:09.053 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0077578769999999998 2020-11-16T20:56:09.053 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.054 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.054 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:09.054 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.140538+0000", 2020-11-16T20:56:09.054 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034462300000000001 2020-11-16T20:56:09.054 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.054 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.054 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:09.055 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.140882+0000", 2020-11-16T20:56:09.055 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9279000000000001e-05 2020-11-16T20:56:09.055 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.055 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.055 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.055 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.140921+0000", 2020-11-16T20:56:09.055 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5751999999999999e-05 2020-11-16T20:56:09.056 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.056 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.056 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.056 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.140957+0000", 2020-11-16T20:56:09.056 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019371455999999999 2020-11-16T20:56:09.056 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.056 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.056 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.057 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.057 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.057 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1447 4.2 4:59c20b01:::smithi16641208-324:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e36)", 2020-11-16T20:56:09.057 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.121644+0000", 2020-11-16T20:56:09.057 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 12.832344561999999, 2020-11-16T20:56:09.057 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019680626, 2020-11-16T20:56:09.057 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.058 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:09.058 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:09.058 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:09.058 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:09.058 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1447 2020-11-16T20:56:09.058 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.058 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.058 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.059 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.059 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121644+0000", 2020-11-16T20:56:09.059 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.059 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.059 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.059 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.059 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121644+0000", 2020-11-16T20:56:09.060 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5140000000000001e-05 2020-11-16T20:56:09.060 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.060 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.060 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.060 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121659+0000", 2020-11-16T20:56:09.060 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3369999999999996e-06 2020-11-16T20:56:09.060 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.060 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.061 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.061 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121665+0000", 2020-11-16T20:56:09.061 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6899999999999997e-06 2020-11-16T20:56:09.061 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.061 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.061 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.061 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121671+0000", 2020-11-16T20:56:09.062 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.418e-06 2020-11-16T20:56:09.062 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.062 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.062 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.062 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121673+0000", 2020-11-16T20:56:09.062 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1782000000000002e-05 2020-11-16T20:56:09.062 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.062 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.063 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.063 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121705+0000", 2020-11-16T20:56:09.063 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3116e-05 2020-11-16T20:56:09.063 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.063 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.063 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:09.063 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.121728+0000", 2020-11-16T20:56:09.064 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0097798739999999992 2020-11-16T20:56:09.064 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.064 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.064 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.064 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.131508+0000", 2020-11-16T20:56:09.064 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011847500000000001 2020-11-16T20:56:09.064 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.064 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:09.065 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.131627+0000", 2020-11-16T20:56:09.065 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.009370817 2020-11-16T20:56:09.065 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.065 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.140997+0000", 2020-11-16T20:56:09.066 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8214999999999996e-05 2020-11-16T20:56:09.066 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.066 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.066 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.141076+0000", 2020-11-16T20:56:09.066 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024876199999999997 2020-11-16T20:56:09.066 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.066 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.067 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.067 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.141324+0000", 2020-11-16T20:56:09.067 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019680626 2020-11-16T20:56:09.067 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.067 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.067 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.067 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.068 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.068 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2350 4.2 4:540952ab:::smithi16641208-369:head [setxattr _header (57) in=7b,truncate 2689219] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:09.068 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:04.995896+0000", 2020-11-16T20:56:09.068 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.9580920530000001, 2020-11-16T20:56:09.068 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029642330000000001, 2020-11-16T20:56:09.068 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.068 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.068 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:09.069 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:09.069 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:09.069 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2350 2020-11-16T20:56:09.069 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.069 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.069 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.069 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.070 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995896+0000", 2020-11-16T20:56:09.070 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.070 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.070 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.070 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.070 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995896+0000", 2020-11-16T20:56:09.070 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6718999999999999e-05 2020-11-16T20:56:09.070 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.071 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.071 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.071 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995923+0000", 2020-11-16T20:56:09.071 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.45e-06 2020-11-16T20:56:09.071 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.071 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.071 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.072 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995926+0000", 2020-11-16T20:56:09.072 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0610000000000001e-06 2020-11-16T20:56:09.072 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.072 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.072 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.072 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995932+0000", 2020-11-16T20:56:09.072 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8159999999999998e-06 2020-11-16T20:56:09.072 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.073 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.073 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.073 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995935+0000", 2020-11-16T20:56:09.073 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033157800000000002 2020-11-16T20:56:09.073 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.073 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.073 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.074 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.996267+0000", 2020-11-16T20:56:09.074 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2596999999999997e-05 2020-11-16T20:56:09.074 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.074 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.074 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:09.074 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.996329+0000", 2020-11-16T20:56:09.074 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017162574 2020-11-16T20:56:09.074 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.075 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.075 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.075 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.013492+0000", 2020-11-16T20:56:09.075 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010529100000000001 2020-11-16T20:56:09.075 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.075 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.075 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.076 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.013597+0000", 2020-11-16T20:56:09.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00026468599999999998 2020-11-16T20:56:09.076 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.076 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.076 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:09.076 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.013862+0000", 2020-11-16T20:56:09.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039181670000000002 2020-11-16T20:56:09.076 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.077 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.077 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:09.077 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017780+0000", 2020-11-16T20:56:09.077 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0074859829999999999 2020-11-16T20:56:09.077 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.077 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.077 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:09.078 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025266+0000", 2020-11-16T20:56:09.078 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014650000000000001 2020-11-16T20:56:09.078 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.078 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.078 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:09.078 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025413+0000", 2020-11-16T20:56:09.078 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0152999999999998e-05 2020-11-16T20:56:09.078 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.079 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.079 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.079 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025473+0000", 2020-11-16T20:56:09.079 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5754999999999996e-05 2020-11-16T20:56:09.079 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.079 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.079 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.080 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025539+0000", 2020-11-16T20:56:09.080 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029642330000000001 2020-11-16T20:56:09.080 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.080 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.080 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.080 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.080 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.081 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2351 4.2 4:540952ab:::smithi16641208-369:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e42)", 2020-11-16T20:56:09.081 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:04.995959+0000", 2020-11-16T20:56:09.081 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.9580289579999999, 2020-11-16T20:56:09.081 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030096398999999999, 2020-11-16T20:56:09.081 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.081 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:09.081 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:09.081 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:09.082 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:09.082 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2351 2020-11-16T20:56:09.082 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.082 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.082 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.082 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.082 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995959+0000", 2020-11-16T20:56:09.083 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.083 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.083 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.083 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.083 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995959+0000", 2020-11-16T20:56:09.083 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5330000000000001e-05 2020-11-16T20:56:09.083 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.083 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.084 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.084 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995975+0000", 2020-11-16T20:56:09.084 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.45e-06 2020-11-16T20:56:09.084 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.084 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.084 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.084 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995978+0000", 2020-11-16T20:56:09.085 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0909999999999998e-06 2020-11-16T20:56:09.085 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.085 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.085 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.085 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995984+0000", 2020-11-16T20:56:09.085 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6350000000000002e-06 2020-11-16T20:56:09.085 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.085 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.086 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.086 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995987+0000", 2020-11-16T20:56:09.086 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00037882600000000002 2020-11-16T20:56:09.086 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.086 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.086 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.086 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.996366+0000", 2020-11-16T20:56:09.087 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4063000000000002e-05 2020-11-16T20:56:09.087 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.087 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.087 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:09.087 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.996400+0000", 2020-11-16T20:56:09.087 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017796823 2020-11-16T20:56:09.087 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.088 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.088 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.088 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.014197+0000", 2020-11-16T20:56:09.088 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9716000000000005e-05 2020-11-16T20:56:09.088 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.088 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.088 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:09.088 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.014296+0000", 2020-11-16T20:56:09.089 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011288734999999999 2020-11-16T20:56:09.089 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.089 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.089 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.089 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025585+0000", 2020-11-16T20:56:09.089 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000152924 2020-11-16T20:56:09.089 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.090 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.090 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.090 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025738+0000", 2020-11-16T20:56:09.090 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00031780600000000001 2020-11-16T20:56:09.090 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.090 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.090 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.090 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.026056+0000", 2020-11-16T20:56:09.091 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030096398999999999 2020-11-16T20:56:09.091 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.091 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.091 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.091 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.091 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.091 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2364 4.2 4:646fee8a:::smithi16641208-407:head [write 1887942~537832] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:09.092 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.038059+0000", 2020-11-16T20:56:09.092 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.9159289589999999, 2020-11-16T20:56:09.092 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041814939000000002, 2020-11-16T20:56:09.092 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.092 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.092 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:09.092 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:09.092 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:09.093 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2364 2020-11-16T20:56:09.093 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.093 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.093 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.093 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.093 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038059+0000", 2020-11-16T20:56:09.093 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.093 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.094 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.094 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.094 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038059+0000", 2020-11-16T20:56:09.094 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017486300000000001 2020-11-16T20:56:09.094 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.094 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.094 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.095 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038234+0000", 2020-11-16T20:56:09.095 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2265e-05 2020-11-16T20:56:09.095 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.095 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.095 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.095 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038246+0000", 2020-11-16T20:56:09.095 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7935e-05 2020-11-16T20:56:09.096 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.096 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.096 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.096 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038264+0000", 2020-11-16T20:56:09.096 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2608e-05 2020-11-16T20:56:09.096 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.096 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.096 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.097 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038277+0000", 2020-11-16T20:56:09.097 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9994000000000002e-05 2020-11-16T20:56:09.097 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.097 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.097 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.097 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038337+0000", 2020-11-16T20:56:09.097 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8548999999999997e-05 2020-11-16T20:56:09.097 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.098 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.098 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:09.098 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038406+0000", 2020-11-16T20:56:09.098 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022992545 2020-11-16T20:56:09.098 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.098 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.098 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.099 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.061398+0000", 2020-11-16T20:56:09.099 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011551499999999999 2020-11-16T20:56:09.099 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.099 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.099 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.099 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.061514+0000", 2020-11-16T20:56:09.099 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018992799999999999 2020-11-16T20:56:09.100 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.100 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.100 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:09.100 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.061704+0000", 2020-11-16T20:56:09.100 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078335980000000006 2020-11-16T20:56:09.100 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.100 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.100 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:09.101 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.069537+0000", 2020-11-16T20:56:09.101 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0069952080000000002 2020-11-16T20:56:09.101 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.101 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.101 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:09.101 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076532+0000", 2020-11-16T20:56:09.101 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0032792590000000001 2020-11-16T20:56:09.101 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.102 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.102 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:09.102 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.079812+0000", 2020-11-16T20:56:09.102 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6931999999999998e-05 2020-11-16T20:56:09.102 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.102 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.102 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.103 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.079849+0000", 2020-11-16T20:56:09.103 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5740000000000001e-05 2020-11-16T20:56:09.103 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.103 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.103 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.103 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.079874+0000", 2020-11-16T20:56:09.103 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041814939000000002 2020-11-16T20:56:09.103 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.104 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.104 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.104 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.104 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.104 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2365 4.2 4:646fee8a:::smithi16641208-407:head [setxattr _header (57) in=7b,truncate 2756447] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:09.104 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.038336+0000", 2020-11-16T20:56:09.104 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.9156523870000002, 2020-11-16T20:56:09.105 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041675704000000001, 2020-11-16T20:56:09.105 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.105 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.105 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:09.105 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:09.105 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:09.105 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2365 2020-11-16T20:56:09.106 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.106 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.106 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.106 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.106 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038336+0000", 2020-11-16T20:56:09.106 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.106 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.106 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.107 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.107 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038336+0000", 2020-11-16T20:56:09.107 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4296999999999999e-05 2020-11-16T20:56:09.107 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.107 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.107 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.107 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038390+0000", 2020-11-16T20:56:09.108 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0770000000000002e-06 2020-11-16T20:56:09.108 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.108 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.108 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.108 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038397+0000", 2020-11-16T20:56:09.108 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1194e-05 2020-11-16T20:56:09.108 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.108 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.109 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.109 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038408+0000", 2020-11-16T20:56:09.109 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4639999999999997e-06 2020-11-16T20:56:09.109 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.109 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.109 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.109 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038414+0000", 2020-11-16T20:56:09.110 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2388000000000002e-05 2020-11-16T20:56:09.110 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.110 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.110 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.110 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038446+0000", 2020-11-16T20:56:09.110 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1230999999999999e-05 2020-11-16T20:56:09.110 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.110 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.111 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:09.111 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038488+0000", 2020-11-16T20:56:09.111 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030040847999999998 2020-11-16T20:56:09.111 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.111 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.111 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.111 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.068528+0000", 2020-11-16T20:56:09.112 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000171237 2020-11-16T20:56:09.112 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.112 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.112 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.112 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.068700+0000", 2020-11-16T20:56:09.112 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033098099999999999 2020-11-16T20:56:09.112 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.112 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:09.113 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.069031+0000", 2020-11-16T20:56:09.113 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061702559999999998 2020-11-16T20:56:09.113 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.113 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:09.113 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.075201+0000", 2020-11-16T20:56:09.113 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0013760949999999999 2020-11-16T20:56:09.114 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.114 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.114 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:09.114 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076577+0000", 2020-11-16T20:56:09.114 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033426459999999999 2020-11-16T20:56:09.114 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.114 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.115 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:09.115 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.079920+0000", 2020-11-16T20:56:09.115 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7162000000000001e-05 2020-11-16T20:56:09.115 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.115 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.115 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.115 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.079957+0000", 2020-11-16T20:56:09.115 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4827999999999998e-05 2020-11-16T20:56:09.116 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.116 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.116 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.116 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.080012+0000", 2020-11-16T20:56:09.116 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041675704000000001 2020-11-16T20:56:09.116 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.116 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.117 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.117 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.117 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.117 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2366 4.2 4:646fee8a:::smithi16641208-407:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e42)", 2020-11-16T20:56:09.117 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.038451+0000", 2020-11-16T20:56:09.117 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.9155373760000001, 2020-11-16T20:56:09.117 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041982845999999997, 2020-11-16T20:56:09.117 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.118 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:09.118 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:09.118 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:09.118 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:09.118 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2366 2020-11-16T20:56:09.118 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.118 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.119 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.119 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.119 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038451+0000", 2020-11-16T20:56:09.119 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.119 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.119 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.119 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.120 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038451+0000", 2020-11-16T20:56:09.120 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0439999999999999e-05 2020-11-16T20:56:09.120 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.120 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.120 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.120 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038491+0000", 2020-11-16T20:56:09.120 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5890000000000002e-06 2020-11-16T20:56:09.120 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.121 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.121 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.121 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038497+0000", 2020-11-16T20:56:09.121 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4161999999999999e-05 2020-11-16T20:56:09.121 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.121 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.121 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.121 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038511+0000", 2020-11-16T20:56:09.122 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.533e-06 2020-11-16T20:56:09.122 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.122 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.122 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.122 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038518+0000", 2020-11-16T20:56:09.122 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5011000000000001e-05 2020-11-16T20:56:09.122 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.123 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.123 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.123 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038553+0000", 2020-11-16T20:56:09.123 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5098000000000001e-05 2020-11-16T20:56:09.123 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.123 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.123 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:09.123 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038598+0000", 2020-11-16T20:56:09.124 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030972613999999999 2020-11-16T20:56:09.124 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.124 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.124 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.124 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.069570+0000", 2020-11-16T20:56:09.124 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000133509 2020-11-16T20:56:09.124 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.125 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.125 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:09.125 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.069704+0000", 2020-11-16T20:56:09.125 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010338886 2020-11-16T20:56:09.125 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.125 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.125 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.125 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.080043+0000", 2020-11-16T20:56:09.126 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4997e-05 2020-11-16T20:56:09.126 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.126 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.126 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.126 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.080118+0000", 2020-11-16T20:56:09.126 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00031600699999999998 2020-11-16T20:56:09.126 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.127 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.127 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.127 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.080434+0000", 2020-11-16T20:56:09.127 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041982845999999997 2020-11-16T20:56:09.127 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.127 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.127 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.127 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.128 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.128 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2367 4.2 4:581c1e5b:::smithi16641208-124:head [copy-from ver 55] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:09.128 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.038554+0000", 2020-11-16T20:56:09.128 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.915433878, 2020-11-16T20:56:09.128 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037316112999999998, 2020-11-16T20:56:09.128 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.128 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.129 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:09.129 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:09.129 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:09.129 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2367 2020-11-16T20:56:09.129 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.129 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.129 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.129 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.130 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038554+0000", 2020-11-16T20:56:09.130 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.130 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.130 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.130 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.130 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038554+0000", 2020-11-16T20:56:09.130 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0499e-05 2020-11-16T20:56:09.131 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.131 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.131 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.131 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038595+0000", 2020-11-16T20:56:09.131 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2469999999999997e-06 2020-11-16T20:56:09.131 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.131 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.132 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.132 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038601+0000", 2020-11-16T20:56:09.132 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0334e-05 2020-11-16T20:56:09.132 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.132 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.132 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.132 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038611+0000", 2020-11-16T20:56:09.132 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4869999999999996e-06 2020-11-16T20:56:09.133 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.133 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.133 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.133 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038619+0000", 2020-11-16T20:56:09.133 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2597999999999999e-05 2020-11-16T20:56:09.133 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.133 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.134 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.134 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038642+0000", 2020-11-16T20:56:09.134 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.0017000000000003e-05 2020-11-16T20:56:09.134 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.134 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.134 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.134 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038722+0000", 2020-11-16T20:56:09.134 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013694288000000001 2020-11-16T20:56:09.135 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.135 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.135 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:09.135 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.052416+0000", 2020-11-16T20:56:09.135 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010514186999999999 2020-11-16T20:56:09.135 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.135 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.136 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:09.136 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.062930+0000", 2020-11-16T20:56:09.136 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0065865289999999998 2020-11-16T20:56:09.136 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.136 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.136 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:09.136 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.069517+0000", 2020-11-16T20:56:09.136 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0062547710000000001 2020-11-16T20:56:09.137 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.137 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.137 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:09.137 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.075771+0000", 2020-11-16T20:56:09.137 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0716e-05 2020-11-16T20:56:09.137 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.137 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.138 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.138 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.075822+0000", 2020-11-16T20:56:09.138 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8439999999999997e-05 2020-11-16T20:56:09.138 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.138 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.138 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.138 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.075870+0000", 2020-11-16T20:56:09.138 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037316112999999998 2020-11-16T20:56:09.139 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.139 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.139 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.139 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.139 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.139 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2368 4.2 4:581c1e5b:::smithi16641208-124:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e42)", 2020-11-16T20:56:09.139 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.038662+0000", 2020-11-16T20:56:09.140 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.915326141, 2020-11-16T20:56:09.140 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037390824000000003, 2020-11-16T20:56:09.140 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.140 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:09.140 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:09.140 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:09.140 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:09.140 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2368 2020-11-16T20:56:09.141 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.141 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.141 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.141 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.141 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038662+0000", 2020-11-16T20:56:09.141 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.141 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.142 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.142 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.142 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038662+0000", 2020-11-16T20:56:09.142 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8368999999999999e-05 2020-11-16T20:56:09.142 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.142 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.142 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.142 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038690+0000", 2020-11-16T20:56:09.143 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2320000000000007e-06 2020-11-16T20:56:09.143 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.143 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.143 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.143 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038700+0000", 2020-11-16T20:56:09.143 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6840000000000001e-05 2020-11-16T20:56:09.143 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.144 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.144 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.144 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038717+0000", 2020-11-16T20:56:09.144 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3580000000000002e-06 2020-11-16T20:56:09.144 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.144 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.144 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.144 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038722+0000", 2020-11-16T20:56:09.145 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000148469 2020-11-16T20:56:09.145 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.145 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.145 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.145 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038870+0000", 2020-11-16T20:56:09.145 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8625000000000003e-05 2020-11-16T20:56:09.145 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.145 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.146 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:09.146 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038919+0000", 2020-11-16T20:56:09.146 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030826721000000001 2020-11-16T20:56:09.146 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.146 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.146 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.146 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.069746+0000", 2020-11-16T20:56:09.147 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011651500000000001 2020-11-16T20:56:09.147 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.147 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.147 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:09.147 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.069862+0000", 2020-11-16T20:56:09.147 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0060354850000000002 2020-11-16T20:56:09.147 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.148 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.148 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.148 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.075898+0000", 2020-11-16T20:56:09.148 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2551000000000003e-05 2020-11-16T20:56:09.148 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.148 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.148 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.149 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.075980+0000", 2020-11-16T20:56:09.149 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2658999999999997e-05 2020-11-16T20:56:09.149 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.149 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.149 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.149 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076053+0000", 2020-11-16T20:56:09.149 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037390824000000003 2020-11-16T20:56:09.150 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.150 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.150 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.150 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.150 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.150 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2376 4.2 4:540952ab:::smithi16641208-369:head [setxattr _header (57) in=7b,truncate 2790061] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:09.150 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.070033+0000", 2020-11-16T20:56:09.150 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.8839549870000001, 2020-11-16T20:56:09.151 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023378961, 2020-11-16T20:56:09.151 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.151 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.151 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:09.151 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:09.151 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:09.151 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2376 2020-11-16T20:56:09.152 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.152 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.152 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.152 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.152 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070033+0000", 2020-11-16T20:56:09.152 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.152 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.153 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.153 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.153 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070033+0000", 2020-11-16T20:56:09.153 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3158999999999998e-05 2020-11-16T20:56:09.153 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.153 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.153 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.154 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070076+0000", 2020-11-16T20:56:09.154 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8919999999999997e-06 2020-11-16T20:56:09.154 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.154 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.154 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.154 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070082+0000", 2020-11-16T20:56:09.154 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0039e-05 2020-11-16T20:56:09.155 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.155 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.155 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.155 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070092+0000", 2020-11-16T20:56:09.155 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1699999999999996e-06 2020-11-16T20:56:09.155 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.155 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.155 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.156 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070098+0000", 2020-11-16T20:56:09.156 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006570378 2020-11-16T20:56:09.156 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.156 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.156 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.156 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076668+0000", 2020-11-16T20:56:09.157 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012836600000000001 2020-11-16T20:56:09.157 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.157 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.157 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.157 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076796+0000", 2020-11-16T20:56:09.157 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000202857 2020-11-16T20:56:09.157 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.158 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.158 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:09.158 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076999+0000", 2020-11-16T20:56:09.158 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002782419 2020-11-16T20:56:09.158 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.158 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.158 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:09.159 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.079782+0000", 2020-11-16T20:56:09.159 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0036439520000000002 2020-11-16T20:56:09.159 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.159 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.159 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:09.159 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.083426+0000", 2020-11-16T20:56:09.159 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0098012419999999999 2020-11-16T20:56:09.159 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.160 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.160 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:09.160 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.093227+0000", 2020-11-16T20:56:09.160 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.5495999999999995e-05 2020-11-16T20:56:09.160 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.160 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.160 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.161 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.093322+0000", 2020-11-16T20:56:09.161 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9990999999999999e-05 2020-11-16T20:56:09.161 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.161 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.161 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.161 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.093412+0000", 2020-11-16T20:56:09.161 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023378961 2020-11-16T20:56:09.161 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.162 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.162 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.162 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.162 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.162 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2377 4.2 4:540952ab:::smithi16641208-369:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e42)", 2020-11-16T20:56:09.162 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.070126+0000", 2020-11-16T20:56:09.162 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.8838621770000001, 2020-11-16T20:56:09.163 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023513600999999999, 2020-11-16T20:56:09.163 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.163 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:09.163 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:09.163 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:09.163 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:09.163 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2377 2020-11-16T20:56:09.163 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.164 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.164 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.164 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.164 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070126+0000", 2020-11-16T20:56:09.164 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.164 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.164 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.165 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.165 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070126+0000", 2020-11-16T20:56:09.165 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7708999999999998e-05 2020-11-16T20:56:09.165 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.165 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.165 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.165 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070154+0000", 2020-11-16T20:56:09.165 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6370000000000004e-06 2020-11-16T20:56:09.166 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.166 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.166 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.166 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070159+0000", 2020-11-16T20:56:09.166 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0202e-05 2020-11-16T20:56:09.166 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.166 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.167 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.167 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070170+0000", 2020-11-16T20:56:09.167 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1049999999999997e-06 2020-11-16T20:56:09.167 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.167 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.167 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.167 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070174+0000", 2020-11-16T20:56:09.168 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0071943199999999997 2020-11-16T20:56:09.168 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.168 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.168 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.168 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.077368+0000", 2020-11-16T20:56:09.168 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000108006 2020-11-16T20:56:09.168 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.168 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.169 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:09.169 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.077476+0000", 2020-11-16T20:56:09.169 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01596991 2020-11-16T20:56:09.169 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.169 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.169 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.169 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.093446+0000", 2020-11-16T20:56:09.170 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.5842999999999997e-05 2020-11-16T20:56:09.170 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.170 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.170 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.170 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.093542+0000", 2020-11-16T20:56:09.170 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.7868999999999994e-05 2020-11-16T20:56:09.170 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.170 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.171 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.171 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.093640+0000", 2020-11-16T20:56:09.171 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023513600999999999 2020-11-16T20:56:09.171 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.171 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.171 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.171 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.172 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.172 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:09.175 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:09.034+0000 7f1837789700 -1 osd.4 pg_epoch: 46 pg[3.3( v 46'437 (0'0,46'437] local-lis/les=19/20 n=132 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [4,0,6] r=0 lpr=19 crt=46'437 lcod 46'435 mlcod 46'435 active+clean+snaptrim trimq=[4~1] ps=[2~2,6~1]] removing snap head 2020-11-16T20:56:09.175 INFO:tasks.rados.rados.0.smithi166.stdout:575: done (5 left) 2020-11-16T20:56:09.175 INFO:tasks.rados.rados.0.smithi166.stdout:576: rollback oid 88 current snap is 6 2020-11-16T20:56:09.176 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 88 to 5 2020-11-16T20:56:09.176 INFO:tasks.rados.rados.0.smithi166.stdout:577: cache_evict oid 134 snap -1 2020-11-16T20:56:09.176 INFO:tasks.rados.rados.0.smithi166.stdout:578: write (excl) oid 153 current snap is 6 2020-11-16T20:56:09.176 INFO:tasks.rados.rados.0.smithi166.stdout:578: seq_num 527 ranges {457289=484580,1438834=548839,2772623=84666} 2020-11-16T20:56:09.176 INFO:tasks.rados.rados.0.smithi166.stdout:578: writing smithi16641208-153 from 457289 to 941869 tid 1 2020-11-16T20:56:09.176 INFO:tasks.rados.rados.0.smithi166.stdout:578: writing smithi16641208-153 from 1438834 to 1987673 tid 2 2020-11-16T20:56:09.177 INFO:tasks.rados.rados.0.smithi166.stdout:578: writing smithi16641208-153 from 2772623 to 2857289 tid 3 2020-11-16T20:56:09.177 INFO:tasks.rados.rados.0.smithi166.stdout:579: cache_flush oid 453 snap -1 2020-11-16T20:56:09.177 INFO:tasks.rados.rados.0.smithi166.stdout:580: copy_from oid 111 from oid 341 current snap is 6 2020-11-16T20:56:09.177 INFO:tasks.rados.rados.0.smithi166.stdout:581: cache_try_flush oid 217 snap -1 2020-11-16T20:56:09.177 INFO:tasks.rados.rados.0.smithi166.stdout:582: snap_create 2020-11-16T20:56:09.177 INFO:tasks.rados.rados.0.smithi166.stdout:571: got (2) No such file or directory 2020-11-16T20:56:09.177 INFO:tasks.rados.rados.0.smithi166.stdout:572: finishing write tid 1 to smithi16641208-317 2020-11-16T20:56:09.178 INFO:tasks.rados.rados.0.smithi166.stdout:573: got (2) No such file or directory 2020-11-16T20:56:09.178 INFO:tasks.rados.rados.0.smithi166.stdout:569: finishing write tid 2 to smithi16641208-140 2020-11-16T20:56:09.178 INFO:tasks.rados.rados.0.smithi166.stdout:569: finishing write tid 3 to smithi16641208-140 2020-11-16T20:56:09.178 INFO:tasks.rados.rados.0.smithi166.stdout:569: finishing write tid 4 to smithi16641208-140 2020-11-16T20:56:09.178 INFO:tasks.rados.rados.0.smithi166.stdout:569: finishing write tid 5 to smithi16641208-140 2020-11-16T20:56:09.178 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 140 v 496 (ObjNum 525 snap 6 seq_num 525) dirty exists 2020-11-16T20:56:09.178 INFO:tasks.rados.rados.0.smithi166.stdout:569: left oid 140 (ObjNum 525 snap 6 seq_num 525) 2020-11-16T20:56:09.178 INFO:tasks.rados.rados.0.smithi166.stdout:572: finishing write tid 2 to smithi16641208-317 2020-11-16T20:56:09.179 INFO:tasks.rados.rados.0.smithi166.stdout:572: finishing write tid 3 to smithi16641208-317 2020-11-16T20:56:09.179 INFO:tasks.rados.rados.0.smithi166.stdout:572: finishing write tid 4 to smithi16641208-317 2020-11-16T20:56:09.179 INFO:tasks.rados.rados.0.smithi166.stdout:572: finishing write tid 5 to smithi16641208-317 2020-11-16T20:56:09.179 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 317 v 436 (ObjNum 526 snap 6 seq_num 526) dirty exists 2020-11-16T20:56:09.179 INFO:tasks.rados.rados.0.smithi166.stdout:572: left oid 317 (ObjNum 526 snap 6 seq_num 526) 2020-11-16T20:56:09.179 INFO:tasks.rados.rados.0.smithi166.stdout:574: finishing copy_from to smithi16641208-252 2020-11-16T20:56:09.179 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 252 v 160 (ObjNum 293 snap 0 seq_num 293) dirty exists 2020-11-16T20:56:09.180 INFO:tasks.rados.rados.0.smithi166.stdout:574: finishing copy_from racing read to smithi16641208-252 2020-11-16T20:56:09.180 INFO:tasks.rados.rados.0.smithi166.stdout:577: got (2) No such file or directory 2020-11-16T20:56:09.180 INFO:tasks.rados.rados.0.smithi166.stdout:581: got (2) No such file or directory 2020-11-16T20:56:09.180 INFO:tasks.rados.rados.0.smithi166.stdout:579: got (0) Success 2020-11-16T20:56:09.180 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 453 v 0 (ObjNum 452 snap 0 seq_num 452) dirty exists 2020-11-16T20:56:09.180 INFO:tasks.rados.rados.0.smithi166.stdout:576: finishing rollback tid 0 to smithi16641208-88 2020-11-16T20:56:09.180 INFO:tasks.rados.rados.0.smithi166.stdout:576: finishing rollback tid 1 to smithi16641208-88 2020-11-16T20:56:09.181 INFO:tasks.rados.rados.0.smithi166.stdout:576: finishing rollback tid 2 to smithi16641208-88 2020-11-16T20:56:09.181 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 88 v 439 (ObjNum 87 snap 0 seq_num 87) dirty exists 2020-11-16T20:56:09.181 INFO:tasks.rados.rados.0.smithi166.stdout:578: finishing write tid 1 to smithi16641208-153 2020-11-16T20:56:09.181 INFO:tasks.rados.rados.0.smithi166.stdout:578: finishing write tid 2 to smithi16641208-153 2020-11-16T20:56:09.181 INFO:tasks.rados.rados.0.smithi166.stdout:578: finishing write tid 3 to smithi16641208-153 2020-11-16T20:56:09.181 INFO:tasks.rados.rados.0.smithi166.stdout:578: finishing write tid 4 to smithi16641208-153 2020-11-16T20:56:09.181 INFO:tasks.rados.rados.0.smithi166.stdout:578: finishing write tid 5 to smithi16641208-153 2020-11-16T20:56:09.181 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 153 v 442 (ObjNum 527 snap 6 seq_num 527) dirty exists 2020-11-16T20:56:09.182 INFO:tasks.rados.rados.0.smithi166.stdout:578: left oid 153 (ObjNum 527 snap 6 seq_num 527) 2020-11-16T20:56:09.182 INFO:tasks.rados.rados.0.smithi166.stdout:580: finishing copy_from to smithi16641208-111 2020-11-16T20:56:09.182 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 111 v 265 (ObjNum 340 snap 0 seq_num 340) dirty exists 2020-11-16T20:56:09.182 INFO:tasks.rados.rados.0.smithi166.stdout:580: finishing copy_from racing read to smithi16641208-111 2020-11-16T20:56:09.182 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:09.024+0000 7ff3cda4b700 -1 osd.0 pg_epoch: 46 pg[3.1( v 46'508 (0'0,46'508] local-lis/les=19/20 n=147 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [0,4,3] r=0 lpr=19 luod=46'506 crt=46'508 lcod 46'504 mlcod 46'504 active+clean+snaptrim trimq=[4~1] ps=[2~2,6~1]] removing snap head 2020-11-16T20:56:09.182 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:09.025+0000 7f1d7e7f5700 -1 osd.3 pg_epoch: 46 pg[3.2( v 46'441 (0'0,46'441] local-lis/les=19/20 n=124 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [3,5,6] r=0 lpr=19 luod=46'437 crt=46'441 lcod 46'435 mlcod 46'435 active+clean+snaptrim trimq=[4~1] ps=[2~2,6~1]] removing snap head 2020-11-16T20:56:09.183 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:09.178+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:09.183 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:56:09.274 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:09.278+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:09.340 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:09.341 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:09.341 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:56:09.341 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:09.349 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:56:09.393 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:09.398+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:09.474 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:09.474 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:09.475 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:56:09.475 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:56:09.475 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:09.477 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:09.482+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:09.483 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:56:09.578 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:09.583+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:09.652 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:09.652 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:56:09.652 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:56:09.652 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:56:09.652 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.652 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:170 3.0 e33/19 3:1e260d0e:::smithi16641208-43:head v 33'12, mlcod=33'10)", 2020-11-16T20:56:09.653 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.458057+0000", 2020-11-16T20:56:09.653 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 18.197583925, 2020-11-16T20:56:09.653 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040611839999999998, 2020-11-16T20:56:09.653 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.653 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.653 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.654 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.654 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.654 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458057+0000", 2020-11-16T20:56:09.654 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.654 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.654 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.654 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.655 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458057+0000", 2020-11-16T20:56:09.655 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000227333 2020-11-16T20:56:09.655 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.655 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.655 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.655 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458284+0000", 2020-11-16T20:56:09.655 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8389999999999996e-06 2020-11-16T20:56:09.655 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.656 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.656 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.656 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458293+0000", 2020-11-16T20:56:09.656 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9907999999999998e-05 2020-11-16T20:56:09.656 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.656 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.656 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.657 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458333+0000", 2020-11-16T20:56:09.657 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2132e-05 2020-11-16T20:56:09.657 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.657 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.657 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.657 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458345+0000", 2020-11-16T20:56:09.657 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0157000000000001e-05 2020-11-16T20:56:09.658 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.658 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.658 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.658 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458395+0000", 2020-11-16T20:56:09.658 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6659e-05 2020-11-16T20:56:09.658 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.658 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.659 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.659 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458422+0000", 2020-11-16T20:56:09.659 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0036338049999999999 2020-11-16T20:56:09.659 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.659 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.659 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.659 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.462056+0000", 2020-11-16T20:56:09.659 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2351e-05 2020-11-16T20:56:09.660 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.660 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.660 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.660 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.462118+0000", 2020-11-16T20:56:09.660 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040611839999999998 2020-11-16T20:56:09.660 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.660 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.661 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.661 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.661 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.661 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:890 3.0 e35/19 3:2209b6da:::smithi16641208-202:head v 35'131, mlcod=35'129)", 2020-11-16T20:56:09.661 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.078620+0000", 2020-11-16T20:56:09.661 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 15.577020879999999, 2020-11-16T20:56:09.661 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039687519999999999, 2020-11-16T20:56:09.662 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.662 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.662 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.662 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.662 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.662 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078620+0000", 2020-11-16T20:56:09.662 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.663 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.663 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.663 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.663 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078620+0000", 2020-11-16T20:56:09.663 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018733000000000001 2020-11-16T20:56:09.663 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.663 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.663 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.664 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078807+0000", 2020-11-16T20:56:09.664 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9799999999999993e-06 2020-11-16T20:56:09.664 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.664 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.664 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.664 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078817+0000", 2020-11-16T20:56:09.664 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5116000000000001e-05 2020-11-16T20:56:09.665 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.665 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.665 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.665 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078832+0000", 2020-11-16T20:56:09.665 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2634e-05 2020-11-16T20:56:09.665 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.665 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.666 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.666 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078845+0000", 2020-11-16T20:56:09.666 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1001999999999997e-05 2020-11-16T20:56:09.666 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.666 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.666 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.666 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078896+0000", 2020-11-16T20:56:09.666 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5238000000000001e-05 2020-11-16T20:56:09.667 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.667 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.667 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.667 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078921+0000", 2020-11-16T20:56:09.667 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035949210000000001 2020-11-16T20:56:09.667 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.667 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.668 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.668 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.082516+0000", 2020-11-16T20:56:09.668 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2531000000000001e-05 2020-11-16T20:56:09.668 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.668 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.668 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.668 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.082588+0000", 2020-11-16T20:56:09.669 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039687519999999999 2020-11-16T20:56:09.669 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.669 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.669 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.669 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.669 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.669 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:901 3.0 e35/19 3:29e07ad2:::smithi16641208-204:head v 35'134, mlcod=35'132)", 2020-11-16T20:56:09.669 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.128152+0000", 2020-11-16T20:56:09.670 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 15.527488667, 2020-11-16T20:56:09.670 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042710120000000002, 2020-11-16T20:56:09.670 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.670 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.670 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.670 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.670 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.671 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128152+0000", 2020-11-16T20:56:09.671 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.671 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.671 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.671 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.671 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128152+0000", 2020-11-16T20:56:09.671 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019783600000000001 2020-11-16T20:56:09.671 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.672 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.672 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.672 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128350+0000", 2020-11-16T20:56:09.672 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6030000000000005e-06 2020-11-16T20:56:09.672 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.672 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.672 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.673 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128358+0000", 2020-11-16T20:56:09.673 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2595999999999999e-05 2020-11-16T20:56:09.673 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.673 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.673 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.673 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128371+0000", 2020-11-16T20:56:09.673 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3209999999999999e-06 2020-11-16T20:56:09.674 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.674 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.674 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.674 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128378+0000", 2020-11-16T20:56:09.674 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4047e-05 2020-11-16T20:56:09.674 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.674 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.674 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.675 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128422+0000", 2020-11-16T20:56:09.675 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9796000000000001e-05 2020-11-16T20:56:09.675 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.675 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.675 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.675 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128452+0000", 2020-11-16T20:56:09.675 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039150929999999997 2020-11-16T20:56:09.676 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.676 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.676 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.676 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.132367+0000", 2020-11-16T20:56:09.676 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5720000000000002e-05 2020-11-16T20:56:09.676 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.676 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.677 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.677 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.132423+0000", 2020-11-16T20:56:09.677 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042710120000000002 2020-11-16T20:56:09.677 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.677 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.677 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.677 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.677 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.678 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:945 3.0 e35/19 3:0893b5ca:::smithi16641208-213:head v 35'145, mlcod=35'143)", 2020-11-16T20:56:09.678 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.298660+0000", 2020-11-16T20:56:09.678 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 15.356981103000001, 2020-11-16T20:56:09.678 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003872028, 2020-11-16T20:56:09.678 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.678 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.678 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.679 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.679 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.679 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298660+0000", 2020-11-16T20:56:09.679 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.679 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.679 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.679 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.680 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298660+0000", 2020-11-16T20:56:09.680 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000217042 2020-11-16T20:56:09.680 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.680 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.680 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.680 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298877+0000", 2020-11-16T20:56:09.680 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1629e-05 2020-11-16T20:56:09.681 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.681 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.681 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.681 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298888+0000", 2020-11-16T20:56:09.681 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7003999999999998e-05 2020-11-16T20:56:09.681 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.681 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.682 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.682 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298905+0000", 2020-11-16T20:56:09.682 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.5119999999999997e-06 2020-11-16T20:56:09.682 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.682 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.682 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.682 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298915+0000", 2020-11-16T20:56:09.682 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1298999999999997e-05 2020-11-16T20:56:09.683 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.683 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.683 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.683 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298976+0000", 2020-11-16T20:56:09.683 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1288000000000003e-05 2020-11-16T20:56:09.683 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.683 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.684 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.684 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.299007+0000", 2020-11-16T20:56:09.684 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0034819920000000002 2020-11-16T20:56:09.684 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.684 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.684 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.684 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.302489+0000", 2020-11-16T20:56:09.684 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2262000000000003e-05 2020-11-16T20:56:09.685 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.685 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.685 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.685 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.302532+0000", 2020-11-16T20:56:09.685 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003872028 2020-11-16T20:56:09.685 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.685 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.686 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.686 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.686 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.686 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1028 3.0 e35/19 3:2e3eb594:::smithi16641208-229:head v 35'159, mlcod=35'157)", 2020-11-16T20:56:09.686 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.635550+0000", 2020-11-16T20:56:09.686 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 15.020090225000001, 2020-11-16T20:56:09.686 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042338380000000002, 2020-11-16T20:56:09.687 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.687 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.687 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.687 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.687 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.687 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635550+0000", 2020-11-16T20:56:09.687 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.687 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.688 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.688 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.688 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635550+0000", 2020-11-16T20:56:09.688 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018653699999999999 2020-11-16T20:56:09.688 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.688 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.688 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.689 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635737+0000", 2020-11-16T20:56:09.689 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.037e-06 2020-11-16T20:56:09.689 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.689 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.689 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.689 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635746+0000", 2020-11-16T20:56:09.689 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3001e-05 2020-11-16T20:56:09.689 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.690 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.690 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.690 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635759+0000", 2020-11-16T20:56:09.690 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7740000000000004e-06 2020-11-16T20:56:09.690 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.690 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.690 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.691 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635767+0000", 2020-11-16T20:56:09.691 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1385999999999999e-05 2020-11-16T20:56:09.691 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.691 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.691 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.691 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635818+0000", 2020-11-16T20:56:09.691 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6427e-05 2020-11-16T20:56:09.692 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.692 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.692 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.692 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635845+0000", 2020-11-16T20:56:09.692 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003885164 2020-11-16T20:56:09.692 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.692 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.692 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.693 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.639730+0000", 2020-11-16T20:56:09.693 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4512000000000003e-05 2020-11-16T20:56:09.693 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.693 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.693 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.693 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.639784+0000", 2020-11-16T20:56:09.693 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042338380000000002 2020-11-16T20:56:09.694 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.694 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.694 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.694 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.694 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.694 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1037 3.0 e35/19 3:0fda7169:::smithi16641208-231:head v 35'162, mlcod=35'160)", 2020-11-16T20:56:09.694 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.671040+0000", 2020-11-16T20:56:09.694 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 14.984600736000001, 2020-11-16T20:56:09.695 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040297739999999999, 2020-11-16T20:56:09.695 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.695 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.695 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.695 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.695 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.695 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671040+0000", 2020-11-16T20:56:09.696 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.696 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.696 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.696 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.696 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671040+0000", 2020-11-16T20:56:09.696 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012993299999999999 2020-11-16T20:56:09.696 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.696 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.697 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.697 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671170+0000", 2020-11-16T20:56:09.697 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9879999999999999e-06 2020-11-16T20:56:09.697 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.697 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.697 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.697 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671180+0000", 2020-11-16T20:56:09.698 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0243e-05 2020-11-16T20:56:09.698 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.698 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.698 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.698 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671190+0000", 2020-11-16T20:56:09.698 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4890000000000003e-06 2020-11-16T20:56:09.698 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.699 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.699 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.699 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671196+0000", 2020-11-16T20:56:09.699 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9298999999999997e-05 2020-11-16T20:56:09.699 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.699 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.699 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.699 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671245+0000", 2020-11-16T20:56:09.700 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4561000000000001e-05 2020-11-16T20:56:09.700 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.700 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.700 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.700 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671269+0000", 2020-11-16T20:56:09.700 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037448540000000002 2020-11-16T20:56:09.700 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.701 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.701 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.701 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.675014+0000", 2020-11-16T20:56:09.701 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5407e-05 2020-11-16T20:56:09.701 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.701 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.701 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.702 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.675070+0000", 2020-11-16T20:56:09.702 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040297739999999999 2020-11-16T20:56:09.702 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.702 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.702 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.702 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.702 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.703 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1102 3.0 e35/19 3:1c1ecb34:::smithi16641208-245:head v 35'172, mlcod=35'170)", 2020-11-16T20:56:09.703 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.920148+0000", 2020-11-16T20:56:09.703 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 14.73549234, 2020-11-16T20:56:09.703 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053854699999999998, 2020-11-16T20:56:09.703 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.703 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.703 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.703 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.704 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.704 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920148+0000", 2020-11-16T20:56:09.704 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.704 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.704 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.704 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.704 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920148+0000", 2020-11-16T20:56:09.705 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019421400000000001 2020-11-16T20:56:09.705 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.705 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.705 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.705 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920342+0000", 2020-11-16T20:56:09.705 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6169999999999996e-06 2020-11-16T20:56:09.705 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.706 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.706 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.706 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920352+0000", 2020-11-16T20:56:09.706 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3684e-05 2020-11-16T20:56:09.706 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.706 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.706 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.707 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920366+0000", 2020-11-16T20:56:09.707 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7789999999999996e-06 2020-11-16T20:56:09.707 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.707 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.707 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.707 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920374+0000", 2020-11-16T20:56:09.707 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8783999999999995e-05 2020-11-16T20:56:09.707 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.708 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.708 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.708 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920472+0000", 2020-11-16T20:56:09.708 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6865000000000001e-05 2020-11-16T20:56:09.708 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.708 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.708 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.709 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920499+0000", 2020-11-16T20:56:09.709 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004975246 2020-11-16T20:56:09.709 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.709 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.709 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.709 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.925474+0000", 2020-11-16T20:56:09.709 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9280999999999997e-05 2020-11-16T20:56:09.709 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.710 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.710 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.710 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.925534+0000", 2020-11-16T20:56:09.710 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053854699999999998 2020-11-16T20:56:09.710 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.710 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.711 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.711 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.711 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.711 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1198 3.0 e35/19 3:1b4407ea:::smithi16641208-269:head v 35'184, mlcod=35'182)", 2020-11-16T20:56:09.711 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.231667+0000", 2020-11-16T20:56:09.711 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 14.423973181999999, 2020-11-16T20:56:09.711 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041081770000000002, 2020-11-16T20:56:09.711 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.712 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.712 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.712 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.712 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.712 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231667+0000", 2020-11-16T20:56:09.712 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.712 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.713 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.713 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.713 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231667+0000", 2020-11-16T20:56:09.713 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018666399999999999 2020-11-16T20:56:09.713 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.713 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.713 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.713 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231854+0000", 2020-11-16T20:56:09.714 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.152e-05 2020-11-16T20:56:09.714 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.714 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.714 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.714 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231866+0000", 2020-11-16T20:56:09.714 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2456000000000002e-05 2020-11-16T20:56:09.714 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.715 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.715 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.715 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231898+0000", 2020-11-16T20:56:09.715 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6789999999999994e-06 2020-11-16T20:56:09.715 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.715 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.715 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.716 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231907+0000", 2020-11-16T20:56:09.716 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0732999999999997e-05 2020-11-16T20:56:09.716 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.716 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.716 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.716 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231957+0000", 2020-11-16T20:56:09.716 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9028000000000001e-05 2020-11-16T20:56:09.716 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.717 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.717 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.717 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231987+0000", 2020-11-16T20:56:09.717 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037323830000000001 2020-11-16T20:56:09.717 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.717 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.717 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.718 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.235719+0000", 2020-11-16T20:56:09.718 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6713999999999999e-05 2020-11-16T20:56:09.718 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.718 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.718 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.718 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.235776+0000", 2020-11-16T20:56:09.718 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041081770000000002 2020-11-16T20:56:09.719 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.719 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.719 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.719 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.720 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.720 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1234 3.0 e35/19 3:2294fced:::smithi16641208-278:head v 35'187, mlcod=35'185)", 2020-11-16T20:56:09.720 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.353572+0000", 2020-11-16T20:56:09.720 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 14.302068941, 2020-11-16T20:56:09.720 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003816182, 2020-11-16T20:56:09.720 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.720 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.721 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.721 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.721 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.721 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.353572+0000", 2020-11-16T20:56:09.721 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.721 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.721 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.722 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.722 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.353572+0000", 2020-11-16T20:56:09.722 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000142526 2020-11-16T20:56:09.722 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.722 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.722 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.722 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.353714+0000", 2020-11-16T20:56:09.723 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9410000000000001e-06 2020-11-16T20:56:09.723 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.723 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.723 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.723 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.353721+0000", 2020-11-16T20:56:09.723 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7479999999999999e-06 2020-11-16T20:56:09.723 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.723 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.724 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.724 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.353730+0000", 2020-11-16T20:56:09.724 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3039999999999999e-06 2020-11-16T20:56:09.724 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.724 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.724 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.724 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.353737+0000", 2020-11-16T20:56:09.725 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4474000000000001e-05 2020-11-16T20:56:09.725 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.725 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.725 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.725 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.353792+0000", 2020-11-16T20:56:09.725 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8490999999999999e-05 2020-11-16T20:56:09.725 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.725 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.726 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.726 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.353820+0000", 2020-11-16T20:56:09.726 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035076360000000002 2020-11-16T20:56:09.726 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.726 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.726 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.726 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.357328+0000", 2020-11-16T20:56:09.727 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0062000000000002e-05 2020-11-16T20:56:09.727 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.727 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.727 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.727 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.357388+0000", 2020-11-16T20:56:09.727 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003816182 2020-11-16T20:56:09.727 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.728 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.728 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.728 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.728 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.728 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1235 3.0 e35/19 3:2294fced:::smithi16641208-278:head v 35'188, mlcod=35'185)", 2020-11-16T20:56:09.728 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.354799+0000", 2020-11-16T20:56:09.728 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 14.300841226999999, 2020-11-16T20:56:09.728 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050791389999999999, 2020-11-16T20:56:09.729 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.729 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.729 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.729 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.729 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.729 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354799+0000", 2020-11-16T20:56:09.729 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.730 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.730 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.730 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.730 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354799+0000", 2020-11-16T20:56:09.730 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2141000000000002e-05 2020-11-16T20:56:09.730 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.730 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.730 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.731 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354842+0000", 2020-11-16T20:56:09.731 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.601e-06 2020-11-16T20:56:09.731 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.731 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.731 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.731 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354848+0000", 2020-11-16T20:56:09.731 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.028e-05 2020-11-16T20:56:09.732 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.732 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.732 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.732 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354858+0000", 2020-11-16T20:56:09.732 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2959999999999998e-06 2020-11-16T20:56:09.732 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.732 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.733 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.733 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354864+0000", 2020-11-16T20:56:09.733 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3279999999999999e-05 2020-11-16T20:56:09.733 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.733 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.733 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.733 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354907+0000", 2020-11-16T20:56:09.734 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3655e-05 2020-11-16T20:56:09.734 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.734 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.734 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.734 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354931+0000", 2020-11-16T20:56:09.734 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004888875 2020-11-16T20:56:09.734 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.735 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.735 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.735 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.359820+0000", 2020-11-16T20:56:09.735 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9011000000000001e-05 2020-11-16T20:56:09.735 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.735 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.735 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.735 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.359879+0000", 2020-11-16T20:56:09.736 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050791389999999999 2020-11-16T20:56:09.736 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.736 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.736 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.736 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.736 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.736 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1237 3.0 e35/19 3:0b7cd9c0:::smithi16641208-279:head v 35'189, mlcod=35'187)", 2020-11-16T20:56:09.737 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.361967+0000", 2020-11-16T20:56:09.737 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 14.293673985, 2020-11-16T20:56:09.737 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041733320000000001, 2020-11-16T20:56:09.737 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.737 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.737 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.737 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.737 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.738 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.361967+0000", 2020-11-16T20:56:09.738 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.738 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.738 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.738 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.738 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.361967+0000", 2020-11-16T20:56:09.738 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045453300000000002 2020-11-16T20:56:09.739 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.739 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.739 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.739 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362421+0000", 2020-11-16T20:56:09.739 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1178999999999999e-05 2020-11-16T20:56:09.739 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.739 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.740 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.740 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362432+0000", 2020-11-16T20:56:09.740 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5865000000000001e-05 2020-11-16T20:56:09.740 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.740 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.740 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.740 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362448+0000", 2020-11-16T20:56:09.740 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9809999999999992e-06 2020-11-16T20:56:09.741 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.741 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.741 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.741 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362457+0000", 2020-11-16T20:56:09.741 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9304e-05 2020-11-16T20:56:09.741 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.741 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.742 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.742 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362516+0000", 2020-11-16T20:56:09.742 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2886000000000003e-05 2020-11-16T20:56:09.742 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.742 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.742 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.742 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362549+0000", 2020-11-16T20:56:09.743 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035249809999999999 2020-11-16T20:56:09.743 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.743 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.743 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.743 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.366074+0000", 2020-11-16T20:56:09.743 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5603000000000002e-05 2020-11-16T20:56:09.743 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.743 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.744 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.744 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.366140+0000", 2020-11-16T20:56:09.744 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041733320000000001 2020-11-16T20:56:09.744 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.744 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.744 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.744 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.745 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.745 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1261 3.0 e35/19 3:393883c7:::smithi16641208-285:head v 35'195, mlcod=35'193)", 2020-11-16T20:56:09.745 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.447335+0000", 2020-11-16T20:56:09.745 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 14.208305648, 2020-11-16T20:56:09.745 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0038521330000000002, 2020-11-16T20:56:09.745 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.745 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.745 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.746 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.746 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.746 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.447335+0000", 2020-11-16T20:56:09.746 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.746 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.746 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.746 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.747 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.447335+0000", 2020-11-16T20:56:09.747 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016204500000000001 2020-11-16T20:56:09.747 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.747 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.747 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.747 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.447497+0000", 2020-11-16T20:56:09.747 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0059e-05 2020-11-16T20:56:09.747 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.748 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.748 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.748 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.447507+0000", 2020-11-16T20:56:09.748 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3206e-05 2020-11-16T20:56:09.748 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.748 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.748 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.749 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.447520+0000", 2020-11-16T20:56:09.749 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7039999999999994e-06 2020-11-16T20:56:09.749 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.749 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.749 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.749 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.447528+0000", 2020-11-16T20:56:09.749 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1130999999999995e-05 2020-11-16T20:56:09.749 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.750 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.750 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.750 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.447589+0000", 2020-11-16T20:56:09.750 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0258e-05 2020-11-16T20:56:09.750 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.750 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.750 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.751 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.447629+0000", 2020-11-16T20:56:09.751 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003512018 2020-11-16T20:56:09.751 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.751 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.751 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.751 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.451141+0000", 2020-11-16T20:56:09.751 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5711999999999999e-05 2020-11-16T20:56:09.752 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.752 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.752 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.752 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.451187+0000", 2020-11-16T20:56:09.752 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0038521330000000002 2020-11-16T20:56:09.752 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.752 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.752 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.753 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.753 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.753 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1262 3.0 e35/19 3:393883c7:::smithi16641208-285:head v 35'196, mlcod=35'194)", 2020-11-16T20:56:09.753 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.455617+0000", 2020-11-16T20:56:09.753 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 14.200023947, 2020-11-16T20:56:09.753 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039170029999999996, 2020-11-16T20:56:09.753 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.754 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.754 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.754 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.754 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.754 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455617+0000", 2020-11-16T20:56:09.754 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.754 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.754 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.755 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.755 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455617+0000", 2020-11-16T20:56:09.755 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00021765099999999999 2020-11-16T20:56:09.755 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.755 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.755 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.755 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455834+0000", 2020-11-16T20:56:09.756 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.296e-05 2020-11-16T20:56:09.756 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.756 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.756 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.756 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455847+0000", 2020-11-16T20:56:09.756 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2149e-05 2020-11-16T20:56:09.756 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.756 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.757 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.757 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455859+0000", 2020-11-16T20:56:09.757 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7663e-05 2020-11-16T20:56:09.757 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.757 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.757 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.757 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455877+0000", 2020-11-16T20:56:09.758 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6128000000000003e-05 2020-11-16T20:56:09.758 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.758 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.758 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.758 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455923+0000", 2020-11-16T20:56:09.758 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8368999999999999e-05 2020-11-16T20:56:09.758 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.758 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.759 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.759 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455952+0000", 2020-11-16T20:56:09.759 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035271780000000002 2020-11-16T20:56:09.759 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.759 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.759 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.759 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.459479+0000", 2020-11-16T20:56:09.760 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4904999999999997e-05 2020-11-16T20:56:09.760 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.760 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.760 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.760 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.459534+0000", 2020-11-16T20:56:09.760 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039170029999999996 2020-11-16T20:56:09.760 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.761 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.761 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.761 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.761 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.761 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1273 3.0 e35/19 3:2e8bdc7f:::smithi16641208-288:head v 35'198, mlcod=35'196)", 2020-11-16T20:56:09.761 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.489833+0000", 2020-11-16T20:56:09.761 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 14.165807713, 2020-11-16T20:56:09.761 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039382189999999997, 2020-11-16T20:56:09.762 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.762 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.762 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.762 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.762 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.762 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.489833+0000", 2020-11-16T20:56:09.762 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.763 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.763 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.763 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.763 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.489833+0000", 2020-11-16T20:56:09.763 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000194852 2020-11-16T20:56:09.763 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.763 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.763 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.764 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.490028+0000", 2020-11-16T20:56:09.764 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1319e-05 2020-11-16T20:56:09.764 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.764 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.764 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.764 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.490039+0000", 2020-11-16T20:56:09.764 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5579000000000001e-05 2020-11-16T20:56:09.765 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.765 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.765 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.765 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.490055+0000", 2020-11-16T20:56:09.765 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9619999999999999e-06 2020-11-16T20:56:09.765 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.765 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.766 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.766 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.490064+0000", 2020-11-16T20:56:09.766 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5654e-05 2020-11-16T20:56:09.766 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.766 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.766 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.766 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.490109+0000", 2020-11-16T20:56:09.766 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.472e-05 2020-11-16T20:56:09.767 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.767 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.767 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.767 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.490134+0000", 2020-11-16T20:56:09.767 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035931819999999999 2020-11-16T20:56:09.767 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.767 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.768 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.768 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.493727+0000", 2020-11-16T20:56:09.768 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3951e-05 2020-11-16T20:56:09.768 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.768 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.768 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.768 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.493771+0000", 2020-11-16T20:56:09.768 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039382189999999997 2020-11-16T20:56:09.769 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.769 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.769 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.769 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.769 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.769 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1311 3.0 e35/19 3:2e3f435b:::smithi16641208-296:head v 35'211, mlcod=35'209)", 2020-11-16T20:56:09.769 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.626771+0000", 2020-11-16T20:56:09.770 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 14.028869473, 2020-11-16T20:56:09.770 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0038662929999999998, 2020-11-16T20:56:09.770 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.770 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.770 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.770 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.770 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.771 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.626771+0000", 2020-11-16T20:56:09.771 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.771 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.771 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.771 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.771 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.626771+0000", 2020-11-16T20:56:09.771 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000138097 2020-11-16T20:56:09.771 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.772 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.772 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.772 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.626909+0000", 2020-11-16T20:56:09.772 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7810000000000002e-06 2020-11-16T20:56:09.772 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.772 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.772 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.773 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.626915+0000", 2020-11-16T20:56:09.773 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0280000000000003e-06 2020-11-16T20:56:09.773 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.773 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.773 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.773 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.626922+0000", 2020-11-16T20:56:09.773 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4429999999999996e-06 2020-11-16T20:56:09.773 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.774 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.774 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.774 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.626926+0000", 2020-11-16T20:56:09.774 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9570000000000002e-05 2020-11-16T20:56:09.774 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.774 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.774 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.775 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.626966+0000", 2020-11-16T20:56:09.775 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4292000000000001e-05 2020-11-16T20:56:09.775 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.775 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.775 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.775 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.626990+0000", 2020-11-16T20:56:09.775 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0036085119999999999 2020-11-16T20:56:09.776 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.776 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.776 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.776 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.630599+0000", 2020-11-16T20:56:09.776 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8569999999999998e-05 2020-11-16T20:56:09.776 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.776 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.776 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.777 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.630637+0000", 2020-11-16T20:56:09.777 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0038662929999999998 2020-11-16T20:56:09.777 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.777 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.777 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.777 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.777 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.778 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1423 3.0 e36/19 3:1e5364a0:::smithi16641208-320:head v 36'221, mlcod=35'219)", 2020-11-16T20:56:09.778 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.033789+0000", 2020-11-16T20:56:09.778 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 13.621851595000001, 2020-11-16T20:56:09.778 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041251339999999999, 2020-11-16T20:56:09.778 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.778 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.778 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.779 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.779 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.779 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033789+0000", 2020-11-16T20:56:09.779 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.779 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.779 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.779 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.779 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033789+0000", 2020-11-16T20:56:09.780 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015644000000000001 2020-11-16T20:56:09.780 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.780 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.780 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.780 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033945+0000", 2020-11-16T20:56:09.780 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0270000000000003e-06 2020-11-16T20:56:09.780 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.781 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.781 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.781 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033950+0000", 2020-11-16T20:56:09.781 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6420000000000007e-06 2020-11-16T20:56:09.781 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.781 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.781 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.781 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033958+0000", 2020-11-16T20:56:09.782 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.477e-06 2020-11-16T20:56:09.782 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.782 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.782 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.782 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033965+0000", 2020-11-16T20:56:09.782 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9178999999999998e-05 2020-11-16T20:56:09.782 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.783 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.783 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.783 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.034014+0000", 2020-11-16T20:56:09.783 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2172e-05 2020-11-16T20:56:09.783 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.783 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.783 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.784 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.034036+0000", 2020-11-16T20:56:09.784 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0038237190000000002 2020-11-16T20:56:09.784 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.784 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.784 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.784 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.037860+0000", 2020-11-16T20:56:09.784 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4478000000000003e-05 2020-11-16T20:56:09.784 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.785 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.785 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.785 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.037914+0000", 2020-11-16T20:56:09.785 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041251339999999999 2020-11-16T20:56:09.785 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.785 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.785 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.786 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.786 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.786 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1468 3.0 e36/19 3:1852173c:::smithi16641208-329:head v 36'238, mlcod=36'236)", 2020-11-16T20:56:09.786 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.208167+0000", 2020-11-16T20:56:09.786 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 13.447473821000001, 2020-11-16T20:56:09.786 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052481979999999999, 2020-11-16T20:56:09.786 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.787 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.787 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.787 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.787 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.787 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208167+0000", 2020-11-16T20:56:09.787 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.787 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.787 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.788 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.788 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208167+0000", 2020-11-16T20:56:09.788 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013521900000000001 2020-11-16T20:56:09.788 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.788 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.788 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.788 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208302+0000", 2020-11-16T20:56:09.789 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1307e-05 2020-11-16T20:56:09.789 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.789 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.789 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.789 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208313+0000", 2020-11-16T20:56:09.789 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2828e-05 2020-11-16T20:56:09.789 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.789 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.790 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.790 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208326+0000", 2020-11-16T20:56:09.790 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8889999999999996e-06 2020-11-16T20:56:09.790 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.790 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.790 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.790 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208333+0000", 2020-11-16T20:56:09.791 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2843999999999999e-05 2020-11-16T20:56:09.791 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.791 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.791 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.791 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208366+0000", 2020-11-16T20:56:09.791 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4986e-05 2020-11-16T20:56:09.791 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.792 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.792 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.792 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208381+0000", 2020-11-16T20:56:09.792 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0049810990000000001 2020-11-16T20:56:09.792 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.792 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.792 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.792 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.213362+0000", 2020-11-16T20:56:09.793 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3025999999999997e-05 2020-11-16T20:56:09.793 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.793 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.793 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.793 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.213415+0000", 2020-11-16T20:56:09.793 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052481979999999999 2020-11-16T20:56:09.793 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.794 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.794 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.794 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.794 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.794 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1490 3.0 e36/19 3:10845e0e:::smithi16641208-333:head v 36'252, mlcod=36'250)", 2020-11-16T20:56:09.794 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.301912+0000", 2020-11-16T20:56:09.794 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 13.353728819000001, 2020-11-16T20:56:09.795 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044835179999999997, 2020-11-16T20:56:09.795 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.795 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.795 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.795 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.795 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.795 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.301912+0000", 2020-11-16T20:56:09.796 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.796 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.796 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.796 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.796 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.301912+0000", 2020-11-16T20:56:09.796 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114265 2020-11-16T20:56:09.796 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.796 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.797 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.797 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302026+0000", 2020-11-16T20:56:09.797 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7940000000000008e-06 2020-11-16T20:56:09.797 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.797 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.797 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.797 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302035+0000", 2020-11-16T20:56:09.798 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5187e-05 2020-11-16T20:56:09.798 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.798 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.798 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302050+0000", 2020-11-16T20:56:09.798 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.653e-06 2020-11-16T20:56:09.798 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.798 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.799 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.799 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302059+0000", 2020-11-16T20:56:09.799 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8010000000000003e-05 2020-11-16T20:56:09.799 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.799 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.799 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.799 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302107+0000", 2020-11-16T20:56:09.800 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5335000000000001e-05 2020-11-16T20:56:09.800 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.800 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.800 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.800 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302132+0000", 2020-11-16T20:56:09.800 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042049239999999996 2020-11-16T20:56:09.800 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.800 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.801 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.801 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.306337+0000", 2020-11-16T20:56:09.801 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8350000000000002e-05 2020-11-16T20:56:09.801 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.801 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.801 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.801 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.306395+0000", 2020-11-16T20:56:09.802 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044835179999999997 2020-11-16T20:56:09.802 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.802 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.802 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.802 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.802 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.802 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1491 3.0 e36/19 3:10845e0e:::smithi16641208-333:head v 36'253, mlcod=36'250)", 2020-11-16T20:56:09.803 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.302814+0000", 2020-11-16T20:56:09.803 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 13.352826658, 2020-11-16T20:56:09.803 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039006700000000002, 2020-11-16T20:56:09.803 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.803 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.803 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.803 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.803 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.804 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302814+0000", 2020-11-16T20:56:09.804 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.804 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.804 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.804 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.804 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302814+0000", 2020-11-16T20:56:09.804 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5510999999999998e-05 2020-11-16T20:56:09.805 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.805 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.805 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.805 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302859+0000", 2020-11-16T20:56:09.805 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3980000000000002e-06 2020-11-16T20:56:09.805 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.805 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.805 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.806 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302867+0000", 2020-11-16T20:56:09.806 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0713999999999999e-05 2020-11-16T20:56:09.806 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.806 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.806 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.806 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302878+0000", 2020-11-16T20:56:09.806 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7679999999999997e-06 2020-11-16T20:56:09.807 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.807 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.807 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.807 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302883+0000", 2020-11-16T20:56:09.807 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0617000000000001e-05 2020-11-16T20:56:09.807 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.807 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.808 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.808 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302924+0000", 2020-11-16T20:56:09.808 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4732999999999999e-05 2020-11-16T20:56:09.808 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.808 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.808 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.808 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302949+0000", 2020-11-16T20:56:09.808 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037127919999999999 2020-11-16T20:56:09.809 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.809 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.809 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.809 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.306661+0000", 2020-11-16T20:56:09.809 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3137000000000003e-05 2020-11-16T20:56:09.809 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.809 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.810 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.810 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.306715+0000", 2020-11-16T20:56:09.810 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039006700000000002 2020-11-16T20:56:09.810 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.810 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.810 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.810 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.810 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.811 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:534 3.0 e46/19 3:10845e0e:::smithi16641208-333:5 v 46'391, mlcod=45'385)", 2020-11-16T20:56:09.811 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.013124+0000", 2020-11-16T20:56:09.811 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.64251624699999998, 2020-11-16T20:56:09.811 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050053900000000002, 2020-11-16T20:56:09.811 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:09.811 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:09.811 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:09.812 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.812 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:09.812 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013124+0000", 2020-11-16T20:56:09.812 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:09.812 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.812 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.812 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:09.813 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013124+0000", 2020-11-16T20:56:09.813 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9255999999999997e-05 2020-11-16T20:56:09.813 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.813 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.813 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:09.813 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013174+0000", 2020-11-16T20:56:09.813 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5140000000000004e-06 2020-11-16T20:56:09.813 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.814 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.814 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:09.814 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013181+0000", 2020-11-16T20:56:09.814 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1279e-05 2020-11-16T20:56:09.814 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.814 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.814 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:09.815 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013192+0000", 2020-11-16T20:56:09.815 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0970000000000002e-06 2020-11-16T20:56:09.815 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.815 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.815 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:09.815 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013199+0000", 2020-11-16T20:56:09.815 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5442e-05 2020-11-16T20:56:09.815 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.816 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.816 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:09.816 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013284+0000", 2020-11-16T20:56:09.816 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8368e-05 2020-11-16T20:56:09.816 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.816 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.816 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:09.817 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013312+0000", 2020-11-16T20:56:09.817 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0047640549999999997 2020-11-16T20:56:09.817 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.817 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.817 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:09.817 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.018076+0000", 2020-11-16T20:56:09.817 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3378999999999998e-05 2020-11-16T20:56:09.817 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:09.818 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:09.818 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:09.818 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.018130+0000", 2020-11-16T20:56:09.818 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050053900000000002 2020-11-16T20:56:09.818 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.818 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.818 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.819 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:09.819 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:09.819 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:09.820 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:56:09.821 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:09.825+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:09.921 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:09.925+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:09.987 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:09.987 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:09.987 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:56:09.987 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:09.996 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:56:10.010 INFO:tasks.rados.rados.0.smithi166.stdout:569: done (11 left) 2020-11-16T20:56:10.011 INFO:tasks.rados.rados.0.smithi166.stdout:571: done (10 left) 2020-11-16T20:56:10.011 INFO:tasks.rados.rados.0.smithi166.stdout:572: done (9 left) 2020-11-16T20:56:10.011 INFO:tasks.rados.rados.0.smithi166.stdout:573: done (8 left) 2020-11-16T20:56:10.011 INFO:tasks.rados.rados.0.smithi166.stdout:574: done (7 left) 2020-11-16T20:56:10.011 INFO:tasks.rados.rados.0.smithi166.stdout:576: done (6 left) 2020-11-16T20:56:10.011 INFO:tasks.rados.rados.0.smithi166.stdout:577: done (5 left) 2020-11-16T20:56:10.011 INFO:tasks.rados.rados.0.smithi166.stdout:578: done (4 left) 2020-11-16T20:56:10.012 INFO:tasks.rados.rados.0.smithi166.stdout:579: done (3 left) 2020-11-16T20:56:10.012 INFO:tasks.rados.rados.0.smithi166.stdout:580: done (2 left) 2020-11-16T20:56:10.012 INFO:tasks.rados.rados.0.smithi166.stdout:581: done (1 left) 2020-11-16T20:56:10.012 INFO:tasks.rados.rados.0.smithi166.stdout:582: done (0 left) 2020-11-16T20:56:10.012 INFO:tasks.rados.rados.0.smithi166.stdout:583: cache_flush oid 471 snap -1 2020-11-16T20:56:10.012 INFO:tasks.rados.rados.0.smithi166.stdout:584: rollback oid 69 current snap is 7 2020-11-16T20:56:10.012 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 69 to 5 2020-11-16T20:56:10.013 INFO:tasks.rados.rados.0.smithi166.stdout:585: read oid 16 snap -1 2020-11-16T20:56:10.013 INFO:tasks.rados.rados.0.smithi166.stdout:585: expect (ObjNum 15 snap 0 seq_num 15) 2020-11-16T20:56:10.013 INFO:tasks.rados.rados.0.smithi166.stdout:586: cache_try_flush oid 36 snap 5 2020-11-16T20:56:10.013 INFO:tasks.rados.rados.0.smithi166.stdout:587: snap_create 2020-11-16T20:56:10.013 INFO:tasks.rados.rados.0.smithi166.stdout:586: got (2) No such file or directory 2020-11-16T20:56:10.016 INFO:tasks.rados.rados.0.smithi166.stdout:584: finishing rollback tid 0 to smithi16641208-69 2020-11-16T20:56:10.021 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:10.025+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:10.023 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2020-11-16T20:56:10.024 INFO:tasks.rados.rados.0.smithi166.stdout:585: expect (ObjNum 15 snap 0 seq_num 15) 2020-11-16T20:56:10.106 INFO:tasks.rados.rados.0.smithi166.stdout:584: finishing rollback tid 1 to smithi16641208-69 2020-11-16T20:56:10.106 INFO:tasks.rados.rados.0.smithi166.stdout:584: finishing rollback tid 2 to smithi16641208-69 2020-11-16T20:56:10.107 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 69 v 441 (ObjNum 68 snap 0 seq_num 68) dirty exists 2020-11-16T20:56:10.107 INFO:tasks.rados.rados.0.smithi166.stdout:583: got (0) Success 2020-11-16T20:56:10.107 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 471 v 0 (ObjNum 470 snap 0 seq_num 470) dirty exists 2020-11-16T20:56:10.122 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:10.127+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:10.143 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:10.143 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:10.143 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:56:10.144 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:56:10.144 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:10.153 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:56:10.237 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:10.242+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:10.324 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:10.329+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:10.328 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:10.329 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:56:10.329 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:56:10.329 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:56:10.329 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.329 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1100 4.0 4:1e86053b:::smithi16641208-244:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:56:10.329 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.904112+0000", 2020-11-16T20:56:10.330 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 15.427800574000001, 2020-11-16T20:56:10.330 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021275207000000001, 2020-11-16T20:56:10.330 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:10.330 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:10.330 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:10.330 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:10.331 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:10.331 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1100 2020-11-16T20:56:10.331 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.331 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:10.331 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.331 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:10.331 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904112+0000", 2020-11-16T20:56:10.331 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:10.332 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.332 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.332 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:10.332 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904112+0000", 2020-11-16T20:56:10.332 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2320999999999998e-05 2020-11-16T20:56:10.332 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.332 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.333 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:10.333 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904144+0000", 2020-11-16T20:56:10.333 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8300000000000001e-06 2020-11-16T20:56:10.333 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.333 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.333 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:10.333 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904150+0000", 2020-11-16T20:56:10.334 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2289999999999999e-05 2020-11-16T20:56:10.334 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.334 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.334 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:10.334 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904162+0000", 2020-11-16T20:56:10.334 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1189999999999999e-06 2020-11-16T20:56:10.334 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:10.335 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904166+0000", 2020-11-16T20:56:10.335 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00041665099999999998 2020-11-16T20:56:10.335 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.335 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904583+0000", 2020-11-16T20:56:10.336 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4852999999999999e-05 2020-11-16T20:56:10.336 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.336 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.336 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:10.336 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904628+0000", 2020-11-16T20:56:10.336 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012226348999999999 2020-11-16T20:56:10.336 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.337 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.337 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.337 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.916854+0000", 2020-11-16T20:56:10.337 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000130242 2020-11-16T20:56:10.337 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.337 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.337 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:10.337 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.916984+0000", 2020-11-16T20:56:10.338 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078369049999999999 2020-11-16T20:56:10.338 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.338 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.338 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.338 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.924821+0000", 2020-11-16T20:56:10.338 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9945999999999997e-05 2020-11-16T20:56:10.338 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.339 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.339 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:10.339 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.924901+0000", 2020-11-16T20:56:10.339 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000485701 2020-11-16T20:56:10.339 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.339 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.339 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:10.340 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.925387+0000", 2020-11-16T20:56:10.340 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021275207000000001 2020-11-16T20:56:10.340 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.340 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:10.340 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.340 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.340 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.340 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:201 3.2 3:515e6cf6:::smithi16641208-22:head [copy-from ver 21] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e35)", 2020-11-16T20:56:10.341 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.969037+0000", 2020-11-16T20:56:10.341 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 15.362875025999999, 2020-11-16T20:56:10.341 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021703407000000001, 2020-11-16T20:56:10.341 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:10.341 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:10.341 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:10.341 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.342 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:10.342 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969037+0000", 2020-11-16T20:56:10.342 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:10.342 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.342 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.342 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:10.342 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969037+0000", 2020-11-16T20:56:10.343 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1260000000000006e-05 2020-11-16T20:56:10.343 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.343 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.343 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:10.343 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969099+0000", 2020-11-16T20:56:10.343 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8179999999999993e-06 2020-11-16T20:56:10.343 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.343 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.344 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:10.344 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969107+0000", 2020-11-16T20:56:10.344 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.428e-05 2020-11-16T20:56:10.344 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.344 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.344 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:10.344 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969122+0000", 2020-11-16T20:56:10.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9359999999999999e-06 2020-11-16T20:56:10.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.345 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.345 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:10.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969130+0000", 2020-11-16T20:56:10.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000117713 2020-11-16T20:56:10.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.346 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.346 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.346 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969247+0000", 2020-11-16T20:56:10.346 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014414199999999999 2020-11-16T20:56:10.346 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.346 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.346 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:10.346 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969391+0000", 2020-11-16T20:56:10.347 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.005648737 2020-11-16T20:56:10.347 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.347 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.347 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:10.347 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.975040+0000", 2020-11-16T20:56:10.347 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011700868999999999 2020-11-16T20:56:10.347 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.348 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.348 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:10.348 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.986741+0000", 2020-11-16T20:56:10.348 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00078654400000000002 2020-11-16T20:56:10.348 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.348 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.348 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.348 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987528+0000", 2020-11-16T20:56:10.349 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030922979999999998 2020-11-16T20:56:10.349 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.349 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.349 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.349 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.990620+0000", 2020-11-16T20:56:10.349 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9068999999999999e-05 2020-11-16T20:56:10.349 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.350 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:10.350 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.990689+0000", 2020-11-16T20:56:10.350 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1740999999999998e-05 2020-11-16T20:56:10.350 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.350 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:10.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.990741+0000", 2020-11-16T20:56:10.351 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021703407000000001 2020-11-16T20:56:10.351 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.351 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:10.351 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.351 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.351 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.351 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:202 3.2 3:5723fd94:::smithi16641208-211:head [copy-from ver 110] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e35)", 2020-11-16T20:56:10.352 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:56:10.352 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 15.36273181, 2020-11-16T20:56:10.352 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027790216999999999, 2020-11-16T20:56:10.352 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:10.352 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:10.352 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:10.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.353 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:10.353 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:56:10.353 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:10.353 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.353 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.353 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:10.353 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:56:10.354 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1907999999999998e-05 2020-11-16T20:56:10.354 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.354 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.354 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:10.354 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969232+0000", 2020-11-16T20:56:10.354 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5270000000000004e-06 2020-11-16T20:56:10.354 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.354 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.355 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:10.355 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969239+0000", 2020-11-16T20:56:10.355 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3062e-05 2020-11-16T20:56:10.355 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.355 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.355 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:10.355 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969252+0000", 2020-11-16T20:56:10.356 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8919999999999997e-06 2020-11-16T20:56:10.356 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.356 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.356 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:10.356 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969258+0000", 2020-11-16T20:56:10.356 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00040859799999999998 2020-11-16T20:56:10.356 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.357 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.357 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.357 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969666+0000", 2020-11-16T20:56:10.357 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0932000000000003e-05 2020-11-16T20:56:10.357 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.357 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.357 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:10.358 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969757+0000", 2020-11-16T20:56:10.358 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010999395 2020-11-16T20:56:10.358 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.358 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.358 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:10.358 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.980757+0000", 2020-11-16T20:56:10.358 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006260659 2020-11-16T20:56:10.358 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.359 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.359 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:10.359 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987017+0000", 2020-11-16T20:56:10.359 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0080836880000000003 2020-11-16T20:56:10.359 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.359 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.359 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.360 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995101+0000", 2020-11-16T20:56:10.360 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001796829 2020-11-16T20:56:10.360 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.360 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.360 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.360 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996898+0000", 2020-11-16T20:56:10.360 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2086000000000003e-05 2020-11-16T20:56:10.360 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.361 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.361 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:10.361 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996940+0000", 2020-11-16T20:56:10.361 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0641e-05 2020-11-16T20:56:10.361 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.361 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.361 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:10.362 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996971+0000", 2020-11-16T20:56:10.362 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027790216999999999 2020-11-16T20:56:10.362 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.362 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:10.362 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.362 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.362 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.362 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1121 3.2 3:7ef90409:::smithi16641208-250:head [write 584943~460297,stat] snapc 0=[] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e35)", 2020-11-16T20:56:10.363 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.979302+0000", 2020-11-16T20:56:10.363 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 15.352610244999999, 2020-11-16T20:56:10.363 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018294922000000002, 2020-11-16T20:56:10.363 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:10.363 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:10.363 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:10.363 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.364 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:10.364 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.979302+0000", 2020-11-16T20:56:10.364 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:10.364 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.364 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.364 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:10.364 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.979302+0000", 2020-11-16T20:56:10.364 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016355300000000001 2020-11-16T20:56:10.365 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.365 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.365 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:10.365 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.979466+0000", 2020-11-16T20:56:10.365 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9299999999999998e-06 2020-11-16T20:56:10.365 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.365 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.366 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:10.366 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.979476+0000", 2020-11-16T20:56:10.366 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7201999999999999e-05 2020-11-16T20:56:10.366 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.366 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.366 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:10.366 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.979493+0000", 2020-11-16T20:56:10.367 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8890000000000008e-06 2020-11-16T20:56:10.367 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.367 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.367 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:10.367 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.979502+0000", 2020-11-16T20:56:10.367 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0060374069999999998 2020-11-16T20:56:10.367 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.367 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.368 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.368 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.985539+0000", 2020-11-16T20:56:10.368 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000144306 2020-11-16T20:56:10.368 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.368 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.368 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:10.368 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.985683+0000", 2020-11-16T20:56:10.369 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015322099999999999 2020-11-16T20:56:10.369 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.369 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.369 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:10.369 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.985837+0000", 2020-11-16T20:56:10.369 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001516189 2020-11-16T20:56:10.369 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.369 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.370 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:10.370 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987353+0000", 2020-11-16T20:56:10.370 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010080207000000001 2020-11-16T20:56:10.370 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.370 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.370 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.370 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.997433+0000", 2020-11-16T20:56:10.371 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9851000000000001e-05 2020-11-16T20:56:10.371 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.371 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.371 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.371 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.997483+0000", 2020-11-16T20:56:10.371 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7873000000000001e-05 2020-11-16T20:56:10.371 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.371 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.372 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:10.372 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.997521+0000", 2020-11-16T20:56:10.372 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6293999999999998e-05 2020-11-16T20:56:10.372 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.372 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.372 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:10.372 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.997597+0000", 2020-11-16T20:56:10.373 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018294922000000002 2020-11-16T20:56:10.373 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.373 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:10.373 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.373 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.373 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.373 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1122 3.2 3:7ef90409:::smithi16641208-250:head [write 1587781~597162] snapc 0=[] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e35)", 2020-11-16T20:56:10.373 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.983325+0000", 2020-11-16T20:56:10.374 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 15.348586908, 2020-11-16T20:56:10.374 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019229049000000002, 2020-11-16T20:56:10.374 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:10.374 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:10.374 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:10.374 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.374 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:10.375 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983325+0000", 2020-11-16T20:56:10.375 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:10.375 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.375 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.375 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:10.375 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983325+0000", 2020-11-16T20:56:10.375 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015493500000000001 2020-11-16T20:56:10.375 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.376 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.376 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:10.376 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983480+0000", 2020-11-16T20:56:10.376 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4990000000000002e-06 2020-11-16T20:56:10.376 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.376 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.376 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:10.377 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983486+0000", 2020-11-16T20:56:10.377 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7037e-05 2020-11-16T20:56:10.377 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.377 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.377 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:10.377 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983503+0000", 2020-11-16T20:56:10.377 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6639999999999998e-06 2020-11-16T20:56:10.377 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.378 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.378 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:10.378 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983511+0000", 2020-11-16T20:56:10.378 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003260757 2020-11-16T20:56:10.378 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.378 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.378 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.379 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.986771+0000", 2020-11-16T20:56:10.379 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000136346 2020-11-16T20:56:10.379 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.379 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.379 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:10.379 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.986908+0000", 2020-11-16T20:56:10.379 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010723052 2020-11-16T20:56:10.379 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.380 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.380 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.380 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.997631+0000", 2020-11-16T20:56:10.380 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5947999999999998e-05 2020-11-16T20:56:10.380 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.380 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.380 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:10.381 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.997717+0000", 2020-11-16T20:56:10.381 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016206200000000001 2020-11-16T20:56:10.381 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.381 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.381 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:10.381 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.997879+0000", 2020-11-16T20:56:10.381 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003597205 2020-11-16T20:56:10.382 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.382 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.382 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.001476+0000", 2020-11-16T20:56:10.382 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1767000000000001e-05 2020-11-16T20:56:10.382 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.383 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.383 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.001528+0000", 2020-11-16T20:56:10.383 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00085415100000000004 2020-11-16T20:56:10.383 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.383 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.383 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:10.383 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002382+0000", 2020-11-16T20:56:10.383 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000102564 2020-11-16T20:56:10.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.384 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:10.384 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002484+0000", 2020-11-16T20:56:10.384 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0061999999999994e-05 2020-11-16T20:56:10.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.385 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:10.385 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002554+0000", 2020-11-16T20:56:10.385 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019229049000000002 2020-11-16T20:56:10.385 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.385 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:10.385 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.385 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.385 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.386 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1123 3.2 3:7ef90409:::smithi16641208-250:head [setxattr _header (57) in=7b,truncate 2184943] snapc 0=[] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e35)", 2020-11-16T20:56:10.386 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.983910+0000", 2020-11-16T20:56:10.386 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 15.348002163, 2020-11-16T20:56:10.386 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018919126000000001, 2020-11-16T20:56:10.386 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:10.386 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:10.386 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:10.387 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.387 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:10.387 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983910+0000", 2020-11-16T20:56:10.387 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:10.387 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.387 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.387 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:10.388 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983910+0000", 2020-11-16T20:56:10.388 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6406999999999998e-05 2020-11-16T20:56:10.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.388 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.388 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:10.388 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983957+0000", 2020-11-16T20:56:10.388 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0913999999999999e-05 2020-11-16T20:56:10.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.389 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:10.389 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983967+0000", 2020-11-16T20:56:10.389 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4635e-05 2020-11-16T20:56:10.389 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.389 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:10.390 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983982+0000", 2020-11-16T20:56:10.390 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8420000000000005e-06 2020-11-16T20:56:10.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.390 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.390 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:10.390 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983990+0000", 2020-11-16T20:56:10.390 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029550890000000002 2020-11-16T20:56:10.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.391 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.391 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.986945+0000", 2020-11-16T20:56:10.391 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5418000000000003e-05 2020-11-16T20:56:10.391 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.391 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:10.392 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987010+0000", 2020-11-16T20:56:10.392 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011737546 2020-11-16T20:56:10.392 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.392 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.392 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.392 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.998748+0000", 2020-11-16T20:56:10.392 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000104208 2020-11-16T20:56:10.392 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.393 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.393 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:10.393 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.998852+0000", 2020-11-16T20:56:10.393 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015971400000000001 2020-11-16T20:56:10.393 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.393 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.393 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:10.394 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.999012+0000", 2020-11-16T20:56:10.394 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0025627029999999999 2020-11-16T20:56:10.394 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.394 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.394 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.394 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.001575+0000", 2020-11-16T20:56:10.394 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0382000000000001e-05 2020-11-16T20:56:10.395 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.395 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.395 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.395 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.001615+0000", 2020-11-16T20:56:10.395 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001134216 2020-11-16T20:56:10.395 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.395 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.395 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:10.396 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002749+0000", 2020-11-16T20:56:10.396 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2852000000000002e-05 2020-11-16T20:56:10.396 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.396 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.396 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:10.396 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002792+0000", 2020-11-16T20:56:10.396 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7200000000000003e-05 2020-11-16T20:56:10.397 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.397 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.397 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:10.397 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002829+0000", 2020-11-16T20:56:10.397 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018919126000000001 2020-11-16T20:56:10.397 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.397 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:10.397 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.398 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.398 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.398 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:206 3.2 3:7ef90409:::smithi16641208-250:head [read 0~1] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+known_if_redirected e35)", 2020-11-16T20:56:10.398 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.984112+0000", 2020-11-16T20:56:10.398 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 15.347800646, 2020-11-16T20:56:10.398 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018870285000000001, 2020-11-16T20:56:10.398 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:10.399 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:10.399 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:10.399 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.399 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:10.399 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.984112+0000", 2020-11-16T20:56:10.399 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:10.399 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.399 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.400 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:10.400 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.984112+0000", 2020-11-16T20:56:10.400 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2836000000000002e-05 2020-11-16T20:56:10.400 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.400 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.400 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:10.400 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.984144+0000", 2020-11-16T20:56:10.401 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7229999999999998e-06 2020-11-16T20:56:10.401 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.401 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.401 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:10.401 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.984151+0000", 2020-11-16T20:56:10.401 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5872e-05 2020-11-16T20:56:10.401 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.401 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.402 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:10.402 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.984167+0000", 2020-11-16T20:56:10.402 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3956e-05 2020-11-16T20:56:10.402 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.402 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.402 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:10.402 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.984181+0000", 2020-11-16T20:56:10.403 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002868916 2020-11-16T20:56:10.403 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.403 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.403 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.403 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987050+0000", 2020-11-16T20:56:10.403 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000100128 2020-11-16T20:56:10.403 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.403 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.404 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:10.404 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987150+0000", 2020-11-16T20:56:10.404 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012240048 2020-11-16T20:56:10.404 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.404 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.404 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.404 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.999390+0000", 2020-11-16T20:56:10.405 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8245999999999997e-05 2020-11-16T20:56:10.405 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.405 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.405 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:10.405 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.999458+0000", 2020-11-16T20:56:10.405 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003399507 2020-11-16T20:56:10.405 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.406 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.406 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.406 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002858+0000", 2020-11-16T20:56:10.406 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4651000000000002e-05 2020-11-16T20:56:10.406 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.406 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.406 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:10.407 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002913+0000", 2020-11-16T20:56:10.407 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9401999999999997e-05 2020-11-16T20:56:10.407 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.407 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.407 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:10.407 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002982+0000", 2020-11-16T20:56:10.407 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018870285000000001 2020-11-16T20:56:10.407 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.408 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:10.408 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.411 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.411 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.411 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:208 3.2 3:762d577a:::smithi16641208-195:head [copy-from ver 102] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e35)", 2020-11-16T20:56:10.411 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.003022+0000", 2020-11-16T20:56:10.411 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 15.328890174, 2020-11-16T20:56:10.411 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017627352999999998, 2020-11-16T20:56:10.412 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:10.412 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:10.412 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:10.412 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.412 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:10.412 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003022+0000", 2020-11-16T20:56:10.413 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:10.413 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.413 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.413 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:10.413 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003022+0000", 2020-11-16T20:56:10.414 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3676e-05 2020-11-16T20:56:10.414 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.414 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.414 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:10.414 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003066+0000", 2020-11-16T20:56:10.414 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2129999999999999e-06 2020-11-16T20:56:10.414 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.415 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.415 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:10.415 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003071+0000", 2020-11-16T20:56:10.415 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2689999999999999e-06 2020-11-16T20:56:10.415 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.415 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.416 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:10.416 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003079+0000", 2020-11-16T20:56:10.416 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6480000000000002e-06 2020-11-16T20:56:10.416 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.416 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.416 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:10.416 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003084+0000", 2020-11-16T20:56:10.417 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9362000000000001e-05 2020-11-16T20:56:10.417 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.417 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.417 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.417 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003113+0000", 2020-11-16T20:56:10.417 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1527999999999999e-05 2020-11-16T20:56:10.417 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.418 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.418 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:10.418 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003165+0000", 2020-11-16T20:56:10.418 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042510660000000004 2020-11-16T20:56:10.418 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.418 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.418 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:10.419 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.007416+0000", 2020-11-16T20:56:10.419 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0043608070000000004 2020-11-16T20:56:10.419 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.419 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.419 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:10.419 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.011777+0000", 2020-11-16T20:56:10.419 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0086685419999999996 2020-11-16T20:56:10.420 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.420 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.420 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.420 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.020445+0000", 2020-11-16T20:56:10.420 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8176000000000004e-05 2020-11-16T20:56:10.420 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.420 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.421 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.421 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.020533+0000", 2020-11-16T20:56:10.421 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9265999999999997e-05 2020-11-16T20:56:10.421 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.421 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.421 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:10.421 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.020603+0000", 2020-11-16T20:56:10.422 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6799999999999999e-05 2020-11-16T20:56:10.422 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.422 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.422 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:10.422 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.020649+0000", 2020-11-16T20:56:10.422 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017627352999999998 2020-11-16T20:56:10.422 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.423 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:10.423 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.423 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.423 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.423 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1148 4.0 4:0285a053:::smithi16641208-256:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:56:10.423 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.060859+0000", 2020-11-16T20:56:10.424 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 15.271052815999999, 2020-11-16T20:56:10.424 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018754663000000001, 2020-11-16T20:56:10.424 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:10.424 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:10.424 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:10.424 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:10.424 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:10.425 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1148 2020-11-16T20:56:10.425 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.425 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:10.425 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.425 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:10.425 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.060859+0000", 2020-11-16T20:56:10.425 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:10.426 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.426 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.426 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:10.426 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.060859+0000", 2020-11-16T20:56:10.426 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9090000000000001e-05 2020-11-16T20:56:10.426 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.426 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.427 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:10.427 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.060889+0000", 2020-11-16T20:56:10.427 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2449999999999998e-06 2020-11-16T20:56:10.427 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.427 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.427 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:10.427 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.060894+0000", 2020-11-16T20:56:10.428 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0559e-05 2020-11-16T20:56:10.428 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.428 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.428 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:10.428 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.060904+0000", 2020-11-16T20:56:10.428 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4089999999999996e-06 2020-11-16T20:56:10.428 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.429 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.429 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:10.429 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.060909+0000", 2020-11-16T20:56:10.429 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00040223899999999998 2020-11-16T20:56:10.429 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.429 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.429 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.430 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.061311+0000", 2020-11-16T20:56:10.430 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4712000000000001e-05 2020-11-16T20:56:10.430 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.430 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.430 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:10.430 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.061366+0000", 2020-11-16T20:56:10.430 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012445941 2020-11-16T20:56:10.431 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.431 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.431 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.431 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.073812+0000", 2020-11-16T20:56:10.431 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015803799999999999 2020-11-16T20:56:10.431 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.431 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.432 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:10.432 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.073970+0000", 2020-11-16T20:56:10.432 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0048616500000000003 2020-11-16T20:56:10.432 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.432 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.432 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.432 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.078831+0000", 2020-11-16T20:56:10.433 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1623000000000002e-05 2020-11-16T20:56:10.433 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.433 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.433 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:10.433 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.078903+0000", 2020-11-16T20:56:10.433 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00071115700000000002 2020-11-16T20:56:10.433 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.434 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.434 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:10.434 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.079614+0000", 2020-11-16T20:56:10.434 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018754663000000001 2020-11-16T20:56:10.434 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.434 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:10.434 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.435 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.435 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.435 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1432 4.0 4:3dccbd44:::smithi16641208-321:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e36)", 2020-11-16T20:56:10.435 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.063349+0000", 2020-11-16T20:56:10.435 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 14.268562859999999, 2020-11-16T20:56:10.435 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020415261000000001, 2020-11-16T20:56:10.435 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:10.436 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:10.436 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:10.436 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:10.436 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:10.436 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1432 2020-11-16T20:56:10.436 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.436 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:10.437 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.437 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:10.437 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.063349+0000", 2020-11-16T20:56:10.437 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:10.437 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.437 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.437 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:10.438 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.063349+0000", 2020-11-16T20:56:10.438 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5721000000000001e-05 2020-11-16T20:56:10.438 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.438 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.438 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:10.438 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.063365+0000", 2020-11-16T20:56:10.438 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8200000000000001e-06 2020-11-16T20:56:10.439 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.439 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.439 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:10.439 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.063368+0000", 2020-11-16T20:56:10.439 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8499999999999999e-06 2020-11-16T20:56:10.439 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.440 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.440 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:10.440 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.063374+0000", 2020-11-16T20:56:10.440 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3489999999999999e-06 2020-11-16T20:56:10.440 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.440 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.440 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:10.441 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.063376+0000", 2020-11-16T20:56:10.441 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045649699999999999 2020-11-16T20:56:10.441 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.441 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.441 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.441 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.063833+0000", 2020-11-16T20:56:10.441 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6248000000000001e-05 2020-11-16T20:56:10.442 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.442 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.442 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:10.442 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.063889+0000", 2020-11-16T20:56:10.442 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012858675999999999 2020-11-16T20:56:10.442 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.442 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.443 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.443 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.076748+0000", 2020-11-16T20:56:10.443 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012343099999999999 2020-11-16T20:56:10.443 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.443 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.443 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:10.443 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.076871+0000", 2020-11-16T20:56:10.444 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0065606579999999996 2020-11-16T20:56:10.444 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.444 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.444 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.444 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.083432+0000", 2020-11-16T20:56:10.444 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9738000000000003e-05 2020-11-16T20:56:10.444 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.445 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.445 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:10.445 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.083491+0000", 2020-11-16T20:56:10.445 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00027327299999999998 2020-11-16T20:56:10.445 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.445 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.445 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:10.446 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.083765+0000", 2020-11-16T20:56:10.446 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020415261000000001 2020-11-16T20:56:10.446 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.446 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:10.446 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.446 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.446 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.447 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1437 4.0 4:3729c5f0:::smithi16641208-322:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e36)", 2020-11-16T20:56:10.447 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.082908+0000", 2020-11-16T20:56:10.447 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 14.249004210000001, 2020-11-16T20:56:10.447 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01873671, 2020-11-16T20:56:10.447 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:10.447 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:10.447 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:10.448 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:10.448 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:10.448 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1437 2020-11-16T20:56:10.448 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.448 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:10.448 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.448 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:10.449 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.082908+0000", 2020-11-16T20:56:10.449 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:10.449 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.449 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.449 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:10.449 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.082908+0000", 2020-11-16T20:56:10.449 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5228999999999999e-05 2020-11-16T20:56:10.450 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.450 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.450 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:10.450 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.082923+0000", 2020-11-16T20:56:10.450 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9790000000000002e-06 2020-11-16T20:56:10.450 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.450 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.451 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:10.451 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.082926+0000", 2020-11-16T20:56:10.451 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9599999999999997e-06 2020-11-16T20:56:10.451 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.451 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.451 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:10.451 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.082932+0000", 2020-11-16T20:56:10.452 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5890000000000001e-06 2020-11-16T20:56:10.452 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.452 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.452 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:10.452 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.082935+0000", 2020-11-16T20:56:10.452 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000366616 2020-11-16T20:56:10.452 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.453 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.453 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.453 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.083301+0000", 2020-11-16T20:56:10.453 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0166999999999997e-05 2020-11-16T20:56:10.453 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.453 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.453 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:10.454 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.083342+0000", 2020-11-16T20:56:10.454 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.009997878 2020-11-16T20:56:10.454 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.454 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.454 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.454 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.093340+0000", 2020-11-16T20:56:10.454 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000144334 2020-11-16T20:56:10.455 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.455 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.455 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:10.455 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.093484+0000", 2020-11-16T20:56:10.455 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078439579999999998 2020-11-16T20:56:10.455 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.455 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.456 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.456 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.101328+0000", 2020-11-16T20:56:10.456 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7257999999999999e-05 2020-11-16T20:56:10.456 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.456 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.456 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:10.456 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.101395+0000", 2020-11-16T20:56:10.457 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024974200000000001 2020-11-16T20:56:10.457 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.457 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.457 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:10.457 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.101645+0000", 2020-11-16T20:56:10.457 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01873671 2020-11-16T20:56:10.457 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.458 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:10.458 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.458 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.458 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.458 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:547 3.2 3:5f250a2b:::smithi16641208-75:head [copy-from ver 38] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:10.458 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:56:10.458 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.3143445070000004, 2020-11-16T20:56:10.459 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027400430999999999, 2020-11-16T20:56:10.459 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:10.459 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:10.459 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:10.459 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.459 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:10.459 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:56:10.460 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:10.460 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.460 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.460 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:10.460 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:56:10.460 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5093999999999999e-05 2020-11-16T20:56:10.460 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.461 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.461 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:10.461 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017613+0000", 2020-11-16T20:56:10.461 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6150000000000003e-06 2020-11-16T20:56:10.461 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.461 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.461 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:10.462 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017623+0000", 2020-11-16T20:56:10.462 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6934000000000001e-05 2020-11-16T20:56:10.462 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.462 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.462 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:10.462 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017639+0000", 2020-11-16T20:56:10.462 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1892000000000001e-05 2020-11-16T20:56:10.463 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.463 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.463 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:10.463 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017651+0000", 2020-11-16T20:56:10.463 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2955999999999998e-05 2020-11-16T20:56:10.463 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.463 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.464 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.464 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017714+0000", 2020-11-16T20:56:10.464 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019352400000000001 2020-11-16T20:56:10.464 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.464 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.464 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:10.464 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017908+0000", 2020-11-16T20:56:10.465 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0073901349999999999 2020-11-16T20:56:10.465 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.465 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.465 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:10.465 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025298+0000", 2020-11-16T20:56:10.465 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0082133799999999993 2020-11-16T20:56:10.465 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.466 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.466 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:10.466 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033511+0000", 2020-11-16T20:56:10.466 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0074347629999999996 2020-11-16T20:56:10.466 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.466 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.466 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.467 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.040946+0000", 2020-11-16T20:56:10.467 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039404669999999996 2020-11-16T20:56:10.467 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.467 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.467 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.467 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044887+0000", 2020-11-16T20:56:10.467 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7098000000000002e-05 2020-11-16T20:56:10.468 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.468 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.468 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:10.468 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044934+0000", 2020-11-16T20:56:10.468 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4573000000000003e-05 2020-11-16T20:56:10.468 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.468 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.469 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:10.469 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044968+0000", 2020-11-16T20:56:10.469 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027400430999999999 2020-11-16T20:56:10.469 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.469 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:10.469 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.469 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.470 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.470 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:548 3.2 3:6173e90a:::smithi16641208-2:head [copy-from ver 3] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:10.470 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:56:10.470 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.3142131739999998, 2020-11-16T20:56:10.470 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029556911000000002, 2020-11-16T20:56:10.470 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:10.470 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:10.471 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:10.471 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.471 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:10.471 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:56:10.471 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:10.471 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.471 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.472 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:10.472 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:56:10.472 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2478000000000002e-05 2020-11-16T20:56:10.472 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.472 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.472 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:10.472 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017742+0000", 2020-11-16T20:56:10.473 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3060000000000003e-06 2020-11-16T20:56:10.473 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.473 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.473 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:10.473 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017748+0000", 2020-11-16T20:56:10.473 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1102e-05 2020-11-16T20:56:10.473 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.474 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.474 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:10.474 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017759+0000", 2020-11-16T20:56:10.474 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.118e-06 2020-11-16T20:56:10.474 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.474 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.475 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:10.475 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017764+0000", 2020-11-16T20:56:10.475 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032233700000000001 2020-11-16T20:56:10.475 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.475 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.475 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.475 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.018086+0000", 2020-11-16T20:56:10.476 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000128374 2020-11-16T20:56:10.476 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.476 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.476 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:10.476 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.018215+0000", 2020-11-16T20:56:10.476 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012971355 2020-11-16T20:56:10.476 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.477 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.477 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:10.477 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.031186+0000", 2020-11-16T20:56:10.477 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044142890000000001 2020-11-16T20:56:10.477 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.477 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.477 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:10.477 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.035600+0000", 2020-11-16T20:56:10.478 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092372719999999995 2020-11-16T20:56:10.478 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.478 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.478 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.478 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044838+0000", 2020-11-16T20:56:10.478 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0023022049999999999 2020-11-16T20:56:10.479 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.479 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.479 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.479 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047140+0000", 2020-11-16T20:56:10.479 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0380999999999997e-05 2020-11-16T20:56:10.479 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.479 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.479 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:10.480 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047200+0000", 2020-11-16T20:56:10.480 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5693999999999999e-05 2020-11-16T20:56:10.480 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.480 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.480 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:10.480 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047256+0000", 2020-11-16T20:56:10.481 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029556911000000002 2020-11-16T20:56:10.481 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.481 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:10.481 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.481 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.481 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.481 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:551 3.2 3:646fee8a:::smithi16641208-407:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e42)", 2020-11-16T20:56:10.482 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.033053+0000", 2020-11-16T20:56:10.482 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.2988597369999999, 2020-11-16T20:56:10.482 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018118614000000002, 2020-11-16T20:56:10.482 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:10.482 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:10.482 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:10.482 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.483 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:10.483 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033053+0000", 2020-11-16T20:56:10.483 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:10.483 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.483 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.483 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:10.483 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033053+0000", 2020-11-16T20:56:10.484 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0894e-05 2020-11-16T20:56:10.484 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.484 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.484 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:10.484 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033073+0000", 2020-11-16T20:56:10.484 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.903e-06 2020-11-16T20:56:10.484 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.485 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.485 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:10.485 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033076+0000", 2020-11-16T20:56:10.485 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.417e-06 2020-11-16T20:56:10.485 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.485 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.485 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:10.486 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033082+0000", 2020-11-16T20:56:10.486 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4449999999999999e-06 2020-11-16T20:56:10.486 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.486 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.486 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:10.486 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033084+0000", 2020-11-16T20:56:10.486 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0025466 2020-11-16T20:56:10.487 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.487 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.487 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.487 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.035631+0000", 2020-11-16T20:56:10.487 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6619000000000006e-05 2020-11-16T20:56:10.487 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.487 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.488 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:10.488 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.035707+0000", 2020-11-16T20:56:10.488 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012470798 2020-11-16T20:56:10.488 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.488 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.488 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.488 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.048178+0000", 2020-11-16T20:56:10.489 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3502000000000001e-05 2020-11-16T20:56:10.489 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.489 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.489 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:10.489 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.048262+0000", 2020-11-16T20:56:10.489 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029094360000000001 2020-11-16T20:56:10.489 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.490 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.490 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:10.490 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.051171+0000", 2020-11-16T20:56:10.490 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018118614000000002 2020-11-16T20:56:10.490 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.490 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:10.490 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.491 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.491 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.491 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:554 3.2 3:769099fd:::smithi16641208-247:head [copy-from ver 123] snapc 1=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:10.491 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:56:10.491 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.2818098559999997, 2020-11-16T20:56:10.491 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998, 2020-11-16T20:56:10.491 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:10.492 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:10.492 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:10.492 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.492 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:10.492 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:56:10.492 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:10.492 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.493 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.493 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:10.493 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:56:10.493 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6705999999999997e-05 2020-11-16T20:56:10.493 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.493 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.493 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:10.494 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050139+0000", 2020-11-16T20:56:10.494 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6199999999999998e-06 2020-11-16T20:56:10.494 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.494 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.494 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:10.494 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050144+0000", 2020-11-16T20:56:10.494 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.944e-06 2020-11-16T20:56:10.495 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.495 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.495 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:10.495 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050154+0000", 2020-11-16T20:56:10.495 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4043999999999999e-05 2020-11-16T20:56:10.495 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.495 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.496 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:10.496 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050178+0000", 2020-11-16T20:56:10.496 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078971409999999999 2020-11-16T20:56:10.496 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.496 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.496 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.496 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058075+0000", 2020-11-16T20:56:10.497 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012776500000000001 2020-11-16T20:56:10.497 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.497 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.497 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:10.497 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058203+0000", 2020-11-16T20:56:10.497 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011807013 2020-11-16T20:56:10.497 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.498 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.498 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:10.498 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070010+0000", 2020-11-16T20:56:10.498 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029522160000000001 2020-11-16T20:56:10.498 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.498 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.498 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:10.499 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.072962+0000", 2020-11-16T20:56:10.499 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017845006 2020-11-16T20:56:10.499 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.499 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.499 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.499 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.090807+0000", 2020-11-16T20:56:10.499 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.009301808 2020-11-16T20:56:10.500 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.500 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.500 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.500 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100109+0000", 2020-11-16T20:56:10.500 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7076999999999995e-05 2020-11-16T20:56:10.500 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.500 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.501 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:10.501 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100176+0000", 2020-11-16T20:56:10.501 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9790999999999999e-05 2020-11-16T20:56:10.501 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.501 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.501 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:10.501 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100216+0000", 2020-11-16T20:56:10.502 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998 2020-11-16T20:56:10.502 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.502 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:10.502 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.502 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.502 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.502 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:555 3.2 3:590e6edd:::smithi16641208-203:head [delete] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:10.503 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.076366+0000", 2020-11-16T20:56:10.503 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.2555459989999997, 2020-11-16T20:56:10.503 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024009968, 2020-11-16T20:56:10.503 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:10.503 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:10.503 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:10.503 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.504 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:10.504 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076366+0000", 2020-11-16T20:56:10.504 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:10.504 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.504 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.504 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:10.504 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076366+0000", 2020-11-16T20:56:10.505 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2963999999999998e-05 2020-11-16T20:56:10.505 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.505 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.505 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:10.505 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076399+0000", 2020-11-16T20:56:10.505 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6879999999999999e-06 2020-11-16T20:56:10.505 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.506 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.506 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:10.506 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076407+0000", 2020-11-16T20:56:10.506 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4088999999999999e-05 2020-11-16T20:56:10.506 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.506 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.506 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:10.507 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076431+0000", 2020-11-16T20:56:10.507 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.4280000000000002e-06 2020-11-16T20:56:10.507 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.507 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.507 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:10.507 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076440+0000", 2020-11-16T20:56:10.507 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3467999999999998e-05 2020-11-16T20:56:10.508 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.508 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.508 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.508 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076484+0000", 2020-11-16T20:56:10.508 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011613 2020-11-16T20:56:10.508 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.508 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.509 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:10.509 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076600+0000", 2020-11-16T20:56:10.509 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8172999999999998e-05 2020-11-16T20:56:10.509 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.509 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.509 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:10.509 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076678+0000", 2020-11-16T20:56:10.510 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0009822749999999999 2020-11-16T20:56:10.510 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.510 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.510 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:10.510 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.077661+0000", 2020-11-16T20:56:10.510 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018605739999999999 2020-11-16T20:56:10.510 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.511 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.511 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.511 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.096266+0000", 2020-11-16T20:56:10.511 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039876709999999999 2020-11-16T20:56:10.511 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.511 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.511 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.512 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100254+0000", 2020-11-16T20:56:10.512 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4382999999999996e-05 2020-11-16T20:56:10.512 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.512 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.512 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:10.512 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100328+0000", 2020-11-16T20:56:10.512 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7958999999999999e-05 2020-11-16T20:56:10.513 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.513 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.513 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:10.513 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100376+0000", 2020-11-16T20:56:10.513 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024009968 2020-11-16T20:56:10.513 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.513 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:10.514 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.514 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.514 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.514 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:556 3.2 3:590e6edd:::smithi16641208-203:head [copy-from ver 105] snapc 1=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:10.514 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.076482+0000", 2020-11-16T20:56:10.514 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.2554305489999997, 2020-11-16T20:56:10.514 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025150006999999999, 2020-11-16T20:56:10.515 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:10.515 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:10.515 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:10.515 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.515 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:10.515 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076482+0000", 2020-11-16T20:56:10.515 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:10.516 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.516 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.516 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:10.516 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076482+0000", 2020-11-16T20:56:10.516 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0086000000000006e-05 2020-11-16T20:56:10.516 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.516 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.517 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:10.517 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076552+0000", 2020-11-16T20:56:10.517 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7299999999999999e-06 2020-11-16T20:56:10.517 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.517 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.517 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:10.517 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076559+0000", 2020-11-16T20:56:10.518 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5905000000000001e-05 2020-11-16T20:56:10.518 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.518 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.518 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:10.518 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076574+0000", 2020-11-16T20:56:10.518 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9369999999999993e-06 2020-11-16T20:56:10.518 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.519 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.519 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:10.519 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076583+0000", 2020-11-16T20:56:10.519 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00064848599999999998 2020-11-16T20:56:10.519 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.519 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.519 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.520 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.077232+0000", 2020-11-16T20:56:10.520 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8629999999999999e-05 2020-11-16T20:56:10.520 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.520 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.520 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:10.520 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.077291+0000", 2020-11-16T20:56:10.520 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003820773 2020-11-16T20:56:10.521 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.521 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.521 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:10.521 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.081111+0000", 2020-11-16T20:56:10.521 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033171849999999998 2020-11-16T20:56:10.521 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.521 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.522 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:10.522 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.084428+0000", 2020-11-16T20:56:10.522 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016400174 2020-11-16T20:56:10.522 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.522 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.522 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.523 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100829+0000", 2020-11-16T20:56:10.523 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00071628499999999999 2020-11-16T20:56:10.523 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.523 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.523 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.523 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.101545+0000", 2020-11-16T20:56:10.523 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7249e-05 2020-11-16T20:56:10.524 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.524 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.524 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:10.524 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.101602+0000", 2020-11-16T20:56:10.524 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9567e-05 2020-11-16T20:56:10.524 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.524 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.524 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:10.525 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.101632+0000", 2020-11-16T20:56:10.525 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025150006999999999 2020-11-16T20:56:10.525 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.525 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:10.525 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.525 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.525 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.526 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:564 3.2 3:724a4144:::smithi16641208-153:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e46)", 2020-11-16T20:56:10.526 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.018269+0000", 2020-11-16T20:56:10.526 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 1.3136432250000001, 2020-11-16T20:56:10.526 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016004377, 2020-11-16T20:56:10.526 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:10.526 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:10.527 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:10.527 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.527 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:10.527 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.018269+0000", 2020-11-16T20:56:10.527 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:10.527 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.527 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.528 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:10.528 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.018269+0000", 2020-11-16T20:56:10.528 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8299e-05 2020-11-16T20:56:10.528 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.528 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.528 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:10.528 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.018317+0000", 2020-11-16T20:56:10.529 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8900000000000004e-06 2020-11-16T20:56:10.529 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.529 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.529 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:10.529 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.018323+0000", 2020-11-16T20:56:10.529 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1661000000000001e-05 2020-11-16T20:56:10.529 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.529 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.530 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:10.530 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.018335+0000", 2020-11-16T20:56:10.530 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5480000000000001e-06 2020-11-16T20:56:10.530 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.530 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.530 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:10.531 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.018340+0000", 2020-11-16T20:56:10.531 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021199600000000002 2020-11-16T20:56:10.531 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.531 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.531 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.531 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.020460+0000", 2020-11-16T20:56:10.531 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7681000000000004e-05 2020-11-16T20:56:10.532 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.532 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.532 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:10.532 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.020538+0000", 2020-11-16T20:56:10.532 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011467484 2020-11-16T20:56:10.532 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.532 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.532 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.533 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.032006+0000", 2020-11-16T20:56:10.533 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011483 2020-11-16T20:56:10.533 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.533 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.533 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:10.533 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.032120+0000", 2020-11-16T20:56:10.533 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021530239999999999 2020-11-16T20:56:10.534 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.534 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.534 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:10.534 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.034273+0000", 2020-11-16T20:56:10.534 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016004377 2020-11-16T20:56:10.534 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.535 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:10.535 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.535 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.535 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.535 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2429 4.0 4:3b92f709:::smithi16641208-69:head [rollback 7] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:56:10.535 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:56:10.535 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.315891594, 2020-11-16T20:56:10.535 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003, 2020-11-16T20:56:10.536 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:10.536 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:10.536 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:10.536 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:10.536 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:10.536 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2429 2020-11-16T20:56:10.536 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.537 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:10.537 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.537 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:10.537 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:56:10.537 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:10.537 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.537 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.538 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:10.538 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:56:10.538 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3710000000000002e-05 2020-11-16T20:56:10.538 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.538 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.538 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:10.538 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016044+0000", 2020-11-16T20:56:10.539 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7090000000000001e-06 2020-11-16T20:56:10.539 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.539 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.539 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:10.539 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016049+0000", 2020-11-16T20:56:10.539 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8820000000000003e-06 2020-11-16T20:56:10.539 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.540 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.540 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:10.540 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016056+0000", 2020-11-16T20:56:10.540 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.27e-06 2020-11-16T20:56:10.540 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.540 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.540 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:10.541 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016059+0000", 2020-11-16T20:56:10.541 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.537e-05 2020-11-16T20:56:10.541 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.541 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.541 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.541 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016115+0000", 2020-11-16T20:56:10.541 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8690000000000003e-06 2020-11-16T20:56:10.542 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.542 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.542 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:10.542 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016120+0000", 2020-11-16T20:56:10.542 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021405730000000002 2020-11-16T20:56:10.542 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.543 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.543 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.543 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018260+0000", 2020-11-16T20:56:10.543 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0137999999999999e-05 2020-11-16T20:56:10.543 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.543 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.543 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:10.544 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018320+0000", 2020-11-16T20:56:10.544 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011799352000000001 2020-11-16T20:56:10.544 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.544 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.544 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.544 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030120+0000", 2020-11-16T20:56:10.544 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000163139 2020-11-16T20:56:10.545 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.545 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.545 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:10.545 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030283+0000", 2020-11-16T20:56:10.545 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029657000000000002 2020-11-16T20:56:10.545 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.545 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.546 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:10.546 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030579+0000", 2020-11-16T20:56:10.546 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3058000000000001e-05 2020-11-16T20:56:10.546 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.546 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.546 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:10.546 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030612+0000", 2020-11-16T20:56:10.547 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0075168259999999999 2020-11-16T20:56:10.547 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.547 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.547 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.547 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038129+0000", 2020-11-16T20:56:10.547 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012914299999999999 2020-11-16T20:56:10.547 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.548 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.548 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:10.548 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038258+0000", 2020-11-16T20:56:10.548 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034292799999999999 2020-11-16T20:56:10.548 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.548 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.548 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:56:10.549 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038601+0000", 2020-11-16T20:56:10.549 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0025181159999999999 2020-11-16T20:56:10.549 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.549 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.549 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.549 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041119+0000", 2020-11-16T20:56:10.549 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2331999999999997e-05 2020-11-16T20:56:10.550 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.550 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.550 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for ondisk", 2020-11-16T20:56:10.550 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041202+0000", 2020-11-16T20:56:10.550 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028481750000000001 2020-11-16T20:56:10.550 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.550 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.551 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:10.551 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044050+0000", 2020-11-16T20:56:10.551 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001269921 2020-11-16T20:56:10.551 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.551 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.551 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.551 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045320+0000", 2020-11-16T20:56:10.552 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054215490000000003 2020-11-16T20:56:10.552 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.552 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.552 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.552 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050741+0000", 2020-11-16T20:56:10.552 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6981000000000001e-05 2020-11-16T20:56:10.552 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.553 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.553 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:10.553 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050808+0000", 2020-11-16T20:56:10.553 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8841e-05 2020-11-16T20:56:10.553 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.553 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.553 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:10.554 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050877+0000", 2020-11-16T20:56:10.554 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003 2020-11-16T20:56:10.554 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.554 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:10.554 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.554 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.555 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.555 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2430 4.0 4:3b92f709:::smithi16641208-69:head [append 0~0] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:56:10.555 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:56:10.555 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.31583527099999997, 2020-11-16T20:56:10.555 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001, 2020-11-16T20:56:10.555 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:10.555 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:10.556 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:10.556 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:10.556 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:10.556 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2430 2020-11-16T20:56:10.556 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.556 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:10.556 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.556 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:10.557 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:56:10.557 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:10.557 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.557 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.557 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:10.557 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:56:10.558 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0857e-05 2020-11-16T20:56:10.558 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.558 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.558 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:10.558 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016098+0000", 2020-11-16T20:56:10.558 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9179999999999999e-06 2020-11-16T20:56:10.558 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.559 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.559 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:10.559 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016104+0000", 2020-11-16T20:56:10.559 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8230000000000006e-06 2020-11-16T20:56:10.559 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.559 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.559 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:10.560 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016114+0000", 2020-11-16T20:56:10.560 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2180000000000001e-06 2020-11-16T20:56:10.560 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.560 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.560 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:10.560 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016118+0000", 2020-11-16T20:56:10.560 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3547999999999995e-05 2020-11-16T20:56:10.560 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.561 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.561 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.561 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016181+0000", 2020-11-16T20:56:10.561 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8730000000000007e-06 2020-11-16T20:56:10.561 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.561 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.561 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:10.562 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016189+0000", 2020-11-16T20:56:10.562 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021577200000000001 2020-11-16T20:56:10.562 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.562 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.562 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.562 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018347+0000", 2020-11-16T20:56:10.563 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6832000000000001e-05 2020-11-16T20:56:10.563 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.563 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.563 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:10.563 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018404+0000", 2020-11-16T20:56:10.563 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012272913999999999 2020-11-16T20:56:10.563 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.564 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.564 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.564 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030677+0000", 2020-11-16T20:56:10.564 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2555000000000002e-05 2020-11-16T20:56:10.564 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.564 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.564 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:10.564 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030719+0000", 2020-11-16T20:56:10.565 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010518684 2020-11-16T20:56:10.565 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.565 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.565 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:10.565 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041238+0000", 2020-11-16T20:56:10.565 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000144723 2020-11-16T20:56:10.565 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.566 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.566 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:10.566 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041383+0000", 2020-11-16T20:56:10.566 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000214575 2020-11-16T20:56:10.566 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.566 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.567 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:56:10.567 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041597+0000", 2020-11-16T20:56:10.567 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002463196 2020-11-16T20:56:10.567 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.567 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.567 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:10.567 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044060+0000", 2020-11-16T20:56:10.568 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001654066 2020-11-16T20:56:10.568 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.568 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.568 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.568 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045715+0000", 2020-11-16T20:56:10.568 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053780599999999996 2020-11-16T20:56:10.568 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.568 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.569 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:10.569 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051093+0000", 2020-11-16T20:56:10.569 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8189999999999996e-05 2020-11-16T20:56:10.569 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.569 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.569 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:10.569 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051161+0000", 2020-11-16T20:56:10.570 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4910000000000001e-05 2020-11-16T20:56:10.570 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:10.570 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:10.570 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:10.570 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051216+0000", 2020-11-16T20:56:10.570 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001 2020-11-16T20:56:10.570 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.571 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:10.571 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.571 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:10.571 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:10.571 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:10.572 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:10.577+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:10.573 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:56:10.673 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:10.678+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:10.677 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:56:10.721 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:10.721 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:10.721 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:56:10.721 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:10.730 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:56:10.773 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:10.778+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:10.819 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:56:10.839 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:56:10.858 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:56:10.866 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:10.867 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:10.867 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:56:10.867 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:56:10.867 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:10.874 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:10.879+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:10.876 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:56:10.876 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:56:10.896 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:56:10.915 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:56:10.935 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:56:10.954 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:56:10.955 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:56:10.955 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:56:10.956 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:56:10.956 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:56:10.956 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:56:10.956 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:56:10.956 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:56:10.956 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:56:10.976 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:10.980+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:11.009 INFO:tasks.rados.rados.0.smithi166.stdout:583: done (4 left) 2020-11-16T20:56:11.009 INFO:tasks.rados.rados.0.smithi166.stdout:584: done (3 left) 2020-11-16T20:56:11.009 INFO:tasks.rados.rados.0.smithi166.stdout:585: done (2 left) 2020-11-16T20:56:11.009 INFO:tasks.rados.rados.0.smithi166.stdout:586: done (1 left) 2020-11-16T20:56:11.010 INFO:tasks.rados.rados.0.smithi166.stdout:587: done (0 left) 2020-11-16T20:56:11.010 INFO:tasks.rados.rados.0.smithi166.stdout:588: rollback oid 364 current snap is 8 2020-11-16T20:56:11.010 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 364 to 6 2020-11-16T20:56:11.010 INFO:tasks.rados.rados.0.smithi166.stdout:589: read oid 493 snap -1 2020-11-16T20:56:11.010 INFO:tasks.rados.rados.0.smithi166.stdout:589: expect (ObjNum 492 snap 0 seq_num 492) 2020-11-16T20:56:11.010 INFO:tasks.rados.rados.0.smithi166.stdout:590: rollback oid 158 current snap is 8 2020-11-16T20:56:11.010 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 158 to 6 2020-11-16T20:56:11.011 INFO:tasks.rados.rados.0.smithi166.stdout:591: cache_try_flush oid 284 snap -1 2020-11-16T20:56:11.011 INFO:tasks.rados.rados.0.smithi166.stdout:592: snap_create 2020-11-16T20:56:11.020 INFO:tasks.rados.rados.0.smithi166.stdout:589: expect (ObjNum 492 snap 0 seq_num 492) 2020-11-16T20:56:11.021 INFO:teuthology.orchestra.run.smithi166.stderr:noscrub is unset 2020-11-16T20:56:11.059 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:11.059 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:11.069 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:56:11.076 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:11.081+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:11.092 INFO:tasks.rados.rados.0.smithi166.stdout:591: got (2) No such file or directory 2020-11-16T20:56:11.092 INFO:tasks.rados.rados.0.smithi166.stdout:588: finishing rollback tid 0 to smithi16641208-364 2020-11-16T20:56:11.092 INFO:tasks.rados.rados.0.smithi166.stdout:588: finishing rollback tid 1 to smithi16641208-364 2020-11-16T20:56:11.092 INFO:tasks.rados.rados.0.smithi166.stdout:590: finishing rollback tid 0 to smithi16641208-158 2020-11-16T20:56:11.093 INFO:tasks.rados.rados.0.smithi166.stdout:588: finishing rollback tid 2 to smithi16641208-364 2020-11-16T20:56:11.093 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 364 v 523 (ObjNum 363 snap 0 seq_num 363) dirty exists 2020-11-16T20:56:11.093 INFO:tasks.rados.rados.0.smithi166.stdout:590: finishing rollback tid 1 to smithi16641208-158 2020-11-16T20:56:11.093 INFO:tasks.rados.rados.0.smithi166.stdout:590: finishing rollback tid 2 to smithi16641208-158 2020-11-16T20:56:11.093 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 158 v 443 (ObjNum 157 snap 0 seq_num 157) dirty exists 2020-11-16T20:56:11.176 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:11.181+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:11.204 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:11.205 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:11.214 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:56:11.298 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:11.303+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:11.379 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:11.383+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:11.389 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:11.389 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:11.398 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:56:11.479 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:11.485+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:11.574 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:11.574 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:11.580 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:11.585+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:11.583 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:56:11.663 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:56:11.664 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:56:11.664 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2020-11-16T20:56:11.680 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:11.685+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:11.719 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:11.719 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:11.728 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:56:11.781 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:11.786+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:11.881 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:11.886+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:11.903 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:11.903 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:11.913 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:56:11.958 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:56:11.959 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:11.959 INFO:teuthology.orchestra.run.smithi166.stdout: "epoch": 48, 2020-11-16T20:56:11.959 INFO:teuthology.orchestra.run.smithi166.stdout: "fsid": "a14fd848-4cfe-4cd9-9140-5b3c4b4e904d", 2020-11-16T20:56:11.959 INFO:teuthology.orchestra.run.smithi166.stdout: "created": "2020-11-16T20:54:44.938121+0000", 2020-11-16T20:56:11.959 INFO:teuthology.orchestra.run.smithi166.stdout: "modified": "2020-11-16T20:56:11.009321+0000", 2020-11-16T20:56:11.959 INFO:teuthology.orchestra.run.smithi166.stdout: "last_up_change": "2020-11-16T20:54:52.080163+0000", 2020-11-16T20:56:11.960 INFO:teuthology.orchestra.run.smithi166.stdout: "last_in_change": "2020-11-16T20:54:52.080163+0000", 2020-11-16T20:56:11.960 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-11-16T20:56:11.960 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_num": 5804032, 2020-11-16T20:56:11.960 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_set": [ 2020-11-16T20:56:11.960 INFO:teuthology.orchestra.run.smithi166.stdout: "nodeep-scrub", 2020-11-16T20:56:11.960 INFO:teuthology.orchestra.run.smithi166.stdout: "pglog_hardlimit", 2020-11-16T20:56:11.960 INFO:teuthology.orchestra.run.smithi166.stdout: "purged_snapdirs", 2020-11-16T20:56:11.961 INFO:teuthology.orchestra.run.smithi166.stdout: "recovery_deletes", 2020-11-16T20:56:11.961 INFO:teuthology.orchestra.run.smithi166.stdout: "sortbitwise" 2020-11-16T20:56:11.961 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:11.961 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_version": 5, 2020-11-16T20:56:11.961 INFO:teuthology.orchestra.run.smithi166.stdout: "full_ratio": 0.94999998807907104, 2020-11-16T20:56:11.961 INFO:teuthology.orchestra.run.smithi166.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-11-16T20:56:11.961 INFO:teuthology.orchestra.run.smithi166.stdout: "nearfull_ratio": 0.85000002384185791, 2020-11-16T20:56:11.961 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_snapshot": "", 2020-11-16T20:56:11.962 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_max": 4, 2020-11-16T20:56:11.962 INFO:teuthology.orchestra.run.smithi166.stdout: "max_osd": 8, 2020-11-16T20:56:11.962 INFO:teuthology.orchestra.run.smithi166.stdout: "require_min_compat_client": "luminous", 2020-11-16T20:56:11.962 INFO:teuthology.orchestra.run.smithi166.stdout: "min_compat_client": "jewel", 2020-11-16T20:56:11.962 INFO:teuthology.orchestra.run.smithi166.stdout: "require_osd_release": "pacific", 2020-11-16T20:56:11.962 INFO:teuthology.orchestra.run.smithi166.stdout: "pools": [ 2020-11-16T20:56:11.962 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:11.963 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 1, 2020-11-16T20:56:11.963 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "device_health_metrics", 2020-11-16T20:56:11.963 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:54:49.109999+0000", 2020-11-16T20:56:11.963 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 1, 2020-11-16T20:56:11.963 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool", 2020-11-16T20:56:11.963 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:56:11.963 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:56:11.964 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:56:11.964 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:56:11.964 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:56:11.964 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:56:11.964 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:56:11.964 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:56:11.964 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:56:11.964 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:56:11.965 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 1, 2020-11-16T20:56:11.965 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 1, 2020-11-16T20:56:11.965 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 1, 2020-11-16T20:56:11.965 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 1, 2020-11-16T20:56:11.965 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 1, 2020-11-16T20:56:11.965 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:56:11.965 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:56:11.966 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:56:11.966 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:56:11.966 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:56:11.966 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:56:11.966 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:56:11.966 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:11.966 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "15", 2020-11-16T20:56:11.967 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "0", 2020-11-16T20:56:11.967 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-16T20:56:11.967 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "0", 2020-11-16T20:56:11.967 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:56:11.967 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:56:11.967 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 0, 2020-11-16T20:56:11.967 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 0, 2020-11-16T20:56:11.967 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:56:11.968 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:56:11.968 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:56:11.968 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:56:11.968 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:56:11.968 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:56:11.968 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:56:11.968 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:56:11.969 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:56:11.969 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:56:11.969 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:56:11.969 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:56:11.969 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:56:11.969 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:56:11.969 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:56:11.969 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:56:11.970 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:56:11.970 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:56:11.970 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:56:11.970 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:11.970 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:56:11.970 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:56:11.970 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:56:11.971 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:56:11.971 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:56:11.971 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:56:11.971 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:56:11.971 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:56:11.971 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:56:11.971 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:56:11.971 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:56:11.972 INFO:teuthology.orchestra.run.smithi166.stdout: "options": { 2020-11-16T20:56:11.972 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_min": 1 2020-11-16T20:56:11.972 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:11.972 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:56:11.972 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_devicehealth": {} 2020-11-16T20:56:11.972 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:11.972 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:11.973 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:11.973 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 2, 2020-11-16T20:56:11.973 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "rbd", 2020-11-16T20:56:11.973 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:54:53.253680+0000", 2020-11-16T20:56:11.973 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 1, 2020-11-16T20:56:11.973 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool", 2020-11-16T20:56:11.973 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:56:11.973 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:56:11.974 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:56:11.974 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:56:11.974 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:56:11.974 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:56:11.974 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:56:11.974 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:56:11.974 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:56:11.975 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:56:11.975 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 18, 2020-11-16T20:56:11.975 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 18, 2020-11-16T20:56:11.975 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 18, 2020-11-16T20:56:11.975 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 18, 2020-11-16T20:56:11.975 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 18, 2020-11-16T20:56:11.975 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:56:11.976 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:56:11.976 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:56:11.976 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:56:11.976 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:56:11.976 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:56:11.976 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:56:11.976 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:11.976 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "34", 2020-11-16T20:56:11.977 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "0", 2020-11-16T20:56:11.977 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-16T20:56:11.977 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "32", 2020-11-16T20:56:11.977 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:56:11.977 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:56:11.977 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 0, 2020-11-16T20:56:11.977 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 0, 2020-11-16T20:56:11.978 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:56:11.978 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:56:11.978 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:56:11.978 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:56:11.978 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:56:11.978 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:56:11.978 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:56:11.978 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:56:11.979 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:56:11.979 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:56:11.979 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:56:11.979 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:56:11.979 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:56:11.979 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:56:11.979 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:56:11.980 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:56:11.980 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:56:11.980 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:56:11.980 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:56:11.980 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:11.980 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:56:11.980 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:56:11.980 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:56:11.981 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:56:11.981 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:56:11.981 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:56:11.981 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:56:11.981 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:56:11.981 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:56:11.981 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:56:11.982 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:56:11.982 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:56:11.982 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:56:11.982 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd": {} 2020-11-16T20:56:11.982 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:11.982 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:11.982 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:11.982 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 3, 2020-11-16T20:56:11.983 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "base", 2020-11-16T20:56:11.983 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:55:23.597952+0000", 2020-11-16T20:56:11.983 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 8193, 2020-11-16T20:56:11.983 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2020-11-16T20:56:11.983 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:56:11.983 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:56:11.983 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:56:11.983 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:56:11.984 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:56:11.984 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:56:11.984 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:56:11.984 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:56:11.984 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:56:11.984 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:56:11.984 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 4, 2020-11-16T20:56:11.985 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 4, 2020-11-16T20:56:11.985 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 4, 2020-11-16T20:56:11.985 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 4, 2020-11-16T20:56:11.985 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 4, 2020-11-16T20:56:11.985 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:56:11.985 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:56:11.985 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:56:11.986 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:56:11.986 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:56:11.986 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:56:11.986 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:56:11.986 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:11.986 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "48", 2020-11-16T20:56:11.986 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "27", 2020-11-16T20:56:11.986 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "27", 2020-11-16T20:56:11.987 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "27", 2020-11-16T20:56:11.987 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:56:11.987 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:56:11.987 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 13, 2020-11-16T20:56:11.987 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 48, 2020-11-16T20:56:11.987 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:56:11.987 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:56:11.988 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:56:11.988 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:56:11.988 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [ 2020-11-16T20:56:11.988 INFO:teuthology.orchestra.run.smithi166.stdout: 4 2020-11-16T20:56:11.988 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:11.988 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:56:11.988 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": 4, 2020-11-16T20:56:11.988 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": 4, 2020-11-16T20:56:11.989 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:56:11.989 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:56:11.989 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:56:11.989 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:56:11.989 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:56:11.989 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:56:11.989 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:56:11.989 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:56:11.990 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:56:11.990 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:56:11.990 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:56:11.990 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:11.990 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:56:11.990 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:56:11.990 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:56:11.991 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:56:11.991 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:56:11.991 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:56:11.991 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:56:11.991 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:56:11.991 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:56:11.991 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:56:11.992 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:56:11.992 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:56:11.992 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:56:11.992 INFO:teuthology.orchestra.run.smithi166.stdout: "rados": {} 2020-11-16T20:56:11.992 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:11.992 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:11.992 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:11.992 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 4, 2020-11-16T20:56:11.993 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "cache", 2020-11-16T20:56:11.993 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:55:28.901773+0000", 2020-11-16T20:56:11.993 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 8201, 2020-11-16T20:56:11.993 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool,incomplete_clones,selfmanaged_snaps", 2020-11-16T20:56:11.993 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:56:11.993 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:56:11.993 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:56:11.993 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:56:11.994 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:56:11.994 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:56:11.994 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:56:11.994 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:56:11.994 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:56:11.994 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:56:11.994 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 4, 2020-11-16T20:56:11.995 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 4, 2020-11-16T20:56:11.995 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 4, 2020-11-16T20:56:11.995 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 4, 2020-11-16T20:56:11.995 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 4, 2020-11-16T20:56:11.995 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:56:11.995 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:56:11.995 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:56:11.996 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:56:11.996 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:56:11.996 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:56:11.996 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:56:11.996 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:11.996 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "48", 2020-11-16T20:56:11.996 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "27", 2020-11-16T20:56:11.996 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "27", 2020-11-16T20:56:11.997 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "27", 2020-11-16T20:56:11.997 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:56:11.997 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:56:11.997 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 13, 2020-11-16T20:56:11.997 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 48, 2020-11-16T20:56:11.997 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:56:11.997 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:56:11.997 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:56:11.998 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:56:11.998 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:56:11.998 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": 3, 2020-11-16T20:56:11.998 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:56:11.998 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:56:11.998 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "writeback", 2020-11-16T20:56:11.998 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:56:11.999 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 250, 2020-11-16T20:56:11.999 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:56:11.999 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:56:11.999 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:56:11.999 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:56:11.999 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:56:11.999 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:56:11.999 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:56:12.000 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "bloom", 2020-11-16T20:56:12.000 INFO:teuthology.orchestra.run.smithi166.stdout: "false_positive_probability": 0.050000000000000003, 2020-11-16T20:56:12.000 INFO:teuthology.orchestra.run.smithi166.stdout: "target_size": 0, 2020-11-16T20:56:12.000 INFO:teuthology.orchestra.run.smithi166.stdout: "seed": 0 2020-11-16T20:56:12.000 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.000 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 3600, 2020-11-16T20:56:12.000 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 8, 2020-11-16T20:56:12.001 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:56:12.001 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 2, 2020-11-16T20:56:12.001 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:56:12.001 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:56:12.001 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:56:12.001 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [ 2020-11-16T20:56:12.001 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:12.001 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:12.002 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:12.002 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:12.002 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:12.002 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:12.002 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:12.002 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000 2020-11-16T20:56:12.002 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:12.003 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:56:12.003 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:56:12.003 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:56:12.003 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:56:12.003 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": {} 2020-11-16T20:56:12.003 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.003 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:12.003 INFO:teuthology.orchestra.run.smithi166.stdout: "osds": [ 2020-11-16T20:56:12.004 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.004 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 0, 2020-11-16T20:56:12.004 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "35950122-efbd-420e-b07a-f5730f26df17", 2020-11-16T20:56:12.004 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:12.004 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:12.004 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:12.004 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:12.005 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:12.005 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:12.005 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:12.005 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 22, 2020-11-16T20:56:12.005 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:12.005 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:12.005 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:12.005 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.006 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.006 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.006 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6800", 2020-11-16T20:56:12.006 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:56:12.006 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.006 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.006 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.007 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:12.007 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.007 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.007 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.007 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6802", 2020-11-16T20:56:12.007 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:56:12.007 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.008 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.008 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.008 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:12.008 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.008 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.008 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.008 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6806", 2020-11-16T20:56:12.008 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:56:12.009 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.009 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.009 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.009 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:12.009 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.009 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.009 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.009 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6804", 2020-11-16T20:56:12.010 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:56:12.010 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.010 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.010 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.010 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6800/35293", 2020-11-16T20:56:12.010 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6802/35293", 2020-11-16T20:56:12.010 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6806/35293", 2020-11-16T20:56:12.011 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6804/35293", 2020-11-16T20:56:12.011 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:12.011 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:12.011 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:12.011 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.011 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.011 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.011 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 1, 2020-11-16T20:56:12.012 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "f768a1ff-3e8a-4131-a6ed-10f93b3ca900", 2020-11-16T20:56:12.012 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:12.012 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:12.012 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:12.012 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:12.012 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:12.012 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:12.013 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:12.013 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 34, 2020-11-16T20:56:12.013 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:12.013 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:12.013 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:12.013 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.013 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.013 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.014 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6808", 2020-11-16T20:56:12.014 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:56:12.014 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.014 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.014 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.014 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:12.014 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.015 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.015 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.015 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6809", 2020-11-16T20:56:12.015 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:56:12.015 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.015 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.015 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.015 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:12.016 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.016 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.016 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6811", 2020-11-16T20:56:12.016 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:56:12.016 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.016 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.017 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.017 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:12.017 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.017 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.017 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.017 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6810", 2020-11-16T20:56:12.017 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:56:12.017 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.018 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.018 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.018 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6808/35323", 2020-11-16T20:56:12.018 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6809/35323", 2020-11-16T20:56:12.018 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6811/35323", 2020-11-16T20:56:12.018 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6810/35323", 2020-11-16T20:56:12.018 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:12.019 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:12.019 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:12.019 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.019 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.019 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.019 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 2, 2020-11-16T20:56:12.019 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "88734179-84a6-4a9b-8af0-692805815875", 2020-11-16T20:56:12.019 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:12.020 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:12.020 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:12.020 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:12.020 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:12.020 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:12.020 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:12.020 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 34, 2020-11-16T20:56:12.020 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:12.021 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:12.021 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:12.021 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.021 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.021 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.021 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6801", 2020-11-16T20:56:12.021 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:56:12.022 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.022 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.022 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.022 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:12.022 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.022 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.022 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.022 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6803", 2020-11-16T20:56:12.023 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:56:12.023 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.023 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.023 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.023 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:12.023 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.023 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.023 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.024 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6807", 2020-11-16T20:56:12.024 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:56:12.024 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.024 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.024 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.024 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:12.024 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.025 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.025 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.025 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6805", 2020-11-16T20:56:12.025 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:56:12.025 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.025 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.025 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.025 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6801/35294", 2020-11-16T20:56:12.026 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6803/35294", 2020-11-16T20:56:12.026 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6807/35294", 2020-11-16T20:56:12.026 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6805/35294", 2020-11-16T20:56:12.026 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:12.026 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:12.026 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:12.026 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.027 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.027 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.027 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 3, 2020-11-16T20:56:12.027 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "319e54e8-3f03-4388-8de6-678d148e25d4", 2020-11-16T20:56:12.027 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:12.027 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:12.027 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:12.027 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:12.028 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:12.028 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:12.028 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:12.028 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 22, 2020-11-16T20:56:12.028 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:12.028 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:12.028 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:12.029 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.029 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.029 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.029 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6812", 2020-11-16T20:56:12.029 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:56:12.029 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.029 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.029 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.030 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:12.030 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.030 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.030 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.030 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6813", 2020-11-16T20:56:12.030 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:56:12.030 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.031 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.031 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.031 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:12.031 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.031 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.031 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.031 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6815", 2020-11-16T20:56:12.031 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:56:12.032 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.032 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.032 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.032 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:12.032 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.032 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.032 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.032 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6814", 2020-11-16T20:56:12.033 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:56:12.033 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.033 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.033 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.033 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6812/35324", 2020-11-16T20:56:12.033 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6813/35324", 2020-11-16T20:56:12.033 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6815/35324", 2020-11-16T20:56:12.034 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6814/35324", 2020-11-16T20:56:12.034 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:12.034 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:12.034 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:12.034 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.034 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.034 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.034 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 4, 2020-11-16T20:56:12.035 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "3edbb68e-e030-4379-891e-2412f1235ffb", 2020-11-16T20:56:12.035 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:12.035 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:12.035 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:12.035 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:12.035 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:12.035 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:12.036 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:12.036 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 34, 2020-11-16T20:56:12.036 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:12.036 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:12.036 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:12.036 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.036 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.036 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.037 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6804", 2020-11-16T20:56:12.037 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:56:12.037 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.037 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.037 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.037 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:12.037 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.038 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.038 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.038 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6805", 2020-11-16T20:56:12.038 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:56:12.038 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.038 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.038 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.038 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:12.039 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.039 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.039 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.039 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6807", 2020-11-16T20:56:12.039 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:56:12.039 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.039 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.040 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.040 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:12.040 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.040 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.040 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.040 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6806", 2020-11-16T20:56:12.040 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:56:12.040 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.041 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.041 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.041 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6804/31586", 2020-11-16T20:56:12.041 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6805/31586", 2020-11-16T20:56:12.041 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6807/31586", 2020-11-16T20:56:12.041 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6806/31586", 2020-11-16T20:56:12.041 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:12.041 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:12.042 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:12.042 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.042 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.042 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.042 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 5, 2020-11-16T20:56:12.042 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "44fbf5ac-4484-48a8-a846-1f5c01a6ec2c", 2020-11-16T20:56:12.042 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:12.043 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:12.043 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:12.043 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:12.043 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:12.043 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:12.043 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:12.043 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 32, 2020-11-16T20:56:12.043 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:12.044 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:12.044 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:12.044 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.044 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.044 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.044 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6808", 2020-11-16T20:56:12.044 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:56:12.045 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.045 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.045 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.045 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:12.045 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.045 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.045 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.045 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6810", 2020-11-16T20:56:12.046 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:56:12.046 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.046 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.046 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.046 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:12.046 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.046 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.047 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.047 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6813", 2020-11-16T20:56:12.047 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:56:12.047 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.047 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.047 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.047 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:12.047 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.048 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.048 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.048 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6812", 2020-11-16T20:56:12.048 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:56:12.048 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.048 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.048 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.048 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6808/31610", 2020-11-16T20:56:12.049 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6810/31610", 2020-11-16T20:56:12.049 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6813/31610", 2020-11-16T20:56:12.049 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6812/31610", 2020-11-16T20:56:12.049 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:12.049 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:12.049 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:12.049 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.050 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.050 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.050 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 6, 2020-11-16T20:56:12.050 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "f93b82df-f537-4601-8247-388bf100b5b5", 2020-11-16T20:56:12.050 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:12.050 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:12.050 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:12.050 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:12.051 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:12.051 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:12.051 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:12.051 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 34, 2020-11-16T20:56:12.051 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:12.051 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:12.051 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:12.052 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.052 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.052 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.052 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6800", 2020-11-16T20:56:12.052 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:56:12.052 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.052 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.052 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.053 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:12.053 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.053 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.053 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.053 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6801", 2020-11-16T20:56:12.053 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:56:12.053 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.053 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.054 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.054 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:12.054 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.054 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.054 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.054 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6803", 2020-11-16T20:56:12.054 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:56:12.055 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.055 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.055 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.055 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:12.055 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.055 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.055 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.055 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6802", 2020-11-16T20:56:12.056 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:56:12.056 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.056 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.056 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.056 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6800/31587", 2020-11-16T20:56:12.056 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6801/31587", 2020-11-16T20:56:12.056 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6803/31587", 2020-11-16T20:56:12.057 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6802/31587", 2020-11-16T20:56:12.057 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:12.057 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:12.057 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:12.057 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.057 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.057 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.057 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 7, 2020-11-16T20:56:12.058 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "e5485c88-d267-4a6a-b9b6-15d869d28f28", 2020-11-16T20:56:12.058 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:12.058 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:12.058 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:12.058 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:12.058 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:12.058 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:12.058 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:12.059 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 34, 2020-11-16T20:56:12.059 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:12.059 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:12.059 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:12.059 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.059 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.059 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.060 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6809", 2020-11-16T20:56:12.060 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:56:12.060 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.060 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.060 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.060 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:12.060 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.060 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.061 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.061 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6811", 2020-11-16T20:56:12.061 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:56:12.061 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.061 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.061 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.061 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:12.062 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.062 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.062 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.062 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6815", 2020-11-16T20:56:12.062 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:56:12.062 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.062 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.062 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.063 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:12.063 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:12.063 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.063 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:12.063 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6814", 2020-11-16T20:56:12.063 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:56:12.063 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.064 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.064 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.064 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6809/31617", 2020-11-16T20:56:12.064 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6811/31617", 2020-11-16T20:56:12.064 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6815/31617", 2020-11-16T20:56:12.064 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6814/31617", 2020-11-16T20:56:12.064 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:12.064 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:12.065 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:12.065 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.065 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.065 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:12.065 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_xinfo": [ 2020-11-16T20:56:12.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.065 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 0, 2020-11-16T20:56:12.065 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:12.066 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:12.066 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:12.066 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:12.066 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:12.066 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:50.610058+0000", 2020-11-16T20:56:12.066 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:12.066 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.067 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.067 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 1, 2020-11-16T20:56:12.067 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:12.067 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:12.067 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:12.067 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:12.067 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:12.067 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:50.548086+0000", 2020-11-16T20:56:12.068 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:12.068 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.068 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.068 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 2, 2020-11-16T20:56:12.068 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:12.068 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:12.068 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:12.069 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:12.069 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:12.069 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:50.536944+0000", 2020-11-16T20:56:12.069 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:12.069 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.069 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.069 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 3, 2020-11-16T20:56:12.069 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:12.070 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:12.070 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:12.070 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:12.070 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:12.070 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:51.137739+0000", 2020-11-16T20:56:12.070 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:12.070 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.071 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.071 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 4, 2020-11-16T20:56:12.071 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:12.071 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:12.071 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:12.071 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:12.071 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:12.071 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:50.747840+0000", 2020-11-16T20:56:12.072 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:12.072 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.072 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.072 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 5, 2020-11-16T20:56:12.072 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:12.072 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:12.072 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:12.072 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:12.073 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:12.073 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:51.365378+0000", 2020-11-16T20:56:12.073 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:12.073 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.073 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.073 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 6, 2020-11-16T20:56:12.073 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:12.074 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:12.074 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:12.074 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:12.074 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:12.074 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:50.725150+0000", 2020-11-16T20:56:12.074 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:12.074 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.074 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.075 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 7, 2020-11-16T20:56:12.075 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:12.075 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:12.075 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:12.075 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:12.075 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:12.075 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:50.621411+0000", 2020-11-16T20:56:12.076 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:12.076 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.076 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:12.076 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_upmap": [], 2020-11-16T20:56:12.076 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_upmap_items": [], 2020-11-16T20:56:12.076 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_temp": [], 2020-11-16T20:56:12.076 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_temp": [], 2020-11-16T20:56:12.076 INFO:teuthology.orchestra.run.smithi166.stdout: "blocklist": {}, 2020-11-16T20:56:12.077 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profiles": { 2020-11-16T20:56:12.077 INFO:teuthology.orchestra.run.smithi166.stdout: "default": { 2020-11-16T20:56:12.077 INFO:teuthology.orchestra.run.smithi166.stdout: "crush-failure-domain": "osd", 2020-11-16T20:56:12.077 INFO:teuthology.orchestra.run.smithi166.stdout: "k": "2", 2020-11-16T20:56:12.077 INFO:teuthology.orchestra.run.smithi166.stdout: "m": "1", 2020-11-16T20:56:12.077 INFO:teuthology.orchestra.run.smithi166.stdout: "plugin": "jerasure", 2020-11-16T20:56:12.077 INFO:teuthology.orchestra.run.smithi166.stdout: "ruleset-failure-domain": "osd", 2020-11-16T20:56:12.077 INFO:teuthology.orchestra.run.smithi166.stdout: "technique": "reed_sol_van" 2020-11-16T20:56:12.078 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.078 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.078 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps_queue": [ 2020-11-16T20:56:12.078 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.078 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 3, 2020-11-16T20:56:12.078 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:56:12.078 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.079 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 2, 2020-11-16T20:56:12.079 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 3 2020-11-16T20:56:12.079 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.079 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.079 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 6, 2020-11-16T20:56:12.079 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:12.079 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.079 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.080 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.080 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.080 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 4, 2020-11-16T20:56:12.080 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:56:12.080 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.080 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 2, 2020-11-16T20:56:12.080 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 3 2020-11-16T20:56:12.080 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:12.081 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:12.081 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 6, 2020-11-16T20:56:12.081 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:12.081 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.081 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:12.081 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.081 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:12.082 INFO:teuthology.orchestra.run.smithi166.stdout: "new_removed_snaps": [], 2020-11-16T20:56:12.082 INFO:teuthology.orchestra.run.smithi166.stdout: "new_purged_snaps": [], 2020-11-16T20:56:12.082 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_node_flags": {}, 2020-11-16T20:56:12.082 INFO:teuthology.orchestra.run.smithi166.stdout: "device_class_flags": {}, 2020-11-16T20:56:12.082 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode": { 2020-11-16T20:56:12.082 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode_enabled": false, 2020-11-16T20:56:12.082 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_bucket_count": 0, 2020-11-16T20:56:12.082 INFO:teuthology.orchestra.run.smithi166.stdout: "degraded_stretch_mode": 0, 2020-11-16T20:56:12.083 INFO:teuthology.orchestra.run.smithi166.stdout: "recovering_stretch_mode": 0, 2020-11-16T20:56:12.083 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode_bucket": 0 2020-11-16T20:56:12.083 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:12.083 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:12.085 INFO:tasks.rados.rados.0.smithi166.stdout:588: done (4 left) 2020-11-16T20:56:12.085 INFO:tasks.rados.rados.0.smithi166.stdout:589: done (3 left) 2020-11-16T20:56:12.085 INFO:tasks.rados.rados.0.smithi166.stdout:590: done (2 left) 2020-11-16T20:56:12.086 INFO:tasks.rados.rados.0.smithi166.stdout:591: done (1 left) 2020-11-16T20:56:12.086 INFO:tasks.rados.rados.0.smithi166.stdout:592: done (0 left) 2020-11-16T20:56:12.086 INFO:tasks.rados.rados.0.smithi166.stdout:593: copy_from oid 58 from oid 30 current snap is 9 2020-11-16T20:56:12.086 INFO:tasks.rados.rados.0.smithi166.stdout:594: cache_evict oid 132 snap -1 2020-11-16T20:56:12.086 INFO:tasks.rados.rados.0.smithi166.stdout:595: cache_try_flush oid 88 snap -1 2020-11-16T20:56:12.086 INFO:tasks.rados.rados.0.smithi166.stdout:596: cache_evict oid 9 snap -1 2020-11-16T20:56:12.086 INFO:tasks.rados.rados.0.smithi166.stdout:597: read oid 98 snap -1 2020-11-16T20:56:12.087 INFO:tasks.rados.rados.0.smithi166.stdout:597: expect (ObjNum 97 snap 0 seq_num 97) 2020-11-16T20:56:12.087 INFO:tasks.rados.rados.0.smithi166.stdout:598: rollback oid 65 current snap is 9 2020-11-16T20:56:12.087 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 65 to 6 2020-11-16T20:56:12.087 INFO:tasks.rados.rados.0.smithi166.stdout:599: write oid 11 current snap is 9 2020-11-16T20:56:12.087 INFO:tasks.rados.rados.0.smithi166.stdout:599: seq_num 528 ranges {474096=559829,1780963=408850,2800046=74050} 2020-11-16T20:56:12.087 INFO:tasks.rados.rados.0.smithi166.stdout:599: writing smithi16641208-11 from 474096 to 1033925 tid 1 2020-11-16T20:56:12.087 INFO:tasks.rados.rados.0.smithi166.stdout:599: writing smithi16641208-11 from 1780963 to 2189813 tid 2 2020-11-16T20:56:12.088 INFO:tasks.rados.rados.0.smithi166.stdout:599: writing smithi16641208-11 from 2800046 to 2874096 tid 3 2020-11-16T20:56:12.088 INFO:tasks.rados.rados.0.smithi166.stdout:600: cache_evict oid 480 snap 7 2020-11-16T20:56:12.088 INFO:tasks.rados.rados.0.smithi166.stdout:601: cache_try_flush oid 176 snap 3 2020-11-16T20:56:12.088 INFO:tasks.rados.rados.0.smithi166.stdout:602: rollback oid 207 current snap is 9 2020-11-16T20:56:12.088 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 207 to 6 2020-11-16T20:56:12.088 INFO:tasks.rados.rados.0.smithi166.stdout:603: cache_try_flush oid 363 snap -1 2020-11-16T20:56:12.088 INFO:tasks.rados.rados.0.smithi166.stdout:604: delete oid 109 current snap is 9 2020-11-16T20:56:12.088 INFO:tasks.rados.rados.0.smithi166.stdout:595: got (16) Device or resource busy 2020-11-16T20:56:12.089 INFO:tasks.rados.rados.0.smithi166.stdout:594: got (2) No such file or directory 2020-11-16T20:56:12.089 INFO:tasks.rados.rados.0.smithi166.stdout:596: got (16) Device or resource busy 2020-11-16T20:56:12.089 INFO:tasks.rados.rados.0.smithi166.stdout:598: finishing rollback tid 0 to smithi16641208-65 2020-11-16T20:56:12.089 INFO:tasks.rados.rados.0.smithi166.stdout:598: finishing rollback tid 1 to smithi16641208-65 2020-11-16T20:56:12.089 INFO:tasks.rados.rados.0.smithi166.stdout:598: finishing rollback tid 2 to smithi16641208-65 2020-11-16T20:56:12.089 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 65 v 416 (ObjNum 64 snap 0 seq_num 64) dirty exists 2020-11-16T20:56:12.089 INFO:tasks.rados.rados.0.smithi166.stdout:603: got (2) No such file or directory 2020-11-16T20:56:12.090 INFO:tasks.rados.rados.0.smithi166.stdout:597: expect (ObjNum 97 snap 0 seq_num 97) 2020-11-16T20:56:12.090 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:12.088+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:12.090 INFO:tasks.thrashosds.thrasher:j is {'epoch': 48, 'fsid': 'a14fd848-4cfe-4cd9-9140-5b3c4b4e904d', 'created': '2020-11-16T20:54:44.938121+0000', 'modified': '2020-11-16T20:56:11.009321+0000', 'last_up_change': '2020-11-16T20:54:52.080163+0000', 'last_in_change': '2020-11-16T20:54:52.080163+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-16T20:54:49.109999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-16T20:54:53.253680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 18, 'pg_placement_num': 18, 'pg_placement_num_target': 18, 'pg_num_target': 18, 'pg_num_pending': 18, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '32', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'base', 'create_time': '2020-11-16T20:55:23.597952+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 4, 'pg_placement_num': 4, 'pg_placement_num_target': 4, 'pg_num_target': 4, 'pg_num_pending': 4, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '27', 'last_force_op_resend_prenautilus': '27', 'last_force_op_resend_preluminous': '27', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 13, 'snap_epoch': 48, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [4], 'tier_of': -1, 'read_tier': 4, 'write_tier': 4, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 4, 'pool_name': 'cache', 'create_time': '2020-11-16T20:55:28.901773+0000', 'flags': 8201, 'flags_names': 'hashpspool,incomplete_clones,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 4, 'pg_placement_num': 4, 'pg_placement_num_target': 4, 'pg_num_target': 4, 'pg_num_pending': 4, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '27', 'last_force_op_resend_prenautilus': '27', 'last_force_op_resend_preluminous': '27', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 13, 'snap_epoch': 48, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': 3, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'writeback', 'target_max_bytes': 0, 'target_max_objects': 250, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'bloom', 'false_positive_probability': 0.05, 'target_size': 0, 'seed': 0}, 'hit_set_period': 3600, 'hit_set_count': 8, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 2, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [1000000, 1000000, 1000000, 1000000, 1000000, 1000000, 1000000, 1000000], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}}], 'osds': [{'osd': 0, 'uuid': '35950122-efbd-420e-b07a-f5730f26df17', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6800', 'nonce': 35293}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6802', 'nonce': 35293}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6806', 'nonce': 35293}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6804', 'nonce': 35293}]}, 'public_addr': '172.21.15.166:6800/35293', 'cluster_addr': '172.21.15.166:6802/35293', 'heartbeat_back_addr': '172.21.15.166:6806/35293', 'heartbeat_front_addr': '172.21.15.166:6804/35293', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f768a1ff-3e8a-4131-a6ed-10f93b3ca900', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6808', 'nonce': 35323}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6809', 'nonce': 35323}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6811', 'nonce': 35323}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6810', 'nonce': 35323}]}, 'public_addr': '172.21.15.166:6808/35323', 'cluster_addr': '172.21.15.166:6809/35323', 'heartbeat_back_addr': '172.21.15.166:6811/35323', 'heartbeat_front_addr': '172.21.15.166:6810/35323', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '88734179-84a6-4a9b-8af0-692805815875', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6801', 'nonce': 35294}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6803', 'nonce': 35294}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6807', 'nonce': 35294}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6805', 'nonce': 35294}]}, 'public_addr': '172.21.15.166:6801/35294', 'cluster_addr': '172.21.15.166:6803/35294', 'heartbeat_back_addr': '172.21.15.166:6807/35294', 'heartbeat_front_addr': '172.21.15.166:6805/35294', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '319e54e8-3f03-4388-8de6-678d148e25d4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6812', 'nonce': 35324}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6813', 'nonce': 35324}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6815', 'nonce': 35324}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6814', 'nonce': 35324}]}, 'public_addr': '172.21.15.166:6812/35324', 'cluster_addr': '172.21.15.166:6813/35324', 'heartbeat_back_addr': '172.21.15.166:6815/35324', 'heartbeat_front_addr': '172.21.15.166:6814/35324', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '3edbb68e-e030-4379-891e-2412f1235ffb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6804', 'nonce': 31586}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6805', 'nonce': 31586}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6807', 'nonce': 31586}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6806', 'nonce': 31586}]}, 'public_addr': '172.21.15.59:6804/31586', 'cluster_addr': '172.21.15.59:6805/31586', 'heartbeat_back_addr': '172.21.15.59:6807/31586', 'heartbeat_front_addr': '172.21.15.59:6806/31586', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '44fbf5ac-4484-48a8-a846-1f5c01a6ec2c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 32, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6808', 'nonce': 31610}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6810', 'nonce': 31610}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6813', 'nonce': 31610}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6812', 'nonce': 31610}]}, 'public_addr': '172.21.15.59:6808/31610', 'cluster_addr': '172.21.15.59:6810/31610', 'heartbeat_back_addr': '172.21.15.59:6813/31610', 'heartbeat_front_addr': '172.21.15.59:6812/31610', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'f93b82df-f537-4601-8247-388bf100b5b5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6800', 'nonce': 31587}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6801', 'nonce': 31587}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6803', 'nonce': 31587}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6802', 'nonce': 31587}]}, 'public_addr': '172.21.15.59:6800/31587', 'cluster_addr': '172.21.15.59:6801/31587', 'heartbeat_back_addr': '172.21.15.59:6803/31587', 'heartbeat_front_addr': '172.21.15.59:6802/31587', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'e5485c88-d267-4a6a-b9b6-15d869d28f28', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6809', 'nonce': 31617}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6811', 'nonce': 31617}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6815', 'nonce': 31617}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6814', 'nonce': 31617}]}, 'public_addr': '172.21.15.59:6809/31617', 'cluster_addr': '172.21.15.59:6811/31617', 'heartbeat_back_addr': '172.21.15.59:6815/31617', 'heartbeat_front_addr': '172.21.15.59:6814/31617', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:50.610058+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:50.548086+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:50.536944+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:51.137739+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:50.747840+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:51.365378+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:50.725150+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:50.621411+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 2, 'length': 3}, {'begin': 6, 'length': 1}]}, {'pool': 4, 'snaps': [{'begin': 2, 'length': 3}, {'begin': 6, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2020-11-16T20:56:12.091 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-16T20:56:12.122 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:12.122 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:12.132 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:56:12.164 INFO:tasks.rados.rados.0.smithi166.stdout:600: got (2) No such file or directory 2020-11-16T20:56:12.165 INFO:tasks.rados.rados.0.smithi166.stdout:599: finishing write tid 1 to smithi16641208-11 2020-11-16T20:56:12.165 INFO:tasks.rados.rados.0.smithi166.stdout:599: finishing write tid 2 to smithi16641208-11 2020-11-16T20:56:12.165 INFO:tasks.rados.rados.0.smithi166.stdout:594: done (11 left) 2020-11-16T20:56:12.165 INFO:tasks.rados.rados.0.smithi166.stdout:595: done (10 left) 2020-11-16T20:56:12.165 INFO:tasks.rados.rados.0.smithi166.stdout:596: done (9 left) 2020-11-16T20:56:12.165 INFO:tasks.rados.rados.0.smithi166.stdout:597: done (8 left) 2020-11-16T20:56:12.166 INFO:tasks.rados.rados.0.smithi166.stdout:598: done (7 left) 2020-11-16T20:56:12.166 INFO:tasks.rados.rados.0.smithi166.stdout:600: done (6 left) 2020-11-16T20:56:12.166 INFO:tasks.rados.rados.0.smithi166.stdout:603: done (5 left) 2020-11-16T20:56:12.166 INFO:tasks.rados.rados.0.smithi166.stdout:604: done (4 left) 2020-11-16T20:56:12.166 INFO:tasks.rados.rados.0.smithi166.stdout:605: write oid 9 current snap is 9 2020-11-16T20:56:12.166 INFO:tasks.rados.rados.0.smithi166.stdout:599: finishing write tid 3 to smithi16641208-11 2020-11-16T20:56:12.166 INFO:tasks.rados.rados.0.smithi166.stdout:605: seq_num 530 ranges {507710=710327,1897927=412519,2854892=52818} 2020-11-16T20:56:12.171 INFO:tasks.rados.rados.0.smithi166.stdout:605: writing smithi16641208-9 from 507710 to 1218037 tid 1 2020-11-16T20:56:12.176 INFO:tasks.rados.rados.0.smithi166.stdout:605: writing smithi16641208-9 from 1897927 to 2310446 tid 2 2020-11-16T20:56:12.180 INFO:tasks.rados.rados.0.smithi166.stdout:605: writing smithi16641208-9 from 2854892 to 2907710 tid 3 2020-11-16T20:56:12.180 INFO:tasks.rados.rados.0.smithi166.stdout:606: delete oid 110 current snap is 9 2020-11-16T20:56:12.181 INFO:tasks.rados.rados.0.smithi166.stdout:599: finishing write tid 4 to smithi16641208-11 2020-11-16T20:56:12.181 INFO:tasks.rados.rados.0.smithi166.stdout:599: finishing write tid 5 to smithi16641208-11 2020-11-16T20:56:12.181 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 11 v 420 (ObjNum 528 snap 9 seq_num 528) dirty exists 2020-11-16T20:56:12.181 INFO:tasks.rados.rados.0.smithi166.stdout:599: left oid 11 (ObjNum 528 snap 9 seq_num 528) 2020-11-16T20:56:12.181 INFO:tasks.rados.rados.0.smithi166.stdout:601: got (2) No such file or directory 2020-11-16T20:56:12.181 INFO:tasks.rados.rados.0.smithi166.stdout:602: finishing rollback tid 0 to smithi16641208-207 2020-11-16T20:56:12.181 INFO:tasks.rados.rados.0.smithi166.stdout:602: finishing rollback tid 1 to smithi16641208-207 2020-11-16T20:56:12.181 INFO:tasks.rados.rados.0.smithi166.stdout:602: finishing rollback tid 2 to smithi16641208-207 2020-11-16T20:56:12.182 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 207 v 445 (ObjNum 206 snap 0 seq_num 206) dirty exists 2020-11-16T20:56:12.182 INFO:tasks.rados.rados.0.smithi166.stdout:593: finishing copy_from to smithi16641208-58 2020-11-16T20:56:12.182 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 58 v 21 (ObjNum 29 snap 0 seq_num 29) dirty exists 2020-11-16T20:56:12.182 INFO:tasks.rados.rados.0.smithi166.stdout:593: finishing copy_from racing read to smithi16641208-58 2020-11-16T20:56:12.182 INFO:tasks.rados.rados.0.smithi166.stdout:605: finishing write tid 1 to smithi16641208-9 2020-11-16T20:56:12.182 INFO:tasks.rados.rados.0.smithi166.stdout:605: finishing write tid 2 to smithi16641208-9 2020-11-16T20:56:12.185 INFO:tasks.rados.rados.0.smithi166.stdout:605: finishing write tid 3 to smithi16641208-9 2020-11-16T20:56:12.185 INFO:tasks.rados.rados.0.smithi166.stdout:605: finishing write tid 4 to smithi16641208-9 2020-11-16T20:56:12.186 INFO:tasks.rados.rados.0.smithi166.stdout:605: finishing write tid 5 to smithi16641208-9 2020-11-16T20:56:12.187 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 9 v 528 (ObjNum 530 snap 9 seq_num 530) dirty exists 2020-11-16T20:56:12.187 INFO:tasks.rados.rados.0.smithi166.stdout:605: left oid 9 (ObjNum 530 snap 9 seq_num 530) 2020-11-16T20:56:12.187 INFO:tasks.rados.rados.0.smithi166.stdout:593: done (5 left) 2020-11-16T20:56:12.187 INFO:tasks.rados.rados.0.smithi166.stdout:599: done (4 left) 2020-11-16T20:56:12.187 INFO:tasks.rados.rados.0.smithi166.stdout:601: done (3 left) 2020-11-16T20:56:12.187 INFO:tasks.rados.rados.0.smithi166.stdout:602: done (2 left) 2020-11-16T20:56:12.187 INFO:tasks.rados.rados.0.smithi166.stdout:605: done (1 left) 2020-11-16T20:56:12.188 INFO:tasks.rados.rados.0.smithi166.stdout:606: done (0 left) 2020-11-16T20:56:12.188 INFO:tasks.rados.rados.0.smithi166.stdout:607: cache_flush oid 59 snap -1 2020-11-16T20:56:12.188 INFO:tasks.rados.rados.0.smithi166.stdout:608: read oid 62 snap -1 2020-11-16T20:56:12.188 INFO:tasks.rados.rados.0.smithi166.stdout:608: expect (ObjNum 61 snap 0 seq_num 61) 2020-11-16T20:56:12.188 INFO:tasks.rados.rados.0.smithi166.stdout:609: copy_from oid 345 from oid 499 current snap is 9 2020-11-16T20:56:12.188 INFO:tasks.rados.rados.0.smithi166.stdout:610: write oid 120 current snap is 9 2020-11-16T20:56:12.188 INFO:tasks.rados.rados.0.smithi166.stdout:610: seq_num 532 ranges {541324=460825,1498538=416188,2393385=547939} 2020-11-16T20:56:12.192 INFO:tasks.rados.rados.0.smithi166.stdout:610: writing smithi16641208-120 from 541324 to 1002149 tid 1 2020-11-16T20:56:12.197 INFO:tasks.rados.rados.0.smithi166.stdout:610: writing smithi16641208-120 from 1498538 to 1914726 tid 2 2020-11-16T20:56:12.203 INFO:tasks.rados.rados.0.smithi166.stdout:610: writing smithi16641208-120 from 2393385 to 2941324 tid 3 2020-11-16T20:56:12.204 INFO:tasks.rados.rados.0.smithi166.stdout:611: delete oid 422 current snap is 9 2020-11-16T20:56:12.204 INFO:tasks.rados.rados.0.smithi166.stdout:607: got (2) No such file or directory 2020-11-16T20:56:12.204 INFO:tasks.rados.rados.0.smithi166.stdout:608: expect (ObjNum 61 snap 0 seq_num 61) 2020-11-16T20:56:12.216 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:12.221+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:12.286 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:12.291+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:12.307 INFO:tasks.rados.rados.0.smithi166.stdout:610: finishing write tid 1 to smithi16641208-120 2020-11-16T20:56:12.307 INFO:tasks.rados.rados.0.smithi166.stdout:607: done (4 left) 2020-11-16T20:56:12.307 INFO:tasks.rados.rados.0.smithi166.stdout:608: done (3 left) 2020-11-16T20:56:12.307 INFO:tasks.rados.rados.0.smithi166.stdout:611: done (2 left) 2020-11-16T20:56:12.308 INFO:tasks.rados.rados.0.smithi166.stdout:612: read oid 142 snap -1 2020-11-16T20:56:12.308 INFO:tasks.rados.rados.0.smithi166.stdout:612: expect (ObjNum 141 snap 0 seq_num 141) 2020-11-16T20:56:12.308 INFO:tasks.rados.rados.0.smithi166.stdout:613: read oid 96 snap 6 2020-11-16T20:56:12.308 INFO:tasks.rados.rados.0.smithi166.stdout:613: expect (ObjNum 95 snap 0 seq_num 95) 2020-11-16T20:56:12.308 INFO:tasks.rados.rados.0.smithi166.stdout:614: write (excl) oid 366 current snap is 9 2020-11-16T20:56:12.308 INFO:tasks.rados.rados.0.smithi166.stdout:610: finishing write tid 2 to smithi16641208-120 2020-11-16T20:56:12.308 INFO:tasks.rados.rados.0.smithi166.stdout:609: finishing copy_from to smithi16641208-345 2020-11-16T20:56:12.309 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 345 v 383 (ObjNum 498 snap 0 seq_num 498) dirty exists 2020-11-16T20:56:12.309 INFO:tasks.rados.rados.0.smithi166.stdout:610: finishing write tid 3 to smithi16641208-120 2020-11-16T20:56:12.309 INFO:tasks.rados.rados.0.smithi166.stdout:610: finishing write tid 4 to smithi16641208-120 2020-11-16T20:56:12.309 INFO:tasks.rados.rados.0.smithi166.stdout:610: finishing write tid 5 to smithi16641208-120 2020-11-16T20:56:12.309 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 120 v 447 (ObjNum 532 snap 9 seq_num 532) dirty exists 2020-11-16T20:56:12.309 INFO:tasks.rados.rados.0.smithi166.stdout:610: left oid 120 (ObjNum 532 snap 9 seq_num 532) 2020-11-16T20:56:12.309 INFO:tasks.rados.rados.0.smithi166.stdout:609: finishing copy_from racing read to smithi16641208-345 2020-11-16T20:56:12.309 INFO:tasks.rados.rados.0.smithi166.stdout:614: seq_num 534 ranges {574938=727676,1731855=703504,2848231=126707} 2020-11-16T20:56:12.314 INFO:tasks.rados.rados.0.smithi166.stdout:614: writing smithi16641208-366 from 574938 to 1302614 tid 1 2020-11-16T20:56:12.318 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:12.318 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:12.321 INFO:tasks.rados.rados.0.smithi166.stdout:614: writing smithi16641208-366 from 1731855 to 2435359 tid 2 2020-11-16T20:56:12.324 INFO:tasks.rados.rados.0.smithi166.stdout:614: writing smithi16641208-366 from 2848231 to 2974938 tid 3 2020-11-16T20:56:12.324 INFO:tasks.rados.rados.0.smithi166.stdout:609: done (4 left) 2020-11-16T20:56:12.324 INFO:tasks.rados.rados.0.smithi166.stdout:610: done (3 left) 2020-11-16T20:56:12.324 INFO:tasks.rados.rados.0.smithi166.stdout:615: snap_create 2020-11-16T20:56:12.325 INFO:tasks.rados.rados.0.smithi166.stdout:612: expect (ObjNum 141 snap 0 seq_num 141) 2020-11-16T20:56:12.330 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:56:12.387 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:12.392+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:12.408 INFO:tasks.rados.rados.0.smithi166.stdout:613: expect (ObjNum 95 snap 0 seq_num 95) 2020-11-16T20:56:12.452 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:56:12.454 INFO:teuthology.orchestra.run.smithi166.stderr:dumped all 2020-11-16T20:56:12.464 INFO:teuthology.orchestra.run.smithi166.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2020-11-16T20:56:12.022061+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1794456528,"num_objects":677,"num_object_clones":35,"num_object_copies":2031,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":624,"num_whiteouts":13,"num_read":1264,"num_read_kb":132699,"num_write":2366,"num_write_kb":768093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":30,"num_flush_kb":82343,"num_evict":0,"num_evict_kb":0,"num_promote":144,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2162,"ondisk_log_size":2162,"up":81,"acting":81,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3049688,"kb_used_data":2969696,"kb_used_omap":0,"kb_used_meta":71296,"kb_avail":751925032,"statfs":{"total":773094113280,"available":769971232768,"internally_reserved":0,"allocated":3040968704,"data_stored":3083097880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":73007104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17039494,"num_objects":12,"num_object_clones":7,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":2,"num_read":21,"num_read_kb":18391,"num_write":10,"num_write_kb":2707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":7,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.026771"},"pg_stats":[{"pgid":"2.11","version":"0'0","reported_seq":"22","reported_epoch":"43","state":"active+clean","last_fresh":"2020-11-16T20:56:05.991100+0000","last_change":"2020-11-16T20:56:03.679710+0000","last_active":"2020-11-16T20:56:05.991100+0000","last_peered":"2020-11-16T20:56:05.991100+0000","last_clean":"2020-11-16T20:56:05.991100+0000","last_became_active":"2020-11-16T20:55:52.916223+0000","last_became_peered":"2020-11-16T20:55:52.916223+0000","last_unstale":"2020-11-16T20:56:05.991100+0000","last_undegraded":"2020-11-16T20:56:05.991100+0000","last_fullsized":"2020-11-16T20:56:05.991100+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:03.679641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:03.679641+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"22","reported_epoch":"43","state":"active+clean","last_fresh":"2020-11-16T20:56:05.986732+0000","last_change":"2020-11-16T20:55:59.416734+0000","last_active":"2020-11-16T20:56:05.986732+0000","last_peered":"2020-11-16T20:56:05.986732+0000","last_clean":"2020-11-16T20:56:05.986732+0000","last_became_active":"2020-11-16T20:55:52.921860+0000","last_became_peered":"2020-11-16T20:55:52.921860+0000","last_unstale":"2020-11-16T20:56:05.986732+0000","last_undegraded":"2020-11-16T20:56:05.986732+0000","last_fullsized":"2020-11-16T20:56:05.986732+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.416654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.416654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":"22","reported_epoch":"43","state":"active+clean","last_fresh":"2020-11-16T20:56:05.988163+0000","last_change":"2020-11-16T20:55:56.438524+0000","last_active":"2020-11-16T20:56:05.988163+0000","last_peered":"2020-11-16T20:56:05.988163+0000","last_clean":"2020-11-16T20:56:05.988163+0000","last_became_active":"2020-11-16T20:55:52.922023+0000","last_became_peered":"2020-11-16T20:55:52.922023+0000","last_unstale":"2020-11-16T20:56:05.988163+0000","last_undegraded":"2020-11-16T20:56:05.988163+0000","last_fullsized":"2020-11-16T20:56:05.988163+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:56.438428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:56.438428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":"22","reported_epoch":"43","state":"active+clean","last_fresh":"2020-11-16T20:56:05.986860+0000","last_change":"2020-11-16T20:56:04.388573+0000","last_active":"2020-11-16T20:56:05.986860+0000","last_peered":"2020-11-16T20:56:05.986860+0000","last_clean":"2020-11-16T20:56:05.986860+0000","last_became_active":"2020-11-16T20:55:52.921111+0000","last_became_peered":"2020-11-16T20:55:52.921111+0000","last_unstale":"2020-11-16T20:56:05.986860+0000","last_undegraded":"2020-11-16T20:56:05.986860+0000","last_fullsized":"2020-11-16T20:56:05.986860+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:04.388506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:04.388506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"19","reported_epoch":"43","state":"active+clean","last_fresh":"2020-11-16T20:56:06.129620+0000","last_change":"2020-11-16T20:55:52.923475+0000","last_active":"2020-11-16T20:56:06.129620+0000","last_peered":"2020-11-16T20:56:06.129620+0000","last_clean":"2020-11-16T20:56:06.129620+0000","last_became_active":"2020-11-16T20:55:52.922134+0000","last_became_peered":"2020-11-16T20:55:52.922134+0000","last_unstale":"2020-11-16T20:56:06.129620+0000","last_undegraded":"2020-11-16T20:56:06.129620+0000","last_fullsized":"2020-11-16T20:56:06.129620+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:54:54.096603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"22","reported_epoch":"43","state":"active+clean","last_fresh":"2020-11-16T20:56:05.986813+0000","last_change":"2020-11-16T20:56:02.387946+0000","last_active":"2020-11-16T20:56:05.986813+0000","last_peered":"2020-11-16T20:56:05.986813+0000","last_clean":"2020-11-16T20:56:05.986813+0000","last_became_active":"2020-11-16T20:55:52.920496+0000","last_became_peered":"2020-11-16T20:55:52.920496+0000","last_unstale":"2020-11-16T20:56:05.986813+0000","last_undegraded":"2020-11-16T20:56:05.986813+0000","last_fullsized":"2020-11-16T20:56:05.986813+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:02.387861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:02.387861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"48","reported_epoch":"43","state":"active+clean","last_fresh":"2020-11-16T20:56:05.993335+0000","last_change":"2020-11-16T20:56:02.565668+0000","last_active":"2020-11-16T20:56:05.993335+0000","last_peered":"2020-11-16T20:56:05.993335+0000","last_clean":"2020-11-16T20:56:05.993335+0000","last_became_active":"2020-11-16T20:55:52.917496+0000","last_became_peered":"2020-11-16T20:55:52.917496+0000","last_unstale":"2020-11-16T20:56:05.993335+0000","last_undegraded":"2020-11-16T20:56:05.993335+0000","last_fullsized":"2020-11-16T20:56:05.993335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:02.565607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:56:02.565607+0000","last_clean_scrub_stamp":"2020-11-16T20:56:02.565607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"48","reported_epoch":"43","state":"active+clean","last_fresh":"2020-11-16T20:56:06.129553+0000","last_change":"2020-11-16T20:56:01.955760+0000","last_active":"2020-11-16T20:56:06.129553+0000","last_peered":"2020-11-16T20:56:06.129553+0000","last_clean":"2020-11-16T20:56:06.129553+0000","last_became_active":"2020-11-16T20:55:52.922447+0000","last_became_peered":"2020-11-16T20:55:52.922447+0000","last_unstale":"2020-11-16T20:56:06.129553+0000","last_undegraded":"2020-11-16T20:56:06.129553+0000","last_fullsized":"2020-11-16T20:56:06.129553+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:01.955691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:01.955691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"22","reported_epoch":"43","state":"active+clean","last_fresh":"2020-11-16T20:56:06.129540+0000","last_change":"2020-11-16T20:56:00.967620+0000","last_active":"2020-11-16T20:56:06.129540+0000","last_peered":"2020-11-16T20:56:06.129540+0000","last_clean":"2020-11-16T20:56:06.129540+0000","last_became_active":"2020-11-16T20:55:52.926407+0000","last_became_peered":"2020-11-16T20:55:52.926407+0000","last_unstale":"2020-11-16T20:56:06.129540+0000","last_undegraded":"2020-11-16T20:56:06.129540+0000","last_fullsized":"2020-11-16T20:56:06.129540+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:00.967553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:00.967553+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"57","reported_epoch":"43","state":"active+clean","last_fresh":"2020-11-16T20:56:05.992838+0000","last_change":"2020-11-16T20:56:01.528273+0000","last_active":"2020-11-16T20:56:05.992838+0000","last_peered":"2020-11-16T20:56:05.992838+0000","last_clean":"2020-11-16T20:56:05.992838+0000","last_became_active":"2020-11-16T20:55:52.922303+0000","last_became_peered":"2020-11-16T20:55:52.922303+0000","last_unstale":"2020-11-16T20:56:05.992838+0000","last_undegraded":"2020-11-16T20:56:05.992838+0000","last_fullsized":"2020-11-16T20:56:05.992838+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:01.528217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:01.528217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"48","reported_epoch":"43","state":"active+clean","last_fresh":"2020-11-16T20:56:06.129624+0000","last_change":"2020-11-16T20:55:57.905062+0000","last_active":"2020-11-16T20:56:06.129624+0000","last_peered":"2020-11-16T20:56:06.129624+0000","last_clean":"2020-11-16T20:56:06.129624+0000","last_became_active":"2020-11-16T20:55:50.904146+0000","last_became_peered":"2020-11-16T20:55:50.904146+0000","last_unstale":"2020-11-16T20:56:06.129624+0000","last_undegraded":"2020-11-16T20:56:06.129624+0000","last_fullsized":"2020-11-16T20:56:06.129624+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:57.905004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:57.905004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"44'153","reported_seq":"242","reported_epoch":"44","state":"active+clean","last_fresh":"2020-11-16T20:56:07.001264+0000","last_change":"2020-11-16T20:56:07.001657+0000","last_active":"2020-11-16T20:56:07.001264+0000","last_peered":"2020-11-16T20:56:07.001264+0000","last_clean":"2020-11-16T20:56:07.001264+0000","last_became_active":"2020-11-16T20:55:30.828637+0000","last_became_peered":"2020-11-16T20:55:30.828637+0000","last_unstale":"2020-11-16T20:56:07.001264+0000","last_undegraded":"2020-11-16T20:56:07.001264+0000","last_fullsized":"2020-11-16T20:56:07.001264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":153,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":100976852,"num_objects":40,"num_object_clones":4,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":2,"num_read":42,"num_read_kb":38,"num_write":122,"num_write_kb":19773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":17,"num_flush_kb":45407,"num_evict":0,"num_evict_kb":0,"num_promote":38,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"},{"start":"6","length":"1"}]},{"pgid":"2.2","version":"0'0","reported_seq":"49","reported_epoch":"44","state":"active+clean","last_fresh":"2020-11-16T20:56:06.993496+0000","last_change":"2020-11-16T20:55:57.606554+0000","last_active":"2020-11-16T20:56:06.993496+0000","last_peered":"2020-11-16T20:56:06.993496+0000","last_clean":"2020-11-16T20:56:06.993496+0000","last_became_active":"2020-11-16T20:55:50.906585+0000","last_became_peered":"2020-11-16T20:55:50.906585+0000","last_unstale":"2020-11-16T20:56:06.993496+0000","last_undegraded":"2020-11-16T20:56:06.993496+0000","last_fullsized":"2020-11-16T20:56:06.993496+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:57.606500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:57.606500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"44'415","reported_seq":"614","reported_epoch":"44","state":"active+clean","last_fresh":"2020-11-16T20:56:07.040179+0000","last_change":"2020-11-16T20:56:07.040179+0000","last_active":"2020-11-16T20:56:07.040179+0000","last_peered":"2020-11-16T20:56:07.040179+0000","last_clean":"2020-11-16T20:56:07.040179+0000","last_became_active":"2020-11-16T20:55:25.103851+0000","last_became_peered":"2020-11-16T20:55:25.103851+0000","last_unstale":"2020-11-16T20:56:07.040179+0000","last_undegraded":"2020-11-16T20:56:07.040179+0000","last_fullsized":"2020-11-16T20:56:07.040179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":415,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":343539661,"num_objects":131,"num_object_clones":6,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":2,"num_read":256,"num_read_kb":94,"num_write":493,"num_write_kb":169850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"},{"start":"6","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":"48","reported_epoch":"43","state":"active+clean","last_fresh":"2020-11-16T20:56:05.986755+0000","last_change":"2020-11-16T20:55:58.465447+0000","last_active":"2020-11-16T20:56:05.986755+0000","last_peered":"2020-11-16T20:56:05.986755+0000","last_clean":"2020-11-16T20:56:05.986755+0000","last_became_active":"2020-11-16T20:55:50.905925+0000","last_became_peered":"2020-11-16T20:55:50.905925+0000","last_unstale":"2020-11-16T20:56:05.986755+0000","last_undegraded":"2020-11-16T20:56:05.986755+0000","last_fullsized":"2020-11-16T20:56:05.986755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:58.465384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:58.465384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"44'383","reported_seq":"572","reported_epoch":"44","state":"active+clean","last_fresh":"2020-11-16T20:56:06.998648+0000","last_change":"2020-11-16T20:56:06.998973+0000","last_active":"2020-11-16T20:56:06.998648+0000","last_peered":"2020-11-16T20:56:06.998648+0000","last_clean":"2020-11-16T20:56:06.998648+0000","last_became_active":"2020-11-16T20:55:25.103928+0000","last_became_peered":"2020-11-16T20:55:25.103928+0000","last_unstale":"2020-11-16T20:56:06.998648+0000","last_undegraded":"2020-11-16T20:56:06.998648+0000","last_fullsized":"2020-11-16T20:56:06.998648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":383,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":326859545,"num_objects":121,"num_object_clones":2,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":1,"num_read":239,"num_read_kb":88,"num_write":469,"num_write_kb":156106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"},{"start":"6","length":"1"}]},{"pgid":"2.3","version":"0'0","reported_seq":"49","reported_epoch":"44","state":"active+clean","last_fresh":"2020-11-16T20:56:06.992434+0000","last_change":"2020-11-16T20:55:59.611811+0000","last_active":"2020-11-16T20:56:06.992434+0000","last_peered":"2020-11-16T20:56:06.992434+0000","last_clean":"2020-11-16T20:56:06.992434+0000","last_became_active":"2020-11-16T20:55:50.903578+0000","last_became_peered":"2020-11-16T20:55:50.903578+0000","last_unstale":"2020-11-16T20:56:06.992434+0000","last_undegraded":"2020-11-16T20:56:06.992434+0000","last_fullsized":"2020-11-16T20:56:06.992434+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.611727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.611727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"44","reported_epoch":"43","state":"active+clean","last_fresh":"2020-11-16T20:56:05.992966+0000","last_change":"2020-11-16T20:56:03.542304+0000","last_active":"2020-11-16T20:56:05.992966+0000","last_peered":"2020-11-16T20:56:05.992966+0000","last_clean":"2020-11-16T20:56:05.992966+0000","last_became_active":"2020-11-16T20:54:53.112038+0000","last_became_peered":"2020-11-16T20:54:53.112038+0000","last_unstale":"2020-11-16T20:56:05.992966+0000","last_undegraded":"2020-11-16T20:56:05.992966+0000","last_fullsized":"2020-11-16T20:56:05.992966+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'2","last_scrub_stamp":"2020-11-16T20:56:03.542235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:50.068882+0000","last_clean_scrub_stamp":"2020-11-16T20:56:03.542235+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"44'411","reported_seq":"610","reported_epoch":"44","state":"active+clean","last_fresh":"2020-11-16T20:56:07.033535+0000","last_change":"2020-11-16T20:56:07.033827+0000","last_active":"2020-11-16T20:56:07.033535+0000","last_peered":"2020-11-16T20:56:07.033535+0000","last_clean":"2020-11-16T20:56:07.033535+0000","last_became_active":"2020-11-16T20:55:25.106302+0000","last_became_peered":"2020-11-16T20:55:25.106302+0000","last_unstale":"2020-11-16T20:56:07.033535+0000","last_undegraded":"2020-11-16T20:56:07.033535+0000","last_fullsized":"2020-11-16T20:56:07.033535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":411,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":340518337,"num_objects":129,"num_object_clones":10,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":3,"num_read":278,"num_read_kb":43657,"num_write":468,"num_write_kb":195618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"},{"start":"6","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":"49","reported_epoch":"43","state":"active+clean","last_fresh":"2020-11-16T20:56:05.993065+0000","last_change":"2020-11-16T20:55:56.657297+0000","last_active":"2020-11-16T20:56:05.993065+0000","last_peered":"2020-11-16T20:56:05.993065+0000","last_clean":"2020-11-16T20:56:05.993065+0000","last_became_active":"2020-11-16T20:55:50.908710+0000","last_became_peered":"2020-11-16T20:55:50.908710+0000","last_unstale":"2020-11-16T20:56:05.993065+0000","last_undegraded":"2020-11-16T20:56:05.993065+0000","last_fullsized":"2020-11-16T20:56:05.993065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:56.657242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:56.657242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"45'491","reported_seq":"715","reported_epoch":"45","state":"active+clean","last_fresh":"2020-11-16T20:56:08.035100+0000","last_change":"2020-11-16T20:56:08.035376+0000","last_active":"2020-11-16T20:56:08.035100+0000","last_peered":"2020-11-16T20:56:08.035100+0000","last_clean":"2020-11-16T20:56:08.035100+0000","last_became_active":"2020-11-16T20:55:24.802649+0000","last_became_peered":"2020-11-16T20:55:24.802649+0000","last_unstale":"2020-11-16T20:56:08.035100+0000","last_undegraded":"2020-11-16T20:56:08.035100+0000","last_fullsized":"2020-11-16T20:56:08.035100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":491,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":390767819,"num_objects":145,"num_object_clones":8,"num_object_copies":435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":3,"num_read":321,"num_read_kb":46396,"num_write":561,"num_write_kb":186884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"2"},{"start":"6","length":"1"}]},{"pgid":"4.3","version":"45'116","reported_seq":"205","reported_epoch":"45","state":"active+clean","last_fresh":"2020-11-16T20:56:08.056015+0000","last_change":"2020-11-16T20:56:08.008510+0000","last_active":"2020-11-16T20:56:08.056015+0000","last_peered":"2020-11-16T20:56:08.056015+0000","last_clean":"2020-11-16T20:56:08.056015+0000","last_became_active":"2020-11-16T20:55:30.829833+0000","last_became_peered":"2020-11-16T20:55:30.829833+0000","last_unstale":"2020-11-16T20:56:08.056015+0000","last_undegraded":"2020-11-16T20:56:08.056015+0000","last_fullsized":"2020-11-16T20:56:08.056015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":116,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104345348,"num_objects":40,"num_object_clones":3,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":46,"num_read_kb":18423,"num_write":89,"num_write_kb":14020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":6,"num_flush_kb":16876,"num_evict":0,"num_evict_kb":0,"num_promote":39,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"2"},{"start":"6","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":"49","reported_epoch":"43","state":"active+clean","last_fresh":"2020-11-16T20:56:05.993016+0000","last_change":"2020-11-16T20:55:59.571968+0000","last_active":"2020-11-16T20:56:05.993016+0000","last_peered":"2020-11-16T20:56:05.993016+0000","last_clean":"2020-11-16T20:56:05.993016+0000","last_became_active":"2020-11-16T20:55:50.901014+0000","last_became_peered":"2020-11-16T20:55:50.901014+0000","last_unstale":"2020-11-16T20:56:05.993016+0000","last_undegraded":"2020-11-16T20:56:05.993016+0000","last_fullsized":"2020-11-16T20:56:05.993016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.571892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.571892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"48","reported_epoch":"43","state":"active+clean","last_fresh":"2020-11-16T20:56:06.129650+0000","last_change":"2020-11-16T20:55:59.950321+0000","last_active":"2020-11-16T20:56:06.129650+0000","last_peered":"2020-11-16T20:56:06.129650+0000","last_clean":"2020-11-16T20:56:06.129650+0000","last_became_active":"2020-11-16T20:55:50.905408+0000","last_became_peered":"2020-11-16T20:55:50.905408+0000","last_unstale":"2020-11-16T20:56:06.129650+0000","last_undegraded":"2020-11-16T20:56:06.129650+0000","last_fullsized":"2020-11-16T20:56:06.129650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.950219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.950219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"44'89","reported_seq":"164","reported_epoch":"44","state":"active+clean","last_fresh":"2020-11-16T20:56:07.014211+0000","last_change":"2020-11-16T20:56:07.007488+0000","last_active":"2020-11-16T20:56:07.014211+0000","last_peered":"2020-11-16T20:56:07.014211+0000","last_clean":"2020-11-16T20:56:07.014211+0000","last_became_active":"2020-11-16T20:55:30.827526+0000","last_became_peered":"2020-11-16T20:55:30.827526+0000","last_unstale":"2020-11-16T20:56:07.014211+0000","last_undegraded":"2020-11-16T20:56:07.014211+0000","last_fullsized":"2020-11-16T20:56:07.014211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":89,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":87732738,"num_objects":33,"num_object_clones":1,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":39,"num_read_kb":9194,"num_write":75,"num_write_kb":11364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":3,"num_flush_kb":9521,"num_evict":0,"num_evict_kb":0,"num_promote":32,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"},{"start":"6","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":"48","reported_epoch":"43","state":"active+clean","last_fresh":"2020-11-16T20:56:05.991364+0000","last_change":"2020-11-16T20:55:59.645073+0000","last_active":"2020-11-16T20:56:05.991364+0000","last_peered":"2020-11-16T20:56:05.991364+0000","last_clean":"2020-11-16T20:56:05.991364+0000","last_became_active":"2020-11-16T20:55:50.905649+0000","last_became_peered":"2020-11-16T20:55:50.905649+0000","last_unstale":"2020-11-16T20:56:05.991364+0000","last_undegraded":"2020-11-16T20:56:05.991364+0000","last_fullsized":"2020-11-16T20:56:05.991364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.644996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.644996+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"44'102","reported_seq":"180","reported_epoch":"44","state":"active+clean","last_fresh":"2020-11-16T20:56:07.033187+0000","last_change":"2020-11-16T20:56:07.002355+0000","last_active":"2020-11-16T20:56:07.033187+0000","last_peered":"2020-11-16T20:56:07.033187+0000","last_clean":"2020-11-16T20:56:07.033187+0000","last_became_active":"2020-11-16T20:55:31.120583+0000","last_became_peered":"2020-11-16T20:55:31.120583+0000","last_unstale":"2020-11-16T20:56:07.033187+0000","last_undegraded":"2020-11-16T20:56:07.033187+0000","last_fullsized":"2020-11-16T20:56:07.033187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":102,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":99716228,"num_objects":36,"num_object_clones":1,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":2,"num_read":43,"num_read_kb":14809,"num_write":87,"num_write_kb":14468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":4,"num_flush_kb":10539,"num_evict":0,"num_evict_kb":0,"num_promote":35,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"},{"start":"6","length":"1"}]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":392771166,"num_objects":149,"num_object_clones":9,"num_object_copies":447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":4,"num_read":170,"num_read_kb":42464,"num_write":373,"num_write_kb":59625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":30,"num_flush_kb":82343,"num_evict":0,"num_evict_kb":0,"num_promote":144,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":938610688,"data_stored":973566902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":460,"ondisk_log_size":460,"up":12,"acting":12,"num_store_stats":7},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":1401685362,"num_objects":526,"num_object_clones":26,"num_object_copies":1578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":526,"num_whiteouts":9,"num_read":1094,"num_read_kb":90235,"num_write":1991,"num_write_kb":708458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2121641984,"data_stored":2136040919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1700,"ondisk_log_size":1700,"up":12,"acting":12,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":18,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150032,"kb_used_data":144328,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":94221808,"statfs":{"total":96636764160,"available":96483131392,"internally_reserved":0,"allocated":147791872,"data_stored":153636661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.98499999999999999}]},{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.1919999999999999}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.085},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.1699999999999999}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.107},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.2529999999999999}]},{"osd":4,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.96699999999999997}]},{"osd":5,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":1.0580000000000001}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.3799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":592300,"kb_used_data":579024,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":93779540,"statfs":{"total":96636764160,"available":96030248960,"internally_reserved":0,"allocated":592920576,"data_stored":596261423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.94799999999999995}]},{"osd":1,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":1.095}]},{"osd":2,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.212},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.98699999999999999}]},{"osd":3,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.369},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.133}]},{"osd":4,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.4910000000000001}]},{"osd":5,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.755},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.157}]},{"osd":7,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.0029999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":238112,"kb_used_data":230384,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":94133728,"statfs":{"total":96636764160,"available":96392937472,"internally_reserved":0,"allocated":235913216,"data_stored":235799209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.437},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.47999999999999998}]},{"osd":2,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.64700000000000002}]},{"osd":3,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.677,"5min":2.677,"15min":2.677},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.57599999999999996}]},{"osd":4,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.96699999999999997}]},{"osd":5,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.0700000000000001}]},{"osd":6,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.024}]},{"osd":7,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"max":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":1},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.91100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":513084,"kb_used_data":501428,"kb_used_omap":0,"kb_used_meta":11648,"kb_avail":93858756,"statfs":{"total":96636764160,"available":96111366144,"internally_reserved":0,"allocated":513462272,"data_stored":526290857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11927552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.84599999999999997}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.62}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.81299999999999994}]},{"osd":4,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.86599999999999999}]},{"osd":5,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.0589999999999999}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":1.0720000000000001}]},{"osd":7,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"max":{"1min":1.954,"5min":1.954,"15min":1.954},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":0.97799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160376,"kb_used_data":154544,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":94211464,"statfs":{"total":96636764160,"available":96472539136,"internally_reserved":0,"allocated":158253056,"data_stored":156863110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.624},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.754}]},{"osd":3,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.56899999999999995}]},{"osd":4,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.0269999999999999}]},{"osd":5,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.131}]},{"osd":6,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.93300000000000005}]},{"osd":7,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.91600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":450944,"kb_used_data":439672,"kb_used_omap":0,"kb_used_meta":11264,"kb_avail":93920896,"statfs":{"total":96636764160,"available":96174997504,"internally_reserved":0,"allocated":450224128,"data_stored":455624607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11534336},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.629},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.81499999999999995}]},{"osd":1,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.76900000000000002}]},{"osd":2,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.84299999999999997}]},{"osd":4,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.923,"5min":2.923,"15min":2.923},"last":1.115},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.968,"5min":2.968,"15min":2.968},"last":0.874}]},{"osd":5,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.8479999999999999,"5min":2.8479999999999999,"15min":2.8479999999999999},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.92400000000000004}]},{"osd":6,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.859,"5min":2.859,"15min":2.859},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":3.5390000000000001,"5min":3.5390000000000001,"15min":3.5390000000000001},"last":1.026}]},{"osd":7,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.9780000000000002,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":1.252}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":515652,"kb_used_data":501248,"kb_used_omap":0,"kb_used_meta":11648,"kb_avail":93856188,"statfs":{"total":96636764160,"available":96108736512,"internally_reserved":0,"allocated":513277952,"data_stored":518121648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11927552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.0549999999999999}]},{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.61499999999999999}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":1.222}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.113}]},{"osd":5,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.194}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.181},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.357}]},{"osd":7,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":2.4369999999999998,"5min":2.4369999999999998,"15min":2.4369999999999998},"last":1.319},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.2609999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":429188,"kb_used_data":419068,"kb_used_omap":0,"kb_used_meta":6976,"kb_avail":93942652,"statfs":{"total":96636764160,"available":96197275648,"internally_reserved":0,"allocated":429125632,"data_stored":440500365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7143424},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.89900000000000002}]},{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.55500000000000005}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.76100000000000001}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.026},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.86899999999999999}]},{"osd":4,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.141},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.65300000000000002}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.202}]},{"osd":7,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":1.107,"5min":1.107,"15min":1.107},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.98599999999999999}]}]}]}} 2020-11-16T20:56:12.467 INFO:tasks.thrashosds.thrasher:Setting 4.1 to [7, 4, 1, 6, 5, 3] 2020-11-16T20:56:12.467 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.1', '7', '4', '1', '6', '5', '3'] 2020-11-16T20:56:12.467 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.1 7 4 1 6 5 3 2020-11-16T20:56:12.488 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:12.493+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:12.507 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:12.507 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:12.516 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:56:12.521 INFO:tasks.rados.rados.0.smithi166.stdout:614: finishing write tid 1 to smithi16641208-366 2020-11-16T20:56:12.522 INFO:tasks.rados.rados.0.smithi166.stdout:614: finishing write tid 2 to smithi16641208-366 2020-11-16T20:56:12.522 INFO:tasks.rados.rados.0.smithi166.stdout:614: finishing write tid 3 to smithi16641208-366 2020-11-16T20:56:12.522 INFO:tasks.rados.rados.0.smithi166.stdout:614: finishing write tid 4 to smithi16641208-366 2020-11-16T20:56:12.522 INFO:tasks.rados.rados.0.smithi166.stdout:614: finishing write tid 5 to smithi16641208-366 2020-11-16T20:56:12.522 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 366 v 457 (ObjNum 534 snap 9 seq_num 534) dirty exists 2020-11-16T20:56:12.522 INFO:tasks.rados.rados.0.smithi166.stdout:614: left oid 366 (ObjNum 534 snap 9 seq_num 534) 2020-11-16T20:56:12.589 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:12.594+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:12.690 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:12.695+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:12.691 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:12.691 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:12.701 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:56:12.791 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:12.796+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:12.830 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:12.830 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:12.839 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:56:12.924 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:12.929+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:12.966 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:56:13.009 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:13.010 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:13.010 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:13.015+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:13.020 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:56:13.025 INFO:tasks.rados.rados.0.smithi166.stdout:612: done (3 left) 2020-11-16T20:56:13.025 INFO:tasks.rados.rados.0.smithi166.stdout:613: done (2 left) 2020-11-16T20:56:13.025 INFO:tasks.rados.rados.0.smithi166.stdout:614: done (1 left) 2020-11-16T20:56:13.025 INFO:tasks.rados.rados.0.smithi166.stdout:615: done (0 left) 2020-11-16T20:56:13.026 INFO:tasks.rados.rados.0.smithi166.stdout:616: snap_remove snap 5 2020-11-16T20:56:13.027 INFO:teuthology.orchestra.run.smithi166.stderr:set 4.1 pg_upmap_items mapping to [7->4,1->6,5->3] 2020-11-16T20:56:13.032 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2020-11-16T20:56:13.122 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:13.127+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:13.124 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:56:13.146 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:56:13.166 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:56:13.169 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:13.169 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:56:13.169 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:56:13.169 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:56:13.169 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.169 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:18 4.3 4:d8946fd6:::smithi16641208-5:head [write 1717575~349653] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:56:13.170 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:50.958077+0000", 2020-11-16T20:56:13.170 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 22.213956558, 2020-11-16T20:56:13.170 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019792713999999999, 2020-11-16T20:56:13.170 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.170 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:13.170 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.171 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.171 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.171 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 18 2020-11-16T20:56:13.171 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.171 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.171 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.171 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.171 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958077+0000", 2020-11-16T20:56:13.172 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.172 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.172 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.172 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.172 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958077+0000", 2020-11-16T20:56:13.172 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000115425 2020-11-16T20:56:13.172 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.173 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.173 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.173 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958193+0000", 2020-11-16T20:56:13.173 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9710000000000001e-06 2020-11-16T20:56:13.173 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.173 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.173 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.173 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958199+0000", 2020-11-16T20:56:13.174 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2489e-05 2020-11-16T20:56:13.174 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.174 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.174 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.174 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958211+0000", 2020-11-16T20:56:13.174 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7489999999999998e-06 2020-11-16T20:56:13.174 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.175 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.175 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.175 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958216+0000", 2020-11-16T20:56:13.175 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9798000000000001e-05 2020-11-16T20:56:13.175 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.175 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.175 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.176 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958256+0000", 2020-11-16T20:56:13.176 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4114999999999999e-05 2020-11-16T20:56:13.176 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.176 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.176 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.176 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958310+0000", 2020-11-16T20:56:13.176 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0083851729999999992 2020-11-16T20:56:13.176 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.177 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.177 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.177 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.966695+0000", 2020-11-16T20:56:13.177 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1750999999999996e-05 2020-11-16T20:56:13.177 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.177 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.177 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.177 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.966787+0000", 2020-11-16T20:56:13.178 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014934400000000001 2020-11-16T20:56:13.178 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.178 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.178 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:56:13.178 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.966936+0000", 2020-11-16T20:56:13.178 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0015362729999999999 2020-11-16T20:56:13.178 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.179 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.179 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:13.179 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.968472+0000", 2020-11-16T20:56:13.179 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0087044050000000001 2020-11-16T20:56:13.179 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.179 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.179 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.179 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.977177+0000", 2020-11-16T20:56:13.180 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000539311 2020-11-16T20:56:13.180 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.180 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.180 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.180 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.977716+0000", 2020-11-16T20:56:13.180 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.0599999999999994e-05 2020-11-16T20:56:13.180 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.181 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.181 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:13.181 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.977797+0000", 2020-11-16T20:56:13.181 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3310000000000001e-05 2020-11-16T20:56:13.181 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.181 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.181 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.181 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.977870+0000", 2020-11-16T20:56:13.182 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019792713999999999 2020-11-16T20:56:13.182 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.182 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.182 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.182 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.182 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.182 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:19 4.3 4:d8946fd6:::smithi16641208-5:head [setxattr _header (55) in=7b,truncate 2067228] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:56:13.183 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:50.958258+0000", 2020-11-16T20:56:13.183 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 22.213776093, 2020-11-16T20:56:13.183 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019802436, 2020-11-16T20:56:13.183 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.183 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:13.183 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.183 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.183 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.184 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 19 2020-11-16T20:56:13.184 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.184 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.184 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.184 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.184 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958258+0000", 2020-11-16T20:56:13.184 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.185 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.185 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.185 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.185 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958258+0000", 2020-11-16T20:56:13.185 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2262000000000003e-05 2020-11-16T20:56:13.185 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.185 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.185 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.186 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958300+0000", 2020-11-16T20:56:13.186 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0206e-05 2020-11-16T20:56:13.186 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.186 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.186 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.186 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958310+0000", 2020-11-16T20:56:13.186 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.4520000000000003e-06 2020-11-16T20:56:13.187 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.187 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.187 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.187 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958320+0000", 2020-11-16T20:56:13.187 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1749999999999998e-06 2020-11-16T20:56:13.187 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.187 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.187 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.188 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958324+0000", 2020-11-16T20:56:13.188 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0672e-05 2020-11-16T20:56:13.188 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.188 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.188 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.188 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958354+0000", 2020-11-16T20:56:13.188 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3983999999999999e-05 2020-11-16T20:56:13.189 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.189 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.189 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.189 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958388+0000", 2020-11-16T20:56:13.189 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0095662669999999998 2020-11-16T20:56:13.189 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.189 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.189 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.190 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.967955+0000", 2020-11-16T20:56:13.190 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010241199999999999 2020-11-16T20:56:13.190 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.190 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.190 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.190 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.968057+0000", 2020-11-16T20:56:13.190 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010603399999999999 2020-11-16T20:56:13.191 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.191 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.191 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:56:13.191 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.968163+0000", 2020-11-16T20:56:13.191 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045006899999999999 2020-11-16T20:56:13.191 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.191 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.191 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:13.192 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.968613+0000", 2020-11-16T20:56:13.192 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0086477959999999993 2020-11-16T20:56:13.192 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.192 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.192 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.192 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.977261+0000", 2020-11-16T20:56:13.192 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00066711699999999995 2020-11-16T20:56:13.192 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.193 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.193 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.193 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.977928+0000", 2020-11-16T20:56:13.193 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3701000000000005e-05 2020-11-16T20:56:13.193 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.193 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.193 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:13.194 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.978002+0000", 2020-11-16T20:56:13.194 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8288999999999997e-05 2020-11-16T20:56:13.194 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.194 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.194 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.194 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.978060+0000", 2020-11-16T20:56:13.194 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019802436 2020-11-16T20:56:13.195 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.195 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.195 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.195 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.195 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.195 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:20 4.3 4:d8946fd6:::smithi16641208-5:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:56:13.195 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:50.958352+0000", 2020-11-16T20:56:13.195 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 22.213681941000001, 2020-11-16T20:56:13.196 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020323929000000001, 2020-11-16T20:56:13.196 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.196 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:13.196 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.196 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.196 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.196 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 20 2020-11-16T20:56:13.197 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.197 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.197 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.197 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.197 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958352+0000", 2020-11-16T20:56:13.197 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.197 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.197 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.198 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.198 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958352+0000", 2020-11-16T20:56:13.198 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7867999999999999e-05 2020-11-16T20:56:13.198 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.198 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.198 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.198 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958370+0000", 2020-11-16T20:56:13.199 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.895e-06 2020-11-16T20:56:13.199 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.199 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.199 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.199 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958374+0000", 2020-11-16T20:56:13.199 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4629999999999998e-06 2020-11-16T20:56:13.199 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.199 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.200 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.200 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958380+0000", 2020-11-16T20:56:13.200 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6400000000000001e-06 2020-11-16T20:56:13.200 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.200 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.200 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.200 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958383+0000", 2020-11-16T20:56:13.200 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.879e-05 2020-11-16T20:56:13.201 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.201 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.201 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.201 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958412+0000", 2020-11-16T20:56:13.201 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5111000000000002e-05 2020-11-16T20:56:13.201 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.201 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.202 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.202 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.958457+0000", 2020-11-16T20:56:13.202 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0099396320000000003 2020-11-16T20:56:13.202 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.202 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.202 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.202 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.968396+0000", 2020-11-16T20:56:13.202 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3598999999999999e-05 2020-11-16T20:56:13.203 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.203 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.203 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:13.203 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.968460+0000", 2020-11-16T20:56:13.203 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0096448909999999992 2020-11-16T20:56:13.203 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.203 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.204 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.204 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.978105+0000", 2020-11-16T20:56:13.204 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011328999999999999 2020-11-16T20:56:13.204 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.204 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.204 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.204 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.978218+0000", 2020-11-16T20:56:13.204 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045774999999999999 2020-11-16T20:56:13.205 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.205 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.205 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.205 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.978676+0000", 2020-11-16T20:56:13.205 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020323929000000001 2020-11-16T20:56:13.205 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.205 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.206 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.206 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.206 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.206 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:22 4.3 4:fc3a32b3:::smithi16641208-6:head [write 2059704~24331] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:56:13.206 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:50.969667+0000", 2020-11-16T20:56:13.206 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 22.202366640000001, 2020-11-16T20:56:13.206 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022958137, 2020-11-16T20:56:13.206 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.207 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:13.207 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.207 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.207 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.207 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 22 2020-11-16T20:56:13.207 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.207 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.208 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.208 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.208 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969667+0000", 2020-11-16T20:56:13.208 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.208 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.208 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.208 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.208 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969667+0000", 2020-11-16T20:56:13.209 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9085999999999998e-05 2020-11-16T20:56:13.209 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.209 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.209 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.209 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969706+0000", 2020-11-16T20:56:13.209 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.994e-06 2020-11-16T20:56:13.209 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.209 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.210 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.210 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969711+0000", 2020-11-16T20:56:13.210 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6490000000000008e-06 2020-11-16T20:56:13.210 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.210 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.210 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.210 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969719+0000", 2020-11-16T20:56:13.211 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4499999999999997e-06 2020-11-16T20:56:13.211 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.211 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.211 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.211 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969723+0000", 2020-11-16T20:56:13.211 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2823e-05 2020-11-16T20:56:13.211 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.211 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.212 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.212 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969766+0000", 2020-11-16T20:56:13.212 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6242999999999996e-05 2020-11-16T20:56:13.212 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.212 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.212 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.212 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969832+0000", 2020-11-16T20:56:13.213 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012406587 2020-11-16T20:56:13.213 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.213 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.213 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.213 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.982239+0000", 2020-11-16T20:56:13.213 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.0938000000000003e-05 2020-11-16T20:56:13.213 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.213 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.214 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.214 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.982320+0000", 2020-11-16T20:56:13.214 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011629 2020-11-16T20:56:13.214 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.214 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.214 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:56:13.214 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.982436+0000", 2020-11-16T20:56:13.215 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0013140879999999999 2020-11-16T20:56:13.215 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.215 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.215 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:13.215 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.983750+0000", 2020-11-16T20:56:13.215 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0087830349999999998 2020-11-16T20:56:13.215 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.215 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.216 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.216 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.992533+0000", 2020-11-16T20:56:13.216 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2541999999999999e-05 2020-11-16T20:56:13.216 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.216 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.216 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.216 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.992556+0000", 2020-11-16T20:56:13.216 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1795999999999998e-05 2020-11-16T20:56:13.217 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.217 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.217 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:13.217 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.992598+0000", 2020-11-16T20:56:13.217 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7616000000000001e-05 2020-11-16T20:56:13.217 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.217 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.218 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.218 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.992625+0000", 2020-11-16T20:56:13.218 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022958137 2020-11-16T20:56:13.218 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.218 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.218 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.218 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.218 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.219 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:23 4.3 4:fc3a32b3:::smithi16641208-6:head [setxattr _header (55) in=7b,truncate 2084035] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:56:13.219 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:50.969748+0000", 2020-11-16T20:56:13.219 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 22.202285705000001, 2020-11-16T20:56:13.219 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023094956999999999, 2020-11-16T20:56:13.219 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.219 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:13.219 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.220 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.220 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.220 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 23 2020-11-16T20:56:13.220 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.220 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.220 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.220 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.220 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969748+0000", 2020-11-16T20:56:13.221 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.221 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.221 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.221 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.221 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969748+0000", 2020-11-16T20:56:13.221 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1563e-05 2020-11-16T20:56:13.221 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.222 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.222 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.222 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969770+0000", 2020-11-16T20:56:13.222 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.155e-06 2020-11-16T20:56:13.222 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.222 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.222 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.222 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969774+0000", 2020-11-16T20:56:13.223 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.502e-06 2020-11-16T20:56:13.223 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.223 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.223 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.223 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969779+0000", 2020-11-16T20:56:13.223 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8930000000000001e-06 2020-11-16T20:56:13.223 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.224 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.224 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.224 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969782+0000", 2020-11-16T20:56:13.224 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6954999999999998e-05 2020-11-16T20:56:13.224 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.224 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.224 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.224 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969859+0000", 2020-11-16T20:56:13.225 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9341e-05 2020-11-16T20:56:13.225 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.225 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.225 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.225 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969919+0000", 2020-11-16T20:56:13.225 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013171852 2020-11-16T20:56:13.225 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.225 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.226 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.226 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.983090+0000", 2020-11-16T20:56:13.226 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8386000000000005e-05 2020-11-16T20:56:13.226 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.226 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.226 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.226 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.983169+0000", 2020-11-16T20:56:13.227 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013316599999999999 2020-11-16T20:56:13.227 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.227 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.227 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:56:13.227 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.983302+0000", 2020-11-16T20:56:13.227 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045381300000000001 2020-11-16T20:56:13.227 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.227 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.228 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:13.228 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.983756+0000", 2020-11-16T20:56:13.228 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0089264610000000001 2020-11-16T20:56:13.228 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.228 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.228 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.228 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.992682+0000", 2020-11-16T20:56:13.229 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8300000000000003e-05 2020-11-16T20:56:13.229 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.229 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.229 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.229 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.992721+0000", 2020-11-16T20:56:13.229 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0717999999999997e-05 2020-11-16T20:56:13.229 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.229 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.230 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:13.230 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.992781+0000", 2020-11-16T20:56:13.230 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1852000000000003e-05 2020-11-16T20:56:13.230 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.230 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.230 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.230 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.992843+0000", 2020-11-16T20:56:13.231 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023094956999999999 2020-11-16T20:56:13.231 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.231 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.231 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.231 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.231 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.231 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:24 4.3 4:fc3a32b3:::smithi16641208-6:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:56:13.232 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:50.969800+0000", 2020-11-16T20:56:13.232 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 22.202234065999999, 2020-11-16T20:56:13.232 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023518638000000001, 2020-11-16T20:56:13.232 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.232 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:13.232 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.232 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.232 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.233 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 24 2020-11-16T20:56:13.233 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.233 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.233 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.233 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.233 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969800+0000", 2020-11-16T20:56:13.233 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.234 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.234 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.234 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.234 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969800+0000", 2020-11-16T20:56:13.234 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5668999999999999e-05 2020-11-16T20:56:13.234 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.234 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.234 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.235 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969815+0000", 2020-11-16T20:56:13.235 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7439999999999999e-06 2020-11-16T20:56:13.235 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.235 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.235 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.235 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969818+0000", 2020-11-16T20:56:13.235 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3100000000000001e-06 2020-11-16T20:56:13.236 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.236 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.236 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.236 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969826+0000", 2020-11-16T20:56:13.236 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.514e-06 2020-11-16T20:56:13.236 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.236 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.236 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.237 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969829+0000", 2020-11-16T20:56:13.237 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000115017 2020-11-16T20:56:13.237 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.237 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.237 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.237 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969944+0000", 2020-11-16T20:56:13.237 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7790000000000002e-05 2020-11-16T20:56:13.237 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.238 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.238 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.238 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969992+0000", 2020-11-16T20:56:13.238 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013548503 2020-11-16T20:56:13.238 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.238 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.238 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.239 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.983540+0000", 2020-11-16T20:56:13.239 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4671000000000003e-05 2020-11-16T20:56:13.239 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.239 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.239 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:13.239 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.983625+0000", 2020-11-16T20:56:13.239 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092540999999999995 2020-11-16T20:56:13.239 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.240 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.240 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.240 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.992879+0000", 2020-11-16T20:56:13.240 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012690499999999999 2020-11-16T20:56:13.240 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.240 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.240 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.241 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.993006+0000", 2020-11-16T20:56:13.241 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00031241500000000002 2020-11-16T20:56:13.241 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.241 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.241 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.241 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.993318+0000", 2020-11-16T20:56:13.241 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023518638000000001 2020-11-16T20:56:13.241 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.242 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.242 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.242 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.242 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.242 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:39 4.3 4:d775beee:::smithi16641208-10:head [setxattr _header (56) in=7b,truncate 2151263] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:56:13.242 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.018400+0000", 2020-11-16T20:56:13.242 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 22.153633973000002, 2020-11-16T20:56:13.243 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019533334999999999, 2020-11-16T20:56:13.243 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.243 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:13.243 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.243 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.243 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.243 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 39 2020-11-16T20:56:13.243 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.244 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.244 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.244 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.244 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.018400+0000", 2020-11-16T20:56:13.244 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.244 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.244 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.245 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.245 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.018400+0000", 2020-11-16T20:56:13.245 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1831e-05 2020-11-16T20:56:13.245 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.245 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.245 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.245 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.018442+0000", 2020-11-16T20:56:13.245 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4010000000000002e-06 2020-11-16T20:56:13.246 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.246 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.246 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.246 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.018448+0000", 2020-11-16T20:56:13.246 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.7610000000000002e-06 2020-11-16T20:56:13.246 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.246 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.247 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.247 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.018458+0000", 2020-11-16T20:56:13.247 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.797e-06 2020-11-16T20:56:13.247 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.247 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.247 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.247 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.018463+0000", 2020-11-16T20:56:13.247 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3118999999999999e-05 2020-11-16T20:56:13.248 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.248 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.248 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.248 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.018496+0000", 2020-11-16T20:56:13.248 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7179999999999999e-05 2020-11-16T20:56:13.248 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.248 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.249 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.249 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.018543+0000", 2020-11-16T20:56:13.249 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011545496000000001 2020-11-16T20:56:13.249 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.249 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.249 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.249 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.030088+0000", 2020-11-16T20:56:13.249 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012190599999999999 2020-11-16T20:56:13.250 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.250 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.250 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.250 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.030210+0000", 2020-11-16T20:56:13.250 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016386699999999999 2020-11-16T20:56:13.250 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.250 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.250 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:56:13.251 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.030374+0000", 2020-11-16T20:56:13.251 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00075755600000000005 2020-11-16T20:56:13.251 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.251 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.251 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:13.251 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.031132+0000", 2020-11-16T20:56:13.251 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0064089730000000001 2020-11-16T20:56:13.252 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.252 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.252 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.252 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.037541+0000", 2020-11-16T20:56:13.252 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000262391 2020-11-16T20:56:13.252 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.252 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.252 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.253 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.037803+0000", 2020-11-16T20:56:13.253 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4414999999999999e-05 2020-11-16T20:56:13.253 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.253 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.253 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:13.253 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.037868+0000", 2020-11-16T20:56:13.253 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5642000000000006e-05 2020-11-16T20:56:13.254 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.254 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.254 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.254 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.037933+0000", 2020-11-16T20:56:13.254 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019533334999999999 2020-11-16T20:56:13.254 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.254 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.254 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.255 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.255 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.255 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:40 4.3 4:d775beee:::smithi16641208-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:56:13.255 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.018504+0000", 2020-11-16T20:56:13.255 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 22.153529771999999, 2020-11-16T20:56:13.255 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020430296000000001, 2020-11-16T20:56:13.255 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.256 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:13.256 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.256 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.256 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.256 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 40 2020-11-16T20:56:13.256 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.256 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.256 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.257 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.257 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.018504+0000", 2020-11-16T20:56:13.257 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.257 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.257 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.257 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.257 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.018504+0000", 2020-11-16T20:56:13.257 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1136999999999997e-05 2020-11-16T20:56:13.258 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.258 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.258 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.258 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.018535+0000", 2020-11-16T20:56:13.258 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5710000000000003e-06 2020-11-16T20:56:13.258 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.258 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.259 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.259 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.018542+0000", 2020-11-16T20:56:13.259 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1749000000000001e-05 2020-11-16T20:56:13.259 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.259 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.259 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.259 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.018554+0000", 2020-11-16T20:56:13.259 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1990000000000002e-06 2020-11-16T20:56:13.260 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.260 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.260 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.260 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.018557+0000", 2020-11-16T20:56:13.260 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7719e-05 2020-11-16T20:56:13.260 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.260 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.261 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.261 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.018584+0000", 2020-11-16T20:56:13.261 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9153e-05 2020-11-16T20:56:13.261 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.261 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.261 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.261 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.018614+0000", 2020-11-16T20:56:13.261 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012035171000000001 2020-11-16T20:56:13.262 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.262 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.262 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.262 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.030649+0000", 2020-11-16T20:56:13.262 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013793599999999999 2020-11-16T20:56:13.262 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.262 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.263 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:13.263 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.030787+0000", 2020-11-16T20:56:13.263 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0071838179999999998 2020-11-16T20:56:13.263 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.263 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.263 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.263 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.037971+0000", 2020-11-16T20:56:13.263 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9283999999999993e-05 2020-11-16T20:56:13.264 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.264 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.264 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.264 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.038070+0000", 2020-11-16T20:56:13.264 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00086455899999999999 2020-11-16T20:56:13.264 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.264 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.264 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.265 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.038934+0000", 2020-11-16T20:56:13.265 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020430296000000001 2020-11-16T20:56:13.265 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.265 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.265 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.265 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.265 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.266 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1058 4.3 4:c9fee0b4:::smithi16641208-235:head [write 3210039~571651] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:13.266 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.758237+0000", 2020-11-16T20:56:13.266 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 18.413797200000001, 2020-11-16T20:56:13.266 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022625346000000001, 2020-11-16T20:56:13.266 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.266 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:13.266 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.266 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.267 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.267 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1058 2020-11-16T20:56:13.267 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.267 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.267 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.267 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.267 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758237+0000", 2020-11-16T20:56:13.268 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.268 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.268 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.268 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.268 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758237+0000", 2020-11-16T20:56:13.268 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013014999999999999 2020-11-16T20:56:13.268 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.268 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.269 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.269 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758367+0000", 2020-11-16T20:56:13.269 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.826e-06 2020-11-16T20:56:13.269 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.269 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.269 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.269 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758372+0000", 2020-11-16T20:56:13.270 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8520000000000004e-06 2020-11-16T20:56:13.270 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.270 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.270 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.270 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758379+0000", 2020-11-16T20:56:13.270 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8880000000000002e-06 2020-11-16T20:56:13.270 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.270 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.271 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.271 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758385+0000", 2020-11-16T20:56:13.271 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1022000000000001e-05 2020-11-16T20:56:13.271 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.271 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.271 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.271 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758426+0000", 2020-11-16T20:56:13.272 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6464e-05 2020-11-16T20:56:13.272 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.272 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.272 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.272 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758483+0000", 2020-11-16T20:56:13.272 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007121863 2020-11-16T20:56:13.272 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.272 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.273 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.273 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.765605+0000", 2020-11-16T20:56:13.273 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000150488 2020-11-16T20:56:13.273 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.273 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.273 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.273 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.765755+0000", 2020-11-16T20:56:13.273 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000196104 2020-11-16T20:56:13.274 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.274 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.274 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:56:13.274 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.765951+0000", 2020-11-16T20:56:13.274 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0047861450000000003 2020-11-16T20:56:13.274 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.275 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.275 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:13.275 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.770737+0000", 2020-11-16T20:56:13.275 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094327530000000003 2020-11-16T20:56:13.275 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.275 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.275 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.275 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.780170+0000", 2020-11-16T20:56:13.276 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00057350800000000003 2020-11-16T20:56:13.276 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.276 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.276 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.276 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.780744+0000", 2020-11-16T20:56:13.276 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9132000000000002e-05 2020-11-16T20:56:13.276 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.276 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.277 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:13.277 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.780813+0000", 2020-11-16T20:56:13.277 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9150999999999997e-05 2020-11-16T20:56:13.277 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.277 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.277 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.277 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.780862+0000", 2020-11-16T20:56:13.278 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022625346000000001 2020-11-16T20:56:13.278 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.278 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.278 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.278 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.278 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.278 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1059 4.3 4:c9fee0b4:::smithi16641208-235:head [setxattr _header (57) in=7b,truncate 3932838] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:13.278 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.758407+0000", 2020-11-16T20:56:13.279 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 18.413626802, 2020-11-16T20:56:13.279 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022754090000000001, 2020-11-16T20:56:13.279 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.279 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:13.279 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.279 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.279 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.280 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1059 2020-11-16T20:56:13.280 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.280 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.280 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.280 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.280 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758407+0000", 2020-11-16T20:56:13.280 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.280 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.281 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.281 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.281 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758407+0000", 2020-11-16T20:56:13.281 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3376000000000001e-05 2020-11-16T20:56:13.281 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.281 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.281 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.282 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758430+0000", 2020-11-16T20:56:13.282 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1310000000000002e-06 2020-11-16T20:56:13.282 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.282 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.282 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.282 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758434+0000", 2020-11-16T20:56:13.282 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2789999999999998e-06 2020-11-16T20:56:13.282 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.283 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.283 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.283 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758439+0000", 2020-11-16T20:56:13.283 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7379999999999999e-06 2020-11-16T20:56:13.283 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.283 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.283 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.284 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758442+0000", 2020-11-16T20:56:13.284 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6581999999999994e-05 2020-11-16T20:56:13.284 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.284 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.284 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.284 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758508+0000", 2020-11-16T20:56:13.284 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6446999999999998e-05 2020-11-16T20:56:13.284 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.285 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.285 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.285 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758555+0000", 2020-11-16T20:56:13.285 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0085127880000000003 2020-11-16T20:56:13.285 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.285 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.285 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.285 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.767067+0000", 2020-11-16T20:56:13.286 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000135029 2020-11-16T20:56:13.286 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.286 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.286 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.286 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.767202+0000", 2020-11-16T20:56:13.286 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016839700000000001 2020-11-16T20:56:13.286 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.287 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.287 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:56:13.287 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.767371+0000", 2020-11-16T20:56:13.287 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035788830000000002 2020-11-16T20:56:13.287 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.287 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.287 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:13.287 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.770950+0000", 2020-11-16T20:56:13.288 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0099601050000000003 2020-11-16T20:56:13.288 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.288 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.288 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.288 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.780910+0000", 2020-11-16T20:56:13.288 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8102000000000002e-05 2020-11-16T20:56:13.288 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.289 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.289 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.289 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.780948+0000", 2020-11-16T20:56:13.289 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012368500000000001 2020-11-16T20:56:13.289 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.289 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.289 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:13.289 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.781072+0000", 2020-11-16T20:56:13.290 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9548000000000004e-05 2020-11-16T20:56:13.290 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.290 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.290 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.290 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.781161+0000", 2020-11-16T20:56:13.290 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022754090000000001 2020-11-16T20:56:13.290 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.291 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.291 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.291 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.291 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.291 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1060 4.3 4:c9fee0b4:::smithi16641208-235:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:56:13.291 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.758461+0000", 2020-11-16T20:56:13.291 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 18.413572884000001, 2020-11-16T20:56:13.291 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023396862000000001, 2020-11-16T20:56:13.292 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.292 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:13.292 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.292 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.292 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.292 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1060 2020-11-16T20:56:13.292 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.292 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.293 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.293 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.293 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758461+0000", 2020-11-16T20:56:13.293 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.293 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.293 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.293 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.294 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758461+0000", 2020-11-16T20:56:13.294 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5608e-05 2020-11-16T20:56:13.294 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.294 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.294 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.294 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758477+0000", 2020-11-16T20:56:13.294 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.971e-06 2020-11-16T20:56:13.294 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.295 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.295 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.295 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758480+0000", 2020-11-16T20:56:13.295 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5110000000000003e-06 2020-11-16T20:56:13.295 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.295 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.295 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.296 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758485+0000", 2020-11-16T20:56:13.296 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3420000000000002e-06 2020-11-16T20:56:13.296 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.296 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.296 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.296 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758487+0000", 2020-11-16T20:56:13.296 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9705999999999998e-05 2020-11-16T20:56:13.296 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.297 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.297 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.297 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758577+0000", 2020-11-16T20:56:13.297 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3758999999999999e-05 2020-11-16T20:56:13.297 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.297 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.297 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.298 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758621+0000", 2020-11-16T20:56:13.298 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0090497489999999993 2020-11-16T20:56:13.298 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.298 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.298 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.298 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.767671+0000", 2020-11-16T20:56:13.298 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114125 2020-11-16T20:56:13.298 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.299 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.299 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:13.299 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.767785+0000", 2020-11-16T20:56:13.299 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013424666 2020-11-16T20:56:13.299 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.299 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.299 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.300 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.781209+0000", 2020-11-16T20:56:13.300 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5508999999999997e-05 2020-11-16T20:56:13.300 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.300 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.300 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.300 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.781295+0000", 2020-11-16T20:56:13.300 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000562916 2020-11-16T20:56:13.300 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.301 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.301 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.301 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.781858+0000", 2020-11-16T20:56:13.301 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023396862000000001 2020-11-16T20:56:13.301 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.301 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.301 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.301 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.302 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.302 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1087 4.3 4:d76da88a:::smithi16641208-241:head [setxattr _header (57) in=7b,truncate 2033680] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:13.302 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.865089+0000", 2020-11-16T20:56:13.302 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 18.306945036999998, 2020-11-16T20:56:13.302 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021749237000000001, 2020-11-16T20:56:13.302 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.302 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:13.303 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.303 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.303 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.303 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1087 2020-11-16T20:56:13.303 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.303 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.303 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.303 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.304 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865089+0000", 2020-11-16T20:56:13.304 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.304 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.304 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.304 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.304 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865089+0000", 2020-11-16T20:56:13.304 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9706000000000002e-05 2020-11-16T20:56:13.305 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.305 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.305 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.305 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865128+0000", 2020-11-16T20:56:13.305 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0039999999999999e-06 2020-11-16T20:56:13.305 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.305 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.305 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.306 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865133+0000", 2020-11-16T20:56:13.306 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.7759999999999992e-06 2020-11-16T20:56:13.306 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.306 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.306 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.306 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865143+0000", 2020-11-16T20:56:13.306 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9530000000000001e-06 2020-11-16T20:56:13.307 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.307 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.307 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.307 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865147+0000", 2020-11-16T20:56:13.307 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00027494100000000001 2020-11-16T20:56:13.307 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.307 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.307 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.308 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865422+0000", 2020-11-16T20:56:13.308 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1785000000000006e-05 2020-11-16T20:56:13.308 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.308 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.308 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.308 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865484+0000", 2020-11-16T20:56:13.308 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011240791999999999 2020-11-16T20:56:13.309 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.309 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.309 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.309 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.876725+0000", 2020-11-16T20:56:13.309 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015467500000000001 2020-11-16T20:56:13.309 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.309 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.309 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.310 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.876879+0000", 2020-11-16T20:56:13.310 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011158900000000001 2020-11-16T20:56:13.310 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.310 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.310 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:56:13.310 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.876991+0000", 2020-11-16T20:56:13.310 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001134 2020-11-16T20:56:13.311 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.311 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.311 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:13.311 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.878125+0000", 2020-11-16T20:56:13.311 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0082293690000000003 2020-11-16T20:56:13.311 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.311 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.311 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.312 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.886354+0000", 2020-11-16T20:56:13.312 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00035530099999999998 2020-11-16T20:56:13.312 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.312 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.312 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.312 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.886710+0000", 2020-11-16T20:56:13.312 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1882000000000001e-05 2020-11-16T20:56:13.312 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.313 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:13.313 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.886772+0000", 2020-11-16T20:56:13.313 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6464000000000006e-05 2020-11-16T20:56:13.313 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.313 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.314 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.886838+0000", 2020-11-16T20:56:13.314 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021749237000000001 2020-11-16T20:56:13.314 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.314 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.314 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.314 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.314 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.314 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1088 4.3 4:d76da88a:::smithi16641208-241:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:56:13.315 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.865184+0000", 2020-11-16T20:56:13.315 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 18.306849802999999, 2020-11-16T20:56:13.315 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022135986, 2020-11-16T20:56:13.315 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.315 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:13.315 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.315 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.316 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.316 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1088 2020-11-16T20:56:13.316 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.316 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.316 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.316 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.316 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865184+0000", 2020-11-16T20:56:13.316 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.317 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.317 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.317 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.317 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865184+0000", 2020-11-16T20:56:13.317 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8971000000000001e-05 2020-11-16T20:56:13.317 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.317 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.317 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.318 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865213+0000", 2020-11-16T20:56:13.318 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9339999999999997e-06 2020-11-16T20:56:13.318 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.318 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.318 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.318 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865218+0000", 2020-11-16T20:56:13.318 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7649999999999999e-06 2020-11-16T20:56:13.319 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.319 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.319 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.319 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865227+0000", 2020-11-16T20:56:13.319 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8120000000000001e-06 2020-11-16T20:56:13.319 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.319 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.319 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.320 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865231+0000", 2020-11-16T20:56:13.320 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000276438 2020-11-16T20:56:13.320 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.320 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.320 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.320 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865507+0000", 2020-11-16T20:56:13.320 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2175999999999997e-05 2020-11-16T20:56:13.321 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.321 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.321 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.321 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865549+0000", 2020-11-16T20:56:13.321 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011964954 2020-11-16T20:56:13.321 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.321 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.321 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.322 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.877514+0000", 2020-11-16T20:56:13.322 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000123745 2020-11-16T20:56:13.322 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.322 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.322 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:13.322 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.877638+0000", 2020-11-16T20:56:13.322 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092450929999999994 2020-11-16T20:56:13.323 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.323 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.323 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.323 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.886883+0000", 2020-11-16T20:56:13.323 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000126353 2020-11-16T20:56:13.323 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.323 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.323 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.324 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.887009+0000", 2020-11-16T20:56:13.324 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00031074500000000002 2020-11-16T20:56:13.324 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.324 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.324 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.324 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.887320+0000", 2020-11-16T20:56:13.324 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022135986 2020-11-16T20:56:13.325 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.325 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.325 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.325 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.325 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.325 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1092 4.3 4:dafe2ce7:::smithi16641208-242:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:56:13.325 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.877720+0000", 2020-11-16T20:56:13.325 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 18.294313418000002, 2020-11-16T20:56:13.326 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030035315, 2020-11-16T20:56:13.326 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.326 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:13.326 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.326 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.326 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.326 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1092 2020-11-16T20:56:13.327 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.327 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.327 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.327 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.327 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.877720+0000", 2020-11-16T20:56:13.327 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.327 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.327 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.328 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.328 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.877720+0000", 2020-11-16T20:56:13.328 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1433999999999998e-05 2020-11-16T20:56:13.328 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.328 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.328 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.328 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.877752+0000", 2020-11-16T20:56:13.328 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1099999999999999e-06 2020-11-16T20:56:13.329 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.329 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.329 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.329 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.877758+0000", 2020-11-16T20:56:13.329 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5451000000000001e-05 2020-11-16T20:56:13.329 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.329 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.330 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.330 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.877783+0000", 2020-11-16T20:56:13.330 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4539999999999998e-06 2020-11-16T20:56:13.330 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.330 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.330 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.330 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.877789+0000", 2020-11-16T20:56:13.330 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024410299999999999 2020-11-16T20:56:13.331 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.331 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.331 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.331 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.878033+0000", 2020-11-16T20:56:13.331 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9281000000000002e-05 2020-11-16T20:56:13.331 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.331 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.332 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.332 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.878112+0000", 2020-11-16T20:56:13.332 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020799528000000001 2020-11-16T20:56:13.332 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.332 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.332 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.332 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.898912+0000", 2020-11-16T20:56:13.332 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012294699999999999 2020-11-16T20:56:13.333 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.333 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.333 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:13.333 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.899035+0000", 2020-11-16T20:56:13.333 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0081677739999999992 2020-11-16T20:56:13.333 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.333 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.334 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.334 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.907202+0000", 2020-11-16T20:56:13.334 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000115129 2020-11-16T20:56:13.334 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.334 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.334 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.334 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.907318+0000", 2020-11-16T20:56:13.334 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00043810399999999998 2020-11-16T20:56:13.335 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.335 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.907756+0000", 2020-11-16T20:56:13.335 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030035315 2020-11-16T20:56:13.335 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.335 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.336 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.336 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.336 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.336 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2342 4.3 4:c97658cf:::smithi16641208-283:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e41)", 2020-11-16T20:56:13.336 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:03.998575+0000", 2020-11-16T20:56:13.336 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.1734584980000005, 2020-11-16T20:56:13.336 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027999124, 2020-11-16T20:56:13.336 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.337 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:13.337 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.337 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.337 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.337 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2342 2020-11-16T20:56:13.337 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.337 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.338 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.338 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.338 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:03.998575+0000", 2020-11-16T20:56:13.338 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.338 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.338 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.338 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.338 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:03.998575+0000", 2020-11-16T20:56:13.339 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3098000000000001e-05 2020-11-16T20:56:13.339 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.339 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.339 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.339 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:03.998598+0000", 2020-11-16T20:56:13.339 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3189999999999999e-06 2020-11-16T20:56:13.339 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.340 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.340 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.340 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:03.998602+0000", 2020-11-16T20:56:13.340 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9750000000000001e-06 2020-11-16T20:56:13.340 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.340 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.340 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.340 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:03.998609+0000", 2020-11-16T20:56:13.341 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8540000000000001e-06 2020-11-16T20:56:13.341 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.341 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.341 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.341 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:03.998612+0000", 2020-11-16T20:56:13.341 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00031678499999999998 2020-11-16T20:56:13.341 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.341 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.342 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.342 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:03.998928+0000", 2020-11-16T20:56:13.342 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7091000000000001e-05 2020-11-16T20:56:13.342 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.342 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.342 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.342 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:03.998965+0000", 2020-11-16T20:56:13.343 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016605517 2020-11-16T20:56:13.343 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.343 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.343 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.343 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.015571+0000", 2020-11-16T20:56:13.343 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000127174 2020-11-16T20:56:13.343 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.343 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.344 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:13.344 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.015698+0000", 2020-11-16T20:56:13.344 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010568884000000001 2020-11-16T20:56:13.344 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.344 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.344 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.344 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.026267+0000", 2020-11-16T20:56:13.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2447000000000005e-05 2020-11-16T20:56:13.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.345 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.345 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.026349+0000", 2020-11-16T20:56:13.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022498 2020-11-16T20:56:13.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.345 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.346 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.346 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.026574+0000", 2020-11-16T20:56:13.346 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027999124 2020-11-16T20:56:13.346 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.346 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.346 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.346 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.347 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.347 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2345 4.3 4:c9160c9c:::smithi16641208-411:head [rollback 5] snapc 6=[6,5,4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e41)", 2020-11-16T20:56:13.347 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:04.115684+0000", 2020-11-16T20:56:13.347 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.0563497730000009, 2020-11-16T20:56:13.347 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033152890999999997, 2020-11-16T20:56:13.347 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.347 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:13.348 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.348 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.348 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.348 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2345 2020-11-16T20:56:13.348 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.348 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.348 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.348 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.349 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115684+0000", 2020-11-16T20:56:13.349 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.349 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.349 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.349 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.349 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115684+0000", 2020-11-16T20:56:13.349 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5156e-05 2020-11-16T20:56:13.349 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.350 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.350 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115699+0000", 2020-11-16T20:56:13.350 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.852e-06 2020-11-16T20:56:13.350 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.350 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115702+0000", 2020-11-16T20:56:13.351 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.366e-06 2020-11-16T20:56:13.351 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.351 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.351 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115707+0000", 2020-11-16T20:56:13.351 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5110000000000002e-06 2020-11-16T20:56:13.351 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.352 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.352 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115710+0000", 2020-11-16T20:56:13.352 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00026113800000000001 2020-11-16T20:56:13.352 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.352 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.353 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115971+0000", 2020-11-16T20:56:13.353 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5478000000000002e-05 2020-11-16T20:56:13.353 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.353 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.353 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.353 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.116007+0000", 2020-11-16T20:56:13.353 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011434730000000001 2020-11-16T20:56:13.353 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.354 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.354 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.354 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.127441+0000", 2020-11-16T20:56:13.354 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000106121 2020-11-16T20:56:13.354 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.354 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.354 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.354 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.127547+0000", 2020-11-16T20:56:13.355 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019369799999999999 2020-11-16T20:56:13.355 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.355 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.355 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.355 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.127741+0000", 2020-11-16T20:56:13.355 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8986999999999999e-05 2020-11-16T20:56:13.355 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.356 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.356 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.356 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.127770+0000", 2020-11-16T20:56:13.356 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0079205560000000005 2020-11-16T20:56:13.356 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.356 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.356 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.356 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.135691+0000", 2020-11-16T20:56:13.357 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010364799999999999 2020-11-16T20:56:13.357 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.357 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.357 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.357 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.135794+0000", 2020-11-16T20:56:13.357 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000194532 2020-11-16T20:56:13.357 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.358 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.358 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:56:13.358 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.135989+0000", 2020-11-16T20:56:13.358 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001241301 2020-11-16T20:56:13.358 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.358 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.358 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.358 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.137230+0000", 2020-11-16T20:56:13.359 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9125000000000002e-05 2020-11-16T20:56:13.359 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.359 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.359 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for ondisk", 2020-11-16T20:56:13.359 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.137269+0000", 2020-11-16T20:56:13.359 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0014352239999999999 2020-11-16T20:56:13.359 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.360 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.360 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:13.360 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.138704+0000", 2020-11-16T20:56:13.360 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0076177900000000002 2020-11-16T20:56:13.360 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.360 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.360 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.360 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.146322+0000", 2020-11-16T20:56:13.361 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0024308260000000001 2020-11-16T20:56:13.361 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.361 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.361 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.361 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.148753+0000", 2020-11-16T20:56:13.361 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4169999999999999e-05 2020-11-16T20:56:13.361 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.362 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.362 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:13.362 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.148797+0000", 2020-11-16T20:56:13.362 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9681999999999997e-05 2020-11-16T20:56:13.362 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.362 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.362 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.362 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.148837+0000", 2020-11-16T20:56:13.363 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033152890999999997 2020-11-16T20:56:13.363 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.363 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.363 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.363 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.363 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.363 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2346 4.3 4:c9160c9c:::smithi16641208-411:head [append 0~0] snapc 6=[6,5,4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e41)", 2020-11-16T20:56:13.363 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:04.115728+0000", 2020-11-16T20:56:13.364 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.0563060320000002, 2020-11-16T20:56:13.364 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035920868000000002, 2020-11-16T20:56:13.364 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.364 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:13.364 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.364 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.364 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.365 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2346 2020-11-16T20:56:13.365 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.365 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.365 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.365 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.365 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115728+0000", 2020-11-16T20:56:13.365 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.365 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.366 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.366 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.366 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115728+0000", 2020-11-16T20:56:13.366 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4843e-05 2020-11-16T20:56:13.366 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.366 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.366 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.367 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115743+0000", 2020-11-16T20:56:13.367 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6399999999999999e-06 2020-11-16T20:56:13.367 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.367 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.367 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.367 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115746+0000", 2020-11-16T20:56:13.367 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1749999999999996e-06 2020-11-16T20:56:13.367 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.368 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.368 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.368 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115751+0000", 2020-11-16T20:56:13.368 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2500000000000001e-06 2020-11-16T20:56:13.368 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.368 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.368 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.369 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115754+0000", 2020-11-16T20:56:13.369 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00027690100000000002 2020-11-16T20:56:13.369 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.369 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.369 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.369 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.116031+0000", 2020-11-16T20:56:13.369 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8213000000000001e-05 2020-11-16T20:56:13.369 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.370 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.370 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.370 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.116079+0000", 2020-11-16T20:56:13.370 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011729105 2020-11-16T20:56:13.370 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.370 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.370 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.371 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.127808+0000", 2020-11-16T20:56:13.371 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8734e-05 2020-11-16T20:56:13.371 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.371 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.371 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.371 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.127837+0000", 2020-11-16T20:56:13.371 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094608379999999992 2020-11-16T20:56:13.371 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.372 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.372 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.372 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.137297+0000", 2020-11-16T20:56:13.372 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8356999999999996e-05 2020-11-16T20:56:13.372 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.372 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.372 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.373 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.137366+0000", 2020-11-16T20:56:13.373 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010179300000000001 2020-11-16T20:56:13.373 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.373 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.373 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:56:13.373 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.137468+0000", 2020-11-16T20:56:13.373 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001540626 2020-11-16T20:56:13.373 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.374 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.374 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:13.374 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.139008+0000", 2020-11-16T20:56:13.374 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0073602659999999999 2020-11-16T20:56:13.374 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.374 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.374 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.375 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.146369+0000", 2020-11-16T20:56:13.375 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.005211467 2020-11-16T20:56:13.375 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.375 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.375 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.375 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.151580+0000", 2020-11-16T20:56:13.375 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2265000000000003e-05 2020-11-16T20:56:13.375 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.376 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.376 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:13.376 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.151622+0000", 2020-11-16T20:56:13.376 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6395000000000001e-05 2020-11-16T20:56:13.376 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.376 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.376 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.377 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.151649+0000", 2020-11-16T20:56:13.377 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035920868000000002 2020-11-16T20:56:13.377 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.377 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.377 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.377 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.377 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.377 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2423 4.3 4:c5716d1e:::smithi16641208-111:head [copy-from ver 265] snapc 7=[7,5] ondisk+write+known_if_redirected e46)", 2020-11-16T20:56:13.378 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.026587+0000", 2020-11-16T20:56:13.378 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 4.1454465919999999, 2020-11-16T20:56:13.378 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039457442000000002, 2020-11-16T20:56:13.378 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.378 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:13.378 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.378 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.378 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.379 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2423 2020-11-16T20:56:13.379 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.379 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.379 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.379 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.379 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026587+0000", 2020-11-16T20:56:13.379 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.380 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.380 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.380 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.380 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026587+0000", 2020-11-16T20:56:13.380 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2777000000000001e-05 2020-11-16T20:56:13.380 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.380 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.380 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.381 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026630+0000", 2020-11-16T20:56:13.381 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.993e-06 2020-11-16T20:56:13.381 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.381 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.381 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.381 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026636+0000", 2020-11-16T20:56:13.381 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1423000000000001e-05 2020-11-16T20:56:13.382 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.382 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.382 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026647+0000", 2020-11-16T20:56:13.382 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1880000000000001e-06 2020-11-16T20:56:13.382 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.382 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.383 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026653+0000", 2020-11-16T20:56:13.383 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00021074700000000001 2020-11-16T20:56:13.383 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.383 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.383 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.383 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026863+0000", 2020-11-16T20:56:13.383 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039178896999999997 2020-11-16T20:56:13.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.384 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:13.384 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.066042+0000", 2020-11-16T20:56:13.384 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4169999999999999e-06 2020-11-16T20:56:13.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.384 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.385 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.066045+0000", 2020-11-16T20:56:13.385 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039457442000000002 2020-11-16T20:56:13.385 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.385 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.385 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.385 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.385 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.385 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2424 4.3 4:c5716d1e:::smithi16641208-111:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e46)", 2020-11-16T20:56:13.386 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.026685+0000", 2020-11-16T20:56:13.386 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 4.1453488099999998, 2020-11-16T20:56:13.386 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065304164999999997, 2020-11-16T20:56:13.386 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.386 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:13.386 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.386 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.387 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.387 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2424 2020-11-16T20:56:13.387 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.387 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.387 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.387 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.387 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026685+0000", 2020-11-16T20:56:13.387 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.388 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.388 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.388 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026685+0000", 2020-11-16T20:56:13.388 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4087000000000001e-05 2020-11-16T20:56:13.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.388 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.389 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.389 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026719+0000", 2020-11-16T20:56:13.389 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2298e-05 2020-11-16T20:56:13.389 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.389 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.389 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026731+0000", 2020-11-16T20:56:13.389 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1001e-05 2020-11-16T20:56:13.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.390 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.390 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.390 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026742+0000", 2020-11-16T20:56:13.390 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6129999999999997e-06 2020-11-16T20:56:13.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.390 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.391 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.391 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026747+0000", 2020-11-16T20:56:13.391 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00047150600000000001 2020-11-16T20:56:13.391 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.391 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.391 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.027219+0000", 2020-11-16T20:56:13.391 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5602999999999998e-05 2020-11-16T20:56:13.392 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.392 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.392 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.392 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.027254+0000", 2020-11-16T20:56:13.392 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050318838999999997 2020-11-16T20:56:13.392 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.392 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.392 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.393 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.077573+0000", 2020-11-16T20:56:13.393 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6290000000000001e-05 2020-11-16T20:56:13.393 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.393 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.393 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:13.393 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.077669+0000", 2020-11-16T20:56:13.393 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014149599000000001 2020-11-16T20:56:13.394 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.394 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.394 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.394 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.091819+0000", 2020-11-16T20:56:13.394 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6891000000000005e-05 2020-11-16T20:56:13.394 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.394 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.395 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.395 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.091906+0000", 2020-11-16T20:56:13.395 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3437999999999996e-05 2020-11-16T20:56:13.395 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.395 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.395 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.395 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.091989+0000", 2020-11-16T20:56:13.395 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065304164999999997 2020-11-16T20:56:13.396 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.396 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.396 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.396 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.396 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.396 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.4.13:663 3.1 3:a1b421f3:::smithi16641208-471:head [copy-from ver 412] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e47)", 2020-11-16T20:56:13.396 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.018904+0000", 2020-11-16T20:56:13.396 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.1531297070000002, 2020-11-16T20:56:13.397 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032531157999999998, 2020-11-16T20:56:13.397 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.397 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:13.397 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.397 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.397 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.397 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018904+0000", 2020-11-16T20:56:13.398 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.398 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.398 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.398 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.398 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018904+0000", 2020-11-16T20:56:13.398 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5086000000000002e-05 2020-11-16T20:56:13.398 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.398 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.399 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.399 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018949+0000", 2020-11-16T20:56:13.399 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5539999999999998e-06 2020-11-16T20:56:13.399 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.399 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.399 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.399 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018958+0000", 2020-11-16T20:56:13.400 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5410999999999999e-05 2020-11-16T20:56:13.400 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.400 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.400 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.400 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018973+0000", 2020-11-16T20:56:13.400 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7989999999999994e-06 2020-11-16T20:56:13.400 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.400 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.401 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.401 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018981+0000", 2020-11-16T20:56:13.401 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2879000000000006e-05 2020-11-16T20:56:13.401 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.401 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.401 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.401 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.019044+0000", 2020-11-16T20:56:13.402 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000118254 2020-11-16T20:56:13.402 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.402 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.402 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.402 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.019162+0000", 2020-11-16T20:56:13.402 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017941413 2020-11-16T20:56:13.402 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.402 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.403 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 3,4", 2020-11-16T20:56:13.403 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.037104+0000", 2020-11-16T20:56:13.403 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013272983 2020-11-16T20:56:13.403 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.403 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.403 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.403 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050376+0000", 2020-11-16T20:56:13.404 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00052193599999999997 2020-11-16T20:56:13.404 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.404 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.404 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:13.404 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050898+0000", 2020-11-16T20:56:13.404 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00040169700000000001 2020-11-16T20:56:13.404 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.404 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.405 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.405 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051300+0000", 2020-11-16T20:56:13.405 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.0907000000000003e-05 2020-11-16T20:56:13.405 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.405 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.405 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:13.405 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051381+0000", 2020-11-16T20:56:13.406 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4239e-05 2020-11-16T20:56:13.406 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.406 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.406 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.406 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051435+0000", 2020-11-16T20:56:13.406 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032531157999999998 2020-11-16T20:56:13.406 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.406 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.407 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.407 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.407 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.407 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:13.409 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:56:13.409 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:56:13.410 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:56:13.410 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:56:13.410 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:56:13.410 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:56:13.410 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:56:13.410 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:56:13.411 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:56:13.411 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:56:13.411 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:56:13.411 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:56:13.411 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:56:13.411 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:56:13.412 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:13.413+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:13.509 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:13.514+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:13.574 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:13.574 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:13.574 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:56:13.574 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:13.583 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:56:13.626 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:13.631+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:13.711 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:13.711 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:13.712 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:56:13.712 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:56:13.712 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:13.712 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:13.716+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:13.720 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:56:13.812 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:13.816+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:13.888 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:13.888 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:56:13.888 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:56:13.888 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:56:13.888 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.889 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1115 4.2 4:5a2aa7df:::smithi16641208-248:head [setxattr _header (57) in=7b,truncate 2151329] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:13.889 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.954978+0000", 2020-11-16T20:56:13.889 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 18.936253357999998, 2020-11-16T20:56:13.889 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023396486000000001, 2020-11-16T20:56:13.889 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.889 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:13.889 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.890 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.890 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.890 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1115 2020-11-16T20:56:13.890 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.890 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.890 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.890 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.891 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.954978+0000", 2020-11-16T20:56:13.891 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.891 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.891 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.891 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.891 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.954978+0000", 2020-11-16T20:56:13.891 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2381000000000001e-05 2020-11-16T20:56:13.892 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.892 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.892 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.892 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955000+0000", 2020-11-16T20:56:13.892 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3979999999999999e-06 2020-11-16T20:56:13.892 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.892 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.892 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.893 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955003+0000", 2020-11-16T20:56:13.893 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1510000000000001e-06 2020-11-16T20:56:13.893 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.893 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.893 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.893 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955009+0000", 2020-11-16T20:56:13.893 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6690000000000002e-06 2020-11-16T20:56:13.894 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.894 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.894 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.894 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955012+0000", 2020-11-16T20:56:13.894 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000317423 2020-11-16T20:56:13.894 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.894 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.894 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.895 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955330+0000", 2020-11-16T20:56:13.895 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3217000000000002e-05 2020-11-16T20:56:13.895 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.895 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.895 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.895 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955383+0000", 2020-11-16T20:56:13.895 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011320966 2020-11-16T20:56:13.896 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.896 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.896 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.896 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.966704+0000", 2020-11-16T20:56:13.896 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015513500000000001 2020-11-16T20:56:13.896 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.896 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.896 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.897 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.966859+0000", 2020-11-16T20:56:13.897 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018944 2020-11-16T20:56:13.897 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.897 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.897 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:13.897 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.967048+0000", 2020-11-16T20:56:13.897 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0062409930000000002 2020-11-16T20:56:13.897 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.898 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.898 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:13.898 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.973289+0000", 2020-11-16T20:56:13.898 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0049529889999999997 2020-11-16T20:56:13.898 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.898 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.898 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.899 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978242+0000", 2020-11-16T20:56:13.899 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1761999999999999e-05 2020-11-16T20:56:13.899 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.899 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.899 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.899 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978264+0000", 2020-11-16T20:56:13.899 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9797999999999999e-05 2020-11-16T20:56:13.900 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.900 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.900 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:13.900 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978324+0000", 2020-11-16T20:56:13.900 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0164000000000003e-05 2020-11-16T20:56:13.900 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.900 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.900 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.901 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978374+0000", 2020-11-16T20:56:13.901 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023396486000000001 2020-11-16T20:56:13.901 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.901 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.901 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.901 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.901 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.901 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1116 4.2 4:5a2aa7df:::smithi16641208-248:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:56:13.902 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.955031+0000", 2020-11-16T20:56:13.902 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 18.936200037999999, 2020-11-16T20:56:13.902 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023838986999999999, 2020-11-16T20:56:13.902 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.902 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:13.902 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.903 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.903 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.903 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1116 2020-11-16T20:56:13.903 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.903 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.903 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.903 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.903 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955031+0000", 2020-11-16T20:56:13.904 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.904 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.904 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.904 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.904 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955031+0000", 2020-11-16T20:56:13.904 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5029e-05 2020-11-16T20:56:13.904 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.905 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.905 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.905 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955046+0000", 2020-11-16T20:56:13.905 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8770000000000002e-06 2020-11-16T20:56:13.905 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.905 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.905 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.906 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955049+0000", 2020-11-16T20:56:13.906 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7219999999999996e-06 2020-11-16T20:56:13.906 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.906 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.906 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.906 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955055+0000", 2020-11-16T20:56:13.906 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4109999999999999e-06 2020-11-16T20:56:13.906 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.907 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.907 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.907 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955057+0000", 2020-11-16T20:56:13.907 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00035397299999999999 2020-11-16T20:56:13.907 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.907 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.907 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.908 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955411+0000", 2020-11-16T20:56:13.908 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4848000000000001e-05 2020-11-16T20:56:13.908 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.908 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.908 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.908 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955466+0000", 2020-11-16T20:56:13.908 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012080844 2020-11-16T20:56:13.908 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.909 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.909 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.909 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.967547+0000", 2020-11-16T20:56:13.909 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015558100000000001 2020-11-16T20:56:13.909 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.909 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.909 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:13.909 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.967702+0000", 2020-11-16T20:56:13.910 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010726072999999999 2020-11-16T20:56:13.910 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.910 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.910 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.910 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978428+0000", 2020-11-16T20:56:13.910 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013814900000000001 2020-11-16T20:56:13.910 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.911 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.911 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.911 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978566+0000", 2020-11-16T20:56:13.911 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030348000000000001 2020-11-16T20:56:13.911 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.911 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.911 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.911 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978870+0000", 2020-11-16T20:56:13.912 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023838986999999999 2020-11-16T20:56:13.912 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.912 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.912 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.912 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.912 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.913 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1121 4.2 4:7ef90409:::smithi16641208-250:head [write 584943~460297,stat] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:13.913 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.974149+0000", 2020-11-16T20:56:13.913 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 18.917081754000002, 2020-11-16T20:56:13.913 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025650249999999999, 2020-11-16T20:56:13.913 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.913 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:13.914 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.914 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.914 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.914 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1121 2020-11-16T20:56:13.914 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.914 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.914 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.915 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.915 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.974149+0000", 2020-11-16T20:56:13.915 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.915 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.915 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.915 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.915 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.974149+0000", 2020-11-16T20:56:13.916 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000117531 2020-11-16T20:56:13.916 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.916 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.916 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.916 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.974267+0000", 2020-11-16T20:56:13.916 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.618e-06 2020-11-16T20:56:13.916 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.917 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.917 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.917 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.974273+0000", 2020-11-16T20:56:13.917 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.343e-05 2020-11-16T20:56:13.917 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.917 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.917 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.917 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.974287+0000", 2020-11-16T20:56:13.918 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8980000000000001e-06 2020-11-16T20:56:13.918 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.918 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.918 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.918 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.974293+0000", 2020-11-16T20:56:13.918 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0046077069999999999 2020-11-16T20:56:13.918 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.919 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.919 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.919 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978900+0000", 2020-11-16T20:56:13.919 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020897138999999999 2020-11-16T20:56:13.919 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.919 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.919 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:13.919 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.999797+0000", 2020-11-16T20:56:13.920 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9269999999999999e-06 2020-11-16T20:56:13.920 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.920 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.920 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.920 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.999799+0000", 2020-11-16T20:56:13.920 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025650249999999999 2020-11-16T20:56:13.920 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.921 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.921 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.921 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.921 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.921 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1122 4.2 4:7ef90409:::smithi16641208-250:head [write 1587781~597162] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:13.921 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.982754+0000", 2020-11-16T20:56:13.921 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 18.908477316999999, 2020-11-16T20:56:13.921 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020140918000000001, 2020-11-16T20:56:13.922 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.922 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:13.922 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.922 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.922 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.922 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1122 2020-11-16T20:56:13.922 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.923 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.923 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.923 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.923 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.982754+0000", 2020-11-16T20:56:13.923 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.923 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.923 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.923 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.924 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.982754+0000", 2020-11-16T20:56:13.924 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019379 2020-11-16T20:56:13.924 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.924 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.924 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.924 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.982947+0000", 2020-11-16T20:56:13.924 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2900000000000008e-06 2020-11-16T20:56:13.924 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.925 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.925 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.925 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.982957+0000", 2020-11-16T20:56:13.925 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6120000000000002e-05 2020-11-16T20:56:13.925 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.925 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.925 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.926 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.982973+0000", 2020-11-16T20:56:13.926 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.5219999999999996e-06 2020-11-16T20:56:13.926 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.926 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.926 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.926 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.982982+0000", 2020-11-16T20:56:13.926 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5333e-05 2020-11-16T20:56:13.926 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.927 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.927 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.927 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983038+0000", 2020-11-16T20:56:13.927 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019854133999999999 2020-11-16T20:56:13.927 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.927 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.927 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:13.928 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002892+0000", 2020-11-16T20:56:13.928 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.729e-06 2020-11-16T20:56:13.928 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.928 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.928 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.928 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002895+0000", 2020-11-16T20:56:13.928 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020140918000000001 2020-11-16T20:56:13.928 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.929 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.929 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.929 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.929 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.929 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1123 4.2 4:7ef90409:::smithi16641208-250:head [setxattr _header (57) in=7b,truncate 2184943] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:13.929 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.983026+0000", 2020-11-16T20:56:13.929 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 18.908204603000001, 2020-11-16T20:56:13.930 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020255397000000001, 2020-11-16T20:56:13.930 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.930 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:13.930 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.930 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.930 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.930 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1123 2020-11-16T20:56:13.930 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.931 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.931 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.931 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.931 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983026+0000", 2020-11-16T20:56:13.931 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.931 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.931 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.932 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.932 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983026+0000", 2020-11-16T20:56:13.932 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9609e-05 2020-11-16T20:56:13.932 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.932 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.932 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.932 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983066+0000", 2020-11-16T20:56:13.932 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0859999999999998e-06 2020-11-16T20:56:13.933 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.933 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.933 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.933 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983072+0000", 2020-11-16T20:56:13.933 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00043611499999999999 2020-11-16T20:56:13.933 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.933 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.933 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.934 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983508+0000", 2020-11-16T20:56:13.934 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4060000000000005e-06 2020-11-16T20:56:13.934 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.934 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.934 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.934 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983517+0000", 2020-11-16T20:56:13.935 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9840999999999998e-05 2020-11-16T20:56:13.935 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.935 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.935 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.935 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983586+0000", 2020-11-16T20:56:13.935 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019692405 2020-11-16T20:56:13.935 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.936 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.936 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:13.936 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003279+0000", 2020-11-16T20:56:13.936 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9349999999999999e-06 2020-11-16T20:56:13.937 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.937 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.937 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.937 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003282+0000", 2020-11-16T20:56:13.938 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020255397000000001 2020-11-16T20:56:13.938 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.938 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.939 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.939 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.939 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.939 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1406 4.2 4:6c6ed246:::smithi16641208-316:head [setxattr _header (57) in=7b,truncate 3294205] snapc 0=[] ondisk+write+known_if_redirected e36)", 2020-11-16T20:56:13.939 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.968144+0000", 2020-11-16T20:56:13.940 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 17.923086658999999, 2020-11-16T20:56:13.940 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026933623, 2020-11-16T20:56:13.940 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.940 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:13.940 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.940 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.940 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.941 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1406 2020-11-16T20:56:13.941 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.941 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.941 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.941 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.941 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968144+0000", 2020-11-16T20:56:13.941 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.942 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.942 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.942 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.942 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968144+0000", 2020-11-16T20:56:13.942 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3442999999999999e-05 2020-11-16T20:56:13.942 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.942 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.943 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.943 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968168+0000", 2020-11-16T20:56:13.943 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3569999999999998e-06 2020-11-16T20:56:13.943 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.943 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.943 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.943 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968171+0000", 2020-11-16T20:56:13.943 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.728e-06 2020-11-16T20:56:13.944 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.944 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.944 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.944 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968177+0000", 2020-11-16T20:56:13.944 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.943e-06 2020-11-16T20:56:13.944 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.944 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.945 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.945 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968180+0000", 2020-11-16T20:56:13.945 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018267500000000001 2020-11-16T20:56:13.945 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.945 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.945 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.945 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968362+0000", 2020-11-16T20:56:13.945 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3270000000000003e-05 2020-11-16T20:56:13.946 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.946 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.946 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.946 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968416+0000", 2020-11-16T20:56:13.947 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011050572999999999 2020-11-16T20:56:13.947 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.947 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.948 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.948 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.979466+0000", 2020-11-16T20:56:13.948 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8349000000000005e-05 2020-11-16T20:56:13.948 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.948 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.948 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.949 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.979545+0000", 2020-11-16T20:56:13.949 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010998299999999999 2020-11-16T20:56:13.949 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.949 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.950 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:13.950 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.979655+0000", 2020-11-16T20:56:13.950 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00092610999999999995 2020-11-16T20:56:13.950 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.950 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.950 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:13.951 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.980581+0000", 2020-11-16T20:56:13.951 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0068293140000000004 2020-11-16T20:56:13.951 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.951 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.951 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.951 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.987410+0000", 2020-11-16T20:56:13.951 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0075214959999999999 2020-11-16T20:56:13.951 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.952 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.952 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.952 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.994931+0000", 2020-11-16T20:56:13.952 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5657e-05 2020-11-16T20:56:13.952 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.952 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.952 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:13.953 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.994977+0000", 2020-11-16T20:56:13.953 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000100725 2020-11-16T20:56:13.953 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.953 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.953 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.953 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.995078+0000", 2020-11-16T20:56:13.953 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026933623 2020-11-16T20:56:13.953 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.954 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.954 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.954 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.954 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.954 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1407 4.2 4:6c6ed246:::smithi16641208-316:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e36)", 2020-11-16T20:56:13.954 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.968204+0000", 2020-11-16T20:56:13.954 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 17.923027230999999, 2020-11-16T20:56:13.955 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027229834000000001, 2020-11-16T20:56:13.955 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.955 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:13.955 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.955 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.955 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.955 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1407 2020-11-16T20:56:13.955 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.956 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.956 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.956 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.956 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968204+0000", 2020-11-16T20:56:13.956 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.956 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.956 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.957 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.957 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968204+0000", 2020-11-16T20:56:13.957 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6412000000000001e-05 2020-11-16T20:56:13.957 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.957 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.957 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.957 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968220+0000", 2020-11-16T20:56:13.957 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0060000000000001e-06 2020-11-16T20:56:13.958 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.958 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.958 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.958 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968223+0000", 2020-11-16T20:56:13.958 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7660000000000004e-06 2020-11-16T20:56:13.958 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.958 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.959 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.959 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968229+0000", 2020-11-16T20:56:13.959 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6979999999999998e-06 2020-11-16T20:56:13.959 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.959 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.959 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.959 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968232+0000", 2020-11-16T20:56:13.959 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000199786 2020-11-16T20:56:13.960 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.960 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.960 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.960 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968431+0000", 2020-11-16T20:56:13.960 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7841999999999999e-05 2020-11-16T20:56:13.960 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.960 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.961 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.961 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968459+0000", 2020-11-16T20:56:13.961 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011510038 2020-11-16T20:56:13.961 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.961 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.961 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.961 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.979969+0000", 2020-11-16T20:56:13.962 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7645000000000006e-05 2020-11-16T20:56:13.962 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.962 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.962 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:13.963 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.980047+0000", 2020-11-16T20:56:13.963 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015060982000000001 2020-11-16T20:56:13.963 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.963 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.963 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.963 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.995108+0000", 2020-11-16T20:56:13.964 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4376999999999997e-05 2020-11-16T20:56:13.964 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.964 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.964 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.964 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.995172+0000", 2020-11-16T20:56:13.964 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000261282 2020-11-16T20:56:13.964 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.965 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.965 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.965 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.995434+0000", 2020-11-16T20:56:13.965 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027229834000000001 2020-11-16T20:56:13.965 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.965 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.965 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.966 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.966 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.966 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2350 4.2 4:540952ab:::smithi16641208-369:head [setxattr _header (57) in=7b,truncate 2689219] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:13.966 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:04.995896+0000", 2020-11-16T20:56:13.966 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.8953347029999996, 2020-11-16T20:56:13.966 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029642330000000001, 2020-11-16T20:56:13.966 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.967 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:13.967 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.967 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.967 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.967 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2350 2020-11-16T20:56:13.967 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.967 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.967 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.968 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.968 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995896+0000", 2020-11-16T20:56:13.968 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.968 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.968 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.968 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.968 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995896+0000", 2020-11-16T20:56:13.969 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6718999999999999e-05 2020-11-16T20:56:13.969 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.969 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.969 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.969 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995923+0000", 2020-11-16T20:56:13.969 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.45e-06 2020-11-16T20:56:13.969 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.969 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.970 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.970 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995926+0000", 2020-11-16T20:56:13.970 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0610000000000001e-06 2020-11-16T20:56:13.970 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.970 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.970 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.970 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995932+0000", 2020-11-16T20:56:13.971 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8159999999999998e-06 2020-11-16T20:56:13.971 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.971 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.971 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.971 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995935+0000", 2020-11-16T20:56:13.971 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033157800000000002 2020-11-16T20:56:13.971 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.972 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.972 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.972 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.996267+0000", 2020-11-16T20:56:13.972 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2596999999999997e-05 2020-11-16T20:56:13.972 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.972 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.972 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.972 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.996329+0000", 2020-11-16T20:56:13.973 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017162574 2020-11-16T20:56:13.973 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.973 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.973 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.973 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.013492+0000", 2020-11-16T20:56:13.973 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010529100000000001 2020-11-16T20:56:13.973 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.974 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.974 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.974 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.013597+0000", 2020-11-16T20:56:13.974 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00026468599999999998 2020-11-16T20:56:13.974 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.975 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.975 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:13.975 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.013862+0000", 2020-11-16T20:56:13.975 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039181670000000002 2020-11-16T20:56:13.975 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.975 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.975 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:13.976 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017780+0000", 2020-11-16T20:56:13.976 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0074859829999999999 2020-11-16T20:56:13.976 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.976 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.976 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.976 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025266+0000", 2020-11-16T20:56:13.977 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014650000000000001 2020-11-16T20:56:13.977 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.977 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.977 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:13.977 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025413+0000", 2020-11-16T20:56:13.977 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0152999999999998e-05 2020-11-16T20:56:13.977 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.978 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.978 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:13.978 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025473+0000", 2020-11-16T20:56:13.978 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5754999999999996e-05 2020-11-16T20:56:13.978 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.978 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.979 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.979 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025539+0000", 2020-11-16T20:56:13.979 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029642330000000001 2020-11-16T20:56:13.979 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.979 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.979 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.979 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.980 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.980 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2351 4.2 4:540952ab:::smithi16641208-369:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e42)", 2020-11-16T20:56:13.980 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:04.995959+0000", 2020-11-16T20:56:13.980 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.8952716079999998, 2020-11-16T20:56:13.980 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030096398999999999, 2020-11-16T20:56:13.980 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.980 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:13.980 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.981 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.981 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.981 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2351 2020-11-16T20:56:13.981 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.981 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.981 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.981 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.982 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995959+0000", 2020-11-16T20:56:13.982 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.982 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.982 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.982 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.982 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995959+0000", 2020-11-16T20:56:13.982 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5330000000000001e-05 2020-11-16T20:56:13.983 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.983 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.983 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.983 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995975+0000", 2020-11-16T20:56:13.983 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.45e-06 2020-11-16T20:56:13.983 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.983 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.983 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.984 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995978+0000", 2020-11-16T20:56:13.984 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0909999999999998e-06 2020-11-16T20:56:13.984 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.984 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.984 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.984 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995984+0000", 2020-11-16T20:56:13.984 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6350000000000002e-06 2020-11-16T20:56:13.985 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.985 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.985 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.985 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995987+0000", 2020-11-16T20:56:13.985 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00037882600000000002 2020-11-16T20:56:13.985 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.985 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.985 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.986 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.996366+0000", 2020-11-16T20:56:13.986 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4063000000000002e-05 2020-11-16T20:56:13.986 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.986 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.986 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.986 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.996400+0000", 2020-11-16T20:56:13.986 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017796823 2020-11-16T20:56:13.987 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.987 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.987 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.987 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.014197+0000", 2020-11-16T20:56:13.987 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9716000000000005e-05 2020-11-16T20:56:13.987 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.987 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.987 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:13.988 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.014296+0000", 2020-11-16T20:56:13.988 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011288734999999999 2020-11-16T20:56:13.988 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.988 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.988 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.988 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025585+0000", 2020-11-16T20:56:13.988 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000152924 2020-11-16T20:56:13.989 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.989 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.989 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.989 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025738+0000", 2020-11-16T20:56:13.989 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00031780600000000001 2020-11-16T20:56:13.989 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.989 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.989 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:13.990 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.026056+0000", 2020-11-16T20:56:13.990 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030096398999999999 2020-11-16T20:56:13.990 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.990 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:13.990 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:13.990 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.990 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.991 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2364 4.2 4:646fee8a:::smithi16641208-407:head [write 1887942~537832] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:13.991 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.038059+0000", 2020-11-16T20:56:13.991 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.8531716090000003, 2020-11-16T20:56:13.991 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041814939000000002, 2020-11-16T20:56:13.991 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:13.991 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:13.991 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:13.991 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:13.992 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:13.992 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2364 2020-11-16T20:56:13.992 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.992 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:13.992 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.992 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:13.992 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038059+0000", 2020-11-16T20:56:13.993 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:13.993 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.993 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.993 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:13.993 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038059+0000", 2020-11-16T20:56:13.993 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017486300000000001 2020-11-16T20:56:13.993 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.993 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.994 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:13.994 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038234+0000", 2020-11-16T20:56:13.994 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2265e-05 2020-11-16T20:56:13.994 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.994 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.994 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:13.994 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038246+0000", 2020-11-16T20:56:13.995 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7935e-05 2020-11-16T20:56:13.995 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.995 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.995 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:13.995 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038264+0000", 2020-11-16T20:56:13.995 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2608e-05 2020-11-16T20:56:13.995 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.995 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.996 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:13.996 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038277+0000", 2020-11-16T20:56:13.996 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9994000000000002e-05 2020-11-16T20:56:13.996 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.996 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.996 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.996 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038337+0000", 2020-11-16T20:56:13.997 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8548999999999997e-05 2020-11-16T20:56:13.997 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.997 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.997 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:13.997 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038406+0000", 2020-11-16T20:56:13.997 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022992545 2020-11-16T20:56:13.997 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.998 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.998 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:13.998 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.061398+0000", 2020-11-16T20:56:13.998 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011551499999999999 2020-11-16T20:56:13.998 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.998 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.998 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:13.998 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.061514+0000", 2020-11-16T20:56:13.999 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018992799999999999 2020-11-16T20:56:13.999 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:13.999 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:13.999 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:13.999 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.061704+0000", 2020-11-16T20:56:13.999 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078335980000000006 2020-11-16T20:56:13.999 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.000 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.000 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:14.000 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.069537+0000", 2020-11-16T20:56:14.000 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0069952080000000002 2020-11-16T20:56:14.000 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.000 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.000 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:14.001 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076532+0000", 2020-11-16T20:56:14.001 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0032792590000000001 2020-11-16T20:56:14.001 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.001 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.001 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:14.001 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.079812+0000", 2020-11-16T20:56:14.001 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6931999999999998e-05 2020-11-16T20:56:14.001 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.002 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.002 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.002 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.079849+0000", 2020-11-16T20:56:14.002 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5740000000000001e-05 2020-11-16T20:56:14.002 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.002 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.002 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.003 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.079874+0000", 2020-11-16T20:56:14.003 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041814939000000002 2020-11-16T20:56:14.003 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.003 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.003 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.003 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.003 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.003 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2365 4.2 4:646fee8a:::smithi16641208-407:head [setxattr _header (57) in=7b,truncate 2756447] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:14.004 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.038336+0000", 2020-11-16T20:56:14.004 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.8528950369999997, 2020-11-16T20:56:14.004 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041675704000000001, 2020-11-16T20:56:14.004 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.004 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.004 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:14.004 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:14.004 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:14.005 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2365 2020-11-16T20:56:14.005 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.005 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.005 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.005 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.005 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038336+0000", 2020-11-16T20:56:14.005 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.006 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.006 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.006 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.006 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038336+0000", 2020-11-16T20:56:14.006 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4296999999999999e-05 2020-11-16T20:56:14.006 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.006 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.007 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.007 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038390+0000", 2020-11-16T20:56:14.007 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0770000000000002e-06 2020-11-16T20:56:14.007 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.007 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.007 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.007 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038397+0000", 2020-11-16T20:56:14.007 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1194e-05 2020-11-16T20:56:14.008 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.008 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.008 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.008 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038408+0000", 2020-11-16T20:56:14.008 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4639999999999997e-06 2020-11-16T20:56:14.008 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.008 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.009 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.009 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038414+0000", 2020-11-16T20:56:14.009 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2388000000000002e-05 2020-11-16T20:56:14.009 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.009 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.009 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.009 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038446+0000", 2020-11-16T20:56:14.009 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1230999999999999e-05 2020-11-16T20:56:14.010 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.010 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.010 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:14.010 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038488+0000", 2020-11-16T20:56:14.010 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030040847999999998 2020-11-16T20:56:14.010 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.010 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.011 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.011 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.068528+0000", 2020-11-16T20:56:14.011 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000171237 2020-11-16T20:56:14.011 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.011 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.011 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.011 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.068700+0000", 2020-11-16T20:56:14.011 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033098099999999999 2020-11-16T20:56:14.012 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.012 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.012 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:14.012 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.069031+0000", 2020-11-16T20:56:14.012 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061702559999999998 2020-11-16T20:56:14.012 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.012 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.013 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:14.013 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.075201+0000", 2020-11-16T20:56:14.013 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0013760949999999999 2020-11-16T20:56:14.013 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.013 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.013 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:14.013 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076577+0000", 2020-11-16T20:56:14.013 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033426459999999999 2020-11-16T20:56:14.014 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.014 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.014 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:14.014 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.079920+0000", 2020-11-16T20:56:14.014 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7162000000000001e-05 2020-11-16T20:56:14.014 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.014 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.014 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.015 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.079957+0000", 2020-11-16T20:56:14.015 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4827999999999998e-05 2020-11-16T20:56:14.015 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.015 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.015 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.015 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.080012+0000", 2020-11-16T20:56:14.015 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041675704000000001 2020-11-16T20:56:14.016 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.016 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.016 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.016 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.016 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2366 4.2 4:646fee8a:::smithi16641208-407:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e42)", 2020-11-16T20:56:14.016 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.038451+0000", 2020-11-16T20:56:14.016 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.8527800259999996, 2020-11-16T20:56:14.017 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041982845999999997, 2020-11-16T20:56:14.017 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.017 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:14.017 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:14.017 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:14.017 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:14.017 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2366 2020-11-16T20:56:14.018 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.018 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.018 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.018 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.018 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038451+0000", 2020-11-16T20:56:14.018 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.018 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.018 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.019 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.019 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038451+0000", 2020-11-16T20:56:14.019 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0439999999999999e-05 2020-11-16T20:56:14.019 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.019 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.019 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.019 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038491+0000", 2020-11-16T20:56:14.020 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5890000000000002e-06 2020-11-16T20:56:14.020 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.020 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.020 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.020 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038497+0000", 2020-11-16T20:56:14.020 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4161999999999999e-05 2020-11-16T20:56:14.020 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.020 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.021 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.021 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038511+0000", 2020-11-16T20:56:14.021 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.533e-06 2020-11-16T20:56:14.021 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.021 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.021 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.021 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038518+0000", 2020-11-16T20:56:14.022 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5011000000000001e-05 2020-11-16T20:56:14.022 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.022 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.022 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.022 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038553+0000", 2020-11-16T20:56:14.022 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5098000000000001e-05 2020-11-16T20:56:14.022 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.023 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.023 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:14.023 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038598+0000", 2020-11-16T20:56:14.023 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030972613999999999 2020-11-16T20:56:14.023 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.023 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.023 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.023 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.069570+0000", 2020-11-16T20:56:14.024 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000133509 2020-11-16T20:56:14.024 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.024 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.024 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:14.024 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.069704+0000", 2020-11-16T20:56:14.024 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010338886 2020-11-16T20:56:14.024 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.025 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.025 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.025 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.080043+0000", 2020-11-16T20:56:14.025 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4997e-05 2020-11-16T20:56:14.025 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.025 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.025 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.025 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.080118+0000", 2020-11-16T20:56:14.026 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00031600699999999998 2020-11-16T20:56:14.026 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.026 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.026 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.026 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.080434+0000", 2020-11-16T20:56:14.026 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041982845999999997 2020-11-16T20:56:14.026 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.027 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.027 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.027 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.027 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.027 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2367 4.2 4:581c1e5b:::smithi16641208-124:head [copy-from ver 55] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:14.027 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.038554+0000", 2020-11-16T20:56:14.027 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.8526765279999999, 2020-11-16T20:56:14.028 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037316112999999998, 2020-11-16T20:56:14.028 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.028 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.028 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:14.028 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:14.028 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:14.028 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2367 2020-11-16T20:56:14.029 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.029 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.029 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.029 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.029 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038554+0000", 2020-11-16T20:56:14.029 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.029 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.029 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.030 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.030 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038554+0000", 2020-11-16T20:56:14.030 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0499e-05 2020-11-16T20:56:14.030 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.030 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.030 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.030 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038595+0000", 2020-11-16T20:56:14.031 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2469999999999997e-06 2020-11-16T20:56:14.031 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.031 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.031 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.031 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038601+0000", 2020-11-16T20:56:14.031 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0334e-05 2020-11-16T20:56:14.031 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.031 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.032 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.032 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038611+0000", 2020-11-16T20:56:14.032 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4869999999999996e-06 2020-11-16T20:56:14.032 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.032 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.032 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.032 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038619+0000", 2020-11-16T20:56:14.033 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2597999999999999e-05 2020-11-16T20:56:14.033 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.033 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.033 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.033 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038642+0000", 2020-11-16T20:56:14.033 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.0017000000000003e-05 2020-11-16T20:56:14.033 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.033 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.034 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.034 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038722+0000", 2020-11-16T20:56:14.034 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013694288000000001 2020-11-16T20:56:14.034 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.034 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.034 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:14.034 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.052416+0000", 2020-11-16T20:56:14.035 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010514186999999999 2020-11-16T20:56:14.035 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.035 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.035 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:14.035 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.062930+0000", 2020-11-16T20:56:14.035 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0065865289999999998 2020-11-16T20:56:14.035 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.035 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.036 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:14.036 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.069517+0000", 2020-11-16T20:56:14.036 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0062547710000000001 2020-11-16T20:56:14.036 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.036 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.036 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:14.036 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.075771+0000", 2020-11-16T20:56:14.036 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0716e-05 2020-11-16T20:56:14.037 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.037 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.037 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.037 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.075822+0000", 2020-11-16T20:56:14.037 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8439999999999997e-05 2020-11-16T20:56:14.037 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.037 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.038 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.038 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.075870+0000", 2020-11-16T20:56:14.038 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037316112999999998 2020-11-16T20:56:14.038 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.038 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.038 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.038 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.039 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.039 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2368 4.2 4:581c1e5b:::smithi16641208-124:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e42)", 2020-11-16T20:56:14.039 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.038662+0000", 2020-11-16T20:56:14.039 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.8525687909999995, 2020-11-16T20:56:14.039 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037390824000000003, 2020-11-16T20:56:14.039 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.040 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:14.040 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:14.040 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:14.040 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:14.040 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2368 2020-11-16T20:56:14.040 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.040 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.041 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.041 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.041 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038662+0000", 2020-11-16T20:56:14.041 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.041 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.041 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.041 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.042 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038662+0000", 2020-11-16T20:56:14.042 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8368999999999999e-05 2020-11-16T20:56:14.042 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.042 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.042 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.042 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038690+0000", 2020-11-16T20:56:14.042 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2320000000000007e-06 2020-11-16T20:56:14.042 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.043 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.043 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.043 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038700+0000", 2020-11-16T20:56:14.043 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6840000000000001e-05 2020-11-16T20:56:14.043 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.043 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.043 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.044 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038717+0000", 2020-11-16T20:56:14.044 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3580000000000002e-06 2020-11-16T20:56:14.044 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.044 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.044 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.044 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038722+0000", 2020-11-16T20:56:14.044 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000148469 2020-11-16T20:56:14.044 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.045 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.045 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.045 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038870+0000", 2020-11-16T20:56:14.045 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8625000000000003e-05 2020-11-16T20:56:14.045 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.045 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.045 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:14.045 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038919+0000", 2020-11-16T20:56:14.046 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030826721000000001 2020-11-16T20:56:14.046 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.046 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.046 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.046 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.069746+0000", 2020-11-16T20:56:14.046 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011651500000000001 2020-11-16T20:56:14.046 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.047 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.047 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:14.047 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.069862+0000", 2020-11-16T20:56:14.047 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0060354850000000002 2020-11-16T20:56:14.047 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.047 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.047 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.048 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.075898+0000", 2020-11-16T20:56:14.048 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2551000000000003e-05 2020-11-16T20:56:14.048 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.048 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.048 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.048 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.075980+0000", 2020-11-16T20:56:14.048 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2658999999999997e-05 2020-11-16T20:56:14.049 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.049 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.049 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.049 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076053+0000", 2020-11-16T20:56:14.049 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037390824000000003 2020-11-16T20:56:14.049 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.049 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.050 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.050 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.050 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.050 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2376 4.2 4:540952ab:::smithi16641208-369:head [setxattr _header (57) in=7b,truncate 2790061] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:14.050 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.070033+0000", 2020-11-16T20:56:14.050 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.8211976369999991, 2020-11-16T20:56:14.050 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023378961, 2020-11-16T20:56:14.051 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.051 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.051 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:14.051 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:14.051 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:14.051 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2376 2020-11-16T20:56:14.051 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.051 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.052 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.052 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.052 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070033+0000", 2020-11-16T20:56:14.052 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.052 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.052 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.052 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.053 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070033+0000", 2020-11-16T20:56:14.053 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3158999999999998e-05 2020-11-16T20:56:14.053 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.053 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.053 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.053 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070076+0000", 2020-11-16T20:56:14.053 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8919999999999997e-06 2020-11-16T20:56:14.053 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.054 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.054 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.054 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070082+0000", 2020-11-16T20:56:14.054 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0039e-05 2020-11-16T20:56:14.054 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.054 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.054 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.055 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070092+0000", 2020-11-16T20:56:14.055 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1699999999999996e-06 2020-11-16T20:56:14.055 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.055 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.055 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.055 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070098+0000", 2020-11-16T20:56:14.055 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006570378 2020-11-16T20:56:14.056 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.056 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.056 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.056 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076668+0000", 2020-11-16T20:56:14.056 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012836600000000001 2020-11-16T20:56:14.056 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.056 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.056 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.057 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076796+0000", 2020-11-16T20:56:14.057 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000202857 2020-11-16T20:56:14.057 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.057 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.057 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:14.057 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076999+0000", 2020-11-16T20:56:14.057 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002782419 2020-11-16T20:56:14.057 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.058 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.058 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:14.058 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.079782+0000", 2020-11-16T20:56:14.058 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0036439520000000002 2020-11-16T20:56:14.058 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.058 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.058 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:14.059 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.083426+0000", 2020-11-16T20:56:14.059 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0098012419999999999 2020-11-16T20:56:14.059 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.059 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.059 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:14.059 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.093227+0000", 2020-11-16T20:56:14.059 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.5495999999999995e-05 2020-11-16T20:56:14.059 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.060 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.060 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.060 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.093322+0000", 2020-11-16T20:56:14.060 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9990999999999999e-05 2020-11-16T20:56:14.060 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.060 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.060 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.061 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.093412+0000", 2020-11-16T20:56:14.061 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023378961 2020-11-16T20:56:14.061 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.061 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.061 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.061 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.061 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.061 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2377 4.2 4:540952ab:::smithi16641208-369:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e42)", 2020-11-16T20:56:14.062 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.070126+0000", 2020-11-16T20:56:14.062 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.8211048269999992, 2020-11-16T20:56:14.062 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023513600999999999, 2020-11-16T20:56:14.062 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.062 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:14.062 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:14.062 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:14.063 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:14.063 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2377 2020-11-16T20:56:14.063 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.063 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.063 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.064 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.064 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070126+0000", 2020-11-16T20:56:14.064 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.064 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.065 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070126+0000", 2020-11-16T20:56:14.065 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7708999999999998e-05 2020-11-16T20:56:14.065 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070154+0000", 2020-11-16T20:56:14.066 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6370000000000004e-06 2020-11-16T20:56:14.066 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.066 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.066 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070159+0000", 2020-11-16T20:56:14.066 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0202e-05 2020-11-16T20:56:14.067 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.067 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.067 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.067 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070170+0000", 2020-11-16T20:56:14.067 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1049999999999997e-06 2020-11-16T20:56:14.067 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.067 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.067 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.068 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070174+0000", 2020-11-16T20:56:14.068 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0071943199999999997 2020-11-16T20:56:14.068 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.068 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.068 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.068 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.077368+0000", 2020-11-16T20:56:14.068 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000108006 2020-11-16T20:56:14.068 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.069 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.069 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:14.069 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.077476+0000", 2020-11-16T20:56:14.069 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01596991 2020-11-16T20:56:14.069 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.069 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.069 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.070 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.093446+0000", 2020-11-16T20:56:14.070 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.5842999999999997e-05 2020-11-16T20:56:14.070 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.070 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.070 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.071 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.093542+0000", 2020-11-16T20:56:14.071 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.7868999999999994e-05 2020-11-16T20:56:14.071 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.071 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.071 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.071 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.093640+0000", 2020-11-16T20:56:14.071 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023513600999999999 2020-11-16T20:56:14.071 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.072 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.072 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.072 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.072 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.072 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2418 4.2 4:724a4144:::smithi16641208-153:head [write 1438834~548839] snapc 7=[7,5] ondisk+write+known_if_redirected e46)", 2020-11-16T20:56:14.072 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.021448+0000", 2020-11-16T20:56:14.072 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 4.869782796, 2020-11-16T20:56:14.073 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032459158000000002, 2020-11-16T20:56:14.073 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.073 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.073 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:14.073 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:14.073 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:14.073 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2418 2020-11-16T20:56:14.073 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.074 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.074 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.074 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.074 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.021448+0000", 2020-11-16T20:56:14.074 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.074 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.074 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.075 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.075 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.021448+0000", 2020-11-16T20:56:14.075 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029617499999999998 2020-11-16T20:56:14.075 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.075 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.075 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.075 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.021744+0000", 2020-11-16T20:56:14.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7950000000000008e-06 2020-11-16T20:56:14.076 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.076 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.076 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.076 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.021752+0000", 2020-11-16T20:56:14.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4569999999999999e-05 2020-11-16T20:56:14.076 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.076 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.077 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.077 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.021767+0000", 2020-11-16T20:56:14.077 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7260000000000002e-06 2020-11-16T20:56:14.077 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.077 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.077 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.077 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.021774+0000", 2020-11-16T20:56:14.078 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9556999999999998e-05 2020-11-16T20:56:14.078 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.078 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.078 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.078 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.021804+0000", 2020-11-16T20:56:14.078 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0703e-05 2020-11-16T20:56:14.078 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.078 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.079 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:14.079 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.021845+0000", 2020-11-16T20:56:14.079 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017052996000000001 2020-11-16T20:56:14.079 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.079 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.079 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.079 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.038898+0000", 2020-11-16T20:56:14.080 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.7804000000000001e-05 2020-11-16T20:56:14.080 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.080 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.080 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.080 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.038995+0000", 2020-11-16T20:56:14.080 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000150631 2020-11-16T20:56:14.080 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.080 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.081 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:14.081 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.039146+0000", 2020-11-16T20:56:14.081 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035641010000000001 2020-11-16T20:56:14.081 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.081 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.081 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:14.081 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.042710+0000", 2020-11-16T20:56:14.081 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011018581 2020-11-16T20:56:14.082 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.082 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.082 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:14.082 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.053729+0000", 2020-11-16T20:56:14.082 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2806000000000006e-05 2020-11-16T20:56:14.082 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.082 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.083 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:14.083 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.053812+0000", 2020-11-16T20:56:14.083 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3730000000000003e-05 2020-11-16T20:56:14.083 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.083 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.083 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.083 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.053855+0000", 2020-11-16T20:56:14.083 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1983e-05 2020-11-16T20:56:14.084 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.084 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.084 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.084 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.053907+0000", 2020-11-16T20:56:14.084 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032459158000000002 2020-11-16T20:56:14.084 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.084 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.085 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.085 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.085 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.085 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2419 4.2 4:724a4144:::smithi16641208-153:head [write 2772623~84666] snapc 7=[7,5] ondisk+write+known_if_redirected e46)", 2020-11-16T20:56:14.085 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.026339+0000", 2020-11-16T20:56:14.085 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 4.8648921630000004, 2020-11-16T20:56:14.085 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.02778197, 2020-11-16T20:56:14.086 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.086 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.086 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:14.086 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:14.086 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:14.086 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2419 2020-11-16T20:56:14.086 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.087 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.087 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.087 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.087 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026339+0000", 2020-11-16T20:56:14.087 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.087 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.087 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.088 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.088 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026339+0000", 2020-11-16T20:56:14.088 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000438381 2020-11-16T20:56:14.088 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.088 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.088 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.088 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026777+0000", 2020-11-16T20:56:14.088 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6909999999999997e-06 2020-11-16T20:56:14.089 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.089 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.089 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.089 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026785+0000", 2020-11-16T20:56:14.089 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2333e-05 2020-11-16T20:56:14.089 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.089 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.089 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.090 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026797+0000", 2020-11-16T20:56:14.090 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0769999999999996e-06 2020-11-16T20:56:14.090 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.090 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.090 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.090 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026803+0000", 2020-11-16T20:56:14.090 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0915999999999999e-05 2020-11-16T20:56:14.091 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.091 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.091 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.091 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026844+0000", 2020-11-16T20:56:14.091 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9409e-05 2020-11-16T20:56:14.091 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.091 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.091 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:14.092 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026904+0000", 2020-11-16T20:56:14.092 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013496961 2020-11-16T20:56:14.092 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.092 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.092 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.092 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.040401+0000", 2020-11-16T20:56:14.092 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000107769 2020-11-16T20:56:14.092 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.093 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.093 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.093 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.040508+0000", 2020-11-16T20:56:14.093 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015488500000000001 2020-11-16T20:56:14.093 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.093 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.093 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:14.094 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.040663+0000", 2020-11-16T20:56:14.094 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0020556089999999999 2020-11-16T20:56:14.094 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.094 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.094 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:14.094 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.042719+0000", 2020-11-16T20:56:14.094 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011058805 2020-11-16T20:56:14.094 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.095 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.095 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:14.095 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.053778+0000", 2020-11-16T20:56:14.095 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00025737699999999999 2020-11-16T20:56:14.095 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.095 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.095 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:14.096 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.054035+0000", 2020-11-16T20:56:14.096 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1175999999999999e-05 2020-11-16T20:56:14.096 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.096 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.096 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.096 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.054086+0000", 2020-11-16T20:56:14.096 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4581e-05 2020-11-16T20:56:14.096 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.097 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.097 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.097 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.054121+0000", 2020-11-16T20:56:14.097 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.02778197 2020-11-16T20:56:14.097 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.097 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.097 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.097 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.098 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.098 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2420 4.2 4:724a4144:::smithi16641208-153:head [setxattr _header (57) in=7b,truncate 2857289] snapc 7=[7,5] ondisk+write+known_if_redirected e46)", 2020-11-16T20:56:14.098 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.026844+0000", 2020-11-16T20:56:14.098 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 4.8643873500000003, 2020-11-16T20:56:14.098 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027470980999999998, 2020-11-16T20:56:14.098 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.098 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.099 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:14.099 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:14.099 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:14.099 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2420 2020-11-16T20:56:14.099 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.099 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.099 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.099 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.100 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026844+0000", 2020-11-16T20:56:14.100 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.100 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.100 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.100 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.100 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026844+0000", 2020-11-16T20:56:14.100 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2929999999999997e-05 2020-11-16T20:56:14.101 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.101 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.101 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.101 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026886+0000", 2020-11-16T20:56:14.101 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5990000000000001e-06 2020-11-16T20:56:14.101 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.101 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.101 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.102 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026892+0000", 2020-11-16T20:56:14.102 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0091e-05 2020-11-16T20:56:14.102 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.102 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.102 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.102 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026902+0000", 2020-11-16T20:56:14.102 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2870000000000004e-06 2020-11-16T20:56:14.103 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.103 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.103 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.103 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026907+0000", 2020-11-16T20:56:14.103 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9246999999999995e-05 2020-11-16T20:56:14.103 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.103 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.103 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.104 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026987+0000", 2020-11-16T20:56:14.104 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5386e-05 2020-11-16T20:56:14.104 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.104 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.104 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:14.104 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.027052+0000", 2020-11-16T20:56:14.104 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014205850000000001 2020-11-16T20:56:14.104 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.105 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.105 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.105 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.041258+0000", 2020-11-16T20:56:14.105 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016296600000000001 2020-11-16T20:56:14.105 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.105 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.105 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.106 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.041421+0000", 2020-11-16T20:56:14.106 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000169118 2020-11-16T20:56:14.106 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.106 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.106 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:14.106 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.041590+0000", 2020-11-16T20:56:14.106 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0011468590000000001 2020-11-16T20:56:14.106 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.107 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.107 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:14.107 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.042737+0000", 2020-11-16T20:56:14.107 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011235906 2020-11-16T20:56:14.107 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.107 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.107 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:14.107 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.053973+0000", 2020-11-16T20:56:14.108 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000205262 2020-11-16T20:56:14.108 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.108 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.108 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:14.108 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.054178+0000", 2020-11-16T20:56:14.108 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2368999999999998e-05 2020-11-16T20:56:14.108 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.109 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.109 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.109 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.054250+0000", 2020-11-16T20:56:14.109 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4110999999999997e-05 2020-11-16T20:56:14.109 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.109 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.109 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.109 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.054315+0000", 2020-11-16T20:56:14.110 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027470980999999998 2020-11-16T20:56:14.110 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.110 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.110 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.110 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.110 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.110 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2421 4.2 4:724a4144:::smithi16641208-153:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e46)", 2020-11-16T20:56:14.111 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.026947+0000", 2020-11-16T20:56:14.111 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 4.8642838780000002, 2020-11-16T20:56:14.111 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027770521999999999, 2020-11-16T20:56:14.111 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.111 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:14.111 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:14.111 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:14.111 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:14.112 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2421 2020-11-16T20:56:14.112 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.112 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.112 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.112 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.112 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026947+0000", 2020-11-16T20:56:14.112 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.112 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.113 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.113 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026947+0000", 2020-11-16T20:56:14.113 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9481000000000001e-05 2020-11-16T20:56:14.113 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.113 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.114 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026977+0000", 2020-11-16T20:56:14.114 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8000000000000004e-06 2020-11-16T20:56:14.114 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.114 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.114 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.114 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026982+0000", 2020-11-16T20:56:14.114 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1068e-05 2020-11-16T20:56:14.114 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.115 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.115 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.115 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026993+0000", 2020-11-16T20:56:14.115 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8620000000000002e-06 2020-11-16T20:56:14.115 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.115 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.115 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.116 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026998+0000", 2020-11-16T20:56:14.116 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.0631999999999996e-05 2020-11-16T20:56:14.116 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.116 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.116 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.116 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.027079+0000", 2020-11-16T20:56:14.116 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6573000000000002e-05 2020-11-16T20:56:14.116 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.117 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.117 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:14.117 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.027135+0000", 2020-11-16T20:56:14.117 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014786033000000001 2020-11-16T20:56:14.117 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.117 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.117 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.118 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.041921+0000", 2020-11-16T20:56:14.118 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1741000000000003e-05 2020-11-16T20:56:14.118 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.118 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.118 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:14.118 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.041993+0000", 2020-11-16T20:56:14.118 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01234825 2020-11-16T20:56:14.118 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.119 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.119 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.119 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.054341+0000", 2020-11-16T20:56:14.119 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000106609 2020-11-16T20:56:14.119 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.119 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.119 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.120 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.054448+0000", 2020-11-16T20:56:14.120 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000269473 2020-11-16T20:56:14.120 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.120 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.120 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.120 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.054718+0000", 2020-11-16T20:56:14.120 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027770521999999999 2020-11-16T20:56:14.120 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.121 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.121 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.121 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.121 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.121 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:14.123 INFO:tasks.rados.rados.0.smithi166.stdout:616: done (0 left) 2020-11-16T20:56:14.123 INFO:tasks.rados.rados.0.smithi166.stdout:617: snap_remove snap 6 2020-11-16T20:56:14.123 INFO:teuthology.orchestra.run.smithi166.stderr:nodeep-scrub is unset 2020-11-16T20:56:14.123 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:14.127+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:14.124 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:56:14.223 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:14.228+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:14.288 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:14.288 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:14.288 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:56:14.289 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:14.297 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:56:14.324 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:14.328+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:14.426 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:14.430+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:14.463 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:14.463 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:14.463 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:56:14.463 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:56:14.464 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:14.472 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:56:14.555 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:14.560+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:14.626 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:14.631+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:14.639 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:14.639 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:56:14.639 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:56:14.639 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:56:14.639 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.640 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:170 3.0 e33/19 3:1e260d0e:::smithi16641208-43:head v 33'12, mlcod=33'10)", 2020-11-16T20:56:14.640 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.458057+0000", 2020-11-16T20:56:14.640 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 23.184842370999998, 2020-11-16T20:56:14.640 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040611839999999998, 2020-11-16T20:56:14.640 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.640 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.640 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.641 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.641 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.641 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458057+0000", 2020-11-16T20:56:14.641 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.641 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.641 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.641 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.642 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458057+0000", 2020-11-16T20:56:14.642 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000227333 2020-11-16T20:56:14.642 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.642 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.642 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.642 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458284+0000", 2020-11-16T20:56:14.642 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8389999999999996e-06 2020-11-16T20:56:14.643 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.643 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.643 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.643 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458293+0000", 2020-11-16T20:56:14.643 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9907999999999998e-05 2020-11-16T20:56:14.643 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.643 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.643 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.644 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458333+0000", 2020-11-16T20:56:14.644 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2132e-05 2020-11-16T20:56:14.644 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.644 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.644 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.644 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458345+0000", 2020-11-16T20:56:14.644 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0157000000000001e-05 2020-11-16T20:56:14.645 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.645 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.645 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.645 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458395+0000", 2020-11-16T20:56:14.645 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6659e-05 2020-11-16T20:56:14.645 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.645 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.645 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.646 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458422+0000", 2020-11-16T20:56:14.646 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0036338049999999999 2020-11-16T20:56:14.646 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.646 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.646 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.646 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.462056+0000", 2020-11-16T20:56:14.646 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2351e-05 2020-11-16T20:56:14.647 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.647 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.647 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.647 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.462118+0000", 2020-11-16T20:56:14.647 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040611839999999998 2020-11-16T20:56:14.647 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.647 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.647 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.648 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.648 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.648 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:890 3.0 e35/19 3:2209b6da:::smithi16641208-202:head v 35'131, mlcod=35'129)", 2020-11-16T20:56:14.648 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.078620+0000", 2020-11-16T20:56:14.648 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 20.564279326000001, 2020-11-16T20:56:14.648 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039687519999999999, 2020-11-16T20:56:14.648 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.649 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.649 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.649 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.649 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.649 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078620+0000", 2020-11-16T20:56:14.649 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.649 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.649 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.650 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.650 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078620+0000", 2020-11-16T20:56:14.650 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018733000000000001 2020-11-16T20:56:14.650 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.650 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.650 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.650 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078807+0000", 2020-11-16T20:56:14.651 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9799999999999993e-06 2020-11-16T20:56:14.651 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.651 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.651 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.651 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078817+0000", 2020-11-16T20:56:14.651 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5116000000000001e-05 2020-11-16T20:56:14.651 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.651 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.652 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.652 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078832+0000", 2020-11-16T20:56:14.652 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2634e-05 2020-11-16T20:56:14.652 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.652 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.652 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.652 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078845+0000", 2020-11-16T20:56:14.653 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1001999999999997e-05 2020-11-16T20:56:14.653 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.653 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.653 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.653 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078896+0000", 2020-11-16T20:56:14.653 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5238000000000001e-05 2020-11-16T20:56:14.653 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.654 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.654 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.654 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078921+0000", 2020-11-16T20:56:14.654 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035949210000000001 2020-11-16T20:56:14.654 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.654 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.654 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.654 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.082516+0000", 2020-11-16T20:56:14.655 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2531000000000001e-05 2020-11-16T20:56:14.655 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.655 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.655 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.655 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.082588+0000", 2020-11-16T20:56:14.655 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039687519999999999 2020-11-16T20:56:14.655 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.656 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.656 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.656 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.656 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.656 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:901 3.0 e35/19 3:29e07ad2:::smithi16641208-204:head v 35'134, mlcod=35'132)", 2020-11-16T20:56:14.656 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.128152+0000", 2020-11-16T20:56:14.656 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 20.514747112999999, 2020-11-16T20:56:14.656 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042710120000000002, 2020-11-16T20:56:14.657 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.657 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.657 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.657 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.657 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.657 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128152+0000", 2020-11-16T20:56:14.657 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.658 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.658 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.658 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.658 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128152+0000", 2020-11-16T20:56:14.658 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019783600000000001 2020-11-16T20:56:14.658 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.658 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.659 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.659 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128350+0000", 2020-11-16T20:56:14.659 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6030000000000005e-06 2020-11-16T20:56:14.659 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.659 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.659 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.659 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128358+0000", 2020-11-16T20:56:14.659 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2595999999999999e-05 2020-11-16T20:56:14.660 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.660 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.660 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.660 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128371+0000", 2020-11-16T20:56:14.660 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3209999999999999e-06 2020-11-16T20:56:14.660 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.660 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.660 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.661 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128378+0000", 2020-11-16T20:56:14.661 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4047e-05 2020-11-16T20:56:14.661 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.661 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.661 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.661 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128422+0000", 2020-11-16T20:56:14.661 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9796000000000001e-05 2020-11-16T20:56:14.662 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.662 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.662 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.662 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128452+0000", 2020-11-16T20:56:14.662 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039150929999999997 2020-11-16T20:56:14.662 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.662 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.662 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.663 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.132367+0000", 2020-11-16T20:56:14.663 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5720000000000002e-05 2020-11-16T20:56:14.663 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.663 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.663 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.663 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.132423+0000", 2020-11-16T20:56:14.663 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042710120000000002 2020-11-16T20:56:14.664 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.664 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.664 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.664 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.664 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.664 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:945 3.0 e35/19 3:0893b5ca:::smithi16641208-213:head v 35'145, mlcod=35'143)", 2020-11-16T20:56:14.664 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.298660+0000", 2020-11-16T20:56:14.664 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 20.344239549000001, 2020-11-16T20:56:14.665 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003872028, 2020-11-16T20:56:14.665 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.665 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.665 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.665 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.665 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.665 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298660+0000", 2020-11-16T20:56:14.666 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.666 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.666 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.666 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.666 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298660+0000", 2020-11-16T20:56:14.666 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000217042 2020-11-16T20:56:14.666 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.666 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.667 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.667 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298877+0000", 2020-11-16T20:56:14.667 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1629e-05 2020-11-16T20:56:14.667 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.667 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.667 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.667 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298888+0000", 2020-11-16T20:56:14.668 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7003999999999998e-05 2020-11-16T20:56:14.668 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.668 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.668 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.668 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298905+0000", 2020-11-16T20:56:14.668 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.5119999999999997e-06 2020-11-16T20:56:14.668 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.668 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.669 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.669 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298915+0000", 2020-11-16T20:56:14.669 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1298999999999997e-05 2020-11-16T20:56:14.669 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.669 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.669 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.669 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.298976+0000", 2020-11-16T20:56:14.669 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1288000000000003e-05 2020-11-16T20:56:14.670 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.670 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.670 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.670 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.299007+0000", 2020-11-16T20:56:14.670 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0034819920000000002 2020-11-16T20:56:14.670 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.670 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.671 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.671 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.302489+0000", 2020-11-16T20:56:14.671 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2262000000000003e-05 2020-11-16T20:56:14.671 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.671 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.671 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.671 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.302532+0000", 2020-11-16T20:56:14.671 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003872028 2020-11-16T20:56:14.672 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.672 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.672 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.672 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.672 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.672 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1028 3.0 e35/19 3:2e3eb594:::smithi16641208-229:head v 35'159, mlcod=35'157)", 2020-11-16T20:56:14.672 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.635550+0000", 2020-11-16T20:56:14.673 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 20.007348670999999, 2020-11-16T20:56:14.673 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042338380000000002, 2020-11-16T20:56:14.673 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.673 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.673 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.673 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.673 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.673 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635550+0000", 2020-11-16T20:56:14.674 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.674 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.674 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.674 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.674 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635550+0000", 2020-11-16T20:56:14.674 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018653699999999999 2020-11-16T20:56:14.674 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.675 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.675 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.675 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635737+0000", 2020-11-16T20:56:14.675 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.037e-06 2020-11-16T20:56:14.675 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.675 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.675 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.675 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635746+0000", 2020-11-16T20:56:14.676 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3001e-05 2020-11-16T20:56:14.676 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.676 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.676 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.676 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635759+0000", 2020-11-16T20:56:14.676 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7740000000000004e-06 2020-11-16T20:56:14.676 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.677 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.677 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.677 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635767+0000", 2020-11-16T20:56:14.677 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1385999999999999e-05 2020-11-16T20:56:14.677 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.677 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.677 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.677 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635818+0000", 2020-11-16T20:56:14.678 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6427e-05 2020-11-16T20:56:14.678 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.678 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.678 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.678 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635845+0000", 2020-11-16T20:56:14.678 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003885164 2020-11-16T20:56:14.678 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.679 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.679 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.679 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.639730+0000", 2020-11-16T20:56:14.679 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4512000000000003e-05 2020-11-16T20:56:14.679 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.679 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.679 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.679 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.639784+0000", 2020-11-16T20:56:14.680 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042338380000000002 2020-11-16T20:56:14.680 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.680 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.680 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.680 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.680 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.680 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1037 3.0 e35/19 3:0fda7169:::smithi16641208-231:head v 35'162, mlcod=35'160)", 2020-11-16T20:56:14.680 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.671040+0000", 2020-11-16T20:56:14.681 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 19.971859181999999, 2020-11-16T20:56:14.681 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040297739999999999, 2020-11-16T20:56:14.681 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.681 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.681 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.681 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.681 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.682 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671040+0000", 2020-11-16T20:56:14.682 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.682 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.682 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.682 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.682 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671040+0000", 2020-11-16T20:56:14.682 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012993299999999999 2020-11-16T20:56:14.682 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.683 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.683 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.683 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671170+0000", 2020-11-16T20:56:14.683 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9879999999999999e-06 2020-11-16T20:56:14.683 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.683 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.683 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.684 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671180+0000", 2020-11-16T20:56:14.684 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0243e-05 2020-11-16T20:56:14.684 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.684 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.684 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.684 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671190+0000", 2020-11-16T20:56:14.684 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4890000000000003e-06 2020-11-16T20:56:14.685 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.685 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.685 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.685 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671196+0000", 2020-11-16T20:56:14.685 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9298999999999997e-05 2020-11-16T20:56:14.685 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.685 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.685 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.686 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671245+0000", 2020-11-16T20:56:14.686 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4561000000000001e-05 2020-11-16T20:56:14.686 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.686 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.686 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.686 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671269+0000", 2020-11-16T20:56:14.686 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037448540000000002 2020-11-16T20:56:14.686 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.687 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.687 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.687 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.675014+0000", 2020-11-16T20:56:14.687 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5407e-05 2020-11-16T20:56:14.687 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.687 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.687 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.688 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.675070+0000", 2020-11-16T20:56:14.688 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040297739999999999 2020-11-16T20:56:14.688 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.688 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.688 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.688 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.688 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.688 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1102 3.0 e35/19 3:1c1ecb34:::smithi16641208-245:head v 35'172, mlcod=35'170)", 2020-11-16T20:56:14.689 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.920148+0000", 2020-11-16T20:56:14.689 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 19.722750785999999, 2020-11-16T20:56:14.689 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053854699999999998, 2020-11-16T20:56:14.689 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.689 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.689 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.689 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.690 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.690 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920148+0000", 2020-11-16T20:56:14.690 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.690 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.690 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.690 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.690 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920148+0000", 2020-11-16T20:56:14.690 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019421400000000001 2020-11-16T20:56:14.691 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.691 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.691 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.691 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920342+0000", 2020-11-16T20:56:14.691 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6169999999999996e-06 2020-11-16T20:56:14.691 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.691 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.692 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.692 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920352+0000", 2020-11-16T20:56:14.692 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3684e-05 2020-11-16T20:56:14.692 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.692 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.692 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.692 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920366+0000", 2020-11-16T20:56:14.692 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7789999999999996e-06 2020-11-16T20:56:14.693 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.693 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.693 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.693 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920374+0000", 2020-11-16T20:56:14.693 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8783999999999995e-05 2020-11-16T20:56:14.693 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.693 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.694 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.694 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920472+0000", 2020-11-16T20:56:14.694 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6865000000000001e-05 2020-11-16T20:56:14.694 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.694 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.694 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.694 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920499+0000", 2020-11-16T20:56:14.694 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004975246 2020-11-16T20:56:14.695 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.695 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.695 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.695 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.925474+0000", 2020-11-16T20:56:14.695 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9280999999999997e-05 2020-11-16T20:56:14.695 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.695 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.696 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.696 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.925534+0000", 2020-11-16T20:56:14.696 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053854699999999998 2020-11-16T20:56:14.696 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.696 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.696 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.696 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.696 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.697 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1198 3.0 e35/19 3:1b4407ea:::smithi16641208-269:head v 35'184, mlcod=35'182)", 2020-11-16T20:56:14.697 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.231667+0000", 2020-11-16T20:56:14.697 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 19.411231627999999, 2020-11-16T20:56:14.697 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041081770000000002, 2020-11-16T20:56:14.697 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.697 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.697 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.698 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.698 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.698 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231667+0000", 2020-11-16T20:56:14.698 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.698 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.698 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.698 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.698 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231667+0000", 2020-11-16T20:56:14.699 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018666399999999999 2020-11-16T20:56:14.699 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.699 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.699 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.699 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231854+0000", 2020-11-16T20:56:14.699 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.152e-05 2020-11-16T20:56:14.699 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.699 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.700 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.700 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231866+0000", 2020-11-16T20:56:14.700 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2456000000000002e-05 2020-11-16T20:56:14.700 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.700 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.700 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.700 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231898+0000", 2020-11-16T20:56:14.701 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6789999999999994e-06 2020-11-16T20:56:14.701 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.701 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.701 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.701 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231907+0000", 2020-11-16T20:56:14.701 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0732999999999997e-05 2020-11-16T20:56:14.701 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.701 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.702 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.702 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231957+0000", 2020-11-16T20:56:14.702 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9028000000000001e-05 2020-11-16T20:56:14.702 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.702 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.702 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.702 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231987+0000", 2020-11-16T20:56:14.703 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037323830000000001 2020-11-16T20:56:14.703 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.703 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.703 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.703 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.235719+0000", 2020-11-16T20:56:14.703 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6713999999999999e-05 2020-11-16T20:56:14.703 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.703 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.704 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.704 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.235776+0000", 2020-11-16T20:56:14.704 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041081770000000002 2020-11-16T20:56:14.704 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.704 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.704 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.704 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.705 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.705 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1235 3.0 e35/19 3:2294fced:::smithi16641208-278:head v 35'188, mlcod=35'185)", 2020-11-16T20:56:14.705 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.354799+0000", 2020-11-16T20:56:14.705 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 19.288099673000001, 2020-11-16T20:56:14.705 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050791389999999999, 2020-11-16T20:56:14.705 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.705 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.705 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.706 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.706 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.706 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354799+0000", 2020-11-16T20:56:14.706 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.706 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.706 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.706 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.707 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354799+0000", 2020-11-16T20:56:14.707 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2141000000000002e-05 2020-11-16T20:56:14.707 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.707 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.707 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.707 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354842+0000", 2020-11-16T20:56:14.707 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.601e-06 2020-11-16T20:56:14.707 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.708 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.708 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.708 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354848+0000", 2020-11-16T20:56:14.708 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.028e-05 2020-11-16T20:56:14.708 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.708 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.708 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.708 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354858+0000", 2020-11-16T20:56:14.709 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2959999999999998e-06 2020-11-16T20:56:14.709 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.709 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.709 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.709 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354864+0000", 2020-11-16T20:56:14.709 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3279999999999999e-05 2020-11-16T20:56:14.709 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.710 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.710 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.710 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354907+0000", 2020-11-16T20:56:14.710 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3655e-05 2020-11-16T20:56:14.710 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.710 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.710 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.710 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354931+0000", 2020-11-16T20:56:14.711 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004888875 2020-11-16T20:56:14.711 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.711 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.711 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.711 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.359820+0000", 2020-11-16T20:56:14.711 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9011000000000001e-05 2020-11-16T20:56:14.711 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.712 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.712 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.712 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.359879+0000", 2020-11-16T20:56:14.712 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050791389999999999 2020-11-16T20:56:14.712 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.712 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.712 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.712 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.713 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.713 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1237 3.0 e35/19 3:0b7cd9c0:::smithi16641208-279:head v 35'189, mlcod=35'187)", 2020-11-16T20:56:14.713 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.361967+0000", 2020-11-16T20:56:14.713 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 19.280932431, 2020-11-16T20:56:14.713 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041733320000000001, 2020-11-16T20:56:14.713 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.713 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.713 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.714 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.714 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.714 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.361967+0000", 2020-11-16T20:56:14.714 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.714 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.714 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.714 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.715 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.361967+0000", 2020-11-16T20:56:14.715 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045453300000000002 2020-11-16T20:56:14.715 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.715 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.715 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.715 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362421+0000", 2020-11-16T20:56:14.715 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1178999999999999e-05 2020-11-16T20:56:14.715 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.716 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.716 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.716 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362432+0000", 2020-11-16T20:56:14.716 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5865000000000001e-05 2020-11-16T20:56:14.716 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.716 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.716 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.717 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362448+0000", 2020-11-16T20:56:14.717 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9809999999999992e-06 2020-11-16T20:56:14.717 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.717 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.717 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.717 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362457+0000", 2020-11-16T20:56:14.717 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9304e-05 2020-11-16T20:56:14.717 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.718 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.718 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.718 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362516+0000", 2020-11-16T20:56:14.718 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2886000000000003e-05 2020-11-16T20:56:14.718 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.718 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.718 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.719 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362549+0000", 2020-11-16T20:56:14.719 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035249809999999999 2020-11-16T20:56:14.719 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.719 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.719 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.719 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.366074+0000", 2020-11-16T20:56:14.719 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5603000000000002e-05 2020-11-16T20:56:14.720 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.720 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.720 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.720 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.366140+0000", 2020-11-16T20:56:14.720 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041733320000000001 2020-11-16T20:56:14.720 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.720 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.720 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.721 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.721 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.721 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1262 3.0 e35/19 3:393883c7:::smithi16641208-285:head v 35'196, mlcod=35'194)", 2020-11-16T20:56:14.721 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.455617+0000", 2020-11-16T20:56:14.721 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 19.187282393, 2020-11-16T20:56:14.721 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039170029999999996, 2020-11-16T20:56:14.721 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.722 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.722 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.722 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.722 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.722 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455617+0000", 2020-11-16T20:56:14.722 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.722 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.722 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.723 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.723 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455617+0000", 2020-11-16T20:56:14.723 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00021765099999999999 2020-11-16T20:56:14.723 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.723 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.723 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.723 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455834+0000", 2020-11-16T20:56:14.723 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.296e-05 2020-11-16T20:56:14.724 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.724 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.724 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.724 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455847+0000", 2020-11-16T20:56:14.724 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2149e-05 2020-11-16T20:56:14.724 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.724 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.725 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.725 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455859+0000", 2020-11-16T20:56:14.725 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7663e-05 2020-11-16T20:56:14.725 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.725 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.725 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.725 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455877+0000", 2020-11-16T20:56:14.725 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6128000000000003e-05 2020-11-16T20:56:14.726 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.726 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.726 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.726 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455923+0000", 2020-11-16T20:56:14.726 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8368999999999999e-05 2020-11-16T20:56:14.726 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.726 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.727 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.727 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455952+0000", 2020-11-16T20:56:14.727 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035271780000000002 2020-11-16T20:56:14.727 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.727 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.727 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.727 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.459479+0000", 2020-11-16T20:56:14.727 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4904999999999997e-05 2020-11-16T20:56:14.728 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.728 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.728 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.728 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.459534+0000", 2020-11-16T20:56:14.728 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039170029999999996 2020-11-16T20:56:14.728 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.728 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.729 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.729 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.729 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.729 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1273 3.0 e35/19 3:2e8bdc7f:::smithi16641208-288:head v 35'198, mlcod=35'196)", 2020-11-16T20:56:14.729 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.489833+0000", 2020-11-16T20:56:14.729 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 19.153066159000002, 2020-11-16T20:56:14.729 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039382189999999997, 2020-11-16T20:56:14.729 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.730 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.730 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.730 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.730 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.730 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.489833+0000", 2020-11-16T20:56:14.730 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.730 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.731 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.731 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.731 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.489833+0000", 2020-11-16T20:56:14.731 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000194852 2020-11-16T20:56:14.731 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.731 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.731 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.731 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.490028+0000", 2020-11-16T20:56:14.732 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1319e-05 2020-11-16T20:56:14.732 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.732 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.732 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.732 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.490039+0000", 2020-11-16T20:56:14.732 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5579000000000001e-05 2020-11-16T20:56:14.732 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.732 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.733 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.733 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.490055+0000", 2020-11-16T20:56:14.733 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9619999999999999e-06 2020-11-16T20:56:14.733 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.733 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.733 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.733 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.490064+0000", 2020-11-16T20:56:14.733 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5654e-05 2020-11-16T20:56:14.734 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.734 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.734 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.734 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.490109+0000", 2020-11-16T20:56:14.734 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.472e-05 2020-11-16T20:56:14.734 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.734 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.735 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.735 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.490134+0000", 2020-11-16T20:56:14.735 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035931819999999999 2020-11-16T20:56:14.735 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.735 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.735 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.735 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.493727+0000", 2020-11-16T20:56:14.735 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3951e-05 2020-11-16T20:56:14.736 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.736 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.736 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.736 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.493771+0000", 2020-11-16T20:56:14.736 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039382189999999997 2020-11-16T20:56:14.736 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.736 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.737 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.737 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.737 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.737 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1311 3.0 e35/19 3:2e3f435b:::smithi16641208-296:head v 35'211, mlcod=35'209)", 2020-11-16T20:56:14.737 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.626771+0000", 2020-11-16T20:56:14.737 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 19.016127918999999, 2020-11-16T20:56:14.737 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0038662929999999998, 2020-11-16T20:56:14.737 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.738 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.738 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.738 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.738 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.738 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.626771+0000", 2020-11-16T20:56:14.738 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.738 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.738 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.739 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.739 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.626771+0000", 2020-11-16T20:56:14.739 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000138097 2020-11-16T20:56:14.739 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.739 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.739 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.739 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.626909+0000", 2020-11-16T20:56:14.740 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7810000000000002e-06 2020-11-16T20:56:14.740 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.740 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.740 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.740 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.626915+0000", 2020-11-16T20:56:14.740 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0280000000000003e-06 2020-11-16T20:56:14.740 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.740 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.741 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.741 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.626922+0000", 2020-11-16T20:56:14.741 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4429999999999996e-06 2020-11-16T20:56:14.741 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.741 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.741 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.741 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.626926+0000", 2020-11-16T20:56:14.742 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9570000000000002e-05 2020-11-16T20:56:14.742 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.742 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.742 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.742 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.626966+0000", 2020-11-16T20:56:14.742 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4292000000000001e-05 2020-11-16T20:56:14.742 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.742 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.743 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.743 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.626990+0000", 2020-11-16T20:56:14.743 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0036085119999999999 2020-11-16T20:56:14.743 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.743 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.743 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.743 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.630599+0000", 2020-11-16T20:56:14.744 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8569999999999998e-05 2020-11-16T20:56:14.744 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.744 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.744 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.744 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.630637+0000", 2020-11-16T20:56:14.744 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0038662929999999998 2020-11-16T20:56:14.744 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.744 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.745 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.745 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.745 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.745 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1423 3.0 e36/19 3:1e5364a0:::smithi16641208-320:head v 36'221, mlcod=35'219)", 2020-11-16T20:56:14.745 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.033789+0000", 2020-11-16T20:56:14.745 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 18.609110041000001, 2020-11-16T20:56:14.745 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041251339999999999, 2020-11-16T20:56:14.745 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.746 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.746 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.746 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.746 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.746 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033789+0000", 2020-11-16T20:56:14.746 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.746 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.747 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.747 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.747 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033789+0000", 2020-11-16T20:56:14.747 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015644000000000001 2020-11-16T20:56:14.747 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.747 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.747 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.747 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033945+0000", 2020-11-16T20:56:14.748 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0270000000000003e-06 2020-11-16T20:56:14.748 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.748 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.748 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.748 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033950+0000", 2020-11-16T20:56:14.748 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6420000000000007e-06 2020-11-16T20:56:14.748 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.749 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.749 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.749 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033958+0000", 2020-11-16T20:56:14.749 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.477e-06 2020-11-16T20:56:14.749 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.749 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.749 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.749 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033965+0000", 2020-11-16T20:56:14.750 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9178999999999998e-05 2020-11-16T20:56:14.750 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.750 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.750 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.750 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.034014+0000", 2020-11-16T20:56:14.750 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2172e-05 2020-11-16T20:56:14.750 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.751 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.751 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.751 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.034036+0000", 2020-11-16T20:56:14.751 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0038237190000000002 2020-11-16T20:56:14.751 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.751 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.751 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.752 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.037860+0000", 2020-11-16T20:56:14.752 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4478000000000003e-05 2020-11-16T20:56:14.752 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.752 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.752 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.752 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.037914+0000", 2020-11-16T20:56:14.752 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041251339999999999 2020-11-16T20:56:14.752 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.753 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.753 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.753 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.753 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.753 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1468 3.0 e36/19 3:1852173c:::smithi16641208-329:head v 36'238, mlcod=36'236)", 2020-11-16T20:56:14.753 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.208167+0000", 2020-11-16T20:56:14.753 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 18.434732267000001, 2020-11-16T20:56:14.753 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052481979999999999, 2020-11-16T20:56:14.754 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.754 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.754 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.754 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.754 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.754 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208167+0000", 2020-11-16T20:56:14.754 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.755 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.755 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.755 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.755 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208167+0000", 2020-11-16T20:56:14.755 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013521900000000001 2020-11-16T20:56:14.755 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.755 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.755 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.756 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208302+0000", 2020-11-16T20:56:14.756 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1307e-05 2020-11-16T20:56:14.756 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.756 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.756 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.756 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208313+0000", 2020-11-16T20:56:14.756 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2828e-05 2020-11-16T20:56:14.757 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.757 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.757 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.757 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208326+0000", 2020-11-16T20:56:14.757 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8889999999999996e-06 2020-11-16T20:56:14.757 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.757 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.757 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.758 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208333+0000", 2020-11-16T20:56:14.758 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2843999999999999e-05 2020-11-16T20:56:14.758 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.758 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.758 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.758 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208366+0000", 2020-11-16T20:56:14.758 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4986e-05 2020-11-16T20:56:14.759 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.759 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.759 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.759 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208381+0000", 2020-11-16T20:56:14.759 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0049810990000000001 2020-11-16T20:56:14.759 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.759 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.759 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.760 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.213362+0000", 2020-11-16T20:56:14.760 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3025999999999997e-05 2020-11-16T20:56:14.760 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.760 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.760 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.760 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.213415+0000", 2020-11-16T20:56:14.760 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052481979999999999 2020-11-16T20:56:14.760 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.761 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.761 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.761 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.761 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.761 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1490 3.0 e36/19 3:10845e0e:::smithi16641208-333:head v 36'252, mlcod=36'250)", 2020-11-16T20:56:14.761 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.301912+0000", 2020-11-16T20:56:14.761 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 18.340987264999999, 2020-11-16T20:56:14.762 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044835179999999997, 2020-11-16T20:56:14.762 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.762 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.762 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.762 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.762 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.762 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.301912+0000", 2020-11-16T20:56:14.762 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.763 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.763 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.763 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.763 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.301912+0000", 2020-11-16T20:56:14.763 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114265 2020-11-16T20:56:14.763 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.763 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.764 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.764 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302026+0000", 2020-11-16T20:56:14.764 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7940000000000008e-06 2020-11-16T20:56:14.764 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.764 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.764 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.764 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302035+0000", 2020-11-16T20:56:14.764 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5187e-05 2020-11-16T20:56:14.765 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.765 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.765 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.765 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302050+0000", 2020-11-16T20:56:14.765 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.653e-06 2020-11-16T20:56:14.765 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.765 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.765 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.766 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302059+0000", 2020-11-16T20:56:14.766 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8010000000000003e-05 2020-11-16T20:56:14.766 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.766 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.766 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.766 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302107+0000", 2020-11-16T20:56:14.766 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5335000000000001e-05 2020-11-16T20:56:14.767 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.767 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.767 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.767 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302132+0000", 2020-11-16T20:56:14.767 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042049239999999996 2020-11-16T20:56:14.767 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.767 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.767 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.768 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.306337+0000", 2020-11-16T20:56:14.768 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8350000000000002e-05 2020-11-16T20:56:14.768 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.768 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.768 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.768 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.306395+0000", 2020-11-16T20:56:14.768 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044835179999999997 2020-11-16T20:56:14.769 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.769 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.769 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.769 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.769 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.769 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1491 3.0 e36/19 3:10845e0e:::smithi16641208-333:head v 36'253, mlcod=36'250)", 2020-11-16T20:56:14.769 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.302814+0000", 2020-11-16T20:56:14.769 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 18.340085104, 2020-11-16T20:56:14.770 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039006700000000002, 2020-11-16T20:56:14.770 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.770 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.770 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.770 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.770 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.770 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302814+0000", 2020-11-16T20:56:14.771 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.771 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.771 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.771 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.771 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302814+0000", 2020-11-16T20:56:14.771 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5510999999999998e-05 2020-11-16T20:56:14.771 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.771 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.772 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.772 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302859+0000", 2020-11-16T20:56:14.772 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3980000000000002e-06 2020-11-16T20:56:14.772 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.772 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.772 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.772 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302867+0000", 2020-11-16T20:56:14.773 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0713999999999999e-05 2020-11-16T20:56:14.773 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.773 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.773 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.773 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302878+0000", 2020-11-16T20:56:14.773 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7679999999999997e-06 2020-11-16T20:56:14.773 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.773 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.774 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.774 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302883+0000", 2020-11-16T20:56:14.774 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0617000000000001e-05 2020-11-16T20:56:14.774 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.774 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.774 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.774 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302924+0000", 2020-11-16T20:56:14.775 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4732999999999999e-05 2020-11-16T20:56:14.775 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.775 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.775 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.775 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302949+0000", 2020-11-16T20:56:14.775 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037127919999999999 2020-11-16T20:56:14.775 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.775 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.776 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.776 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.306661+0000", 2020-11-16T20:56:14.776 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3137000000000003e-05 2020-11-16T20:56:14.776 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.776 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.776 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.776 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.306715+0000", 2020-11-16T20:56:14.776 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039006700000000002 2020-11-16T20:56:14.777 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.777 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.777 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.777 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.777 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.777 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:534 3.0 e46/19 3:10845e0e:::smithi16641208-333:5 v 46'391, mlcod=45'385)", 2020-11-16T20:56:14.777 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.013124+0000", 2020-11-16T20:56:14.778 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.6297746929999999, 2020-11-16T20:56:14.778 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050053900000000002, 2020-11-16T20:56:14.778 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.778 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.778 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.778 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.778 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.778 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013124+0000", 2020-11-16T20:56:14.779 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.779 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.779 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.779 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.779 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013124+0000", 2020-11-16T20:56:14.779 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9255999999999997e-05 2020-11-16T20:56:14.779 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.780 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.780 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.780 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013174+0000", 2020-11-16T20:56:14.780 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5140000000000004e-06 2020-11-16T20:56:14.780 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.780 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.780 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.780 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013181+0000", 2020-11-16T20:56:14.781 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1279e-05 2020-11-16T20:56:14.781 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.781 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.781 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.781 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013192+0000", 2020-11-16T20:56:14.781 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0970000000000002e-06 2020-11-16T20:56:14.781 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.781 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.782 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.782 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013199+0000", 2020-11-16T20:56:14.782 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5442e-05 2020-11-16T20:56:14.782 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.782 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.782 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.782 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013284+0000", 2020-11-16T20:56:14.783 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8368e-05 2020-11-16T20:56:14.783 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.783 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.783 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.783 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013312+0000", 2020-11-16T20:56:14.783 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0047640549999999997 2020-11-16T20:56:14.783 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.783 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.784 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.784 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.018076+0000", 2020-11-16T20:56:14.784 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3378999999999998e-05 2020-11-16T20:56:14.784 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.784 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.784 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.784 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.018130+0000", 2020-11-16T20:56:14.784 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050053900000000002 2020-11-16T20:56:14.785 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.785 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.785 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.785 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.785 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.785 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:553 3.0 e51/19 3:0980614a:::smithi16641208-158:d v 51'399, mlcod=48'395)", 2020-11-16T20:56:14.785 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.036559+0000", 2020-11-16T20:56:14.786 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.60633963199999996, 2020-11-16T20:56:14.786 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0057593829999999999, 2020-11-16T20:56:14.786 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.786 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.786 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.786 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.786 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.786 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036559+0000", 2020-11-16T20:56:14.787 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.787 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.787 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.787 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.787 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036559+0000", 2020-11-16T20:56:14.787 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3611000000000001e-05 2020-11-16T20:56:14.787 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.788 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.788 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.788 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036593+0000", 2020-11-16T20:56:14.788 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6789999999999996e-06 2020-11-16T20:56:14.788 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.788 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.788 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.789 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036598+0000", 2020-11-16T20:56:14.789 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1350000000000003e-06 2020-11-16T20:56:14.789 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.789 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.789 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.789 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036605+0000", 2020-11-16T20:56:14.789 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5200000000000003e-06 2020-11-16T20:56:14.789 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.790 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.790 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.790 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036611+0000", 2020-11-16T20:56:14.790 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1322000000000001e-05 2020-11-16T20:56:14.790 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.790 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.790 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.790 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036663+0000", 2020-11-16T20:56:14.791 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8333000000000001e-05 2020-11-16T20:56:14.791 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.791 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.791 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.791 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036691+0000", 2020-11-16T20:56:14.791 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0055720800000000001 2020-11-16T20:56:14.791 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.792 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.792 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.792 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.042263+0000", 2020-11-16T20:56:14.792 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5702999999999998e-05 2020-11-16T20:56:14.792 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.792 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.792 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.792 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.042319+0000", 2020-11-16T20:56:14.793 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0057593829999999999 2020-11-16T20:56:14.793 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.793 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.793 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.793 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.793 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.793 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:556 3.0 e51/19 3:03c93966:::smithi16641208-422:e v 51'401, mlcod=48'395)", 2020-11-16T20:56:14.793 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.037559+0000", 2020-11-16T20:56:14.794 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.60533992800000003, 2020-11-16T20:56:14.794 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052553039999999997, 2020-11-16T20:56:14.794 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:14.794 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:14.794 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:14.794 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.794 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:14.795 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037559+0000", 2020-11-16T20:56:14.795 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:14.795 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.795 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.795 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:14.795 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037559+0000", 2020-11-16T20:56:14.795 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2685999999999998e-05 2020-11-16T20:56:14.795 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.796 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.796 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:14.796 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037592+0000", 2020-11-16T20:56:14.796 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1830000000000002e-06 2020-11-16T20:56:14.796 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.796 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.796 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:14.797 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037597+0000", 2020-11-16T20:56:14.797 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0809999999999996e-06 2020-11-16T20:56:14.797 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.797 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.797 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:14.797 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037604+0000", 2020-11-16T20:56:14.797 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.361e-06 2020-11-16T20:56:14.797 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.798 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:14.798 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037609+0000", 2020-11-16T20:56:14.798 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00041286099999999999 2020-11-16T20:56:14.798 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.798 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:14.799 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.038022+0000", 2020-11-16T20:56:14.799 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4833000000000001e-05 2020-11-16T20:56:14.799 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.799 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.799 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:14.799 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.038047+0000", 2020-11-16T20:56:14.799 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0047145110000000002 2020-11-16T20:56:14.799 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.800 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.800 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:14.800 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.042762+0000", 2020-11-16T20:56:14.800 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2787999999999997e-05 2020-11-16T20:56:14.800 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:14.800 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:14.800 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:14.801 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.042814+0000", 2020-11-16T20:56:14.801 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052553039999999997 2020-11-16T20:56:14.801 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.801 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.801 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.801 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:14.801 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:14.801 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:14.803 INFO:tasks.rados.rados.0.smithi166.stdout:617: done (0 left) 2020-11-16T20:56:14.803 INFO:tasks.rados.rados.0.smithi166.stdout:618: write oid 136 current snap is 10 2020-11-16T20:56:14.803 INFO:tasks.rados.rados.0.smithi166.stdout:618: seq_num 535 ranges {591745=402925,1790337=563515} 2020-11-16T20:56:14.803 INFO:tasks.rados.rados.0.smithi166.stdout:618: writing smithi16641208-136 from 591745 to 994670 tid 1 2020-11-16T20:56:14.804 INFO:tasks.rados.rados.0.smithi166.stdout:618: writing smithi16641208-136 from 1790337 to 2353852 tid 2 2020-11-16T20:56:14.804 INFO:tasks.rados.rados.0.smithi166.stdout:619: read oid 361 snap -1 2020-11-16T20:56:14.804 INFO:tasks.rados.rados.0.smithi166.stdout:619: expect (ObjNum 360 snap 0 seq_num 360) 2020-11-16T20:56:14.804 INFO:tasks.rados.rados.0.smithi166.stdout:620: snap_create 2020-11-16T20:56:14.804 INFO:tasks.rados.rados.0.smithi166.stdout:619: expect (ObjNum 360 snap 0 seq_num 360) 2020-11-16T20:56:14.804 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:14.808+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:14.805 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:56:14.823 INFO:tasks.rados.rados.0.smithi166.stdout:618: finishing write tid 1 to smithi16641208-136 2020-11-16T20:56:14.831 INFO:tasks.rados.rados.0.smithi166.stdout:618: finishing write tid 2 to smithi16641208-136 2020-11-16T20:56:14.831 INFO:tasks.rados.rados.0.smithi166.stdout:618: finishing write tid 3 to smithi16641208-136 2020-11-16T20:56:14.832 INFO:tasks.rados.rados.0.smithi166.stdout:618: finishing write tid 4 to smithi16641208-136 2020-11-16T20:56:14.832 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 136 v 546 (ObjNum 535 snap 10 seq_num 535) dirty exists 2020-11-16T20:56:14.833 INFO:tasks.rados.rados.0.smithi166.stdout:618: left oid 136 (ObjNum 535 snap 10 seq_num 535) 2020-11-16T20:56:14.903 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:14.907+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:14.970 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:14.971 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:14.971 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:56:14.971 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:14.981 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:56:15.003 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:15.008+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:15.104 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:15.108+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:15.150 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:15.150 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:15.151 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:56:15.151 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:56:15.151 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:15.159 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:56:15.204 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:15.209+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:15.287 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:15.287 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:56:15.287 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:56:15.287 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:56:15.287 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.288 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1100 4.0 4:1e86053b:::smithi16641208-244:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:56:15.288 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.904112+0000", 2020-11-16T20:56:15.288 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 20.385795027, 2020-11-16T20:56:15.288 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021275207000000001, 2020-11-16T20:56:15.288 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:15.288 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:15.288 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:15.288 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:15.289 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:15.289 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1100 2020-11-16T20:56:15.289 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.289 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:15.289 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.289 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:15.289 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904112+0000", 2020-11-16T20:56:15.290 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:15.290 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.290 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.290 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:15.290 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904112+0000", 2020-11-16T20:56:15.290 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2320999999999998e-05 2020-11-16T20:56:15.290 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.291 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.291 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:15.291 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904144+0000", 2020-11-16T20:56:15.291 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8300000000000001e-06 2020-11-16T20:56:15.291 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.291 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.291 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:15.291 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904150+0000", 2020-11-16T20:56:15.292 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2289999999999999e-05 2020-11-16T20:56:15.292 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.292 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.292 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:15.292 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904162+0000", 2020-11-16T20:56:15.292 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1189999999999999e-06 2020-11-16T20:56:15.292 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.292 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.293 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:15.293 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904166+0000", 2020-11-16T20:56:15.293 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00041665099999999998 2020-11-16T20:56:15.293 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.293 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.293 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.293 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904583+0000", 2020-11-16T20:56:15.294 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4852999999999999e-05 2020-11-16T20:56:15.294 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.294 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.294 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:15.294 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.904628+0000", 2020-11-16T20:56:15.294 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012226348999999999 2020-11-16T20:56:15.294 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.294 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.295 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.295 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.916854+0000", 2020-11-16T20:56:15.295 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000130242 2020-11-16T20:56:15.295 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.295 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.295 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:15.295 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.916984+0000", 2020-11-16T20:56:15.296 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078369049999999999 2020-11-16T20:56:15.296 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.296 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.296 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.296 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.924821+0000", 2020-11-16T20:56:15.296 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9945999999999997e-05 2020-11-16T20:56:15.296 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.296 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.297 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:15.297 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.924901+0000", 2020-11-16T20:56:15.297 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000485701 2020-11-16T20:56:15.297 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.297 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.297 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:15.297 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.925387+0000", 2020-11-16T20:56:15.297 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021275207000000001 2020-11-16T20:56:15.298 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.298 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:15.298 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.298 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.298 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.298 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:201 3.2 3:515e6cf6:::smithi16641208-22:head [copy-from ver 21] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e35)", 2020-11-16T20:56:15.298 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.969037+0000", 2020-11-16T20:56:15.299 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 20.320869478999999, 2020-11-16T20:56:15.299 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021703407000000001, 2020-11-16T20:56:15.299 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:15.299 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:15.299 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:15.299 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.299 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:15.299 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969037+0000", 2020-11-16T20:56:15.300 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:15.300 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.300 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.300 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:15.300 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969037+0000", 2020-11-16T20:56:15.300 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1260000000000006e-05 2020-11-16T20:56:15.300 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.301 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.301 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:15.301 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969099+0000", 2020-11-16T20:56:15.301 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8179999999999993e-06 2020-11-16T20:56:15.301 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.301 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.301 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:15.301 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969107+0000", 2020-11-16T20:56:15.302 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.428e-05 2020-11-16T20:56:15.302 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.302 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.302 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:15.302 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969122+0000", 2020-11-16T20:56:15.302 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9359999999999999e-06 2020-11-16T20:56:15.302 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.303 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.303 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:15.303 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969130+0000", 2020-11-16T20:56:15.303 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000117713 2020-11-16T20:56:15.303 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.303 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.303 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.303 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969247+0000", 2020-11-16T20:56:15.304 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014414199999999999 2020-11-16T20:56:15.304 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.304 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.304 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:15.304 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969391+0000", 2020-11-16T20:56:15.304 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.005648737 2020-11-16T20:56:15.304 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.304 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.305 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:15.305 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.975040+0000", 2020-11-16T20:56:15.305 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011700868999999999 2020-11-16T20:56:15.305 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.305 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.305 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:15.305 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.986741+0000", 2020-11-16T20:56:15.306 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00078654400000000002 2020-11-16T20:56:15.306 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.306 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.306 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:15.306 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987528+0000", 2020-11-16T20:56:15.306 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030922979999999998 2020-11-16T20:56:15.306 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.306 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.307 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:15.307 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.990620+0000", 2020-11-16T20:56:15.307 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9068999999999999e-05 2020-11-16T20:56:15.307 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.307 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.307 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:15.307 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.990689+0000", 2020-11-16T20:56:15.307 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1740999999999998e-05 2020-11-16T20:56:15.308 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.308 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.308 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:15.308 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.990741+0000", 2020-11-16T20:56:15.308 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021703407000000001 2020-11-16T20:56:15.308 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.308 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:15.309 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.309 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.309 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.309 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:202 3.2 3:5723fd94:::smithi16641208-211:head [copy-from ver 110] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e35)", 2020-11-16T20:56:15.309 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:56:15.309 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 20.320726263000001, 2020-11-16T20:56:15.309 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027790216999999999, 2020-11-16T20:56:15.309 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:15.310 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:15.310 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:15.310 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.310 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:15.310 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:56:15.310 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:15.310 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.311 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.311 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:15.311 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:56:15.311 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1907999999999998e-05 2020-11-16T20:56:15.311 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.311 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.311 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:15.311 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969232+0000", 2020-11-16T20:56:15.312 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5270000000000004e-06 2020-11-16T20:56:15.312 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.312 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.312 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:15.312 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969239+0000", 2020-11-16T20:56:15.312 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3062e-05 2020-11-16T20:56:15.312 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.313 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:15.313 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969252+0000", 2020-11-16T20:56:15.313 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8919999999999997e-06 2020-11-16T20:56:15.313 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.313 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:15.313 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969258+0000", 2020-11-16T20:56:15.314 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00040859799999999998 2020-11-16T20:56:15.314 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.314 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.314 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.314 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969666+0000", 2020-11-16T20:56:15.314 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0932000000000003e-05 2020-11-16T20:56:15.314 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.315 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.315 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:15.315 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969757+0000", 2020-11-16T20:56:15.315 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010999395 2020-11-16T20:56:15.315 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.315 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.315 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:15.315 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.980757+0000", 2020-11-16T20:56:15.316 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006260659 2020-11-16T20:56:15.316 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.316 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.316 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:15.316 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987017+0000", 2020-11-16T20:56:15.316 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0080836880000000003 2020-11-16T20:56:15.316 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.317 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.317 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:15.317 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995101+0000", 2020-11-16T20:56:15.317 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001796829 2020-11-16T20:56:15.317 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.317 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.317 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:15.317 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996898+0000", 2020-11-16T20:56:15.318 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2086000000000003e-05 2020-11-16T20:56:15.318 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.318 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.318 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:15.318 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996940+0000", 2020-11-16T20:56:15.318 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0641e-05 2020-11-16T20:56:15.318 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.319 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.319 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:15.319 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996971+0000", 2020-11-16T20:56:15.319 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027790216999999999 2020-11-16T20:56:15.319 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.319 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:15.319 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.319 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.320 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.320 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1122 3.2 3:7ef90409:::smithi16641208-250:head [write 1587781~597162] snapc 0=[] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e35)", 2020-11-16T20:56:15.320 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.983325+0000", 2020-11-16T20:56:15.320 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 20.306581360999999, 2020-11-16T20:56:15.320 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019229049000000002, 2020-11-16T20:56:15.320 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:15.320 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:15.320 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:15.321 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.321 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:15.321 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983325+0000", 2020-11-16T20:56:15.321 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:15.321 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.321 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.321 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:15.322 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983325+0000", 2020-11-16T20:56:15.322 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015493500000000001 2020-11-16T20:56:15.322 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.322 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.322 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:15.322 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983480+0000", 2020-11-16T20:56:15.322 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4990000000000002e-06 2020-11-16T20:56:15.322 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.323 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.323 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:15.323 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983486+0000", 2020-11-16T20:56:15.323 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7037e-05 2020-11-16T20:56:15.323 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.323 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.323 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:15.323 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983503+0000", 2020-11-16T20:56:15.324 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6639999999999998e-06 2020-11-16T20:56:15.324 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.324 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.324 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:15.324 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983511+0000", 2020-11-16T20:56:15.324 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003260757 2020-11-16T20:56:15.324 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.325 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.325 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.325 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.986771+0000", 2020-11-16T20:56:15.325 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000136346 2020-11-16T20:56:15.325 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.325 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.325 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:15.325 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.986908+0000", 2020-11-16T20:56:15.326 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010723052 2020-11-16T20:56:15.326 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.326 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.326 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.326 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.997631+0000", 2020-11-16T20:56:15.326 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5947999999999998e-05 2020-11-16T20:56:15.326 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.327 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.327 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:15.327 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.997717+0000", 2020-11-16T20:56:15.327 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016206200000000001 2020-11-16T20:56:15.327 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.327 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.327 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:15.327 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.997879+0000", 2020-11-16T20:56:15.328 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003597205 2020-11-16T20:56:15.328 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.328 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.328 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:15.328 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.001476+0000", 2020-11-16T20:56:15.328 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1767000000000001e-05 2020-11-16T20:56:15.328 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.328 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.329 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:15.329 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.001528+0000", 2020-11-16T20:56:15.329 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00085415100000000004 2020-11-16T20:56:15.329 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.329 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.329 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:15.329 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002382+0000", 2020-11-16T20:56:15.330 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000102564 2020-11-16T20:56:15.330 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.330 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.330 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:15.330 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002484+0000", 2020-11-16T20:56:15.330 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0061999999999994e-05 2020-11-16T20:56:15.330 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.330 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.331 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:15.331 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002554+0000", 2020-11-16T20:56:15.331 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019229049000000002 2020-11-16T20:56:15.331 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.331 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:15.331 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.331 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.331 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.332 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1123 3.2 3:7ef90409:::smithi16641208-250:head [setxattr _header (57) in=7b,truncate 2184943] snapc 0=[] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e35)", 2020-11-16T20:56:15.332 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.983910+0000", 2020-11-16T20:56:15.332 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 20.305996616000002, 2020-11-16T20:56:15.332 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018919126000000001, 2020-11-16T20:56:15.332 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:15.332 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:15.332 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:15.333 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.333 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:15.333 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983910+0000", 2020-11-16T20:56:15.333 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:15.333 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.333 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.333 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:15.333 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983910+0000", 2020-11-16T20:56:15.334 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6406999999999998e-05 2020-11-16T20:56:15.334 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.334 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.334 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:15.334 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983957+0000", 2020-11-16T20:56:15.334 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0913999999999999e-05 2020-11-16T20:56:15.334 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:15.335 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983967+0000", 2020-11-16T20:56:15.335 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4635e-05 2020-11-16T20:56:15.335 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:15.335 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983982+0000", 2020-11-16T20:56:15.336 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8420000000000005e-06 2020-11-16T20:56:15.336 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.336 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.336 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:15.336 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983990+0000", 2020-11-16T20:56:15.336 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029550890000000002 2020-11-16T20:56:15.336 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.336 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.337 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.337 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.986945+0000", 2020-11-16T20:56:15.337 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5418000000000003e-05 2020-11-16T20:56:15.337 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.337 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.337 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:15.337 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987010+0000", 2020-11-16T20:56:15.338 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011737546 2020-11-16T20:56:15.338 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.338 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.338 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.338 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.998748+0000", 2020-11-16T20:56:15.338 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000104208 2020-11-16T20:56:15.338 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.339 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.339 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:15.339 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.998852+0000", 2020-11-16T20:56:15.339 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015971400000000001 2020-11-16T20:56:15.339 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.339 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.339 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:15.339 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.999012+0000", 2020-11-16T20:56:15.340 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0025627029999999999 2020-11-16T20:56:15.340 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.340 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.340 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:15.340 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.001575+0000", 2020-11-16T20:56:15.340 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0382000000000001e-05 2020-11-16T20:56:15.340 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.340 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.341 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:15.341 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.001615+0000", 2020-11-16T20:56:15.341 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001134216 2020-11-16T20:56:15.341 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.341 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.341 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:15.341 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002749+0000", 2020-11-16T20:56:15.342 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2852000000000002e-05 2020-11-16T20:56:15.342 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.342 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.342 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:15.342 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002792+0000", 2020-11-16T20:56:15.342 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7200000000000003e-05 2020-11-16T20:56:15.342 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.342 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.343 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:15.343 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002829+0000", 2020-11-16T20:56:15.343 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018919126000000001 2020-11-16T20:56:15.343 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.343 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:15.343 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.343 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.344 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.344 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1432 4.0 4:3dccbd44:::smithi16641208-321:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e36)", 2020-11-16T20:56:15.344 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.063349+0000", 2020-11-16T20:56:15.344 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 19.226557313000001, 2020-11-16T20:56:15.344 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020415261000000001, 2020-11-16T20:56:15.344 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:15.344 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:15.344 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:15.345 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:15.345 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:15.345 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1432 2020-11-16T20:56:15.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.345 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:15.345 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.345 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:15.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.063349+0000", 2020-11-16T20:56:15.346 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:15.346 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.346 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.346 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:15.346 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.063349+0000", 2020-11-16T20:56:15.346 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5721000000000001e-05 2020-11-16T20:56:15.346 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.347 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.347 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:15.347 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.063365+0000", 2020-11-16T20:56:15.347 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8200000000000001e-06 2020-11-16T20:56:15.347 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.347 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.347 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:15.347 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.063368+0000", 2020-11-16T20:56:15.348 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8499999999999999e-06 2020-11-16T20:56:15.348 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.348 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.348 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:15.348 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.063374+0000", 2020-11-16T20:56:15.348 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3489999999999999e-06 2020-11-16T20:56:15.348 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.349 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.349 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:15.349 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.063376+0000", 2020-11-16T20:56:15.349 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045649699999999999 2020-11-16T20:56:15.349 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.349 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.349 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.349 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.063833+0000", 2020-11-16T20:56:15.350 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6248000000000001e-05 2020-11-16T20:56:15.350 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.350 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:15.350 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.063889+0000", 2020-11-16T20:56:15.350 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012858675999999999 2020-11-16T20:56:15.350 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.351 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.076748+0000", 2020-11-16T20:56:15.351 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012343099999999999 2020-11-16T20:56:15.351 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.351 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.351 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:15.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.076871+0000", 2020-11-16T20:56:15.352 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0065606579999999996 2020-11-16T20:56:15.352 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.352 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.352 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.083432+0000", 2020-11-16T20:56:15.352 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9738000000000003e-05 2020-11-16T20:56:15.352 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.353 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:15.353 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.083491+0000", 2020-11-16T20:56:15.353 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00027327299999999998 2020-11-16T20:56:15.353 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.353 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.353 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:15.353 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.083765+0000", 2020-11-16T20:56:15.353 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020415261000000001 2020-11-16T20:56:15.354 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.354 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:15.354 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.354 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.354 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.354 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:547 3.2 3:5f250a2b:::smithi16641208-75:head [copy-from ver 38] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:15.354 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:56:15.355 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.272338960000001, 2020-11-16T20:56:15.355 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027400430999999999, 2020-11-16T20:56:15.355 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:15.355 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:15.355 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:15.355 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.355 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:15.355 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:56:15.356 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:15.356 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.356 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.356 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:15.356 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:56:15.356 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5093999999999999e-05 2020-11-16T20:56:15.356 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.356 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.357 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:15.357 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017613+0000", 2020-11-16T20:56:15.357 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6150000000000003e-06 2020-11-16T20:56:15.357 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.357 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.357 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:15.357 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017623+0000", 2020-11-16T20:56:15.358 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6934000000000001e-05 2020-11-16T20:56:15.358 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.358 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.358 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:15.358 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017639+0000", 2020-11-16T20:56:15.358 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1892000000000001e-05 2020-11-16T20:56:15.358 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.358 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.359 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:15.359 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017651+0000", 2020-11-16T20:56:15.359 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2955999999999998e-05 2020-11-16T20:56:15.359 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.359 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.359 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.359 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017714+0000", 2020-11-16T20:56:15.359 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019352400000000001 2020-11-16T20:56:15.360 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.360 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.360 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:15.360 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017908+0000", 2020-11-16T20:56:15.360 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0073901349999999999 2020-11-16T20:56:15.360 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.360 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.361 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:15.361 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025298+0000", 2020-11-16T20:56:15.361 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0082133799999999993 2020-11-16T20:56:15.361 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.361 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.361 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:15.361 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033511+0000", 2020-11-16T20:56:15.361 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0074347629999999996 2020-11-16T20:56:15.362 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.362 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.362 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:15.362 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.040946+0000", 2020-11-16T20:56:15.362 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039404669999999996 2020-11-16T20:56:15.362 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.362 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.363 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:15.363 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044887+0000", 2020-11-16T20:56:15.363 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7098000000000002e-05 2020-11-16T20:56:15.363 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.363 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.363 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:15.363 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044934+0000", 2020-11-16T20:56:15.363 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4573000000000003e-05 2020-11-16T20:56:15.364 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.364 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.364 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:15.364 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044968+0000", 2020-11-16T20:56:15.364 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027400430999999999 2020-11-16T20:56:15.364 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.364 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:15.364 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.365 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.365 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.365 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:548 3.2 3:6173e90a:::smithi16641208-2:head [copy-from ver 3] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:15.365 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:56:15.365 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.272207627, 2020-11-16T20:56:15.365 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029556911000000002, 2020-11-16T20:56:15.365 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:15.366 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:15.366 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:15.366 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.366 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:15.366 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:56:15.366 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:15.366 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.366 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.367 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:15.367 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:56:15.367 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2478000000000002e-05 2020-11-16T20:56:15.367 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.367 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.367 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:15.367 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017742+0000", 2020-11-16T20:56:15.368 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3060000000000003e-06 2020-11-16T20:56:15.368 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.368 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.368 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:15.368 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017748+0000", 2020-11-16T20:56:15.368 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1102e-05 2020-11-16T20:56:15.368 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.368 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.369 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:15.369 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017759+0000", 2020-11-16T20:56:15.369 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.118e-06 2020-11-16T20:56:15.369 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.369 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.369 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:15.369 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017764+0000", 2020-11-16T20:56:15.369 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032233700000000001 2020-11-16T20:56:15.370 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.370 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.370 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.370 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.018086+0000", 2020-11-16T20:56:15.370 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000128374 2020-11-16T20:56:15.370 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.370 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.371 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:15.371 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.018215+0000", 2020-11-16T20:56:15.371 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012971355 2020-11-16T20:56:15.371 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.371 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.371 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:15.371 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.031186+0000", 2020-11-16T20:56:15.371 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044142890000000001 2020-11-16T20:56:15.372 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.372 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.372 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:15.372 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.035600+0000", 2020-11-16T20:56:15.372 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092372719999999995 2020-11-16T20:56:15.372 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.372 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.372 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:15.373 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044838+0000", 2020-11-16T20:56:15.373 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0023022049999999999 2020-11-16T20:56:15.373 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.373 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.373 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:15.373 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047140+0000", 2020-11-16T20:56:15.373 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0380999999999997e-05 2020-11-16T20:56:15.373 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.374 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.374 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:15.374 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047200+0000", 2020-11-16T20:56:15.374 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5693999999999999e-05 2020-11-16T20:56:15.374 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.374 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.374 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:15.375 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047256+0000", 2020-11-16T20:56:15.375 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029556911000000002 2020-11-16T20:56:15.375 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.375 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:15.375 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.375 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.375 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.375 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:554 3.2 3:769099fd:::smithi16641208-247:head [copy-from ver 123] snapc 1=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:15.376 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:56:15.376 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.239804309, 2020-11-16T20:56:15.376 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998, 2020-11-16T20:56:15.376 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:15.376 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:15.376 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:15.376 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.377 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:15.377 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:56:15.377 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:15.377 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.377 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.377 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:15.377 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:56:15.377 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6705999999999997e-05 2020-11-16T20:56:15.378 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.378 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.378 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:15.378 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050139+0000", 2020-11-16T20:56:15.378 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6199999999999998e-06 2020-11-16T20:56:15.378 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.378 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.379 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:15.379 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050144+0000", 2020-11-16T20:56:15.379 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.944e-06 2020-11-16T20:56:15.379 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.379 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.379 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:15.379 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050154+0000", 2020-11-16T20:56:15.379 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4043999999999999e-05 2020-11-16T20:56:15.380 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.380 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.380 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:15.380 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050178+0000", 2020-11-16T20:56:15.380 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078971409999999999 2020-11-16T20:56:15.380 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.380 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.380 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.381 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058075+0000", 2020-11-16T20:56:15.381 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012776500000000001 2020-11-16T20:56:15.381 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.381 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.381 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:15.381 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058203+0000", 2020-11-16T20:56:15.381 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011807013 2020-11-16T20:56:15.381 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.382 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:15.382 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070010+0000", 2020-11-16T20:56:15.382 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029522160000000001 2020-11-16T20:56:15.382 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.382 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:15.383 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.072962+0000", 2020-11-16T20:56:15.383 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017845006 2020-11-16T20:56:15.383 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.383 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.383 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:15.383 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.090807+0000", 2020-11-16T20:56:15.383 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.009301808 2020-11-16T20:56:15.383 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.384 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:15.384 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100109+0000", 2020-11-16T20:56:15.384 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7076999999999995e-05 2020-11-16T20:56:15.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.384 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:15.385 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100176+0000", 2020-11-16T20:56:15.385 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9790999999999999e-05 2020-11-16T20:56:15.385 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.385 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.385 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:15.385 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100216+0000", 2020-11-16T20:56:15.385 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998 2020-11-16T20:56:15.385 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.386 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:15.386 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.386 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.386 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.386 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:555 3.2 3:590e6edd:::smithi16641208-203:head [delete] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:15.386 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.076366+0000", 2020-11-16T20:56:15.386 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.213540452, 2020-11-16T20:56:15.387 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024009968, 2020-11-16T20:56:15.387 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:15.387 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:15.387 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:15.387 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.387 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:15.387 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076366+0000", 2020-11-16T20:56:15.388 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:15.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.388 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.388 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:15.388 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076366+0000", 2020-11-16T20:56:15.388 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2963999999999998e-05 2020-11-16T20:56:15.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.388 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.389 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:15.389 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076399+0000", 2020-11-16T20:56:15.389 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6879999999999999e-06 2020-11-16T20:56:15.389 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.389 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:15.389 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076407+0000", 2020-11-16T20:56:15.389 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4088999999999999e-05 2020-11-16T20:56:15.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.390 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.390 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:15.390 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076431+0000", 2020-11-16T20:56:15.390 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.4280000000000002e-06 2020-11-16T20:56:15.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.390 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.391 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:15.391 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076440+0000", 2020-11-16T20:56:15.391 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3467999999999998e-05 2020-11-16T20:56:15.391 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.391 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.391 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076484+0000", 2020-11-16T20:56:15.391 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011613 2020-11-16T20:56:15.392 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.392 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.392 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:15.392 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076600+0000", 2020-11-16T20:56:15.392 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8172999999999998e-05 2020-11-16T20:56:15.392 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.392 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.393 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:15.393 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076678+0000", 2020-11-16T20:56:15.393 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0009822749999999999 2020-11-16T20:56:15.393 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.393 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.393 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:15.393 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.077661+0000", 2020-11-16T20:56:15.393 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018605739999999999 2020-11-16T20:56:15.394 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.394 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.394 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:15.394 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.096266+0000", 2020-11-16T20:56:15.394 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039876709999999999 2020-11-16T20:56:15.394 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.394 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.395 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:15.395 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100254+0000", 2020-11-16T20:56:15.395 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4382999999999996e-05 2020-11-16T20:56:15.395 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.395 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.395 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:15.395 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100328+0000", 2020-11-16T20:56:15.395 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7958999999999999e-05 2020-11-16T20:56:15.396 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.396 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.396 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:15.396 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100376+0000", 2020-11-16T20:56:15.396 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024009968 2020-11-16T20:56:15.396 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.396 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:15.397 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.397 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.397 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.397 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:556 3.2 3:590e6edd:::smithi16641208-203:head [copy-from ver 105] snapc 1=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:15.397 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.076482+0000", 2020-11-16T20:56:15.397 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.213425001999999, 2020-11-16T20:56:15.397 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025150006999999999, 2020-11-16T20:56:15.397 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:15.398 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:15.398 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:15.398 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.398 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:15.398 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076482+0000", 2020-11-16T20:56:15.398 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:15.398 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.398 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.399 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:15.399 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076482+0000", 2020-11-16T20:56:15.399 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0086000000000006e-05 2020-11-16T20:56:15.399 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.399 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.399 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:15.399 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076552+0000", 2020-11-16T20:56:15.400 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7299999999999999e-06 2020-11-16T20:56:15.400 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.400 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.400 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:15.400 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076559+0000", 2020-11-16T20:56:15.400 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5905000000000001e-05 2020-11-16T20:56:15.400 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.400 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.401 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:15.401 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076574+0000", 2020-11-16T20:56:15.401 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9369999999999993e-06 2020-11-16T20:56:15.401 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.401 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.401 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:15.401 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076583+0000", 2020-11-16T20:56:15.401 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00064848599999999998 2020-11-16T20:56:15.402 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.402 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.402 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.402 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.077232+0000", 2020-11-16T20:56:15.402 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8629999999999999e-05 2020-11-16T20:56:15.402 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.402 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.403 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:15.403 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.077291+0000", 2020-11-16T20:56:15.403 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003820773 2020-11-16T20:56:15.403 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.403 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.403 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:15.403 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.081111+0000", 2020-11-16T20:56:15.403 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033171849999999998 2020-11-16T20:56:15.404 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.404 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.404 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:15.404 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.084428+0000", 2020-11-16T20:56:15.404 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016400174 2020-11-16T20:56:15.404 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.404 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.405 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:15.405 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100829+0000", 2020-11-16T20:56:15.405 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00071628499999999999 2020-11-16T20:56:15.405 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.405 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.405 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:15.405 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.101545+0000", 2020-11-16T20:56:15.405 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7249e-05 2020-11-16T20:56:15.406 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.406 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.406 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:15.406 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.101602+0000", 2020-11-16T20:56:15.406 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9567e-05 2020-11-16T20:56:15.406 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.406 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.406 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:15.407 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.101632+0000", 2020-11-16T20:56:15.407 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025150006999999999 2020-11-16T20:56:15.407 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.407 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:15.407 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.407 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.407 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.408 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2429 4.0 4:3b92f709:::smithi16641208-69:head [rollback 7] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:56:15.408 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:56:15.408 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.2738860470000004, 2020-11-16T20:56:15.408 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003, 2020-11-16T20:56:15.408 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:15.408 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:15.408 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:15.408 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:15.409 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:15.409 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2429 2020-11-16T20:56:15.409 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.409 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:15.409 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.409 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:15.409 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:56:15.409 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:15.410 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.410 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.410 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:15.410 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:56:15.410 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3710000000000002e-05 2020-11-16T20:56:15.410 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.410 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.411 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:15.411 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016044+0000", 2020-11-16T20:56:15.411 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7090000000000001e-06 2020-11-16T20:56:15.411 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.411 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.411 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:15.411 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016049+0000", 2020-11-16T20:56:15.411 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8820000000000003e-06 2020-11-16T20:56:15.412 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.412 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.412 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:15.412 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016056+0000", 2020-11-16T20:56:15.412 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.27e-06 2020-11-16T20:56:15.412 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.412 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.416 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:15.416 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016059+0000", 2020-11-16T20:56:15.416 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.537e-05 2020-11-16T20:56:15.416 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.416 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.416 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.416 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016115+0000", 2020-11-16T20:56:15.416 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8690000000000003e-06 2020-11-16T20:56:15.417 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.417 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.417 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:15.417 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016120+0000", 2020-11-16T20:56:15.417 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021405730000000002 2020-11-16T20:56:15.417 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.417 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.418 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.418 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018260+0000", 2020-11-16T20:56:15.418 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0137999999999999e-05 2020-11-16T20:56:15.418 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.418 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.418 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:15.418 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018320+0000", 2020-11-16T20:56:15.418 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011799352000000001 2020-11-16T20:56:15.419 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.419 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.419 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.419 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030120+0000", 2020-11-16T20:56:15.419 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000163139 2020-11-16T20:56:15.419 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.419 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.420 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:15.420 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030283+0000", 2020-11-16T20:56:15.420 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029657000000000002 2020-11-16T20:56:15.420 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.420 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.420 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:15.420 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030579+0000", 2020-11-16T20:56:15.420 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3058000000000001e-05 2020-11-16T20:56:15.421 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.421 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.421 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:15.421 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030612+0000", 2020-11-16T20:56:15.421 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0075168259999999999 2020-11-16T20:56:15.421 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.421 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.421 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.422 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038129+0000", 2020-11-16T20:56:15.422 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012914299999999999 2020-11-16T20:56:15.422 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.422 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.422 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:15.422 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038258+0000", 2020-11-16T20:56:15.422 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034292799999999999 2020-11-16T20:56:15.423 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.423 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.423 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:56:15.423 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038601+0000", 2020-11-16T20:56:15.423 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0025181159999999999 2020-11-16T20:56:15.423 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.423 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.423 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.424 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041119+0000", 2020-11-16T20:56:15.424 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2331999999999997e-05 2020-11-16T20:56:15.424 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.424 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.424 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for ondisk", 2020-11-16T20:56:15.424 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041202+0000", 2020-11-16T20:56:15.424 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028481750000000001 2020-11-16T20:56:15.424 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.425 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.425 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:15.425 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044050+0000", 2020-11-16T20:56:15.425 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001269921 2020-11-16T20:56:15.425 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.425 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.425 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:15.426 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045320+0000", 2020-11-16T20:56:15.426 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054215490000000003 2020-11-16T20:56:15.426 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.426 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.426 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:15.426 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050741+0000", 2020-11-16T20:56:15.426 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6981000000000001e-05 2020-11-16T20:56:15.426 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.427 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.427 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:15.427 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050808+0000", 2020-11-16T20:56:15.427 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8841e-05 2020-11-16T20:56:15.427 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.427 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.427 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:15.427 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050877+0000", 2020-11-16T20:56:15.428 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003 2020-11-16T20:56:15.428 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.428 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:15.428 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.428 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.428 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.428 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2430 4.0 4:3b92f709:::smithi16641208-69:head [append 0~0] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:56:15.429 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:56:15.429 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.2738297239999996, 2020-11-16T20:56:15.429 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001, 2020-11-16T20:56:15.429 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:15.429 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:15.429 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:15.429 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:15.429 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:15.430 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2430 2020-11-16T20:56:15.430 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.430 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:15.430 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.430 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:15.430 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:56:15.430 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:15.431 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.431 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.431 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:15.431 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:56:15.431 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0857e-05 2020-11-16T20:56:15.431 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.431 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.431 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:15.432 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016098+0000", 2020-11-16T20:56:15.432 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9179999999999999e-06 2020-11-16T20:56:15.432 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.432 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.432 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:15.432 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016104+0000", 2020-11-16T20:56:15.432 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8230000000000006e-06 2020-11-16T20:56:15.433 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.433 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.433 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:15.433 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016114+0000", 2020-11-16T20:56:15.433 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2180000000000001e-06 2020-11-16T20:56:15.433 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.433 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.433 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:15.434 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016118+0000", 2020-11-16T20:56:15.434 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3547999999999995e-05 2020-11-16T20:56:15.434 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.434 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.434 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.434 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016181+0000", 2020-11-16T20:56:15.434 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8730000000000007e-06 2020-11-16T20:56:15.434 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.435 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.435 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:15.435 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016189+0000", 2020-11-16T20:56:15.435 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021577200000000001 2020-11-16T20:56:15.435 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.435 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.435 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.436 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018347+0000", 2020-11-16T20:56:15.436 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6832000000000001e-05 2020-11-16T20:56:15.436 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.436 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.436 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:15.436 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018404+0000", 2020-11-16T20:56:15.436 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012272913999999999 2020-11-16T20:56:15.436 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.437 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.437 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.437 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030677+0000", 2020-11-16T20:56:15.437 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2555000000000002e-05 2020-11-16T20:56:15.437 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.437 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.437 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:15.437 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030719+0000", 2020-11-16T20:56:15.438 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010518684 2020-11-16T20:56:15.438 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.438 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.438 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.438 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041238+0000", 2020-11-16T20:56:15.438 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000144723 2020-11-16T20:56:15.438 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.439 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.439 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:15.439 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041383+0000", 2020-11-16T20:56:15.439 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000214575 2020-11-16T20:56:15.439 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.439 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.439 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:56:15.439 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041597+0000", 2020-11-16T20:56:15.440 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002463196 2020-11-16T20:56:15.440 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.440 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.440 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:15.440 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044060+0000", 2020-11-16T20:56:15.440 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001654066 2020-11-16T20:56:15.440 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.441 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.441 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:15.441 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045715+0000", 2020-11-16T20:56:15.441 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053780599999999996 2020-11-16T20:56:15.441 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.441 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.441 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:15.441 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051093+0000", 2020-11-16T20:56:15.442 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8189999999999996e-05 2020-11-16T20:56:15.442 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.442 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.442 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:15.442 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051161+0000", 2020-11-16T20:56:15.442 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4910000000000001e-05 2020-11-16T20:56:15.442 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.442 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.443 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:15.443 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051216+0000", 2020-11-16T20:56:15.443 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001 2020-11-16T20:56:15.443 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.443 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:15.443 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.443 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.444 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.444 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "MOSDPGPush(4.1 52/51 [PushOp(4:9ab04c4a:::smithi16641208-1:head, version: 33'3, data_included: [0~892056,1542129~156520], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:9ab04c4a:::smithi16641208-1:head@33'3, size: 2016807, copy_subset: [0~2016807], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1698649, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:a1eef07d:::smithi16641208-13:head, version: 33'9, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:a1eef07d:::smithi16641208-13:head@33'9, size: 2201684, copy_subset: [0~2201684], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:929564f0:::smithi16641208-24:head, version: 33'18, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:929564f0:::smithi16641208-24:head@33'18, size: 2386561, copy_subset: [0~2386561], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b565f7d2:::smithi16641208-35:head, version: 33'27, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b565f7d2:::smithi16641208-35:head@33'27, size: 2571438, copy_subset: [0~2571438], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b6545a47:::smithi16641208-46:head, version: 33'29, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b6545a47:::smithi16641208-46:head@33'29, size: 2756315, copy_subset: [0~2756315], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:9bd9f31d:::smithi16641208-48:head, version: 33'35, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:9bd9f31d:::smithi16641208-48:head@33'35, size: 2789929, copy_subset: [0~2789929], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:83205103:::smithi16641208-103:head, version: 34'38, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:83205103:::smithi16641208-103:head@34'38, size: 3714314, copy_subset: [0~3714314], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:86a0a5b7:::smithi16641208-108:head, version: 34'42, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:86a0a5b7:::smithi16641208-108:head@34'42, size: 3798349, copy_subset: [0~3798349], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-16T20:56:15.444 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:56:15.444 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.51923311800000005, 2020-11-16T20:56:15.444 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032552672999999997, 2020-11-16T20:56:15.444 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:15.444 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:15.444 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:15.445 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.445 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:15.445 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:56:15.445 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:15.445 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.445 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.445 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:15.446 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:56:15.446 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017498692999999999 2020-11-16T20:56:15.446 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.446 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.446 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:15.446 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788172+0000", 2020-11-16T20:56:15.446 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4147999999999999e-05 2020-11-16T20:56:15.446 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.447 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.447 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:15.447 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788206+0000", 2020-11-16T20:56:15.447 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0016000000000002e-05 2020-11-16T20:56:15.447 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.447 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.447 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:15.448 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788276+0000", 2020-11-16T20:56:15.448 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2172000000000002e-05 2020-11-16T20:56:15.448 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.448 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.448 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:15.448 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788319+0000", 2020-11-16T20:56:15.448 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000154337 2020-11-16T20:56:15.448 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.449 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.449 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.449 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788473+0000", 2020-11-16T20:56:15.449 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7690000000000002e-06 2020-11-16T20:56:15.449 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.449 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.449 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:15.449 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788482+0000", 2020-11-16T20:56:15.450 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014744538 2020-11-16T20:56:15.450 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.450 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.450 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:15.450 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803226+0000", 2020-11-16T20:56:15.450 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032552672999999997 2020-11-16T20:56:15.450 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.451 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:15.451 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.451 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.451 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.451 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.0:552 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'128, mlcod=0'0)", 2020-11-16T20:56:15.451 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:56:15.451 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.49926769999999998, 2020-11-16T20:56:15.451 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038033168999999999, 2020-11-16T20:56:15.452 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:15.452 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:15.452 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:15.452 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.452 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:15.452 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:56:15.452 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:15.452 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.453 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.453 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:15.453 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:56:15.453 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0031023880000000002 2020-11-16T20:56:15.453 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.453 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.453 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:15.454 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793741+0000", 2020-11-16T20:56:15.454 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1496e-05 2020-11-16T20:56:15.454 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.454 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.454 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:15.454 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793753+0000", 2020-11-16T20:56:15.454 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9009999999999999e-05 2020-11-16T20:56:15.454 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.455 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.455 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:15.455 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793772+0000", 2020-11-16T20:56:15.455 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3318e-05 2020-11-16T20:56:15.455 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.455 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.455 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:15.455 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793785+0000", 2020-11-16T20:56:15.456 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012534775 2020-11-16T20:56:15.456 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.456 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.456 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.456 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806320+0000", 2020-11-16T20:56:15.456 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8144999999999999e-05 2020-11-16T20:56:15.456 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.457 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.457 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:15.457 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806348+0000", 2020-11-16T20:56:15.457 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022285688000000001 2020-11-16T20:56:15.457 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.457 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.457 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:15.457 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828634+0000", 2020-11-16T20:56:15.458 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8349000000000002e-05 2020-11-16T20:56:15.458 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.458 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.458 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:15.458 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828672+0000", 2020-11-16T20:56:15.458 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038033168999999999 2020-11-16T20:56:15.458 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.458 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:15.459 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.459 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.459 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.459 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2503 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'129, mlcod=0'0)", 2020-11-16T20:56:15.459 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:56:15.459 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.49607952, 2020-11-16T20:56:15.459 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034870998, 2020-11-16T20:56:15.460 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:15.460 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:15.460 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:15.460 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.460 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:15.460 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:56:15.460 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:15.460 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.461 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.461 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:15.461 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:56:15.461 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00093048899999999995 2020-11-16T20:56:15.461 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.461 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.461 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:15.462 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794758+0000", 2020-11-16T20:56:15.462 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.169e-05 2020-11-16T20:56:15.462 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.462 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.462 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:15.462 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794769+0000", 2020-11-16T20:56:15.462 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3998999999999999e-05 2020-11-16T20:56:15.462 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.463 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.463 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:15.463 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794783+0000", 2020-11-16T20:56:15.463 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.481e-06 2020-11-16T20:56:15.463 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.463 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.463 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:15.463 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794791+0000", 2020-11-16T20:56:15.464 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.02524036 2020-11-16T20:56:15.464 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.464 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.464 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.464 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820031+0000", 2020-11-16T20:56:15.464 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.811e-05 2020-11-16T20:56:15.464 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.465 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.465 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:15.465 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820059+0000", 2020-11-16T20:56:15.465 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.008614577 2020-11-16T20:56:15.465 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.465 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.465 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:15.465 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828674+0000", 2020-11-16T20:56:15.466 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4292000000000001e-05 2020-11-16T20:56:15.466 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.466 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.466 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:15.466 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828698+0000", 2020-11-16T20:56:15.466 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034870998 2020-11-16T20:56:15.466 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.467 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:15.467 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.467 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.467 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.467 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2504 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'130, mlcod=0'0)", 2020-11-16T20:56:15.467 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:56:15.467 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.49507383799999999, 2020-11-16T20:56:15.467 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033888776000000002, 2020-11-16T20:56:15.468 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:15.468 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:15.468 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:15.468 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.468 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:15.468 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:56:15.468 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:15.468 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.469 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.469 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:15.469 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:56:15.469 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3896999999999997e-05 2020-11-16T20:56:15.469 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.469 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.469 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:15.469 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794877+0000", 2020-11-16T20:56:15.470 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7019999999999998e-06 2020-11-16T20:56:15.470 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.470 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.470 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:15.470 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794883+0000", 2020-11-16T20:56:15.470 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.789e-06 2020-11-16T20:56:15.470 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.471 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.471 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:15.471 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794888+0000", 2020-11-16T20:56:15.471 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.852e-06 2020-11-16T20:56:15.471 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.471 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.471 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:15.471 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794891+0000", 2020-11-16T20:56:15.472 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026152822999999999 2020-11-16T20:56:15.472 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.472 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.472 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.472 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.821044+0000", 2020-11-16T20:56:15.472 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6900999999999999e-05 2020-11-16T20:56:15.472 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.472 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.473 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:15.473 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.821071+0000", 2020-11-16T20:56:15.473 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0076283210000000004 2020-11-16T20:56:15.473 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.473 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.473 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:15.473 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828699+0000", 2020-11-16T20:56:15.474 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2490999999999999e-05 2020-11-16T20:56:15.474 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.474 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.474 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:15.474 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828722+0000", 2020-11-16T20:56:15.474 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033888776000000002 2020-11-16T20:56:15.474 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.474 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:15.475 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.475 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.475 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.475 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.13:681 3.1 e52/19 3:afc69464:::smithi16641208-110:head v 52'546, mlcod=52'544)", 2020-11-16T20:56:15.475 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:56:15.475 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.49241376799999997, 2020-11-16T20:56:15.475 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.03113606, 2020-11-16T20:56:15.476 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:15.476 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:15.476 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:15.476 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.476 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:15.476 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:56:15.476 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:15.476 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.477 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.477 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:15.477 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:56:15.477 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0026681809999999999 2020-11-16T20:56:15.477 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.477 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.477 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:15.477 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800161+0000", 2020-11-16T20:56:15.478 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3499000000000001e-05 2020-11-16T20:56:15.478 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.478 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.478 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:15.478 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800175+0000", 2020-11-16T20:56:15.478 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8301999999999999e-05 2020-11-16T20:56:15.478 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.479 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.479 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:15.479 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800193+0000", 2020-11-16T20:56:15.479 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0465999999999999e-05 2020-11-16T20:56:15.479 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.479 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.479 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:15.479 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800203+0000", 2020-11-16T20:56:15.480 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061432479999999996 2020-11-16T20:56:15.480 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.480 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.480 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.480 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806347+0000", 2020-11-16T20:56:15.480 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.641e-05 2020-11-16T20:56:15.480 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.481 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.481 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:15.481 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806373+0000", 2020-11-16T20:56:15.481 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022190887999999999 2020-11-16T20:56:15.481 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.481 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.481 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:15.481 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828564+0000", 2020-11-16T20:56:15.482 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5066000000000003e-05 2020-11-16T20:56:15.482 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.482 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.482 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:15.482 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828629+0000", 2020-11-16T20:56:15.482 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.03113606 2020-11-16T20:56:15.482 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.482 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:15.483 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.483 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.483 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.483 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.13:682 3.1 e52/19 3:b3ae2c4d:::smithi16641208-463:head v 52'547, mlcod=52'544)", 2020-11-16T20:56:15.483 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.802222+0000", 2020-11-16T20:56:15.483 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.487684864, 2020-11-16T20:56:15.483 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026721733000000001, 2020-11-16T20:56:15.484 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:15.484 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:15.484 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:15.484 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.484 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:15.484 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.802222+0000", 2020-11-16T20:56:15.484 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:15.484 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.485 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.485 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:15.485 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.802222+0000", 2020-11-16T20:56:15.485 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001333442 2020-11-16T20:56:15.485 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.485 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.485 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:15.485 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803555+0000", 2020-11-16T20:56:15.486 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0971999999999999e-05 2020-11-16T20:56:15.486 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.486 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.486 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:15.486 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803566+0000", 2020-11-16T20:56:15.486 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5973000000000001e-05 2020-11-16T20:56:15.486 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.487 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.487 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:15.487 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803582+0000", 2020-11-16T20:56:15.487 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2969999999999998e-06 2020-11-16T20:56:15.487 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.487 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.487 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:15.487 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803590+0000", 2020-11-16T20:56:15.488 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016424259 2020-11-16T20:56:15.488 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.488 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.488 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.488 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820014+0000", 2020-11-16T20:56:15.488 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9485999999999999e-05 2020-11-16T20:56:15.488 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.488 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.489 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:15.489 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820033+0000", 2020-11-16T20:56:15.489 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0088553179999999992 2020-11-16T20:56:15.489 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.489 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.489 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:15.489 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828889+0000", 2020-11-16T20:56:15.490 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4985999999999998e-05 2020-11-16T20:56:15.490 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.490 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.490 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:15.490 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828944+0000", 2020-11-16T20:56:15.490 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026721733000000001 2020-11-16T20:56:15.490 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.490 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:15.491 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.491 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.491 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.491 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "MOSDPGPush(4.1 52/51 [PushOp(4:aee7d493:::smithi16641208-252:head, version: 45'111, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:aee7d493:::smithi16641208-252:head@45'111, size: 2924451, copy_subset: [0~2924451], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:ad0f1f64:::smithi16641208-28:head, version: 45'112, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:ad0f1f64:::smithi16641208-28:head@45'112, size: 2453789, copy_subset: [0~2453789], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b804a575:::smithi16641208-32:head, version: 46'114, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b804a575:::smithi16641208-32:head@46'114, size: 2521017, copy_subset: [0~2521017], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:a1b421f3:::smithi16641208-471:head, version: 47'115, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:a1b421f3:::smithi16641208-471:head@47'115, size: 3899290, copy_subset: [0~3899290], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:bb6e1225:::smithi16641208-364:head, version: 48'117, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:bb6e1225:::smithi16641208-364:head@48'117, size: 2100941, copy_subset: [0~2100941], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-16T20:56:15.491 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.975838+0000", 2020-11-16T20:56:15.491 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.31406866999999999, 2020-11-16T20:56:15.491 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021029161000000001, 2020-11-16T20:56:15.492 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:15.492 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:15.492 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:15.492 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.492 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:15.492 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.975838+0000", 2020-11-16T20:56:15.492 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:15.492 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.493 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.493 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:15.493 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.975838+0000", 2020-11-16T20:56:15.493 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015420552000000001 2020-11-16T20:56:15.493 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.493 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.493 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:15.494 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.991259+0000", 2020-11-16T20:56:15.494 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5593000000000003e-05 2020-11-16T20:56:15.494 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.494 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.494 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:15.494 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.991294+0000", 2020-11-16T20:56:15.494 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1511999999999997e-05 2020-11-16T20:56:15.494 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.495 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.495 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:15.495 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.991346+0000", 2020-11-16T20:56:15.495 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3864000000000001e-05 2020-11-16T20:56:15.495 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.495 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.495 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:15.496 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.991370+0000", 2020-11-16T20:56:15.496 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012323799999999999 2020-11-16T20:56:15.496 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.496 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.496 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:15.496 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.991493+0000", 2020-11-16T20:56:15.496 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.271e-05 2020-11-16T20:56:15.496 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.497 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.497 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:15.497 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.991506+0000", 2020-11-16T20:56:15.497 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053616920000000004 2020-11-16T20:56:15.497 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:15.497 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:15.497 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:15.497 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.996867+0000", 2020-11-16T20:56:15.498 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021029161000000001 2020-11-16T20:56:15.498 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.498 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:15.498 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.498 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:15.498 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:15.498 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:15.499 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:56:15.500 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:56:15.501 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:15.505+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:15.600 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:15.605+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:15.646 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:15.646 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:15.646 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:56:15.647 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:15.656 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:56:15.681 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:56:15.700 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:56:15.701 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:15.705+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:15.719 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:56:15.732 INFO:tasks.rados.rados.0.smithi166.stdout:618: done (2 left) 2020-11-16T20:56:15.732 INFO:tasks.rados.rados.0.smithi166.stdout:619: done (1 left) 2020-11-16T20:56:15.732 INFO:tasks.rados.rados.0.smithi166.stdout:620: done (0 left) 2020-11-16T20:56:15.733 INFO:tasks.rados.rados.0.smithi166.stdout:621: write (excl) oid 110 current snap is 11 2020-11-16T20:56:15.733 INFO:tasks.rados.rados.0.smithi166.stdout:621: seq_num 536 ranges {608552=478174,1848819=707173} 2020-11-16T20:56:15.738 INFO:tasks.rados.rados.0.smithi166.stdout:621: writing smithi16641208-110 from 608552 to 1086726 tid 1 2020-11-16T20:56:15.741 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:56:15.746 INFO:tasks.rados.rados.0.smithi166.stdout:621: writing smithi16641208-110 from 1848819 to 2555992 tid 2 2020-11-16T20:56:15.746 INFO:tasks.rados.rados.0.smithi166.stdout:622: snap_remove snap 7 2020-11-16T20:56:15.761 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:56:15.780 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:56:15.794 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:15.794 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:15.799 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:56:15.801 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:15.807+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:15.803 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:56:15.818 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:56:15.820 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:56:15.820 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:56:15.820 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:56:15.820 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:56:15.820 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:56:15.820 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:56:15.821 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:56:15.821 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:56:15.902 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:15.908+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:15.978 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:15.978 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:15.988 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:56:16.003 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:16.008+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:16.104 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:16.108+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:16.124 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:16.124 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:16.125 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2020-11-16T20:56:16.133 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:56:16.205 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:16.210+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:16.306 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:16.310+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:16.309 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:16.309 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:16.319 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:56:16.406 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:16.411+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:16.494 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:16.494 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:16.504 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:56:16.544 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:16.549+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:16.608 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:16.613+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:16.679 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:16.679 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:16.688 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:56:16.709 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:16.713+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:16.735 INFO:tasks.rados.rados.0.smithi166.stdout:622: done (1 left) 2020-11-16T20:56:16.736 INFO:tasks.rados.rados.0.smithi166.stdout:623: read oid 446 snap -1 2020-11-16T20:56:16.736 INFO:tasks.rados.rados.0.smithi166.stdout:623: expect deleted 2020-11-16T20:56:16.736 INFO:tasks.rados.rados.0.smithi166.stdout:624: cache_try_flush oid 65 snap -1 2020-11-16T20:56:16.736 INFO:tasks.rados.rados.0.smithi166.stdout:625: cache_try_flush oid 68 snap -1 2020-11-16T20:56:16.736 INFO:tasks.rados.rados.0.smithi166.stdout:626: copy_from oid 33 from oid 13 current snap is 11 2020-11-16T20:56:16.736 INFO:tasks.rados.rados.0.smithi166.stdout:627: cache_try_flush oid 137 snap -1 2020-11-16T20:56:16.736 INFO:tasks.rados.rados.0.smithi166.stdout:628: copy_from oid 51 from oid 234 current snap is 11 2020-11-16T20:56:16.737 INFO:tasks.rados.rados.0.smithi166.stdout:629: cache_evict oid 272 snap -1 2020-11-16T20:56:16.737 INFO:tasks.rados.rados.0.smithi166.stdout:630: write (excl) oid 483 current snap is 11 2020-11-16T20:56:16.737 INFO:tasks.rados.rados.0.smithi166.stdout:630: seq_num 537 ranges {625359=553423,1790948=567184,2930500=94859} 2020-11-16T20:56:16.740 INFO:teuthology.orchestra.run.smithi166.stderr:noscrub is set 2020-11-16T20:56:16.743 INFO:tasks.rados.rados.0.smithi166.stdout:630: writing smithi16641208-483 from 625359 to 1178782 tid 1 2020-11-16T20:56:16.750 INFO:tasks.rados.rados.0.smithi166.stdout:630: writing smithi16641208-483 from 1790948 to 2358132 tid 2 2020-11-16T20:56:16.754 INFO:tasks.rados.rados.0.smithi166.stdout:630: writing smithi16641208-483 from 2930500 to 3025359 tid 3 2020-11-16T20:56:16.754 INFO:tasks.rados.rados.0.smithi166.stdout:631: write oid 124 current snap is 11 2020-11-16T20:56:16.755 INFO:tasks.rados.rados.0.smithi166.stdout:624: got (16) Device or resource busy 2020-11-16T20:56:16.755 INFO:tasks.rados.rados.0.smithi166.stdout:631: seq_num 538 ranges {642166=628672,1849430=710842} 2020-11-16T20:56:16.762 INFO:tasks.rados.rados.0.smithi166.stdout:631: writing smithi16641208-124 from 642166 to 1270838 tid 1 2020-11-16T20:56:16.771 INFO:tasks.rados.rados.0.smithi166.stdout:631: writing smithi16641208-124 from 1849430 to 2560272 tid 2 2020-11-16T20:56:16.771 INFO:tasks.rados.rados.0.smithi166.stdout:624: done (9 left) 2020-11-16T20:56:16.771 INFO:tasks.rados.rados.0.smithi166.stdout:632: rollback oid 303 current snap is 11 2020-11-16T20:56:16.772 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 303 to 3 2020-11-16T20:56:16.772 INFO:tasks.rados.rados.0.smithi166.stdout:633: copy_from oid 430 from oid 155 current snap is 11 2020-11-16T20:56:16.772 INFO:tasks.rados.rados.0.smithi166.stdout:629: got (2) No such file or directory 2020-11-16T20:56:16.772 INFO:tasks.rados.rados.0.smithi166.stdout:621: finishing write tid 1 to smithi16641208-110 2020-11-16T20:56:16.772 INFO:tasks.rados.rados.0.smithi166.stdout:630: finishing write tid 1 to smithi16641208-483 2020-11-16T20:56:16.772 INFO:tasks.rados.rados.0.smithi166.stdout:625: got (2) No such file or directory 2020-11-16T20:56:16.772 INFO:tasks.rados.rados.0.smithi166.stdout:627: got (2) No such file or directory 2020-11-16T20:56:16.773 INFO:tasks.rados.rados.0.smithi166.stdout:621: finishing write tid 2 to smithi16641208-110 2020-11-16T20:56:16.773 INFO:tasks.rados.rados.0.smithi166.stdout:621: finishing write tid 3 to smithi16641208-110 2020-11-16T20:56:16.773 INFO:tasks.rados.rados.0.smithi166.stdout:621: finishing write tid 4 to smithi16641208-110 2020-11-16T20:56:16.773 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 110 v 549 (ObjNum 536 snap 11 seq_num 536) dirty exists 2020-11-16T20:56:16.773 INFO:tasks.rados.rados.0.smithi166.stdout:621: left oid 110 (ObjNum 536 snap 11 seq_num 536) 2020-11-16T20:56:16.774 INFO:tasks.rados.rados.0.smithi166.stdout:621: done (10 left) 2020-11-16T20:56:16.774 INFO:tasks.rados.rados.0.smithi166.stdout:623: done (9 left) 2020-11-16T20:56:16.774 INFO:tasks.rados.rados.0.smithi166.stdout:625: done (8 left) 2020-11-16T20:56:16.774 INFO:tasks.rados.rados.0.smithi166.stdout:627: done (7 left) 2020-11-16T20:56:16.774 INFO:tasks.rados.rados.0.smithi166.stdout:629: done (6 left) 2020-11-16T20:56:16.775 INFO:tasks.rados.rados.0.smithi166.stdout:634: copy_from oid 400 from oid 44 current snap is 11 2020-11-16T20:56:16.775 INFO:tasks.rados.rados.0.smithi166.stdout:635: rollback oid 390 current snap is 11 2020-11-16T20:56:16.775 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 390 to 3 2020-11-16T20:56:16.775 INFO:tasks.rados.rados.0.smithi166.stdout:636: cache_flush oid 461 snap 10 2020-11-16T20:56:16.775 INFO:tasks.rados.rados.0.smithi166.stdout:637: snap_create 2020-11-16T20:56:16.776 INFO:tasks.rados.rados.0.smithi166.stdout:636: got (2) No such file or directory 2020-11-16T20:56:16.778 INFO:tasks.rados.rados.0.smithi166.stdout:630: finishing write tid 2 to smithi16641208-483 2020-11-16T20:56:16.779 INFO:tasks.rados.rados.0.smithi166.stdout:630: finishing write tid 3 to smithi16641208-483 2020-11-16T20:56:16.779 INFO:tasks.rados.rados.0.smithi166.stdout:630: finishing write tid 4 to smithi16641208-483 2020-11-16T20:56:16.779 INFO:tasks.rados.rados.0.smithi166.stdout:630: finishing write tid 5 to smithi16641208-483 2020-11-16T20:56:16.780 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 483 v 468 (ObjNum 537 snap 11 seq_num 537) dirty exists 2020-11-16T20:56:16.780 INFO:tasks.rados.rados.0.smithi166.stdout:630: left oid 483 (ObjNum 537 snap 11 seq_num 537) 2020-11-16T20:56:16.780 INFO:tasks.rados.rados.0.smithi166.stdout:631: finishing write tid 1 to smithi16641208-124 2020-11-16T20:56:16.781 INFO:tasks.rados.rados.0.smithi166.stdout:626: finishing copy_from to smithi16641208-33 2020-11-16T20:56:16.781 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 33 v 9 (ObjNum 12 snap 0 seq_num 12) dirty exists 2020-11-16T20:56:16.781 INFO:tasks.rados.rados.0.smithi166.stdout:626: finishing copy_from racing read to smithi16641208-33 2020-11-16T20:56:16.782 INFO:tasks.rados.rados.0.smithi166.stdout:631: finishing write tid 2 to smithi16641208-124 2020-11-16T20:56:16.783 INFO:tasks.rados.rados.0.smithi166.stdout:631: finishing write tid 3 to smithi16641208-124 2020-11-16T20:56:16.785 INFO:tasks.rados.rados.0.smithi166.stdout:631: finishing write tid 4 to smithi16641208-124 2020-11-16T20:56:16.785 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 124 v 471 (ObjNum 538 snap 11 seq_num 538) dirty exists 2020-11-16T20:56:16.785 INFO:tasks.rados.rados.0.smithi166.stdout:631: left oid 124 (ObjNum 538 snap 11 seq_num 538) 2020-11-16T20:56:16.796 INFO:tasks.rados.rados.0.smithi166.stdout:632: finishing rollback tid 0 to smithi16641208-303 2020-11-16T20:56:16.797 INFO:tasks.rados.rados.0.smithi166.stdout:628: finishing copy_from to smithi16641208-51 2020-11-16T20:56:16.797 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 51 v 161 (ObjNum 233 snap 0 seq_num 233) dirty exists 2020-11-16T20:56:16.798 INFO:tasks.rados.rados.0.smithi166.stdout:635: finishing rollback tid 0 to smithi16641208-390 2020-11-16T20:56:16.809 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:16.814+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:16.821 INFO:tasks.rados.rados.0.smithi166.stdout:633: finishing copy_from to smithi16641208-430 2020-11-16T20:56:16.821 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 430 v 244 (ObjNum 270 snap 0 seq_num 270) dirty exists 2020-11-16T20:56:16.831 INFO:tasks.rados.rados.0.smithi166.stdout:634: finishing copy_from to smithi16641208-400 2020-11-16T20:56:16.831 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 400 v 16 (ObjNum 43 snap 0 seq_num 43) dirty exists 2020-11-16T20:56:16.831 INFO:tasks.rados.rados.0.smithi166.stdout:634: finishing copy_from racing read to smithi16641208-400 2020-11-16T20:56:16.836 INFO:tasks.rados.rados.0.smithi166.stdout:632: finishing rollback tid 1 to smithi16641208-303 2020-11-16T20:56:16.837 INFO:tasks.rados.rados.0.smithi166.stdout:632: finishing rollback tid 2 to smithi16641208-303 2020-11-16T20:56:16.837 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 303 v 473 (ObjNum 302 snap 0 seq_num 302) dirty exists 2020-11-16T20:56:16.840 INFO:tasks.rados.rados.0.smithi166.stdout:635: finishing rollback tid 1 to smithi16641208-390 2020-11-16T20:56:16.841 INFO:tasks.rados.rados.0.smithi166.stdout:628: finishing copy_from racing read to smithi16641208-51 2020-11-16T20:56:16.841 INFO:tasks.rados.rados.0.smithi166.stdout:635: finishing rollback tid 2 to smithi16641208-390 2020-11-16T20:56:16.841 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 390 v 449 (ObjNum 389 snap 0 seq_num 389) dirty exists 2020-11-16T20:56:16.848 INFO:tasks.rados.rados.0.smithi166.stdout:633: finishing copy_from racing read to smithi16641208-430 2020-11-16T20:56:16.910 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:16.914+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:16.913 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:16.913 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:16.923 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:56:17.011 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:17.015+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:17.100 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:17.100 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:17.110 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:56:17.151 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:17.155+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:17.213 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:17.217+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:17.285 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:17.285 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:17.295 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:56:17.337 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:17.342+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:17.414 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:17.418+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:17.428 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:17.428 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:17.438 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:56:17.514 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:17.519+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:17.612 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:17.612 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:17.616 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:17.620+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:17.622 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:56:17.717 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:17.721+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:17.737 INFO:tasks.rados.rados.0.smithi166.stdout:626: done (9 left) 2020-11-16T20:56:17.737 INFO:tasks.rados.rados.0.smithi166.stdout:628: done (8 left) 2020-11-16T20:56:17.737 INFO:tasks.rados.rados.0.smithi166.stdout:630: done (7 left) 2020-11-16T20:56:17.738 INFO:tasks.rados.rados.0.smithi166.stdout:631: done (6 left) 2020-11-16T20:56:17.738 INFO:tasks.rados.rados.0.smithi166.stdout:632: done (5 left) 2020-11-16T20:56:17.738 INFO:tasks.rados.rados.0.smithi166.stdout:633: done (4 left) 2020-11-16T20:56:17.738 INFO:tasks.rados.rados.0.smithi166.stdout:634: done (3 left) 2020-11-16T20:56:17.738 INFO:tasks.rados.rados.0.smithi166.stdout:635: done (2 left) 2020-11-16T20:56:17.738 INFO:tasks.rados.rados.0.smithi166.stdout:636: done (1 left) 2020-11-16T20:56:17.738 INFO:tasks.rados.rados.0.smithi166.stdout:637: done (0 left) 2020-11-16T20:56:17.739 INFO:tasks.rados.rados.0.smithi166.stdout:638: rollback oid 236 current snap is 12 2020-11-16T20:56:17.739 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 236 to 3 2020-11-16T20:56:17.739 INFO:tasks.rados.rados.0.smithi166.stdout:639: cache_evict oid 184 snap -1 2020-11-16T20:56:17.739 INFO:tasks.rados.rados.0.smithi166.stdout:640: rollback oid 355 current snap is 12 2020-11-16T20:56:17.739 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 355 to 10 2020-11-16T20:56:17.739 INFO:tasks.rados.rados.0.smithi166.stdout:641: write (excl) oid 486 current snap is 12 2020-11-16T20:56:17.739 INFO:tasks.rados.rados.0.smithi166.stdout:641: seq_num 539 ranges {658973=703921,1907912=570853,2985346=73627} 2020-11-16T20:56:17.745 INFO:tasks.rados.rados.0.smithi166.stdout:641: writing smithi16641208-486 from 658973 to 1362894 tid 1 2020-11-16T20:56:17.752 INFO:tasks.rados.rados.0.smithi166.stdout:641: writing smithi16641208-486 from 1907912 to 2478765 tid 2 2020-11-16T20:56:17.755 INFO:tasks.rados.rados.0.smithi166.stdout:641: writing smithi16641208-486 from 2985346 to 3058973 tid 3 2020-11-16T20:56:17.756 INFO:tasks.rados.rados.0.smithi166.stdout:642: delete oid 464 current snap is 12 2020-11-16T20:56:17.756 INFO:tasks.rados.rados.0.smithi166.stdout:639: got (2) No such file or directory 2020-11-16T20:56:17.756 INFO:tasks.rados.rados.0.smithi166.stdout:638: finishing rollback tid 0 to smithi16641208-236 2020-11-16T20:56:17.756 INFO:tasks.rados.rados.0.smithi166.stdout:640: finishing rollback tid 0 to smithi16641208-355 2020-11-16T20:56:17.756 INFO:tasks.rados.rados.0.smithi166.stdout:641: finishing write tid 1 to smithi16641208-486 2020-11-16T20:56:17.760 INFO:tasks.rados.rados.0.smithi166.stdout:641: finishing write tid 2 to smithi16641208-486 2020-11-16T20:56:17.762 INFO:tasks.rados.rados.0.smithi166.stdout:641: finishing write tid 3 to smithi16641208-486 2020-11-16T20:56:17.762 INFO:tasks.rados.rados.0.smithi166.stdout:641: finishing write tid 4 to smithi16641208-486 2020-11-16T20:56:17.762 INFO:tasks.rados.rados.0.smithi166.stdout:639: done (4 left) 2020-11-16T20:56:17.762 INFO:tasks.rados.rados.0.smithi166.stdout:642: done (3 left) 2020-11-16T20:56:17.762 INFO:tasks.rados.rados.0.smithi166.stdout:643: copy_from oid 82 from oid 405 current snap is 12 2020-11-16T20:56:17.763 INFO:tasks.rados.rados.0.smithi166.stdout:644: cache_flush oid 317 snap -1 2020-11-16T20:56:17.763 INFO:tasks.rados.rados.0.smithi166.stdout:645: rollback oid 321 current snap is 12 2020-11-16T20:56:17.763 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 321 to 3 2020-11-16T20:56:17.763 INFO:tasks.rados.rados.0.smithi166.stdout:641: finishing write tid 5 to smithi16641208-486 2020-11-16T20:56:17.763 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 486 v 461 (ObjNum 539 snap 12 seq_num 539) dirty exists 2020-11-16T20:56:17.763 INFO:tasks.rados.rados.0.smithi166.stdout:641: left oid 486 (ObjNum 539 snap 12 seq_num 539) 2020-11-16T20:56:17.763 INFO:tasks.rados.rados.0.smithi166.stdout:641: done (5 left) 2020-11-16T20:56:17.763 INFO:tasks.rados.rados.0.smithi166.stdout:646: cache_flush oid 156 snap -1 2020-11-16T20:56:17.764 INFO:tasks.rados.rados.0.smithi166.stdout:647: write (excl) oid 6 current snap is 12 2020-11-16T20:56:17.764 INFO:tasks.rados.rados.0.smithi166.stdout:647: seq_num 541 ranges {692587=570772,2024876=574522,3040192=52395} 2020-11-16T20:56:17.770 INFO:tasks.rados.rados.0.smithi166.stdout:647: writing smithi16641208-6 from 692587 to 1263359 tid 1 2020-11-16T20:56:17.773 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:17.773 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:17.779 INFO:tasks.rados.rados.0.smithi166.stdout:647: writing smithi16641208-6 from 2024876 to 2599398 tid 2 2020-11-16T20:56:17.782 INFO:tasks.rados.rados.0.smithi166.stdout:647: writing smithi16641208-6 from 3040192 to 3092587 tid 3 2020-11-16T20:56:17.782 INFO:tasks.rados.rados.0.smithi166.stdout:648: read oid 98 snap 8 2020-11-16T20:56:17.783 INFO:tasks.rados.rados.0.smithi166.stdout:648: expect (ObjNum 97 snap 0 seq_num 97) 2020-11-16T20:56:17.783 INFO:tasks.rados.rados.0.smithi166.stdout:649: delete oid 295 current snap is 12 2020-11-16T20:56:17.783 INFO:tasks.rados.rados.0.smithi166.stdout:644: got (0) Success 2020-11-16T20:56:17.783 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 317 v 0 (ObjNum 526 snap 6 seq_num 526) dirty exists 2020-11-16T20:56:17.783 INFO:tasks.rados.rados.0.smithi166.stdout:645: finishing rollback tid 0 to smithi16641208-321 2020-11-16T20:56:17.784 INFO:tasks.rados.rados.0.smithi166.stdout:645: finishing rollback tid 1 to smithi16641208-321 2020-11-16T20:56:17.784 INFO:tasks.rados.rados.0.smithi166.stdout:645: finishing rollback tid 2 to smithi16641208-321 2020-11-16T20:56:17.784 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 321 v 452 (ObjNum 320 snap 0 seq_num 320) dirty exists 2020-11-16T20:56:17.788 INFO:tasks.rados.rados.0.smithi166.stdout:647: finishing write tid 1 to smithi16641208-6 2020-11-16T20:56:17.791 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:56:17.794 INFO:tasks.rados.rados.0.smithi166.stdout:646: got (2) No such file or directory 2020-11-16T20:56:17.798 INFO:tasks.rados.rados.0.smithi166.stdout:644: done (8 left) 2020-11-16T20:56:17.798 INFO:tasks.rados.rados.0.smithi166.stdout:645: done (7 left) 2020-11-16T20:56:17.798 INFO:tasks.rados.rados.0.smithi166.stdout:646: done (6 left) 2020-11-16T20:56:17.798 INFO:tasks.rados.rados.0.smithi166.stdout:649: done (5 left) 2020-11-16T20:56:17.799 INFO:tasks.rados.rados.0.smithi166.stdout:650: delete oid 409 current snap is 12 2020-11-16T20:56:17.799 INFO:tasks.rados.rados.0.smithi166.stdout:648: expect (ObjNum 97 snap 0 seq_num 97) 2020-11-16T20:56:17.818 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:17.823+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:17.831 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:56:17.919 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:17.923+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:17.925 INFO:tasks.rados.rados.0.smithi166.stdout:647: finishing write tid 2 to smithi16641208-6 2020-11-16T20:56:17.926 INFO:tasks.rados.rados.0.smithi166.stdout:647: finishing write tid 3 to smithi16641208-6 2020-11-16T20:56:17.926 INFO:tasks.rados.rados.0.smithi166.stdout:647: finishing write tid 4 to smithi16641208-6 2020-11-16T20:56:17.926 INFO:tasks.rados.rados.0.smithi166.stdout:647: finishing write tid 5 to smithi16641208-6 2020-11-16T20:56:17.926 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 6 v 465 (ObjNum 541 snap 12 seq_num 541) dirty exists 2020-11-16T20:56:17.926 INFO:tasks.rados.rados.0.smithi166.stdout:647: left oid 6 (ObjNum 541 snap 12 seq_num 541) 2020-11-16T20:56:17.926 INFO:tasks.rados.rados.0.smithi166.stdout:638: finishing rollback tid 1 to smithi16641208-236 2020-11-16T20:56:17.927 INFO:tasks.rados.rados.0.smithi166.stdout:638: finishing rollback tid 2 to smithi16641208-236 2020-11-16T20:56:17.927 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 236 v 477 (ObjNum 235 snap 0 seq_num 235) dirty exists 2020-11-16T20:56:17.927 INFO:tasks.rados.rados.0.smithi166.stdout:640: finishing rollback tid 1 to smithi16641208-355 2020-11-16T20:56:17.927 INFO:tasks.rados.rados.0.smithi166.stdout:640: finishing rollback tid 2 to smithi16641208-355 2020-11-16T20:56:17.927 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 355 v 479 (ObjNum 354 snap 0 seq_num 354) dirty exists 2020-11-16T20:56:17.927 INFO:tasks.rados.rados.0.smithi166.stdout:643: finishing copy_from to smithi16641208-82 2020-11-16T20:56:17.927 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 82 v 267 (ObjNum 404 snap 0 seq_num 404) dirty exists 2020-11-16T20:56:17.928 INFO:tasks.rados.rados.0.smithi166.stdout:643: finishing copy_from racing read to smithi16641208-82 2020-11-16T20:56:17.928 INFO:tasks.rados.rados.0.smithi166.stdout:638: done (5 left) 2020-11-16T20:56:17.928 INFO:tasks.rados.rados.0.smithi166.stdout:640: done (4 left) 2020-11-16T20:56:17.928 INFO:tasks.rados.rados.0.smithi166.stdout:643: done (3 left) 2020-11-16T20:56:17.928 INFO:tasks.rados.rados.0.smithi166.stdout:647: done (2 left) 2020-11-16T20:56:17.928 INFO:tasks.rados.rados.0.smithi166.stdout:648: done (1 left) 2020-11-16T20:56:17.928 INFO:tasks.rados.rados.0.smithi166.stdout:650: done (0 left) 2020-11-16T20:56:17.928 INFO:tasks.rados.rados.0.smithi166.stdout:651: snap_remove snap 11 2020-11-16T20:56:17.947 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:17.947 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:17.958 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:56:17.978 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:56:17.998 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:56:18.019 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:56:18.019 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:18.024+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:18.039 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:56:18.039 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:56:18.039 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2020-11-16T20:56:18.040 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:56:18.065 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:56:18.104 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:56:18.120 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:18.124+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:18.136 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:56:18.139 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:18.140 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:56:18.140 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:56:18.140 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:56:18.140 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.140 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:22 4.3 4:fc3a32b3:::smithi16641208-6:head [write 2059704~24331] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:56:18.140 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:50.969667+0000", 2020-11-16T20:56:18.141 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 27.171772669999999, 2020-11-16T20:56:18.141 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022958137, 2020-11-16T20:56:18.141 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:18.141 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:18.141 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:18.141 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:18.141 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:18.142 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 22 2020-11-16T20:56:18.142 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.142 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:18.142 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.142 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:18.142 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969667+0000", 2020-11-16T20:56:18.142 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:18.143 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.143 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.143 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:18.143 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969667+0000", 2020-11-16T20:56:18.143 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9085999999999998e-05 2020-11-16T20:56:18.143 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.143 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.144 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:18.144 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969706+0000", 2020-11-16T20:56:18.144 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.994e-06 2020-11-16T20:56:18.144 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.144 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.144 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:18.144 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969711+0000", 2020-11-16T20:56:18.144 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6490000000000008e-06 2020-11-16T20:56:18.145 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.145 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.145 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:18.145 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969719+0000", 2020-11-16T20:56:18.145 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4499999999999997e-06 2020-11-16T20:56:18.145 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.145 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.146 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:18.146 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969723+0000", 2020-11-16T20:56:18.146 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2823e-05 2020-11-16T20:56:18.146 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.146 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.146 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.146 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969766+0000", 2020-11-16T20:56:18.147 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6242999999999996e-05 2020-11-16T20:56:18.147 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.147 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.147 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:18.147 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969832+0000", 2020-11-16T20:56:18.147 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012406587 2020-11-16T20:56:18.147 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.147 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.148 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.148 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.982239+0000", 2020-11-16T20:56:18.148 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.0938000000000003e-05 2020-11-16T20:56:18.148 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.148 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.148 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:18.148 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.982320+0000", 2020-11-16T20:56:18.149 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011629 2020-11-16T20:56:18.149 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.149 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.149 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:56:18.149 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.982436+0000", 2020-11-16T20:56:18.149 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0013140879999999999 2020-11-16T20:56:18.149 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.149 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.150 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:18.150 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.983750+0000", 2020-11-16T20:56:18.150 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0087830349999999998 2020-11-16T20:56:18.150 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.150 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.150 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:18.150 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.992533+0000", 2020-11-16T20:56:18.151 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2541999999999999e-05 2020-11-16T20:56:18.151 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.151 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.151 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:18.151 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.992556+0000", 2020-11-16T20:56:18.151 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1795999999999998e-05 2020-11-16T20:56:18.151 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.151 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.152 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:18.152 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.992598+0000", 2020-11-16T20:56:18.152 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7616000000000001e-05 2020-11-16T20:56:18.152 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.152 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.152 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:18.152 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.992625+0000", 2020-11-16T20:56:18.153 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022958137 2020-11-16T20:56:18.153 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.153 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.153 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.153 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.153 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.153 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:23 4.3 4:fc3a32b3:::smithi16641208-6:head [setxattr _header (55) in=7b,truncate 2084035] snapc 0=[] ondisk+write+known_if_redirected e33)", 2020-11-16T20:56:18.153 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:50.969748+0000", 2020-11-16T20:56:18.154 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 27.171691735, 2020-11-16T20:56:18.154 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023094956999999999, 2020-11-16T20:56:18.154 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:18.154 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:18.154 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:18.154 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:18.154 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:18.155 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 23 2020-11-16T20:56:18.155 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.155 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:18.155 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.155 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:18.155 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969748+0000", 2020-11-16T20:56:18.155 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:18.156 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.156 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.156 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:18.156 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969748+0000", 2020-11-16T20:56:18.156 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1563e-05 2020-11-16T20:56:18.156 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.156 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.156 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:18.157 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969770+0000", 2020-11-16T20:56:18.157 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.155e-06 2020-11-16T20:56:18.157 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.157 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.157 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:18.157 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969774+0000", 2020-11-16T20:56:18.157 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.502e-06 2020-11-16T20:56:18.158 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.158 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.158 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:18.158 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969779+0000", 2020-11-16T20:56:18.158 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8930000000000001e-06 2020-11-16T20:56:18.158 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.158 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.159 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:18.159 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969782+0000", 2020-11-16T20:56:18.159 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6954999999999998e-05 2020-11-16T20:56:18.159 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.159 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.159 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.159 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969859+0000", 2020-11-16T20:56:18.159 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9341e-05 2020-11-16T20:56:18.160 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.160 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.160 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:18.160 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969919+0000", 2020-11-16T20:56:18.160 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013171852 2020-11-16T20:56:18.160 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.160 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.160 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.161 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.983090+0000", 2020-11-16T20:56:18.161 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8386000000000005e-05 2020-11-16T20:56:18.161 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.161 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.161 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:18.161 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.983169+0000", 2020-11-16T20:56:18.161 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013316599999999999 2020-11-16T20:56:18.162 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.162 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.162 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:56:18.162 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.983302+0000", 2020-11-16T20:56:18.162 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045381300000000001 2020-11-16T20:56:18.162 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.162 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.163 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:18.163 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.983756+0000", 2020-11-16T20:56:18.163 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0089264610000000001 2020-11-16T20:56:18.163 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.163 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.163 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:18.163 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.992682+0000", 2020-11-16T20:56:18.163 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8300000000000003e-05 2020-11-16T20:56:18.164 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.164 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.164 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:18.164 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.992721+0000", 2020-11-16T20:56:18.164 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0717999999999997e-05 2020-11-16T20:56:18.164 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.164 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.165 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:18.165 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.992781+0000", 2020-11-16T20:56:18.165 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1852000000000003e-05 2020-11-16T20:56:18.165 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.165 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.165 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:18.165 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.992843+0000", 2020-11-16T20:56:18.166 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023094956999999999 2020-11-16T20:56:18.166 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.166 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.166 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.166 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.166 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.166 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:24 4.3 4:fc3a32b3:::smithi16641208-6:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:56:18.166 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:50.969800+0000", 2020-11-16T20:56:18.167 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 27.171640096000001, 2020-11-16T20:56:18.167 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023518638000000001, 2020-11-16T20:56:18.167 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:18.167 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:18.167 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:18.167 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:18.167 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:18.168 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 24 2020-11-16T20:56:18.168 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.168 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:18.168 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.168 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:18.168 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969800+0000", 2020-11-16T20:56:18.168 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:18.168 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.169 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.169 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:18.169 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969800+0000", 2020-11-16T20:56:18.169 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5668999999999999e-05 2020-11-16T20:56:18.169 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.169 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.169 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:18.170 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969815+0000", 2020-11-16T20:56:18.170 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7439999999999999e-06 2020-11-16T20:56:18.170 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.170 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.170 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:18.170 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969818+0000", 2020-11-16T20:56:18.170 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3100000000000001e-06 2020-11-16T20:56:18.171 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.171 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.171 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:18.171 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969826+0000", 2020-11-16T20:56:18.171 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.514e-06 2020-11-16T20:56:18.171 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.171 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.171 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:18.172 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969829+0000", 2020-11-16T20:56:18.172 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000115017 2020-11-16T20:56:18.172 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.172 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.172 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.172 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969944+0000", 2020-11-16T20:56:18.172 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7790000000000002e-05 2020-11-16T20:56:18.173 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.173 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.173 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:18.173 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.969992+0000", 2020-11-16T20:56:18.173 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013548503 2020-11-16T20:56:18.173 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.173 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.173 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.174 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.983540+0000", 2020-11-16T20:56:18.174 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4671000000000003e-05 2020-11-16T20:56:18.174 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.174 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.174 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:18.174 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.983625+0000", 2020-11-16T20:56:18.174 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092540999999999995 2020-11-16T20:56:18.175 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.175 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.175 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.175 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.992879+0000", 2020-11-16T20:56:18.175 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012690499999999999 2020-11-16T20:56:18.175 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.175 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.175 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:18.176 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.993006+0000", 2020-11-16T20:56:18.176 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00031241500000000002 2020-11-16T20:56:18.176 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.176 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.176 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:18.176 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:50.993318+0000", 2020-11-16T20:56:18.176 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023518638000000001 2020-11-16T20:56:18.177 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.177 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.177 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.177 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.177 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.177 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1058 4.3 4:c9fee0b4:::smithi16641208-235:head [write 3210039~571651] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:18.177 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.758237+0000", 2020-11-16T20:56:18.177 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 23.383203229999999, 2020-11-16T20:56:18.178 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022625346000000001, 2020-11-16T20:56:18.178 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:18.178 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:18.178 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:18.178 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:18.178 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:18.178 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1058 2020-11-16T20:56:18.179 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.179 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:18.179 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.179 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:18.179 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758237+0000", 2020-11-16T20:56:18.179 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:18.179 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.179 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.180 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:18.180 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758237+0000", 2020-11-16T20:56:18.180 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013014999999999999 2020-11-16T20:56:18.180 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.180 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.180 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:18.180 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758367+0000", 2020-11-16T20:56:18.181 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.826e-06 2020-11-16T20:56:18.181 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.181 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.181 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:18.181 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758372+0000", 2020-11-16T20:56:18.181 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8520000000000004e-06 2020-11-16T20:56:18.181 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.181 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.182 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:18.182 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758379+0000", 2020-11-16T20:56:18.182 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8880000000000002e-06 2020-11-16T20:56:18.182 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.182 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.182 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:18.182 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758385+0000", 2020-11-16T20:56:18.183 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1022000000000001e-05 2020-11-16T20:56:18.183 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.183 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.183 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.183 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758426+0000", 2020-11-16T20:56:18.183 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6464e-05 2020-11-16T20:56:18.183 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.183 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.184 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:18.184 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758483+0000", 2020-11-16T20:56:18.184 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007121863 2020-11-16T20:56:18.184 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.184 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.184 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.184 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.765605+0000", 2020-11-16T20:56:18.185 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000150488 2020-11-16T20:56:18.185 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.185 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.185 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:18.185 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.765755+0000", 2020-11-16T20:56:18.185 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000196104 2020-11-16T20:56:18.185 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.185 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.186 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:56:18.186 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.765951+0000", 2020-11-16T20:56:18.186 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0047861450000000003 2020-11-16T20:56:18.186 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.186 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.186 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:18.186 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.770737+0000", 2020-11-16T20:56:18.187 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094327530000000003 2020-11-16T20:56:18.187 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.187 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.187 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:18.187 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.780170+0000", 2020-11-16T20:56:18.187 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00057350800000000003 2020-11-16T20:56:18.187 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.187 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.188 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:18.188 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.780744+0000", 2020-11-16T20:56:18.188 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9132000000000002e-05 2020-11-16T20:56:18.188 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.188 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.188 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:18.188 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.780813+0000", 2020-11-16T20:56:18.189 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9150999999999997e-05 2020-11-16T20:56:18.189 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.189 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.189 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:18.189 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.780862+0000", 2020-11-16T20:56:18.189 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022625346000000001 2020-11-16T20:56:18.189 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.189 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.190 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.190 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.190 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.190 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1059 4.3 4:c9fee0b4:::smithi16641208-235:head [setxattr _header (57) in=7b,truncate 3932838] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:18.190 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.758407+0000", 2020-11-16T20:56:18.190 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 23.383032832000001, 2020-11-16T20:56:18.190 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022754090000000001, 2020-11-16T20:56:18.191 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:18.191 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:18.191 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:18.191 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:18.191 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:18.191 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1059 2020-11-16T20:56:18.191 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.191 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:18.192 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.192 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:18.192 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758407+0000", 2020-11-16T20:56:18.192 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:18.192 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.192 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.192 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:18.193 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758407+0000", 2020-11-16T20:56:18.193 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3376000000000001e-05 2020-11-16T20:56:18.193 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.193 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.193 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:18.193 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758430+0000", 2020-11-16T20:56:18.193 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1310000000000002e-06 2020-11-16T20:56:18.193 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.194 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.194 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:18.194 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758434+0000", 2020-11-16T20:56:18.194 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2789999999999998e-06 2020-11-16T20:56:18.194 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.194 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.194 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:18.195 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758439+0000", 2020-11-16T20:56:18.195 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7379999999999999e-06 2020-11-16T20:56:18.195 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.195 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.195 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:18.195 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758442+0000", 2020-11-16T20:56:18.195 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6581999999999994e-05 2020-11-16T20:56:18.196 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.196 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.196 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.196 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758508+0000", 2020-11-16T20:56:18.196 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6446999999999998e-05 2020-11-16T20:56:18.196 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.196 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.196 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:18.197 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758555+0000", 2020-11-16T20:56:18.197 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0085127880000000003 2020-11-16T20:56:18.197 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.197 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.197 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.197 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.767067+0000", 2020-11-16T20:56:18.197 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000135029 2020-11-16T20:56:18.198 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.198 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.198 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:18.198 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.767202+0000", 2020-11-16T20:56:18.198 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016839700000000001 2020-11-16T20:56:18.198 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.198 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.198 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:56:18.199 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.767371+0000", 2020-11-16T20:56:18.199 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035788830000000002 2020-11-16T20:56:18.199 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.199 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.199 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:18.199 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.770950+0000", 2020-11-16T20:56:18.199 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0099601050000000003 2020-11-16T20:56:18.200 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.200 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.200 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:18.200 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.780910+0000", 2020-11-16T20:56:18.200 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8102000000000002e-05 2020-11-16T20:56:18.200 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.200 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.200 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:18.201 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.780948+0000", 2020-11-16T20:56:18.201 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012368500000000001 2020-11-16T20:56:18.201 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.201 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.201 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:18.201 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.781072+0000", 2020-11-16T20:56:18.201 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9548000000000004e-05 2020-11-16T20:56:18.202 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.202 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.202 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:18.202 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.781161+0000", 2020-11-16T20:56:18.202 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022754090000000001 2020-11-16T20:56:18.202 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.202 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.202 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.203 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.203 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.203 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1060 4.3 4:c9fee0b4:::smithi16641208-235:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:56:18.203 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.758461+0000", 2020-11-16T20:56:18.203 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 23.382978913999999, 2020-11-16T20:56:18.203 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023396862000000001, 2020-11-16T20:56:18.203 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:18.204 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:18.204 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:18.204 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:18.204 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:18.204 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1060 2020-11-16T20:56:18.204 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.204 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:18.204 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.205 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:18.205 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758461+0000", 2020-11-16T20:56:18.205 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:18.205 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.205 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.205 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:18.205 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758461+0000", 2020-11-16T20:56:18.206 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5608e-05 2020-11-16T20:56:18.206 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.206 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.206 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:18.206 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758477+0000", 2020-11-16T20:56:18.206 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.971e-06 2020-11-16T20:56:18.206 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.206 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.207 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:18.207 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758480+0000", 2020-11-16T20:56:18.207 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5110000000000003e-06 2020-11-16T20:56:18.207 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.207 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.207 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:18.207 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758485+0000", 2020-11-16T20:56:18.207 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3420000000000002e-06 2020-11-16T20:56:18.208 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.208 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.208 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:18.208 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758487+0000", 2020-11-16T20:56:18.208 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9705999999999998e-05 2020-11-16T20:56:18.208 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.208 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.209 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.209 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758577+0000", 2020-11-16T20:56:18.209 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3758999999999999e-05 2020-11-16T20:56:18.209 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.209 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.209 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:18.209 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.758621+0000", 2020-11-16T20:56:18.209 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0090497489999999993 2020-11-16T20:56:18.210 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.210 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.210 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.210 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.767671+0000", 2020-11-16T20:56:18.210 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114125 2020-11-16T20:56:18.210 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.210 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.211 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:18.211 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.767785+0000", 2020-11-16T20:56:18.211 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013424666 2020-11-16T20:56:18.211 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.211 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.211 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.211 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.781209+0000", 2020-11-16T20:56:18.211 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5508999999999997e-05 2020-11-16T20:56:18.212 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.212 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.212 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:18.212 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.781295+0000", 2020-11-16T20:56:18.212 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000562916 2020-11-16T20:56:18.212 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.212 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.213 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:18.213 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.781858+0000", 2020-11-16T20:56:18.213 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023396862000000001 2020-11-16T20:56:18.213 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.213 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.213 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.213 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.213 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.214 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1087 4.3 4:d76da88a:::smithi16641208-241:head [setxattr _header (57) in=7b,truncate 2033680] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:18.214 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.865089+0000", 2020-11-16T20:56:18.214 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 23.276351067, 2020-11-16T20:56:18.214 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021749237000000001, 2020-11-16T20:56:18.214 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:18.214 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:18.214 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:18.215 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:18.215 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:18.215 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1087 2020-11-16T20:56:18.215 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.215 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:18.215 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.215 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:18.215 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865089+0000", 2020-11-16T20:56:18.216 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:18.216 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.216 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.216 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:18.216 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865089+0000", 2020-11-16T20:56:18.216 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9706000000000002e-05 2020-11-16T20:56:18.216 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.217 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.217 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:18.217 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865128+0000", 2020-11-16T20:56:18.217 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0039999999999999e-06 2020-11-16T20:56:18.217 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.217 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.217 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:18.217 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865133+0000", 2020-11-16T20:56:18.218 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.7759999999999992e-06 2020-11-16T20:56:18.218 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.218 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.218 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:18.218 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865143+0000", 2020-11-16T20:56:18.218 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9530000000000001e-06 2020-11-16T20:56:18.218 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.219 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.219 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:18.219 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865147+0000", 2020-11-16T20:56:18.219 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00027494100000000001 2020-11-16T20:56:18.219 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.219 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.219 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.219 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865422+0000", 2020-11-16T20:56:18.220 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1785000000000006e-05 2020-11-16T20:56:18.220 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.220 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.220 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:18.220 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865484+0000", 2020-11-16T20:56:18.220 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011240791999999999 2020-11-16T20:56:18.220 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.221 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.221 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.221 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.876725+0000", 2020-11-16T20:56:18.221 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015467500000000001 2020-11-16T20:56:18.221 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.221 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.221 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:18.221 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.876879+0000", 2020-11-16T20:56:18.222 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011158900000000001 2020-11-16T20:56:18.222 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.222 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.222 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:56:18.222 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.876991+0000", 2020-11-16T20:56:18.222 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001134 2020-11-16T20:56:18.222 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.223 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.223 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:18.223 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.878125+0000", 2020-11-16T20:56:18.223 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0082293690000000003 2020-11-16T20:56:18.223 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.223 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.223 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:18.223 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.886354+0000", 2020-11-16T20:56:18.224 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00035530099999999998 2020-11-16T20:56:18.224 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.224 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.224 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:18.224 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.886710+0000", 2020-11-16T20:56:18.224 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1882000000000001e-05 2020-11-16T20:56:18.224 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.225 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.225 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:18.225 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.886772+0000", 2020-11-16T20:56:18.225 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6464000000000006e-05 2020-11-16T20:56:18.225 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.225 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.225 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:18.225 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.886838+0000", 2020-11-16T20:56:18.226 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021749237000000001 2020-11-16T20:56:18.226 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.226 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.226 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.226 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.226 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.226 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1088 4.3 4:d76da88a:::smithi16641208-241:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:56:18.227 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.865184+0000", 2020-11-16T20:56:18.227 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 23.276255833, 2020-11-16T20:56:18.227 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022135986, 2020-11-16T20:56:18.227 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:18.227 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:18.227 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:18.227 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:18.227 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:18.228 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1088 2020-11-16T20:56:18.228 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.228 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:18.228 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.228 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:18.228 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865184+0000", 2020-11-16T20:56:18.228 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:18.229 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.229 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.229 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:18.229 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865184+0000", 2020-11-16T20:56:18.229 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8971000000000001e-05 2020-11-16T20:56:18.229 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.229 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.229 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:18.230 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865213+0000", 2020-11-16T20:56:18.230 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9339999999999997e-06 2020-11-16T20:56:18.230 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.230 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.230 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:18.230 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865218+0000", 2020-11-16T20:56:18.230 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7649999999999999e-06 2020-11-16T20:56:18.231 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.231 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.231 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:18.231 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865227+0000", 2020-11-16T20:56:18.231 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8120000000000001e-06 2020-11-16T20:56:18.231 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.231 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.231 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:18.232 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865231+0000", 2020-11-16T20:56:18.232 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000276438 2020-11-16T20:56:18.232 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.232 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.232 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.232 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865507+0000", 2020-11-16T20:56:18.232 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2175999999999997e-05 2020-11-16T20:56:18.233 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.233 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.233 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:18.233 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.865549+0000", 2020-11-16T20:56:18.233 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011964954 2020-11-16T20:56:18.233 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.233 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.233 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.234 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.877514+0000", 2020-11-16T20:56:18.234 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000123745 2020-11-16T20:56:18.234 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.234 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.234 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:18.234 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.877638+0000", 2020-11-16T20:56:18.234 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092450929999999994 2020-11-16T20:56:18.235 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.235 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.235 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.235 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.886883+0000", 2020-11-16T20:56:18.235 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000126353 2020-11-16T20:56:18.235 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.235 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.235 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:18.236 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.887009+0000", 2020-11-16T20:56:18.236 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00031074500000000002 2020-11-16T20:56:18.236 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.236 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.236 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:18.236 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.887320+0000", 2020-11-16T20:56:18.236 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022135986 2020-11-16T20:56:18.237 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.237 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.237 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.237 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.237 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.237 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1092 4.3 4:dafe2ce7:::smithi16641208-242:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:56:18.237 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.877720+0000", 2020-11-16T20:56:18.237 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 23.263719448, 2020-11-16T20:56:18.238 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030035315, 2020-11-16T20:56:18.238 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:18.238 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:18.238 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:18.238 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:18.238 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:18.238 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1092 2020-11-16T20:56:18.239 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.239 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:18.239 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.239 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:18.239 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.877720+0000", 2020-11-16T20:56:18.239 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:18.239 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.239 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.240 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:18.240 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.877720+0000", 2020-11-16T20:56:18.240 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1433999999999998e-05 2020-11-16T20:56:18.240 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.240 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.240 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:18.240 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.877752+0000", 2020-11-16T20:56:18.241 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1099999999999999e-06 2020-11-16T20:56:18.243 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.243 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.243 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:18.243 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.877758+0000", 2020-11-16T20:56:18.243 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5451000000000001e-05 2020-11-16T20:56:18.243 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.244 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.244 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:18.244 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.877783+0000", 2020-11-16T20:56:18.244 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4539999999999998e-06 2020-11-16T20:56:18.244 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.244 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.244 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:18.245 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.877789+0000", 2020-11-16T20:56:18.245 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024410299999999999 2020-11-16T20:56:18.245 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.245 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.245 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.245 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.878033+0000", 2020-11-16T20:56:18.245 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9281000000000002e-05 2020-11-16T20:56:18.246 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.246 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.246 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:18.246 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.878112+0000", 2020-11-16T20:56:18.246 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020799528000000001 2020-11-16T20:56:18.246 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.246 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.246 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.247 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.898912+0000", 2020-11-16T20:56:18.247 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012294699999999999 2020-11-16T20:56:18.247 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.247 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.247 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:18.247 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.899035+0000", 2020-11-16T20:56:18.247 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0081677739999999992 2020-11-16T20:56:18.248 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.248 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.248 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.248 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.907202+0000", 2020-11-16T20:56:18.248 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000115129 2020-11-16T20:56:18.248 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.248 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.248 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:18.249 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.907318+0000", 2020-11-16T20:56:18.249 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00043810399999999998 2020-11-16T20:56:18.249 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.249 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.249 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:18.249 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.907756+0000", 2020-11-16T20:56:18.249 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030035315 2020-11-16T20:56:18.249 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.250 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.250 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.250 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.250 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.250 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2342 4.3 4:c97658cf:::smithi16641208-283:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e41)", 2020-11-16T20:56:18.250 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:03.998575+0000", 2020-11-16T20:56:18.250 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 14.142864528, 2020-11-16T20:56:18.251 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027999124, 2020-11-16T20:56:18.251 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:18.251 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:18.251 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:18.251 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:18.251 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:18.251 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2342 2020-11-16T20:56:18.251 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.252 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:18.252 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.252 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:18.252 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:03.998575+0000", 2020-11-16T20:56:18.252 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:18.252 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.252 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.253 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:18.253 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:03.998575+0000", 2020-11-16T20:56:18.253 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3098000000000001e-05 2020-11-16T20:56:18.253 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.253 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.253 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:18.253 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:03.998598+0000", 2020-11-16T20:56:18.253 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3189999999999999e-06 2020-11-16T20:56:18.254 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.254 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.254 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:18.254 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:03.998602+0000", 2020-11-16T20:56:18.254 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9750000000000001e-06 2020-11-16T20:56:18.254 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.254 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.255 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:18.255 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:03.998609+0000", 2020-11-16T20:56:18.255 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8540000000000001e-06 2020-11-16T20:56:18.255 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.255 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.255 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:18.255 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:03.998612+0000", 2020-11-16T20:56:18.255 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00031678499999999998 2020-11-16T20:56:18.256 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.256 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.256 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.256 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:03.998928+0000", 2020-11-16T20:56:18.256 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7091000000000001e-05 2020-11-16T20:56:18.256 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.256 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.257 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:18.257 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:03.998965+0000", 2020-11-16T20:56:18.257 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016605517 2020-11-16T20:56:18.257 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.257 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.257 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.257 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.015571+0000", 2020-11-16T20:56:18.257 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000127174 2020-11-16T20:56:18.258 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.258 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.258 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:18.258 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.015698+0000", 2020-11-16T20:56:18.258 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010568884000000001 2020-11-16T20:56:18.258 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.258 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.259 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.259 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.026267+0000", 2020-11-16T20:56:18.259 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2447000000000005e-05 2020-11-16T20:56:18.259 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.259 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.259 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:18.259 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.026349+0000", 2020-11-16T20:56:18.259 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022498 2020-11-16T20:56:18.260 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.260 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.260 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:18.260 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.026574+0000", 2020-11-16T20:56:18.260 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027999124 2020-11-16T20:56:18.260 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.260 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.261 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.261 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.261 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.261 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2345 4.3 4:c9160c9c:::smithi16641208-411:head [rollback 5] snapc 6=[6,5,4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e41)", 2020-11-16T20:56:18.261 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:04.115684+0000", 2020-11-16T20:56:18.261 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 14.025755802999999, 2020-11-16T20:56:18.261 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033152890999999997, 2020-11-16T20:56:18.261 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:18.262 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:18.262 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:18.262 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:18.262 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:18.262 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2345 2020-11-16T20:56:18.262 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.262 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:18.263 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.263 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:18.263 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115684+0000", 2020-11-16T20:56:18.263 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:18.263 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.263 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.263 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:18.263 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115684+0000", 2020-11-16T20:56:18.264 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5156e-05 2020-11-16T20:56:18.264 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.264 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.264 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:18.264 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115699+0000", 2020-11-16T20:56:18.264 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.852e-06 2020-11-16T20:56:18.264 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.265 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.265 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:18.265 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115702+0000", 2020-11-16T20:56:18.265 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.366e-06 2020-11-16T20:56:18.265 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.265 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.265 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:18.265 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115707+0000", 2020-11-16T20:56:18.266 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5110000000000002e-06 2020-11-16T20:56:18.266 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.266 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.266 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:18.266 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115710+0000", 2020-11-16T20:56:18.266 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00026113800000000001 2020-11-16T20:56:18.266 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.267 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.267 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.267 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115971+0000", 2020-11-16T20:56:18.267 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5478000000000002e-05 2020-11-16T20:56:18.267 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.267 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.267 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:18.267 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.116007+0000", 2020-11-16T20:56:18.268 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011434730000000001 2020-11-16T20:56:18.268 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.268 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.268 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.268 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.127441+0000", 2020-11-16T20:56:18.268 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000106121 2020-11-16T20:56:18.268 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.269 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.269 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:18.269 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.127547+0000", 2020-11-16T20:56:18.269 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019369799999999999 2020-11-16T20:56:18.269 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.269 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.269 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:18.269 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.127741+0000", 2020-11-16T20:56:18.270 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8986999999999999e-05 2020-11-16T20:56:18.270 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.270 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.270 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:18.270 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.127770+0000", 2020-11-16T20:56:18.270 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0079205560000000005 2020-11-16T20:56:18.270 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.271 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.271 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.271 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.135691+0000", 2020-11-16T20:56:18.271 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010364799999999999 2020-11-16T20:56:18.271 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.271 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.271 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:18.271 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.135794+0000", 2020-11-16T20:56:18.272 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000194532 2020-11-16T20:56:18.272 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.272 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.272 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:56:18.272 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.135989+0000", 2020-11-16T20:56:18.272 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001241301 2020-11-16T20:56:18.272 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.273 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.273 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.273 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.137230+0000", 2020-11-16T20:56:18.273 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9125000000000002e-05 2020-11-16T20:56:18.273 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.273 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.273 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for ondisk", 2020-11-16T20:56:18.273 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.137269+0000", 2020-11-16T20:56:18.274 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0014352239999999999 2020-11-16T20:56:18.274 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.274 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.274 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:18.274 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.138704+0000", 2020-11-16T20:56:18.274 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0076177900000000002 2020-11-16T20:56:18.274 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.275 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.275 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:18.275 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.146322+0000", 2020-11-16T20:56:18.275 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0024308260000000001 2020-11-16T20:56:18.275 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.275 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.275 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:18.275 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.148753+0000", 2020-11-16T20:56:18.276 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4169999999999999e-05 2020-11-16T20:56:18.276 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.276 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.276 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:18.276 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.148797+0000", 2020-11-16T20:56:18.276 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9681999999999997e-05 2020-11-16T20:56:18.276 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.277 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.277 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:18.277 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.148837+0000", 2020-11-16T20:56:18.277 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033152890999999997 2020-11-16T20:56:18.277 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.277 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.277 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.277 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.278 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.278 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2346 4.3 4:c9160c9c:::smithi16641208-411:head [append 0~0] snapc 6=[6,5,4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e41)", 2020-11-16T20:56:18.278 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:04.115728+0000", 2020-11-16T20:56:18.278 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 14.025712062, 2020-11-16T20:56:18.278 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035920868000000002, 2020-11-16T20:56:18.278 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:18.278 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:18.279 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:18.279 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:18.279 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:18.279 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2346 2020-11-16T20:56:18.279 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.279 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:18.279 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.279 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:18.280 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115728+0000", 2020-11-16T20:56:18.280 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:18.280 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.280 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.280 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:18.280 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115728+0000", 2020-11-16T20:56:18.280 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4843e-05 2020-11-16T20:56:18.281 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.281 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.281 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:18.281 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115743+0000", 2020-11-16T20:56:18.281 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6399999999999999e-06 2020-11-16T20:56:18.281 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.281 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.281 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:18.282 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115746+0000", 2020-11-16T20:56:18.282 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1749999999999996e-06 2020-11-16T20:56:18.282 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.282 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.282 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:18.282 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115751+0000", 2020-11-16T20:56:18.282 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2500000000000001e-06 2020-11-16T20:56:18.283 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.283 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.283 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:18.283 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115754+0000", 2020-11-16T20:56:18.283 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00027690100000000002 2020-11-16T20:56:18.283 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.283 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.283 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.284 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.116031+0000", 2020-11-16T20:56:18.284 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8213000000000001e-05 2020-11-16T20:56:18.284 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.284 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.284 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:18.284 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.116079+0000", 2020-11-16T20:56:18.284 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011729105 2020-11-16T20:56:18.285 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.285 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.285 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.285 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.127808+0000", 2020-11-16T20:56:18.285 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8734e-05 2020-11-16T20:56:18.285 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.285 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.285 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:18.286 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.127837+0000", 2020-11-16T20:56:18.286 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094608379999999992 2020-11-16T20:56:18.286 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.286 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.286 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.286 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.137297+0000", 2020-11-16T20:56:18.286 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8356999999999996e-05 2020-11-16T20:56:18.287 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.287 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.287 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:18.287 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.137366+0000", 2020-11-16T20:56:18.287 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010179300000000001 2020-11-16T20:56:18.287 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.287 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.287 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:56:18.288 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.137468+0000", 2020-11-16T20:56:18.288 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001540626 2020-11-16T20:56:18.288 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.288 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.288 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:18.288 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.139008+0000", 2020-11-16T20:56:18.288 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0073602659999999999 2020-11-16T20:56:18.288 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.289 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.289 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:18.289 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.146369+0000", 2020-11-16T20:56:18.289 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.005211467 2020-11-16T20:56:18.289 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.289 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.289 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:18.290 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.151580+0000", 2020-11-16T20:56:18.290 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2265000000000003e-05 2020-11-16T20:56:18.290 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.290 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.290 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:18.290 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.151622+0000", 2020-11-16T20:56:18.290 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6395000000000001e-05 2020-11-16T20:56:18.290 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.291 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.291 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:18.291 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.151649+0000", 2020-11-16T20:56:18.291 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035920868000000002 2020-11-16T20:56:18.291 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.291 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.291 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.292 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.292 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.292 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2423 4.3 4:c5716d1e:::smithi16641208-111:head [copy-from ver 265] snapc 7=[7,5] ondisk+write+known_if_redirected e46)", 2020-11-16T20:56:18.292 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.026587+0000", 2020-11-16T20:56:18.292 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.1148526220000008, 2020-11-16T20:56:18.292 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039457442000000002, 2020-11-16T20:56:18.292 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:18.292 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:18.293 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:18.293 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:18.293 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:18.293 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2423 2020-11-16T20:56:18.293 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.293 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:18.293 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.294 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:18.294 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026587+0000", 2020-11-16T20:56:18.294 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:18.294 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.294 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.294 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:18.294 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026587+0000", 2020-11-16T20:56:18.294 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2777000000000001e-05 2020-11-16T20:56:18.295 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.295 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.295 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:18.295 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026630+0000", 2020-11-16T20:56:18.295 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.993e-06 2020-11-16T20:56:18.295 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.295 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.296 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:18.296 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026636+0000", 2020-11-16T20:56:18.296 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1423000000000001e-05 2020-11-16T20:56:18.296 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.296 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.296 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:18.296 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026647+0000", 2020-11-16T20:56:18.296 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1880000000000001e-06 2020-11-16T20:56:18.297 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.297 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.297 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:18.297 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026653+0000", 2020-11-16T20:56:18.297 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00021074700000000001 2020-11-16T20:56:18.297 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.297 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.298 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.298 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026863+0000", 2020-11-16T20:56:18.298 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039178896999999997 2020-11-16T20:56:18.298 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.298 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.298 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:18.298 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.066042+0000", 2020-11-16T20:56:18.298 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4169999999999999e-06 2020-11-16T20:56:18.299 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.299 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.299 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:18.299 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.066045+0000", 2020-11-16T20:56:18.299 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039457442000000002 2020-11-16T20:56:18.299 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.299 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.300 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.300 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.300 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.300 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2424 4.3 4:c5716d1e:::smithi16641208-111:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e46)", 2020-11-16T20:56:18.300 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.026685+0000", 2020-11-16T20:56:18.300 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.1147548399999998, 2020-11-16T20:56:18.300 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065304164999999997, 2020-11-16T20:56:18.300 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:18.301 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:18.301 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:18.301 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:18.301 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:18.301 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2424 2020-11-16T20:56:18.301 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.301 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:18.302 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.302 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:18.302 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026685+0000", 2020-11-16T20:56:18.302 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:18.302 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.302 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.302 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:18.302 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026685+0000", 2020-11-16T20:56:18.303 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4087000000000001e-05 2020-11-16T20:56:18.303 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.303 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.303 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:18.303 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026719+0000", 2020-11-16T20:56:18.303 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2298e-05 2020-11-16T20:56:18.303 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.304 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.304 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:18.304 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026731+0000", 2020-11-16T20:56:18.304 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1001e-05 2020-11-16T20:56:18.304 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.304 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.304 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:18.304 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026742+0000", 2020-11-16T20:56:18.305 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6129999999999997e-06 2020-11-16T20:56:18.305 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.305 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.305 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:18.305 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026747+0000", 2020-11-16T20:56:18.305 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00047150600000000001 2020-11-16T20:56:18.305 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.305 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.306 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.306 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.027219+0000", 2020-11-16T20:56:18.306 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5602999999999998e-05 2020-11-16T20:56:18.306 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.306 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.306 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:18.306 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.027254+0000", 2020-11-16T20:56:18.307 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050318838999999997 2020-11-16T20:56:18.307 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.307 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.307 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.307 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.077573+0000", 2020-11-16T20:56:18.307 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6290000000000001e-05 2020-11-16T20:56:18.307 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.307 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.308 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:18.308 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.077669+0000", 2020-11-16T20:56:18.308 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014149599000000001 2020-11-16T20:56:18.308 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.308 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.308 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.308 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.091819+0000", 2020-11-16T20:56:18.309 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6891000000000005e-05 2020-11-16T20:56:18.309 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.309 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.309 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:18.309 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.091906+0000", 2020-11-16T20:56:18.309 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3437999999999996e-05 2020-11-16T20:56:18.309 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.309 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.310 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:18.310 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.091989+0000", 2020-11-16T20:56:18.310 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065304164999999997 2020-11-16T20:56:18.310 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.310 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.310 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.310 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.311 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.311 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.4.13:663 3.1 3:a1b421f3:::smithi16641208-471:head [copy-from ver 412] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e47)", 2020-11-16T20:56:18.311 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.018904+0000", 2020-11-16T20:56:18.311 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.1225357369999998, 2020-11-16T20:56:18.311 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032531157999999998, 2020-11-16T20:56:18.311 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:18.311 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:18.311 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:18.312 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.312 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:18.312 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018904+0000", 2020-11-16T20:56:18.312 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:18.312 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.312 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.312 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:18.312 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018904+0000", 2020-11-16T20:56:18.313 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5086000000000002e-05 2020-11-16T20:56:18.313 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.313 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:18.313 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018949+0000", 2020-11-16T20:56:18.313 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5539999999999998e-06 2020-11-16T20:56:18.313 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.314 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.314 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:18.314 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018958+0000", 2020-11-16T20:56:18.314 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5410999999999999e-05 2020-11-16T20:56:18.314 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.314 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.314 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:18.315 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018973+0000", 2020-11-16T20:56:18.315 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7989999999999994e-06 2020-11-16T20:56:18.315 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.315 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.315 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:18.315 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018981+0000", 2020-11-16T20:56:18.315 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2879000000000006e-05 2020-11-16T20:56:18.315 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.316 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.316 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.316 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.019044+0000", 2020-11-16T20:56:18.316 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000118254 2020-11-16T20:56:18.316 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.316 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.316 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:18.316 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.019162+0000", 2020-11-16T20:56:18.317 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017941413 2020-11-16T20:56:18.317 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.317 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.317 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 3,4", 2020-11-16T20:56:18.317 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.037104+0000", 2020-11-16T20:56:18.317 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013272983 2020-11-16T20:56:18.317 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.318 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.318 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:18.318 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050376+0000", 2020-11-16T20:56:18.318 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00052193599999999997 2020-11-16T20:56:18.318 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.318 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.318 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:18.318 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050898+0000", 2020-11-16T20:56:18.319 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00040169700000000001 2020-11-16T20:56:18.319 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.319 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.319 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:18.319 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051300+0000", 2020-11-16T20:56:18.319 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.0907000000000003e-05 2020-11-16T20:56:18.319 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.320 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.320 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:18.320 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051381+0000", 2020-11-16T20:56:18.320 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4239e-05 2020-11-16T20:56:18.320 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.320 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.320 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:18.320 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051435+0000", 2020-11-16T20:56:18.321 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032531157999999998 2020-11-16T20:56:18.321 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.321 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.321 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.321 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.321 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.321 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2502 3.1 3:b0538c7c:::smithi16641208-136:head [write 591745~402925] snapc f=[f,e,d,5] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e52)", 2020-11-16T20:56:18.322 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.748832+0000", 2020-11-16T20:56:18.322 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.3926077690000001, 2020-11-16T20:56:18.322 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021460713999999999, 2020-11-16T20:56:18.322 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:18.322 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:18.322 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:18.322 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.323 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:18.323 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.748832+0000", 2020-11-16T20:56:18.323 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:18.323 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.323 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.323 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:18.323 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.748832+0000", 2020-11-16T20:56:18.323 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00051580199999999999 2020-11-16T20:56:18.324 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.324 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.324 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:18.324 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.749348+0000", 2020-11-16T20:56:18.324 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.0290000000000005e-06 2020-11-16T20:56:18.324 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.324 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.324 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:18.325 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.749356+0000", 2020-11-16T20:56:18.325 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4805e-05 2020-11-16T20:56:18.325 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.325 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.325 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:18.325 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.749371+0000", 2020-11-16T20:56:18.325 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0029999999999997e-06 2020-11-16T20:56:18.326 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.326 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.326 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:18.326 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.749378+0000", 2020-11-16T20:56:18.326 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8396000000000002e-05 2020-11-16T20:56:18.326 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.326 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.326 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.327 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.749426+0000", 2020-11-16T20:56:18.327 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016705800000000001 2020-11-16T20:56:18.327 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.327 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.327 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:18.327 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.749593+0000", 2020-11-16T20:56:18.327 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00021598900000000001 2020-11-16T20:56:18.328 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.328 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.328 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 3,4", 2020-11-16T20:56:18.328 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.749809+0000", 2020-11-16T20:56:18.328 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021284089999999999 2020-11-16T20:56:18.328 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.328 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.328 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:18.329 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.751938+0000", 2020-11-16T20:56:18.329 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012082399999999999 2020-11-16T20:56:18.329 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.329 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.329 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:18.329 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.752058+0000", 2020-11-16T20:56:18.329 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018031690999999999 2020-11-16T20:56:18.329 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.330 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.330 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:18.330 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770090+0000", 2020-11-16T20:56:18.330 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3780000000000001e-05 2020-11-16T20:56:18.330 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.330 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.330 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:18.331 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770174+0000", 2020-11-16T20:56:18.331 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000118928 2020-11-16T20:56:18.331 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.331 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.331 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:18.331 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770293+0000", 2020-11-16T20:56:18.331 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021460713999999999 2020-11-16T20:56:18.331 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.332 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.332 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.332 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.332 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.332 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.4.13:678 3.1 3:b0538c7c:::smithi16641208-136:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e52)", 2020-11-16T20:56:18.332 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.749416+0000", 2020-11-16T20:56:18.332 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.3920242350000001, 2020-11-16T20:56:18.333 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021080498, 2020-11-16T20:56:18.333 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:18.333 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:18.333 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:18.333 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.333 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:18.333 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.749416+0000", 2020-11-16T20:56:18.333 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:18.334 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.334 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.334 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:18.334 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.749416+0000", 2020-11-16T20:56:18.334 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5132000000000002e-05 2020-11-16T20:56:18.334 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.334 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:18.335 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.749451+0000", 2020-11-16T20:56:18.335 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.93e-06 2020-11-16T20:56:18.335 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:18.335 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.749457+0000", 2020-11-16T20:56:18.335 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2693e-05 2020-11-16T20:56:18.336 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.336 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.336 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:18.336 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.749469+0000", 2020-11-16T20:56:18.336 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6789999999999994e-06 2020-11-16T20:56:18.336 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.336 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.336 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:18.337 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.749478+0000", 2020-11-16T20:56:18.337 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0019602040000000001 2020-11-16T20:56:18.337 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.337 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.337 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.337 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.751438+0000", 2020-11-16T20:56:18.337 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9203999999999995e-05 2020-11-16T20:56:18.338 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.338 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.338 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:18.338 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.751527+0000", 2020-11-16T20:56:18.338 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018803613 2020-11-16T20:56:18.338 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.338 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.338 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.339 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770331+0000", 2020-11-16T20:56:18.339 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8804e-05 2020-11-16T20:56:18.339 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.339 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.339 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:18.339 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770410+0000", 2020-11-16T20:56:18.339 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6238999999999999e-05 2020-11-16T20:56:18.340 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.340 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.340 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:18.340 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770496+0000", 2020-11-16T20:56:18.340 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021080498 2020-11-16T20:56:18.340 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.340 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.340 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.341 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.341 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.341 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.4.13:679 3.1 3:b0538c7c:::smithi16641208-136:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e52)", 2020-11-16T20:56:18.341 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.749513+0000", 2020-11-16T20:56:18.341 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.3919264039999999, 2020-11-16T20:56:18.341 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024146582, 2020-11-16T20:56:18.341 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:18.342 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:18.342 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:18.342 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.342 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:18.342 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.749513+0000", 2020-11-16T20:56:18.342 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:18.342 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.342 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.343 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:18.343 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.749513+0000", 2020-11-16T20:56:18.343 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4762000000000003e-05 2020-11-16T20:56:18.343 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.343 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.343 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:18.343 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.749558+0000", 2020-11-16T20:56:18.344 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8470000000000001e-06 2020-11-16T20:56:18.344 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.344 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.344 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:18.344 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.749564+0000", 2020-11-16T20:56:18.344 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4932999999999999e-05 2020-11-16T20:56:18.344 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.344 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.345 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:18.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.749579+0000", 2020-11-16T20:56:18.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6450000000000004e-06 2020-11-16T20:56:18.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.345 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.345 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:18.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.749584+0000", 2020-11-16T20:56:18.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0019630759999999998 2020-11-16T20:56:18.346 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.346 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.346 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.346 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.751547+0000", 2020-11-16T20:56:18.346 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2315000000000003e-05 2020-11-16T20:56:18.346 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.346 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.347 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:18.347 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.751599+0000", 2020-11-16T20:56:18.347 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018921013 2020-11-16T20:56:18.347 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.347 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.347 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.347 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770520+0000", 2020-11-16T20:56:18.348 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000227696 2020-11-16T20:56:18.348 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.348 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.348 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:18.348 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770748+0000", 2020-11-16T20:56:18.348 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029122950000000001 2020-11-16T20:56:18.348 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.348 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.349 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:18.349 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.773660+0000", 2020-11-16T20:56:18.349 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024146582 2020-11-16T20:56:18.349 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.349 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.349 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.349 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.350 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.4.13:681 3.1 3:afc69464:::smithi16641208-110:head [copy-from ver 103] snapc 4=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e52)", 2020-11-16T20:56:18.350 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.786343+0000", 2020-11-16T20:56:18.350 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.3550971989999998, 2020-11-16T20:56:18.350 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042629590000000002, 2020-11-16T20:56:18.350 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:18.350 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:18.350 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:18.351 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.351 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:18.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786343+0000", 2020-11-16T20:56:18.351 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:18.351 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.351 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.351 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:18.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786343+0000", 2020-11-16T20:56:18.352 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6380000000000002e-05 2020-11-16T20:56:18.352 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.352 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:18.352 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786369+0000", 2020-11-16T20:56:18.352 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8649999999999998e-06 2020-11-16T20:56:18.352 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.353 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.353 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:18.353 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786375+0000", 2020-11-16T20:56:18.353 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2170999999999999e-05 2020-11-16T20:56:18.353 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.353 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.353 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:18.353 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786387+0000", 2020-11-16T20:56:18.354 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8500000000000002e-06 2020-11-16T20:56:18.354 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.354 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.354 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:18.354 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786392+0000", 2020-11-16T20:56:18.354 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001049119 2020-11-16T20:56:18.354 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.355 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.355 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.355 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.787441+0000", 2020-11-16T20:56:18.355 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6489000000000006e-05 2020-11-16T20:56:18.355 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.355 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.355 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:18.355 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.787518+0000", 2020-11-16T20:56:18.356 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0097007229999999996 2020-11-16T20:56:18.356 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.356 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.356 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 3,4", 2020-11-16T20:56:18.356 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.797218+0000", 2020-11-16T20:56:18.356 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012009956 2020-11-16T20:56:18.356 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.356 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.357 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:18.357 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.809228+0000", 2020-11-16T20:56:18.357 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019396673 2020-11-16T20:56:18.357 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.357 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.357 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:18.357 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828625+0000", 2020-11-16T20:56:18.358 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023723099999999999 2020-11-16T20:56:18.358 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.358 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.358 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:18.358 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828862+0000", 2020-11-16T20:56:18.358 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2475000000000002e-05 2020-11-16T20:56:18.358 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.358 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.359 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:18.359 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828915+0000", 2020-11-16T20:56:18.359 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7658000000000003e-05 2020-11-16T20:56:18.359 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.359 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.359 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:18.359 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828972+0000", 2020-11-16T20:56:18.360 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042629590000000002 2020-11-16T20:56:18.360 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.360 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.360 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.360 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.360 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.360 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.4.13:682 3.1 3:b3ae2c4d:::smithi16641208-463:head [copy-from ver 402] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e52)", 2020-11-16T20:56:18.360 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.786452+0000", 2020-11-16T20:56:18.361 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.3549880139999999, 2020-11-16T20:56:18.361 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042767143000000001, 2020-11-16T20:56:18.361 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:18.361 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:18.361 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:18.361 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.361 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:18.362 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786452+0000", 2020-11-16T20:56:18.362 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:18.362 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.362 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.362 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:18.362 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786452+0000", 2020-11-16T20:56:18.362 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.025e-05 2020-11-16T20:56:18.362 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.363 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.363 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:18.363 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786482+0000", 2020-11-16T20:56:18.363 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5779999999999999e-06 2020-11-16T20:56:18.363 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.363 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.363 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:18.364 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786486+0000", 2020-11-16T20:56:18.364 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0480000000000004e-06 2020-11-16T20:56:18.364 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.364 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.364 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:18.364 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786492+0000", 2020-11-16T20:56:18.364 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.101e-06 2020-11-16T20:56:18.364 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.365 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.365 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:18.365 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786495+0000", 2020-11-16T20:56:18.365 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001206213 2020-11-16T20:56:18.365 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.365 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.365 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:18.366 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.787701+0000", 2020-11-16T20:56:18.366 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0668999999999998e-05 2020-11-16T20:56:18.366 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.366 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.366 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:18.366 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.787762+0000", 2020-11-16T20:56:18.366 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014276095000000001 2020-11-16T20:56:18.366 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.367 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.367 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 3,4", 2020-11-16T20:56:18.367 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.802038+0000", 2020-11-16T20:56:18.367 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0099596760000000006 2020-11-16T20:56:18.367 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.367 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.367 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:18.368 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.811997+0000", 2020-11-16T20:56:18.368 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017095757999999999 2020-11-16T20:56:18.368 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.368 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.368 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:18.368 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.829093+0000", 2020-11-16T20:56:18.368 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4833999999999998e-05 2020-11-16T20:56:18.368 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.369 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.369 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:18.369 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.829138+0000", 2020-11-16T20:56:18.369 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4724000000000001e-05 2020-11-16T20:56:18.369 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.369 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.369 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:18.369 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.829183+0000", 2020-11-16T20:56:18.370 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6196999999999999e-05 2020-11-16T20:56:18.370 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.370 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.370 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:18.370 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.829219+0000", 2020-11-16T20:56:18.370 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042767143000000001 2020-11-16T20:56:18.370 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.371 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.371 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.371 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.371 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.371 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:18.373 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:56:18.374 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:56:18.374 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:56:18.374 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:56:18.374 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:56:18.375 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:56:18.375 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:56:18.375 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:56:18.375 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:56:18.375 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:56:18.375 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:56:18.376 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:18.376 INFO:teuthology.orchestra.run.smithi166.stdout: "epoch": 55, 2020-11-16T20:56:18.376 INFO:teuthology.orchestra.run.smithi166.stdout: "fsid": "a14fd848-4cfe-4cd9-9140-5b3c4b4e904d", 2020-11-16T20:56:18.376 INFO:teuthology.orchestra.run.smithi166.stdout: "created": "2020-11-16T20:54:44.938121+0000", 2020-11-16T20:56:18.376 INFO:teuthology.orchestra.run.smithi166.stdout: "modified": "2020-11-16T20:56:17.735848+0000", 2020-11-16T20:56:18.376 INFO:teuthology.orchestra.run.smithi166.stdout: "last_up_change": "2020-11-16T20:54:52.080163+0000", 2020-11-16T20:56:18.376 INFO:teuthology.orchestra.run.smithi166.stdout: "last_in_change": "2020-11-16T20:54:52.080163+0000", 2020-11-16T20:56:18.377 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-11-16T20:56:18.377 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_num": 5801984, 2020-11-16T20:56:18.377 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_set": [ 2020-11-16T20:56:18.377 INFO:teuthology.orchestra.run.smithi166.stdout: "noscrub", 2020-11-16T20:56:18.377 INFO:teuthology.orchestra.run.smithi166.stdout: "pglog_hardlimit", 2020-11-16T20:56:18.377 INFO:teuthology.orchestra.run.smithi166.stdout: "purged_snapdirs", 2020-11-16T20:56:18.377 INFO:teuthology.orchestra.run.smithi166.stdout: "recovery_deletes", 2020-11-16T20:56:18.378 INFO:teuthology.orchestra.run.smithi166.stdout: "sortbitwise" 2020-11-16T20:56:18.378 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:18.378 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_version": 6, 2020-11-16T20:56:18.378 INFO:teuthology.orchestra.run.smithi166.stdout: "full_ratio": 0.94999998807907104, 2020-11-16T20:56:18.378 INFO:teuthology.orchestra.run.smithi166.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-11-16T20:56:18.378 INFO:teuthology.orchestra.run.smithi166.stdout: "nearfull_ratio": 0.85000002384185791, 2020-11-16T20:56:18.378 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_snapshot": "", 2020-11-16T20:56:18.378 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_max": 4, 2020-11-16T20:56:18.379 INFO:teuthology.orchestra.run.smithi166.stdout: "max_osd": 8, 2020-11-16T20:56:18.379 INFO:teuthology.orchestra.run.smithi166.stdout: "require_min_compat_client": "luminous", 2020-11-16T20:56:18.379 INFO:teuthology.orchestra.run.smithi166.stdout: "min_compat_client": "luminous", 2020-11-16T20:56:18.379 INFO:teuthology.orchestra.run.smithi166.stdout: "require_osd_release": "pacific", 2020-11-16T20:56:18.379 INFO:teuthology.orchestra.run.smithi166.stdout: "pools": [ 2020-11-16T20:56:18.379 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.379 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 1, 2020-11-16T20:56:18.380 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "device_health_metrics", 2020-11-16T20:56:18.380 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:54:49.109999+0000", 2020-11-16T20:56:18.380 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 1, 2020-11-16T20:56:18.380 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool", 2020-11-16T20:56:18.380 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:56:18.380 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:56:18.380 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:56:18.381 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:56:18.381 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:56:18.381 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:56:18.381 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:56:18.381 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:56:18.381 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:56:18.381 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:56:18.381 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 1, 2020-11-16T20:56:18.382 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 1, 2020-11-16T20:56:18.382 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 1, 2020-11-16T20:56:18.382 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 1, 2020-11-16T20:56:18.382 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 1, 2020-11-16T20:56:18.382 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:56:18.382 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:56:18.382 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:56:18.383 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:56:18.383 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:56:18.383 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:56:18.383 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:56:18.383 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.383 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "15", 2020-11-16T20:56:18.383 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "0", 2020-11-16T20:56:18.383 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-16T20:56:18.384 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "0", 2020-11-16T20:56:18.384 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:56:18.384 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:56:18.384 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 0, 2020-11-16T20:56:18.384 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 0, 2020-11-16T20:56:18.384 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:56:18.384 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:56:18.384 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:56:18.385 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:56:18.385 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:56:18.385 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:56:18.385 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:56:18.385 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:56:18.385 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:56:18.385 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:56:18.386 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:56:18.386 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:56:18.386 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:56:18.386 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:56:18.386 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:56:18.386 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:56:18.386 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:56:18.387 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:56:18.387 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:56:18.387 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.387 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:56:18.387 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:56:18.387 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:56:18.387 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:56:18.387 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:56:18.388 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:56:18.388 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:56:18.388 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:56:18.388 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:56:18.388 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:56:18.388 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:56:18.388 INFO:teuthology.orchestra.run.smithi166.stdout: "options": { 2020-11-16T20:56:18.389 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_min": 1 2020-11-16T20:56:18.389 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.389 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:56:18.389 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_devicehealth": {} 2020-11-16T20:56:18.389 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.389 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.389 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 2, 2020-11-16T20:56:18.390 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "rbd", 2020-11-16T20:56:18.390 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:54:53.253680+0000", 2020-11-16T20:56:18.390 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 1, 2020-11-16T20:56:18.390 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool", 2020-11-16T20:56:18.390 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:56:18.390 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:56:18.390 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:56:18.391 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:56:18.391 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:56:18.391 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:56:18.391 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:56:18.391 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:56:18.391 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:56:18.391 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:56:18.391 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 18, 2020-11-16T20:56:18.392 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 18, 2020-11-16T20:56:18.392 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 18, 2020-11-16T20:56:18.392 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 18, 2020-11-16T20:56:18.392 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 18, 2020-11-16T20:56:18.392 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:56:18.392 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:56:18.392 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:56:18.393 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:56:18.393 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:56:18.393 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:56:18.393 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:56:18.393 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.393 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "34", 2020-11-16T20:56:18.393 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "0", 2020-11-16T20:56:18.393 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-16T20:56:18.394 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "32", 2020-11-16T20:56:18.394 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:56:18.394 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:56:18.394 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 0, 2020-11-16T20:56:18.394 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 0, 2020-11-16T20:56:18.394 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:56:18.394 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:56:18.395 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:56:18.395 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:56:18.395 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:56:18.395 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:56:18.395 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:56:18.395 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:56:18.395 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:56:18.395 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:56:18.396 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:56:18.396 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:56:18.396 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:56:18.396 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:56:18.396 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:56:18.396 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:56:18.396 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:56:18.397 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:56:18.397 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:56:18.397 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.397 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:56:18.397 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:56:18.397 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:56:18.397 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:56:18.397 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:56:18.398 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:56:18.398 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:56:18.398 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:56:18.398 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:56:18.398 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:56:18.398 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:56:18.398 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:56:18.399 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:56:18.399 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd": {} 2020-11-16T20:56:18.399 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.399 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.399 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.399 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 3, 2020-11-16T20:56:18.399 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "base", 2020-11-16T20:56:18.399 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:55:23.597952+0000", 2020-11-16T20:56:18.400 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 8193, 2020-11-16T20:56:18.400 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2020-11-16T20:56:18.400 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:56:18.400 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:56:18.400 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:56:18.400 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:56:18.400 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:56:18.401 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:56:18.401 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:56:18.401 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:56:18.401 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:56:18.401 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:56:18.401 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 4, 2020-11-16T20:56:18.401 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 4, 2020-11-16T20:56:18.401 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 4, 2020-11-16T20:56:18.402 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 4, 2020-11-16T20:56:18.402 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 4, 2020-11-16T20:56:18.402 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:56:18.402 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:56:18.402 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:56:18.402 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:56:18.402 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:56:18.403 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:56:18.403 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:56:18.403 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.403 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "55", 2020-11-16T20:56:18.403 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "27", 2020-11-16T20:56:18.403 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "27", 2020-11-16T20:56:18.403 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "27", 2020-11-16T20:56:18.403 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:56:18.404 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:56:18.404 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 20, 2020-11-16T20:56:18.404 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 55, 2020-11-16T20:56:18.404 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:56:18.404 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:56:18.404 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:56:18.404 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:56:18.405 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [ 2020-11-16T20:56:18.405 INFO:teuthology.orchestra.run.smithi166.stdout: 4 2020-11-16T20:56:18.405 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:18.405 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:56:18.405 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": 4, 2020-11-16T20:56:18.405 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": 4, 2020-11-16T20:56:18.405 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:56:18.405 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:56:18.406 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:56:18.406 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:56:18.406 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:56:18.406 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:56:18.406 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:56:18.406 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:56:18.406 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:56:18.407 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:56:18.407 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:56:18.407 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.407 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:56:18.407 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:56:18.407 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:56:18.407 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:56:18.407 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:56:18.408 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:56:18.408 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:56:18.408 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:56:18.408 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:56:18.408 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:56:18.408 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:56:18.408 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:56:18.409 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:56:18.409 INFO:teuthology.orchestra.run.smithi166.stdout: "rados": {} 2020-11-16T20:56:18.409 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.409 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.409 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.409 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 4, 2020-11-16T20:56:18.409 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "cache", 2020-11-16T20:56:18.409 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:55:28.901773+0000", 2020-11-16T20:56:18.410 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 8201, 2020-11-16T20:56:18.410 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool,incomplete_clones,selfmanaged_snaps", 2020-11-16T20:56:18.410 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:56:18.410 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:56:18.410 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:56:18.410 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:56:18.410 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:56:18.411 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:56:18.411 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:56:18.411 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:56:18.411 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:56:18.411 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:56:18.411 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 4, 2020-11-16T20:56:18.411 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 4, 2020-11-16T20:56:18.411 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 4, 2020-11-16T20:56:18.412 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 4, 2020-11-16T20:56:18.412 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 4, 2020-11-16T20:56:18.412 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:56:18.412 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:56:18.412 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:56:18.412 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:56:18.412 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:56:18.412 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:56:18.413 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:56:18.413 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.413 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "55", 2020-11-16T20:56:18.413 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "27", 2020-11-16T20:56:18.413 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "27", 2020-11-16T20:56:18.413 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "27", 2020-11-16T20:56:18.413 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:56:18.414 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:56:18.414 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 20, 2020-11-16T20:56:18.414 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 55, 2020-11-16T20:56:18.414 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:56:18.414 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:56:18.414 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:56:18.414 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:56:18.415 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:56:18.415 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": 3, 2020-11-16T20:56:18.415 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:56:18.415 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:56:18.415 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "writeback", 2020-11-16T20:56:18.415 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:56:18.415 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 250, 2020-11-16T20:56:18.415 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:56:18.416 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:56:18.416 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:56:18.416 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:56:18.416 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:56:18.416 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:56:18.416 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:56:18.416 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "bloom", 2020-11-16T20:56:18.417 INFO:teuthology.orchestra.run.smithi166.stdout: "false_positive_probability": 0.050000000000000003, 2020-11-16T20:56:18.417 INFO:teuthology.orchestra.run.smithi166.stdout: "target_size": 0, 2020-11-16T20:56:18.417 INFO:teuthology.orchestra.run.smithi166.stdout: "seed": 0 2020-11-16T20:56:18.417 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.417 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 3600, 2020-11-16T20:56:18.417 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 8, 2020-11-16T20:56:18.417 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:56:18.417 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 2, 2020-11-16T20:56:18.418 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:56:18.418 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:56:18.418 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:56:18.418 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [ 2020-11-16T20:56:18.418 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:18.418 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:18.418 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:18.418 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:18.419 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:18.419 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:18.419 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:18.419 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000 2020-11-16T20:56:18.419 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:18.419 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:56:18.419 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:56:18.420 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:56:18.420 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:56:18.420 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": {} 2020-11-16T20:56:18.420 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.420 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:18.420 INFO:teuthology.orchestra.run.smithi166.stdout: "osds": [ 2020-11-16T20:56:18.420 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.420 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 0, 2020-11-16T20:56:18.421 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "35950122-efbd-420e-b07a-f5730f26df17", 2020-11-16T20:56:18.421 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:18.421 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:18.421 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:18.421 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:18.421 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:18.421 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:18.422 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:18.422 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 22, 2020-11-16T20:56:18.422 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:18.422 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:18.422 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:18.422 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.422 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.422 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.423 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6800", 2020-11-16T20:56:18.423 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:56:18.423 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.423 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.423 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.423 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:18.423 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.424 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.424 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.424 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6802", 2020-11-16T20:56:18.424 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:56:18.424 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.424 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.424 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.424 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:18.425 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.425 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.425 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.425 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6806", 2020-11-16T20:56:18.425 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:56:18.425 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.425 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.426 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.426 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:18.426 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.426 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.426 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.426 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6804", 2020-11-16T20:56:18.426 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:56:18.426 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.427 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.427 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.427 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6800/35293", 2020-11-16T20:56:18.427 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6802/35293", 2020-11-16T20:56:18.427 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6806/35293", 2020-11-16T20:56:18.427 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6804/35293", 2020-11-16T20:56:18.427 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:18.428 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:18.428 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:18.428 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.428 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.428 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.428 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 1, 2020-11-16T20:56:18.428 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "f768a1ff-3e8a-4131-a6ed-10f93b3ca900", 2020-11-16T20:56:18.428 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:18.429 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:18.429 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:18.429 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:18.429 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:18.429 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:18.429 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:18.429 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 34, 2020-11-16T20:56:18.430 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:18.430 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:18.430 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:18.430 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.430 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.430 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.430 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6808", 2020-11-16T20:56:18.430 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:56:18.431 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.431 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.431 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.431 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:18.431 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.431 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.431 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.432 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6809", 2020-11-16T20:56:18.432 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:56:18.432 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.432 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.432 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.432 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:18.432 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.432 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.433 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.433 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6811", 2020-11-16T20:56:18.433 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:56:18.433 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.433 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.433 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.433 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:18.434 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.434 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.434 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.434 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6810", 2020-11-16T20:56:18.434 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:56:18.434 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.434 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.434 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.435 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6808/35323", 2020-11-16T20:56:18.435 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6809/35323", 2020-11-16T20:56:18.435 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6811/35323", 2020-11-16T20:56:18.435 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6810/35323", 2020-11-16T20:56:18.435 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:18.435 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:18.435 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:18.436 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.436 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.436 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.436 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 2, 2020-11-16T20:56:18.436 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "88734179-84a6-4a9b-8af0-692805815875", 2020-11-16T20:56:18.436 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:18.436 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:18.436 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:18.437 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:18.437 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:18.437 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:18.437 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:18.437 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 34, 2020-11-16T20:56:18.437 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:18.437 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:18.438 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:18.438 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.438 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.438 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.438 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6801", 2020-11-16T20:56:18.438 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:56:18.438 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.438 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.439 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.439 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:18.439 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.439 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.439 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.439 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6803", 2020-11-16T20:56:18.439 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:56:18.440 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.440 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.440 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.440 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:18.440 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.440 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.440 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.440 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6807", 2020-11-16T20:56:18.441 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:56:18.441 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.441 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.441 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.441 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:18.441 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.441 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.442 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.442 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6805", 2020-11-16T20:56:18.442 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:56:18.442 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.442 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.442 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.442 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6801/35294", 2020-11-16T20:56:18.442 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6803/35294", 2020-11-16T20:56:18.443 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6807/35294", 2020-11-16T20:56:18.443 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6805/35294", 2020-11-16T20:56:18.443 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:18.443 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:18.443 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:18.443 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.443 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.444 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.444 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 3, 2020-11-16T20:56:18.444 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "319e54e8-3f03-4388-8de6-678d148e25d4", 2020-11-16T20:56:18.444 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:18.444 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:18.444 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:18.444 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:18.444 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:18.445 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:18.445 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:18.445 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 22, 2020-11-16T20:56:18.445 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:18.445 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:18.445 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:18.445 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.446 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.446 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.446 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6812", 2020-11-16T20:56:18.446 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:56:18.446 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.446 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.446 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.446 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:18.447 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.447 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.447 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.447 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6813", 2020-11-16T20:56:18.447 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:56:18.447 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.447 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.448 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.448 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:18.448 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.448 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.448 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.448 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6815", 2020-11-16T20:56:18.448 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:56:18.448 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.449 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.449 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.449 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:18.449 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.449 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.449 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.449 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6814", 2020-11-16T20:56:18.450 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:56:18.450 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.450 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.450 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.450 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6812/35324", 2020-11-16T20:56:18.450 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6813/35324", 2020-11-16T20:56:18.450 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6815/35324", 2020-11-16T20:56:18.451 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6814/35324", 2020-11-16T20:56:18.451 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:18.451 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:18.451 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:18.451 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.451 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.451 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.451 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 4, 2020-11-16T20:56:18.452 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "3edbb68e-e030-4379-891e-2412f1235ffb", 2020-11-16T20:56:18.452 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:18.452 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:18.452 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:18.452 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:18.452 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:18.452 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:18.453 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:18.453 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 53, 2020-11-16T20:56:18.453 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:18.453 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:18.453 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:18.453 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.453 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.453 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.454 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6804", 2020-11-16T20:56:18.454 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:56:18.454 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.454 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.454 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.454 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:18.454 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.455 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.455 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.455 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6805", 2020-11-16T20:56:18.455 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:56:18.455 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.455 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.455 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.455 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:18.456 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.456 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.456 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.456 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6807", 2020-11-16T20:56:18.456 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:56:18.456 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.456 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.456 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.457 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:18.457 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.457 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.457 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.457 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6806", 2020-11-16T20:56:18.457 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:56:18.457 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.458 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.458 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.458 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6804/31586", 2020-11-16T20:56:18.458 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6805/31586", 2020-11-16T20:56:18.458 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6807/31586", 2020-11-16T20:56:18.458 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6806/31586", 2020-11-16T20:56:18.458 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:18.458 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:18.459 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:18.459 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.459 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.459 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.459 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 5, 2020-11-16T20:56:18.459 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "44fbf5ac-4484-48a8-a846-1f5c01a6ec2c", 2020-11-16T20:56:18.459 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:18.460 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:18.460 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:18.460 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:18.460 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:18.460 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:18.460 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:18.460 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 32, 2020-11-16T20:56:18.460 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:18.461 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:18.461 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:18.461 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.461 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.461 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.461 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6808", 2020-11-16T20:56:18.461 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:56:18.461 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.462 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.462 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.462 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:18.462 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.462 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.462 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.462 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6810", 2020-11-16T20:56:18.463 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:56:18.463 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.463 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.463 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.463 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:18.463 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.463 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.463 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.464 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6813", 2020-11-16T20:56:18.464 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:56:18.464 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.464 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.464 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.464 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:18.464 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.465 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.465 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.465 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6812", 2020-11-16T20:56:18.465 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:56:18.465 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.465 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.465 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.465 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6808/31610", 2020-11-16T20:56:18.466 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6810/31610", 2020-11-16T20:56:18.466 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6813/31610", 2020-11-16T20:56:18.466 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6812/31610", 2020-11-16T20:56:18.466 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:18.466 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:18.466 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:18.466 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.467 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.467 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.467 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 6, 2020-11-16T20:56:18.467 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "f93b82df-f537-4601-8247-388bf100b5b5", 2020-11-16T20:56:18.467 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:18.467 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:18.467 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:18.467 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:18.468 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:18.468 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:18.468 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:18.468 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 34, 2020-11-16T20:56:18.468 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:18.468 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:18.468 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:18.468 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.469 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.469 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.469 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6800", 2020-11-16T20:56:18.469 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:56:18.469 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.469 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.469 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.470 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:18.470 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.470 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.470 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.470 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6801", 2020-11-16T20:56:18.470 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:56:18.470 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.470 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.471 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.471 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:18.471 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.471 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.471 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.471 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6803", 2020-11-16T20:56:18.471 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:56:18.472 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.472 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.472 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.472 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:18.472 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.472 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.472 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.472 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6802", 2020-11-16T20:56:18.473 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:56:18.473 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.473 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.473 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.473 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6800/31587", 2020-11-16T20:56:18.473 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6801/31587", 2020-11-16T20:56:18.473 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6803/31587", 2020-11-16T20:56:18.473 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6802/31587", 2020-11-16T20:56:18.474 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:18.474 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:18.474 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:18.474 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.474 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.474 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.474 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 7, 2020-11-16T20:56:18.475 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "e5485c88-d267-4a6a-b9b6-15d869d28f28", 2020-11-16T20:56:18.475 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:18.475 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:18.475 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:18.475 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:18.475 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:18.475 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:18.475 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:18.476 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 34, 2020-11-16T20:56:18.476 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:18.476 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:18.476 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:18.476 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.476 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.476 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.477 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6809", 2020-11-16T20:56:18.477 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:56:18.477 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.477 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.477 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.477 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:18.477 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.477 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.478 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.478 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6811", 2020-11-16T20:56:18.478 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:56:18.478 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.478 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.478 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.478 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:18.479 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.479 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.479 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.479 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6815", 2020-11-16T20:56:18.479 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:56:18.479 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.479 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.479 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.480 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:18.480 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:18.480 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.480 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:18.480 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6814", 2020-11-16T20:56:18.480 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:56:18.480 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.481 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.481 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.481 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6809/31617", 2020-11-16T20:56:18.481 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6811/31617", 2020-11-16T20:56:18.481 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6815/31617", 2020-11-16T20:56:18.481 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6814/31617", 2020-11-16T20:56:18.481 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:18.481 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:18.482 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:18.482 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.482 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.482 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:18.482 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_xinfo": [ 2020-11-16T20:56:18.482 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.482 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 0, 2020-11-16T20:56:18.483 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:18.483 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:18.483 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:18.483 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:18.483 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:18.483 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:50.610058+0000", 2020-11-16T20:56:18.483 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:18.483 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.484 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.484 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 1, 2020-11-16T20:56:18.484 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:18.484 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:18.484 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:18.484 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:18.484 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:18.484 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:50.548086+0000", 2020-11-16T20:56:18.485 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:18.485 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.485 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.485 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 2, 2020-11-16T20:56:18.485 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:18.485 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:18.485 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:18.486 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:18.486 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:18.486 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:50.536944+0000", 2020-11-16T20:56:18.486 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:18.486 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.486 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.486 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 3, 2020-11-16T20:56:18.487 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:18.487 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:18.487 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:18.487 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:18.487 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:18.487 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:51.137739+0000", 2020-11-16T20:56:18.487 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:18.487 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.488 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.488 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 4, 2020-11-16T20:56:18.488 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:18.488 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:18.488 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:18.488 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:18.488 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:18.488 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:50.747840+0000", 2020-11-16T20:56:18.489 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:18.489 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.489 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.489 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 5, 2020-11-16T20:56:18.489 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:18.489 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:18.489 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:18.490 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:18.490 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:18.490 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:51.365378+0000", 2020-11-16T20:56:18.490 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:18.490 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.490 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.490 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 6, 2020-11-16T20:56:18.490 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:18.491 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:18.491 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:18.491 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:18.491 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:18.491 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:50.725150+0000", 2020-11-16T20:56:18.491 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:18.491 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.492 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.492 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 7, 2020-11-16T20:56:18.492 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:18.492 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:18.492 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:18.492 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:18.492 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:18.492 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:50.621411+0000", 2020-11-16T20:56:18.493 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:18.493 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.493 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:18.493 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_upmap": [], 2020-11-16T20:56:18.493 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_upmap_items": [ 2020-11-16T20:56:18.493 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.493 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "4.1", 2020-11-16T20:56:18.494 INFO:teuthology.orchestra.run.smithi166.stdout: "mappings": [ 2020-11-16T20:56:18.494 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.494 INFO:teuthology.orchestra.run.smithi166.stdout: "from": 5, 2020-11-16T20:56:18.494 INFO:teuthology.orchestra.run.smithi166.stdout: "to": 3 2020-11-16T20:56:18.494 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.494 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.494 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.494 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:18.495 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_temp": [], 2020-11-16T20:56:18.495 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_temp": [], 2020-11-16T20:56:18.495 INFO:teuthology.orchestra.run.smithi166.stdout: "blocklist": {}, 2020-11-16T20:56:18.495 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profiles": { 2020-11-16T20:56:18.495 INFO:teuthology.orchestra.run.smithi166.stdout: "default": { 2020-11-16T20:56:18.495 INFO:teuthology.orchestra.run.smithi166.stdout: "crush-failure-domain": "osd", 2020-11-16T20:56:18.495 INFO:teuthology.orchestra.run.smithi166.stdout: "k": "2", 2020-11-16T20:56:18.496 INFO:teuthology.orchestra.run.smithi166.stdout: "m": "1", 2020-11-16T20:56:18.496 INFO:teuthology.orchestra.run.smithi166.stdout: "plugin": "jerasure", 2020-11-16T20:56:18.496 INFO:teuthology.orchestra.run.smithi166.stdout: "ruleset-failure-domain": "osd", 2020-11-16T20:56:18.496 INFO:teuthology.orchestra.run.smithi166.stdout: "technique": "reed_sol_van" 2020-11-16T20:56:18.496 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.496 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.496 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps_queue": [ 2020-11-16T20:56:18.496 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.497 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 3, 2020-11-16T20:56:18.497 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:56:18.497 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.497 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 4, 2020-11-16T20:56:18.497 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:18.497 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.497 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.498 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 7, 2020-11-16T20:56:18.498 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:18.498 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.498 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.498 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 12, 2020-11-16T20:56:18.498 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 2 2020-11-16T20:56:18.498 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.499 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.499 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.499 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.499 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 4, 2020-11-16T20:56:18.499 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:56:18.499 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.499 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 4, 2020-11-16T20:56:18.499 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:18.500 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.500 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.500 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 7, 2020-11-16T20:56:18.500 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:18.500 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:18.500 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:18.500 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 12, 2020-11-16T20:56:18.500 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 2 2020-11-16T20:56:18.501 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.501 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:18.501 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.501 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:18.501 INFO:teuthology.orchestra.run.smithi166.stdout: "new_removed_snaps": [], 2020-11-16T20:56:18.501 INFO:teuthology.orchestra.run.smithi166.stdout: "new_purged_snaps": [], 2020-11-16T20:56:18.501 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_node_flags": {}, 2020-11-16T20:56:18.502 INFO:teuthology.orchestra.run.smithi166.stdout: "device_class_flags": {}, 2020-11-16T20:56:18.502 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode": { 2020-11-16T20:56:18.502 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode_enabled": false, 2020-11-16T20:56:18.502 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_bucket_count": 0, 2020-11-16T20:56:18.502 INFO:teuthology.orchestra.run.smithi166.stdout: "degraded_stretch_mode": 0, 2020-11-16T20:56:18.502 INFO:teuthology.orchestra.run.smithi166.stdout: "recovering_stretch_mode": 0, 2020-11-16T20:56:18.502 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode_bucket": 0 2020-11-16T20:56:18.502 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:18.503 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:18.503 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:18.376+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:18.504 INFO:tasks.thrashosds.thrasher:j is {'epoch': 55, 'fsid': 'a14fd848-4cfe-4cd9-9140-5b3c4b4e904d', 'created': '2020-11-16T20:54:44.938121+0000', 'modified': '2020-11-16T20:56:17.735848+0000', 'last_up_change': '2020-11-16T20:54:52.080163+0000', 'last_in_change': '2020-11-16T20:54:52.080163+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-16T20:54:49.109999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-16T20:54:53.253680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 18, 'pg_placement_num': 18, 'pg_placement_num_target': 18, 'pg_num_target': 18, 'pg_num_pending': 18, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '32', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'base', 'create_time': '2020-11-16T20:55:23.597952+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 4, 'pg_placement_num': 4, 'pg_placement_num_target': 4, 'pg_num_target': 4, 'pg_num_pending': 4, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '27', 'last_force_op_resend_prenautilus': '27', 'last_force_op_resend_preluminous': '27', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 20, 'snap_epoch': 55, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [4], 'tier_of': -1, 'read_tier': 4, 'write_tier': 4, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 4, 'pool_name': 'cache', 'create_time': '2020-11-16T20:55:28.901773+0000', 'flags': 8201, 'flags_names': 'hashpspool,incomplete_clones,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 4, 'pg_placement_num': 4, 'pg_placement_num_target': 4, 'pg_num_target': 4, 'pg_num_pending': 4, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '27', 'last_force_op_resend_prenautilus': '27', 'last_force_op_resend_preluminous': '27', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 20, 'snap_epoch': 55, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': 3, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'writeback', 'target_max_bytes': 0, 'target_max_objects': 250, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'bloom', 'false_positive_probability': 0.05, 'target_size': 0, 'seed': 0}, 'hit_set_period': 3600, 'hit_set_count': 8, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 2, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [1000000, 1000000, 1000000, 1000000, 1000000, 1000000, 1000000, 1000000], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}}], 'osds': [{'osd': 0, 'uuid': '35950122-efbd-420e-b07a-f5730f26df17', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6800', 'nonce': 35293}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6802', 'nonce': 35293}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6806', 'nonce': 35293}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6804', 'nonce': 35293}]}, 'public_addr': '172.21.15.166:6800/35293', 'cluster_addr': '172.21.15.166:6802/35293', 'heartbeat_back_addr': '172.21.15.166:6806/35293', 'heartbeat_front_addr': '172.21.15.166:6804/35293', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f768a1ff-3e8a-4131-a6ed-10f93b3ca900', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6808', 'nonce': 35323}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6809', 'nonce': 35323}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6811', 'nonce': 35323}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6810', 'nonce': 35323}]}, 'public_addr': '172.21.15.166:6808/35323', 'cluster_addr': '172.21.15.166:6809/35323', 'heartbeat_back_addr': '172.21.15.166:6811/35323', 'heartbeat_front_addr': '172.21.15.166:6810/35323', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '88734179-84a6-4a9b-8af0-692805815875', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6801', 'nonce': 35294}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6803', 'nonce': 35294}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6807', 'nonce': 35294}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6805', 'nonce': 35294}]}, 'public_addr': '172.21.15.166:6801/35294', 'cluster_addr': '172.21.15.166:6803/35294', 'heartbeat_back_addr': '172.21.15.166:6807/35294', 'heartbeat_front_addr': '172.21.15.166:6805/35294', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '319e54e8-3f03-4388-8de6-678d148e25d4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6812', 'nonce': 35324}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6813', 'nonce': 35324}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6815', 'nonce': 35324}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6814', 'nonce': 35324}]}, 'public_addr': '172.21.15.166:6812/35324', 'cluster_addr': '172.21.15.166:6813/35324', 'heartbeat_back_addr': '172.21.15.166:6815/35324', 'heartbeat_front_addr': '172.21.15.166:6814/35324', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '3edbb68e-e030-4379-891e-2412f1235ffb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 53, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6804', 'nonce': 31586}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6805', 'nonce': 31586}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6807', 'nonce': 31586}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6806', 'nonce': 31586}]}, 'public_addr': '172.21.15.59:6804/31586', 'cluster_addr': '172.21.15.59:6805/31586', 'heartbeat_back_addr': '172.21.15.59:6807/31586', 'heartbeat_front_addr': '172.21.15.59:6806/31586', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '44fbf5ac-4484-48a8-a846-1f5c01a6ec2c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 32, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6808', 'nonce': 31610}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6810', 'nonce': 31610}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6813', 'nonce': 31610}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6812', 'nonce': 31610}]}, 'public_addr': '172.21.15.59:6808/31610', 'cluster_addr': '172.21.15.59:6810/31610', 'heartbeat_back_addr': '172.21.15.59:6813/31610', 'heartbeat_front_addr': '172.21.15.59:6812/31610', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'f93b82df-f537-4601-8247-388bf100b5b5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6800', 'nonce': 31587}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6801', 'nonce': 31587}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6803', 'nonce': 31587}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6802', 'nonce': 31587}]}, 'public_addr': '172.21.15.59:6800/31587', 'cluster_addr': '172.21.15.59:6801/31587', 'heartbeat_back_addr': '172.21.15.59:6803/31587', 'heartbeat_front_addr': '172.21.15.59:6802/31587', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'e5485c88-d267-4a6a-b9b6-15d869d28f28', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6809', 'nonce': 31617}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6811', 'nonce': 31617}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6815', 'nonce': 31617}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6814', 'nonce': 31617}]}, 'public_addr': '172.21.15.59:6809/31617', 'cluster_addr': '172.21.15.59:6811/31617', 'heartbeat_back_addr': '172.21.15.59:6815/31617', 'heartbeat_front_addr': '172.21.15.59:6814/31617', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:50.610058+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:50.548086+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:50.536944+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:51.137739+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:50.747840+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:51.365378+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:50.725150+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:50.621411+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '4.1', 'mappings': [{'from': 5, 'to': 3}]}], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 4, 'length': 1}, {'begin': 7, 'length': 1}, {'begin': 12, 'length': 2}]}, {'pool': 4, 'snaps': [{'begin': 4, 'length': 1}, {'begin': 7, 'length': 1}, {'begin': 12, 'length': 2}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2020-11-16T20:56:18.504 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-16T20:56:18.506 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:18.510+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:18.606 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:18.610+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:18.636 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:18.636 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:18.637 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:56:18.637 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:18.646 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:56:18.729 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:18.733+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:18.741 INFO:tasks.rados.rados.0.smithi166.stdout:651: done (0 left) 2020-11-16T20:56:18.741 INFO:tasks.rados.rados.0.smithi166.stdout:652: delete oid 153 current snap is 12 2020-11-16T20:56:18.750 INFO:tasks.rados.rados.0.smithi166.stdout:652: done (0 left) 2020-11-16T20:56:18.751 INFO:tasks.rados.rados.0.smithi166.stdout:653: snap_remove snap 8 2020-11-16T20:56:18.757 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2020-11-16T20:56:18.808 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:18.813+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:18.817 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:56:18.819 INFO:teuthology.orchestra.run.smithi166.stderr:dumped all 2020-11-16T20:56:18.829 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:18.829 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:18.829 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:56:18.829 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:56:18.829 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:18.830 INFO:teuthology.orchestra.run.smithi166.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2020-11-16T20:56:18.744413+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1883959884,"num_objects":710,"num_object_clones":55,"num_object_copies":2130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":631,"num_whiteouts":10,"num_read":1371,"num_read_kb":212937,"num_write":2484,"num_write_kb":878571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":91753326,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":50,"num_flush_kb":140045,"num_evict":0,"num_evict_kb":0,"num_promote":165,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2579,"ondisk_log_size":2579,"up":81,"acting":81,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3332496,"kb_used_data":3246492,"kb_used_omap":0,"kb_used_meta":79872,"kb_avail":751642224,"statfs":{"total":773094113280,"available":769681637376,"internally_reserved":0,"allocated":3324407808,"data_stored":3422237398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81788928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":64375745,"num_objects":25,"num_object_clones":18,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":59,"num_read_kb":41983,"num_write":66,"num_write_kb":64516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":91753326,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":8,"num_flush_kb":22883,"num_evict":0,"num_evict_kb":0,"num_promote":9,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.014593"},"pg_stats":[{"pgid":"2.11","version":"0'0","reported_seq":"32","reported_epoch":"53","state":"active+clean","last_fresh":"2020-11-16T20:56:15.741571+0000","last_change":"2020-11-16T20:56:03.679710+0000","last_active":"2020-11-16T20:56:15.741571+0000","last_peered":"2020-11-16T20:56:15.741571+0000","last_clean":"2020-11-16T20:56:15.741571+0000","last_became_active":"2020-11-16T20:55:52.916223+0000","last_became_peered":"2020-11-16T20:55:52.916223+0000","last_unstale":"2020-11-16T20:56:15.741571+0000","last_undegraded":"2020-11-16T20:56:15.741571+0000","last_fullsized":"2020-11-16T20:56:15.741571+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:03.679641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:03.679641+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"32","reported_epoch":"53","state":"active+clean","last_fresh":"2020-11-16T20:56:16.311971+0000","last_change":"2020-11-16T20:55:59.416734+0000","last_active":"2020-11-16T20:56:16.311971+0000","last_peered":"2020-11-16T20:56:16.311971+0000","last_clean":"2020-11-16T20:56:16.311971+0000","last_became_active":"2020-11-16T20:55:52.921860+0000","last_became_peered":"2020-11-16T20:55:52.921860+0000","last_unstale":"2020-11-16T20:56:16.311971+0000","last_undegraded":"2020-11-16T20:56:16.311971+0000","last_fullsized":"2020-11-16T20:56:16.311971+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.416654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.416654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":"32","reported_epoch":"53","state":"active+clean","last_fresh":"2020-11-16T20:56:15.738902+0000","last_change":"2020-11-16T20:55:56.438524+0000","last_active":"2020-11-16T20:56:15.738902+0000","last_peered":"2020-11-16T20:56:15.738902+0000","last_clean":"2020-11-16T20:56:15.738902+0000","last_became_active":"2020-11-16T20:55:52.922023+0000","last_became_peered":"2020-11-16T20:55:52.922023+0000","last_unstale":"2020-11-16T20:56:15.738902+0000","last_undegraded":"2020-11-16T20:56:15.738902+0000","last_fullsized":"2020-11-16T20:56:15.738902+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:56.438428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:56.438428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":"32","reported_epoch":"53","state":"active+clean","last_fresh":"2020-11-16T20:56:16.311985+0000","last_change":"2020-11-16T20:56:04.388573+0000","last_active":"2020-11-16T20:56:16.311985+0000","last_peered":"2020-11-16T20:56:16.311985+0000","last_clean":"2020-11-16T20:56:16.311985+0000","last_became_active":"2020-11-16T20:55:52.921111+0000","last_became_peered":"2020-11-16T20:55:52.921111+0000","last_unstale":"2020-11-16T20:56:16.311985+0000","last_undegraded":"2020-11-16T20:56:16.311985+0000","last_fullsized":"2020-11-16T20:56:16.311985+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:04.388506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:04.388506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"32","reported_epoch":"53","state":"active+clean","last_fresh":"2020-11-16T20:56:15.737233+0000","last_change":"2020-11-16T20:56:11.940489+0000","last_active":"2020-11-16T20:56:15.737233+0000","last_peered":"2020-11-16T20:56:15.737233+0000","last_clean":"2020-11-16T20:56:15.737233+0000","last_became_active":"2020-11-16T20:55:52.922134+0000","last_became_peered":"2020-11-16T20:55:52.922134+0000","last_unstale":"2020-11-16T20:56:15.737233+0000","last_undegraded":"2020-11-16T20:56:15.737233+0000","last_fullsized":"2020-11-16T20:56:15.737233+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:11.940423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:11.940423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"32","reported_epoch":"53","state":"active+clean","last_fresh":"2020-11-16T20:56:16.312011+0000","last_change":"2020-11-16T20:56:02.387946+0000","last_active":"2020-11-16T20:56:16.312011+0000","last_peered":"2020-11-16T20:56:16.312011+0000","last_clean":"2020-11-16T20:56:16.312011+0000","last_became_active":"2020-11-16T20:55:52.920496+0000","last_became_peered":"2020-11-16T20:55:52.920496+0000","last_unstale":"2020-11-16T20:56:16.312011+0000","last_undegraded":"2020-11-16T20:56:16.312011+0000","last_fullsized":"2020-11-16T20:56:16.312011+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:02.387861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:02.387861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"58","reported_epoch":"53","state":"active+clean","last_fresh":"2020-11-16T20:56:15.736842+0000","last_change":"2020-11-16T20:56:02.565668+0000","last_active":"2020-11-16T20:56:15.736842+0000","last_peered":"2020-11-16T20:56:15.736842+0000","last_clean":"2020-11-16T20:56:15.736842+0000","last_became_active":"2020-11-16T20:55:52.917496+0000","last_became_peered":"2020-11-16T20:55:52.917496+0000","last_unstale":"2020-11-16T20:56:15.736842+0000","last_undegraded":"2020-11-16T20:56:15.736842+0000","last_fullsized":"2020-11-16T20:56:15.736842+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:02.565607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:56:02.565607+0000","last_clean_scrub_stamp":"2020-11-16T20:56:02.565607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"58","reported_epoch":"53","state":"active+clean","last_fresh":"2020-11-16T20:56:15.737108+0000","last_change":"2020-11-16T20:56:01.955760+0000","last_active":"2020-11-16T20:56:15.737108+0000","last_peered":"2020-11-16T20:56:15.737108+0000","last_clean":"2020-11-16T20:56:15.737108+0000","last_became_active":"2020-11-16T20:55:52.922447+0000","last_became_peered":"2020-11-16T20:55:52.922447+0000","last_unstale":"2020-11-16T20:56:15.737108+0000","last_undegraded":"2020-11-16T20:56:15.737108+0000","last_fullsized":"2020-11-16T20:56:15.737108+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:01.955691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:01.955691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"32","reported_epoch":"53","state":"active+clean","last_fresh":"2020-11-16T20:56:15.737070+0000","last_change":"2020-11-16T20:56:00.967620+0000","last_active":"2020-11-16T20:56:15.737070+0000","last_peered":"2020-11-16T20:56:15.737070+0000","last_clean":"2020-11-16T20:56:15.737070+0000","last_became_active":"2020-11-16T20:55:52.926407+0000","last_became_peered":"2020-11-16T20:55:52.926407+0000","last_unstale":"2020-11-16T20:56:15.737070+0000","last_undegraded":"2020-11-16T20:56:15.737070+0000","last_fullsized":"2020-11-16T20:56:15.737070+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:00.967553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:00.967553+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"67","reported_epoch":"53","state":"active+clean","last_fresh":"2020-11-16T20:56:15.736138+0000","last_change":"2020-11-16T20:56:01.528273+0000","last_active":"2020-11-16T20:56:15.736138+0000","last_peered":"2020-11-16T20:56:15.736138+0000","last_clean":"2020-11-16T20:56:15.736138+0000","last_became_active":"2020-11-16T20:55:52.922303+0000","last_became_peered":"2020-11-16T20:55:52.922303+0000","last_unstale":"2020-11-16T20:56:15.736138+0000","last_undegraded":"2020-11-16T20:56:15.736138+0000","last_fullsized":"2020-11-16T20:56:15.736138+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:01.528217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:01.528217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"58","reported_epoch":"53","state":"active+clean","last_fresh":"2020-11-16T20:56:15.737032+0000","last_change":"2020-11-16T20:55:57.905062+0000","last_active":"2020-11-16T20:56:15.737032+0000","last_peered":"2020-11-16T20:56:15.737032+0000","last_clean":"2020-11-16T20:56:15.737032+0000","last_became_active":"2020-11-16T20:55:50.904146+0000","last_became_peered":"2020-11-16T20:55:50.904146+0000","last_unstale":"2020-11-16T20:56:15.737032+0000","last_undegraded":"2020-11-16T20:56:15.737032+0000","last_fullsized":"2020-11-16T20:56:15.737032+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:57.905004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:57.905004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"54'210","reported_seq":"334","reported_epoch":"54","state":"active+clean","last_fresh":"2020-11-16T20:56:16.869586+0000","last_change":"2020-11-16T20:56:16.750358+0000","last_active":"2020-11-16T20:56:16.869586+0000","last_peered":"2020-11-16T20:56:16.869586+0000","last_clean":"2020-11-16T20:56:16.869586+0000","last_became_active":"2020-11-16T20:55:30.828637+0000","last_became_peered":"2020-11-16T20:55:30.828637+0000","last_unstale":"2020-11-16T20:56:16.869586+0000","last_undegraded":"2020-11-16T20:56:16.869586+0000","last_fullsized":"2020-11-16T20:56:16.869586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":210,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":111224472,"num_objects":46,"num_object_clones":5,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":2,"num_read":47,"num_read_kb":42,"num_write":143,"num_write_kb":23115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":23,"num_flush_kb":61904,"num_evict":0,"num_evict_kb":0,"num_promote":44,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"4","length":"1"},{"start":"7","length":"1"},{"start":"c","length":"2"}]},{"pgid":"2.2","version":"0'0","reported_seq":"59","reported_epoch":"54","state":"active+clean","last_fresh":"2020-11-16T20:56:16.742076+0000","last_change":"2020-11-16T20:55:57.606554+0000","last_active":"2020-11-16T20:56:16.742076+0000","last_peered":"2020-11-16T20:56:16.742076+0000","last_clean":"2020-11-16T20:56:16.742076+0000","last_became_active":"2020-11-16T20:55:50.906585+0000","last_became_peered":"2020-11-16T20:55:50.906585+0000","last_unstale":"2020-11-16T20:56:16.742076+0000","last_undegraded":"2020-11-16T20:56:16.742076+0000","last_fullsized":"2020-11-16T20:56:16.742076+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:57.606500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:57.606500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"54'474","reported_seq":"708","reported_epoch":"54","state":"active+clean","last_fresh":"2020-11-16T20:56:16.761031+0000","last_change":"2020-11-16T20:56:16.761386+0000","last_active":"2020-11-16T20:56:16.761031+0000","last_peered":"2020-11-16T20:56:16.761031+0000","last_clean":"2020-11-16T20:56:16.761031+0000","last_became_active":"2020-11-16T20:55:25.103851+0000","last_became_peered":"2020-11-16T20:55:25.103851+0000","last_unstale":"2020-11-16T20:56:16.761031+0000","last_undegraded":"2020-11-16T20:56:16.761031+0000","last_fullsized":"2020-11-16T20:56:16.761031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":474,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":357104028,"num_objects":133,"num_object_clones":9,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133,"num_whiteouts":1,"num_read":286,"num_read_kb":28242,"num_write":502,"num_write_kb":194234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4","length":"1"},{"start":"7","length":"1"},{"start":"c","length":"2"}]},{"pgid":"2.1","version":"0'0","reported_seq":"58","reported_epoch":"53","state":"active+clean","last_fresh":"2020-11-16T20:56:16.311975+0000","last_change":"2020-11-16T20:55:58.465447+0000","last_active":"2020-11-16T20:56:16.311975+0000","last_peered":"2020-11-16T20:56:16.311975+0000","last_clean":"2020-11-16T20:56:16.311975+0000","last_became_active":"2020-11-16T20:55:50.905925+0000","last_became_peered":"2020-11-16T20:55:50.905925+0000","last_unstale":"2020-11-16T20:56:16.311975+0000","last_undegraded":"2020-11-16T20:56:16.311975+0000","last_fullsized":"2020-11-16T20:56:16.311975+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:58.465384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:58.465384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"54'420","reported_seq":"643","reported_epoch":"54","state":"active+clean","last_fresh":"2020-11-16T20:56:16.823527+0000","last_change":"2020-11-16T20:56:16.752346+0000","last_active":"2020-11-16T20:56:16.823527+0000","last_peered":"2020-11-16T20:56:16.823527+0000","last_clean":"2020-11-16T20:56:16.823527+0000","last_became_active":"2020-11-16T20:55:25.103928+0000","last_became_peered":"2020-11-16T20:55:25.103928+0000","last_unstale":"2020-11-16T20:56:16.823527+0000","last_undegraded":"2020-11-16T20:56:16.823527+0000","last_fullsized":"2020-11-16T20:56:16.823527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":420,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":334326091,"num_objects":126,"num_object_clones":7,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":2,"num_read":243,"num_read_kb":88,"num_write":477,"num_write_kb":167876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"4","length":"1"},{"start":"7","length":"1"},{"start":"c","length":"2"}]},{"pgid":"2.3","version":"0'0","reported_seq":"59","reported_epoch":"54","state":"active+clean","last_fresh":"2020-11-16T20:56:16.742285+0000","last_change":"2020-11-16T20:55:59.611811+0000","last_active":"2020-11-16T20:56:16.742285+0000","last_peered":"2020-11-16T20:56:16.742285+0000","last_clean":"2020-11-16T20:56:16.742285+0000","last_became_active":"2020-11-16T20:55:50.903578+0000","last_became_peered":"2020-11-16T20:55:50.903578+0000","last_unstale":"2020-11-16T20:56:16.742285+0000","last_undegraded":"2020-11-16T20:56:16.742285+0000","last_fullsized":"2020-11-16T20:56:16.742285+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.611727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.611727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"54","reported_epoch":"53","state":"active+clean","last_fresh":"2020-11-16T20:56:15.736376+0000","last_change":"2020-11-16T20:56:03.542304+0000","last_active":"2020-11-16T20:56:15.736376+0000","last_peered":"2020-11-16T20:56:15.736376+0000","last_clean":"2020-11-16T20:56:15.736376+0000","last_became_active":"2020-11-16T20:54:53.112038+0000","last_became_peered":"2020-11-16T20:54:53.112038+0000","last_unstale":"2020-11-16T20:56:15.736376+0000","last_undegraded":"2020-11-16T20:56:15.736376+0000","last_fullsized":"2020-11-16T20:56:15.736376+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'2","last_scrub_stamp":"2020-11-16T20:56:03.542235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:50.068882+0000","last_clean_scrub_stamp":"2020-11-16T20:56:03.542235+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"54'473","reported_seq":"703","reported_epoch":"54","state":"active+clean","last_fresh":"2020-11-16T20:56:16.868566+0000","last_change":"2020-11-16T20:56:16.743038+0000","last_active":"2020-11-16T20:56:16.868566+0000","last_peered":"2020-11-16T20:56:16.868566+0000","last_clean":"2020-11-16T20:56:16.868566+0000","last_became_active":"2020-11-16T20:55:25.106302+0000","last_became_peered":"2020-11-16T20:55:25.106302+0000","last_unstale":"2020-11-16T20:56:16.868566+0000","last_undegraded":"2020-11-16T20:56:16.868566+0000","last_fullsized":"2020-11-16T20:56:16.868566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":473,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":334282527,"num_objects":125,"num_object_clones":8,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":1,"num_read":296,"num_read_kb":64937,"num_write":481,"num_write_kb":216009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"1"},{"start":"7","length":"1"},{"start":"c","length":"2"}]},{"pgid":"2.0","version":"0'0","reported_seq":"59","reported_epoch":"53","state":"active+clean","last_fresh":"2020-11-16T20:56:15.736263+0000","last_change":"2020-11-16T20:55:56.657297+0000","last_active":"2020-11-16T20:56:15.736263+0000","last_peered":"2020-11-16T20:56:15.736263+0000","last_clean":"2020-11-16T20:56:15.736263+0000","last_became_active":"2020-11-16T20:55:50.908710+0000","last_became_peered":"2020-11-16T20:55:50.908710+0000","last_unstale":"2020-11-16T20:56:15.736263+0000","last_undegraded":"2020-11-16T20:56:15.736263+0000","last_fullsized":"2020-11-16T20:56:15.736263+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:56.657242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:56.657242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"55'560","reported_seq":"806","reported_epoch":"55","state":"active+clean","last_fresh":"2020-11-16T20:56:17.820176+0000","last_change":"2020-11-16T20:56:16.762543+0000","last_active":"2020-11-16T20:56:17.820176+0000","last_peered":"2020-11-16T20:56:17.820176+0000","last_clean":"2020-11-16T20:56:17.820176+0000","last_became_active":"2020-11-16T20:55:24.802649+0000","last_became_peered":"2020-11-16T20:55:24.802649+0000","last_unstale":"2020-11-16T20:56:17.820176+0000","last_undegraded":"2020-11-16T20:56:17.820176+0000","last_fullsized":"2020-11-16T20:56:17.820176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":560,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":405423384,"num_objects":148,"num_object_clones":12,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":2,"num_read":328,"num_read_kb":46396,"num_write":578,"num_write_kb":223454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"1"},{"start":"7","length":"1"},{"start":"c","length":"2"}]},{"pgid":"4.3","version":"55'166","reported_seq":"290","reported_epoch":"55","state":"active+clean","last_fresh":"2020-11-16T20:56:17.807782+0000","last_change":"2020-11-16T20:56:16.754061+0000","last_active":"2020-11-16T20:56:17.807782+0000","last_peered":"2020-11-16T20:56:17.807782+0000","last_clean":"2020-11-16T20:56:17.807782+0000","last_became_active":"2020-11-16T20:55:30.829833+0000","last_became_peered":"2020-11-16T20:55:30.829833+0000","last_unstale":"2020-11-16T20:56:17.807782+0000","last_undegraded":"2020-11-16T20:56:17.807782+0000","last_fullsized":"2020-11-16T20:56:17.807782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":166,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":117232838,"num_objects":46,"num_object_clones":6,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":61,"num_read_kb":25079,"num_write":110,"num_write_kb":18342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":11,"num_flush_kb":31126,"num_evict":0,"num_evict_kb":0,"num_promote":42,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"1"},{"start":"7","length":"1"},{"start":"c","length":"2"}]},{"pgid":"2.5","version":"0'0","reported_seq":"59","reported_epoch":"53","state":"active+clean","last_fresh":"2020-11-16T20:56:15.736556+0000","last_change":"2020-11-16T20:55:59.571968+0000","last_active":"2020-11-16T20:56:15.736556+0000","last_peered":"2020-11-16T20:56:15.736556+0000","last_clean":"2020-11-16T20:56:15.736556+0000","last_became_active":"2020-11-16T20:55:50.901014+0000","last_became_peered":"2020-11-16T20:55:50.901014+0000","last_unstale":"2020-11-16T20:56:15.736556+0000","last_undegraded":"2020-11-16T20:56:15.736556+0000","last_fullsized":"2020-11-16T20:56:15.736556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.571892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.571892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"58","reported_epoch":"53","state":"active+clean","last_fresh":"2020-11-16T20:56:15.737729+0000","last_change":"2020-11-16T20:55:59.950321+0000","last_active":"2020-11-16T20:56:15.737729+0000","last_peered":"2020-11-16T20:56:15.737729+0000","last_clean":"2020-11-16T20:56:15.737729+0000","last_became_active":"2020-11-16T20:55:50.905408+0000","last_became_peered":"2020-11-16T20:55:50.905408+0000","last_unstale":"2020-11-16T20:56:15.737729+0000","last_undegraded":"2020-11-16T20:56:15.737729+0000","last_fullsized":"2020-11-16T20:56:15.737729+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.950219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.950219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"54'132","reported_seq":"242","reported_epoch":"54","state":"active+clean","last_fresh":"2020-11-16T20:56:16.846856+0000","last_change":"2020-11-16T20:56:16.757197+0000","last_active":"2020-11-16T20:56:16.846856+0000","last_peered":"2020-11-16T20:56:16.846856+0000","last_clean":"2020-11-16T20:56:16.846856+0000","last_became_active":"2020-11-16T20:55:30.827526+0000","last_became_peered":"2020-11-16T20:55:30.827526+0000","last_unstale":"2020-11-16T20:56:16.846856+0000","last_undegraded":"2020-11-16T20:56:16.846856+0000","last_fullsized":"2020-11-16T20:56:16.846856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":132,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":103988255,"num_objects":41,"num_object_clones":5,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":51,"num_read_kb":23022,"num_write":84,"num_write_kb":14909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":6,"num_flush_kb":17466,"num_evict":0,"num_evict_kb":0,"num_promote":39,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"1"},{"start":"7","length":"1"},{"start":"c","length":"2"}]},{"pgid":"2.7","version":"0'0","reported_seq":"58","reported_epoch":"53","state":"active+clean","last_fresh":"2020-11-16T20:56:15.742027+0000","last_change":"2020-11-16T20:55:59.645073+0000","last_active":"2020-11-16T20:56:15.742027+0000","last_peered":"2020-11-16T20:56:15.742027+0000","last_clean":"2020-11-16T20:56:15.742027+0000","last_became_active":"2020-11-16T20:55:50.905649+0000","last_became_peered":"2020-11-16T20:55:50.905649+0000","last_unstale":"2020-11-16T20:56:15.742027+0000","last_undegraded":"2020-11-16T20:56:15.742027+0000","last_fullsized":"2020-11-16T20:56:15.742027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.644996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.644996+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"54'142","reported_seq":"369","reported_epoch":"54","state":"active+clean","last_fresh":"2020-11-16T20:56:16.835879+0000","last_change":"2020-11-16T20:56:16.795591+0000","last_active":"2020-11-16T20:56:16.835879+0000","last_peered":"2020-11-16T20:56:16.835879+0000","last_clean":"2020-11-16T20:56:16.835879+0000","last_became_active":"2020-11-16T20:56:16.750108+0000","last_became_peered":"2020-11-16T20:56:16.750108+0000","last_unstale":"2020-11-16T20:56:16.835879+0000","last_undegraded":"2020-11-16T20:56:16.835879+0000","last_fullsized":"2020-11-16T20:56:16.835879+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":142,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":120378289,"num_objects":43,"num_object_clones":3,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":2,"num_read":59,"num_read_kb":25131,"num_write":107,"num_write_kb":20622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":91753326,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":10,"num_flush_kb":29549,"num_evict":0,"num_evict_kb":0,"num_promote":40,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4","length":"1"},{"start":"7","length":"1"},{"start":"c","length":"2"}]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":452823854,"num_objects":176,"num_object_clones":19,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":4,"num_read":218,"num_read_kb":73274,"num_write":444,"num_write_kb":76988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":91753326,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":50,"num_flush_kb":140045,"num_evict":0,"num_evict_kb":0,"num_promote":165,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1113878528,"data_stored":1206538542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":650,"ondisk_log_size":650,"up":12,"acting":12,"num_store_stats":7},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":1431136030,"num_objects":532,"num_object_clones":36,"num_object_copies":1596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":532,"num_whiteouts":6,"num_read":1153,"num_read_kb":139663,"num_write":2038,"num_write_kb":801573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2286460928,"data_stored":2316676953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1927,"ondisk_log_size":1927,"up":12,"acting":12,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":18,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174176,"kb_used_data":168152,"kb_used_omap":0,"kb_used_meta":6016,"kb_avail":94197664,"statfs":{"total":96636764160,"available":96458407936,"internally_reserved":0,"allocated":172187648,"data_stored":186017994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6160384},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.61199999999999999}]},{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.70399999999999996}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.3069999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.125}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.089},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.83899999999999997}]},{"osd":4,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.2270000000000001}]},{"osd":5,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.98499999999999999}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.038}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":627360,"kb_used_data":614408,"kb_used_omap":0,"kb_used_meta":12480,"kb_avail":93744480,"statfs":{"total":96636764160,"available":95994347520,"internally_reserved":0,"allocated":629153792,"data_stored":635470479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12779520},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.78600000000000003}]},{"osd":1,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.86799999999999999}]},{"osd":2,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.95099999999999996}]},{"osd":3,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.1299999999999999}]},{"osd":4,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.89200000000000002}]},{"osd":5,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.095}]},{"osd":7,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.169},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.365}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":256588,"kb_used_data":249988,"kb_used_omap":0,"kb_used_meta":6592,"kb_avail":94115252,"statfs":{"total":96636764160,"available":96374018048,"internally_reserved":0,"allocated":255987712,"data_stored":262577227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6750208},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.69999999999999996}]},{"osd":2,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.81899999999999995}]},{"osd":3,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.677,"5min":2.677,"15min":2.677},"last":0.875},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.82999999999999996}]},{"osd":4,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.097}]},{"osd":5,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":0.95599999999999996}]},{"osd":6,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.2769999999999999}]},{"osd":7,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"max":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":1.117},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.2230000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":586988,"kb_used_data":574564,"kb_used_omap":0,"kb_used_meta":12416,"kb_avail":93784852,"statfs":{"total":96636764160,"available":96035688448,"internally_reserved":0,"allocated":588353536,"data_stored":614526955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12713984},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.59899999999999998}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.70999999999999996}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.55200000000000005}]},{"osd":4,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.129}]},{"osd":5,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.85799999999999998}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":0.83799999999999997}]},{"osd":7,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"max":{"1min":1.954,"5min":1.954,"15min":1.954},"last":0.997},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.071}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160624,"kb_used_data":154664,"kb_used_omap":0,"kb_used_meta":5952,"kb_avail":94211216,"statfs":{"total":96636764160,"available":96472285184,"internally_reserved":0,"allocated":158375936,"data_stored":159062507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6094848},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.73199999999999998}]},{"osd":1,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.86299999999999999}]},{"osd":3,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.83999999999999997}]},{"osd":4,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.4990000000000001}]},{"osd":5,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.085}]},{"osd":6,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.278},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.1180000000000001}]},{"osd":7,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.1719999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":576712,"kb_used_data":559212,"kb_used_omap":0,"kb_used_meta":12352,"kb_avail":93795128,"statfs":{"total":96636764160,"available":96046211072,"internally_reserved":0,"allocated":572633088,"data_stored":588000221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12648448},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.59199999999999997}]},{"osd":1,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":0.623},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":1.03}]},{"osd":2,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.194}]},{"osd":4,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.923,"5min":2.923,"15min":2.923},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.968,"5min":2.968,"15min":2.968},"last":2.016}]},{"osd":5,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.8479999999999999,"5min":2.8479999999999999,"15min":2.8479999999999999},"last":2.1789999999999998},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.284}]},{"osd":6,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.859,"5min":2.859,"15min":2.859},"last":1.226},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":3.5390000000000001,"5min":3.5390000000000001,"15min":3.5390000000000001},"last":2.2890000000000001}]},{"osd":7,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.9780000000000002,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":1.47}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":568496,"kb_used_data":555736,"kb_used_omap":0,"kb_used_meta":12288,"kb_avail":93803344,"statfs":{"total":96636764160,"available":96054624256,"internally_reserved":0,"allocated":569073664,"data_stored":578634956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12582912},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.016}]},{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.63600000000000001}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.83399999999999996}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.88400000000000001}]},{"osd":5,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.91600000000000004}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":0.95799999999999996}]},{"osd":7,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":2.4369999999999998,"5min":2.4369999999999998,"15min":2.4369999999999998},"last":1.083},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.98999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381552,"kb_used_data":369768,"kb_used_omap":0,"kb_used_meta":11776,"kb_avail":93990288,"statfs":{"total":96636764160,"available":96246054912,"internally_reserved":0,"allocated":378642432,"data_stored":397947059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12058624},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.105},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.56299999999999994}]},{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.93999999999999995}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.53800000000000003}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.97099999999999997}]},{"osd":4,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.70899999999999996}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.2190000000000001}]},{"osd":7,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":1.107,"5min":1.107,"15min":1.107},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.05}]}]}]}} 2020-11-16T20:56:18.833 INFO:tasks.thrashosds.thrasher:Setting 2.e to [1, 7, 0] 2020-11-16T20:56:18.834 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '2.e', '1', '7', '0'] 2020-11-16T20:56:18.834 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 2.e 1 7 0 2020-11-16T20:56:18.839 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:56:18.909 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:18.914+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:19.010 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:19.015+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:19.020 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:19.020 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:56:19.021 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:56:19.021 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:56:19.021 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.021 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1115 4.2 4:5a2aa7df:::smithi16641208-248:head [setxattr _header (57) in=7b,truncate 2151329] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:19.021 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.954978+0000", 2020-11-16T20:56:19.021 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 24.068870069999999, 2020-11-16T20:56:19.022 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023396486000000001, 2020-11-16T20:56:19.022 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.022 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.022 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:19.022 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:19.022 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:19.022 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1115 2020-11-16T20:56:19.023 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.023 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.023 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.023 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.023 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.954978+0000", 2020-11-16T20:56:19.023 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.023 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.023 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.024 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.024 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.954978+0000", 2020-11-16T20:56:19.024 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2381000000000001e-05 2020-11-16T20:56:19.024 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.024 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.024 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.024 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955000+0000", 2020-11-16T20:56:19.025 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3979999999999999e-06 2020-11-16T20:56:19.025 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.025 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.025 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.025 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955003+0000", 2020-11-16T20:56:19.025 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1510000000000001e-06 2020-11-16T20:56:19.025 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.026 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.026 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.026 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955009+0000", 2020-11-16T20:56:19.026 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6690000000000002e-06 2020-11-16T20:56:19.026 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.026 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.026 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.026 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955012+0000", 2020-11-16T20:56:19.027 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000317423 2020-11-16T20:56:19.027 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.027 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.027 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.027 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955330+0000", 2020-11-16T20:56:19.027 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3217000000000002e-05 2020-11-16T20:56:19.027 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.028 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.028 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:19.028 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955383+0000", 2020-11-16T20:56:19.028 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011320966 2020-11-16T20:56:19.028 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.028 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.028 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.028 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.966704+0000", 2020-11-16T20:56:19.029 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015513500000000001 2020-11-16T20:56:19.029 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.029 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.029 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.029 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.966859+0000", 2020-11-16T20:56:19.029 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018944 2020-11-16T20:56:19.029 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.030 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.030 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:19.030 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.967048+0000", 2020-11-16T20:56:19.030 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0062409930000000002 2020-11-16T20:56:19.030 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.030 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.030 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:19.031 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.973289+0000", 2020-11-16T20:56:19.031 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0049529889999999997 2020-11-16T20:56:19.031 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.031 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.031 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:19.031 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978242+0000", 2020-11-16T20:56:19.031 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1761999999999999e-05 2020-11-16T20:56:19.031 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.032 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.032 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:19.032 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978264+0000", 2020-11-16T20:56:19.032 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9797999999999999e-05 2020-11-16T20:56:19.032 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.032 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.032 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.032 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978324+0000", 2020-11-16T20:56:19.033 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0164000000000003e-05 2020-11-16T20:56:19.033 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.033 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.033 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.033 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978374+0000", 2020-11-16T20:56:19.033 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023396486000000001 2020-11-16T20:56:19.033 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.034 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.034 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.034 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.034 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.034 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1116 4.2 4:5a2aa7df:::smithi16641208-248:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e35)", 2020-11-16T20:56:19.034 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.955031+0000", 2020-11-16T20:56:19.034 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 24.06881675, 2020-11-16T20:56:19.035 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023838986999999999, 2020-11-16T20:56:19.035 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.035 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:19.035 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:19.035 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:19.035 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:19.035 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1116 2020-11-16T20:56:19.035 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.036 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.036 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.036 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.036 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955031+0000", 2020-11-16T20:56:19.036 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.036 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.036 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.037 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.037 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955031+0000", 2020-11-16T20:56:19.037 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5029e-05 2020-11-16T20:56:19.037 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.037 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.037 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.037 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955046+0000", 2020-11-16T20:56:19.037 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8770000000000002e-06 2020-11-16T20:56:19.038 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.038 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.038 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.038 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955049+0000", 2020-11-16T20:56:19.038 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7219999999999996e-06 2020-11-16T20:56:19.038 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.038 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.039 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.039 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955055+0000", 2020-11-16T20:56:19.039 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4109999999999999e-06 2020-11-16T20:56:19.039 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.039 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.039 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.039 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955057+0000", 2020-11-16T20:56:19.039 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00035397299999999999 2020-11-16T20:56:19.040 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.040 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.040 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.040 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955411+0000", 2020-11-16T20:56:19.040 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4848000000000001e-05 2020-11-16T20:56:19.040 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.040 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.041 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:19.041 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.955466+0000", 2020-11-16T20:56:19.041 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012080844 2020-11-16T20:56:19.041 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.041 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.041 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.041 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.967547+0000", 2020-11-16T20:56:19.041 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015558100000000001 2020-11-16T20:56:19.042 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.042 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.042 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:19.042 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.967702+0000", 2020-11-16T20:56:19.042 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010726072999999999 2020-11-16T20:56:19.042 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.042 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.043 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.043 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978428+0000", 2020-11-16T20:56:19.043 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013814900000000001 2020-11-16T20:56:19.043 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.043 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.043 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.043 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978566+0000", 2020-11-16T20:56:19.043 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030348000000000001 2020-11-16T20:56:19.044 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.044 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.044 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.044 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978870+0000", 2020-11-16T20:56:19.044 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023838986999999999 2020-11-16T20:56:19.044 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.044 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.045 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.045 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.045 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.045 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1121 4.2 4:7ef90409:::smithi16641208-250:head [write 584943~460297,stat] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:19.045 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.974149+0000", 2020-11-16T20:56:19.045 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 24.049698465999999, 2020-11-16T20:56:19.045 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025650249999999999, 2020-11-16T20:56:19.045 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.046 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.046 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:19.046 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:19.046 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:19.046 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1121 2020-11-16T20:56:19.046 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.046 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.047 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.047 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.047 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.974149+0000", 2020-11-16T20:56:19.047 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.047 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.047 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.047 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.047 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.974149+0000", 2020-11-16T20:56:19.048 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000117531 2020-11-16T20:56:19.048 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.048 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.048 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.048 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.974267+0000", 2020-11-16T20:56:19.048 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.618e-06 2020-11-16T20:56:19.048 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.049 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.049 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.049 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.974273+0000", 2020-11-16T20:56:19.049 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.343e-05 2020-11-16T20:56:19.049 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.049 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.049 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.049 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.974287+0000", 2020-11-16T20:56:19.050 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8980000000000001e-06 2020-11-16T20:56:19.050 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.050 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.050 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.050 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.974293+0000", 2020-11-16T20:56:19.050 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0046077069999999999 2020-11-16T20:56:19.050 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.051 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.051 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.051 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.978900+0000", 2020-11-16T20:56:19.051 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020897138999999999 2020-11-16T20:56:19.051 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.051 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.051 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.051 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.999797+0000", 2020-11-16T20:56:19.052 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9269999999999999e-06 2020-11-16T20:56:19.052 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.052 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.052 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.052 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.999799+0000", 2020-11-16T20:56:19.052 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025650249999999999 2020-11-16T20:56:19.052 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.053 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.053 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.053 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.053 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.053 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1122 4.2 4:7ef90409:::smithi16641208-250:head [write 1587781~597162] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:19.053 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.982754+0000", 2020-11-16T20:56:19.053 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 24.041094029, 2020-11-16T20:56:19.053 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020140918000000001, 2020-11-16T20:56:19.054 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.054 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.054 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:19.054 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:19.054 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:19.054 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1122 2020-11-16T20:56:19.054 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.055 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.055 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.055 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.055 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.982754+0000", 2020-11-16T20:56:19.055 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.055 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.055 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.055 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.056 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.982754+0000", 2020-11-16T20:56:19.056 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019379 2020-11-16T20:56:19.056 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.056 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.056 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.056 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.982947+0000", 2020-11-16T20:56:19.056 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2900000000000008e-06 2020-11-16T20:56:19.056 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.057 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.057 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.057 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.982957+0000", 2020-11-16T20:56:19.057 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6120000000000002e-05 2020-11-16T20:56:19.057 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.057 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.057 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.058 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.982973+0000", 2020-11-16T20:56:19.058 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.5219999999999996e-06 2020-11-16T20:56:19.058 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.058 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.058 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.058 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.982982+0000", 2020-11-16T20:56:19.058 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5333e-05 2020-11-16T20:56:19.058 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.059 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.059 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.059 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983038+0000", 2020-11-16T20:56:19.059 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019854133999999999 2020-11-16T20:56:19.059 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.059 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.059 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.060 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002892+0000", 2020-11-16T20:56:19.060 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.729e-06 2020-11-16T20:56:19.060 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.060 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.060 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.060 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.002895+0000", 2020-11-16T20:56:19.060 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020140918000000001 2020-11-16T20:56:19.060 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.061 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.061 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.061 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.061 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.061 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1123 4.2 4:7ef90409:::smithi16641208-250:head [setxattr _header (57) in=7b,truncate 2184943] snapc 0=[] ondisk+write+known_if_redirected e35)", 2020-11-16T20:56:19.061 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.983026+0000", 2020-11-16T20:56:19.061 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 24.040821314999999, 2020-11-16T20:56:19.061 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020255397000000001, 2020-11-16T20:56:19.062 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.062 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.062 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:19.062 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:19.062 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:19.062 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1123 2020-11-16T20:56:19.062 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.063 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.063 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.063 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.063 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983026+0000", 2020-11-16T20:56:19.063 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.063 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.063 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.063 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.064 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983026+0000", 2020-11-16T20:56:19.064 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9609e-05 2020-11-16T20:56:19.064 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.064 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.064 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.064 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983066+0000", 2020-11-16T20:56:19.064 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0859999999999998e-06 2020-11-16T20:56:19.065 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.065 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983072+0000", 2020-11-16T20:56:19.065 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00043611499999999999 2020-11-16T20:56:19.065 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983508+0000", 2020-11-16T20:56:19.066 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4060000000000005e-06 2020-11-16T20:56:19.066 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.066 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.066 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983517+0000", 2020-11-16T20:56:19.066 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9840999999999998e-05 2020-11-16T20:56:19.067 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.067 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.067 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.067 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.983586+0000", 2020-11-16T20:56:19.067 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019692405 2020-11-16T20:56:19.067 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.067 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.067 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.068 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003279+0000", 2020-11-16T20:56:19.068 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9349999999999999e-06 2020-11-16T20:56:19.068 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.068 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.068 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.068 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.003282+0000", 2020-11-16T20:56:19.068 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020255397000000001 2020-11-16T20:56:19.069 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.069 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.069 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.069 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.069 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.069 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1406 4.2 4:6c6ed246:::smithi16641208-316:head [setxattr _header (57) in=7b,truncate 3294205] snapc 0=[] ondisk+write+known_if_redirected e36)", 2020-11-16T20:56:19.069 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.968144+0000", 2020-11-16T20:56:19.069 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 23.055703371, 2020-11-16T20:56:19.070 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026933623, 2020-11-16T20:56:19.070 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.070 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.070 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:19.070 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:19.070 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:19.070 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1406 2020-11-16T20:56:19.071 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.071 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.071 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.071 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.071 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968144+0000", 2020-11-16T20:56:19.071 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.071 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.071 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.072 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.072 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968144+0000", 2020-11-16T20:56:19.072 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3442999999999999e-05 2020-11-16T20:56:19.072 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.072 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.072 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.072 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968168+0000", 2020-11-16T20:56:19.073 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3569999999999998e-06 2020-11-16T20:56:19.073 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.073 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.073 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.073 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968171+0000", 2020-11-16T20:56:19.073 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.728e-06 2020-11-16T20:56:19.073 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.073 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.074 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.074 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968177+0000", 2020-11-16T20:56:19.074 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.943e-06 2020-11-16T20:56:19.074 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.074 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.074 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.074 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968180+0000", 2020-11-16T20:56:19.075 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018267500000000001 2020-11-16T20:56:19.075 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.075 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.075 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.075 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968362+0000", 2020-11-16T20:56:19.075 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3270000000000003e-05 2020-11-16T20:56:19.075 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.076 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.076 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:19.076 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968416+0000", 2020-11-16T20:56:19.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011050572999999999 2020-11-16T20:56:19.076 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.076 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.076 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.076 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.979466+0000", 2020-11-16T20:56:19.077 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8349000000000005e-05 2020-11-16T20:56:19.077 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.077 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.077 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.077 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.979545+0000", 2020-11-16T20:56:19.077 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010998299999999999 2020-11-16T20:56:19.077 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.077 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.078 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:19.078 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.979655+0000", 2020-11-16T20:56:19.078 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00092610999999999995 2020-11-16T20:56:19.078 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.078 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.078 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:19.078 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.980581+0000", 2020-11-16T20:56:19.079 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0068293140000000004 2020-11-16T20:56:19.079 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.079 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.079 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:19.079 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.987410+0000", 2020-11-16T20:56:19.079 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0075214959999999999 2020-11-16T20:56:19.079 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.080 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.080 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:19.080 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.994931+0000", 2020-11-16T20:56:19.080 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5657e-05 2020-11-16T20:56:19.080 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.080 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.080 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.080 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.994977+0000", 2020-11-16T20:56:19.081 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000100725 2020-11-16T20:56:19.081 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.081 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.081 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.081 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.995078+0000", 2020-11-16T20:56:19.081 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026933623 2020-11-16T20:56:19.081 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.081 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.082 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.082 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.082 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.082 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:1407 4.2 4:6c6ed246:::smithi16641208-316:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e36)", 2020-11-16T20:56:19.082 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.968204+0000", 2020-11-16T20:56:19.082 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 23.055643943, 2020-11-16T20:56:19.082 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027229834000000001, 2020-11-16T20:56:19.083 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.083 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:19.083 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:19.083 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:19.083 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:19.083 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 1407 2020-11-16T20:56:19.083 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.083 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.084 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.084 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.084 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968204+0000", 2020-11-16T20:56:19.084 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.084 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.084 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.084 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.085 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968204+0000", 2020-11-16T20:56:19.085 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6412000000000001e-05 2020-11-16T20:56:19.085 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.085 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.085 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.085 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968220+0000", 2020-11-16T20:56:19.085 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0060000000000001e-06 2020-11-16T20:56:19.085 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.086 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.086 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.086 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968223+0000", 2020-11-16T20:56:19.086 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7660000000000004e-06 2020-11-16T20:56:19.086 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.086 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.086 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.087 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968229+0000", 2020-11-16T20:56:19.087 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6979999999999998e-06 2020-11-16T20:56:19.087 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.087 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.087 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.087 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968232+0000", 2020-11-16T20:56:19.087 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000199786 2020-11-16T20:56:19.087 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.088 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.088 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.088 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968431+0000", 2020-11-16T20:56:19.088 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7841999999999999e-05 2020-11-16T20:56:19.088 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.088 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.088 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:19.089 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.968459+0000", 2020-11-16T20:56:19.089 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011510038 2020-11-16T20:56:19.089 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.089 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.089 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.089 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.979969+0000", 2020-11-16T20:56:19.089 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7645000000000006e-05 2020-11-16T20:56:19.089 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.090 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.090 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:19.090 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.980047+0000", 2020-11-16T20:56:19.090 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015060982000000001 2020-11-16T20:56:19.090 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.090 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.090 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.090 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.995108+0000", 2020-11-16T20:56:19.091 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4376999999999997e-05 2020-11-16T20:56:19.091 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.091 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.091 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.091 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.995172+0000", 2020-11-16T20:56:19.091 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000261282 2020-11-16T20:56:19.091 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.092 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.092 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.092 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.995434+0000", 2020-11-16T20:56:19.092 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027229834000000001 2020-11-16T20:56:19.092 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.092 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.092 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.092 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.093 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.093 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2350 4.2 4:540952ab:::smithi16641208-369:head [setxattr _header (57) in=7b,truncate 2689219] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:19.093 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:04.995896+0000", 2020-11-16T20:56:19.093 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 14.027951415, 2020-11-16T20:56:19.093 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029642330000000001, 2020-11-16T20:56:19.093 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.093 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.094 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:19.094 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:19.094 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:19.094 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2350 2020-11-16T20:56:19.094 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.094 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.094 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.095 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.095 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995896+0000", 2020-11-16T20:56:19.095 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.095 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.095 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.095 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.095 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995896+0000", 2020-11-16T20:56:19.095 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6718999999999999e-05 2020-11-16T20:56:19.096 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.096 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.096 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.096 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995923+0000", 2020-11-16T20:56:19.096 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.45e-06 2020-11-16T20:56:19.096 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.096 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.096 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.097 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995926+0000", 2020-11-16T20:56:19.097 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0610000000000001e-06 2020-11-16T20:56:19.097 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.097 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.097 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.097 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995932+0000", 2020-11-16T20:56:19.097 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8159999999999998e-06 2020-11-16T20:56:19.098 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.098 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.098 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.098 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995935+0000", 2020-11-16T20:56:19.098 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033157800000000002 2020-11-16T20:56:19.098 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.098 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.099 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.099 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.996267+0000", 2020-11-16T20:56:19.099 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2596999999999997e-05 2020-11-16T20:56:19.099 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.099 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.099 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:19.099 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.996329+0000", 2020-11-16T20:56:19.099 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017162574 2020-11-16T20:56:19.100 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.100 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.100 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.100 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.013492+0000", 2020-11-16T20:56:19.100 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010529100000000001 2020-11-16T20:56:19.100 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.100 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.100 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.101 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.013597+0000", 2020-11-16T20:56:19.101 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00026468599999999998 2020-11-16T20:56:19.101 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.101 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.101 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:19.101 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.013862+0000", 2020-11-16T20:56:19.101 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039181670000000002 2020-11-16T20:56:19.102 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.102 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.102 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:19.102 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017780+0000", 2020-11-16T20:56:19.102 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0074859829999999999 2020-11-16T20:56:19.102 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.102 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.103 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:19.103 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025266+0000", 2020-11-16T20:56:19.103 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014650000000000001 2020-11-16T20:56:19.103 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.103 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.103 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:19.103 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025413+0000", 2020-11-16T20:56:19.103 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0152999999999998e-05 2020-11-16T20:56:19.104 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.104 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.104 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.104 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025473+0000", 2020-11-16T20:56:19.104 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5754999999999996e-05 2020-11-16T20:56:19.104 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.104 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.105 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.105 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025539+0000", 2020-11-16T20:56:19.105 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029642330000000001 2020-11-16T20:56:19.105 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.105 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.105 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.105 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.105 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.106 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2351 4.2 4:540952ab:::smithi16641208-369:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e42)", 2020-11-16T20:56:19.106 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:04.995959+0000", 2020-11-16T20:56:19.106 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 14.027888320000001, 2020-11-16T20:56:19.106 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030096398999999999, 2020-11-16T20:56:19.106 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.106 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:19.106 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:19.107 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:19.107 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:19.107 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2351 2020-11-16T20:56:19.107 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.107 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.107 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.107 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.107 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995959+0000", 2020-11-16T20:56:19.108 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.108 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.108 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.108 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.108 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995959+0000", 2020-11-16T20:56:19.108 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5330000000000001e-05 2020-11-16T20:56:19.108 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.108 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.109 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.109 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995975+0000", 2020-11-16T20:56:19.109 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.45e-06 2020-11-16T20:56:19.109 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.109 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.109 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.109 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995978+0000", 2020-11-16T20:56:19.110 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0909999999999998e-06 2020-11-16T20:56:19.110 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.110 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.110 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.110 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995984+0000", 2020-11-16T20:56:19.110 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6350000000000002e-06 2020-11-16T20:56:19.110 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.110 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.111 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.111 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.995987+0000", 2020-11-16T20:56:19.111 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00037882600000000002 2020-11-16T20:56:19.111 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.111 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.111 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.111 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.996366+0000", 2020-11-16T20:56:19.112 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4063000000000002e-05 2020-11-16T20:56:19.112 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.112 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.112 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:19.112 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.996400+0000", 2020-11-16T20:56:19.112 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017796823 2020-11-16T20:56:19.112 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.112 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.113 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.014197+0000", 2020-11-16T20:56:19.113 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9716000000000005e-05 2020-11-16T20:56:19.113 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.113 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:19.113 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.014296+0000", 2020-11-16T20:56:19.113 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011288734999999999 2020-11-16T20:56:19.114 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.114 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.114 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.114 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025585+0000", 2020-11-16T20:56:19.114 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000152924 2020-11-16T20:56:19.114 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.114 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.115 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.115 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025738+0000", 2020-11-16T20:56:19.115 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00031780600000000001 2020-11-16T20:56:19.115 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.115 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.115 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.115 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.026056+0000", 2020-11-16T20:56:19.115 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030096398999999999 2020-11-16T20:56:19.116 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.116 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.116 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.116 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.116 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.116 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2364 4.2 4:646fee8a:::smithi16641208-407:head [write 1887942~537832] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:19.116 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.038059+0000", 2020-11-16T20:56:19.117 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 13.985788320999999, 2020-11-16T20:56:19.117 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041814939000000002, 2020-11-16T20:56:19.117 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.117 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.117 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:19.117 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:19.117 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:19.117 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2364 2020-11-16T20:56:19.118 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.118 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.118 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.118 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.118 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038059+0000", 2020-11-16T20:56:19.118 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.118 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.119 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.119 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.119 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038059+0000", 2020-11-16T20:56:19.119 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017486300000000001 2020-11-16T20:56:19.119 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.119 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.119 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.119 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038234+0000", 2020-11-16T20:56:19.120 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2265e-05 2020-11-16T20:56:19.120 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.120 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.120 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.120 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038246+0000", 2020-11-16T20:56:19.120 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7935e-05 2020-11-16T20:56:19.120 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.120 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.121 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.121 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038264+0000", 2020-11-16T20:56:19.121 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2608e-05 2020-11-16T20:56:19.121 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.121 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.121 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.121 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038277+0000", 2020-11-16T20:56:19.122 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9994000000000002e-05 2020-11-16T20:56:19.122 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.122 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.122 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.122 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038337+0000", 2020-11-16T20:56:19.122 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8548999999999997e-05 2020-11-16T20:56:19.122 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.122 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.123 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:19.123 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038406+0000", 2020-11-16T20:56:19.123 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022992545 2020-11-16T20:56:19.123 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.123 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.123 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.123 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.061398+0000", 2020-11-16T20:56:19.124 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011551499999999999 2020-11-16T20:56:19.124 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.124 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.124 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.124 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.061514+0000", 2020-11-16T20:56:19.124 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018992799999999999 2020-11-16T20:56:19.124 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.124 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.125 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:19.125 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.061704+0000", 2020-11-16T20:56:19.125 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078335980000000006 2020-11-16T20:56:19.125 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.125 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.125 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:19.125 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.069537+0000", 2020-11-16T20:56:19.126 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0069952080000000002 2020-11-16T20:56:19.126 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.126 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.126 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:19.126 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076532+0000", 2020-11-16T20:56:19.126 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0032792590000000001 2020-11-16T20:56:19.126 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.126 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.127 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:19.127 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.079812+0000", 2020-11-16T20:56:19.127 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6931999999999998e-05 2020-11-16T20:56:19.127 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.127 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.127 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.127 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.079849+0000", 2020-11-16T20:56:19.128 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5740000000000001e-05 2020-11-16T20:56:19.128 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.128 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.128 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.128 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.079874+0000", 2020-11-16T20:56:19.128 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041814939000000002 2020-11-16T20:56:19.128 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.128 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.129 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.129 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.129 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.129 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2365 4.2 4:646fee8a:::smithi16641208-407:head [setxattr _header (57) in=7b,truncate 2756447] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:19.129 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.038336+0000", 2020-11-16T20:56:19.129 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 13.985511749, 2020-11-16T20:56:19.129 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041675704000000001, 2020-11-16T20:56:19.130 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.130 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.130 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:19.130 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:19.130 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:19.130 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2365 2020-11-16T20:56:19.130 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.130 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.131 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.131 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.131 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038336+0000", 2020-11-16T20:56:19.131 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.131 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.131 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.131 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.132 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038336+0000", 2020-11-16T20:56:19.132 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4296999999999999e-05 2020-11-16T20:56:19.132 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.132 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.132 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.132 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038390+0000", 2020-11-16T20:56:19.132 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0770000000000002e-06 2020-11-16T20:56:19.132 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.133 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.133 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.133 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038397+0000", 2020-11-16T20:56:19.133 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1194e-05 2020-11-16T20:56:19.133 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.133 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.133 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.133 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038408+0000", 2020-11-16T20:56:19.134 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4639999999999997e-06 2020-11-16T20:56:19.134 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.134 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.134 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.134 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038414+0000", 2020-11-16T20:56:19.134 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2388000000000002e-05 2020-11-16T20:56:19.134 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.135 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.135 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.135 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038446+0000", 2020-11-16T20:56:19.135 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1230999999999999e-05 2020-11-16T20:56:19.135 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.135 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.135 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:19.136 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038488+0000", 2020-11-16T20:56:19.136 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030040847999999998 2020-11-16T20:56:19.136 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.136 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.136 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.136 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.068528+0000", 2020-11-16T20:56:19.136 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000171237 2020-11-16T20:56:19.136 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.137 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.137 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.137 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.068700+0000", 2020-11-16T20:56:19.137 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033098099999999999 2020-11-16T20:56:19.137 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.137 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.137 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:19.137 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.069031+0000", 2020-11-16T20:56:19.138 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061702559999999998 2020-11-16T20:56:19.138 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.138 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.138 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:19.138 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.075201+0000", 2020-11-16T20:56:19.138 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0013760949999999999 2020-11-16T20:56:19.138 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.139 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.139 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:19.139 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076577+0000", 2020-11-16T20:56:19.139 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033426459999999999 2020-11-16T20:56:19.139 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.139 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.139 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:19.139 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.079920+0000", 2020-11-16T20:56:19.140 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7162000000000001e-05 2020-11-16T20:56:19.140 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.140 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.140 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.140 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.079957+0000", 2020-11-16T20:56:19.140 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4827999999999998e-05 2020-11-16T20:56:19.140 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.141 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.141 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.141 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.080012+0000", 2020-11-16T20:56:19.141 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041675704000000001 2020-11-16T20:56:19.141 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.141 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.141 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.141 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.142 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.142 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2366 4.2 4:646fee8a:::smithi16641208-407:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e42)", 2020-11-16T20:56:19.142 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.038451+0000", 2020-11-16T20:56:19.142 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 13.985396738, 2020-11-16T20:56:19.142 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041982845999999997, 2020-11-16T20:56:19.142 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.142 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:19.143 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:19.143 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:19.143 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:19.143 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2366 2020-11-16T20:56:19.143 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.143 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.143 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.143 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.144 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038451+0000", 2020-11-16T20:56:19.144 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.144 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.144 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.144 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.144 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038451+0000", 2020-11-16T20:56:19.144 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0439999999999999e-05 2020-11-16T20:56:19.145 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.145 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.145 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.145 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038491+0000", 2020-11-16T20:56:19.145 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5890000000000002e-06 2020-11-16T20:56:19.145 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.145 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.145 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.146 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038497+0000", 2020-11-16T20:56:19.146 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4161999999999999e-05 2020-11-16T20:56:19.146 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.146 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.146 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.146 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038511+0000", 2020-11-16T20:56:19.146 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.533e-06 2020-11-16T20:56:19.146 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.147 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.147 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.147 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038518+0000", 2020-11-16T20:56:19.147 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5011000000000001e-05 2020-11-16T20:56:19.147 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.147 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.147 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.148 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038553+0000", 2020-11-16T20:56:19.148 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5098000000000001e-05 2020-11-16T20:56:19.148 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.148 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.148 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:19.148 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038598+0000", 2020-11-16T20:56:19.148 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030972613999999999 2020-11-16T20:56:19.148 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.149 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.149 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.149 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.069570+0000", 2020-11-16T20:56:19.149 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000133509 2020-11-16T20:56:19.149 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.149 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.149 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:19.150 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.069704+0000", 2020-11-16T20:56:19.150 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010338886 2020-11-16T20:56:19.150 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.150 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.150 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.150 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.080043+0000", 2020-11-16T20:56:19.150 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4997e-05 2020-11-16T20:56:19.150 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.151 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.151 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.151 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.080118+0000", 2020-11-16T20:56:19.151 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00031600699999999998 2020-11-16T20:56:19.151 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.151 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.151 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.152 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.080434+0000", 2020-11-16T20:56:19.152 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041982845999999997 2020-11-16T20:56:19.152 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.152 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.152 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.152 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.152 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.152 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2367 4.2 4:581c1e5b:::smithi16641208-124:head [copy-from ver 55] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:19.153 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.038554+0000", 2020-11-16T20:56:19.153 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 13.985293240000001, 2020-11-16T20:56:19.153 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037316112999999998, 2020-11-16T20:56:19.153 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.153 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.153 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:19.153 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:19.154 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:19.154 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2367 2020-11-16T20:56:19.154 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.154 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.154 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.154 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.154 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038554+0000", 2020-11-16T20:56:19.154 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.155 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.155 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.155 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.155 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038554+0000", 2020-11-16T20:56:19.155 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0499e-05 2020-11-16T20:56:19.155 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.155 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.156 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.156 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038595+0000", 2020-11-16T20:56:19.156 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2469999999999997e-06 2020-11-16T20:56:19.156 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.156 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.156 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.156 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038601+0000", 2020-11-16T20:56:19.156 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0334e-05 2020-11-16T20:56:19.157 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.157 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.157 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.157 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038611+0000", 2020-11-16T20:56:19.157 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4869999999999996e-06 2020-11-16T20:56:19.157 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.157 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.157 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.158 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038619+0000", 2020-11-16T20:56:19.158 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2597999999999999e-05 2020-11-16T20:56:19.158 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.158 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.158 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.158 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038642+0000", 2020-11-16T20:56:19.158 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.0017000000000003e-05 2020-11-16T20:56:19.159 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.159 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.159 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.159 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038722+0000", 2020-11-16T20:56:19.159 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013694288000000001 2020-11-16T20:56:19.159 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.159 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.159 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:19.160 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.052416+0000", 2020-11-16T20:56:19.160 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010514186999999999 2020-11-16T20:56:19.160 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.160 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.160 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:19.160 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.062930+0000", 2020-11-16T20:56:19.160 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0065865289999999998 2020-11-16T20:56:19.160 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.161 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.161 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:19.161 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.069517+0000", 2020-11-16T20:56:19.161 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0062547710000000001 2020-11-16T20:56:19.161 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.161 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.161 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:19.162 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.075771+0000", 2020-11-16T20:56:19.162 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0716e-05 2020-11-16T20:56:19.162 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.162 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.162 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.162 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.075822+0000", 2020-11-16T20:56:19.162 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8439999999999997e-05 2020-11-16T20:56:19.162 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.163 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.163 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.163 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.075870+0000", 2020-11-16T20:56:19.163 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037316112999999998 2020-11-16T20:56:19.163 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.163 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.163 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.164 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.164 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.164 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2368 4.2 4:581c1e5b:::smithi16641208-124:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e42)", 2020-11-16T20:56:19.164 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.038662+0000", 2020-11-16T20:56:19.164 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 13.985185503, 2020-11-16T20:56:19.164 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037390824000000003, 2020-11-16T20:56:19.164 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.164 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:19.165 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:19.165 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:19.165 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:19.165 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2368 2020-11-16T20:56:19.165 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.165 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.165 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.165 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.166 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038662+0000", 2020-11-16T20:56:19.166 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.166 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.166 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.166 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.166 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038662+0000", 2020-11-16T20:56:19.166 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8368999999999999e-05 2020-11-16T20:56:19.167 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.167 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.167 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.167 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038690+0000", 2020-11-16T20:56:19.167 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2320000000000007e-06 2020-11-16T20:56:19.167 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.167 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.167 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.168 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038700+0000", 2020-11-16T20:56:19.168 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6840000000000001e-05 2020-11-16T20:56:19.168 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.168 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.168 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.168 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038717+0000", 2020-11-16T20:56:19.168 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3580000000000002e-06 2020-11-16T20:56:19.169 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.169 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.169 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.169 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038722+0000", 2020-11-16T20:56:19.169 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000148469 2020-11-16T20:56:19.169 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.169 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.169 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.170 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038870+0000", 2020-11-16T20:56:19.170 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8625000000000003e-05 2020-11-16T20:56:19.170 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.170 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.170 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:19.170 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.038919+0000", 2020-11-16T20:56:19.170 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030826721000000001 2020-11-16T20:56:19.170 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.171 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.171 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.171 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.069746+0000", 2020-11-16T20:56:19.171 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011651500000000001 2020-11-16T20:56:19.171 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.171 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.171 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:19.172 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.069862+0000", 2020-11-16T20:56:19.172 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0060354850000000002 2020-11-16T20:56:19.172 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.172 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.172 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.172 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.075898+0000", 2020-11-16T20:56:19.172 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2551000000000003e-05 2020-11-16T20:56:19.172 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.173 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.173 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.173 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.075980+0000", 2020-11-16T20:56:19.173 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2658999999999997e-05 2020-11-16T20:56:19.173 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.173 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.173 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.174 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076053+0000", 2020-11-16T20:56:19.174 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037390824000000003 2020-11-16T20:56:19.174 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.174 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.174 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.174 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.174 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.174 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2376 4.2 4:540952ab:::smithi16641208-369:head [setxattr _header (57) in=7b,truncate 2790061] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:19.175 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.070033+0000", 2020-11-16T20:56:19.175 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 13.953814349, 2020-11-16T20:56:19.175 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023378961, 2020-11-16T20:56:19.175 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.175 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.175 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:19.175 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:19.176 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:19.176 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2376 2020-11-16T20:56:19.176 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.176 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.176 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.176 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.176 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070033+0000", 2020-11-16T20:56:19.176 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.177 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.177 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.177 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.177 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070033+0000", 2020-11-16T20:56:19.177 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3158999999999998e-05 2020-11-16T20:56:19.177 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.177 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.178 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.178 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070076+0000", 2020-11-16T20:56:19.178 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8919999999999997e-06 2020-11-16T20:56:19.178 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.178 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.178 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.178 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070082+0000", 2020-11-16T20:56:19.178 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0039e-05 2020-11-16T20:56:19.179 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.179 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.179 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.179 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070092+0000", 2020-11-16T20:56:19.179 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1699999999999996e-06 2020-11-16T20:56:19.179 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.179 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.180 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.180 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070098+0000", 2020-11-16T20:56:19.180 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006570378 2020-11-16T20:56:19.180 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.180 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.180 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.180 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076668+0000", 2020-11-16T20:56:19.180 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012836600000000001 2020-11-16T20:56:19.181 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.181 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.181 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.181 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076796+0000", 2020-11-16T20:56:19.181 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000202857 2020-11-16T20:56:19.181 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.181 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.181 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:19.182 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076999+0000", 2020-11-16T20:56:19.182 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002782419 2020-11-16T20:56:19.182 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.182 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.182 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:19.182 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.079782+0000", 2020-11-16T20:56:19.182 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0036439520000000002 2020-11-16T20:56:19.183 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.183 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.183 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:19.183 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.083426+0000", 2020-11-16T20:56:19.183 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0098012419999999999 2020-11-16T20:56:19.183 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.183 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.183 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:19.184 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.093227+0000", 2020-11-16T20:56:19.184 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.5495999999999995e-05 2020-11-16T20:56:19.184 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.184 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.184 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.184 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.093322+0000", 2020-11-16T20:56:19.184 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9990999999999999e-05 2020-11-16T20:56:19.185 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.185 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.185 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.185 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.093412+0000", 2020-11-16T20:56:19.185 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023378961 2020-11-16T20:56:19.185 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.185 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.186 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.186 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.186 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.186 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2377 4.2 4:540952ab:::smithi16641208-369:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e42)", 2020-11-16T20:56:19.186 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.070126+0000", 2020-11-16T20:56:19.186 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 13.953721539, 2020-11-16T20:56:19.186 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023513600999999999, 2020-11-16T20:56:19.186 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.187 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:19.187 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:19.187 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:19.187 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:19.187 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2377 2020-11-16T20:56:19.187 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.187 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.188 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.188 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.188 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070126+0000", 2020-11-16T20:56:19.188 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.188 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.188 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.188 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.188 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070126+0000", 2020-11-16T20:56:19.189 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7708999999999998e-05 2020-11-16T20:56:19.189 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.189 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.189 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.189 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070154+0000", 2020-11-16T20:56:19.189 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6370000000000004e-06 2020-11-16T20:56:19.189 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.189 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.190 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.190 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070159+0000", 2020-11-16T20:56:19.190 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0202e-05 2020-11-16T20:56:19.190 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.190 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.190 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.190 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070170+0000", 2020-11-16T20:56:19.191 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1049999999999997e-06 2020-11-16T20:56:19.191 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.191 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.191 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.191 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070174+0000", 2020-11-16T20:56:19.191 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0071943199999999997 2020-11-16T20:56:19.191 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.191 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.192 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.192 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.077368+0000", 2020-11-16T20:56:19.192 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000108006 2020-11-16T20:56:19.192 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.192 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.192 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:19.192 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.077476+0000", 2020-11-16T20:56:19.193 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01596991 2020-11-16T20:56:19.193 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.193 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.193 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.193 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.093446+0000", 2020-11-16T20:56:19.193 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.5842999999999997e-05 2020-11-16T20:56:19.193 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.193 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.194 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.194 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.093542+0000", 2020-11-16T20:56:19.194 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.7868999999999994e-05 2020-11-16T20:56:19.194 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.194 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.194 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.194 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.093640+0000", 2020-11-16T20:56:19.195 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023513600999999999 2020-11-16T20:56:19.195 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.195 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.195 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.195 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.195 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.195 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2418 4.2 4:724a4144:::smithi16641208-153:head [write 1438834~548839] snapc 7=[7,5] ondisk+write+known_if_redirected e46)", 2020-11-16T20:56:19.195 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.021448+0000", 2020-11-16T20:56:19.196 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.002399508, 2020-11-16T20:56:19.196 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032459158000000002, 2020-11-16T20:56:19.196 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.196 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.196 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:19.196 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:19.196 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:19.197 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2418 2020-11-16T20:56:19.197 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.197 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.197 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.197 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.197 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.021448+0000", 2020-11-16T20:56:19.197 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.197 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.198 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.198 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.198 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.021448+0000", 2020-11-16T20:56:19.198 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029617499999999998 2020-11-16T20:56:19.198 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.198 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.198 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.199 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.021744+0000", 2020-11-16T20:56:19.199 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7950000000000008e-06 2020-11-16T20:56:19.199 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.199 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.199 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.199 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.021752+0000", 2020-11-16T20:56:19.199 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4569999999999999e-05 2020-11-16T20:56:19.199 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.200 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.200 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.200 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.021767+0000", 2020-11-16T20:56:19.200 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7260000000000002e-06 2020-11-16T20:56:19.200 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.200 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.200 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.201 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.021774+0000", 2020-11-16T20:56:19.201 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9556999999999998e-05 2020-11-16T20:56:19.201 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.201 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.201 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.201 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.021804+0000", 2020-11-16T20:56:19.201 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0703e-05 2020-11-16T20:56:19.201 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.202 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.202 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:19.202 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.021845+0000", 2020-11-16T20:56:19.202 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017052996000000001 2020-11-16T20:56:19.202 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.202 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.202 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.203 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.038898+0000", 2020-11-16T20:56:19.203 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.7804000000000001e-05 2020-11-16T20:56:19.203 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.203 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.203 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.203 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.038995+0000", 2020-11-16T20:56:19.203 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000150631 2020-11-16T20:56:19.203 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.204 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.204 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:19.204 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.039146+0000", 2020-11-16T20:56:19.204 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035641010000000001 2020-11-16T20:56:19.204 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.204 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.204 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:19.204 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.042710+0000", 2020-11-16T20:56:19.205 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011018581 2020-11-16T20:56:19.205 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.205 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.205 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:19.205 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.053729+0000", 2020-11-16T20:56:19.205 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2806000000000006e-05 2020-11-16T20:56:19.205 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.206 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.206 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:19.206 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.053812+0000", 2020-11-16T20:56:19.206 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3730000000000003e-05 2020-11-16T20:56:19.206 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.206 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.206 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.206 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.053855+0000", 2020-11-16T20:56:19.207 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1983e-05 2020-11-16T20:56:19.207 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.207 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.207 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.207 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.053907+0000", 2020-11-16T20:56:19.207 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032459158000000002 2020-11-16T20:56:19.207 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.208 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.208 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.208 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.208 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.208 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2419 4.2 4:724a4144:::smithi16641208-153:head [write 2772623~84666] snapc 7=[7,5] ondisk+write+known_if_redirected e46)", 2020-11-16T20:56:19.208 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.026339+0000", 2020-11-16T20:56:19.208 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.9975088749999994, 2020-11-16T20:56:19.208 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.02778197, 2020-11-16T20:56:19.209 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.209 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.209 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:19.209 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:19.209 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:19.209 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2419 2020-11-16T20:56:19.209 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.209 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.210 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.210 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.210 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026339+0000", 2020-11-16T20:56:19.210 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.210 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.210 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.210 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.211 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026339+0000", 2020-11-16T20:56:19.211 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000438381 2020-11-16T20:56:19.211 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.211 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.211 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.211 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026777+0000", 2020-11-16T20:56:19.211 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6909999999999997e-06 2020-11-16T20:56:19.211 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.212 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.212 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.212 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026785+0000", 2020-11-16T20:56:19.212 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2333e-05 2020-11-16T20:56:19.212 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.212 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.212 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.213 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026797+0000", 2020-11-16T20:56:19.213 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0769999999999996e-06 2020-11-16T20:56:19.213 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.213 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.213 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.213 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026803+0000", 2020-11-16T20:56:19.213 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0915999999999999e-05 2020-11-16T20:56:19.213 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.214 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.214 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.214 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026844+0000", 2020-11-16T20:56:19.214 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9409e-05 2020-11-16T20:56:19.214 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.214 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.214 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:19.215 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026904+0000", 2020-11-16T20:56:19.215 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013496961 2020-11-16T20:56:19.215 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.215 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.215 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.215 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.040401+0000", 2020-11-16T20:56:19.215 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000107769 2020-11-16T20:56:19.215 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.216 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.216 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.216 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.040508+0000", 2020-11-16T20:56:19.216 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015488500000000001 2020-11-16T20:56:19.216 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.216 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.216 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:19.217 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.040663+0000", 2020-11-16T20:56:19.217 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0020556089999999999 2020-11-16T20:56:19.217 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.217 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.217 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:19.217 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.042719+0000", 2020-11-16T20:56:19.217 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011058805 2020-11-16T20:56:19.217 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.218 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.218 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:19.218 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.053778+0000", 2020-11-16T20:56:19.218 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00025737699999999999 2020-11-16T20:56:19.218 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.218 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.218 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:19.218 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.054035+0000", 2020-11-16T20:56:19.219 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1175999999999999e-05 2020-11-16T20:56:19.219 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.219 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.219 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.219 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.054086+0000", 2020-11-16T20:56:19.219 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4581e-05 2020-11-16T20:56:19.219 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.220 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.220 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.220 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.054121+0000", 2020-11-16T20:56:19.220 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.02778197 2020-11-16T20:56:19.220 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.220 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.220 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.220 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.221 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.221 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2420 4.2 4:724a4144:::smithi16641208-153:head [setxattr _header (57) in=7b,truncate 2857289] snapc 7=[7,5] ondisk+write+known_if_redirected e46)", 2020-11-16T20:56:19.221 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.026844+0000", 2020-11-16T20:56:19.221 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.9970040620000002, 2020-11-16T20:56:19.221 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027470980999999998, 2020-11-16T20:56:19.221 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.221 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.222 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:19.222 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:19.222 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:19.222 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2420 2020-11-16T20:56:19.222 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.222 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.222 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.222 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.223 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026844+0000", 2020-11-16T20:56:19.223 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.223 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.223 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.223 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.223 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026844+0000", 2020-11-16T20:56:19.223 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2929999999999997e-05 2020-11-16T20:56:19.224 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.224 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.224 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.224 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026886+0000", 2020-11-16T20:56:19.224 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5990000000000001e-06 2020-11-16T20:56:19.224 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.224 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.224 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.225 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026892+0000", 2020-11-16T20:56:19.225 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0091e-05 2020-11-16T20:56:19.225 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.225 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.225 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.225 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026902+0000", 2020-11-16T20:56:19.225 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2870000000000004e-06 2020-11-16T20:56:19.226 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.226 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.226 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.226 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026907+0000", 2020-11-16T20:56:19.226 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9246999999999995e-05 2020-11-16T20:56:19.226 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.226 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.226 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.227 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026987+0000", 2020-11-16T20:56:19.227 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5386e-05 2020-11-16T20:56:19.227 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.227 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.227 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:19.227 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.027052+0000", 2020-11-16T20:56:19.227 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014205850000000001 2020-11-16T20:56:19.227 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.228 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.228 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.228 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.041258+0000", 2020-11-16T20:56:19.228 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016296600000000001 2020-11-16T20:56:19.228 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.228 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.228 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.229 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.041421+0000", 2020-11-16T20:56:19.229 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000169118 2020-11-16T20:56:19.229 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.229 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.229 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:56:19.229 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.041590+0000", 2020-11-16T20:56:19.229 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0011468590000000001 2020-11-16T20:56:19.229 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.230 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.230 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:19.230 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.042737+0000", 2020-11-16T20:56:19.230 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011235906 2020-11-16T20:56:19.230 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.230 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.230 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:19.231 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.053973+0000", 2020-11-16T20:56:19.231 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000205262 2020-11-16T20:56:19.231 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.231 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.231 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:19.231 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.054178+0000", 2020-11-16T20:56:19.231 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2368999999999998e-05 2020-11-16T20:56:19.231 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.232 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.232 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.232 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.054250+0000", 2020-11-16T20:56:19.232 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4110999999999997e-05 2020-11-16T20:56:19.232 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.232 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.232 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.233 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.054315+0000", 2020-11-16T20:56:19.233 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027470980999999998 2020-11-16T20:56:19.233 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.233 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.233 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.233 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.233 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.233 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2421 4.2 4:724a4144:::smithi16641208-153:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e46)", 2020-11-16T20:56:19.234 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.026947+0000", 2020-11-16T20:56:19.234 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.9969005899999992, 2020-11-16T20:56:19.234 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027770521999999999, 2020-11-16T20:56:19.234 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.234 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:19.234 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:19.234 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:19.235 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:19.235 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2421 2020-11-16T20:56:19.235 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.235 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.235 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.235 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.235 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026947+0000", 2020-11-16T20:56:19.235 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.236 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.236 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.236 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.236 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026947+0000", 2020-11-16T20:56:19.236 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9481000000000001e-05 2020-11-16T20:56:19.236 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.236 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.236 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.237 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026977+0000", 2020-11-16T20:56:19.237 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8000000000000004e-06 2020-11-16T20:56:19.237 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.237 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.237 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.237 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026982+0000", 2020-11-16T20:56:19.237 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1068e-05 2020-11-16T20:56:19.238 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.238 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.238 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.238 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026993+0000", 2020-11-16T20:56:19.238 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8620000000000002e-06 2020-11-16T20:56:19.238 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.238 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.238 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.239 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026998+0000", 2020-11-16T20:56:19.239 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.0631999999999996e-05 2020-11-16T20:56:19.239 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.239 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.239 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.239 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.027079+0000", 2020-11-16T20:56:19.239 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6573000000000002e-05 2020-11-16T20:56:19.239 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.240 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.240 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:19.240 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.027135+0000", 2020-11-16T20:56:19.240 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014786033000000001 2020-11-16T20:56:19.240 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.240 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.240 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.241 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.041921+0000", 2020-11-16T20:56:19.241 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1741000000000003e-05 2020-11-16T20:56:19.241 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.241 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.241 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:19.241 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.041993+0000", 2020-11-16T20:56:19.241 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01234825 2020-11-16T20:56:19.241 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.242 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.242 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.242 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.054341+0000", 2020-11-16T20:56:19.242 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000106609 2020-11-16T20:56:19.242 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.242 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.242 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.243 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.054448+0000", 2020-11-16T20:56:19.243 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000269473 2020-11-16T20:56:19.243 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.243 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.243 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.243 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.054718+0000", 2020-11-16T20:56:19.243 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027770521999999999 2020-11-16T20:56:19.243 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.244 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.244 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.244 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.244 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.244 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:19.245 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:56:19.246 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:19.250+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:19.346 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:19.350+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:19.372 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:19.372 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:19.372 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:56:19.372 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:19.381 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:56:19.447 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:19.451+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:19.546 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:19.546 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:19.546 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:56:19.546 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:56:19.546 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:19.548 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:19.552+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:19.555 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:56:19.649 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:19.654+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:19.724 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:19.724 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:56:19.724 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:56:19.724 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:56:19.725 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.725 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:170 3.0 e33/19 3:1e260d0e:::smithi16641208-43:head v 33'12, mlcod=33'10)", 2020-11-16T20:56:19.725 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.458057+0000", 2020-11-16T20:56:19.725 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 28.269962009, 2020-11-16T20:56:19.725 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040611839999999998, 2020-11-16T20:56:19.725 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.725 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.726 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.726 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.726 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.726 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458057+0000", 2020-11-16T20:56:19.726 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.726 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.726 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.727 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.727 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458057+0000", 2020-11-16T20:56:19.727 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000227333 2020-11-16T20:56:19.727 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.727 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.727 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.727 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458284+0000", 2020-11-16T20:56:19.728 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8389999999999996e-06 2020-11-16T20:56:19.728 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.728 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.728 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.728 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458293+0000", 2020-11-16T20:56:19.728 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9907999999999998e-05 2020-11-16T20:56:19.728 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.728 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.729 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.729 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458333+0000", 2020-11-16T20:56:19.729 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2132e-05 2020-11-16T20:56:19.729 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.729 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.729 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.729 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458345+0000", 2020-11-16T20:56:19.730 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0157000000000001e-05 2020-11-16T20:56:19.730 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.730 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.730 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.730 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458395+0000", 2020-11-16T20:56:19.730 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6659e-05 2020-11-16T20:56:19.730 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.731 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.731 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.731 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458422+0000", 2020-11-16T20:56:19.731 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0036338049999999999 2020-11-16T20:56:19.731 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.731 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.731 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.731 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.462056+0000", 2020-11-16T20:56:19.732 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2351e-05 2020-11-16T20:56:19.732 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.732 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.732 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.732 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.462118+0000", 2020-11-16T20:56:19.732 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040611839999999998 2020-11-16T20:56:19.732 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.733 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.733 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.733 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.733 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.733 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:890 3.0 e35/19 3:2209b6da:::smithi16641208-202:head v 35'131, mlcod=35'129)", 2020-11-16T20:56:19.733 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.078620+0000", 2020-11-16T20:56:19.733 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 25.649398964, 2020-11-16T20:56:19.734 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039687519999999999, 2020-11-16T20:56:19.734 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.734 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.734 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.734 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.734 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.734 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078620+0000", 2020-11-16T20:56:19.734 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.735 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.735 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.735 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.735 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078620+0000", 2020-11-16T20:56:19.735 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018733000000000001 2020-11-16T20:56:19.735 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.735 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.736 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.736 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078807+0000", 2020-11-16T20:56:19.736 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9799999999999993e-06 2020-11-16T20:56:19.736 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.736 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.736 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.736 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078817+0000", 2020-11-16T20:56:19.736 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5116000000000001e-05 2020-11-16T20:56:19.737 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.737 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.737 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.737 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078832+0000", 2020-11-16T20:56:19.737 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2634e-05 2020-11-16T20:56:19.737 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.737 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.738 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.738 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078845+0000", 2020-11-16T20:56:19.738 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1001999999999997e-05 2020-11-16T20:56:19.738 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.738 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.738 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.738 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078896+0000", 2020-11-16T20:56:19.739 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5238000000000001e-05 2020-11-16T20:56:19.739 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.739 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.739 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.739 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.078921+0000", 2020-11-16T20:56:19.739 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035949210000000001 2020-11-16T20:56:19.739 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.739 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.740 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.740 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.082516+0000", 2020-11-16T20:56:19.740 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2531000000000001e-05 2020-11-16T20:56:19.740 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.740 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.740 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.740 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.082588+0000", 2020-11-16T20:56:19.741 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039687519999999999 2020-11-16T20:56:19.741 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.741 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.741 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.741 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.741 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.741 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:901 3.0 e35/19 3:29e07ad2:::smithi16641208-204:head v 35'134, mlcod=35'132)", 2020-11-16T20:56:19.742 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.128152+0000", 2020-11-16T20:56:19.742 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 25.599866751, 2020-11-16T20:56:19.742 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042710120000000002, 2020-11-16T20:56:19.742 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.742 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.742 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.742 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.742 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.743 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128152+0000", 2020-11-16T20:56:19.743 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.743 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.743 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.743 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.743 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128152+0000", 2020-11-16T20:56:19.743 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019783600000000001 2020-11-16T20:56:19.744 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.744 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.744 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.744 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128350+0000", 2020-11-16T20:56:19.744 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6030000000000005e-06 2020-11-16T20:56:19.744 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.744 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.744 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.745 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128358+0000", 2020-11-16T20:56:19.745 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2595999999999999e-05 2020-11-16T20:56:19.745 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.745 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.745 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.745 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128371+0000", 2020-11-16T20:56:19.745 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3209999999999999e-06 2020-11-16T20:56:19.746 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.746 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.746 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.746 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128378+0000", 2020-11-16T20:56:19.746 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4047e-05 2020-11-16T20:56:19.746 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.746 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.747 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.747 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128422+0000", 2020-11-16T20:56:19.747 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9796000000000001e-05 2020-11-16T20:56:19.747 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.747 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.747 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.747 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128452+0000", 2020-11-16T20:56:19.747 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039150929999999997 2020-11-16T20:56:19.748 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.748 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.748 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.748 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.132367+0000", 2020-11-16T20:56:19.748 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5720000000000002e-05 2020-11-16T20:56:19.748 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.748 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.749 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.749 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.132423+0000", 2020-11-16T20:56:19.749 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042710120000000002 2020-11-16T20:56:19.749 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.749 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.750 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.750 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.750 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.750 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1028 3.0 e35/19 3:2e3eb594:::smithi16641208-229:head v 35'159, mlcod=35'157)", 2020-11-16T20:56:19.750 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.635550+0000", 2020-11-16T20:56:19.750 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 25.092468309000001, 2020-11-16T20:56:19.750 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042338380000000002, 2020-11-16T20:56:19.751 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.751 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.751 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.751 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.751 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.751 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635550+0000", 2020-11-16T20:56:19.751 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.751 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.752 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.752 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.752 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635550+0000", 2020-11-16T20:56:19.752 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018653699999999999 2020-11-16T20:56:19.752 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.752 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.752 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.753 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635737+0000", 2020-11-16T20:56:19.753 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.037e-06 2020-11-16T20:56:19.753 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.753 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.753 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.753 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635746+0000", 2020-11-16T20:56:19.753 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3001e-05 2020-11-16T20:56:19.754 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.754 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.754 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.754 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635759+0000", 2020-11-16T20:56:19.754 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7740000000000004e-06 2020-11-16T20:56:19.754 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.754 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.755 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.755 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635767+0000", 2020-11-16T20:56:19.755 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1385999999999999e-05 2020-11-16T20:56:19.755 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.755 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.755 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.755 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635818+0000", 2020-11-16T20:56:19.755 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6427e-05 2020-11-16T20:56:19.756 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.756 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.756 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.756 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635845+0000", 2020-11-16T20:56:19.756 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003885164 2020-11-16T20:56:19.756 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.756 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.757 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.757 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.639730+0000", 2020-11-16T20:56:19.757 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4512000000000003e-05 2020-11-16T20:56:19.757 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.757 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.757 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.757 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.639784+0000", 2020-11-16T20:56:19.757 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042338380000000002 2020-11-16T20:56:19.758 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.758 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.758 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.758 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.758 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.758 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1037 3.0 e35/19 3:0fda7169:::smithi16641208-231:head v 35'162, mlcod=35'160)", 2020-11-16T20:56:19.758 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.671040+0000", 2020-11-16T20:56:19.759 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 25.056978820000001, 2020-11-16T20:56:19.759 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040297739999999999, 2020-11-16T20:56:19.759 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.759 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.759 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.759 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.759 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.759 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671040+0000", 2020-11-16T20:56:19.760 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.760 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.760 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.760 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.760 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671040+0000", 2020-11-16T20:56:19.760 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012993299999999999 2020-11-16T20:56:19.760 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.761 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.761 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.761 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671170+0000", 2020-11-16T20:56:19.761 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9879999999999999e-06 2020-11-16T20:56:19.761 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.761 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.761 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.761 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671180+0000", 2020-11-16T20:56:19.762 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0243e-05 2020-11-16T20:56:19.762 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.762 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.762 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.762 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671190+0000", 2020-11-16T20:56:19.762 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4890000000000003e-06 2020-11-16T20:56:19.762 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.763 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.763 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.763 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671196+0000", 2020-11-16T20:56:19.763 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9298999999999997e-05 2020-11-16T20:56:19.763 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.763 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.763 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.764 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671245+0000", 2020-11-16T20:56:19.764 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4561000000000001e-05 2020-11-16T20:56:19.764 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.764 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.764 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.764 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.671269+0000", 2020-11-16T20:56:19.764 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037448540000000002 2020-11-16T20:56:19.764 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.765 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.765 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.765 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.675014+0000", 2020-11-16T20:56:19.765 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5407e-05 2020-11-16T20:56:19.765 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.765 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.765 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.766 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.675070+0000", 2020-11-16T20:56:19.766 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040297739999999999 2020-11-16T20:56:19.766 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.766 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.766 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.766 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.766 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.767 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1102 3.0 e35/19 3:1c1ecb34:::smithi16641208-245:head v 35'172, mlcod=35'170)", 2020-11-16T20:56:19.767 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.920148+0000", 2020-11-16T20:56:19.767 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 24.807870424000001, 2020-11-16T20:56:19.767 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053854699999999998, 2020-11-16T20:56:19.767 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.767 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.767 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.767 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.768 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.768 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920148+0000", 2020-11-16T20:56:19.768 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.768 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.768 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.768 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.768 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920148+0000", 2020-11-16T20:56:19.769 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019421400000000001 2020-11-16T20:56:19.769 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.769 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.769 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.769 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920342+0000", 2020-11-16T20:56:19.769 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6169999999999996e-06 2020-11-16T20:56:19.769 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.769 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.770 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.770 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920352+0000", 2020-11-16T20:56:19.770 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3684e-05 2020-11-16T20:56:19.770 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.770 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.770 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.770 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920366+0000", 2020-11-16T20:56:19.771 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7789999999999996e-06 2020-11-16T20:56:19.771 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.771 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.771 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.771 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920374+0000", 2020-11-16T20:56:19.771 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8783999999999995e-05 2020-11-16T20:56:19.771 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.771 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.772 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.772 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920472+0000", 2020-11-16T20:56:19.772 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6865000000000001e-05 2020-11-16T20:56:19.772 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.772 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.772 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.772 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920499+0000", 2020-11-16T20:56:19.773 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004975246 2020-11-16T20:56:19.773 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.773 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.773 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.773 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.925474+0000", 2020-11-16T20:56:19.773 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9280999999999997e-05 2020-11-16T20:56:19.773 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.773 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.774 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.774 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.925534+0000", 2020-11-16T20:56:19.774 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053854699999999998 2020-11-16T20:56:19.774 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.774 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.774 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.774 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.775 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.775 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1198 3.0 e35/19 3:1b4407ea:::smithi16641208-269:head v 35'184, mlcod=35'182)", 2020-11-16T20:56:19.775 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.231667+0000", 2020-11-16T20:56:19.775 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 24.496351266000001, 2020-11-16T20:56:19.775 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041081770000000002, 2020-11-16T20:56:19.775 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.775 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.775 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.776 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.776 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.776 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231667+0000", 2020-11-16T20:56:19.776 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.776 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.776 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.776 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.777 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231667+0000", 2020-11-16T20:56:19.777 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018666399999999999 2020-11-16T20:56:19.777 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.777 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.777 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.777 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231854+0000", 2020-11-16T20:56:19.777 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.152e-05 2020-11-16T20:56:19.777 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.778 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.778 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.778 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231866+0000", 2020-11-16T20:56:19.778 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2456000000000002e-05 2020-11-16T20:56:19.778 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.778 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.778 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.779 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231898+0000", 2020-11-16T20:56:19.779 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6789999999999994e-06 2020-11-16T20:56:19.779 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.779 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.779 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.779 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231907+0000", 2020-11-16T20:56:19.779 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0732999999999997e-05 2020-11-16T20:56:19.780 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.780 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.780 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.780 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231957+0000", 2020-11-16T20:56:19.780 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9028000000000001e-05 2020-11-16T20:56:19.780 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.780 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.780 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.781 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231987+0000", 2020-11-16T20:56:19.781 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037323830000000001 2020-11-16T20:56:19.781 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.781 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.781 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.781 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.235719+0000", 2020-11-16T20:56:19.781 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6713999999999999e-05 2020-11-16T20:56:19.782 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.782 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.782 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.782 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.235776+0000", 2020-11-16T20:56:19.782 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041081770000000002 2020-11-16T20:56:19.782 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.782 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.782 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.783 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.783 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.783 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1235 3.0 e35/19 3:2294fced:::smithi16641208-278:head v 35'188, mlcod=35'185)", 2020-11-16T20:56:19.783 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.354799+0000", 2020-11-16T20:56:19.783 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 24.373219311, 2020-11-16T20:56:19.783 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050791389999999999, 2020-11-16T20:56:19.783 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.784 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.784 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.784 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.784 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.784 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354799+0000", 2020-11-16T20:56:19.784 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.784 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.785 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.785 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.785 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354799+0000", 2020-11-16T20:56:19.785 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2141000000000002e-05 2020-11-16T20:56:19.785 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.785 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.785 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.785 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354842+0000", 2020-11-16T20:56:19.786 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.601e-06 2020-11-16T20:56:19.786 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.786 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.786 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.786 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354848+0000", 2020-11-16T20:56:19.786 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.028e-05 2020-11-16T20:56:19.786 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.787 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.787 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.787 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354858+0000", 2020-11-16T20:56:19.787 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2959999999999998e-06 2020-11-16T20:56:19.787 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.787 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.787 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.787 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354864+0000", 2020-11-16T20:56:19.788 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3279999999999999e-05 2020-11-16T20:56:19.788 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.788 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.788 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.788 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354907+0000", 2020-11-16T20:56:19.788 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3655e-05 2020-11-16T20:56:19.788 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.789 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.789 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.789 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354931+0000", 2020-11-16T20:56:19.789 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004888875 2020-11-16T20:56:19.789 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.789 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.789 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.789 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.359820+0000", 2020-11-16T20:56:19.790 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9011000000000001e-05 2020-11-16T20:56:19.790 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.790 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.790 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.790 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.359879+0000", 2020-11-16T20:56:19.790 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050791389999999999 2020-11-16T20:56:19.790 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.791 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.791 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.791 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.791 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.791 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1237 3.0 e35/19 3:0b7cd9c0:::smithi16641208-279:head v 35'189, mlcod=35'187)", 2020-11-16T20:56:19.791 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.361967+0000", 2020-11-16T20:56:19.791 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 24.366052068999998, 2020-11-16T20:56:19.791 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041733320000000001, 2020-11-16T20:56:19.792 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.792 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.792 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.792 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.792 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.792 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.361967+0000", 2020-11-16T20:56:19.792 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.793 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.793 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.793 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.793 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.361967+0000", 2020-11-16T20:56:19.793 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045453300000000002 2020-11-16T20:56:19.793 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.793 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.793 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.794 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362421+0000", 2020-11-16T20:56:19.794 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1178999999999999e-05 2020-11-16T20:56:19.794 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.794 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.794 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.794 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362432+0000", 2020-11-16T20:56:19.794 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5865000000000001e-05 2020-11-16T20:56:19.795 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.795 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.795 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.795 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362448+0000", 2020-11-16T20:56:19.795 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9809999999999992e-06 2020-11-16T20:56:19.795 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.795 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.796 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.796 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362457+0000", 2020-11-16T20:56:19.796 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9304e-05 2020-11-16T20:56:19.796 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.796 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.796 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.796 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362516+0000", 2020-11-16T20:56:19.796 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2886000000000003e-05 2020-11-16T20:56:19.797 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.797 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.797 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.797 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362549+0000", 2020-11-16T20:56:19.797 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035249809999999999 2020-11-16T20:56:19.797 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.797 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.798 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.366074+0000", 2020-11-16T20:56:19.798 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5603000000000002e-05 2020-11-16T20:56:19.798 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.798 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.798 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.366140+0000", 2020-11-16T20:56:19.798 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041733320000000001 2020-11-16T20:56:19.799 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.799 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.799 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.799 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.799 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.799 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1262 3.0 e35/19 3:393883c7:::smithi16641208-285:head v 35'196, mlcod=35'194)", 2020-11-16T20:56:19.799 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.455617+0000", 2020-11-16T20:56:19.800 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 24.272402030999999, 2020-11-16T20:56:19.800 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039170029999999996, 2020-11-16T20:56:19.800 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.800 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.800 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.800 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.800 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.800 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455617+0000", 2020-11-16T20:56:19.801 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.801 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.801 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.801 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.801 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455617+0000", 2020-11-16T20:56:19.801 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00021765099999999999 2020-11-16T20:56:19.801 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.802 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.802 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.802 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455834+0000", 2020-11-16T20:56:19.802 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.296e-05 2020-11-16T20:56:19.802 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.802 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.802 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.802 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455847+0000", 2020-11-16T20:56:19.803 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2149e-05 2020-11-16T20:56:19.803 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.803 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.803 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.803 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455859+0000", 2020-11-16T20:56:19.803 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7663e-05 2020-11-16T20:56:19.803 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.804 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.804 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.804 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455877+0000", 2020-11-16T20:56:19.804 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6128000000000003e-05 2020-11-16T20:56:19.804 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.804 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.804 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.805 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455923+0000", 2020-11-16T20:56:19.805 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8368999999999999e-05 2020-11-16T20:56:19.805 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.805 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.805 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.805 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.455952+0000", 2020-11-16T20:56:19.805 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035271780000000002 2020-11-16T20:56:19.805 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.806 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.806 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.806 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.459479+0000", 2020-11-16T20:56:19.806 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4904999999999997e-05 2020-11-16T20:56:19.806 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.806 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.806 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.807 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.459534+0000", 2020-11-16T20:56:19.807 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039170029999999996 2020-11-16T20:56:19.807 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.807 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.807 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.807 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.807 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.807 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1273 3.0 e35/19 3:2e8bdc7f:::smithi16641208-288:head v 35'198, mlcod=35'196)", 2020-11-16T20:56:19.808 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.489833+0000", 2020-11-16T20:56:19.808 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 24.238185797, 2020-11-16T20:56:19.808 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039382189999999997, 2020-11-16T20:56:19.808 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.808 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.808 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.808 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.809 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.809 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.489833+0000", 2020-11-16T20:56:19.809 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.809 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.809 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.809 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.809 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.489833+0000", 2020-11-16T20:56:19.809 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000194852 2020-11-16T20:56:19.810 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.810 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.810 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.810 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.490028+0000", 2020-11-16T20:56:19.810 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1319e-05 2020-11-16T20:56:19.810 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.810 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.811 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.811 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.490039+0000", 2020-11-16T20:56:19.811 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5579000000000001e-05 2020-11-16T20:56:19.811 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.811 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.811 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.811 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.490055+0000", 2020-11-16T20:56:19.811 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9619999999999999e-06 2020-11-16T20:56:19.812 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.812 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.812 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.812 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.490064+0000", 2020-11-16T20:56:19.812 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5654e-05 2020-11-16T20:56:19.812 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.812 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.813 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.813 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.490109+0000", 2020-11-16T20:56:19.813 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.472e-05 2020-11-16T20:56:19.813 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.813 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.813 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.813 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.490134+0000", 2020-11-16T20:56:19.813 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035931819999999999 2020-11-16T20:56:19.814 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.814 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.814 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.814 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.493727+0000", 2020-11-16T20:56:19.814 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3951e-05 2020-11-16T20:56:19.814 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.814 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.815 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.815 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.493771+0000", 2020-11-16T20:56:19.815 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039382189999999997 2020-11-16T20:56:19.815 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.815 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.815 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.815 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.816 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.816 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1423 3.0 e36/19 3:1e5364a0:::smithi16641208-320:head v 36'221, mlcod=35'219)", 2020-11-16T20:56:19.816 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.033789+0000", 2020-11-16T20:56:19.816 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 23.694229678999999, 2020-11-16T20:56:19.816 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041251339999999999, 2020-11-16T20:56:19.816 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.816 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.816 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.817 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.817 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.817 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033789+0000", 2020-11-16T20:56:19.817 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.817 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.817 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.817 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.818 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033789+0000", 2020-11-16T20:56:19.818 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015644000000000001 2020-11-16T20:56:19.818 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.818 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.818 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.818 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033945+0000", 2020-11-16T20:56:19.818 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0270000000000003e-06 2020-11-16T20:56:19.819 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.819 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.819 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.819 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033950+0000", 2020-11-16T20:56:19.819 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6420000000000007e-06 2020-11-16T20:56:19.819 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.819 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.819 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.820 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033958+0000", 2020-11-16T20:56:19.820 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.477e-06 2020-11-16T20:56:19.820 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.820 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.820 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.820 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033965+0000", 2020-11-16T20:56:19.820 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9178999999999998e-05 2020-11-16T20:56:19.820 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.821 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.821 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.821 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.034014+0000", 2020-11-16T20:56:19.821 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2172e-05 2020-11-16T20:56:19.821 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.821 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.821 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.822 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.034036+0000", 2020-11-16T20:56:19.822 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0038237190000000002 2020-11-16T20:56:19.822 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.822 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.822 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.822 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.037860+0000", 2020-11-16T20:56:19.822 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4478000000000003e-05 2020-11-16T20:56:19.822 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.823 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.823 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.823 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.037914+0000", 2020-11-16T20:56:19.823 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041251339999999999 2020-11-16T20:56:19.823 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.823 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.823 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.824 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.824 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.824 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1468 3.0 e36/19 3:1852173c:::smithi16641208-329:head v 36'238, mlcod=36'236)", 2020-11-16T20:56:19.824 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.208167+0000", 2020-11-16T20:56:19.824 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 23.519851904999999, 2020-11-16T20:56:19.824 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052481979999999999, 2020-11-16T20:56:19.824 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.824 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.825 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.825 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.825 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.825 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208167+0000", 2020-11-16T20:56:19.825 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.825 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.825 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.826 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.826 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208167+0000", 2020-11-16T20:56:19.826 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013521900000000001 2020-11-16T20:56:19.826 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.826 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.826 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.826 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208302+0000", 2020-11-16T20:56:19.826 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1307e-05 2020-11-16T20:56:19.827 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.827 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.827 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.827 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208313+0000", 2020-11-16T20:56:19.827 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2828e-05 2020-11-16T20:56:19.827 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.827 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.828 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.828 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208326+0000", 2020-11-16T20:56:19.828 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8889999999999996e-06 2020-11-16T20:56:19.828 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.828 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.828 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.828 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208333+0000", 2020-11-16T20:56:19.828 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2843999999999999e-05 2020-11-16T20:56:19.829 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.829 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.829 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.829 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208366+0000", 2020-11-16T20:56:19.829 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4986e-05 2020-11-16T20:56:19.829 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.829 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.830 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.830 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208381+0000", 2020-11-16T20:56:19.830 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0049810990000000001 2020-11-16T20:56:19.830 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.830 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.830 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.830 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.213362+0000", 2020-11-16T20:56:19.831 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3025999999999997e-05 2020-11-16T20:56:19.831 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.831 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.831 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.831 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.213415+0000", 2020-11-16T20:56:19.831 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052481979999999999 2020-11-16T20:56:19.831 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.831 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.832 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.832 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.832 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.832 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1490 3.0 e36/19 3:10845e0e:::smithi16641208-333:head v 36'252, mlcod=36'250)", 2020-11-16T20:56:19.832 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.301912+0000", 2020-11-16T20:56:19.832 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 23.426106903000001, 2020-11-16T20:56:19.832 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044835179999999997, 2020-11-16T20:56:19.833 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.833 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.833 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.833 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.833 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.833 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.301912+0000", 2020-11-16T20:56:19.833 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.833 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.834 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.834 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.834 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.301912+0000", 2020-11-16T20:56:19.834 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114265 2020-11-16T20:56:19.834 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.834 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.834 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.835 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302026+0000", 2020-11-16T20:56:19.835 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7940000000000008e-06 2020-11-16T20:56:19.835 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.835 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.835 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.835 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302035+0000", 2020-11-16T20:56:19.835 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5187e-05 2020-11-16T20:56:19.835 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.836 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.836 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.836 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302050+0000", 2020-11-16T20:56:19.836 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.653e-06 2020-11-16T20:56:19.836 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.836 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.836 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.837 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302059+0000", 2020-11-16T20:56:19.837 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8010000000000003e-05 2020-11-16T20:56:19.837 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.837 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.837 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.837 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302107+0000", 2020-11-16T20:56:19.837 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5335000000000001e-05 2020-11-16T20:56:19.837 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.838 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.838 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.838 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302132+0000", 2020-11-16T20:56:19.838 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042049239999999996 2020-11-16T20:56:19.838 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.838 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.838 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.839 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.306337+0000", 2020-11-16T20:56:19.839 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8350000000000002e-05 2020-11-16T20:56:19.839 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.839 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.839 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.839 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.306395+0000", 2020-11-16T20:56:19.839 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044835179999999997 2020-11-16T20:56:19.840 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.840 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.840 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.840 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.840 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.840 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1491 3.0 e36/19 3:10845e0e:::smithi16641208-333:head v 36'253, mlcod=36'250)", 2020-11-16T20:56:19.840 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.302814+0000", 2020-11-16T20:56:19.840 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 23.425204741999998, 2020-11-16T20:56:19.841 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039006700000000002, 2020-11-16T20:56:19.841 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.841 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.841 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.841 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.841 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.841 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302814+0000", 2020-11-16T20:56:19.842 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.842 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.842 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.842 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.842 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302814+0000", 2020-11-16T20:56:19.842 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5510999999999998e-05 2020-11-16T20:56:19.842 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.842 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.843 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.843 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302859+0000", 2020-11-16T20:56:19.843 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3980000000000002e-06 2020-11-16T20:56:19.843 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.843 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.843 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.843 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302867+0000", 2020-11-16T20:56:19.844 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0713999999999999e-05 2020-11-16T20:56:19.844 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.844 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.844 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.844 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302878+0000", 2020-11-16T20:56:19.844 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7679999999999997e-06 2020-11-16T20:56:19.844 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.844 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.845 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.845 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302883+0000", 2020-11-16T20:56:19.845 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0617000000000001e-05 2020-11-16T20:56:19.845 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.845 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.845 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.845 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302924+0000", 2020-11-16T20:56:19.846 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4732999999999999e-05 2020-11-16T20:56:19.846 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.846 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.846 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.846 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302949+0000", 2020-11-16T20:56:19.846 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037127919999999999 2020-11-16T20:56:19.846 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.847 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.847 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.847 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.306661+0000", 2020-11-16T20:56:19.847 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3137000000000003e-05 2020-11-16T20:56:19.847 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.847 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.847 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.847 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.306715+0000", 2020-11-16T20:56:19.848 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039006700000000002 2020-11-16T20:56:19.848 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.848 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.848 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.848 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.848 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.848 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:534 3.0 e46/19 3:10845e0e:::smithi16641208-333:5 v 46'391, mlcod=45'385)", 2020-11-16T20:56:19.848 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.013124+0000", 2020-11-16T20:56:19.849 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.714894331, 2020-11-16T20:56:19.849 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050053900000000002, 2020-11-16T20:56:19.849 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.849 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.849 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.849 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.849 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.850 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013124+0000", 2020-11-16T20:56:19.850 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.850 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.850 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.850 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.850 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013124+0000", 2020-11-16T20:56:19.850 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9255999999999997e-05 2020-11-16T20:56:19.851 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.851 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.851 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.851 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013174+0000", 2020-11-16T20:56:19.851 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5140000000000004e-06 2020-11-16T20:56:19.851 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.851 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.851 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.852 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013181+0000", 2020-11-16T20:56:19.852 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1279e-05 2020-11-16T20:56:19.852 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.852 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.852 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.852 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013192+0000", 2020-11-16T20:56:19.852 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0970000000000002e-06 2020-11-16T20:56:19.853 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.853 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.853 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.853 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013199+0000", 2020-11-16T20:56:19.853 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5442e-05 2020-11-16T20:56:19.853 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.853 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.853 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.854 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013284+0000", 2020-11-16T20:56:19.854 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8368e-05 2020-11-16T20:56:19.854 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.854 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.854 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.854 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013312+0000", 2020-11-16T20:56:19.854 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0047640549999999997 2020-11-16T20:56:19.855 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.855 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.855 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.855 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.018076+0000", 2020-11-16T20:56:19.855 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3378999999999998e-05 2020-11-16T20:56:19.855 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.855 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.855 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.856 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.018130+0000", 2020-11-16T20:56:19.856 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050053900000000002 2020-11-16T20:56:19.856 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.856 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.856 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.856 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.856 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.857 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:553 3.0 e51/19 3:0980614a:::smithi16641208-158:d v 51'399, mlcod=48'395)", 2020-11-16T20:56:19.857 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.036559+0000", 2020-11-16T20:56:19.857 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.6914592700000002, 2020-11-16T20:56:19.857 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0057593829999999999, 2020-11-16T20:56:19.857 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.857 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.857 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.857 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.858 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.858 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036559+0000", 2020-11-16T20:56:19.858 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.858 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.858 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.858 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.858 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036559+0000", 2020-11-16T20:56:19.859 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3611000000000001e-05 2020-11-16T20:56:19.859 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.859 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.859 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.859 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036593+0000", 2020-11-16T20:56:19.859 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6789999999999996e-06 2020-11-16T20:56:19.859 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.860 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.860 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.860 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036598+0000", 2020-11-16T20:56:19.860 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1350000000000003e-06 2020-11-16T20:56:19.860 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.860 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.860 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.860 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036605+0000", 2020-11-16T20:56:19.861 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5200000000000003e-06 2020-11-16T20:56:19.861 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.861 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.861 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.861 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036611+0000", 2020-11-16T20:56:19.861 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1322000000000001e-05 2020-11-16T20:56:19.861 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.862 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.862 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.862 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036663+0000", 2020-11-16T20:56:19.862 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8333000000000001e-05 2020-11-16T20:56:19.862 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.862 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.862 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.862 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036691+0000", 2020-11-16T20:56:19.863 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0055720800000000001 2020-11-16T20:56:19.863 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.863 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.863 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.863 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.042263+0000", 2020-11-16T20:56:19.863 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5702999999999998e-05 2020-11-16T20:56:19.863 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.864 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.864 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.864 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.042319+0000", 2020-11-16T20:56:19.864 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0057593829999999999 2020-11-16T20:56:19.864 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.864 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.864 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.864 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.865 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.865 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:556 3.0 e51/19 3:03c93966:::smithi16641208-422:e v 51'401, mlcod=48'395)", 2020-11-16T20:56:19.865 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.037559+0000", 2020-11-16T20:56:19.865 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.6904595660000004, 2020-11-16T20:56:19.865 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052553039999999997, 2020-11-16T20:56:19.865 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.865 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.866 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.866 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.866 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.866 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037559+0000", 2020-11-16T20:56:19.866 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.866 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.866 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.867 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.867 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037559+0000", 2020-11-16T20:56:19.867 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2685999999999998e-05 2020-11-16T20:56:19.867 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.867 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.867 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.867 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037592+0000", 2020-11-16T20:56:19.867 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1830000000000002e-06 2020-11-16T20:56:19.868 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.868 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.868 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.868 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037597+0000", 2020-11-16T20:56:19.868 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0809999999999996e-06 2020-11-16T20:56:19.868 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.868 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.869 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.869 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037604+0000", 2020-11-16T20:56:19.869 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.361e-06 2020-11-16T20:56:19.869 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.869 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.869 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.869 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037609+0000", 2020-11-16T20:56:19.869 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00041286099999999999 2020-11-16T20:56:19.870 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.870 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.870 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.870 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.038022+0000", 2020-11-16T20:56:19.870 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4833000000000001e-05 2020-11-16T20:56:19.870 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.870 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.871 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.871 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.038047+0000", 2020-11-16T20:56:19.871 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0047145110000000002 2020-11-16T20:56:19.871 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.871 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.871 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.871 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.042762+0000", 2020-11-16T20:56:19.871 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2787999999999997e-05 2020-11-16T20:56:19.872 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.872 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.872 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.872 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.042814+0000", 2020-11-16T20:56:19.872 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052553039999999997 2020-11-16T20:56:19.872 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.872 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.873 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.873 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.873 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.873 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:559 3.0 e52/19 3:0980614a:::smithi16641208-158:d v 52'405, mlcod=51'401)", 2020-11-16T20:56:19.873 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:15.014239+0000", 2020-11-16T20:56:19.873 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 4.7137796930000002, 2020-11-16T20:56:19.873 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0060540699999999999, 2020-11-16T20:56:19.873 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.874 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.874 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.874 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.874 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.874 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014239+0000", 2020-11-16T20:56:19.874 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.874 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.875 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.875 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.875 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014239+0000", 2020-11-16T20:56:19.875 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1819000000000001e-05 2020-11-16T20:56:19.875 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.875 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.875 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.875 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014281+0000", 2020-11-16T20:56:19.876 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6719999999999998e-06 2020-11-16T20:56:19.876 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.876 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.876 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.876 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014288+0000", 2020-11-16T20:56:19.876 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0564000000000001e-05 2020-11-16T20:56:19.876 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.877 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.877 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.877 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014298+0000", 2020-11-16T20:56:19.877 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1902000000000001e-05 2020-11-16T20:56:19.877 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.877 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.877 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.877 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014310+0000", 2020-11-16T20:56:19.878 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4212999999999997e-05 2020-11-16T20:56:19.878 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.878 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.878 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.878 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014364+0000", 2020-11-16T20:56:19.878 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9425e-05 2020-11-16T20:56:19.878 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.879 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.879 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.879 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014394+0000", 2020-11-16T20:56:19.879 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0058527630000000004 2020-11-16T20:56:19.879 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.879 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.879 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.879 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.020246+0000", 2020-11-16T20:56:19.880 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6712000000000003e-05 2020-11-16T20:56:19.880 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.880 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.880 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.880 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.020293+0000", 2020-11-16T20:56:19.880 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0060540699999999999 2020-11-16T20:56:19.880 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.881 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.881 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.881 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.881 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.881 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:561 3.0 e52/19 3:03c93966:::smithi16641208-422:e v 52'407, mlcod=51'401)", 2020-11-16T20:56:19.881 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:15.015143+0000", 2020-11-16T20:56:19.881 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 4.7128754720000003, 2020-11-16T20:56:19.881 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0073835719999999997, 2020-11-16T20:56:19.882 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:19.882 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:19.882 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:19.882 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.882 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:19.882 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015143+0000", 2020-11-16T20:56:19.882 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:19.883 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.883 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.883 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:19.883 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015143+0000", 2020-11-16T20:56:19.883 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4036999999999999e-05 2020-11-16T20:56:19.883 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.883 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.883 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:19.884 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015187+0000", 2020-11-16T20:56:19.884 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8350000000000004e-06 2020-11-16T20:56:19.884 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.884 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.884 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:19.884 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015195+0000", 2020-11-16T20:56:19.884 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1216999999999999e-05 2020-11-16T20:56:19.885 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.885 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.885 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:19.885 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015206+0000", 2020-11-16T20:56:19.885 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9390000000000002e-06 2020-11-16T20:56:19.885 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.885 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.885 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:19.886 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015212+0000", 2020-11-16T20:56:19.886 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.066e-05 2020-11-16T20:56:19.886 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.886 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.886 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:19.886 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015253+0000", 2020-11-16T20:56:19.886 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1534000000000001e-05 2020-11-16T20:56:19.887 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.887 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.887 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:19.887 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015274+0000", 2020-11-16T20:56:19.887 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0072086629999999997 2020-11-16T20:56:19.887 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.887 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.887 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:19.888 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.022483+0000", 2020-11-16T20:56:19.888 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3686999999999997e-05 2020-11-16T20:56:19.888 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:19.888 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:19.888 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:19.888 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.022527+0000", 2020-11-16T20:56:19.888 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0073835719999999997 2020-11-16T20:56:19.889 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.889 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.889 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.889 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:19.889 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:19.889 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:19.892 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:56:19.892 INFO:tasks.rados.rados.0.smithi166.stdout:653: done (0 left) 2020-11-16T20:56:19.893 INFO:tasks.rados.rados.0.smithi166.stdout:654: write oid 340 current snap is 12 2020-11-16T20:56:19.893 INFO:tasks.rados.rados.0.smithi166.stdout:654: seq_num 545 ranges {759815=471768,1742451=465507,2917178=242637} 2020-11-16T20:56:19.893 INFO:tasks.rados.rados.0.smithi166.stdout:654: writing smithi16641208-340 from 759815 to 1231583 tid 1 2020-11-16T20:56:19.893 INFO:tasks.rados.rados.0.smithi166.stdout:654: writing smithi16641208-340 from 1742451 to 2207958 tid 2 2020-11-16T20:56:19.893 INFO:tasks.rados.rados.0.smithi166.stdout:654: writing smithi16641208-340 from 2917178 to 3159815 tid 3 2020-11-16T20:56:19.893 INFO:tasks.rados.rados.0.smithi166.stdout:655: read oid 66 snap -1 2020-11-16T20:56:19.893 INFO:tasks.rados.rados.0.smithi166.stdout:655: expect (ObjNum 65 snap 0 seq_num 65) 2020-11-16T20:56:19.894 INFO:tasks.rados.rados.0.smithi166.stdout:656: write oid 219 current snap is 12 2020-11-16T20:56:19.894 INFO:tasks.rados.rados.0.smithi166.stdout:656: seq_num 546 ranges {776622=547017,1800933=725518,2944601=232021} 2020-11-16T20:56:19.894 INFO:tasks.rados.rados.0.smithi166.stdout:656: writing smithi16641208-219 from 776622 to 1323639 tid 1 2020-11-16T20:56:19.894 INFO:tasks.rados.rados.0.smithi166.stdout:656: writing smithi16641208-219 from 1800933 to 2526451 tid 2 2020-11-16T20:56:19.894 INFO:tasks.rados.rados.0.smithi166.stdout:656: writing smithi16641208-219 from 2944601 to 3176622 tid 3 2020-11-16T20:56:19.894 INFO:tasks.rados.rados.0.smithi166.stdout:657: copy_from oid 144 from oid 104 current snap is 12 2020-11-16T20:56:19.894 INFO:tasks.rados.rados.0.smithi166.stdout:655: expect (ObjNum 65 snap 0 seq_num 65) 2020-11-16T20:56:19.895 INFO:teuthology.orchestra.run.smithi166.stderr:set 2.e pg_upmap mapping to [1,7,0] 2020-11-16T20:56:19.895 INFO:teuthology.orchestra.run.smithi166.stderr:nodeep-scrub is set 2020-11-16T20:56:19.895 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:19.895+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:19.896 INFO:tasks.rados.rados.0.smithi166.stdout:654: finishing write tid 1 to smithi16641208-340 2020-11-16T20:56:19.896 INFO:tasks.rados.rados.0.smithi166.stdout:654: finishing write tid 2 to smithi16641208-340 2020-11-16T20:56:19.896 INFO:tasks.rados.rados.0.smithi166.stdout:656: finishing write tid 1 to smithi16641208-219 2020-11-16T20:56:19.897 INFO:tasks.rados.rados.0.smithi166.stdout:655: done (3 left) 2020-11-16T20:56:19.897 INFO:tasks.rados.rados.0.smithi166.stdout:658: write (excl) oid 364 current snap is 12 2020-11-16T20:56:19.897 INFO:tasks.rados.rados.0.smithi166.stdout:654: finishing write tid 3 to smithi16641208-340 2020-11-16T20:56:19.897 INFO:tasks.rados.rados.0.smithi166.stdout:658: seq_num 547 ranges {793429=622266,1859415=469176,2972024=221405} 2020-11-16T20:56:19.900 INFO:tasks.rados.rados.0.smithi166.stdout:658: writing smithi16641208-364 from 793429 to 1415695 tid 1 2020-11-16T20:56:19.905 INFO:tasks.rados.rados.0.smithi166.stdout:658: writing smithi16641208-364 from 1859415 to 2328591 tid 2 2020-11-16T20:56:19.911 INFO:tasks.rados.rados.0.smithi166.stdout:658: writing smithi16641208-364 from 2972024 to 3193429 tid 3 2020-11-16T20:56:19.911 INFO:tasks.rados.rados.0.smithi166.stdout:659: read oid 412 snap 10 2020-11-16T20:56:19.911 INFO:tasks.rados.rados.0.smithi166.stdout:659: expect (ObjNum 411 snap 0 seq_num 411) 2020-11-16T20:56:19.911 INFO:tasks.rados.rados.0.smithi166.stdout:660: cache_try_flush oid 419 snap -1 2020-11-16T20:56:19.912 INFO:tasks.rados.rados.0.smithi166.stdout:654: finishing write tid 4 to smithi16641208-340 2020-11-16T20:56:19.912 INFO:tasks.rados.rados.0.smithi166.stdout:654: finishing write tid 5 to smithi16641208-340 2020-11-16T20:56:19.912 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 340 v 496 (ObjNum 545 snap 12 seq_num 545) dirty exists 2020-11-16T20:56:19.912 INFO:tasks.rados.rados.0.smithi166.stdout:654: left oid 340 (ObjNum 545 snap 12 seq_num 545) 2020-11-16T20:56:19.912 INFO:tasks.rados.rados.0.smithi166.stdout:657: finishing copy_from to smithi16641208-144 2020-11-16T20:56:19.912 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 144 v 64 (ObjNum 103 snap 0 seq_num 103) dirty exists 2020-11-16T20:56:19.912 INFO:tasks.rados.rados.0.smithi166.stdout:656: finishing write tid 2 to smithi16641208-219 2020-11-16T20:56:19.913 INFO:tasks.rados.rados.0.smithi166.stdout:656: finishing write tid 3 to smithi16641208-219 2020-11-16T20:56:19.913 INFO:tasks.rados.rados.0.smithi166.stdout:656: finishing write tid 4 to smithi16641208-219 2020-11-16T20:56:19.913 INFO:tasks.rados.rados.0.smithi166.stdout:656: finishing write tid 5 to smithi16641208-219 2020-11-16T20:56:19.913 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 219 v 483 (ObjNum 546 snap 12 seq_num 546) dirty exists 2020-11-16T20:56:19.913 INFO:tasks.rados.rados.0.smithi166.stdout:656: left oid 219 (ObjNum 546 snap 12 seq_num 546) 2020-11-16T20:56:19.913 INFO:tasks.rados.rados.0.smithi166.stdout:657: finishing copy_from racing read to smithi16641208-144 2020-11-16T20:56:19.913 INFO:tasks.rados.rados.0.smithi166.stdout:654: done (5 left) 2020-11-16T20:56:19.914 INFO:tasks.rados.rados.0.smithi166.stdout:656: done (4 left) 2020-11-16T20:56:19.914 INFO:tasks.rados.rados.0.smithi166.stdout:657: done (3 left) 2020-11-16T20:56:19.914 INFO:tasks.rados.rados.0.smithi166.stdout:661: copy_from oid 278 from oid 360 current snap is 12 2020-11-16T20:56:19.914 INFO:tasks.rados.rados.0.smithi166.stdout:658: finishing write tid 1 to smithi16641208-364 2020-11-16T20:56:19.914 INFO:tasks.rados.rados.0.smithi166.stdout:658: finishing write tid 2 to smithi16641208-364 2020-11-16T20:56:19.914 INFO:tasks.rados.rados.0.smithi166.stdout:662: cache_try_flush oid 133 snap 9 2020-11-16T20:56:19.914 INFO:tasks.rados.rados.0.smithi166.stdout:663: snap_remove snap 3 2020-11-16T20:56:19.992 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:19.996+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:20.031 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:20.031 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:20.031 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:56:20.031 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:20.040 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:56:20.092 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:20.097+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:20.193 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:20.197+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:20.204 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:20.205 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:20.205 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:56:20.205 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:56:20.205 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:20.214 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:56:20.293 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:20.298+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:20.376 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:56:20.381 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:20.381 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:56:20.382 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:56:20.382 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:56:20.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.382 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:202 3.2 3:5723fd94:::smithi16641208-211:head [copy-from ver 110] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e35)", 2020-11-16T20:56:20.382 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:56:20.382 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 25.414998917999998, 2020-11-16T20:56:20.383 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027790216999999999, 2020-11-16T20:56:20.383 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:20.383 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:20.383 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:20.383 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.383 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:20.383 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:56:20.384 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:20.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.384 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:20.384 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:56:20.384 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1907999999999998e-05 2020-11-16T20:56:20.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.385 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.385 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:20.385 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969232+0000", 2020-11-16T20:56:20.385 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5270000000000004e-06 2020-11-16T20:56:20.385 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.385 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.385 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:20.385 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969239+0000", 2020-11-16T20:56:20.386 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3062e-05 2020-11-16T20:56:20.386 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.386 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.386 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:20.386 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969252+0000", 2020-11-16T20:56:20.386 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8919999999999997e-06 2020-11-16T20:56:20.386 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.387 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.387 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:20.387 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969258+0000", 2020-11-16T20:56:20.387 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00040859799999999998 2020-11-16T20:56:20.387 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.387 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.387 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.387 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969666+0000", 2020-11-16T20:56:20.388 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0932000000000003e-05 2020-11-16T20:56:20.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.388 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.388 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:20.388 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969757+0000", 2020-11-16T20:56:20.388 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010999395 2020-11-16T20:56:20.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.389 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:20.389 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.980757+0000", 2020-11-16T20:56:20.389 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006260659 2020-11-16T20:56:20.389 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.389 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:20.389 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987017+0000", 2020-11-16T20:56:20.390 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0080836880000000003 2020-11-16T20:56:20.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.390 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.390 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.390 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995101+0000", 2020-11-16T20:56:20.390 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001796829 2020-11-16T20:56:20.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.391 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.391 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996898+0000", 2020-11-16T20:56:20.391 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2086000000000003e-05 2020-11-16T20:56:20.391 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.391 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:20.391 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996940+0000", 2020-11-16T20:56:20.392 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0641e-05 2020-11-16T20:56:20.392 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.392 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.392 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:20.392 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996971+0000", 2020-11-16T20:56:20.392 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027790216999999999 2020-11-16T20:56:20.392 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.393 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:20.393 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.393 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.393 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.393 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:547 3.2 3:5f250a2b:::smithi16641208-75:head [copy-from ver 38] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:20.393 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:56:20.393 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 15.366611615, 2020-11-16T20:56:20.393 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027400430999999999, 2020-11-16T20:56:20.394 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:20.394 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:20.394 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:20.394 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.394 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:20.394 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:56:20.394 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:20.395 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.395 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.395 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:20.395 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:56:20.395 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5093999999999999e-05 2020-11-16T20:56:20.395 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.395 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.395 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:20.396 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017613+0000", 2020-11-16T20:56:20.396 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6150000000000003e-06 2020-11-16T20:56:20.396 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.396 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.396 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:20.396 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017623+0000", 2020-11-16T20:56:20.396 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6934000000000001e-05 2020-11-16T20:56:20.397 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.397 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.397 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:20.397 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017639+0000", 2020-11-16T20:56:20.397 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1892000000000001e-05 2020-11-16T20:56:20.397 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.397 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.397 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:20.398 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017651+0000", 2020-11-16T20:56:20.398 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2955999999999998e-05 2020-11-16T20:56:20.398 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.398 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.398 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.398 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017714+0000", 2020-11-16T20:56:20.398 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019352400000000001 2020-11-16T20:56:20.399 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.399 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.399 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:20.399 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017908+0000", 2020-11-16T20:56:20.399 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0073901349999999999 2020-11-16T20:56:20.399 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.399 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.399 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:20.400 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025298+0000", 2020-11-16T20:56:20.400 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0082133799999999993 2020-11-16T20:56:20.400 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.400 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.400 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:20.400 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033511+0000", 2020-11-16T20:56:20.400 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0074347629999999996 2020-11-16T20:56:20.401 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.401 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.401 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.401 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.040946+0000", 2020-11-16T20:56:20.401 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039404669999999996 2020-11-16T20:56:20.401 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.401 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.401 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.402 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044887+0000", 2020-11-16T20:56:20.402 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7098000000000002e-05 2020-11-16T20:56:20.402 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.402 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.402 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:20.402 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044934+0000", 2020-11-16T20:56:20.402 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4573000000000003e-05 2020-11-16T20:56:20.403 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.403 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.403 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:20.403 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044968+0000", 2020-11-16T20:56:20.403 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027400430999999999 2020-11-16T20:56:20.403 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.403 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:20.403 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.404 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.404 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.404 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:548 3.2 3:6173e90a:::smithi16641208-2:head [copy-from ver 3] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:20.404 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:56:20.404 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 15.366480281999999, 2020-11-16T20:56:20.404 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029556911000000002, 2020-11-16T20:56:20.404 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:20.405 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:20.405 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:20.405 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.405 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:20.405 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:56:20.405 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:20.405 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.405 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.406 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:20.406 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:56:20.406 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2478000000000002e-05 2020-11-16T20:56:20.406 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.406 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.406 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:20.406 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017742+0000", 2020-11-16T20:56:20.406 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3060000000000003e-06 2020-11-16T20:56:20.407 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.407 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.407 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:20.407 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017748+0000", 2020-11-16T20:56:20.407 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1102e-05 2020-11-16T20:56:20.407 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.407 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.408 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:20.408 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017759+0000", 2020-11-16T20:56:20.408 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.118e-06 2020-11-16T20:56:20.408 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.408 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.408 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:20.408 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017764+0000", 2020-11-16T20:56:20.409 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032233700000000001 2020-11-16T20:56:20.409 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.409 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.409 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.409 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.018086+0000", 2020-11-16T20:56:20.409 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000128374 2020-11-16T20:56:20.409 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.409 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.410 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:20.410 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.018215+0000", 2020-11-16T20:56:20.410 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012971355 2020-11-16T20:56:20.410 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.410 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.410 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:20.410 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.031186+0000", 2020-11-16T20:56:20.411 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044142890000000001 2020-11-16T20:56:20.411 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.411 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.411 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:20.411 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.035600+0000", 2020-11-16T20:56:20.411 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092372719999999995 2020-11-16T20:56:20.411 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.411 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.412 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.412 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044838+0000", 2020-11-16T20:56:20.412 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0023022049999999999 2020-11-16T20:56:20.412 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.412 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.412 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.412 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047140+0000", 2020-11-16T20:56:20.413 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0380999999999997e-05 2020-11-16T20:56:20.413 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.413 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.413 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:20.413 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047200+0000", 2020-11-16T20:56:20.413 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5693999999999999e-05 2020-11-16T20:56:20.413 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.413 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.414 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:20.414 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047256+0000", 2020-11-16T20:56:20.414 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029556911000000002 2020-11-16T20:56:20.414 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.414 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:20.414 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.414 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.415 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.415 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:554 3.2 3:769099fd:::smithi16641208-247:head [copy-from ver 123] snapc 1=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:20.415 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:56:20.415 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 15.334076963999999, 2020-11-16T20:56:20.415 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998, 2020-11-16T20:56:20.415 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:20.415 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:20.416 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:20.416 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.416 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:20.416 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:56:20.416 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:20.416 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.416 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.416 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:20.417 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:56:20.417 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6705999999999997e-05 2020-11-16T20:56:20.417 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.417 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.417 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:20.417 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050139+0000", 2020-11-16T20:56:20.417 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6199999999999998e-06 2020-11-16T20:56:20.421 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.421 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.421 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:20.421 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050144+0000", 2020-11-16T20:56:20.421 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.944e-06 2020-11-16T20:56:20.421 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.421 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.421 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:20.422 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050154+0000", 2020-11-16T20:56:20.422 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4043999999999999e-05 2020-11-16T20:56:20.422 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.422 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.422 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:20.422 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050178+0000", 2020-11-16T20:56:20.422 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078971409999999999 2020-11-16T20:56:20.423 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.423 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.423 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.423 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058075+0000", 2020-11-16T20:56:20.423 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012776500000000001 2020-11-16T20:56:20.423 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.423 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.423 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:20.424 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058203+0000", 2020-11-16T20:56:20.424 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011807013 2020-11-16T20:56:20.424 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.424 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.424 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:20.424 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070010+0000", 2020-11-16T20:56:20.424 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029522160000000001 2020-11-16T20:56:20.425 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.425 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.425 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:20.425 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.072962+0000", 2020-11-16T20:56:20.425 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017845006 2020-11-16T20:56:20.425 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.425 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.425 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.426 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.090807+0000", 2020-11-16T20:56:20.426 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.009301808 2020-11-16T20:56:20.426 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.426 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.426 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.426 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100109+0000", 2020-11-16T20:56:20.426 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7076999999999995e-05 2020-11-16T20:56:20.427 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.427 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.427 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:20.427 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100176+0000", 2020-11-16T20:56:20.427 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9790999999999999e-05 2020-11-16T20:56:20.427 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.427 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.428 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:20.428 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100216+0000", 2020-11-16T20:56:20.428 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998 2020-11-16T20:56:20.428 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.428 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:20.428 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.428 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.428 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.429 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:555 3.2 3:590e6edd:::smithi16641208-203:head [delete] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:20.429 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.076366+0000", 2020-11-16T20:56:20.429 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 15.307813106999999, 2020-11-16T20:56:20.429 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024009968, 2020-11-16T20:56:20.429 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:20.429 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:20.429 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:20.430 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.430 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:20.430 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076366+0000", 2020-11-16T20:56:20.430 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:20.430 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.430 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.430 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:20.430 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076366+0000", 2020-11-16T20:56:20.431 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2963999999999998e-05 2020-11-16T20:56:20.431 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.431 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.431 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:20.431 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076399+0000", 2020-11-16T20:56:20.431 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6879999999999999e-06 2020-11-16T20:56:20.431 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.432 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.432 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:20.432 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076407+0000", 2020-11-16T20:56:20.432 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4088999999999999e-05 2020-11-16T20:56:20.432 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.432 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.432 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:20.432 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076431+0000", 2020-11-16T20:56:20.433 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.4280000000000002e-06 2020-11-16T20:56:20.433 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.433 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.433 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:20.433 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076440+0000", 2020-11-16T20:56:20.433 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3467999999999998e-05 2020-11-16T20:56:20.433 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.433 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.434 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.434 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076484+0000", 2020-11-16T20:56:20.434 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011613 2020-11-16T20:56:20.434 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.434 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.434 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:20.434 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076600+0000", 2020-11-16T20:56:20.435 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8172999999999998e-05 2020-11-16T20:56:20.435 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.435 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.435 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:20.435 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076678+0000", 2020-11-16T20:56:20.435 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0009822749999999999 2020-11-16T20:56:20.435 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.436 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.436 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:20.436 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.077661+0000", 2020-11-16T20:56:20.436 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018605739999999999 2020-11-16T20:56:20.436 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.436 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.436 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.436 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.096266+0000", 2020-11-16T20:56:20.437 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039876709999999999 2020-11-16T20:56:20.437 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.437 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.437 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.437 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100254+0000", 2020-11-16T20:56:20.437 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4382999999999996e-05 2020-11-16T20:56:20.437 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.438 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.438 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:20.438 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100328+0000", 2020-11-16T20:56:20.438 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7958999999999999e-05 2020-11-16T20:56:20.438 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.438 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.438 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:20.438 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100376+0000", 2020-11-16T20:56:20.439 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024009968 2020-11-16T20:56:20.439 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.439 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:20.439 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.439 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.439 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.439 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:556 3.2 3:590e6edd:::smithi16641208-203:head [copy-from ver 105] snapc 1=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:20.440 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.076482+0000", 2020-11-16T20:56:20.440 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 15.307697657, 2020-11-16T20:56:20.440 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025150006999999999, 2020-11-16T20:56:20.440 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:20.440 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:20.440 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:20.440 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.440 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:20.441 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076482+0000", 2020-11-16T20:56:20.441 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:20.441 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.441 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.441 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:20.441 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076482+0000", 2020-11-16T20:56:20.441 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0086000000000006e-05 2020-11-16T20:56:20.442 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.442 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.442 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:20.442 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076552+0000", 2020-11-16T20:56:20.442 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7299999999999999e-06 2020-11-16T20:56:20.442 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.442 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.442 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:20.443 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076559+0000", 2020-11-16T20:56:20.443 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5905000000000001e-05 2020-11-16T20:56:20.443 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.443 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.443 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:20.443 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076574+0000", 2020-11-16T20:56:20.443 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9369999999999993e-06 2020-11-16T20:56:20.444 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.444 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.444 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:20.444 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076583+0000", 2020-11-16T20:56:20.444 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00064848599999999998 2020-11-16T20:56:20.444 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.444 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.444 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.445 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.077232+0000", 2020-11-16T20:56:20.445 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8629999999999999e-05 2020-11-16T20:56:20.445 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.445 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.445 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:20.445 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.077291+0000", 2020-11-16T20:56:20.445 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003820773 2020-11-16T20:56:20.446 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.446 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.446 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:20.446 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.081111+0000", 2020-11-16T20:56:20.446 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033171849999999998 2020-11-16T20:56:20.446 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.446 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.446 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:20.447 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.084428+0000", 2020-11-16T20:56:20.447 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016400174 2020-11-16T20:56:20.447 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.447 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.447 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.447 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100829+0000", 2020-11-16T20:56:20.447 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00071628499999999999 2020-11-16T20:56:20.448 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.448 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.448 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.448 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.101545+0000", 2020-11-16T20:56:20.448 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7249e-05 2020-11-16T20:56:20.448 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.448 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.448 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:20.449 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.101602+0000", 2020-11-16T20:56:20.449 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9567e-05 2020-11-16T20:56:20.449 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.449 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.449 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:20.449 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.101632+0000", 2020-11-16T20:56:20.449 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025150006999999999 2020-11-16T20:56:20.450 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.450 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:20.450 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.450 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.450 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.450 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2429 4.0 4:3b92f709:::smithi16641208-69:head [rollback 7] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:56:20.450 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:56:20.450 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.368158702000001, 2020-11-16T20:56:20.451 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003, 2020-11-16T20:56:20.451 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:20.451 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:20.451 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:20.451 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:20.451 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:20.451 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2429 2020-11-16T20:56:20.452 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.452 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:20.452 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.452 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:20.452 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:56:20.452 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:20.452 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.452 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.453 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:20.453 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:56:20.453 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3710000000000002e-05 2020-11-16T20:56:20.453 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.453 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.453 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:20.453 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016044+0000", 2020-11-16T20:56:20.454 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7090000000000001e-06 2020-11-16T20:56:20.454 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.454 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.454 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:20.454 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016049+0000", 2020-11-16T20:56:20.454 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8820000000000003e-06 2020-11-16T20:56:20.454 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.454 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.455 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:20.455 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016056+0000", 2020-11-16T20:56:20.455 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.27e-06 2020-11-16T20:56:20.455 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.455 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.455 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:20.455 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016059+0000", 2020-11-16T20:56:20.456 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.537e-05 2020-11-16T20:56:20.456 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.456 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.456 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.456 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016115+0000", 2020-11-16T20:56:20.456 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8690000000000003e-06 2020-11-16T20:56:20.456 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.456 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.457 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:20.457 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016120+0000", 2020-11-16T20:56:20.457 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021405730000000002 2020-11-16T20:56:20.457 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.457 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.457 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.457 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018260+0000", 2020-11-16T20:56:20.457 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0137999999999999e-05 2020-11-16T20:56:20.458 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.458 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.458 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:20.458 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018320+0000", 2020-11-16T20:56:20.458 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011799352000000001 2020-11-16T20:56:20.458 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.458 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.459 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.459 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030120+0000", 2020-11-16T20:56:20.459 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000163139 2020-11-16T20:56:20.459 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.459 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.459 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:20.459 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030283+0000", 2020-11-16T20:56:20.460 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029657000000000002 2020-11-16T20:56:20.460 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.460 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.460 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:20.460 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030579+0000", 2020-11-16T20:56:20.460 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3058000000000001e-05 2020-11-16T20:56:20.460 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.460 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.461 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:20.461 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030612+0000", 2020-11-16T20:56:20.461 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0075168259999999999 2020-11-16T20:56:20.461 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.461 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.461 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.461 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038129+0000", 2020-11-16T20:56:20.462 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012914299999999999 2020-11-16T20:56:20.462 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.462 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.462 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:20.462 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038258+0000", 2020-11-16T20:56:20.462 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034292799999999999 2020-11-16T20:56:20.462 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.462 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.463 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:56:20.463 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038601+0000", 2020-11-16T20:56:20.463 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0025181159999999999 2020-11-16T20:56:20.463 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.463 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.463 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.463 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041119+0000", 2020-11-16T20:56:20.464 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2331999999999997e-05 2020-11-16T20:56:20.464 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.464 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.464 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for ondisk", 2020-11-16T20:56:20.464 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041202+0000", 2020-11-16T20:56:20.464 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028481750000000001 2020-11-16T20:56:20.464 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.464 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.465 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:20.465 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044050+0000", 2020-11-16T20:56:20.465 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001269921 2020-11-16T20:56:20.465 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.465 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.465 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.465 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045320+0000", 2020-11-16T20:56:20.466 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054215490000000003 2020-11-16T20:56:20.466 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.466 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.466 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.466 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050741+0000", 2020-11-16T20:56:20.466 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6981000000000001e-05 2020-11-16T20:56:20.466 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.466 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.467 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:20.467 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050808+0000", 2020-11-16T20:56:20.467 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8841e-05 2020-11-16T20:56:20.467 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.467 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.467 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:20.467 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050877+0000", 2020-11-16T20:56:20.468 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003 2020-11-16T20:56:20.468 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.468 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:20.468 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.468 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.468 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.468 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2430 4.0 4:3b92f709:::smithi16641208-69:head [append 0~0] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:56:20.468 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:56:20.469 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.368102379, 2020-11-16T20:56:20.469 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001, 2020-11-16T20:56:20.469 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:20.469 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:20.469 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:20.469 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:20.469 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:20.469 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2430 2020-11-16T20:56:20.470 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.470 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:20.470 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.470 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:20.470 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:56:20.470 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:20.470 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.471 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.471 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:20.471 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:56:20.471 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0857e-05 2020-11-16T20:56:20.471 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.471 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.471 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:20.471 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016098+0000", 2020-11-16T20:56:20.472 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9179999999999999e-06 2020-11-16T20:56:20.472 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.472 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.472 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:20.472 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016104+0000", 2020-11-16T20:56:20.472 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8230000000000006e-06 2020-11-16T20:56:20.472 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.473 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.473 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:20.473 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016114+0000", 2020-11-16T20:56:20.473 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2180000000000001e-06 2020-11-16T20:56:20.473 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.473 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.473 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:20.473 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016118+0000", 2020-11-16T20:56:20.474 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3547999999999995e-05 2020-11-16T20:56:20.474 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.474 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.474 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.474 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016181+0000", 2020-11-16T20:56:20.474 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8730000000000007e-06 2020-11-16T20:56:20.474 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.475 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.475 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:20.475 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016189+0000", 2020-11-16T20:56:20.475 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021577200000000001 2020-11-16T20:56:20.475 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.475 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.475 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.475 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018347+0000", 2020-11-16T20:56:20.476 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6832000000000001e-05 2020-11-16T20:56:20.476 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.476 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.476 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:20.476 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018404+0000", 2020-11-16T20:56:20.476 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012272913999999999 2020-11-16T20:56:20.476 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.476 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.477 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.477 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030677+0000", 2020-11-16T20:56:20.477 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2555000000000002e-05 2020-11-16T20:56:20.477 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.477 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.477 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:20.477 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030719+0000", 2020-11-16T20:56:20.478 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010518684 2020-11-16T20:56:20.478 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.478 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.478 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.478 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041238+0000", 2020-11-16T20:56:20.478 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000144723 2020-11-16T20:56:20.478 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.478 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.479 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:20.479 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041383+0000", 2020-11-16T20:56:20.479 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000214575 2020-11-16T20:56:20.479 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.479 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.479 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:56:20.479 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041597+0000", 2020-11-16T20:56:20.480 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002463196 2020-11-16T20:56:20.480 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.480 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.480 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:20.480 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044060+0000", 2020-11-16T20:56:20.480 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001654066 2020-11-16T20:56:20.480 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.480 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.481 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.481 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045715+0000", 2020-11-16T20:56:20.481 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053780599999999996 2020-11-16T20:56:20.481 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.481 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.481 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.481 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051093+0000", 2020-11-16T20:56:20.481 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8189999999999996e-05 2020-11-16T20:56:20.482 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.482 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.482 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:20.482 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051161+0000", 2020-11-16T20:56:20.482 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4910000000000001e-05 2020-11-16T20:56:20.482 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.482 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.483 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:20.483 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051216+0000", 2020-11-16T20:56:20.483 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001 2020-11-16T20:56:20.483 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.483 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:20.483 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.483 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.483 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.484 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "MOSDPGPush(4.1 52/51 [PushOp(4:9ab04c4a:::smithi16641208-1:head, version: 33'3, data_included: [0~892056,1542129~156520], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:9ab04c4a:::smithi16641208-1:head@33'3, size: 2016807, copy_subset: [0~2016807], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1698649, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:a1eef07d:::smithi16641208-13:head, version: 33'9, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:a1eef07d:::smithi16641208-13:head@33'9, size: 2201684, copy_subset: [0~2201684], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:929564f0:::smithi16641208-24:head, version: 33'18, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:929564f0:::smithi16641208-24:head@33'18, size: 2386561, copy_subset: [0~2386561], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b565f7d2:::smithi16641208-35:head, version: 33'27, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b565f7d2:::smithi16641208-35:head@33'27, size: 2571438, copy_subset: [0~2571438], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b6545a47:::smithi16641208-46:head, version: 33'29, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b6545a47:::smithi16641208-46:head@33'29, size: 2756315, copy_subset: [0~2756315], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:9bd9f31d:::smithi16641208-48:head, version: 33'35, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:9bd9f31d:::smithi16641208-48:head@33'35, size: 2789929, copy_subset: [0~2789929], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:83205103:::smithi16641208-103:head, version: 34'38, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:83205103:::smithi16641208-103:head@34'38, size: 3714314, copy_subset: [0~3714314], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:86a0a5b7:::smithi16641208-108:head, version: 34'42, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:86a0a5b7:::smithi16641208-108:head@34'42, size: 3798349, copy_subset: [0~3798349], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-16T20:56:20.484 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:56:20.484 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.613505773, 2020-11-16T20:56:20.484 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032552672999999997, 2020-11-16T20:56:20.484 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:20.484 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:20.484 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:20.485 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.485 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:20.485 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:56:20.485 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:20.485 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.485 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.485 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:20.486 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:56:20.486 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017498692999999999 2020-11-16T20:56:20.486 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.486 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.486 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:20.486 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788172+0000", 2020-11-16T20:56:20.486 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4147999999999999e-05 2020-11-16T20:56:20.486 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.487 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.487 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:20.487 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788206+0000", 2020-11-16T20:56:20.487 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0016000000000002e-05 2020-11-16T20:56:20.487 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.487 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.487 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:20.488 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788276+0000", 2020-11-16T20:56:20.488 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2172000000000002e-05 2020-11-16T20:56:20.488 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.488 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.488 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:20.488 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788319+0000", 2020-11-16T20:56:20.488 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000154337 2020-11-16T20:56:20.488 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.489 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.489 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.489 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788473+0000", 2020-11-16T20:56:20.489 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7690000000000002e-06 2020-11-16T20:56:20.489 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.489 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.489 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:20.490 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788482+0000", 2020-11-16T20:56:20.490 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014744538 2020-11-16T20:56:20.490 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.490 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.490 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:20.490 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803226+0000", 2020-11-16T20:56:20.490 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032552672999999997 2020-11-16T20:56:20.490 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.491 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:20.491 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.491 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.491 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.491 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.0:552 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'128, mlcod=0'0)", 2020-11-16T20:56:20.491 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:56:20.491 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.593540355, 2020-11-16T20:56:20.492 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038033168999999999, 2020-11-16T20:56:20.492 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:20.492 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:20.492 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:20.492 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.492 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:20.492 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:56:20.492 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:20.493 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.493 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.493 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:20.493 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:56:20.493 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0031023880000000002 2020-11-16T20:56:20.493 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.493 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.494 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:20.494 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793741+0000", 2020-11-16T20:56:20.494 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1496e-05 2020-11-16T20:56:20.494 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.494 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.494 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:20.494 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793753+0000", 2020-11-16T20:56:20.494 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9009999999999999e-05 2020-11-16T20:56:20.495 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.495 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.495 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:20.495 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793772+0000", 2020-11-16T20:56:20.495 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3318e-05 2020-11-16T20:56:20.495 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.495 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.496 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:20.496 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793785+0000", 2020-11-16T20:56:20.496 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012534775 2020-11-16T20:56:20.496 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.496 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.496 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.496 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806320+0000", 2020-11-16T20:56:20.496 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8144999999999999e-05 2020-11-16T20:56:20.497 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.497 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.497 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:20.497 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806348+0000", 2020-11-16T20:56:20.497 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022285688000000001 2020-11-16T20:56:20.497 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.497 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.498 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:20.498 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828634+0000", 2020-11-16T20:56:20.498 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8349000000000002e-05 2020-11-16T20:56:20.498 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.498 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.498 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:20.498 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828672+0000", 2020-11-16T20:56:20.498 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038033168999999999 2020-11-16T20:56:20.499 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.499 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:20.499 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.499 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.499 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.499 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2503 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'129, mlcod=0'0)", 2020-11-16T20:56:20.499 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:56:20.499 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.5903521749999996, 2020-11-16T20:56:20.500 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034870998, 2020-11-16T20:56:20.500 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:20.500 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:20.500 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:20.500 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.500 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:20.500 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:56:20.501 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:20.501 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.501 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.501 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:20.501 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:56:20.501 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00093048899999999995 2020-11-16T20:56:20.501 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.501 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.502 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:20.502 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794758+0000", 2020-11-16T20:56:20.502 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.169e-05 2020-11-16T20:56:20.502 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.502 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.502 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:20.502 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794769+0000", 2020-11-16T20:56:20.503 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3998999999999999e-05 2020-11-16T20:56:20.503 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.503 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.503 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:20.503 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794783+0000", 2020-11-16T20:56:20.503 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.481e-06 2020-11-16T20:56:20.503 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.503 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.504 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:20.504 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794791+0000", 2020-11-16T20:56:20.504 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.02524036 2020-11-16T20:56:20.504 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.504 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.504 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.504 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820031+0000", 2020-11-16T20:56:20.505 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.811e-05 2020-11-16T20:56:20.505 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.505 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.505 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:20.505 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820059+0000", 2020-11-16T20:56:20.505 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.008614577 2020-11-16T20:56:20.505 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.505 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.506 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:20.506 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828674+0000", 2020-11-16T20:56:20.506 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4292000000000001e-05 2020-11-16T20:56:20.506 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.506 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.506 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:20.506 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828698+0000", 2020-11-16T20:56:20.507 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034870998 2020-11-16T20:56:20.507 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.507 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:20.507 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.507 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.507 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.507 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2504 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'130, mlcod=0'0)", 2020-11-16T20:56:20.507 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:56:20.508 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.5893464929999999, 2020-11-16T20:56:20.508 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033888776000000002, 2020-11-16T20:56:20.508 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:20.508 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:20.508 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:20.508 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.508 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:20.509 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:56:20.509 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:20.509 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.509 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.509 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:20.509 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:56:20.509 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3896999999999997e-05 2020-11-16T20:56:20.509 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.510 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.510 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:20.510 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794877+0000", 2020-11-16T20:56:20.510 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7019999999999998e-06 2020-11-16T20:56:20.510 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.510 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.510 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:20.511 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794883+0000", 2020-11-16T20:56:20.511 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.789e-06 2020-11-16T20:56:20.511 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.511 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.511 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:20.511 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794888+0000", 2020-11-16T20:56:20.511 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.852e-06 2020-11-16T20:56:20.511 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.512 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.512 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:20.512 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794891+0000", 2020-11-16T20:56:20.512 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026152822999999999 2020-11-16T20:56:20.512 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.512 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.512 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.512 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.821044+0000", 2020-11-16T20:56:20.513 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6900999999999999e-05 2020-11-16T20:56:20.513 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.513 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.513 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:20.513 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.821071+0000", 2020-11-16T20:56:20.513 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0076283210000000004 2020-11-16T20:56:20.513 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.514 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.514 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:20.514 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828699+0000", 2020-11-16T20:56:20.514 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2490999999999999e-05 2020-11-16T20:56:20.514 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.514 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.514 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:20.514 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828722+0000", 2020-11-16T20:56:20.515 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033888776000000002 2020-11-16T20:56:20.515 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.515 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:20.515 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.515 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.515 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.515 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.13:681 3.1 e52/19 3:afc69464:::smithi16641208-110:head v 52'546, mlcod=52'544)", 2020-11-16T20:56:20.516 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:56:20.516 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.5866864229999997, 2020-11-16T20:56:20.516 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.03113606, 2020-11-16T20:56:20.516 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:20.516 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:20.516 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:20.516 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.516 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:20.517 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:56:20.517 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:20.517 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.517 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.517 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:20.517 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:56:20.517 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0026681809999999999 2020-11-16T20:56:20.517 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.518 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.518 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:20.518 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800161+0000", 2020-11-16T20:56:20.518 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3499000000000001e-05 2020-11-16T20:56:20.518 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.518 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.518 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:20.519 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800175+0000", 2020-11-16T20:56:20.519 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8301999999999999e-05 2020-11-16T20:56:20.519 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.519 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.519 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:20.519 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800193+0000", 2020-11-16T20:56:20.519 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0465999999999999e-05 2020-11-16T20:56:20.519 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.520 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.520 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:20.520 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800203+0000", 2020-11-16T20:56:20.520 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061432479999999996 2020-11-16T20:56:20.520 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.520 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.520 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.521 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806347+0000", 2020-11-16T20:56:20.521 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.641e-05 2020-11-16T20:56:20.521 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.521 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.521 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:20.521 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806373+0000", 2020-11-16T20:56:20.521 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022190887999999999 2020-11-16T20:56:20.521 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.522 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.522 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:20.522 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828564+0000", 2020-11-16T20:56:20.522 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5066000000000003e-05 2020-11-16T20:56:20.522 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.522 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.522 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:20.523 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828629+0000", 2020-11-16T20:56:20.523 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.03113606 2020-11-16T20:56:20.523 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.523 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:20.523 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.523 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.523 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.523 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.13:682 3.1 e52/19 3:b3ae2c4d:::smithi16641208-463:head v 52'547, mlcod=52'544)", 2020-11-16T20:56:20.524 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.802222+0000", 2020-11-16T20:56:20.524 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.5819575190000004, 2020-11-16T20:56:20.524 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026721733000000001, 2020-11-16T20:56:20.524 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:20.524 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:20.524 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:20.524 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.525 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:20.525 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.802222+0000", 2020-11-16T20:56:20.525 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:20.525 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.525 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.525 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:20.525 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.802222+0000", 2020-11-16T20:56:20.525 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001333442 2020-11-16T20:56:20.526 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.526 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.526 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:20.526 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803555+0000", 2020-11-16T20:56:20.526 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0971999999999999e-05 2020-11-16T20:56:20.526 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.526 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.527 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:20.527 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803566+0000", 2020-11-16T20:56:20.527 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5973000000000001e-05 2020-11-16T20:56:20.527 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.527 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.527 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:20.527 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803582+0000", 2020-11-16T20:56:20.527 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2969999999999998e-06 2020-11-16T20:56:20.528 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.528 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.528 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:20.528 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803590+0000", 2020-11-16T20:56:20.528 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016424259 2020-11-16T20:56:20.528 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.528 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.528 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.529 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820014+0000", 2020-11-16T20:56:20.529 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9485999999999999e-05 2020-11-16T20:56:20.529 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.529 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.529 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:20.529 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820033+0000", 2020-11-16T20:56:20.529 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0088553179999999992 2020-11-16T20:56:20.530 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.530 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.530 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:20.530 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828889+0000", 2020-11-16T20:56:20.530 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4985999999999998e-05 2020-11-16T20:56:20.530 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.530 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.530 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:20.531 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828944+0000", 2020-11-16T20:56:20.531 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026721733000000001 2020-11-16T20:56:20.531 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.531 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:20.531 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.531 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.531 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.532 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:602 3.2 3:5a2aa7df:::smithi16641208-248:head [copy-from ver 124] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:56:20.532 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.751134+0000", 2020-11-16T20:56:20.532 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.63304501499999999, 2020-11-16T20:56:20.532 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026671776000000001, 2020-11-16T20:56:20.532 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:20.532 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:20.532 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:20.532 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.533 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:20.533 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751134+0000", 2020-11-16T20:56:20.533 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:20.533 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.533 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.533 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:20.533 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751134+0000", 2020-11-16T20:56:20.533 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2177e-05 2020-11-16T20:56:20.534 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.534 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.534 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:20.534 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751177+0000", 2020-11-16T20:56:20.534 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8199999999999999e-06 2020-11-16T20:56:20.534 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.534 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.535 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:20.535 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751183+0000", 2020-11-16T20:56:20.535 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3193999999999999e-05 2020-11-16T20:56:20.535 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.535 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.535 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:20.535 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751197+0000", 2020-11-16T20:56:20.535 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.823e-06 2020-11-16T20:56:20.536 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.536 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.536 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:20.536 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751202+0000", 2020-11-16T20:56:20.536 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3791000000000001e-05 2020-11-16T20:56:20.536 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.536 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.537 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.537 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751246+0000", 2020-11-16T20:56:20.537 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019541200000000001 2020-11-16T20:56:20.537 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.537 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.537 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:20.537 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751442+0000", 2020-11-16T20:56:20.537 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0098138649999999997 2020-11-16T20:56:20.538 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.538 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.538 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:20.538 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.761255+0000", 2020-11-16T20:56:20.538 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0093475569999999994 2020-11-16T20:56:20.538 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.538 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.539 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:20.539 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770603+0000", 2020-11-16T20:56:20.539 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053967829999999996 2020-11-16T20:56:20.539 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.539 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.539 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.539 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.776000+0000", 2020-11-16T20:56:20.539 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001679687 2020-11-16T20:56:20.540 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.540 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.540 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.540 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.777680+0000", 2020-11-16T20:56:20.540 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5221000000000005e-05 2020-11-16T20:56:20.540 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.540 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.540 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:20.541 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.777745+0000", 2020-11-16T20:56:20.541 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1445999999999994e-05 2020-11-16T20:56:20.541 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.541 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.541 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:20.541 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.777806+0000", 2020-11-16T20:56:20.541 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026671776000000001 2020-11-16T20:56:20.542 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.542 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:20.542 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.542 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.542 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.542 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:603 3.2 3:5a2e7c26:::smithi16641208-130:head [copy-from ver 67] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:56:20.542 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:56:20.542 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.63293842899999997, 2020-11-16T20:56:20.543 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036631116999999998, 2020-11-16T20:56:20.543 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:20.543 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:20.543 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:20.543 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.543 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:20.543 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:56:20.543 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:20.544 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.544 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.544 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:20.544 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:56:20.544 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9854000000000002e-05 2020-11-16T20:56:20.544 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.544 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.545 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:20.545 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751281+0000", 2020-11-16T20:56:20.545 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1840000000000004e-06 2020-11-16T20:56:20.545 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.545 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.545 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:20.545 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751287+0000", 2020-11-16T20:56:20.545 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0231000000000001e-05 2020-11-16T20:56:20.546 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.546 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.546 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:20.546 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751297+0000", 2020-11-16T20:56:20.546 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.639e-06 2020-11-16T20:56:20.546 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.546 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.547 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:20.547 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751302+0000", 2020-11-16T20:56:20.547 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030012000000000002 2020-11-16T20:56:20.547 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.547 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.547 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.547 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751602+0000", 2020-11-16T20:56:20.547 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013830200000000001 2020-11-16T20:56:20.548 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.548 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.548 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:20.548 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751740+0000", 2020-11-16T20:56:20.548 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019538969999999999 2020-11-16T20:56:20.548 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.548 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.549 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:20.549 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771279+0000", 2020-11-16T20:56:20.549 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007630403 2020-11-16T20:56:20.549 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.549 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.549 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:20.549 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.778910+0000", 2020-11-16T20:56:20.549 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0065002009999999997 2020-11-16T20:56:20.550 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.550 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.550 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.550 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.785410+0000", 2020-11-16T20:56:20.550 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0023914140000000001 2020-11-16T20:56:20.550 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.550 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.551 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.551 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787801+0000", 2020-11-16T20:56:20.551 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9629999999999998e-05 2020-11-16T20:56:20.551 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.551 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.551 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:20.551 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787841+0000", 2020-11-16T20:56:20.551 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1168999999999999e-05 2020-11-16T20:56:20.552 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.552 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.552 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:20.552 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787872+0000", 2020-11-16T20:56:20.552 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036631116999999998 2020-11-16T20:56:20.552 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.552 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:20.553 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.553 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.553 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.553 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2580 3.2 3:75836747:::smithi16641208-340:head [write 759815~471768] snapc 14=[12,f,5] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e57)", 2020-11-16T20:56:20.553 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.762905+0000", 2020-11-16T20:56:20.553 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.621274243, 2020-11-16T20:56:20.553 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023946682, 2020-11-16T20:56:20.553 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:20.554 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:20.554 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:20.554 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.554 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:20.554 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.762905+0000", 2020-11-16T20:56:20.554 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:20.554 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.554 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.555 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:20.555 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.762905+0000", 2020-11-16T20:56:20.555 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029291700000000001 2020-11-16T20:56:20.555 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.555 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.555 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:20.555 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.763198+0000", 2020-11-16T20:56:20.556 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.605e-06 2020-11-16T20:56:20.556 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.556 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.556 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:20.556 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.763206+0000", 2020-11-16T20:56:20.556 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2612000000000001e-05 2020-11-16T20:56:20.556 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.556 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.557 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:20.557 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.763218+0000", 2020-11-16T20:56:20.557 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5729999999999996e-06 2020-11-16T20:56:20.557 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.557 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.557 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:20.557 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.763225+0000", 2020-11-16T20:56:20.558 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0011325650000000001 2020-11-16T20:56:20.558 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.558 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.558 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.558 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.764357+0000", 2020-11-16T20:56:20.558 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022501899999999999 2020-11-16T20:56:20.558 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.558 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.559 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:20.559 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.764582+0000", 2020-11-16T20:56:20.559 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000241258 2020-11-16T20:56:20.559 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.559 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.559 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:20.559 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.764824+0000", 2020-11-16T20:56:20.559 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011230629000000001 2020-11-16T20:56:20.560 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.560 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.560 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.560 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.776054+0000", 2020-11-16T20:56:20.560 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028210319999999998 2020-11-16T20:56:20.560 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.560 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.561 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:20.561 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.778875+0000", 2020-11-16T20:56:20.561 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0077083120000000001 2020-11-16T20:56:20.561 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.561 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.561 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.561 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786584+0000", 2020-11-16T20:56:20.561 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6310000000000006e-05 2020-11-16T20:56:20.562 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.562 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.562 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:20.562 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786660+0000", 2020-11-16T20:56:20.562 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019185 2020-11-16T20:56:20.562 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.562 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.563 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:20.563 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786852+0000", 2020-11-16T20:56:20.563 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023946682 2020-11-16T20:56:20.563 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.563 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:20.563 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.563 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.563 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.564 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2581 3.2 3:75836747:::smithi16641208-340:head [write 1742451~465507] snapc 14=[12,f,5] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e57)", 2020-11-16T20:56:20.564 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.763262+0000", 2020-11-16T20:56:20.564 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.62091717000000002, 2020-11-16T20:56:20.564 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023779689999999999, 2020-11-16T20:56:20.564 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:20.564 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:20.564 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:20.565 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.565 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:20.565 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.763262+0000", 2020-11-16T20:56:20.565 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:20.565 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.565 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.565 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:20.565 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.763262+0000", 2020-11-16T20:56:20.566 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00060551799999999999 2020-11-16T20:56:20.566 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.566 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.566 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:20.566 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.763868+0000", 2020-11-16T20:56:20.566 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4009999999999997e-06 2020-11-16T20:56:20.566 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.566 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.567 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:20.567 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.763876+0000", 2020-11-16T20:56:20.567 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5914e-05 2020-11-16T20:56:20.567 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.567 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.567 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:20.567 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.763902+0000", 2020-11-16T20:56:20.568 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1030000000000008e-06 2020-11-16T20:56:20.568 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.568 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.568 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:20.568 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.763911+0000", 2020-11-16T20:56:20.568 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044747320000000004 2020-11-16T20:56:20.568 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.568 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.569 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.569 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.768386+0000", 2020-11-16T20:56:20.569 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000145527 2020-11-16T20:56:20.569 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.569 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.569 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:20.569 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.768531+0000", 2020-11-16T20:56:20.570 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018354499999999999 2020-11-16T20:56:20.570 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.570 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.570 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:20.570 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.768715+0000", 2020-11-16T20:56:20.570 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0073865340000000002 2020-11-16T20:56:20.570 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.570 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.571 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.571 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.776102+0000", 2020-11-16T20:56:20.571 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002783911 2020-11-16T20:56:20.571 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.571 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.571 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:20.571 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.778885+0000", 2020-11-16T20:56:20.572 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0080263539999999994 2020-11-16T20:56:20.572 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.572 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.572 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.572 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786912+0000", 2020-11-16T20:56:20.572 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1526000000000006e-05 2020-11-16T20:56:20.572 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.572 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.573 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:20.573 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786983+0000", 2020-11-16T20:56:20.573 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8625000000000002e-05 2020-11-16T20:56:20.573 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.573 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.573 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:20.573 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787042+0000", 2020-11-16T20:56:20.574 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023779689999999999 2020-11-16T20:56:20.574 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.574 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:20.574 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.574 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.574 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.574 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:609 3.2 3:5eead97c:::smithi16641208-34:head [copy-from ver 27] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:56:20.574 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:56:20.575 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.59514129999999998, 2020-11-16T20:56:20.575 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.062626424, 2020-11-16T20:56:20.575 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:20.575 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:20.575 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:20.575 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.575 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:20.576 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:56:20.576 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:20.576 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.576 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.576 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:20.576 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:56:20.576 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3596000000000001e-05 2020-11-16T20:56:20.576 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.577 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.577 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:20.577 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789082+0000", 2020-11-16T20:56:20.577 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3209999999999999e-06 2020-11-16T20:56:20.577 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.577 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.577 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:20.577 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789089+0000", 2020-11-16T20:56:20.578 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3498e-05 2020-11-16T20:56:20.578 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.578 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.578 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:20.578 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789103+0000", 2020-11-16T20:56:20.578 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3679999999999998e-06 2020-11-16T20:56:20.578 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.579 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.579 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:20.579 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789109+0000", 2020-11-16T20:56:20.579 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007399638 2020-11-16T20:56:20.579 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.579 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.579 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.579 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.796509+0000", 2020-11-16T20:56:20.580 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000181168 2020-11-16T20:56:20.580 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.580 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.580 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:20.580 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.796690+0000", 2020-11-16T20:56:20.580 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01336562 2020-11-16T20:56:20.580 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.581 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.581 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:20.581 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.810055+0000", 2020-11-16T20:56:20.581 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044828350000000001 2020-11-16T20:56:20.581 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.581 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.581 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:20.581 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.814538+0000", 2020-11-16T20:56:20.582 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035609628999999997 2020-11-16T20:56:20.582 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.582 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.582 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.582 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850148+0000", 2020-11-16T20:56:20.582 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0013754730000000001 2020-11-16T20:56:20.582 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.583 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.583 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:20.583 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851523+0000", 2020-11-16T20:56:20.583 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9935e-05 2020-11-16T20:56:20.583 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.583 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.583 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:20.583 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851603+0000", 2020-11-16T20:56:20.584 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1342999999999999e-05 2020-11-16T20:56:20.584 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.584 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.584 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:20.584 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851665+0000", 2020-11-16T20:56:20.584 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.062626424 2020-11-16T20:56:20.584 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.584 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:20.585 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.585 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.585 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.585 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2605 4.0 4:2294fced:::smithi16641208-278:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:56:20.585 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:56:20.585 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 0.46730618400000001, 2020-11-16T20:56:20.585 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032301128999999998, 2020-11-16T20:56:20.586 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:20.586 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:20.586 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:20.586 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:20.586 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:20.586 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2605 2020-11-16T20:56:20.586 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.586 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:20.587 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.587 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:20.587 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:56:20.587 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:20.587 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.587 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.587 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:20.588 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:56:20.588 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.811e-05 2020-11-16T20:56:20.588 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.588 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.588 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:20.588 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916901+0000", 2020-11-16T20:56:20.588 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2939999999999996e-06 2020-11-16T20:56:20.588 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.589 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.589 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:20.589 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916907+0000", 2020-11-16T20:56:20.589 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0589e-05 2020-11-16T20:56:20.589 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.589 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.589 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:20.590 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916917+0000", 2020-11-16T20:56:20.590 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2549999999999999e-06 2020-11-16T20:56:20.590 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.590 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.590 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:20.590 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916921+0000", 2020-11-16T20:56:20.590 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033789099999999999 2020-11-16T20:56:20.590 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.591 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.591 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.591 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.917259+0000", 2020-11-16T20:56:20.591 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.25e-05 2020-11-16T20:56:20.591 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.591 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.591 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:20.592 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.917332+0000", 2020-11-16T20:56:20.592 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.028336376999999999 2020-11-16T20:56:20.592 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.592 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.592 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.592 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.945668+0000", 2020-11-16T20:56:20.592 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0983000000000006e-05 2020-11-16T20:56:20.592 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.593 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.593 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:20.593 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.945759+0000", 2020-11-16T20:56:20.593 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00324756 2020-11-16T20:56:20.593 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.593 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.593 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:20.593 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949007+0000", 2020-11-16T20:56:20.594 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0583999999999999e-05 2020-11-16T20:56:20.594 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.594 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.594 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:20.594 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949097+0000", 2020-11-16T20:56:20.594 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6985999999999998e-05 2020-11-16T20:56:20.595 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:20.595 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:20.595 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:20.595 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949174+0000", 2020-11-16T20:56:20.595 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032301128999999998 2020-11-16T20:56:20.595 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.595 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:20.595 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.596 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:20.596 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:20.596 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:20.597 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:56:20.598 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:56:20.598 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:56:20.598 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:56:20.598 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:56:20.598 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:20.601+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:20.599 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:56:20.616 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:56:20.636 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:56:20.658 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:56:20.659 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:56:20.659 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:56:20.659 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:56:20.660 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:56:20.660 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:56:20.660 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:56:20.660 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:56:20.660 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:56:20.698 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:20.703+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:20.743 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:20.747+0000 7f868ad23700 -1 osd.1 pg_epoch: 58 pg[3.0( v 58'442 (0'0,58'442] local-lis/les=19/20 n=128 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [1,2,6] r=0 lpr=19 luod=57'440 crt=58'442 lcod 57'438 mlcod 57'438 active+clean+snaptrim trimq=[5~1] ps=[4~1,7~1,c~3,14~1]] removing snap head 2020-11-16T20:56:20.746 INFO:tasks.rados.rados.0.smithi166.stdout:663: done (5 left) 2020-11-16T20:56:20.747 INFO:tasks.rados.rados.0.smithi166.stdout:664: cache_flush oid 132 snap -1 2020-11-16T20:56:20.747 INFO:tasks.rados.rados.0.smithi166.stdout:665: cache_try_flush oid 237 snap 9 2020-11-16T20:56:20.747 INFO:tasks.rados.rados.0.smithi166.stdout:666: read oid 400 snap 10 2020-11-16T20:56:20.747 INFO:tasks.rados.rados.0.smithi166.stdout:666: expect deleted 2020-11-16T20:56:20.747 INFO:tasks.rados.rados.0.smithi166.stdout:667: rollback oid 371 current snap is 12 2020-11-16T20:56:20.747 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 371 to 9 2020-11-16T20:56:20.748 INFO:tasks.rados.rados.0.smithi166.stdout:668: rollback oid 477 current snap is 12 2020-11-16T20:56:20.748 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 477 to 10 2020-11-16T20:56:20.748 INFO:tasks.rados.rados.0.smithi166.stdout:669: read oid 463 snap -1 2020-11-16T20:56:20.748 INFO:tasks.rados.rados.0.smithi166.stdout:669: expect (ObjNum 462 snap 0 seq_num 462) 2020-11-16T20:56:20.748 INFO:tasks.rados.rados.0.smithi166.stdout:670: rollback oid 459 current snap is 12 2020-11-16T20:56:20.748 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 459 to 10 2020-11-16T20:56:20.748 INFO:tasks.rados.rados.0.smithi166.stdout:671: read oid 177 snap 9 2020-11-16T20:56:20.749 INFO:tasks.rados.rados.0.smithi166.stdout:671: expect (ObjNum 176 snap 0 seq_num 176) 2020-11-16T20:56:20.749 INFO:tasks.rados.rados.0.smithi166.stdout:672: snap_create 2020-11-16T20:56:20.749 INFO:tasks.rados.rados.0.smithi166.stdout:660: got (2) No such file or directory 2020-11-16T20:56:20.749 INFO:tasks.rados.rados.0.smithi166.stdout:662: got (2) No such file or directory 2020-11-16T20:56:20.749 INFO:tasks.rados.rados.0.smithi166.stdout:658: finishing write tid 3 to smithi16641208-364 2020-11-16T20:56:20.749 INFO:tasks.rados.rados.0.smithi166.stdout:658: finishing write tid 4 to smithi16641208-364 2020-11-16T20:56:20.749 INFO:tasks.rados.rados.0.smithi166.stdout:658: finishing write tid 5 to smithi16641208-364 2020-11-16T20:56:20.749 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 364 v 554 (ObjNum 547 snap 12 seq_num 547) dirty exists 2020-11-16T20:56:20.750 INFO:tasks.rados.rados.0.smithi166.stdout:658: left oid 364 (ObjNum 547 snap 12 seq_num 547) 2020-11-16T20:56:20.750 INFO:tasks.rados.rados.0.smithi166.stdout:659: expect (ObjNum 411 snap 0 seq_num 411) 2020-11-16T20:56:20.755 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:20.756 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:20.757 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:20.759+0000 7f868ad23700 -1 osd.1 pg_epoch: 58 pg[3.0( v 58'446 (0'0,58'446] local-lis/les=19/20 n=127 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [1,2,6] r=0 lpr=19 luod=58'444 crt=58'446 lcod 58'442 mlcod 58'442 active+clean+snaptrim trimq=[5~1] ps=[4~1,7~1,c~3,14~1]] removing snap head 2020-11-16T20:56:20.772 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:56:20.784 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:20.789+0000 7f183b791700 -1 osd.4 pg_epoch: 58 pg[3.3( v 58'494 (0'0,58'494] local-lis/les=19/20 n=132 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [4,0,6] r=0 lpr=19 crt=58'494 lcod 58'492 mlcod 58'492 active+clean+snaptrim trimq=[5~1] ps=[4~1,7~1,c~3,14~1]] removing snap head 2020-11-16T20:56:20.794 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:20.797+0000 7f1d7e7f5700 -1 osd.3 pg_epoch: 58 pg[3.2( v 58'516 (0'0,58'516] local-lis/les=19/20 n=124 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [3,5,6] r=0 lpr=19 luod=58'514 crt=58'516 lcod 58'512 mlcod 58'512 active+clean+snaptrim trimq=[5~1] ps=[4~1,7~1,c~3,14~1]] removing snap head 2020-11-16T20:56:20.803 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:20.807+0000 7ff3cda4b700 -1 osd.0 pg_epoch: 58 pg[3.1( v 58'582 (0'0,58'582] local-lis/les=19/20 n=143 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [0,4,3] r=0 lpr=19 crt=58'582 lcod 58'580 mlcod 58'580 active+clean+snaptrim trimq=[5~1] ps=[4~1,7~1,c~3,14~1]] removing snap head 2020-11-16T20:56:20.804 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:20.808+0000 7ff3cda4b700 -1 osd.0 pg_epoch: 58 pg[3.1( v 58'584 (0'0,58'584] local-lis/les=19/20 n=141 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [0,4,3] r=0 lpr=19 luod=58'582 crt=58'584 lcod 58'580 mlcod 58'580 active+clean+snaptrim trimq=[5~1] ps=[4~1,7~1,c~3,14~1]] removing snap head 2020-11-16T20:56:20.828 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:20.833+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:20.859 INFO:tasks.rados.rados.0.smithi166.stdout:661: finishing copy_from to smithi16641208-278 2020-11-16T20:56:25.122 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 278 v 322 (ObjNum 359 snap 0 seq_num 359) dirty exists 2020-11-16T20:56:25.122 INFO:tasks.rados.rados.0.smithi166.stdout:661: finishing copy_from racing read to smithi16641208-278 2020-11-16T20:56:25.122 INFO:tasks.rados.rados.0.smithi166.stdout:665: got (2) No such file or directory 2020-11-16T20:56:25.123 INFO:tasks.rados.rados.0.smithi166.stdout:664: got (2) No such file or directory 2020-11-16T20:56:25.123 INFO:tasks.rados.rados.0.smithi166.stdout:670: finishing rollback tid 0 to smithi16641208-459 2020-11-16T20:56:25.123 INFO:tasks.rados.rados.0.smithi166.stdout:667: finishing rollback tid 0 to smithi16641208-371 2020-11-16T20:56:25.123 INFO:tasks.rados.rados.0.smithi166.stdout:669: expect (ObjNum 462 snap 0 seq_num 462) 2020-11-16T20:56:25.124 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2020-11-16T20:56:25.124 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:56:25.125 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:56:25.125 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:56:25.125 INFO:tasks.thrashosds.thrasher:Reweighting osd 6 to 0.5654873103867742 2020-11-16T20:56:25.125 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 0.5654873103867742 2020-11-16T20:56:25.132 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:25.132 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:25.132 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:25.129+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:25.133 INFO:tasks.rados.rados.0.smithi166.stdout:667: finishing rollback tid 1 to smithi16641208-371 2020-11-16T20:56:25.133 INFO:tasks.rados.rados.0.smithi166.stdout:667: finishing rollback tid 2 to smithi16641208-371 2020-11-16T20:56:25.133 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 371 v 486 (ObjNum 370 snap 0 seq_num 370) dirty exists 2020-11-16T20:56:25.133 INFO:tasks.rados.rados.0.smithi166.stdout:668: finishing rollback tid 0 to smithi16641208-477 2020-11-16T20:56:25.133 INFO:tasks.rados.rados.0.smithi166.stdout:671: expect (ObjNum 176 snap 0 seq_num 176) 2020-11-16T20:56:25.133 INFO:tasks.rados.rados.0.smithi166.stdout:670: finishing rollback tid 1 to smithi16641208-459 2020-11-16T20:56:25.134 INFO:tasks.rados.rados.0.smithi166.stdout:670: finishing rollback tid 2 to smithi16641208-459 2020-11-16T20:56:25.134 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 459 v 454 (ObjNum 458 snap 0 seq_num 458) dirty exists 2020-11-16T20:56:25.134 INFO:tasks.rados.rados.0.smithi166.stdout:668: finishing rollback tid 1 to smithi16641208-477 2020-11-16T20:56:25.134 INFO:tasks.rados.rados.0.smithi166.stdout:668: finishing rollback tid 2 to smithi16641208-477 2020-11-16T20:56:25.134 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 477 v 492 (ObjNum 476 snap 0 seq_num 476) dirty exists 2020-11-16T20:56:25.134 INFO:tasks.rados.rados.0.smithi166.stdout:658: done (13 left) 2020-11-16T20:56:25.134 INFO:tasks.rados.rados.0.smithi166.stdout:659: done (12 left) 2020-11-16T20:56:25.135 INFO:tasks.rados.rados.0.smithi166.stdout:660: done (11 left) 2020-11-16T20:56:25.135 INFO:tasks.rados.rados.0.smithi166.stdout:661: done (10 left) 2020-11-16T20:56:25.135 INFO:tasks.rados.rados.0.smithi166.stdout:662: done (9 left) 2020-11-16T20:56:25.135 INFO:tasks.rados.rados.0.smithi166.stdout:664: done (8 left) 2020-11-16T20:56:25.135 INFO:tasks.rados.rados.0.smithi166.stdout:665: done (7 left) 2020-11-16T20:56:25.135 INFO:tasks.rados.rados.0.smithi166.stdout:666: done (6 left) 2020-11-16T20:56:25.135 INFO:tasks.rados.rados.0.smithi166.stdout:667: done (5 left) 2020-11-16T20:56:25.135 INFO:tasks.rados.rados.0.smithi166.stdout:668: done (4 left) 2020-11-16T20:56:25.136 INFO:tasks.rados.rados.0.smithi166.stdout:669: done (3 left) 2020-11-16T20:56:25.136 INFO:tasks.rados.rados.0.smithi166.stdout:670: done (2 left) 2020-11-16T20:56:25.136 INFO:tasks.rados.rados.0.smithi166.stdout:671: done (1 left) 2020-11-16T20:56:25.136 INFO:tasks.rados.rados.0.smithi166.stdout:672: done (0 left) 2020-11-16T20:56:25.136 INFO:tasks.rados.rados.0.smithi166.stdout:673: write oid 499 current snap is 13 2020-11-16T20:56:25.136 INFO:tasks.rados.rados.0.smithi166.stdout:673: seq_num 548 ranges {410236=413868,1234250=729187,2715800=423063} 2020-11-16T20:56:25.136 INFO:tasks.rados.rados.0.smithi166.stdout:673: writing smithi16641208-499 from 410236 to 824104 tid 1 2020-11-16T20:56:25.137 INFO:tasks.rados.rados.0.smithi166.stdout:673: writing smithi16641208-499 from 1234250 to 1963437 tid 2 2020-11-16T20:56:25.137 INFO:tasks.rados.rados.0.smithi166.stdout:673: writing smithi16641208-499 from 2715800 to 3138863 tid 3 2020-11-16T20:56:25.137 INFO:tasks.rados.rados.0.smithi166.stdout:674: write (excl) oid 305 current snap is 13 2020-11-16T20:56:25.137 INFO:tasks.rados.rados.0.smithi166.stdout:673: finishing write tid 1 to smithi16641208-499 2020-11-16T20:56:25.137 INFO:tasks.rados.rados.0.smithi166.stdout:674: seq_num 549 ranges {427043=489117,1576379=472845,2626870=600173} 2020-11-16T20:56:25.137 INFO:tasks.rados.rados.0.smithi166.stdout:674: writing smithi16641208-305 from 427043 to 916160 tid 1 2020-11-16T20:56:25.137 INFO:tasks.rados.rados.0.smithi166.stdout:674: writing smithi16641208-305 from 1576379 to 2049224 tid 2 2020-11-16T20:56:25.137 INFO:tasks.rados.rados.0.smithi166.stdout:674: writing smithi16641208-305 from 2626870 to 3227043 tid 3 2020-11-16T20:56:25.138 INFO:tasks.rados.rados.0.smithi166.stdout:675: read oid 74 snap -1 2020-11-16T20:56:25.138 INFO:tasks.rados.rados.0.smithi166.stdout:675: expect (ObjNum 73 snap 0 seq_num 73) 2020-11-16T20:56:25.138 INFO:tasks.rados.rados.0.smithi166.stdout:676: write oid 315 current snap is 13 2020-11-16T20:56:25.138 INFO:tasks.rados.rados.0.smithi166.stdout:673: finishing write tid 2 to smithi16641208-499 2020-11-16T20:56:25.138 INFO:tasks.rados.rados.0.smithi166.stdout:673: finishing write tid 3 to smithi16641208-499 2020-11-16T20:56:25.138 INFO:tasks.rados.rados.0.smithi166.stdout:673: finishing write tid 4 to smithi16641208-499 2020-11-16T20:56:25.138 INFO:tasks.rados.rados.0.smithi166.stdout:676: seq_num 550 ranges {443850=564366,1634861=732856,2770646=473204} 2020-11-16T20:56:25.139 INFO:tasks.rados.rados.0.smithi166.stdout:676: writing smithi16641208-315 from 443850 to 1008216 tid 1 2020-11-16T20:56:25.139 INFO:tasks.rados.rados.0.smithi166.stdout:676: writing smithi16641208-315 from 1634861 to 2367717 tid 2 2020-11-16T20:56:25.139 INFO:tasks.rados.rados.0.smithi166.stdout:676: writing smithi16641208-315 from 2770646 to 3243850 tid 3 2020-11-16T20:56:25.139 INFO:tasks.rados.rados.0.smithi166.stdout:677: copy_from oid 105 from oid 12 current snap is 13 2020-11-16T20:56:25.139 INFO:tasks.rados.rados.0.smithi166.stdout:674: finishing write tid 1 to smithi16641208-305 2020-11-16T20:56:25.139 INFO:tasks.rados.rados.0.smithi166.stdout:673: finishing write tid 5 to smithi16641208-499 2020-11-16T20:56:25.139 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 499 v 513 (ObjNum 548 snap 13 seq_num 548) dirty exists 2020-11-16T20:56:25.139 INFO:tasks.rados.rados.0.smithi166.stdout:673: left oid 499 (ObjNum 548 snap 13 seq_num 548) 2020-11-16T20:56:25.140 INFO:tasks.rados.rados.0.smithi166.stdout:674: finishing write tid 2 to smithi16641208-305 2020-11-16T20:56:25.140 INFO:tasks.rados.rados.0.smithi166.stdout:674: finishing write tid 3 to smithi16641208-305 2020-11-16T20:56:25.140 INFO:tasks.rados.rados.0.smithi166.stdout:674: finishing write tid 4 to smithi16641208-305 2020-11-16T20:56:25.140 INFO:tasks.rados.rados.0.smithi166.stdout:673: done (4 left) 2020-11-16T20:56:25.140 INFO:tasks.rados.rados.0.smithi166.stdout:678: rollback oid 89 current snap is 13 2020-11-16T20:56:25.140 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 89 to 10 2020-11-16T20:56:25.140 INFO:tasks.rados.rados.0.smithi166.stdout:679: cache_evict oid 211 snap 9 2020-11-16T20:56:25.141 INFO:tasks.rados.rados.0.smithi166.stdout:680: read oid 210 snap 9 2020-11-16T20:56:25.141 INFO:tasks.rados.rados.0.smithi166.stdout:680: expect (ObjNum 209 snap 0 seq_num 209) 2020-11-16T20:56:25.141 INFO:tasks.rados.rados.0.smithi166.stdout:681: copy_from oid 205 from oid 214 current snap is 13 2020-11-16T20:56:25.141 INFO:tasks.rados.rados.0.smithi166.stdout:674: finishing write tid 5 to smithi16641208-305 2020-11-16T20:56:25.141 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 305 v 518 (ObjNum 549 snap 13 seq_num 549) dirty exists 2020-11-16T20:56:25.141 INFO:tasks.rados.rados.0.smithi166.stdout:674: left oid 305 (ObjNum 549 snap 13 seq_num 549) 2020-11-16T20:56:25.141 INFO:tasks.rados.rados.0.smithi166.stdout:674: done (7 left) 2020-11-16T20:56:25.141 INFO:tasks.rados.rados.0.smithi166.stdout:682: cache_try_flush oid 249 snap -1 2020-11-16T20:56:25.142 INFO:tasks.rados.rados.0.smithi166.stdout:683: snap_create 2020-11-16T20:56:25.142 INFO:tasks.rados.rados.0.smithi166.stdout:682: got (2) No such file or directory 2020-11-16T20:56:25.142 INFO:tasks.rados.rados.0.smithi166.stdout:675: expect (ObjNum 73 snap 0 seq_num 73) 2020-11-16T20:56:25.142 INFO:tasks.rados.rados.0.smithi166.stdout:679: got (0) Success 2020-11-16T20:56:25.142 INFO:tasks.rados.rados.0.smithi166.stdout:676: finishing write tid 1 to smithi16641208-315 2020-11-16T20:56:25.142 INFO:tasks.rados.rados.0.smithi166.stdout:677: finishing copy_from to smithi16641208-105 2020-11-16T20:56:25.142 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 105 v 9 (ObjNum 11 snap 0 seq_num 11) dirty exists 2020-11-16T20:56:25.143 INFO:tasks.rados.rados.0.smithi166.stdout:678: finishing rollback tid 0 to smithi16641208-89 2020-11-16T20:56:25.143 INFO:tasks.rados.rados.0.smithi166.stdout:680: expect (ObjNum 209 snap 0 seq_num 209) 2020-11-16T20:56:25.143 INFO:tasks.rados.rados.0.smithi166.stdout:681: finishing copy_from to smithi16641208-205 2020-11-16T20:56:25.143 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 205 v 133 (ObjNum 213 snap 0 seq_num 213) dirty exists 2020-11-16T20:56:25.143 INFO:tasks.rados.rados.0.smithi166.stdout:677: finishing copy_from racing read to smithi16641208-105 2020-11-16T20:56:25.143 INFO:tasks.rados.rados.0.smithi166.stdout:676: finishing write tid 2 to smithi16641208-315 2020-11-16T20:56:25.143 INFO:tasks.rados.rados.0.smithi166.stdout:676: finishing write tid 3 to smithi16641208-315 2020-11-16T20:56:25.143 INFO:tasks.rados.rados.0.smithi166.stdout:676: finishing write tid 4 to smithi16641208-315 2020-11-16T20:56:25.144 INFO:tasks.rados.rados.0.smithi166.stdout:676: finishing write tid 5 to smithi16641208-315 2020-11-16T20:56:25.144 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 315 v 599 (ObjNum 550 snap 13 seq_num 550) dirty exists 2020-11-16T20:56:25.144 INFO:tasks.rados.rados.0.smithi166.stdout:676: left oid 315 (ObjNum 550 snap 13 seq_num 550) 2020-11-16T20:56:25.144 INFO:tasks.rados.rados.0.smithi166.stdout:678: finishing rollback tid 1 to smithi16641208-89 2020-11-16T20:56:25.144 INFO:tasks.rados.rados.0.smithi166.stdout:678: finishing rollback tid 2 to smithi16641208-89 2020-11-16T20:56:25.144 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 89 v 601 (ObjNum 88 snap 0 seq_num 88) dirty exists 2020-11-16T20:56:25.144 INFO:tasks.rados.rados.0.smithi166.stdout:681: finishing copy_from racing read to smithi16641208-205 2020-11-16T20:56:25.145 INFO:tasks.rados.rados.0.smithi166.stdout:675: done (8 left) 2020-11-16T20:56:25.145 INFO:tasks.rados.rados.0.smithi166.stdout:676: done (7 left) 2020-11-16T20:56:25.145 INFO:tasks.rados.rados.0.smithi166.stdout:677: done (6 left) 2020-11-16T20:56:25.145 INFO:tasks.rados.rados.0.smithi166.stdout:678: done (5 left) 2020-11-16T20:56:25.145 INFO:tasks.rados.rados.0.smithi166.stdout:679: done (4 left) 2020-11-16T20:56:25.145 INFO:tasks.rados.rados.0.smithi166.stdout:680: done (3 left) 2020-11-16T20:56:25.145 INFO:tasks.rados.rados.0.smithi166.stdout:681: done (2 left) 2020-11-16T20:56:25.145 INFO:tasks.rados.rados.0.smithi166.stdout:682: done (1 left) 2020-11-16T20:56:25.146 INFO:tasks.rados.rados.0.smithi166.stdout:683: done (0 left) 2020-11-16T20:56:25.146 INFO:tasks.rados.rados.0.smithi166.stdout:684: copy_from oid 280 from oid 322 current snap is 14 2020-11-16T20:56:25.146 INFO:tasks.rados.rados.0.smithi166.stdout:685: cache_flush oid 40 snap -1 2020-11-16T20:56:25.146 INFO:tasks.rados.rados.0.smithi166.stdout:686: read oid 338 snap 13 2020-11-16T20:56:25.146 INFO:tasks.rados.rados.0.smithi166.stdout:686: expect (ObjNum 337 snap 0 seq_num 337) 2020-11-16T20:56:25.146 INFO:tasks.rados.rados.0.smithi166.stdout:687: write (excl) oid 215 current snap is 14 2020-11-16T20:56:25.146 INFO:tasks.rados.rados.0.smithi166.stdout:687: seq_num 551 ranges {460657=639615,1693343=476514,2681716=578941} 2020-11-16T20:56:25.147 INFO:tasks.rados.rados.0.smithi166.stdout:687: writing smithi16641208-215 from 460657 to 1100272 tid 1 2020-11-16T20:56:25.147 INFO:tasks.rados.rados.0.smithi166.stdout:687: writing smithi16641208-215 from 1693343 to 2169857 tid 2 2020-11-16T20:56:25.147 INFO:tasks.rados.rados.0.smithi166.stdout:687: writing smithi16641208-215 from 2681716 to 3260657 tid 3 2020-11-16T20:56:25.147 INFO:tasks.rados.rados.0.smithi166.stdout:688: cache_try_flush oid 202 snap -1 2020-11-16T20:56:25.147 INFO:tasks.rados.rados.0.smithi166.stdout:685: got (2) No such file or directory 2020-11-16T20:56:25.147 INFO:tasks.rados.rados.0.smithi166.stdout:685: done (4 left) 2020-11-16T20:56:25.147 INFO:tasks.rados.rados.0.smithi166.stdout:689: read oid 66 snap -1 2020-11-16T20:56:25.148 INFO:tasks.rados.rados.0.smithi166.stdout:689: expect (ObjNum 65 snap 0 seq_num 65) 2020-11-16T20:56:25.148 INFO:tasks.rados.rados.0.smithi166.stdout:690: read oid 344 snap 9 2020-11-16T20:56:25.148 INFO:tasks.rados.rados.0.smithi166.stdout:690: expect (ObjNum 343 snap 0 seq_num 343) 2020-11-16T20:56:25.148 INFO:tasks.rados.rados.0.smithi166.stdout:691: cache_evict oid 401 snap 10 2020-11-16T20:56:25.148 INFO:tasks.rados.rados.0.smithi166.stdout:686: expect (ObjNum 337 snap 0 seq_num 337) 2020-11-16T20:56:25.148 INFO:tasks.rados.rados.0.smithi166.stdout:687: finishing write tid 1 to smithi16641208-215 2020-11-16T20:56:25.148 INFO:tasks.rados.rados.0.smithi166.stdout:691: got (0) Success 2020-11-16T20:56:25.148 INFO:tasks.rados.rados.0.smithi166.stdout:689: expect (ObjNum 65 snap 0 seq_num 65) 2020-11-16T20:56:25.149 INFO:tasks.rados.rados.0.smithi166.stdout:690: expect (ObjNum 343 snap 0 seq_num 343) 2020-11-16T20:56:25.149 INFO:tasks.rados.rados.0.smithi166.stdout:684: finishing copy_from to smithi16641208-280 2020-11-16T20:56:25.149 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 280 v 229 (ObjNum 321 snap 0 seq_num 321) dirty exists 2020-11-16T20:56:25.149 INFO:tasks.rados.rados.0.smithi166.stdout:687: finishing write tid 2 to smithi16641208-215 2020-11-16T20:56:25.149 INFO:tasks.rados.rados.0.smithi166.stdout:688: got (0) Success 2020-11-16T20:56:25.149 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 202 v 0 (ObjNum 201 snap 0 seq_num 201) dirty exists 2020-11-16T20:56:25.149 INFO:tasks.rados.rados.0.smithi166.stdout:687: finishing write tid 3 to smithi16641208-215 2020-11-16T20:56:25.149 INFO:tasks.rados.rados.0.smithi166.stdout:687: finishing write tid 4 to smithi16641208-215 2020-11-16T20:56:25.150 INFO:tasks.rados.rados.0.smithi166.stdout:686: done (6 left) 2020-11-16T20:56:25.150 INFO:tasks.rados.rados.0.smithi166.stdout:688: done (5 left) 2020-11-16T20:56:25.150 INFO:tasks.rados.rados.0.smithi166.stdout:689: done (4 left) 2020-11-16T20:56:25.150 INFO:tasks.rados.rados.0.smithi166.stdout:690: done (3 left) 2020-11-16T20:56:25.150 INFO:tasks.rados.rados.0.smithi166.stdout:691: done (2 left) 2020-11-16T20:56:25.150 INFO:tasks.rados.rados.0.smithi166.stdout:692: delete oid 352 current snap is 14 2020-11-16T20:56:25.151 INFO:tasks.rados.rados.0.smithi166.stdout:684: finishing copy_from racing read to smithi16641208-280 2020-11-16T20:56:25.151 INFO:tasks.rados.rados.0.smithi166.stdout:687: finishing write tid 5 to smithi16641208-215 2020-11-16T20:56:25.151 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 215 v 525 (ObjNum 551 snap 14 seq_num 551) dirty exists 2020-11-16T20:56:25.151 INFO:tasks.rados.rados.0.smithi166.stdout:687: left oid 215 (ObjNum 551 snap 14 seq_num 551) 2020-11-16T20:56:25.151 INFO:tasks.rados.rados.0.smithi166.stdout:684: done (2 left) 2020-11-16T20:56:25.151 INFO:tasks.rados.rados.0.smithi166.stdout:687: done (1 left) 2020-11-16T20:56:25.151 INFO:tasks.rados.rados.0.smithi166.stdout:692: done (0 left) 2020-11-16T20:56:25.152 INFO:tasks.rados.rados.0.smithi166.stdout:693: cache_flush oid 35 snap -1 2020-11-16T20:56:25.152 INFO:tasks.rados.rados.0.smithi166.stdout:694: read oid 167 snap 9 2020-11-16T20:56:25.152 INFO:tasks.rados.rados.0.smithi166.stdout:694: expect (ObjNum 166 snap 0 seq_num 166) 2020-11-16T20:56:25.152 INFO:tasks.rados.rados.0.smithi166.stdout:695: cache_evict oid 455 snap -1 2020-11-16T20:56:25.152 INFO:tasks.rados.rados.0.smithi166.stdout:696: read oid 263 snap 12 2020-11-16T20:56:25.152 INFO:tasks.rados.rados.0.smithi166.stdout:696: expect (ObjNum 262 snap 0 seq_num 262) 2020-11-16T20:56:25.152 INFO:tasks.rados.rados.0.smithi166.stdout:697: cache_evict oid 472 snap -1 2020-11-16T20:56:25.152 INFO:tasks.rados.rados.0.smithi166.stdout:698: cache_evict oid 491 snap -1 2020-11-16T20:56:25.153 INFO:tasks.rados.rados.0.smithi166.stdout:699: snap_remove snap 10 2020-11-16T20:56:25.153 INFO:tasks.rados.rados.0.smithi166.stdout:699: done (6 left) 2020-11-16T20:56:25.153 INFO:tasks.rados.rados.0.smithi166.stdout:700: read oid 368 snap -1 2020-11-16T20:56:25.153 INFO:tasks.rados.rados.0.smithi166.stdout:700: expect (ObjNum 367 snap 0 seq_num 367) 2020-11-16T20:56:25.153 INFO:tasks.rados.rados.0.smithi166.stdout:701: snap_remove snap 13 2020-11-16T20:56:25.153 INFO:tasks.rados.rados.0.smithi166.stdout:701: done (7 left) 2020-11-16T20:56:25.153 INFO:tasks.rados.rados.0.smithi166.stdout:702: cache_flush oid 398 snap -1 2020-11-16T20:56:25.153 INFO:tasks.rados.rados.0.smithi166.stdout:703: cache_try_flush oid 470 snap -1 2020-11-16T20:56:25.154 INFO:tasks.rados.rados.0.smithi166.stdout:704: rollback oid 340 current snap is 14 2020-11-16T20:56:25.154 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 340 to 12 2020-11-16T20:56:25.154 INFO:tasks.rados.rados.0.smithi166.stdout:705: cache_flush oid 407 snap -1 2020-11-16T20:56:25.154 INFO:tasks.rados.rados.0.smithi166.stdout:706: read oid 488 snap -1 2020-11-16T20:56:25.154 INFO:tasks.rados.rados.0.smithi166.stdout:706: expect (ObjNum 487 snap 0 seq_num 487) 2020-11-16T20:56:25.154 INFO:tasks.rados.rados.0.smithi166.stdout:707: snap_create 2020-11-16T20:56:25.154 INFO:tasks.rados.rados.0.smithi166.stdout:695: got (2) No such file or directory 2020-11-16T20:56:25.155 INFO:tasks.rados.rados.0.smithi166.stdout:698: got (16) Device or resource busy 2020-11-16T20:56:25.155 INFO:tasks.rados.rados.0.smithi166.stdout:697: got (2) No such file or directory 2020-11-16T20:56:25.155 INFO:tasks.rados.rados.0.smithi166.stdout:696: expect (ObjNum 262 snap 0 seq_num 262) 2020-11-16T20:56:25.155 INFO:tasks.rados.rados.0.smithi166.stdout:694: expect (ObjNum 166 snap 0 seq_num 166) 2020-11-16T20:56:25.155 INFO:tasks.rados.rados.0.smithi166.stdout:693: got (0) Success 2020-11-16T20:56:25.155 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 35 v 0 (ObjNum 34 snap 0 seq_num 34) dirty exists 2020-11-16T20:56:25.155 INFO:tasks.rados.rados.0.smithi166.stdout:700: expect (ObjNum 367 snap 0 seq_num 367) 2020-11-16T20:56:25.156 INFO:tasks.rados.rados.0.smithi166.stdout:703: got (2) No such file or directory 2020-11-16T20:56:25.156 INFO:tasks.rados.rados.0.smithi166.stdout:704: finishing rollback tid 0 to smithi16641208-340 2020-11-16T20:56:25.156 INFO:tasks.rados.rados.0.smithi166.stdout:704: finishing rollback tid 1 to smithi16641208-340 2020-11-16T20:56:25.156 INFO:tasks.rados.rados.0.smithi166.stdout:706: expect (ObjNum 487 snap 0 seq_num 487) 2020-11-16T20:56:25.156 INFO:tasks.rados.rados.0.smithi166.stdout:704: finishing rollback tid 2 to smithi16641208-340 2020-11-16T20:56:25.156 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 340 v 499 (ObjNum 545 snap 12 seq_num 545) dirty exists 2020-11-16T20:56:25.156 INFO:tasks.rados.rados.0.smithi166.stdout:702: got (0) Success 2020-11-16T20:56:25.156 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 398 v 0 (ObjNum 397 snap 0 seq_num 397) dirty exists 2020-11-16T20:56:25.157 INFO:tasks.rados.rados.0.smithi166.stdout:705: got (0) Success 2020-11-16T20:56:25.157 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 407 v 0 (ObjNum 521 snap 6 seq_num 521) dirty exists 2020-11-16T20:56:25.157 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:56:25.224 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:25.229+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:25.306 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:56:25.315 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:25.315 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:25.325 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:56:25.326 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:25.329+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:25.327 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:56:25.348 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:56:25.369 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:56:25.389 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:56:25.409 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:56:25.426 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:25.430+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:25.429 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:56:25.448 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:56:25.450 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:56:25.450 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:56:25.451 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:56:25.451 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:56:25.451 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:56:25.451 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:56:25.451 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:56:25.451 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:56:25.503 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:25.504 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:25.504 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:56:25.504 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:25.513 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:56:25.528 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:25.532+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:25.628 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:25.633+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:25.648 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:25.648 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:25.648 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:56:25.649 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:56:25.649 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:25.658 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:56:25.729 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:25.733+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:25.732 INFO:tasks.rados.rados.0.smithi166.stdout:693: done (12 left) 2020-11-16T20:56:25.732 INFO:tasks.rados.rados.0.smithi166.stdout:694: done (11 left) 2020-11-16T20:56:25.732 INFO:tasks.rados.rados.0.smithi166.stdout:695: done (10 left) 2020-11-16T20:56:25.732 INFO:tasks.rados.rados.0.smithi166.stdout:696: done (9 left) 2020-11-16T20:56:25.733 INFO:tasks.rados.rados.0.smithi166.stdout:697: done (8 left) 2020-11-16T20:56:25.733 INFO:tasks.rados.rados.0.smithi166.stdout:698: done (7 left) 2020-11-16T20:56:25.733 INFO:tasks.rados.rados.0.smithi166.stdout:700: done (6 left) 2020-11-16T20:56:25.733 INFO:tasks.rados.rados.0.smithi166.stdout:702: done (5 left) 2020-11-16T20:56:25.733 INFO:tasks.rados.rados.0.smithi166.stdout:703: done (4 left) 2020-11-16T20:56:25.733 INFO:tasks.rados.rados.0.smithi166.stdout:704: done (3 left) 2020-11-16T20:56:25.733 INFO:tasks.rados.rados.0.smithi166.stdout:705: done (2 left) 2020-11-16T20:56:25.734 INFO:tasks.rados.rados.0.smithi166.stdout:706: done (1 left) 2020-11-16T20:56:25.734 INFO:tasks.rados.rados.0.smithi166.stdout:707: done (0 left) 2020-11-16T20:56:25.734 INFO:tasks.rados.rados.0.smithi166.stdout:708: copy_from oid 225 from oid 96 current snap is 15 2020-11-16T20:56:25.734 INFO:tasks.rados.rados.0.smithi166.stdout:709: cache_evict oid 83 snap 12 2020-11-16T20:56:25.734 INFO:tasks.rados.rados.0.smithi166.stdout:710: snap_create 2020-11-16T20:56:25.735 INFO:tasks.rados.rados.0.smithi166.stdout:709: got (2) No such file or directory 2020-11-16T20:56:25.735 INFO:teuthology.orchestra.run.smithi166.stderr:noscrub is unset 2020-11-16T20:56:25.735 INFO:teuthology.orchestra.run.smithi166.stderr:reweighted osd.6 to 0.565487 (90c3) 2020-11-16T20:56:25.765 INFO:tasks.rados.rados.0.smithi166.stdout:708: finishing copy_from to smithi16641208-225 2020-11-16T20:56:25.765 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 225 v 29 (ObjNum 95 snap 0 seq_num 95) dirty exists 2020-11-16T20:56:25.765 INFO:tasks.rados.rados.0.smithi166.stdout:708: finishing copy_from racing read to smithi16641208-225 2020-11-16T20:56:25.830 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:25.834+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:25.841 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:25.841 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:56:25.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:56:25.841 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:56:25.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.842 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:37 4.1 e33/22 4:b6545a47:::smithi16641208-46:head v 33'28, mlcod=33'26)", 2020-11-16T20:56:25.842 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.515282+0000", 2020-11-16T20:56:25.842 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 34.329412699000002, 2020-11-16T20:56:25.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016792344000000001, 2020-11-16T20:56:25.842 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:25.842 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:25.843 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:25.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:25.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.515282+0000", 2020-11-16T20:56:25.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:25.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.515282+0000", 2020-11-16T20:56:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0010571840000000001 2020-11-16T20:56:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516339+0000", 2020-11-16T20:56:25.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3354e-05 2020-11-16T20:56:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516352+0000", 2020-11-16T20:56:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7071999999999998e-05 2020-11-16T20:56:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516369+0000", 2020-11-16T20:56:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1358e-05 2020-11-16T20:56:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:25.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516381+0000", 2020-11-16T20:56:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5952999999999998e-05 2020-11-16T20:56:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516437+0000", 2020-11-16T20:56:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5420999999999998e-05 2020-11-16T20:56:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516472+0000", 2020-11-16T20:56:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015544192 2020-11-16T20:56:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532016+0000", 2020-11-16T20:56:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7809999999999997e-05 2020-11-16T20:56:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532074+0000", 2020-11-16T20:56:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016792344000000001 2020-11-16T20:56:25.849 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:39 4.1 e33/22 4:81558809:::smithi16641208-47:head v 33'30, mlcod=33'26)", 2020-11-16T20:56:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.519956+0000", 2020-11-16T20:56:25.850 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 34.324738551999999, 2020-11-16T20:56:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017898104000000001, 2020-11-16T20:56:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:25.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519956+0000", 2020-11-16T20:56:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519956+0000", 2020-11-16T20:56:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00038710900000000001 2020-11-16T20:56:25.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520343+0000", 2020-11-16T20:56:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0797e-05 2020-11-16T20:56:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:25.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520354+0000", 2020-11-16T20:56:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5874000000000001e-05 2020-11-16T20:56:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520370+0000", 2020-11-16T20:56:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3580000000000003e-06 2020-11-16T20:56:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520378+0000", 2020-11-16T20:56:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5744000000000001e-05 2020-11-16T20:56:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520424+0000", 2020-11-16T20:56:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4641e-05 2020-11-16T20:56:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520449+0000", 2020-11-16T20:56:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01735014 2020-11-16T20:56:25.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.537799+0000", 2020-11-16T20:56:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5441e-05 2020-11-16T20:56:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.537854+0000", 2020-11-16T20:56:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017898104000000001 2020-11-16T20:56:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.858 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:280 4.3 e35/22 4:c9fee0b4:::smithi16641208-235:head v 35'58, mlcod=35'56)", 2020-11-16T20:56:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.763889+0000", 2020-11-16T20:56:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 31.080805550000001, 2020-11-16T20:56:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013950272999999999, 2020-11-16T20:56:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:25.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.763889+0000", 2020-11-16T20:56:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.763889+0000", 2020-11-16T20:56:25.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047249290000000001 2020-11-16T20:56:25.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:25.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768614+0000", 2020-11-16T20:56:25.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.046e-05 2020-11-16T20:56:25.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:25.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768624+0000", 2020-11-16T20:56:25.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3501e-05 2020-11-16T20:56:25.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:25.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768638+0000", 2020-11-16T20:56:25.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9279999999999993e-06 2020-11-16T20:56:25.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:25.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768646+0000", 2020-11-16T20:56:25.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3752999999999999e-05 2020-11-16T20:56:25.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:25.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768690+0000", 2020-11-16T20:56:25.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7498000000000001e-05 2020-11-16T20:56:25.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:25.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768707+0000", 2020-11-16T20:56:25.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0090558849999999996 2020-11-16T20:56:25.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:25.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.777763+0000", 2020-11-16T20:56:25.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6318999999999999e-05 2020-11-16T20:56:25.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:25.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.777839+0000", 2020-11-16T20:56:25.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013950272999999999 2020-11-16T20:56:25.866 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.866 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:25.866 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.867 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:202 3.2 e35/19 3:5723fd94:::smithi16641208-211:head v 35'124, mlcod=35'121)", 2020-11-16T20:56:25.867 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.980847+0000", 2020-11-16T20:56:25.867 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.863847793000001, 2020-11-16T20:56:25.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015747763000000001, 2020-11-16T20:56:25.867 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:25.867 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:25.867 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:25.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:25.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.980847+0000", 2020-11-16T20:56:25.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:25.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:25.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.980847+0000", 2020-11-16T20:56:25.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072722660000000003 2020-11-16T20:56:25.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:25.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988119+0000", 2020-11-16T20:56:25.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2539e-05 2020-11-16T20:56:25.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:25.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988132+0000", 2020-11-16T20:56:25.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3723000000000001e-05 2020-11-16T20:56:25.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:25.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988145+0000", 2020-11-16T20:56:25.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8379999999999998e-06 2020-11-16T20:56:25.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:25.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988151+0000", 2020-11-16T20:56:25.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2691000000000002e-05 2020-11-16T20:56:25.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:25.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988194+0000", 2020-11-16T20:56:25.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8366e-05 2020-11-16T20:56:25.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:25.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988212+0000", 2020-11-16T20:56:25.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0083214259999999998 2020-11-16T20:56:25.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:25.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.996534+0000", 2020-11-16T20:56:25.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0914e-05 2020-11-16T20:56:25.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:25.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.996595+0000", 2020-11-16T20:56:25.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015747763000000001 2020-11-16T20:56:25.874 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.874 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:25.875 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.875 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:538 4.3 e41/22 4:c9160c9c:::smithi16641208-411:head v 41'95, mlcod=37'93)", 2020-11-16T20:56:25.875 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:56:25.875 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 21.719048742999998, 2020-11-16T20:56:25.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021023377999999999, 2020-11-16T20:56:25.876 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:25.876 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:25.876 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:25.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:25.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:56:25.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:25.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:25.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:56:25.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052206140000000002 2020-11-16T20:56:25.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:25.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130866+0000", 2020-11-16T20:56:25.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0824e-05 2020-11-16T20:56:25.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:25.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130877+0000", 2020-11-16T20:56:25.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5384e-05 2020-11-16T20:56:25.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:25.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130893+0000", 2020-11-16T20:56:25.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0064999999999999e-05 2020-11-16T20:56:25.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:25.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130903+0000", 2020-11-16T20:56:25.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3051000000000003e-05 2020-11-16T20:56:25.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:25.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130966+0000", 2020-11-16T20:56:25.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9724e-05 2020-11-16T20:56:25.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.881 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:25.881 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130985+0000", 2020-11-16T20:56:25.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015638332000000001 2020-11-16T20:56:25.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:25.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.146624+0000", 2020-11-16T20:56:25.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5383999999999998e-05 2020-11-16T20:56:25.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:25.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.146669+0000", 2020-11-16T20:56:25.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021023377999999999 2020-11-16T20:56:25.883 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.883 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:25.883 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.883 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:547 3.2 e42/19 3:5f250a2b:::smithi16641208-75:head v 42'381, mlcod=42'379)", 2020-11-16T20:56:25.884 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.026221+0000", 2020-11-16T20:56:25.884 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.818473208, 2020-11-16T20:56:25.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014398213, 2020-11-16T20:56:25.884 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:25.884 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:25.884 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:25.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.884 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:25.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.026221+0000", 2020-11-16T20:56:25.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:25.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.885 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:25.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.026221+0000", 2020-11-16T20:56:25.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052355140000000001 2020-11-16T20:56:25.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:25.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031457+0000", 2020-11-16T20:56:25.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3457e-05 2020-11-16T20:56:25.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:25.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031470+0000", 2020-11-16T20:56:25.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6532e-05 2020-11-16T20:56:25.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:25.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031487+0000", 2020-11-16T20:56:25.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6479999999999992e-06 2020-11-16T20:56:25.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.888 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:25.888 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031496+0000", 2020-11-16T20:56:25.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5820000000000003e-05 2020-11-16T20:56:25.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:25.889 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031561+0000", 2020-11-16T20:56:25.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6701999999999999e-05 2020-11-16T20:56:25.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:25.889 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031588+0000", 2020-11-16T20:56:25.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089396879999999995 2020-11-16T20:56:25.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.890 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:25.890 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.040528+0000", 2020-11-16T20:56:25.890 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1852000000000001e-05 2020-11-16T20:56:25.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.891 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:25.891 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.040620+0000", 2020-11-16T20:56:25.891 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014398213 2020-11-16T20:56:25.891 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.891 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:25.891 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.892 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.892 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2367 4.2 e42/22 4:581c1e5b:::smithi16641208-124:head v 42'136, mlcod=42'133)", 2020-11-16T20:56:25.892 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:56:25.892 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.791350365, 2020-11-16T20:56:25.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021196474999999999, 2020-11-16T20:56:25.892 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:25.892 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:25.892 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:25.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:25.893 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:56:25.893 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:25.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:25.894 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:56:25.894 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070663000000000002 2020-11-16T20:56:25.894 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.894 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.894 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:25.894 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060411+0000", 2020-11-16T20:56:25.894 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0189999999999995e-06 2020-11-16T20:56:25.894 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.895 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.895 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:25.895 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060420+0000", 2020-11-16T20:56:25.895 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0069e-05 2020-11-16T20:56:25.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.895 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.895 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:25.896 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060430+0000", 2020-11-16T20:56:25.896 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6879999999999999e-06 2020-11-16T20:56:25.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.896 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:25.896 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060437+0000", 2020-11-16T20:56:25.896 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3671999999999995e-05 2020-11-16T20:56:25.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.897 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.897 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:25.897 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060511+0000", 2020-11-16T20:56:25.897 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6801999999999998e-05 2020-11-16T20:56:25.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.897 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.897 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:25.898 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060548+0000", 2020-11-16T20:56:25.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013927701000000001 2020-11-16T20:56:25.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.898 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:25.898 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074475+0000", 2020-11-16T20:56:25.899 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5223999999999998e-05 2020-11-16T20:56:25.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.899 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.899 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:25.899 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074541+0000", 2020-11-16T20:56:25.899 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021196474999999999 2020-11-16T20:56:25.899 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.900 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:25.900 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.900 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.900 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:507 4.2 e42/22 4:646fee8a:::smithi16641208-407:head v 42'137, mlcod=42'133)", 2020-11-16T20:56:25.901 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.060496+0000", 2020-11-16T20:56:25.901 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.784199039000001, 2020-11-16T20:56:25.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014098016999999999, 2020-11-16T20:56:25.901 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:25.901 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:25.901 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:25.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:25.902 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060496+0000", 2020-11-16T20:56:25.902 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:25.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.902 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:25.902 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060496+0000", 2020-11-16T20:56:25.902 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054601980000000003 2020-11-16T20:56:25.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.903 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:25.903 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.065956+0000", 2020-11-16T20:56:25.903 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0848e-05 2020-11-16T20:56:25.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:25.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.065967+0000", 2020-11-16T20:56:25.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2801e-05 2020-11-16T20:56:25.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:25.905 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.065979+0000", 2020-11-16T20:56:25.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0550999999999999e-05 2020-11-16T20:56:25.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.905 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:25.905 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.065990+0000", 2020-11-16T20:56:25.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6890000000000005e-05 2020-11-16T20:56:25.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.906 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:25.906 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.066057+0000", 2020-11-16T20:56:25.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4836000000000001e-05 2020-11-16T20:56:25.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.907 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:25.907 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.066082+0000", 2020-11-16T20:56:25.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084662330000000001 2020-11-16T20:56:25.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.907 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.907 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:25.907 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074548+0000", 2020-11-16T20:56:25.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.566e-05 2020-11-16T20:56:25.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.908 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:25.908 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074594+0000", 2020-11-16T20:56:25.908 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014098016999999999 2020-11-16T20:56:25.908 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.908 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:25.909 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.909 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:554 3.2 e42/19 3:769099fd:::smithi16641208-247:head v 42'386, mlcod=42'384)", 2020-11-16T20:56:25.909 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:56:25.909 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.774431392, 2020-11-16T20:56:25.909 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029531213000000001, 2020-11-16T20:56:25.909 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:25.910 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:25.910 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:25.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:25.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:56:25.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:25.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.911 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:25.911 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:56:25.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007828448 2020-11-16T20:56:25.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.911 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:25.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078092+0000", 2020-11-16T20:56:25.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2031000000000001e-05 2020-11-16T20:56:25.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.912 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:25.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078104+0000", 2020-11-16T20:56:25.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3950000000000001e-06 2020-11-16T20:56:25.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.913 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:25.913 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078112+0000", 2020-11-16T20:56:25.913 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.434e-06 2020-11-16T20:56:25.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.913 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:25.913 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078117+0000", 2020-11-16T20:56:25.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0217999999999999e-05 2020-11-16T20:56:25.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:25.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078168+0000", 2020-11-16T20:56:25.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6242e-05 2020-11-16T20:56:25.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.915 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:25.915 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078194+0000", 2020-11-16T20:56:25.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021550488 2020-11-16T20:56:25.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.915 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:25.915 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099744+0000", 2020-11-16T20:56:25.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9957000000000003e-05 2020-11-16T20:56:25.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:25.916 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099794+0000", 2020-11-16T20:56:25.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029531213000000001 2020-11-16T20:56:25.916 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.917 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:25.917 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.917 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2376 4.2 e42/22 4:540952ab:::smithi16641208-369:head v 42'142, mlcod=42'136)", 2020-11-16T20:56:25.917 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.077213+0000", 2020-11-16T20:56:25.917 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.767481296, 2020-11-16T20:56:25.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015666645, 2020-11-16T20:56:25.918 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:25.918 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:25.918 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:25.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:25.918 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077213+0000", 2020-11-16T20:56:25.918 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:25.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.919 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:25.919 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077213+0000", 2020-11-16T20:56:25.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9294e-05 2020-11-16T20:56:25.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.919 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:25.920 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077253+0000", 2020-11-16T20:56:25.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6004e-05 2020-11-16T20:56:25.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.920 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:25.920 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077279+0000", 2020-11-16T20:56:25.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.291e-05 2020-11-16T20:56:25.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:25.921 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077291+0000", 2020-11-16T20:56:25.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.225e-05 2020-11-16T20:56:25.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:25.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077304+0000", 2020-11-16T20:56:25.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9744e-05 2020-11-16T20:56:25.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.922 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:25.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077393+0000", 2020-11-16T20:56:25.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5826e-05 2020-11-16T20:56:25.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:25.923 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077419+0000", 2020-11-16T20:56:25.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015403659 2020-11-16T20:56:25.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:25.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.092823+0000", 2020-11-16T20:56:25.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6957999999999999e-05 2020-11-16T20:56:25.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:25.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.092880+0000", 2020-11-16T20:56:25.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015666645 2020-11-16T20:56:25.925 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.925 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:25.925 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.925 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:555 3.2 e42/19 3:590e6edd:::smithi16641208-203:head v 42'387, mlcod=42'384)", 2020-11-16T20:56:25.925 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:56:25.926 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.766550548000001, 2020-11-16T20:56:25.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021681786000000002, 2020-11-16T20:56:25.926 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:25.926 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:25.926 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:25.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:25.926 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:56:25.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:25.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:25.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:56:25.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6817999999999998e-05 2020-11-16T20:56:25.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:25.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078191+0000", 2020-11-16T20:56:25.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7800000000000003e-06 2020-11-16T20:56:25.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:25.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078198+0000", 2020-11-16T20:56:25.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0331e-05 2020-11-16T20:56:25.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:25.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078208+0000", 2020-11-16T20:56:25.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8429999999999998e-06 2020-11-16T20:56:25.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:25.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078214+0000", 2020-11-16T20:56:25.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0025044690000000001 2020-11-16T20:56:25.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:25.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080718+0000", 2020-11-16T20:56:25.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027441100000000001 2020-11-16T20:56:25.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.931 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:25.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080993+0000", 2020-11-16T20:56:25.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018806976999999999 2020-11-16T20:56:25.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:25.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099800+0000", 2020-11-16T20:56:25.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6157e-05 2020-11-16T20:56:25.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:25.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099826+0000", 2020-11-16T20:56:25.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021681786000000002 2020-11-16T20:56:25.933 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.933 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:25.933 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.933 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:485 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'94, mlcod=41'92)", 2020-11-16T20:56:25.934 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:56:25.934 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.765981580999998, 2020-11-16T20:56:25.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021768460999999999, 2020-11-16T20:56:25.934 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:25.934 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:25.934 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:25.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:25.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:56:25.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:25.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:25.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:56:25.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001603103 2020-11-16T20:56:25.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:25.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080316+0000", 2020-11-16T20:56:25.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4956e-05 2020-11-16T20:56:25.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:25.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080331+0000", 2020-11-16T20:56:25.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6291e-05 2020-11-16T20:56:25.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:25.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080347+0000", 2020-11-16T20:56:25.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3090000000000001e-06 2020-11-16T20:56:25.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:25.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080357+0000", 2020-11-16T20:56:25.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7073000000000001e-05 2020-11-16T20:56:25.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:25.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080414+0000", 2020-11-16T20:56:25.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5877e-05 2020-11-16T20:56:25.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:25.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080440+0000", 2020-11-16T20:56:25.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019927006000000001 2020-11-16T20:56:25.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:25.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100367+0000", 2020-11-16T20:56:25.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114846 2020-11-16T20:56:25.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:25.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100481+0000", 2020-11-16T20:56:25.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021768460999999999 2020-11-16T20:56:25.941 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.942 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:25.942 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.942 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:556 3.2 e42/19 3:590e6edd:::smithi16641208-203:head v 42'388, mlcod=42'384)", 2020-11-16T20:56:25.942 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.081175+0000", 2020-11-16T20:56:25.943 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.763519699, 2020-11-16T20:56:25.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020119680000000001, 2020-11-16T20:56:25.943 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:25.943 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:25.943 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:25.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:25.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081175+0000", 2020-11-16T20:56:25.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:25.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.944 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:25.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081175+0000", 2020-11-16T20:56:25.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084338599999999996 2020-11-16T20:56:25.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:25.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089609+0000", 2020-11-16T20:56:25.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1812e-05 2020-11-16T20:56:25.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:25.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089621+0000", 2020-11-16T20:56:25.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6175e-05 2020-11-16T20:56:25.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:25.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089637+0000", 2020-11-16T20:56:25.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2799999999999992e-06 2020-11-16T20:56:25.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.947 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:25.947 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089646+0000", 2020-11-16T20:56:25.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1341999999999998e-05 2020-11-16T20:56:25.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.947 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:25.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089687+0000", 2020-11-16T20:56:25.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3351999999999999e-05 2020-11-16T20:56:25.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:25.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089711+0000", 2020-11-16T20:56:25.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011527864000000001 2020-11-16T20:56:25.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:25.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101239+0000", 2020-11-16T20:56:25.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5995000000000002e-05 2020-11-16T20:56:25.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:25.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101295+0000", 2020-11-16T20:56:25.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020119680000000001 2020-11-16T20:56:25.950 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.950 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:25.950 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.951 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2370 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'95, mlcod=41'92)", 2020-11-16T20:56:25.951 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.083328+0000", 2020-11-16T20:56:25.951 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.761366998, 2020-11-16T20:56:25.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01719561, 2020-11-16T20:56:25.951 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:25.951 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:25.951 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:25.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.952 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:25.952 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083328+0000", 2020-11-16T20:56:25.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:25.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.952 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:25.952 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083328+0000", 2020-11-16T20:56:25.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00037936799999999999 2020-11-16T20:56:25.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.953 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.953 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:25.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083707+0000", 2020-11-16T20:56:25.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7088999999999999e-05 2020-11-16T20:56:25.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:25.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083724+0000", 2020-11-16T20:56:25.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6737999999999999e-05 2020-11-16T20:56:25.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:25.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083771+0000", 2020-11-16T20:56:25.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7869000000000001e-05 2020-11-16T20:56:25.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:25.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083789+0000", 2020-11-16T20:56:25.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0046429339999999996 2020-11-16T20:56:25.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:25.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.088432+0000", 2020-11-16T20:56:25.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7565999999999998e-05 2020-11-16T20:56:25.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:25.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.088479+0000", 2020-11-16T20:56:25.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012005706 2020-11-16T20:56:25.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:25.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100485+0000", 2020-11-16T20:56:25.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8340000000000002e-05 2020-11-16T20:56:25.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:25.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100523+0000", 2020-11-16T20:56:25.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01719561 2020-11-16T20:56:25.958 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.958 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:25.958 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.959 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2371 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'96, mlcod=41'92)", 2020-11-16T20:56:25.959 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.084682+0000", 2020-11-16T20:56:25.959 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.760012851999999, 2020-11-16T20:56:25.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015864851999999999, 2020-11-16T20:56:25.959 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:25.960 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:25.960 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:25.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:25.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084682+0000", 2020-11-16T20:56:25.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:25.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:25.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084682+0000", 2020-11-16T20:56:25.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1321e-05 2020-11-16T20:56:25.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:25.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084723+0000", 2020-11-16T20:56:25.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9310000000000008e-06 2020-11-16T20:56:25.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:25.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084731+0000", 2020-11-16T20:56:25.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1453e-05 2020-11-16T20:56:25.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:25.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084742+0000", 2020-11-16T20:56:25.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9670000000000004e-06 2020-11-16T20:56:25.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:25.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084749+0000", 2020-11-16T20:56:25.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048588700000000004 2020-11-16T20:56:25.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:25.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089608+0000", 2020-11-16T20:56:25.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3699999999999998e-05 2020-11-16T20:56:25.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:25.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089652+0000", 2020-11-16T20:56:25.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010873481000000001 2020-11-16T20:56:25.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:25.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100525+0000", 2020-11-16T20:56:25.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1129e-05 2020-11-16T20:56:25.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:25.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100547+0000", 2020-11-16T20:56:25.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015864851999999999 2020-11-16T20:56:25.966 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.967 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:25.967 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.967 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:593 4.3 e46/22 4:c5716d1e:::smithi16641208-111:head v 46'121, mlcod=46'118)", 2020-11-16T20:56:25.967 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:09.075394+0000", 2020-11-16T20:56:25.967 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.769300989000001, 2020-11-16T20:56:25.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013710613, 2020-11-16T20:56:25.968 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:25.968 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:25.968 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:25.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:25.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.075394+0000", 2020-11-16T20:56:25.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:25.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:25.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.075394+0000", 2020-11-16T20:56:25.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067667700000000001 2020-11-16T20:56:25.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:25.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082160+0000", 2020-11-16T20:56:25.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0790000000000001e-06 2020-11-16T20:56:25.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:25.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082168+0000", 2020-11-16T20:56:25.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9809999999999992e-06 2020-11-16T20:56:25.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:25.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082177+0000", 2020-11-16T20:56:25.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5310000000000001e-06 2020-11-16T20:56:25.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:25.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082186+0000", 2020-11-16T20:56:25.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5111000000000001e-05 2020-11-16T20:56:25.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:25.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082241+0000", 2020-11-16T20:56:25.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6672000000000001e-05 2020-11-16T20:56:25.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:25.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082268+0000", 2020-11-16T20:56:25.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067531379999999997 2020-11-16T20:56:25.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:25.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.089021+0000", 2020-11-16T20:56:25.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3331000000000006e-05 2020-11-16T20:56:25.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:25.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.089104+0000", 2020-11-16T20:56:25.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013710613 2020-11-16T20:56:25.975 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.975 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:25.975 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.975 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:663 4.3 e57/22 4:f65e82cb:::smithi16641208-219:head v 57'179, mlcod=57'176)", 2020-11-16T20:56:25.975 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:56:25.976 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 6.0478665109999996, 2020-11-16T20:56:25.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022540092000000001, 2020-11-16T20:56:25.976 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:25.976 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:25.976 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:25.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.976 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:25.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:56:25.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:25.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:25.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:56:25.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013414394 2020-11-16T20:56:25.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:25.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810242+0000", 2020-11-16T20:56:25.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1864e-05 2020-11-16T20:56:25.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:25.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810254+0000", 2020-11-16T20:56:25.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3716e-05 2020-11-16T20:56:25.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:25.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810268+0000", 2020-11-16T20:56:25.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.064e-06 2020-11-16T20:56:25.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:25.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810277+0000", 2020-11-16T20:56:25.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0560999999999998e-05 2020-11-16T20:56:25.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:25.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810338+0000", 2020-11-16T20:56:25.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7523999999999999e-05 2020-11-16T20:56:25.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:25.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810365+0000", 2020-11-16T20:56:25.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089020890000000002 2020-11-16T20:56:25.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:25.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819267+0000", 2020-11-16T20:56:25.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010088 2020-11-16T20:56:25.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:25.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819368+0000", 2020-11-16T20:56:25.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022540092000000001 2020-11-16T20:56:25.983 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.983 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:25.983 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.983 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:618 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'243, mlcod=57'241)", 2020-11-16T20:56:25.984 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:56:25.984 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 6.0443604359999998, 2020-11-16T20:56:25.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049183098000000001, 2020-11-16T20:56:25.984 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:25.984 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:25.984 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:25.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:25.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:56:25.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:25.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:25.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:56:25.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019114651 2020-11-16T20:56:25.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:25.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819449+0000", 2020-11-16T20:56:25.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.398e-05 2020-11-16T20:56:25.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:25.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819463+0000", 2020-11-16T20:56:25.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1139e-05 2020-11-16T20:56:25.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:25.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819474+0000", 2020-11-16T20:56:25.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1860000000000003e-06 2020-11-16T20:56:25.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:25.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819481+0000", 2020-11-16T20:56:25.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015472700000000001 2020-11-16T20:56:25.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:25.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819636+0000", 2020-11-16T20:56:25.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9632e-05 2020-11-16T20:56:25.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:25.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819665+0000", 2020-11-16T20:56:25.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029788289999999999 2020-11-16T20:56:25.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:25.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849454+0000", 2020-11-16T20:56:25.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3492999999999997e-05 2020-11-16T20:56:25.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:25.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849517+0000", 2020-11-16T20:56:25.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049183098000000001 2020-11-16T20:56:25.991 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.991 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:25.991 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.992 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:609 3.2 e57/19 3:5eead97c:::smithi16641208-34:head v 57'498, mlcod=57'495)", 2020-11-16T20:56:25.992 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:56:25.992 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 6.0340809369999997, 2020-11-16T20:56:25.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039221579999999999, 2020-11-16T20:56:25.992 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:25.992 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:25.992 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:25.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:25.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:56:25.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:25.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:25.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:56:25.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008889859 2020-11-16T20:56:25.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:25.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819503+0000", 2020-11-16T20:56:25.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0149000000000001e-05 2020-11-16T20:56:25.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:25.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819514+0000", 2020-11-16T20:56:25.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1049999999999999e-05 2020-11-16T20:56:25.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:25.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819525+0000", 2020-11-16T20:56:25.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4829999999999999e-06 2020-11-16T20:56:25.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:25.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819533+0000", 2020-11-16T20:56:25.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031805760000000001 2020-11-16T20:56:25.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:25.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822714+0000", 2020-11-16T20:56:25.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0954000000000002e-05 2020-11-16T20:56:25.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:25.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822745+0000", 2020-11-16T20:56:25.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027044038999999999 2020-11-16T20:56:25.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:25.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849789+0000", 2020-11-16T20:56:25.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6470000000000001e-05 2020-11-16T20:56:25.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:25.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:25.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:25.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849835+0000", 2020-11-16T20:56:25.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039221579999999999 2020-11-16T20:56:25.999 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:25.999 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:25.999 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.000 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2583 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'244, mlcod=57'241)", 2020-11-16T20:56:26.000 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:56:26.000 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 6.0251634019999996, 2020-11-16T20:56:26.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030101836999999999, 2020-11-16T20:56:26.000 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:26.000 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:26.001 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:26.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:26.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:56:26.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:26.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:26.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:56:26.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3781e-05 2020-11-16T20:56:26.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:26.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819575+0000", 2020-11-16T20:56:26.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3355e-05 2020-11-16T20:56:26.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:26.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819588+0000", 2020-11-16T20:56:26.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8198e-05 2020-11-16T20:56:26.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:26.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819657+0000", 2020-11-16T20:56:26.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5849999999999999e-05 2020-11-16T20:56:26.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:26.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819672+0000", 2020-11-16T20:56:26.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003042473 2020-11-16T20:56:26.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:26.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822715+0000", 2020-11-16T20:56:26.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9779999999999999e-05 2020-11-16T20:56:26.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:26.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822745+0000", 2020-11-16T20:56:26.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026828521000000001 2020-11-16T20:56:26.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:26.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849573+0000", 2020-11-16T20:56:26.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9879e-05 2020-11-16T20:56:26.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:26.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849633+0000", 2020-11-16T20:56:26.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030101836999999999 2020-11-16T20:56:26.007 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.007 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:26.008 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.008 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.008 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:26.008 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:26.009 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:56:26.010 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:26.014+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:26.110 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:26.114+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:26.185 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:26.186 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:26.186 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:56:26.186 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:26.195 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:56:26.237 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:26.241+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:26.320 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:26.325+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:26.376 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:26.376 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:26.376 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:56:26.376 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:56:26.376 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:26.385 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:56:26.421 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:26.426+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:26.522 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:26.523 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:56:26.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:56:26.523 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:56:26.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.523 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:37 4.1 e33/22 4:b6545a47:::smithi16641208-46:head v 33'28, mlcod=33'26)", 2020-11-16T20:56:26.523 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.515292+0000", 2020-11-16T20:56:26.524 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 35.010917558000003, 2020-11-16T20:56:26.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016898816000000001, 2020-11-16T20:56:26.524 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:26.524 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:26.524 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:26.524 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.524 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:26.525 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.515292+0000", 2020-11-16T20:56:26.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:26.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.525 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:26.525 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.515292+0000", 2020-11-16T20:56:26.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001749708 2020-11-16T20:56:26.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.526 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:26.526 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.517042+0000", 2020-11-16T20:56:26.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1926000000000001e-05 2020-11-16T20:56:26.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:26.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.517054+0000", 2020-11-16T20:56:26.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4791e-05 2020-11-16T20:56:26.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:26.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.517068+0000", 2020-11-16T20:56:26.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3440000000000001e-06 2020-11-16T20:56:26.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:26.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.517077+0000", 2020-11-16T20:56:26.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5005000000000005e-05 2020-11-16T20:56:26.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:26.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.517142+0000", 2020-11-16T20:56:26.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1109000000000003e-05 2020-11-16T20:56:26.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:26.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.517173+0000", 2020-11-16T20:56:26.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01497009 2020-11-16T20:56:26.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.530 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:26.530 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532143+0000", 2020-11-16T20:56:26.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7843000000000003e-05 2020-11-16T20:56:26.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:26.531 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532191+0000", 2020-11-16T20:56:26.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016898816000000001 2020-11-16T20:56:26.531 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.531 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:26.531 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.532 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:39 4.1 e33/22 4:81558809:::smithi16641208-47:head v 33'30, mlcod=33'26)", 2020-11-16T20:56:26.532 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.520522+0000", 2020-11-16T20:56:26.532 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 35.005687821000002, 2020-11-16T20:56:26.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014376866, 2020-11-16T20:56:26.532 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:26.533 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:26.533 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:26.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:26.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520522+0000", 2020-11-16T20:56:26.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:26.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:26.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520522+0000", 2020-11-16T20:56:26.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00038562500000000001 2020-11-16T20:56:26.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:26.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520907+0000", 2020-11-16T20:56:26.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0479000000000001e-05 2020-11-16T20:56:26.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.535 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:26.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520918+0000", 2020-11-16T20:56:26.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6376999999999999e-05 2020-11-16T20:56:26.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:26.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520934+0000", 2020-11-16T20:56:26.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1693e-05 2020-11-16T20:56:26.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:26.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520946+0000", 2020-11-16T20:56:26.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5083000000000002e-05 2020-11-16T20:56:26.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:26.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520991+0000", 2020-11-16T20:56:26.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2738000000000002e-05 2020-11-16T20:56:26.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.538 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:26.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.521014+0000", 2020-11-16T20:56:26.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013845266 2020-11-16T20:56:26.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.539 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:26.539 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534859+0000", 2020-11-16T20:56:26.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9604999999999998e-05 2020-11-16T20:56:26.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.539 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:26.539 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534899+0000", 2020-11-16T20:56:26.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014376866 2020-11-16T20:56:26.540 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.540 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:26.540 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.540 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:201 3.2 e35/19 3:515e6cf6:::smithi16641208-22:head v 35'123, mlcod=35'121)", 2020-11-16T20:56:26.541 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.975460+0000", 2020-11-16T20:56:26.541 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 31.550749204999999, 2020-11-16T20:56:26.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014831637, 2020-11-16T20:56:26.541 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:26.541 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:26.541 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:26.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:26.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.975460+0000", 2020-11-16T20:56:26.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:26.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:26.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.975460+0000", 2020-11-16T20:56:26.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0037792979999999999 2020-11-16T20:56:26.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.543 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:26.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.979240+0000", 2020-11-16T20:56:26.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1510000000000001e-06 2020-11-16T20:56:26.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:26.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.979246+0000", 2020-11-16T20:56:26.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0080000000000002e-06 2020-11-16T20:56:26.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:26.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.979254+0000", 2020-11-16T20:56:26.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9459999999999997e-06 2020-11-16T20:56:26.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.545 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:26.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.979259+0000", 2020-11-16T20:56:26.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6044999999999997e-05 2020-11-16T20:56:26.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:26.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.979305+0000", 2020-11-16T20:56:26.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8236999999999998e-05 2020-11-16T20:56:26.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:26.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.979323+0000", 2020-11-16T20:56:26.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010909350999999999 2020-11-16T20:56:26.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:26.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.990232+0000", 2020-11-16T20:56:26.548 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9601000000000001e-05 2020-11-16T20:56:26.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.548 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:26.548 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.990292+0000", 2020-11-16T20:56:26.548 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014831637 2020-11-16T20:56:26.548 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.548 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:26.549 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.549 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:202 3.2 e35/19 3:5723fd94:::smithi16641208-211:head v 35'124, mlcod=35'121)", 2020-11-16T20:56:26.549 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.981228+0000", 2020-11-16T20:56:26.549 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 31.54498165, 2020-11-16T20:56:26.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013558532, 2020-11-16T20:56:26.550 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:26.550 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:26.550 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:26.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:26.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.981228+0000", 2020-11-16T20:56:26.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:26.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:26.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.981228+0000", 2020-11-16T20:56:26.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052605159999999998 2020-11-16T20:56:26.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:26.552 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.986488+0000", 2020-11-16T20:56:26.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.52e-06 2020-11-16T20:56:26.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.552 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:26.552 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.986496+0000", 2020-11-16T20:56:26.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0351e-05 2020-11-16T20:56:26.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:26.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.986506+0000", 2020-11-16T20:56:26.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1437000000000001e-05 2020-11-16T20:56:26.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:26.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.986518+0000", 2020-11-16T20:56:26.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2643000000000002e-05 2020-11-16T20:56:26.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:26.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.986590+0000", 2020-11-16T20:56:26.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1520000000000001e-05 2020-11-16T20:56:26.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:26.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.986612+0000", 2020-11-16T20:56:26.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0081095630000000002 2020-11-16T20:56:26.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.556 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:26.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.994721+0000", 2020-11-16T20:56:26.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4981999999999995e-05 2020-11-16T20:56:26.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.556 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:26.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.994786+0000", 2020-11-16T20:56:26.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013558532 2020-11-16T20:56:26.557 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.557 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:26.557 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.557 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:547 3.2 e42/19 3:5f250a2b:::smithi16641208-75:head v 42'381, mlcod=42'379)", 2020-11-16T20:56:26.557 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.027376+0000", 2020-11-16T20:56:26.558 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 21.498833966999999, 2020-11-16T20:56:26.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017180708999999999, 2020-11-16T20:56:26.558 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:26.558 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:26.558 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:26.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:26.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.027376+0000", 2020-11-16T20:56:26.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:26.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:26.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.027376+0000", 2020-11-16T20:56:26.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064232990000000004 2020-11-16T20:56:26.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.560 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:26.560 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.033799+0000", 2020-11-16T20:56:26.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3679000000000001e-05 2020-11-16T20:56:26.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.560 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:26.560 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.033813+0000", 2020-11-16T20:56:26.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9789e-05 2020-11-16T20:56:26.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:26.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.033832+0000", 2020-11-16T20:56:26.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2969999999999999e-05 2020-11-16T20:56:26.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:26.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.033845+0000", 2020-11-16T20:56:26.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7311000000000007e-05 2020-11-16T20:56:26.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:26.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.033913+0000", 2020-11-16T20:56:26.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9128999999999998e-05 2020-11-16T20:56:26.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:26.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.033942+0000", 2020-11-16T20:56:26.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010563673000000001 2020-11-16T20:56:26.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:26.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.044505+0000", 2020-11-16T20:56:26.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0859000000000002e-05 2020-11-16T20:56:26.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:26.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.044556+0000", 2020-11-16T20:56:26.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017180708999999999 2020-11-16T20:56:26.565 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.565 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:26.565 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.565 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:548 3.2 e42/19 3:6173e90a:::smithi16641208-2:head v 42'382, mlcod=42'379)", 2020-11-16T20:56:26.566 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.033886+0000", 2020-11-16T20:56:26.566 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 21.492323117000002, 2020-11-16T20:56:26.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012946935999999999, 2020-11-16T20:56:26.566 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:26.566 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:26.566 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:26.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:26.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.033886+0000", 2020-11-16T20:56:26.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:26.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:26.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.033886+0000", 2020-11-16T20:56:26.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002622657 2020-11-16T20:56:26.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:26.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.036509+0000", 2020-11-16T20:56:26.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.187e-05 2020-11-16T20:56:26.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:26.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.036521+0000", 2020-11-16T20:56:26.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8457e-05 2020-11-16T20:56:26.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:26.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.036539+0000", 2020-11-16T20:56:26.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.349e-05 2020-11-16T20:56:26.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:26.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.036553+0000", 2020-11-16T20:56:26.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0016288100000000001 2020-11-16T20:56:26.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.571 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:26.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.038182+0000", 2020-11-16T20:56:26.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3382000000000001e-05 2020-11-16T20:56:26.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.571 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:26.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.038205+0000", 2020-11-16T20:56:26.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085366859999999999 2020-11-16T20:56:26.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:26.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.046742+0000", 2020-11-16T20:56:26.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1583999999999996e-05 2020-11-16T20:56:26.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:26.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.046833+0000", 2020-11-16T20:56:26.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012946935999999999 2020-11-16T20:56:26.573 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.573 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:26.573 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.574 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:554 3.2 e42/19 3:769099fd:::smithi16641208-247:head v 42'386, mlcod=42'384)", 2020-11-16T20:56:26.574 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.070944+0000", 2020-11-16T20:56:26.574 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 21.455265228999998, 2020-11-16T20:56:26.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019548482999999998, 2020-11-16T20:56:26.574 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:26.574 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:26.574 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:26.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:26.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070944+0000", 2020-11-16T20:56:26.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:26.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:26.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070944+0000", 2020-11-16T20:56:26.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0065296180000000001 2020-11-16T20:56:26.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:26.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077474+0000", 2020-11-16T20:56:26.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0669999999999999e-05 2020-11-16T20:56:26.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:26.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077485+0000", 2020-11-16T20:56:26.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4518999999999999e-05 2020-11-16T20:56:26.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:26.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077499+0000", 2020-11-16T20:56:26.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3319999999999992e-06 2020-11-16T20:56:26.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:26.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077507+0000", 2020-11-16T20:56:26.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3896e-05 2020-11-16T20:56:26.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:26.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077561+0000", 2020-11-16T20:56:26.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9446999999999999e-05 2020-11-16T20:56:26.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:26.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077581+0000", 2020-11-16T20:56:26.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012846296 2020-11-16T20:56:26.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:26.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.090427+0000", 2020-11-16T20:56:26.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5704999999999995e-05 2020-11-16T20:56:26.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:26.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.090493+0000", 2020-11-16T20:56:26.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019548482999999998 2020-11-16T20:56:26.581 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.581 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:26.582 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.582 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:555 3.2 e42/19 3:590e6edd:::smithi16641208-203:head v 42'387, mlcod=42'384)", 2020-11-16T20:56:26.582 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.077550+0000", 2020-11-16T20:56:26.582 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 21.448659787, 2020-11-16T20:56:26.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018403484000000001, 2020-11-16T20:56:26.582 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:26.583 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:26.583 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:26.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:26.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077550+0000", 2020-11-16T20:56:26.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:26.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:26.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077550+0000", 2020-11-16T20:56:26.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5414999999999998e-05 2020-11-16T20:56:26.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:26.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077595+0000", 2020-11-16T20:56:26.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1470000000000004e-06 2020-11-16T20:56:26.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:26.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077602+0000", 2020-11-16T20:56:26.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0637e-05 2020-11-16T20:56:26.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:26.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077613+0000", 2020-11-16T20:56:26.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9250000000000003e-06 2020-11-16T20:56:26.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:26.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077618+0000", 2020-11-16T20:56:26.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002591702 2020-11-16T20:56:26.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:26.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080210+0000", 2020-11-16T20:56:26.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2793000000000003e-05 2020-11-16T20:56:26.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:26.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080242+0000", 2020-11-16T20:56:26.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015665576000000001 2020-11-16T20:56:26.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:26.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.095908+0000", 2020-11-16T20:56:26.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5289e-05 2020-11-16T20:56:26.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:26.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.095953+0000", 2020-11-16T20:56:26.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018403484000000001 2020-11-16T20:56:26.590 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.590 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:26.590 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.590 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:485 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'94, mlcod=41'92)", 2020-11-16T20:56:26.590 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.078771+0000", 2020-11-16T20:56:26.591 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 21.447438625, 2020-11-16T20:56:26.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020640565999999999, 2020-11-16T20:56:26.591 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:26.591 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:26.591 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:26.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:26.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078771+0000", 2020-11-16T20:56:26.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:26.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:26.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078771+0000", 2020-11-16T20:56:26.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003089067 2020-11-16T20:56:26.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:26.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081860+0000", 2020-11-16T20:56:26.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.187e-05 2020-11-16T20:56:26.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:26.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081872+0000", 2020-11-16T20:56:26.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4426999999999999e-05 2020-11-16T20:56:26.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:26.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081886+0000", 2020-11-16T20:56:26.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5287999999999999e-05 2020-11-16T20:56:26.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:26.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081912+0000", 2020-11-16T20:56:26.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0007000000000003e-05 2020-11-16T20:56:26.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:26.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081972+0000", 2020-11-16T20:56:26.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7368e-05 2020-11-16T20:56:26.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:26.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081999+0000", 2020-11-16T20:56:26.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017350596999999999 2020-11-16T20:56:26.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:26.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099350+0000", 2020-11-16T20:56:26.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1941999999999997e-05 2020-11-16T20:56:26.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:26.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099412+0000", 2020-11-16T20:56:26.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020640565999999999 2020-11-16T20:56:26.598 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.598 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:26.598 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.599 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:556 3.2 e42/19 3:590e6edd:::smithi16641208-203:head v 42'388, mlcod=42'384)", 2020-11-16T20:56:26.599 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.081269+0000", 2020-11-16T20:56:26.599 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 21.444940207999998, 2020-11-16T20:56:26.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019299324, 2020-11-16T20:56:26.599 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:26.599 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:26.599 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:26.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:26.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081269+0000", 2020-11-16T20:56:26.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:26.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:26.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081269+0000", 2020-11-16T20:56:26.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048245409999999999 2020-11-16T20:56:26.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:26.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.086094+0000", 2020-11-16T20:56:26.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.995e-06 2020-11-16T20:56:26.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:26.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.086104+0000", 2020-11-16T20:56:26.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6529e-05 2020-11-16T20:56:26.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:26.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.086120+0000", 2020-11-16T20:56:26.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2890000000000003e-06 2020-11-16T20:56:26.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:26.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.086130+0000", 2020-11-16T20:56:26.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0926e-05 2020-11-16T20:56:26.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:26.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.086181+0000", 2020-11-16T20:56:26.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4405000000000001e-05 2020-11-16T20:56:26.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:26.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.086205+0000", 2020-11-16T20:56:26.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014305527 2020-11-16T20:56:26.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:26.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100511+0000", 2020-11-16T20:56:26.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8112000000000002e-05 2020-11-16T20:56:26.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:26.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100569+0000", 2020-11-16T20:56:26.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019299324 2020-11-16T20:56:26.606 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.606 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:26.606 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.607 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2370 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'95, mlcod=41'92)", 2020-11-16T20:56:26.607 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.083353+0000", 2020-11-16T20:56:26.607 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 21.442856834000001, 2020-11-16T20:56:26.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017054562999999998, 2020-11-16T20:56:26.607 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:26.608 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:26.608 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:26.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:26.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083353+0000", 2020-11-16T20:56:26.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:26.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:26.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083353+0000", 2020-11-16T20:56:26.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039019899999999998 2020-11-16T20:56:26.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:26.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083743+0000", 2020-11-16T20:56:26.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.098e-06 2020-11-16T20:56:26.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:26.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083752+0000", 2020-11-16T20:56:26.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2599000000000001e-05 2020-11-16T20:56:26.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:26.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083765+0000", 2020-11-16T20:56:26.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0224000000000001e-05 2020-11-16T20:56:26.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:26.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083775+0000", 2020-11-16T20:56:26.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056252819999999997 2020-11-16T20:56:26.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:26.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089400+0000", 2020-11-16T20:56:26.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4091000000000003e-05 2020-11-16T20:56:26.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:26.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089434+0000", 2020-11-16T20:56:26.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010917029999999999 2020-11-16T20:56:26.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:26.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100351+0000", 2020-11-16T20:56:26.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6039999999999999e-05 2020-11-16T20:56:26.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:26.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100407+0000", 2020-11-16T20:56:26.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017054562999999998 2020-11-16T20:56:26.614 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.615 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:26.615 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.615 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2371 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'96, mlcod=41'92)", 2020-11-16T20:56:26.615 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.084675+0000", 2020-11-16T20:56:26.615 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 21.44153494, 2020-11-16T20:56:26.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015773533999999999, 2020-11-16T20:56:26.616 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:26.616 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:26.616 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:26.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:26.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084675+0000", 2020-11-16T20:56:26.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:26.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:26.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084675+0000", 2020-11-16T20:56:26.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7421999999999999e-05 2020-11-16T20:56:26.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:26.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084702+0000", 2020-11-16T20:56:26.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9120000000000003e-06 2020-11-16T20:56:26.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:26.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084708+0000", 2020-11-16T20:56:26.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4649999999999994e-06 2020-11-16T20:56:26.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:26.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084716+0000", 2020-11-16T20:56:26.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0950000000000003e-06 2020-11-16T20:56:26.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.620 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:26.620 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084722+0000", 2020-11-16T20:56:26.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056083510000000001 2020-11-16T20:56:26.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.620 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:26.620 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.090330+0000", 2020-11-16T20:56:26.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9339000000000001e-05 2020-11-16T20:56:26.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:26.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.090359+0000", 2020-11-16T20:56:26.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010050811 2020-11-16T20:56:26.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:26.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100410+0000", 2020-11-16T20:56:26.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8139000000000002e-05 2020-11-16T20:56:26.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:26.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100448+0000", 2020-11-16T20:56:26.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015773533999999999 2020-11-16T20:56:26.623 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.623 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:26.623 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.623 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2580 3.2 e57/19 3:75836747:::smithi16641208-340:head v 57'492, mlcod=57'483)", 2020-11-16T20:56:26.623 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.768064+0000", 2020-11-16T20:56:26.624 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 6.7581457309999999, 2020-11-16T20:56:26.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018062056, 2020-11-16T20:56:26.624 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:26.624 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:26.624 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:26.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:26.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.768064+0000", 2020-11-16T20:56:26.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:26.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.625 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:26.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.768064+0000", 2020-11-16T20:56:26.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00058317799999999995 2020-11-16T20:56:26.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:26.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.768647+0000", 2020-11-16T20:56:26.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0350000000000007e-06 2020-11-16T20:56:26.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:26.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.768656+0000", 2020-11-16T20:56:26.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2744e-05 2020-11-16T20:56:26.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:26.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.768669+0000", 2020-11-16T20:56:26.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7309999999999996e-06 2020-11-16T20:56:26.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:26.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.768676+0000", 2020-11-16T20:56:26.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0025689390000000001 2020-11-16T20:56:26.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:26.629 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.771244+0000", 2020-11-16T20:56:26.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8636000000000002e-05 2020-11-16T20:56:26.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.629 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.629 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:26.629 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.771273+0000", 2020-11-16T20:56:26.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014783734 2020-11-16T20:56:26.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:26.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786057+0000", 2020-11-16T20:56:26.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9059000000000004e-05 2020-11-16T20:56:26.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.631 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:26.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786126+0000", 2020-11-16T20:56:26.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018062056 2020-11-16T20:56:26.631 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.631 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:26.631 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.632 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2581 3.2 e57/19 3:75836747:::smithi16641208-340:head v 57'493, mlcod=57'483)", 2020-11-16T20:56:26.632 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.768987+0000", 2020-11-16T20:56:26.632 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 6.7572223500000002, 2020-11-16T20:56:26.632 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017169609999999998, 2020-11-16T20:56:26.632 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:26.632 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:26.632 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:26.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.633 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:26.633 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.768987+0000", 2020-11-16T20:56:26.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:26.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.633 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:26.633 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.768987+0000", 2020-11-16T20:56:26.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001144267 2020-11-16T20:56:26.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.634 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:26.634 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.770131+0000", 2020-11-16T20:56:26.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6410000000000008e-06 2020-11-16T20:56:26.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:26.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.770140+0000", 2020-11-16T20:56:26.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2741999999999999e-05 2020-11-16T20:56:26.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:26.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.770153+0000", 2020-11-16T20:56:26.636 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3950000000000003e-06 2020-11-16T20:56:26.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:26.636 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.770160+0000", 2020-11-16T20:56:26.636 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054500110000000003 2020-11-16T20:56:26.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.637 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.637 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:26.637 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.775610+0000", 2020-11-16T20:56:26.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5126e-05 2020-11-16T20:56:26.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.637 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.637 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:26.637 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.775635+0000", 2020-11-16T20:56:26.638 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010494847999999999 2020-11-16T20:56:26.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.638 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:26.638 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786130+0000", 2020-11-16T20:56:26.638 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.658e-05 2020-11-16T20:56:26.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:26.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786157+0000", 2020-11-16T20:56:26.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017169609999999998 2020-11-16T20:56:26.639 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.639 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:26.639 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.640 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:603 3.2 e57/19 3:5a2e7c26:::smithi16641208-130:head v 57'494, mlcod=57'485)", 2020-11-16T20:56:26.640 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.772348+0000", 2020-11-16T20:56:26.640 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 6.7538610730000004, 2020-11-16T20:56:26.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015150215999999999, 2020-11-16T20:56:26.640 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:26.640 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:26.641 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:26.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:26.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.772348+0000", 2020-11-16T20:56:26.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:26.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.642 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:26.642 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.772348+0000", 2020-11-16T20:56:26.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0039012650000000001 2020-11-16T20:56:26.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.642 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.642 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:26.642 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.776250+0000", 2020-11-16T20:56:26.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7919999999999998e-06 2020-11-16T20:56:26.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.643 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:26.643 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.776259+0000", 2020-11-16T20:56:26.643 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1582e-05 2020-11-16T20:56:26.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.644 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:26.644 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.776270+0000", 2020-11-16T20:56:26.644 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6779999999999997e-06 2020-11-16T20:56:26.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.644 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.644 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:26.644 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.776276+0000", 2020-11-16T20:56:26.644 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00067481599999999996 2020-11-16T20:56:26.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:26.645 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.776951+0000", 2020-11-16T20:56:26.645 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1649999999999997e-05 2020-11-16T20:56:26.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.646 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:26.646 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.776982+0000", 2020-11-16T20:56:26.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010457162000000001 2020-11-16T20:56:26.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.646 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.646 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:26.646 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787439+0000", 2020-11-16T20:56:26.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9271000000000002e-05 2020-11-16T20:56:26.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.647 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.647 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:26.647 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787499+0000", 2020-11-16T20:56:26.647 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015150215999999999 2020-11-16T20:56:26.647 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.647 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:26.648 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.648 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.648 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.648 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:609 3.2 e57/19 3:5eead97c:::smithi16641208-34:head v 57'498, mlcod=57'495)", 2020-11-16T20:56:26.648 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.810471+0000", 2020-11-16T20:56:26.648 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 6.7157389380000003, 2020-11-16T20:56:26.648 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040749058999999997, 2020-11-16T20:56:26.648 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:26.649 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:26.649 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:26.649 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.649 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:26.649 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810471+0000", 2020-11-16T20:56:26.649 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:26.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:26.650 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810471+0000", 2020-11-16T20:56:26.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088055860000000007 2020-11-16T20:56:26.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:26.651 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819276+0000", 2020-11-16T20:56:26.651 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3659000000000002e-05 2020-11-16T20:56:26.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.651 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.651 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:26.651 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819300+0000", 2020-11-16T20:56:26.651 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9273e-05 2020-11-16T20:56:26.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.652 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.652 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:26.652 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819319+0000", 2020-11-16T20:56:26.652 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4292e-05 2020-11-16T20:56:26.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.652 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.652 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:26.652 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819333+0000", 2020-11-16T20:56:26.653 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2676999999999995e-05 2020-11-16T20:56:26.653 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.653 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.653 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:26.653 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819416+0000", 2020-11-16T20:56:26.653 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1479e-05 2020-11-16T20:56:26.653 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.654 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.654 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:26.654 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819458+0000", 2020-11-16T20:56:26.654 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.031704478000000001 2020-11-16T20:56:26.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.654 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.654 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:26.655 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851162+0000", 2020-11-16T20:56:26.655 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7615000000000003e-05 2020-11-16T20:56:26.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.655 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.655 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:26.655 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851220+0000", 2020-11-16T20:56:26.655 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040749058999999997 2020-11-16T20:56:26.655 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.656 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:26.656 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.656 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.656 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2593 3.3 e57/19 3:f5f8fa2a:::smithi16641208-144:head v 57'482, mlcod=57'478)", 2020-11-16T20:56:26.656 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.811262+0000", 2020-11-16T20:56:26.656 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 6.7149472169999997, 2020-11-16T20:56:26.657 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039577978999999999, 2020-11-16T20:56:26.657 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:26.657 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:26.657 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:26.657 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.657 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:26.657 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.811262+0000", 2020-11-16T20:56:26.657 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:26.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.658 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.658 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:26.658 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.811262+0000", 2020-11-16T20:56:26.658 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0024992909999999998 2020-11-16T20:56:26.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.658 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.659 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:26.659 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813762+0000", 2020-11-16T20:56:26.659 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3520000000000007e-06 2020-11-16T20:56:26.659 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.659 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.659 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:26.659 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813770+0000", 2020-11-16T20:56:26.660 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6045999999999998e-05 2020-11-16T20:56:26.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.660 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.660 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:26.660 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813786+0000", 2020-11-16T20:56:26.660 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2719999999999997e-06 2020-11-16T20:56:26.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.660 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.661 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:26.661 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813794+0000", 2020-11-16T20:56:26.661 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7755000000000002e-05 2020-11-16T20:56:26.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.661 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.661 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:26.661 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813892+0000", 2020-11-16T20:56:26.662 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4265000000000003e-05 2020-11-16T20:56:26.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.662 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.662 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:26.662 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813946+0000", 2020-11-16T20:56:26.662 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036843977 2020-11-16T20:56:26.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.662 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.663 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:26.663 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.850790+0000", 2020-11-16T20:56:26.663 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0021000000000001e-05 2020-11-16T20:56:26.663 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.663 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.663 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:26.663 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.850840+0000", 2020-11-16T20:56:26.664 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039577978999999999 2020-11-16T20:56:26.664 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.664 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:26.664 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.664 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.664 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.13:618 3.3 e57/19 3:d775beee:::smithi16641208-10:head v 57'483, mlcod=57'478)", 2020-11-16T20:56:26.664 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.825375+0000", 2020-11-16T20:56:26.665 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 6.7008348660000001, 2020-11-16T20:56:26.665 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.025928922, 2020-11-16T20:56:26.665 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:26.665 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:26.665 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:26.665 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.665 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:26.666 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.825375+0000", 2020-11-16T20:56:26.666 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:26.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.666 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.666 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:26.666 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.825375+0000", 2020-11-16T20:56:26.666 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001052641 2020-11-16T20:56:26.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.667 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.667 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:26.667 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.826427+0000", 2020-11-16T20:56:26.667 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.884e-06 2020-11-16T20:56:26.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.667 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.667 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:26.668 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.826436+0000", 2020-11-16T20:56:26.668 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2126999999999999e-05 2020-11-16T20:56:26.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.668 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.668 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:26.668 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.826448+0000", 2020-11-16T20:56:26.668 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5680000000000005e-06 2020-11-16T20:56:26.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.669 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.669 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:26.669 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.826458+0000", 2020-11-16T20:56:26.669 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8312e-05 2020-11-16T20:56:26.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.669 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.669 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:26.670 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.826516+0000", 2020-11-16T20:56:26.670 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3490999999999999e-05 2020-11-16T20:56:26.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.670 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:26.670 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.826540+0000", 2020-11-16T20:56:26.670 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024717156000000001 2020-11-16T20:56:26.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.671 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:26.671 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851257+0000", 2020-11-16T20:56:26.671 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6743000000000003e-05 2020-11-16T20:56:26.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.671 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:26.672 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851304+0000", 2020-11-16T20:56:26.672 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.025928922 2020-11-16T20:56:26.672 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.672 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:26.672 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.672 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.672 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.13:619 3.3 e57/19 3:d79d68cf:::smithi16641208-37:head v 57'484, mlcod=57'478)", 2020-11-16T20:56:26.673 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.827568+0000", 2020-11-16T20:56:26.673 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 6.6986417850000004, 2020-11-16T20:56:26.673 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023912187000000001, 2020-11-16T20:56:26.673 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:26.673 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:26.673 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:26.673 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.674 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:26.674 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.827568+0000", 2020-11-16T20:56:26.674 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:26.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.674 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:26.674 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.827568+0000", 2020-11-16T20:56:26.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011559700000000001 2020-11-16T20:56:26.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:26.675 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.828724+0000", 2020-11-16T20:56:26.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7420000000000003e-06 2020-11-16T20:56:26.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.676 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:26.676 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.828732+0000", 2020-11-16T20:56:26.676 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2694000000000001e-05 2020-11-16T20:56:26.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.676 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.676 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:26.676 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.828745+0000", 2020-11-16T20:56:26.677 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7479999999999999e-06 2020-11-16T20:56:26.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.677 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:26.677 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.828754+0000", 2020-11-16T20:56:26.677 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011949338 2020-11-16T20:56:26.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:26.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.840703+0000", 2020-11-16T20:56:26.678 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2928000000000001e-05 2020-11-16T20:56:26.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:26.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.840726+0000", 2020-11-16T20:56:26.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010701949000000001 2020-11-16T20:56:26.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.679 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:26.679 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851428+0000", 2020-11-16T20:56:26.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1817999999999998e-05 2020-11-16T20:56:26.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.680 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:26.680 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851480+0000", 2020-11-16T20:56:26.680 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023912187000000001 2020-11-16T20:56:26.680 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.680 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:26.680 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.681 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.681 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2705 4.1 e63/53 4:b0e01256:::smithi16641208-225:head v 63'189, mlcod=61'185)", 2020-11-16T20:56:26.681 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:25.752150+0000", 2020-11-16T20:56:26.681 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.77405976399999998, 2020-11-16T20:56:26.681 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017996993999999999, 2020-11-16T20:56:26.681 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:26.681 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:26.681 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:26.682 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.682 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:26.682 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.752150+0000", 2020-11-16T20:56:26.682 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:26.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.682 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.682 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:26.683 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.752150+0000", 2020-11-16T20:56:26.683 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020574230000000001 2020-11-16T20:56:26.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.683 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:26.683 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.754207+0000", 2020-11-16T20:56:26.683 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7051e-05 2020-11-16T20:56:26.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.684 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.684 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:26.684 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.754224+0000", 2020-11-16T20:56:26.684 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8719000000000002e-05 2020-11-16T20:56:26.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.684 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.684 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:26.685 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.754243+0000", 2020-11-16T20:56:26.685 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2979999999999999e-05 2020-11-16T20:56:26.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.685 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.685 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:26.685 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.754256+0000", 2020-11-16T20:56:26.685 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8647999999999996e-05 2020-11-16T20:56:26.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.686 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.686 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:26.686 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.754345+0000", 2020-11-16T20:56:26.686 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8513999999999998e-05 2020-11-16T20:56:26.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.686 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.686 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:26.687 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.754383+0000", 2020-11-16T20:56:26.687 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015688825 2020-11-16T20:56:26.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.687 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.687 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:26.687 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.770072+0000", 2020-11-16T20:56:26.687 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4833999999999995e-05 2020-11-16T20:56:26.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:26.688 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:26.688 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:26.688 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.770147+0000", 2020-11-16T20:56:26.688 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017996993999999999 2020-11-16T20:56:26.688 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.688 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:26.688 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.689 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:26.689 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:26.689 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:26.689 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:26.526+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:26.690 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:56:26.691 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:26.695+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:26.733 INFO:tasks.rados.rados.0.smithi166.stdout:708: done (2 left) 2020-11-16T20:56:26.733 INFO:tasks.rados.rados.0.smithi166.stdout:709: done (1 left) 2020-11-16T20:56:26.733 INFO:tasks.rados.rados.0.smithi166.stdout:710: done (0 left) 2020-11-16T20:56:26.733 INFO:tasks.rados.rados.0.smithi166.stdout:711: delete oid 69 current snap is 16 2020-11-16T20:56:26.737 INFO:tasks.rados.rados.0.smithi166.stdout:711: done (0 left) 2020-11-16T20:56:26.737 INFO:tasks.rados.rados.0.smithi166.stdout:712: snap_remove snap 15 2020-11-16T20:56:26.791 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:26.795+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:26.872 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:26.872 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:26.872 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:56:26.872 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:26.881 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:56:26.892 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:26.896+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:26.994 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:26.998+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:27.056 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:27.057 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:27.057 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:56:27.057 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:56:27.058 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:27.066 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:56:27.094 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:27.098+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:27.194 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:27.199+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:27.203 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:27.203 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:56:27.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:56:27.203 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:56:27.203 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.204 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4237.0:1 1.0 1:04475aff:::INTEL_SSDPEDMD400G4_CVFT5330009L400BGN:head [omap-get-keys] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e13)", 2020-11-16T20:56:27.204 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:54:53.099987+0000", 2020-11-16T20:56:27.204 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 94.106667490000007, 2020-11-16T20:56:27.204 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013001067999999999, 2020-11-16T20:56:27.204 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:27.204 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2020-11-16T20:56:27.204 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:27.205 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4237", 2020-11-16T20:56:27.205 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/2773183201", 2020-11-16T20:56:27.205 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1 2020-11-16T20:56:27.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.205 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:27.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.205 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:27.205 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.099987+0000", 2020-11-16T20:56:27.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:27.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.206 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.206 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:27.206 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.099987+0000", 2020-11-16T20:56:27.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2502000000000001e-05 2020-11-16T20:56:27.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:27.207 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.100029+0000", 2020-11-16T20:56:27.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7090000000000002e-06 2020-11-16T20:56:27.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:27.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.100037+0000", 2020-11-16T20:56:27.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4844000000000001e-05 2020-11-16T20:56:27.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:27.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.100052+0000", 2020-11-16T20:56:27.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4450000000000002e-06 2020-11-16T20:56:27.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:27.209 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.100061+0000", 2020-11-16T20:56:27.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026660600000000002 2020-11-16T20:56:27.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:27.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.100328+0000", 2020-11-16T20:56:27.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7116e-05 2020-11-16T20:56:27.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for peered", 2020-11-16T20:56:27.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.100345+0000", 2020-11-16T20:56:27.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012477217000000001 2020-11-16T20:56:27.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.211 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:27.211 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.112822+0000", 2020-11-16T20:56:27.211 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016562900000000001 2020-11-16T20:56:27.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.212 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:27.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.112988+0000", 2020-11-16T20:56:27.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013001067999999999 2020-11-16T20:56:27.212 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.212 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:27.212 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.213 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:4 4.3 e33/22 4:fc3a32b3:::smithi16641208-6:head v 33'4, mlcod=33'2)", 2020-11-16T20:56:27.213 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:50.981105+0000", 2020-11-16T20:56:27.213 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 36.225549162999997, 2020-11-16T20:56:27.213 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011093057, 2020-11-16T20:56:27.213 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:27.213 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:27.213 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:27.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:27.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.981105+0000", 2020-11-16T20:56:27.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:27.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:27.215 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.981105+0000", 2020-11-16T20:56:27.215 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0021703450000000002 2020-11-16T20:56:27.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.215 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.215 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:27.215 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983276+0000", 2020-11-16T20:56:27.215 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3770000000000002e-06 2020-11-16T20:56:27.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:27.216 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983285+0000", 2020-11-16T20:56:27.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3261999999999999e-05 2020-11-16T20:56:27.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:27.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983298+0000", 2020-11-16T20:56:27.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4188999999999999e-05 2020-11-16T20:56:27.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.217 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:27.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983312+0000", 2020-11-16T20:56:27.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8090999999999997e-05 2020-11-16T20:56:27.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:27.218 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983360+0000", 2020-11-16T20:56:27.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2870999999999998e-05 2020-11-16T20:56:27.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:27.219 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983383+0000", 2020-11-16T20:56:27.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0087614010000000003 2020-11-16T20:56:27.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.219 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:27.219 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.992145+0000", 2020-11-16T20:56:27.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3520999999999998e-05 2020-11-16T20:56:27.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:27.220 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.992198+0000", 2020-11-16T20:56:27.220 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011093057 2020-11-16T20:56:27.220 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.220 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:27.220 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.221 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:280 4.3 e35/22 4:c9fee0b4:::smithi16641208-235:head v 35'58, mlcod=35'56)", 2020-11-16T20:56:27.221 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.763935+0000", 2020-11-16T20:56:27.221 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.442719054999998, 2020-11-16T20:56:27.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013791523, 2020-11-16T20:56:27.221 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:27.222 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:27.222 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:27.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:27.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.763935+0000", 2020-11-16T20:56:27.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:27.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:27.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.763935+0000", 2020-11-16T20:56:27.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0042676880000000004 2020-11-16T20:56:27.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:27.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768203+0000", 2020-11-16T20:56:27.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7779999999999996e-06 2020-11-16T20:56:27.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.224 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:27.224 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768212+0000", 2020-11-16T20:56:27.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1191e-05 2020-11-16T20:56:27.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:27.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768223+0000", 2020-11-16T20:56:27.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.148e-06 2020-11-16T20:56:27.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:27.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768230+0000", 2020-11-16T20:56:27.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9489e-05 2020-11-16T20:56:27.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:27.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768280+0000", 2020-11-16T20:56:27.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9222e-05 2020-11-16T20:56:27.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:27.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768299+0000", 2020-11-16T20:56:27.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0093848479999999995 2020-11-16T20:56:27.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:27.228 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.777684+0000", 2020-11-16T20:56:27.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3158999999999998e-05 2020-11-16T20:56:27.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.228 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:27.228 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.777727+0000", 2020-11-16T20:56:27.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013791523 2020-11-16T20:56:27.229 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.229 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:27.229 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.229 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:1058 4.3 e35/22 4:c9fee0b4:::smithi16641208-235:head v 35'59, mlcod=35'56)", 2020-11-16T20:56:27.229 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.768272+0000", 2020-11-16T20:56:27.229 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.438382457000003, 2020-11-16T20:56:27.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011567512, 2020-11-16T20:56:27.230 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:27.230 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:27.230 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:27.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.231 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:27.231 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768272+0000", 2020-11-16T20:56:27.231 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:27.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.231 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:27.231 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768272+0000", 2020-11-16T20:56:27.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00087617900000000004 2020-11-16T20:56:27.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.232 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:27.232 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.769148+0000", 2020-11-16T20:56:27.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7769999999999997e-06 2020-11-16T20:56:27.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:27.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.769155+0000", 2020-11-16T20:56:27.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1951e-05 2020-11-16T20:56:27.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:27.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.769167+0000", 2020-11-16T20:56:27.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6080000000000001e-06 2020-11-16T20:56:27.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.234 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:27.234 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.769173+0000", 2020-11-16T20:56:27.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0022666840000000001 2020-11-16T20:56:27.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.235 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:27.235 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.771440+0000", 2020-11-16T20:56:27.235 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0822999999999999e-05 2020-11-16T20:56:27.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.235 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:27.235 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.771471+0000", 2020-11-16T20:56:27.236 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0083200759999999992 2020-11-16T20:56:27.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.236 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:27.236 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.779791+0000", 2020-11-16T20:56:27.236 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8414000000000001e-05 2020-11-16T20:56:27.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:27.237 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.779839+0000", 2020-11-16T20:56:27.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011567512 2020-11-16T20:56:27.237 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.237 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:27.237 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.238 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:1059 4.3 e35/22 4:c9fee0b4:::smithi16641208-235:head v 35'60, mlcod=35'56)", 2020-11-16T20:56:27.238 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.769209+0000", 2020-11-16T20:56:27.238 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.437445551000003, 2020-11-16T20:56:27.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010670076000000001, 2020-11-16T20:56:27.238 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:27.238 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:27.239 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:27.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.239 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:27.239 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.769209+0000", 2020-11-16T20:56:27.239 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:27.239 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.240 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:27.240 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.769209+0000", 2020-11-16T20:56:27.240 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4997000000000003e-05 2020-11-16T20:56:27.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.240 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.240 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:27.240 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.769254+0000", 2020-11-16T20:56:27.240 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6109999999999999e-06 2020-11-16T20:56:27.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.241 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:27.241 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.769260+0000", 2020-11-16T20:56:27.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4048000000000001e-05 2020-11-16T20:56:27.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:27.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.769284+0000", 2020-11-16T20:56:27.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.242e-06 2020-11-16T20:56:27.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:27.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.769290+0000", 2020-11-16T20:56:27.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0030006439999999998 2020-11-16T20:56:27.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.243 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:27.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.772290+0000", 2020-11-16T20:56:27.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7189000000000001e-05 2020-11-16T20:56:27.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.244 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:27.244 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.772308+0000", 2020-11-16T20:56:27.244 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0075352120000000003 2020-11-16T20:56:27.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.244 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:27.244 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.779843+0000", 2020-11-16T20:56:27.244 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6133000000000001e-05 2020-11-16T20:56:27.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.245 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.245 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:27.245 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.779879+0000", 2020-11-16T20:56:27.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010670076000000001 2020-11-16T20:56:27.245 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.245 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:27.246 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.246 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:286 4.3 e35/22 4:d76da88a:::smithi16641208-241:head v 35'61, mlcod=35'59)", 2020-11-16T20:56:27.246 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.874677+0000", 2020-11-16T20:56:27.246 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.331977012999999, 2020-11-16T20:56:27.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01129728, 2020-11-16T20:56:27.246 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:27.247 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:27.247 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:27.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:27.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.874677+0000", 2020-11-16T20:56:27.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:27.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.248 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:27.248 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.874677+0000", 2020-11-16T20:56:27.248 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0037049460000000002 2020-11-16T20:56:27.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.248 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:27.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.878382+0000", 2020-11-16T20:56:27.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6219999999999998e-06 2020-11-16T20:56:27.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.249 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:27.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.878391+0000", 2020-11-16T20:56:27.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2730000000000002e-06 2020-11-16T20:56:27.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:27.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.878399+0000", 2020-11-16T20:56:27.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3509999999999996e-06 2020-11-16T20:56:27.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:27.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.878407+0000", 2020-11-16T20:56:27.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8167999999999997e-05 2020-11-16T20:56:27.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:27.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.878455+0000", 2020-11-16T20:56:27.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4728000000000001e-05 2020-11-16T20:56:27.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.252 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.252 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:27.252 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.878479+0000", 2020-11-16T20:56:27.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074377230000000003 2020-11-16T20:56:27.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.252 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.252 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:27.253 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.885917+0000", 2020-11-16T20:56:27.253 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7469000000000002e-05 2020-11-16T20:56:27.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.253 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:27.253 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.885975+0000", 2020-11-16T20:56:27.253 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01129728 2020-11-16T20:56:27.253 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.254 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:27.254 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.254 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:288 4.3 e35/22 4:dafe2ce7:::smithi16641208-242:head v 35'63, mlcod=35'61)", 2020-11-16T20:56:27.254 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.896675+0000", 2020-11-16T20:56:27.254 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.309979421000001, 2020-11-16T20:56:27.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010032602999999999, 2020-11-16T20:56:27.255 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:27.255 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:27.255 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:27.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:27.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.896675+0000", 2020-11-16T20:56:27.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:27.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:27.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.896675+0000", 2020-11-16T20:56:27.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003212356 2020-11-16T20:56:27.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.257 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:27.257 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.899887+0000", 2020-11-16T20:56:27.257 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0545e-05 2020-11-16T20:56:27.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.257 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.257 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:27.257 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.899898+0000", 2020-11-16T20:56:27.258 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7331999999999999e-05 2020-11-16T20:56:27.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.258 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:27.258 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.899915+0000", 2020-11-16T20:56:27.258 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.08e-05 2020-11-16T20:56:27.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.259 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:27.259 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.899926+0000", 2020-11-16T20:56:27.259 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8739999999999997e-05 2020-11-16T20:56:27.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.259 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:27.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.899985+0000", 2020-11-16T20:56:27.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5568e-05 2020-11-16T20:56:27.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:27.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.900010+0000", 2020-11-16T20:56:27.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0066311709999999999 2020-11-16T20:56:27.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:27.261 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.906641+0000", 2020-11-16T20:56:27.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6091000000000001e-05 2020-11-16T20:56:27.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:27.262 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.906708+0000", 2020-11-16T20:56:27.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010032602999999999 2020-11-16T20:56:27.262 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.262 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:27.262 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.262 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:361 4.3 e36/22 4:c982201a:::smithi16641208-344:head v 36'68, mlcod=35'66)", 2020-11-16T20:56:27.263 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:56.539838+0000", 2020-11-16T20:56:27.263 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.666816167, 2020-11-16T20:56:27.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016918861, 2020-11-16T20:56:27.263 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:27.263 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:27.263 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:27.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:27.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.539838+0000", 2020-11-16T20:56:27.264 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:27.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:27.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.539838+0000", 2020-11-16T20:56:27.264 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0063033710000000003 2020-11-16T20:56:27.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.265 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:27.265 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.546142+0000", 2020-11-16T20:56:27.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1715e-05 2020-11-16T20:56:27.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.266 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:27.266 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.546153+0000", 2020-11-16T20:56:27.266 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0464e-05 2020-11-16T20:56:27.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.266 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.266 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:27.266 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.546164+0000", 2020-11-16T20:56:27.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1470000000000001e-06 2020-11-16T20:56:27.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.267 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.267 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:27.267 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.546172+0000", 2020-11-16T20:56:27.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8400999999999995e-05 2020-11-16T20:56:27.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.268 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:27.268 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.546270+0000", 2020-11-16T20:56:27.268 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0125999999999999e-05 2020-11-16T20:56:27.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.268 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:27.268 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.546300+0000", 2020-11-16T20:56:27.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010385676999999999 2020-11-16T20:56:27.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.269 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:27.269 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.556686+0000", 2020-11-16T20:56:27.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0959999999999998e-05 2020-11-16T20:56:27.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:27.270 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.556757+0000", 2020-11-16T20:56:27.270 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016918861 2020-11-16T20:56:27.270 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.270 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:27.270 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.271 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.271 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:537 4.3 e41/22 4:c97658cf:::smithi16641208-283:head v 41'94, mlcod=36'92)", 2020-11-16T20:56:27.271 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:04.013912+0000", 2020-11-16T20:56:27.271 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.192742028000001, 2020-11-16T20:56:27.271 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011964577000000001, 2020-11-16T20:56:27.271 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:27.271 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:27.272 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:27.272 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.272 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:27.272 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.013912+0000", 2020-11-16T20:56:27.272 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:27.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.272 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.272 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:27.273 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.013912+0000", 2020-11-16T20:56:27.273 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00537639 2020-11-16T20:56:27.273 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.273 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.273 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:27.273 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.019289+0000", 2020-11-16T20:56:27.273 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8269999999999993e-06 2020-11-16T20:56:27.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.274 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.274 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:27.274 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.019299+0000", 2020-11-16T20:56:27.274 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2023e-05 2020-11-16T20:56:27.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.275 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.275 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:27.275 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.019311+0000", 2020-11-16T20:56:27.275 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7510000000000003e-06 2020-11-16T20:56:27.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.275 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.275 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:27.276 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.019320+0000", 2020-11-16T20:56:27.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3052e-05 2020-11-16T20:56:27.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.276 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:27.276 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.019363+0000", 2020-11-16T20:56:27.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6609999999999999e-05 2020-11-16T20:56:27.277 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.277 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.277 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:27.277 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.019380+0000", 2020-11-16T20:56:27.277 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064317350000000001 2020-11-16T20:56:27.277 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.277 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.277 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:27.278 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.025812+0000", 2020-11-16T20:56:27.278 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5189000000000002e-05 2020-11-16T20:56:27.278 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.278 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.278 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:27.278 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.025877+0000", 2020-11-16T20:56:27.278 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011964577000000001 2020-11-16T20:56:27.279 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.279 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:27.279 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.279 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.279 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.279 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:538 4.3 e41/22 4:c9160c9c:::smithi16641208-411:head v 41'95, mlcod=37'93)", 2020-11-16T20:56:27.279 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:04.125639+0000", 2020-11-16T20:56:27.279 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.081015781000001, 2020-11-16T20:56:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017440449, 2020-11-16T20:56:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125639+0000", 2020-11-16T20:56:27.281 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:27.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.281 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.281 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:27.281 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125639+0000", 2020-11-16T20:56:27.281 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051874809999999999 2020-11-16T20:56:27.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.281 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.282 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:27.282 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130826+0000", 2020-11-16T20:56:27.282 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1416999999999999e-05 2020-11-16T20:56:27.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.282 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.282 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:27.282 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130837+0000", 2020-11-16T20:56:27.283 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1552999999999999e-05 2020-11-16T20:56:27.283 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.283 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.283 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:27.283 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130849+0000", 2020-11-16T20:56:27.283 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1341e-05 2020-11-16T20:56:27.283 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.284 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.284 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:27.284 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130860+0000", 2020-11-16T20:56:27.284 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4345000000000006e-05 2020-11-16T20:56:27.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.284 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.284 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:27.284 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130955+0000", 2020-11-16T20:56:27.285 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0686999999999997e-05 2020-11-16T20:56:27.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.285 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:27.285 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.131015+0000", 2020-11-16T20:56:27.285 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011987345999999999 2020-11-16T20:56:27.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.286 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:27.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.143003+0000", 2020-11-16T20:56:27.286 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6279000000000006e-05 2020-11-16T20:56:27.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.286 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:27.287 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.143079+0000", 2020-11-16T20:56:27.287 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017440449 2020-11-16T20:56:27.287 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.287 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:27.287 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.287 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.287 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:539 4.3 e41/22 4:c9160c9c:::smithi16641208-411:6 v 41'96, mlcod=37'93)", 2020-11-16T20:56:27.288 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:04.133431+0000", 2020-11-16T20:56:27.288 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.073223687999999, 2020-11-16T20:56:27.288 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012154900999999999, 2020-11-16T20:56:27.288 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:27.288 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:27.288 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:27.288 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:27.289 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.133431+0000", 2020-11-16T20:56:27.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:27.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:27.289 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.133431+0000", 2020-11-16T20:56:27.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004504325 2020-11-16T20:56:27.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.290 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:27.290 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.137935+0000", 2020-11-16T20:56:27.290 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9359999999999994e-06 2020-11-16T20:56:27.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.291 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:27.291 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.137945+0000", 2020-11-16T20:56:27.291 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4032999999999999e-05 2020-11-16T20:56:27.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.291 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.291 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:27.291 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.137959+0000", 2020-11-16T20:56:27.292 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1919999999999994e-06 2020-11-16T20:56:27.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.292 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.292 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:27.292 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.137968+0000", 2020-11-16T20:56:27.292 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2193000000000005e-05 2020-11-16T20:56:27.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.292 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.293 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:27.293 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.138040+0000", 2020-11-16T20:56:27.293 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4004999999999997e-05 2020-11-16T20:56:27.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.293 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:27.293 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.138074+0000", 2020-11-16T20:56:27.294 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074481130000000001 2020-11-16T20:56:27.294 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.294 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.294 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:27.294 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.145522+0000", 2020-11-16T20:56:27.294 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3103999999999998e-05 2020-11-16T20:56:27.294 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.295 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.295 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:27.295 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.145586+0000", 2020-11-16T20:56:27.295 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012154900999999999 2020-11-16T20:56:27.295 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.295 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:27.295 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.296 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.296 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:593 4.3 e46/22 4:c5716d1e:::smithi16641208-111:head v 46'121, mlcod=46'118)", 2020-11-16T20:56:27.296 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:09.075421+0000", 2020-11-16T20:56:27.296 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.131232906000001, 2020-11-16T20:56:27.296 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015644788999999999, 2020-11-16T20:56:27.296 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:27.296 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:27.297 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:27.297 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.297 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:27.297 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.075421+0000", 2020-11-16T20:56:27.297 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:27.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.297 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.298 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:27.298 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.075421+0000", 2020-11-16T20:56:27.298 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006661335 2020-11-16T20:56:27.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.298 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.298 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:27.298 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082083+0000", 2020-11-16T20:56:27.299 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1031e-05 2020-11-16T20:56:27.299 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.299 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.299 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:27.299 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082094+0000", 2020-11-16T20:56:27.299 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5427999999999999e-05 2020-11-16T20:56:27.299 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.299 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.300 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:27.300 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082109+0000", 2020-11-16T20:56:27.300 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7580000000000004e-06 2020-11-16T20:56:27.300 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.300 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.300 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:27.300 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082119+0000", 2020-11-16T20:56:27.301 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6067999999999999e-05 2020-11-16T20:56:27.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.301 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.301 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:27.301 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082175+0000", 2020-11-16T20:56:27.301 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4882e-05 2020-11-16T20:56:27.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.301 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.302 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:27.302 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082200+0000", 2020-11-16T20:56:27.302 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088139840000000004 2020-11-16T20:56:27.302 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.302 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.302 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:27.302 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.091014+0000", 2020-11-16T20:56:27.303 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2302999999999997e-05 2020-11-16T20:56:27.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.303 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.303 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:27.303 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.091066+0000", 2020-11-16T20:56:27.303 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015644788999999999 2020-11-16T20:56:27.303 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.303 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:27.304 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.304 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.304 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.304 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.3.0:498 4.0 e47/22 4:3b92f709:::smithi16641208-69:head v 47'94, mlcod=45'91)", 2020-11-16T20:56:27.304 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:10.026793+0000", 2020-11-16T20:56:27.304 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 17.179861115000001, 2020-11-16T20:56:27.304 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011324136, 2020-11-16T20:56:27.305 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:27.305 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:27.305 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:27.305 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.305 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:27.305 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.026793+0000", 2020-11-16T20:56:27.305 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:27.305 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.306 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.306 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:27.306 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.026793+0000", 2020-11-16T20:56:27.306 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0044730280000000004 2020-11-16T20:56:27.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.306 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.306 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:27.307 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.031266+0000", 2020-11-16T20:56:27.307 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3858e-05 2020-11-16T20:56:27.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.307 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:27.307 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.031280+0000", 2020-11-16T20:56:27.307 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.715e-05 2020-11-16T20:56:27.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.308 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:27.308 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.031297+0000", 2020-11-16T20:56:27.308 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2184999999999999e-05 2020-11-16T20:56:27.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.308 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:27.309 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.031309+0000", 2020-11-16T20:56:27.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1724999999999995e-05 2020-11-16T20:56:27.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.309 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.309 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:27.309 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.031381+0000", 2020-11-16T20:56:27.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6733e-05 2020-11-16T20:56:27.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:27.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.031408+0000", 2020-11-16T20:56:27.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0066279820000000001 2020-11-16T20:56:27.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:27.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.038036+0000", 2020-11-16T20:56:27.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1475000000000002e-05 2020-11-16T20:56:27.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:27.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.038117+0000", 2020-11-16T20:56:27.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011324136 2020-11-16T20:56:27.312 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.312 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:27.312 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.312 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:659 4.3 e57/22 4:d5f06b92:::smithi16641208-65:e v 57'176, mlcod=57'172)", 2020-11-16T20:56:27.312 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.759574+0000", 2020-11-16T20:56:27.312 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 7.4470808130000004, 2020-11-16T20:56:27.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011751119000000001, 2020-11-16T20:56:27.313 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:27.313 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:27.313 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:27.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.313 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:27.313 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759574+0000", 2020-11-16T20:56:27.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:27.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.314 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:27.314 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759574+0000", 2020-11-16T20:56:27.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5672e-05 2020-11-16T20:56:27.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.315 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:27.315 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759609+0000", 2020-11-16T20:56:27.315 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1580000000000002e-06 2020-11-16T20:56:27.315 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.315 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.315 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:27.315 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759615+0000", 2020-11-16T20:56:27.316 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4220000000000003e-06 2020-11-16T20:56:27.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.316 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:27.316 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759623+0000", 2020-11-16T20:56:27.316 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3190000000000002e-06 2020-11-16T20:56:27.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:27.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759628+0000", 2020-11-16T20:56:27.317 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3109000000000003e-05 2020-11-16T20:56:27.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:27.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759681+0000", 2020-11-16T20:56:27.318 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9561000000000001e-05 2020-11-16T20:56:27.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.318 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:27.318 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759701+0000", 2020-11-16T20:56:27.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011559477 2020-11-16T20:56:27.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.319 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:27.319 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.771260+0000", 2020-11-16T20:56:27.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4400999999999995e-05 2020-11-16T20:56:27.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.320 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.320 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:27.320 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.771325+0000", 2020-11-16T20:56:27.320 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011751119000000001 2020-11-16T20:56:27.320 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.320 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:27.320 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.321 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:660 4.3 e57/22 4:fc3a32b3:::smithi16641208-6:14 v 57'178, mlcod=57'172)", 2020-11-16T20:56:27.321 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.759657+0000", 2020-11-16T20:56:27.321 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 7.4469971289999997, 2020-11-16T20:56:27.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011717154, 2020-11-16T20:56:27.321 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:27.321 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:27.322 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:27.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:27.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759657+0000", 2020-11-16T20:56:27.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:27.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:27.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759657+0000", 2020-11-16T20:56:27.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1059999999999997e-05 2020-11-16T20:56:27.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:27.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759688+0000", 2020-11-16T20:56:27.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4467999999999999e-05 2020-11-16T20:56:27.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.324 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:27.324 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759703+0000", 2020-11-16T20:56:27.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7870000000000004e-06 2020-11-16T20:56:27.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.324 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:27.325 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759710+0000", 2020-11-16T20:56:27.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8199999999999998e-06 2020-11-16T20:56:27.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:27.325 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759713+0000", 2020-11-16T20:56:27.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0018547539999999999 2020-11-16T20:56:27.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.326 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:27.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.761568+0000", 2020-11-16T20:56:27.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5524000000000001e-05 2020-11-16T20:56:27.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:27.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.761604+0000", 2020-11-16T20:56:27.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0097264959999999994 2020-11-16T20:56:27.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:27.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.771330+0000", 2020-11-16T20:56:27.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4245000000000001e-05 2020-11-16T20:56:27.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:27.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.771374+0000", 2020-11-16T20:56:27.328 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011717154 2020-11-16T20:56:27.328 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.328 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:27.329 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.329 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:663 4.3 e57/22 4:f65e82cb:::smithi16641208-219:head v 57'179, mlcod=57'176)", 2020-11-16T20:56:27.329 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.796847+0000", 2020-11-16T20:56:27.329 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 7.4098074450000002, 2020-11-16T20:56:27.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.053788638999999999, 2020-11-16T20:56:27.329 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:27.330 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:27.330 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:27.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.330 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:27.330 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796847+0000", 2020-11-16T20:56:27.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:27.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.331 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:27.331 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796847+0000", 2020-11-16T20:56:27.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016730294999999999 2020-11-16T20:56:27.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.331 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:27.332 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813577+0000", 2020-11-16T20:56:27.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3168e-05 2020-11-16T20:56:27.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.332 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:27.332 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813590+0000", 2020-11-16T20:56:27.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.203e-05 2020-11-16T20:56:27.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.333 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:27.333 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813602+0000", 2020-11-16T20:56:27.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4837999999999999e-05 2020-11-16T20:56:27.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.333 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:27.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813617+0000", 2020-11-16T20:56:27.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010021 2020-11-16T20:56:27.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.334 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:27.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813717+0000", 2020-11-16T20:56:27.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7735000000000003e-05 2020-11-16T20:56:27.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.335 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.335 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:27.335 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813765+0000", 2020-11-16T20:56:27.335 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036802020999999997 2020-11-16T20:56:27.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.335 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.335 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:27.336 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.850567+0000", 2020-11-16T20:56:27.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8342000000000004e-05 2020-11-16T20:56:27.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.336 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.336 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:27.336 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.850636+0000", 2020-11-16T20:56:27.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.053788638999999999 2020-11-16T20:56:27.337 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.337 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:27.337 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.337 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2589 4.3 e57/22 4:f65e82cb:::smithi16641208-219:head v 57'180, mlcod=57'176)", 2020-11-16T20:56:27.337 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.813687+0000", 2020-11-16T20:56:27.338 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 7.3929669929999999, 2020-11-16T20:56:27.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.037630996, 2020-11-16T20:56:27.338 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:27.338 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:27.338 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:27.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:27.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813687+0000", 2020-11-16T20:56:27.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:27.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.339 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.339 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:27.339 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813687+0000", 2020-11-16T20:56:27.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010138436000000001 2020-11-16T20:56:27.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.340 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.340 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:27.340 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.823826+0000", 2020-11-16T20:56:27.340 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5939999999999996e-06 2020-11-16T20:56:27.340 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.340 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.340 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:27.341 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.823833+0000", 2020-11-16T20:56:27.341 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8019999999999998e-06 2020-11-16T20:56:27.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.341 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:27.341 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.823842+0000", 2020-11-16T20:56:27.341 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8880000000000002e-06 2020-11-16T20:56:27.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:27.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.823848+0000", 2020-11-16T20:56:27.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2058000000000002e-05 2020-11-16T20:56:27.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:27.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.823900+0000", 2020-11-16T20:56:27.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0489e-05 2020-11-16T20:56:27.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:27.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.823921+0000", 2020-11-16T20:56:27.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027347369 2020-11-16T20:56:27.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.344 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.344 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:27.344 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851268+0000", 2020-11-16T20:56:27.344 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0359999999999999e-05 2020-11-16T20:56:27.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.344 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.344 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:27.345 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851318+0000", 2020-11-16T20:56:27.345 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.037630996 2020-11-16T20:56:27.345 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.345 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:27.345 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.346 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2590 4.3 e57/22 4:f65e82cb:::smithi16641208-219:head v 57'181, mlcod=57'176)", 2020-11-16T20:56:27.346 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.823889+0000", 2020-11-16T20:56:27.346 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 7.3827652480000001, 2020-11-16T20:56:27.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027470371, 2020-11-16T20:56:27.346 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:27.346 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:27.347 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:27.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.347 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:27.347 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.823889+0000", 2020-11-16T20:56:27.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:27.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.347 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:27.348 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.823889+0000", 2020-11-16T20:56:27.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030437800000000001 2020-11-16T20:56:27.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.348 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:27.348 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824193+0000", 2020-11-16T20:56:27.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7940000000000008e-06 2020-11-16T20:56:27.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.349 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:27.349 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824202+0000", 2020-11-16T20:56:27.349 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1396999999999999e-05 2020-11-16T20:56:27.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.349 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:27.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824214+0000", 2020-11-16T20:56:27.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2600000000000002e-06 2020-11-16T20:56:27.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:27.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824220+0000", 2020-11-16T20:56:27.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023416909999999999 2020-11-16T20:56:27.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.351 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:27.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.826562+0000", 2020-11-16T20:56:27.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8850999999999999e-05 2020-11-16T20:56:27.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:27.352 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.826590+0000", 2020-11-16T20:56:27.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024730210999999998 2020-11-16T20:56:27.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:27.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851321+0000", 2020-11-16T20:56:27.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8788999999999997e-05 2020-11-16T20:56:27.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:27.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851359+0000", 2020-11-16T20:56:27.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027470371 2020-11-16T20:56:27.354 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.354 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:27.354 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.354 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.354 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2591 4.3 e57/22 4:f65e82cb:::smithi16641208-219:head v 57'182, mlcod=57'176)", 2020-11-16T20:56:27.354 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.824255+0000", 2020-11-16T20:56:27.355 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 7.3823990229999996, 2020-11-16T20:56:27.355 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027144567000000001, 2020-11-16T20:56:27.355 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:27.355 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:27.355 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:27.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.355 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:27.355 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824255+0000", 2020-11-16T20:56:27.356 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:27.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.356 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.356 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:27.356 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824255+0000", 2020-11-16T20:56:27.356 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8541999999999997e-05 2020-11-16T20:56:27.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:27.357 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824304+0000", 2020-11-16T20:56:27.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7320000000000003e-06 2020-11-16T20:56:27.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:27.357 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824310+0000", 2020-11-16T20:56:27.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0047000000000001e-05 2020-11-16T20:56:27.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.358 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:27.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824320+0000", 2020-11-16T20:56:27.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.279e-06 2020-11-16T20:56:27.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:27.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824324+0000", 2020-11-16T20:56:27.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0029814379999999999 2020-11-16T20:56:27.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:27.360 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.827305+0000", 2020-11-16T20:56:27.360 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8090000000000001e-05 2020-11-16T20:56:27.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.360 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.360 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:27.360 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.827323+0000", 2020-11-16T20:56:27.360 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024037699999999999 2020-11-16T20:56:27.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.361 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.361 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:27.361 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851361+0000", 2020-11-16T20:56:27.361 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8739000000000003e-05 2020-11-16T20:56:27.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.361 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.361 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:27.362 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851400+0000", 2020-11-16T20:56:27.362 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027144567000000001 2020-11-16T20:56:27.362 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.362 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:27.362 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.362 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:667 4.3 e57/22 4:f5f8fa2a:::smithi16641208-144:head v 57'183, mlcod=57'181)", 2020-11-16T20:56:27.363 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.861028+0000", 2020-11-16T20:56:27.363 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 7.3456260990000004, 2020-11-16T20:56:27.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013994273999999999, 2020-11-16T20:56:27.363 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:27.363 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:27.363 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:27.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:27.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.861028+0000", 2020-11-16T20:56:27.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:27.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:27.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.861028+0000", 2020-11-16T20:56:27.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006986707 2020-11-16T20:56:27.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:27.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.868015+0000", 2020-11-16T20:56:27.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9870000000000005e-06 2020-11-16T20:56:27.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.366 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:27.366 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.868024+0000", 2020-11-16T20:56:27.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3794999999999999e-05 2020-11-16T20:56:27.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.366 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:27.366 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.868038+0000", 2020-11-16T20:56:27.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.268e-06 2020-11-16T20:56:27.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:27.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.868047+0000", 2020-11-16T20:56:27.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5488999999999997e-05 2020-11-16T20:56:27.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:27.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.868102+0000", 2020-11-16T20:56:27.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0601000000000001e-05 2020-11-16T20:56:27.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:27.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.868123+0000", 2020-11-16T20:56:27.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0068583079999999996 2020-11-16T20:56:27.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:27.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.874981+0000", 2020-11-16T20:56:27.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1118999999999997e-05 2020-11-16T20:56:27.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:27.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:27.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:27.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.875023+0000", 2020-11-16T20:56:27.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013994273999999999 2020-11-16T20:56:27.370 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.370 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:27.370 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.370 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:27.371 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:27.371 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:27.372 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:56:27.373 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:27.376+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:27.461 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:56:27.473 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:27.477+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:27.514 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:27.514 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:27.514 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:56:27.514 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:27.524 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:56:27.574 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:27.578+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:27.611 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:56:27.632 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:56:27.651 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:56:27.656 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:27.657 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:27.667 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:56:27.671 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:56:27.694 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:56:27.694 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:27.698+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:27.714 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:56:27.735 INFO:tasks.rados.rados.0.smithi166.stdout:712: done (0 left) 2020-11-16T20:56:27.736 INFO:tasks.rados.rados.0.smithi166.stdout:713: copy_from oid 8 from oid 469 current snap is 16 2020-11-16T20:56:27.736 INFO:tasks.rados.rados.0.smithi166.stdout:714: cache_evict oid 165 snap -1 2020-11-16T20:56:27.736 INFO:tasks.rados.rados.0.smithi166.stdout:715: write oid 465 current snap is 16 2020-11-16T20:56:27.736 INFO:tasks.rados.rados.0.smithi166.stdout:715: seq_num 554 ranges {511078=465362,1752436=740194,3163985=147093} 2020-11-16T20:56:27.738 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:56:27.740 INFO:tasks.rados.rados.0.smithi166.stdout:715: writing smithi16641208-465 from 511078 to 976440 tid 1 2020-11-16T20:56:27.749 INFO:tasks.rados.rados.0.smithi166.stdout:715: writing smithi16641208-465 from 1752436 to 2492630 tid 2 2020-11-16T20:56:27.751 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2020-11-16T20:56:27.754 INFO:tasks.rados.rados.0.smithi166.stdout:715: writing smithi16641208-465 from 3163985 to 3311078 tid 3 2020-11-16T20:56:27.754 INFO:tasks.rados.rados.0.smithi166.stdout:716: cache_evict oid 450 snap -1 2020-11-16T20:56:27.754 INFO:tasks.rados.rados.0.smithi166.stdout:717: delete oid 152 current snap is 16 2020-11-16T20:56:27.755 INFO:tasks.rados.rados.0.smithi166.stdout:714: got (2) No such file or directory 2020-11-16T20:56:27.756 INFO:tasks.rados.rados.0.smithi166.stdout:716: got (0) Success 2020-11-16T20:56:27.760 INFO:tasks.rados.rados.0.smithi166.stdout:714: done (4 left) 2020-11-16T20:56:27.761 INFO:tasks.rados.rados.0.smithi166.stdout:716: done (3 left) 2020-11-16T20:56:27.761 INFO:tasks.rados.rados.0.smithi166.stdout:717: done (2 left) 2020-11-16T20:56:27.761 INFO:tasks.rados.rados.0.smithi166.stdout:718: write oid 127 current snap is 16 2020-11-16T20:56:27.761 INFO:tasks.rados.rados.0.smithi166.stdout:718: seq_num 556 ranges {544692=732213,1985753=743863,3335184=9508} 2020-11-16T20:56:27.768 INFO:tasks.rados.rados.0.smithi166.stdout:718: writing smithi16641208-127 from 544692 to 1276905 tid 1 2020-11-16T20:56:27.776 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:27.780+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:27.777 INFO:tasks.rados.rados.0.smithi166.stdout:718: writing smithi16641208-127 from 1985753 to 2729616 tid 2 2020-11-16T20:56:27.782 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:56:27.782 INFO:tasks.rados.rados.0.smithi166.stdout:718: writing smithi16641208-127 from 3335184 to 3344692 tid 3 2020-11-16T20:56:27.782 INFO:tasks.rados.rados.0.smithi166.stdout:719: copy_from oid 174 from oid 353 current snap is 16 2020-11-16T20:56:27.782 INFO:tasks.rados.rados.0.smithi166.stdout:715: finishing write tid 1 to smithi16641208-465 2020-11-16T20:56:27.782 INFO:tasks.rados.rados.0.smithi166.stdout:718: finishing write tid 1 to smithi16641208-127 2020-11-16T20:56:27.782 INFO:tasks.rados.rados.0.smithi166.stdout:720: write oid 23 current snap is 16 2020-11-16T20:56:27.783 INFO:tasks.rados.rados.0.smithi166.stdout:720: seq_num 557 ranges {561499=407462,1527882=487521,2729901=557217} 2020-11-16T20:56:27.785 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:56:27.786 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:56:27.786 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:56:27.786 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:56:27.786 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:56:27.786 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:56:27.786 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:56:27.786 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:56:27.787 INFO:tasks.rados.rados.0.smithi166.stdout:720: writing smithi16641208-23 from 561499 to 968961 tid 1 2020-11-16T20:56:27.793 INFO:tasks.rados.rados.0.smithi166.stdout:720: writing smithi16641208-23 from 1527882 to 2015403 tid 2 2020-11-16T20:56:27.801 INFO:tasks.rados.rados.0.smithi166.stdout:720: writing smithi16641208-23 from 2729901 to 3287118 tid 3 2020-11-16T20:56:27.802 INFO:tasks.rados.rados.0.smithi166.stdout:721: snap_remove snap 12 2020-11-16T20:56:27.846 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:27.846 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:27.862 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:56:27.877 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:27.882+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:27.978 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:27.982+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:28.079 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:28.083+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:28.088 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:28.088 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:28.101 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:56:28.180 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:28.185+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:28.281 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:28.286+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:28.299 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:28.299 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:28.310 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:56:28.382 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:28.386+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:28.464 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:28.464 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:28.476 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:56:28.483 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:28.487+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:28.583 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:28.588+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:28.643 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:28.643 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:28.652 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:56:28.696 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:28.700+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:28.782 INFO:tasks.rados.rados.0.smithi166.stdout:721: done (5 left) 2020-11-16T20:56:28.782 INFO:tasks.rados.rados.0.smithi166.stdout:722: cache_evict oid 25 snap -1 2020-11-16T20:56:28.782 INFO:tasks.rados.rados.0.smithi166.stdout:723: write oid 476 current snap is 16 2020-11-16T20:56:28.782 INFO:tasks.rados.rados.0.smithi166.stdout:723: seq_num 558 ranges {578306=482711,1586364=631179,2757324=484842} 2020-11-16T20:56:28.783 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:28.783 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:28.785 INFO:tasks.rados.rados.0.smithi166.stdout:723: writing smithi16641208-476 from 578306 to 1061017 tid 1 2020-11-16T20:56:28.785 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:28.789+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:28.786 INFO:teuthology.orchestra.run.smithi166.stderr:nodeep-scrub is unset 2020-11-16T20:56:28.792 INFO:tasks.rados.rados.0.smithi166.stdout:723: writing smithi16641208-476 from 1586364 to 2217543 tid 2 2020-11-16T20:56:28.798 INFO:tasks.rados.rados.0.smithi166.stdout:723: writing smithi16641208-476 from 2757324 to 3242166 tid 3 2020-11-16T20:56:28.799 INFO:tasks.rados.rados.0.smithi166.stdout:724: delete oid 436 current snap is 16 2020-11-16T20:56:28.799 INFO:tasks.rados.rados.0.smithi166.stdout:718: finishing write tid 2 to smithi16641208-127 2020-11-16T20:56:28.799 INFO:tasks.rados.rados.0.smithi166.stdout:718: finishing write tid 3 to smithi16641208-127 2020-11-16T20:56:28.799 INFO:tasks.rados.rados.0.smithi166.stdout:718: finishing write tid 4 to smithi16641208-127 2020-11-16T20:56:28.799 INFO:tasks.rados.rados.0.smithi166.stdout:718: finishing write tid 5 to smithi16641208-127 2020-11-16T20:56:28.799 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 127 v 503 (ObjNum 556 snap 16 seq_num 556) dirty exists 2020-11-16T20:56:28.800 INFO:tasks.rados.rados.0.smithi166.stdout:718: left oid 127 (ObjNum 556 snap 16 seq_num 556) 2020-11-16T20:56:28.800 INFO:tasks.rados.rados.0.smithi166.stdout:713: finishing copy_from to smithi16641208-8 2020-11-16T20:56:28.800 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 8 v 408 (ObjNum 468 snap 0 seq_num 468) dirty exists 2020-11-16T20:56:28.800 INFO:tasks.rados.rados.0.smithi166.stdout:713: finishing copy_from racing read to smithi16641208-8 2020-11-16T20:56:28.800 INFO:tasks.rados.rados.0.smithi166.stdout:715: finishing write tid 2 to smithi16641208-465 2020-11-16T20:56:28.800 INFO:tasks.rados.rados.0.smithi166.stdout:715: finishing write tid 3 to smithi16641208-465 2020-11-16T20:56:28.800 INFO:tasks.rados.rados.0.smithi166.stdout:715: finishing write tid 4 to smithi16641208-465 2020-11-16T20:56:28.800 INFO:tasks.rados.rados.0.smithi166.stdout:715: finishing write tid 5 to smithi16641208-465 2020-11-16T20:56:28.801 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 465 v 490 (ObjNum 554 snap 16 seq_num 554) dirty exists 2020-11-16T20:56:28.801 INFO:tasks.rados.rados.0.smithi166.stdout:715: left oid 465 (ObjNum 554 snap 16 seq_num 554) 2020-11-16T20:56:28.801 INFO:tasks.rados.rados.0.smithi166.stdout:720: finishing write tid 1 to smithi16641208-23 2020-11-16T20:56:28.801 INFO:tasks.rados.rados.0.smithi166.stdout:720: finishing write tid 2 to smithi16641208-23 2020-11-16T20:56:28.801 INFO:tasks.rados.rados.0.smithi166.stdout:720: finishing write tid 3 to smithi16641208-23 2020-11-16T20:56:28.801 INFO:tasks.rados.rados.0.smithi166.stdout:720: finishing write tid 4 to smithi16641208-23 2020-11-16T20:56:28.801 INFO:tasks.rados.rados.0.smithi166.stdout:720: finishing write tid 5 to smithi16641208-23 2020-11-16T20:56:28.802 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 23 v 494 (ObjNum 557 snap 16 seq_num 557) dirty exists 2020-11-16T20:56:28.802 INFO:tasks.rados.rados.0.smithi166.stdout:720: left oid 23 (ObjNum 557 snap 16 seq_num 557) 2020-11-16T20:56:28.802 INFO:tasks.rados.rados.0.smithi166.stdout:719: finishing copy_from to smithi16641208-174 2020-11-16T20:56:28.802 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 174 v 312 (ObjNum 352 snap 0 seq_num 352) dirty exists 2020-11-16T20:56:28.802 INFO:tasks.rados.rados.0.smithi166.stdout:719: finishing copy_from racing read to smithi16641208-174 2020-11-16T20:56:28.802 INFO:tasks.rados.rados.0.smithi166.stdout:722: got (16) Device or resource busy 2020-11-16T20:56:28.802 INFO:tasks.rados.rados.0.smithi166.stdout:723: finishing write tid 1 to smithi16641208-476 2020-11-16T20:56:28.803 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:56:28.816 INFO:tasks.rados.rados.0.smithi166.stdout:713: done (7 left) 2020-11-16T20:56:28.816 INFO:tasks.rados.rados.0.smithi166.stdout:715: done (6 left) 2020-11-16T20:56:28.816 INFO:tasks.rados.rados.0.smithi166.stdout:718: done (5 left) 2020-11-16T20:56:28.816 INFO:tasks.rados.rados.0.smithi166.stdout:719: done (4 left) 2020-11-16T20:56:28.817 INFO:tasks.rados.rados.0.smithi166.stdout:720: done (3 left) 2020-11-16T20:56:28.817 INFO:tasks.rados.rados.0.smithi166.stdout:722: done (2 left) 2020-11-16T20:56:28.817 INFO:tasks.rados.rados.0.smithi166.stdout:724: done (1 left) 2020-11-16T20:56:28.817 INFO:tasks.rados.rados.0.smithi166.stdout:725: read oid 219 snap -1 2020-11-16T20:56:28.817 INFO:tasks.rados.rados.0.smithi166.stdout:725: expect (ObjNum 546 snap 12 seq_num 546) 2020-11-16T20:56:28.817 INFO:tasks.rados.rados.0.smithi166.stdout:726: cache_evict oid 272 snap 14 2020-11-16T20:56:28.817 INFO:tasks.rados.rados.0.smithi166.stdout:727: snap_create 2020-11-16T20:56:28.820 INFO:tasks.rados.rados.0.smithi166.stdout:723: finishing write tid 2 to smithi16641208-476 2020-11-16T20:56:28.821 INFO:tasks.rados.rados.0.smithi166.stdout:723: finishing write tid 3 to smithi16641208-476 2020-11-16T20:56:28.821 INFO:tasks.rados.rados.0.smithi166.stdout:723: finishing write tid 4 to smithi16641208-476 2020-11-16T20:56:28.821 INFO:tasks.rados.rados.0.smithi166.stdout:723: finishing write tid 5 to smithi16641208-476 2020-11-16T20:56:28.821 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 476 v 620 (ObjNum 558 snap 16 seq_num 558) dirty exists 2020-11-16T20:56:28.822 INFO:tasks.rados.rados.0.smithi166.stdout:723: left oid 476 (ObjNum 558 snap 16 seq_num 558) 2020-11-16T20:56:28.823 INFO:tasks.rados.rados.0.smithi166.stdout:725: expect (ObjNum 546 snap 12 seq_num 546) 2020-11-16T20:56:28.886 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:28.891+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:28.947 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:28.947 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:28.957 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:56:28.967 INFO:tasks.rados.rados.0.smithi166.stdout:726: got (2) No such file or directory 2020-11-16T20:56:29.010 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:29.014+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:29.088 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:29.093+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:29.092 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:29.092 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:29.102 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:56:29.189 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:29.193+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:29.267 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:29.267 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:29.276 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:56:29.317 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:29.321+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:29.391 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:29.395+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:29.442 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:29.442 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:29.451 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:56:29.494 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:29.499+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:29.593 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:29.597+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:29.599 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:29.599 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:29.609 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:56:29.694 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:29.698+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:29.728 INFO:tasks.rados.rados.0.smithi166.stdout:723: done (3 left) 2020-11-16T20:56:29.728 INFO:tasks.rados.rados.0.smithi166.stdout:725: done (2 left) 2020-11-16T20:56:29.728 INFO:tasks.rados.rados.0.smithi166.stdout:726: done (1 left) 2020-11-16T20:56:29.728 INFO:tasks.rados.rados.0.smithi166.stdout:727: done (0 left) 2020-11-16T20:56:29.728 INFO:tasks.rados.rados.0.smithi166.stdout:728: cache_try_flush oid 341 snap 16 2020-11-16T20:56:29.729 INFO:tasks.rados.rados.0.smithi166.stdout:729: snap_create 2020-11-16T20:56:29.730 INFO:tasks.rados.rados.0.smithi166.stdout:728: got (2) No such file or directory 2020-11-16T20:56:29.785 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:29.785 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:29.794 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:29.799+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:29.796 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:56:29.806 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:56:29.896 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:29.900+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:29.947 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:56:29.965 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:56:29.980 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:29.980 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:29.984 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:56:29.990 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:56:30.004 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:56:30.023 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:56:30.031 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:30.036+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:30.043 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:56:30.062 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:56:30.081 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:56:30.082 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:56:30.083 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:56:30.083 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:56:30.083 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:56:30.083 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:56:30.083 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:56:30.083 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:56:30.083 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:56:30.097 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:30.101+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:30.166 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:30.166 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:30.166 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:56:30.166 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:30.175 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:56:30.218 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:30.223+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:30.299 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:30.303+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:30.310 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:30.310 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:30.310 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:56:30.310 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:56:30.310 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:30.319 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:56:30.404 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:30.409+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:30.496 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:30.496 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:56:30.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:56:30.497 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:56:30.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.497 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:37 4.1 e33/22 4:b6545a47:::smithi16641208-46:head v 33'28, mlcod=33'26)", 2020-11-16T20:56:30.497 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.515282+0000", 2020-11-16T20:56:30.497 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 38.984910067000001, 2020-11-16T20:56:30.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016792344000000001, 2020-11-16T20:56:30.498 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:30.498 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:30.498 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:30.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:30.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.515282+0000", 2020-11-16T20:56:30.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:30.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:30.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.515282+0000", 2020-11-16T20:56:30.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0010571840000000001 2020-11-16T20:56:30.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:30.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516339+0000", 2020-11-16T20:56:30.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3354e-05 2020-11-16T20:56:30.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:30.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516352+0000", 2020-11-16T20:56:30.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7071999999999998e-05 2020-11-16T20:56:30.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:30.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516369+0000", 2020-11-16T20:56:30.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1358e-05 2020-11-16T20:56:30.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:30.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516381+0000", 2020-11-16T20:56:30.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5952999999999998e-05 2020-11-16T20:56:30.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:30.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516437+0000", 2020-11-16T20:56:30.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5420999999999998e-05 2020-11-16T20:56:30.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:30.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516472+0000", 2020-11-16T20:56:30.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015544192 2020-11-16T20:56:30.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:30.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532016+0000", 2020-11-16T20:56:30.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7809999999999997e-05 2020-11-16T20:56:30.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:30.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532074+0000", 2020-11-16T20:56:30.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016792344000000001 2020-11-16T20:56:30.505 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.505 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:30.505 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.505 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:39 4.1 e33/22 4:81558809:::smithi16641208-47:head v 33'30, mlcod=33'26)", 2020-11-16T20:56:30.506 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.519956+0000", 2020-11-16T20:56:30.506 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 38.980235919999998, 2020-11-16T20:56:30.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017898104000000001, 2020-11-16T20:56:30.506 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:30.506 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:30.506 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:30.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:30.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519956+0000", 2020-11-16T20:56:30.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:30.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:30.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519956+0000", 2020-11-16T20:56:30.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00038710900000000001 2020-11-16T20:56:30.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.508 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:30.508 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520343+0000", 2020-11-16T20:56:30.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0797e-05 2020-11-16T20:56:30.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.508 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:30.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520354+0000", 2020-11-16T20:56:30.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5874000000000001e-05 2020-11-16T20:56:30.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:30.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520370+0000", 2020-11-16T20:56:30.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3580000000000003e-06 2020-11-16T20:56:30.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:30.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520378+0000", 2020-11-16T20:56:30.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5744000000000001e-05 2020-11-16T20:56:30.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:30.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520424+0000", 2020-11-16T20:56:30.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4641e-05 2020-11-16T20:56:30.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:30.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520449+0000", 2020-11-16T20:56:30.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01735014 2020-11-16T20:56:30.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.512 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:30.512 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.537799+0000", 2020-11-16T20:56:30.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5441e-05 2020-11-16T20:56:30.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.513 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:30.513 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.537854+0000", 2020-11-16T20:56:30.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017898104000000001 2020-11-16T20:56:30.513 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.513 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:30.513 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.514 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:280 4.3 e35/22 4:c9fee0b4:::smithi16641208-235:head v 35'58, mlcod=35'56)", 2020-11-16T20:56:30.514 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.763889+0000", 2020-11-16T20:56:30.514 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 35.736302918, 2020-11-16T20:56:30.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013950272999999999, 2020-11-16T20:56:30.514 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:30.514 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:30.514 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:30.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:30.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.763889+0000", 2020-11-16T20:56:30.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:30.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:30.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.763889+0000", 2020-11-16T20:56:30.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047249290000000001 2020-11-16T20:56:30.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:30.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768614+0000", 2020-11-16T20:56:30.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.046e-05 2020-11-16T20:56:30.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.517 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:30.517 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768624+0000", 2020-11-16T20:56:30.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3501e-05 2020-11-16T20:56:30.517 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.517 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:30.517 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768638+0000", 2020-11-16T20:56:30.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9279999999999993e-06 2020-11-16T20:56:30.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:30.518 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768646+0000", 2020-11-16T20:56:30.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3752999999999999e-05 2020-11-16T20:56:30.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:30.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768690+0000", 2020-11-16T20:56:30.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7498000000000001e-05 2020-11-16T20:56:30.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:30.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768707+0000", 2020-11-16T20:56:30.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0090558849999999996 2020-11-16T20:56:30.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:30.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.777763+0000", 2020-11-16T20:56:30.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6318999999999999e-05 2020-11-16T20:56:30.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:30.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.777839+0000", 2020-11-16T20:56:30.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013950272999999999 2020-11-16T20:56:30.521 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.521 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:30.521 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.522 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:202 3.2 e35/19 3:5723fd94:::smithi16641208-211:head v 35'124, mlcod=35'121)", 2020-11-16T20:56:30.522 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.980847+0000", 2020-11-16T20:56:30.522 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 35.519345160999997, 2020-11-16T20:56:30.522 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015747763000000001, 2020-11-16T20:56:30.522 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:30.523 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:30.523 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:30.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:30.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.980847+0000", 2020-11-16T20:56:30.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:30.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.524 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:30.524 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.980847+0000", 2020-11-16T20:56:30.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072722660000000003 2020-11-16T20:56:30.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.524 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.524 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:30.524 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988119+0000", 2020-11-16T20:56:30.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2539e-05 2020-11-16T20:56:30.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.525 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:30.525 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988132+0000", 2020-11-16T20:56:30.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3723000000000001e-05 2020-11-16T20:56:30.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.526 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:30.526 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988145+0000", 2020-11-16T20:56:30.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8379999999999998e-06 2020-11-16T20:56:30.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.526 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:30.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988151+0000", 2020-11-16T20:56:30.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2691000000000002e-05 2020-11-16T20:56:30.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:30.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988194+0000", 2020-11-16T20:56:30.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8366e-05 2020-11-16T20:56:30.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:30.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988212+0000", 2020-11-16T20:56:30.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0083214259999999998 2020-11-16T20:56:30.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:30.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.996534+0000", 2020-11-16T20:56:30.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0914e-05 2020-11-16T20:56:30.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:30.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.996595+0000", 2020-11-16T20:56:30.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015747763000000001 2020-11-16T20:56:30.529 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.530 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:30.530 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.530 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:538 4.3 e41/22 4:c9160c9c:::smithi16641208-411:head v 41'95, mlcod=37'93)", 2020-11-16T20:56:30.530 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:56:30.530 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.374546111000001, 2020-11-16T20:56:30.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021023377999999999, 2020-11-16T20:56:30.531 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:30.531 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:30.531 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:30.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:30.531 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:56:30.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:30.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:30.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:56:30.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052206140000000002 2020-11-16T20:56:30.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:30.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130866+0000", 2020-11-16T20:56:30.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0824e-05 2020-11-16T20:56:30.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:30.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130877+0000", 2020-11-16T20:56:30.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5384e-05 2020-11-16T20:56:30.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:30.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130893+0000", 2020-11-16T20:56:30.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0064999999999999e-05 2020-11-16T20:56:30.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.535 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:30.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130903+0000", 2020-11-16T20:56:30.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3051000000000003e-05 2020-11-16T20:56:30.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.535 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:30.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130966+0000", 2020-11-16T20:56:30.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9724e-05 2020-11-16T20:56:30.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:30.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130985+0000", 2020-11-16T20:56:30.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015638332000000001 2020-11-16T20:56:30.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:30.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.146624+0000", 2020-11-16T20:56:30.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5383999999999998e-05 2020-11-16T20:56:30.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:30.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.146669+0000", 2020-11-16T20:56:30.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021023377999999999 2020-11-16T20:56:30.538 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.538 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:30.538 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.538 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:547 3.2 e42/19 3:5f250a2b:::smithi16641208-75:head v 42'381, mlcod=42'379)", 2020-11-16T20:56:30.539 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.026221+0000", 2020-11-16T20:56:30.539 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.473970575999999, 2020-11-16T20:56:30.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014398213, 2020-11-16T20:56:30.539 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:30.539 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:30.539 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:30.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.539 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:30.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.026221+0000", 2020-11-16T20:56:30.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:30.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:30.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.026221+0000", 2020-11-16T20:56:30.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052355140000000001 2020-11-16T20:56:30.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:30.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031457+0000", 2020-11-16T20:56:30.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3457e-05 2020-11-16T20:56:30.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:30.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031470+0000", 2020-11-16T20:56:30.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6532e-05 2020-11-16T20:56:30.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:30.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031487+0000", 2020-11-16T20:56:30.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6479999999999992e-06 2020-11-16T20:56:30.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.543 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:30.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031496+0000", 2020-11-16T20:56:30.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5820000000000003e-05 2020-11-16T20:56:30.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.543 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:30.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031561+0000", 2020-11-16T20:56:30.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6701999999999999e-05 2020-11-16T20:56:30.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:30.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031588+0000", 2020-11-16T20:56:30.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089396879999999995 2020-11-16T20:56:30.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.545 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:30.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.040528+0000", 2020-11-16T20:56:30.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1852000000000001e-05 2020-11-16T20:56:30.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.545 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:30.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.040620+0000", 2020-11-16T20:56:30.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014398213 2020-11-16T20:56:30.546 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.546 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:30.546 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.547 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2367 4.2 e42/22 4:581c1e5b:::smithi16641208-124:head v 42'136, mlcod=42'133)", 2020-11-16T20:56:30.547 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:56:30.547 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.446847732999998, 2020-11-16T20:56:30.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021196474999999999, 2020-11-16T20:56:30.547 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:30.547 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:30.548 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:30.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.548 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:30.548 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:56:30.548 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:30.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.548 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:30.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:56:30.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070663000000000002 2020-11-16T20:56:30.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.549 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:30.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060411+0000", 2020-11-16T20:56:30.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0189999999999995e-06 2020-11-16T20:56:30.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:30.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060420+0000", 2020-11-16T20:56:30.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0069e-05 2020-11-16T20:56:30.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:30.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060430+0000", 2020-11-16T20:56:30.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6879999999999999e-06 2020-11-16T20:56:30.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:30.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060437+0000", 2020-11-16T20:56:30.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3671999999999995e-05 2020-11-16T20:56:30.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.552 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:30.552 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060511+0000", 2020-11-16T20:56:30.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6801999999999998e-05 2020-11-16T20:56:30.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:30.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060548+0000", 2020-11-16T20:56:30.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013927701000000001 2020-11-16T20:56:30.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:30.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074475+0000", 2020-11-16T20:56:30.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5223999999999998e-05 2020-11-16T20:56:30.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:30.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074541+0000", 2020-11-16T20:56:30.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021196474999999999 2020-11-16T20:56:30.554 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.555 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:30.555 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.555 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:507 4.2 e42/22 4:646fee8a:::smithi16641208-407:head v 42'137, mlcod=42'133)", 2020-11-16T20:56:30.555 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.060496+0000", 2020-11-16T20:56:30.555 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.439696407, 2020-11-16T20:56:30.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014098016999999999, 2020-11-16T20:56:30.556 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:30.556 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:30.556 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:30.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.556 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:30.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060496+0000", 2020-11-16T20:56:30.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:30.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:30.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060496+0000", 2020-11-16T20:56:30.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054601980000000003 2020-11-16T20:56:30.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:30.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.065956+0000", 2020-11-16T20:56:30.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0848e-05 2020-11-16T20:56:30.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:30.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.065967+0000", 2020-11-16T20:56:30.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2801e-05 2020-11-16T20:56:30.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:30.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.065979+0000", 2020-11-16T20:56:30.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0550999999999999e-05 2020-11-16T20:56:30.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.560 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:30.560 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.065990+0000", 2020-11-16T20:56:30.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6890000000000005e-05 2020-11-16T20:56:30.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.560 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:30.560 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.066057+0000", 2020-11-16T20:56:30.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4836000000000001e-05 2020-11-16T20:56:30.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:30.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.066082+0000", 2020-11-16T20:56:30.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084662330000000001 2020-11-16T20:56:30.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:30.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074548+0000", 2020-11-16T20:56:30.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.566e-05 2020-11-16T20:56:30.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:30.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074594+0000", 2020-11-16T20:56:30.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014098016999999999 2020-11-16T20:56:30.563 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.563 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:30.563 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.563 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:554 3.2 e42/19 3:769099fd:::smithi16641208-247:head v 42'386, mlcod=42'384)", 2020-11-16T20:56:30.564 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:56:30.564 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.429928759999999, 2020-11-16T20:56:30.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029531213000000001, 2020-11-16T20:56:30.564 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:30.564 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:30.564 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:30.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:30.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:56:30.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:30.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:30.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:56:30.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007828448 2020-11-16T20:56:30.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:30.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078092+0000", 2020-11-16T20:56:30.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2031000000000001e-05 2020-11-16T20:56:30.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:30.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078104+0000", 2020-11-16T20:56:30.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3950000000000001e-06 2020-11-16T20:56:30.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:30.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078112+0000", 2020-11-16T20:56:30.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.434e-06 2020-11-16T20:56:30.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:30.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078117+0000", 2020-11-16T20:56:30.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0217999999999999e-05 2020-11-16T20:56:30.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:30.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078168+0000", 2020-11-16T20:56:30.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6242e-05 2020-11-16T20:56:30.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:30.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078194+0000", 2020-11-16T20:56:30.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021550488 2020-11-16T20:56:30.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:30.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099744+0000", 2020-11-16T20:56:30.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9957000000000003e-05 2020-11-16T20:56:30.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:30.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099794+0000", 2020-11-16T20:56:30.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029531213000000001 2020-11-16T20:56:30.571 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.571 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:30.571 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.572 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2376 4.2 e42/22 4:540952ab:::smithi16641208-369:head v 42'142, mlcod=42'136)", 2020-11-16T20:56:30.572 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.077213+0000", 2020-11-16T20:56:30.572 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.422978663999999, 2020-11-16T20:56:30.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015666645, 2020-11-16T20:56:30.572 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:30.572 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:30.572 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:30.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:30.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077213+0000", 2020-11-16T20:56:30.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:30.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:30.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077213+0000", 2020-11-16T20:56:30.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9294e-05 2020-11-16T20:56:30.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:30.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077253+0000", 2020-11-16T20:56:30.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6004e-05 2020-11-16T20:56:30.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:30.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077279+0000", 2020-11-16T20:56:30.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.291e-05 2020-11-16T20:56:30.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:30.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077291+0000", 2020-11-16T20:56:30.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.225e-05 2020-11-16T20:56:30.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:30.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077304+0000", 2020-11-16T20:56:30.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9744e-05 2020-11-16T20:56:30.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:30.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077393+0000", 2020-11-16T20:56:30.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5826e-05 2020-11-16T20:56:30.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:30.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077419+0000", 2020-11-16T20:56:30.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015403659 2020-11-16T20:56:30.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:30.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.092823+0000", 2020-11-16T20:56:30.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6957999999999999e-05 2020-11-16T20:56:30.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:30.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.092880+0000", 2020-11-16T20:56:30.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015666645 2020-11-16T20:56:30.579 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.579 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:30.579 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.580 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:555 3.2 e42/19 3:590e6edd:::smithi16641208-203:head v 42'387, mlcod=42'384)", 2020-11-16T20:56:30.580 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:56:30.580 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.422047916, 2020-11-16T20:56:30.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021681786000000002, 2020-11-16T20:56:30.580 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:30.580 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:30.581 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:30.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:30.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:56:30.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:30.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:30.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:56:30.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6817999999999998e-05 2020-11-16T20:56:30.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:30.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078191+0000", 2020-11-16T20:56:30.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7800000000000003e-06 2020-11-16T20:56:30.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:30.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078198+0000", 2020-11-16T20:56:30.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0331e-05 2020-11-16T20:56:30.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:30.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078208+0000", 2020-11-16T20:56:30.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8429999999999998e-06 2020-11-16T20:56:30.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:30.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078214+0000", 2020-11-16T20:56:30.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0025044690000000001 2020-11-16T20:56:30.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:30.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080718+0000", 2020-11-16T20:56:30.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027441100000000001 2020-11-16T20:56:30.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:30.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080993+0000", 2020-11-16T20:56:30.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018806976999999999 2020-11-16T20:56:30.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:30.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099800+0000", 2020-11-16T20:56:30.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6157e-05 2020-11-16T20:56:30.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:30.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099826+0000", 2020-11-16T20:56:30.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021681786000000002 2020-11-16T20:56:30.587 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.587 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:30.588 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.588 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:485 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'94, mlcod=41'92)", 2020-11-16T20:56:30.588 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:56:30.588 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.421478949000001, 2020-11-16T20:56:30.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021768460999999999, 2020-11-16T20:56:30.589 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:30.589 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:30.589 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:30.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:30.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:56:30.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:30.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:30.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:56:30.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001603103 2020-11-16T20:56:30.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:30.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080316+0000", 2020-11-16T20:56:30.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4956e-05 2020-11-16T20:56:30.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:30.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080331+0000", 2020-11-16T20:56:30.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6291e-05 2020-11-16T20:56:30.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:30.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080347+0000", 2020-11-16T20:56:30.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3090000000000001e-06 2020-11-16T20:56:30.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:30.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080357+0000", 2020-11-16T20:56:30.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7073000000000001e-05 2020-11-16T20:56:30.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:30.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080414+0000", 2020-11-16T20:56:30.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5877e-05 2020-11-16T20:56:30.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:30.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080440+0000", 2020-11-16T20:56:30.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019927006000000001 2020-11-16T20:56:30.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:30.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100367+0000", 2020-11-16T20:56:30.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114846 2020-11-16T20:56:30.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:30.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100481+0000", 2020-11-16T20:56:30.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021768460999999999 2020-11-16T20:56:30.596 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.596 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:30.596 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.596 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:556 3.2 e42/19 3:590e6edd:::smithi16641208-203:head v 42'388, mlcod=42'384)", 2020-11-16T20:56:30.596 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.081175+0000", 2020-11-16T20:56:30.597 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.419017066999999, 2020-11-16T20:56:30.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020119680000000001, 2020-11-16T20:56:30.597 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:30.597 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:30.597 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:30.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:30.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081175+0000", 2020-11-16T20:56:30.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:30.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:30.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081175+0000", 2020-11-16T20:56:30.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084338599999999996 2020-11-16T20:56:30.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:30.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089609+0000", 2020-11-16T20:56:30.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1812e-05 2020-11-16T20:56:30.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:30.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089621+0000", 2020-11-16T20:56:30.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6175e-05 2020-11-16T20:56:30.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:30.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089637+0000", 2020-11-16T20:56:30.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2799999999999992e-06 2020-11-16T20:56:30.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:30.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089646+0000", 2020-11-16T20:56:30.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1341999999999998e-05 2020-11-16T20:56:30.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:30.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089687+0000", 2020-11-16T20:56:30.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3351999999999999e-05 2020-11-16T20:56:30.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:30.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089711+0000", 2020-11-16T20:56:30.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011527864000000001 2020-11-16T20:56:30.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:30.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101239+0000", 2020-11-16T20:56:30.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5995000000000002e-05 2020-11-16T20:56:30.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:30.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101295+0000", 2020-11-16T20:56:30.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020119680000000001 2020-11-16T20:56:30.604 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.604 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:30.604 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.605 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2370 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'95, mlcod=41'92)", 2020-11-16T20:56:30.605 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.083328+0000", 2020-11-16T20:56:30.605 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.416864365999999, 2020-11-16T20:56:30.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01719561, 2020-11-16T20:56:30.605 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:30.605 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:30.605 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:30.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:30.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083328+0000", 2020-11-16T20:56:30.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:30.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:30.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083328+0000", 2020-11-16T20:56:30.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00037936799999999999 2020-11-16T20:56:30.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:30.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083707+0000", 2020-11-16T20:56:30.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7088999999999999e-05 2020-11-16T20:56:30.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:30.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083724+0000", 2020-11-16T20:56:30.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6737999999999999e-05 2020-11-16T20:56:30.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:30.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083771+0000", 2020-11-16T20:56:30.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7869000000000001e-05 2020-11-16T20:56:30.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:30.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083789+0000", 2020-11-16T20:56:30.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0046429339999999996 2020-11-16T20:56:30.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:30.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.088432+0000", 2020-11-16T20:56:30.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7565999999999998e-05 2020-11-16T20:56:30.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:30.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.088479+0000", 2020-11-16T20:56:30.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012005706 2020-11-16T20:56:30.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:30.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100485+0000", 2020-11-16T20:56:30.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8340000000000002e-05 2020-11-16T20:56:30.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:30.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100523+0000", 2020-11-16T20:56:30.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01719561 2020-11-16T20:56:30.612 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.612 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:30.612 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.613 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2371 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'96, mlcod=41'92)", 2020-11-16T20:56:30.613 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.084682+0000", 2020-11-16T20:56:30.613 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.415510220000002, 2020-11-16T20:56:30.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015864851999999999, 2020-11-16T20:56:30.613 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:30.613 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:30.614 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:30.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:30.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084682+0000", 2020-11-16T20:56:30.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:30.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:30.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084682+0000", 2020-11-16T20:56:30.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1321e-05 2020-11-16T20:56:30.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:30.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084723+0000", 2020-11-16T20:56:30.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9310000000000008e-06 2020-11-16T20:56:30.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:30.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084731+0000", 2020-11-16T20:56:30.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1453e-05 2020-11-16T20:56:30.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:30.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084742+0000", 2020-11-16T20:56:30.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9670000000000004e-06 2020-11-16T20:56:30.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:30.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084749+0000", 2020-11-16T20:56:30.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048588700000000004 2020-11-16T20:56:30.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:30.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089608+0000", 2020-11-16T20:56:30.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3699999999999998e-05 2020-11-16T20:56:30.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:30.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089652+0000", 2020-11-16T20:56:30.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010873481000000001 2020-11-16T20:56:30.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:30.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100525+0000", 2020-11-16T20:56:30.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1129e-05 2020-11-16T20:56:30.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.620 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:30.620 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100547+0000", 2020-11-16T20:56:30.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015864851999999999 2020-11-16T20:56:30.620 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.620 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:30.621 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.621 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:593 4.3 e46/22 4:c5716d1e:::smithi16641208-111:head v 46'121, mlcod=46'118)", 2020-11-16T20:56:30.621 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:09.075394+0000", 2020-11-16T20:56:30.621 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 21.424798357, 2020-11-16T20:56:30.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013710613, 2020-11-16T20:56:30.622 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:30.622 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:30.622 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:30.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:30.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.075394+0000", 2020-11-16T20:56:30.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:30.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:30.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.075394+0000", 2020-11-16T20:56:30.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067667700000000001 2020-11-16T20:56:30.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:30.624 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082160+0000", 2020-11-16T20:56:30.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0790000000000001e-06 2020-11-16T20:56:30.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:30.624 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082168+0000", 2020-11-16T20:56:30.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9809999999999992e-06 2020-11-16T20:56:30.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.625 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:30.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082177+0000", 2020-11-16T20:56:30.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5310000000000001e-06 2020-11-16T20:56:30.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.625 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:30.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082186+0000", 2020-11-16T20:56:30.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5111000000000001e-05 2020-11-16T20:56:30.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:30.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082241+0000", 2020-11-16T20:56:30.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6672000000000001e-05 2020-11-16T20:56:30.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:30.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082268+0000", 2020-11-16T20:56:30.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067531379999999997 2020-11-16T20:56:30.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:30.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.089021+0000", 2020-11-16T20:56:30.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3331000000000006e-05 2020-11-16T20:56:30.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:30.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.089104+0000", 2020-11-16T20:56:30.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013710613 2020-11-16T20:56:30.629 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.629 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:30.629 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.629 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.629 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:663 4.3 e57/22 4:f65e82cb:::smithi16641208-219:head v 57'179, mlcod=57'176)", 2020-11-16T20:56:30.629 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:56:30.630 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.703363878999999, 2020-11-16T20:56:30.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022540092000000001, 2020-11-16T20:56:30.630 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:30.630 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:30.630 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:30.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:30.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:56:30.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:30.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.631 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:30.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:56:30.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013414394 2020-11-16T20:56:30.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.632 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.632 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:30.632 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810242+0000", 2020-11-16T20:56:30.632 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1864e-05 2020-11-16T20:56:30.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.632 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.632 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:30.633 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810254+0000", 2020-11-16T20:56:30.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3716e-05 2020-11-16T20:56:30.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.633 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:30.633 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810268+0000", 2020-11-16T20:56:30.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.064e-06 2020-11-16T20:56:30.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.634 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:30.634 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810277+0000", 2020-11-16T20:56:30.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0560999999999998e-05 2020-11-16T20:56:30.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.634 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:30.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810338+0000", 2020-11-16T20:56:30.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7523999999999999e-05 2020-11-16T20:56:30.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:30.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810365+0000", 2020-11-16T20:56:30.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089020890000000002 2020-11-16T20:56:30.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:30.636 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819267+0000", 2020-11-16T20:56:30.636 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010088 2020-11-16T20:56:30.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:30.637 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819368+0000", 2020-11-16T20:56:30.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022540092000000001 2020-11-16T20:56:30.637 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.637 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:30.637 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.637 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.638 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:618 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'243, mlcod=57'241)", 2020-11-16T20:56:30.638 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:56:30.638 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.699857804000001, 2020-11-16T20:56:30.638 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049183098000000001, 2020-11-16T20:56:30.638 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:30.638 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:30.638 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:30.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:30.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:56:30.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:30.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:30.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:56:30.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019114651 2020-11-16T20:56:30.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:30.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819449+0000", 2020-11-16T20:56:30.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.398e-05 2020-11-16T20:56:30.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:30.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819463+0000", 2020-11-16T20:56:30.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1139e-05 2020-11-16T20:56:30.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:30.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819474+0000", 2020-11-16T20:56:30.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1860000000000003e-06 2020-11-16T20:56:30.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.642 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.642 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:30.642 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819481+0000", 2020-11-16T20:56:30.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015472700000000001 2020-11-16T20:56:30.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.643 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:30.643 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819636+0000", 2020-11-16T20:56:30.643 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9632e-05 2020-11-16T20:56:30.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.643 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:30.644 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819665+0000", 2020-11-16T20:56:30.644 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029788289999999999 2020-11-16T20:56:30.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.644 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.644 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:30.644 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849454+0000", 2020-11-16T20:56:30.644 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3492999999999997e-05 2020-11-16T20:56:30.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:30.645 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849517+0000", 2020-11-16T20:56:30.645 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049183098000000001 2020-11-16T20:56:30.645 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.645 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:30.645 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.646 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.646 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:609 3.2 e57/19 3:5eead97c:::smithi16641208-34:head v 57'498, mlcod=57'495)", 2020-11-16T20:56:30.646 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:56:30.646 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.689578305, 2020-11-16T20:56:30.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039221579999999999, 2020-11-16T20:56:30.646 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:30.647 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:30.647 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:30.647 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.647 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:30.647 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:56:30.647 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:30.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.647 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.648 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:30.648 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:56:30.648 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008889859 2020-11-16T20:56:30.648 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.648 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.648 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:30.648 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819503+0000", 2020-11-16T20:56:30.649 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0149000000000001e-05 2020-11-16T20:56:30.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.649 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.649 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:30.649 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819514+0000", 2020-11-16T20:56:30.649 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1049999999999999e-05 2020-11-16T20:56:30.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.649 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:30.650 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819525+0000", 2020-11-16T20:56:30.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4829999999999999e-06 2020-11-16T20:56:30.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:30.651 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819533+0000", 2020-11-16T20:56:30.651 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031805760000000001 2020-11-16T20:56:30.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.651 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.651 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:30.651 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822714+0000", 2020-11-16T20:56:30.651 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0954000000000002e-05 2020-11-16T20:56:30.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.652 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.652 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:30.652 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822745+0000", 2020-11-16T20:56:30.652 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027044038999999999 2020-11-16T20:56:30.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.652 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.652 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:30.653 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849789+0000", 2020-11-16T20:56:30.653 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6470000000000001e-05 2020-11-16T20:56:30.653 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.653 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.653 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:30.653 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849835+0000", 2020-11-16T20:56:30.653 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039221579999999999 2020-11-16T20:56:30.654 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.654 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:30.654 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.654 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.654 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2583 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'244, mlcod=57'241)", 2020-11-16T20:56:30.654 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:56:30.654 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.680660769999999, 2020-11-16T20:56:30.655 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030101836999999999, 2020-11-16T20:56:30.655 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:30.655 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:30.655 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:30.655 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.655 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:30.655 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:56:30.656 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:30.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.656 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.656 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:30.656 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:56:30.656 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3781e-05 2020-11-16T20:56:30.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.657 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.657 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:30.657 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819575+0000", 2020-11-16T20:56:30.657 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3355e-05 2020-11-16T20:56:30.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.657 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.657 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:30.657 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819588+0000", 2020-11-16T20:56:30.658 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8198e-05 2020-11-16T20:56:30.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.658 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.658 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:30.658 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819657+0000", 2020-11-16T20:56:30.658 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5849999999999999e-05 2020-11-16T20:56:30.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.659 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.659 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:30.659 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819672+0000", 2020-11-16T20:56:30.659 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003042473 2020-11-16T20:56:30.659 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.659 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.659 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:30.659 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822715+0000", 2020-11-16T20:56:30.660 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9779999999999999e-05 2020-11-16T20:56:30.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.660 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.660 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:30.660 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822745+0000", 2020-11-16T20:56:30.660 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026828521000000001 2020-11-16T20:56:30.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.661 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.661 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:30.661 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849573+0000", 2020-11-16T20:56:30.661 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9879e-05 2020-11-16T20:56:30.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:30.661 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:30.661 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:30.661 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849633+0000", 2020-11-16T20:56:30.662 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030101836999999999 2020-11-16T20:56:30.662 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.662 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:30.662 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.662 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:30.662 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:30.662 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:30.663 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:30.667+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:30.664 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:56:30.735 INFO:tasks.rados.rados.0.smithi166.stdout:728: done (1 left) 2020-11-16T20:56:30.735 INFO:tasks.rados.rados.0.smithi166.stdout:729: done (0 left) 2020-11-16T20:56:30.735 INFO:tasks.rados.rados.0.smithi166.stdout:730: snap_remove snap 14 2020-11-16T20:56:30.751 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:56:30.752 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:56:30.752 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2020-11-16T20:56:30.795 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:30.800+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:30.805 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2020-11-16T20:56:30.841 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:30.841 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:30.841 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:56:30.841 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:30.850 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:56:30.893 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:30.898+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:30.966 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:30.970+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:30.987 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:30.987 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:30.988 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:56:30.988 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:56:30.988 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:30.997 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:56:31.067 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:31.071+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:31.083 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:56:31.083 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:31.083 INFO:teuthology.orchestra.run.smithi166.stdout: "epoch": 68, 2020-11-16T20:56:31.083 INFO:teuthology.orchestra.run.smithi166.stdout: "fsid": "a14fd848-4cfe-4cd9-9140-5b3c4b4e904d", 2020-11-16T20:56:31.084 INFO:teuthology.orchestra.run.smithi166.stdout: "created": "2020-11-16T20:54:44.938121+0000", 2020-11-16T20:56:31.084 INFO:teuthology.orchestra.run.smithi166.stdout: "modified": "2020-11-16T20:56:30.736132+0000", 2020-11-16T20:56:31.084 INFO:teuthology.orchestra.run.smithi166.stdout: "last_up_change": "2020-11-16T20:54:52.080163+0000", 2020-11-16T20:56:31.084 INFO:teuthology.orchestra.run.smithi166.stdout: "last_in_change": "2020-11-16T20:54:52.080163+0000", 2020-11-16T20:56:31.084 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-11-16T20:56:31.084 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_num": 5799936, 2020-11-16T20:56:31.084 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_set": [ 2020-11-16T20:56:31.085 INFO:teuthology.orchestra.run.smithi166.stdout: "pglog_hardlimit", 2020-11-16T20:56:31.085 INFO:teuthology.orchestra.run.smithi166.stdout: "purged_snapdirs", 2020-11-16T20:56:31.085 INFO:teuthology.orchestra.run.smithi166.stdout: "recovery_deletes", 2020-11-16T20:56:31.085 INFO:teuthology.orchestra.run.smithi166.stdout: "sortbitwise" 2020-11-16T20:56:31.085 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:31.085 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_version": 6, 2020-11-16T20:56:31.085 INFO:teuthology.orchestra.run.smithi166.stdout: "full_ratio": 0.94999998807907104, 2020-11-16T20:56:31.086 INFO:teuthology.orchestra.run.smithi166.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-11-16T20:56:31.086 INFO:teuthology.orchestra.run.smithi166.stdout: "nearfull_ratio": 0.85000002384185791, 2020-11-16T20:56:31.086 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_snapshot": "", 2020-11-16T20:56:31.086 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_max": 4, 2020-11-16T20:56:31.086 INFO:teuthology.orchestra.run.smithi166.stdout: "max_osd": 8, 2020-11-16T20:56:31.086 INFO:teuthology.orchestra.run.smithi166.stdout: "require_min_compat_client": "luminous", 2020-11-16T20:56:31.086 INFO:teuthology.orchestra.run.smithi166.stdout: "min_compat_client": "luminous", 2020-11-16T20:56:31.087 INFO:teuthology.orchestra.run.smithi166.stdout: "require_osd_release": "pacific", 2020-11-16T20:56:31.087 INFO:teuthology.orchestra.run.smithi166.stdout: "pools": [ 2020-11-16T20:56:31.087 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.087 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 1, 2020-11-16T20:56:31.087 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "device_health_metrics", 2020-11-16T20:56:31.087 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:54:49.109999+0000", 2020-11-16T20:56:31.087 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 1, 2020-11-16T20:56:31.087 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool", 2020-11-16T20:56:31.088 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:56:31.088 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:56:31.088 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:56:31.088 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:56:31.088 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:56:31.088 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:56:31.088 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:56:31.089 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:56:31.089 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:56:31.089 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:56:31.089 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 1, 2020-11-16T20:56:31.089 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 1, 2020-11-16T20:56:31.089 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 1, 2020-11-16T20:56:31.089 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 1, 2020-11-16T20:56:31.089 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 1, 2020-11-16T20:56:31.090 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:56:31.090 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:56:31.090 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:56:31.090 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:56:31.090 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:56:31.090 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:56:31.090 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:56:31.091 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.091 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "15", 2020-11-16T20:56:31.091 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "0", 2020-11-16T20:56:31.091 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-16T20:56:31.091 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "0", 2020-11-16T20:56:31.091 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:56:31.091 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:56:31.092 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 0, 2020-11-16T20:56:31.092 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 0, 2020-11-16T20:56:31.092 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:56:31.092 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:56:31.092 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:56:31.092 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:56:31.092 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:56:31.092 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:56:31.093 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:56:31.093 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:56:31.093 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:56:31.093 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:56:31.093 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:56:31.093 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:56:31.093 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:56:31.094 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:56:31.094 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:56:31.094 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:56:31.094 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:56:31.094 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:56:31.094 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:56:31.094 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.094 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:56:31.095 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:56:31.095 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:56:31.095 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:56:31.095 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:56:31.095 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:56:31.095 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:56:31.095 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:56:31.096 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:56:31.096 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:56:31.096 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:56:31.096 INFO:teuthology.orchestra.run.smithi166.stdout: "options": { 2020-11-16T20:56:31.096 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_min": 1 2020-11-16T20:56:31.096 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.096 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:56:31.096 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_devicehealth": {} 2020-11-16T20:56:31.097 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.097 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.097 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.097 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 2, 2020-11-16T20:56:31.097 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "rbd", 2020-11-16T20:56:31.097 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:54:53.253680+0000", 2020-11-16T20:56:31.097 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 1, 2020-11-16T20:56:31.098 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool", 2020-11-16T20:56:31.098 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:56:31.098 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:56:31.098 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:56:31.098 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:56:31.098 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:56:31.098 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:56:31.098 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:56:31.099 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:56:31.099 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:56:31.099 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:56:31.099 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 18, 2020-11-16T20:56:31.099 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 18, 2020-11-16T20:56:31.099 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 18, 2020-11-16T20:56:31.099 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 18, 2020-11-16T20:56:31.100 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 18, 2020-11-16T20:56:31.100 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:56:31.100 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:56:31.100 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:56:31.100 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:56:31.100 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:56:31.100 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:56:31.100 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:56:31.101 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.101 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "34", 2020-11-16T20:56:31.101 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "0", 2020-11-16T20:56:31.101 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-16T20:56:31.101 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "32", 2020-11-16T20:56:31.101 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:56:31.101 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:56:31.102 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 0, 2020-11-16T20:56:31.102 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 0, 2020-11-16T20:56:31.102 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:56:31.102 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:56:31.102 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:56:31.102 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:56:31.102 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:56:31.102 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:56:31.103 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:56:31.103 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:56:31.103 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:56:31.103 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:56:31.103 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:56:31.103 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:56:31.103 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:56:31.104 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:56:31.104 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:56:31.104 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:56:31.104 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:56:31.104 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:56:31.104 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:56:31.104 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.105 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:56:31.105 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:56:31.105 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:56:31.105 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:56:31.105 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:56:31.105 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:56:31.105 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:56:31.105 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:56:31.106 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:56:31.106 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:56:31.106 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:56:31.106 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:56:31.106 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:56:31.106 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd": {} 2020-11-16T20:56:31.106 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.107 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.107 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.107 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 3, 2020-11-16T20:56:31.107 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "base", 2020-11-16T20:56:31.107 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:55:23.597952+0000", 2020-11-16T20:56:31.107 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 8193, 2020-11-16T20:56:31.107 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2020-11-16T20:56:31.107 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:56:31.108 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:56:31.108 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:56:31.108 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:56:31.108 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:56:31.108 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:56:31.108 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:56:31.108 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:56:31.109 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:56:31.109 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:56:31.109 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 4, 2020-11-16T20:56:31.109 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 4, 2020-11-16T20:56:31.109 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 4, 2020-11-16T20:56:31.109 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 4, 2020-11-16T20:56:31.109 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 4, 2020-11-16T20:56:31.109 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:56:31.110 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:56:31.110 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:56:31.110 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:56:31.110 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:56:31.110 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:56:31.110 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:56:31.110 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.111 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "68", 2020-11-16T20:56:31.111 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "27", 2020-11-16T20:56:31.111 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "27", 2020-11-16T20:56:31.111 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "27", 2020-11-16T20:56:31.111 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:56:31.111 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:56:31.111 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 33, 2020-11-16T20:56:31.111 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 68, 2020-11-16T20:56:31.112 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:56:31.112 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:56:31.112 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:56:31.112 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:56:31.112 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [ 2020-11-16T20:56:31.112 INFO:teuthology.orchestra.run.smithi166.stdout: 4 2020-11-16T20:56:31.112 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:31.113 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:56:31.113 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": 4, 2020-11-16T20:56:31.113 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": 4, 2020-11-16T20:56:31.113 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:56:31.113 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:56:31.113 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:56:31.113 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:56:31.113 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:56:31.114 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:56:31.114 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:56:31.114 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:56:31.114 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:56:31.114 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:56:31.114 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:56:31.114 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.115 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:56:31.115 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:56:31.115 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:56:31.115 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:56:31.115 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:56:31.115 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:56:31.115 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:56:31.116 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:56:31.116 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:56:31.116 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:56:31.116 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:56:31.116 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:56:31.116 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:56:31.116 INFO:teuthology.orchestra.run.smithi166.stdout: "rados": {} 2020-11-16T20:56:31.116 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.117 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.117 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.117 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 4, 2020-11-16T20:56:31.117 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "cache", 2020-11-16T20:56:31.117 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:55:28.901773+0000", 2020-11-16T20:56:31.117 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 8201, 2020-11-16T20:56:31.117 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool,incomplete_clones,selfmanaged_snaps", 2020-11-16T20:56:31.118 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:56:31.118 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:56:31.118 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:56:31.118 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:56:31.118 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:56:31.118 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:56:31.118 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:56:31.118 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:56:31.119 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:56:31.119 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:56:31.119 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 4, 2020-11-16T20:56:31.119 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 4, 2020-11-16T20:56:31.119 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 4, 2020-11-16T20:56:31.119 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 4, 2020-11-16T20:56:31.119 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 4, 2020-11-16T20:56:31.120 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:56:31.120 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:56:31.120 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:56:31.120 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:56:31.120 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:56:31.120 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:56:31.120 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:56:31.120 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.121 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "68", 2020-11-16T20:56:31.121 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "27", 2020-11-16T20:56:31.121 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "27", 2020-11-16T20:56:31.121 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "27", 2020-11-16T20:56:31.121 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:56:31.121 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:56:31.121 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 33, 2020-11-16T20:56:31.122 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 68, 2020-11-16T20:56:31.122 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:56:31.122 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:56:31.122 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:56:31.122 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:56:31.122 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:56:31.122 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": 3, 2020-11-16T20:56:31.122 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:56:31.123 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:56:31.123 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "writeback", 2020-11-16T20:56:31.123 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:56:31.123 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 250, 2020-11-16T20:56:31.123 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:56:31.123 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:56:31.123 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:56:31.124 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:56:31.124 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:56:31.124 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:56:31.124 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:56:31.124 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "bloom", 2020-11-16T20:56:31.124 INFO:teuthology.orchestra.run.smithi166.stdout: "false_positive_probability": 0.050000000000000003, 2020-11-16T20:56:31.124 INFO:teuthology.orchestra.run.smithi166.stdout: "target_size": 0, 2020-11-16T20:56:31.124 INFO:teuthology.orchestra.run.smithi166.stdout: "seed": 0 2020-11-16T20:56:31.125 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.125 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 3600, 2020-11-16T20:56:31.125 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 8, 2020-11-16T20:56:31.125 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:56:31.125 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 2, 2020-11-16T20:56:31.125 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:56:31.125 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:56:31.126 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:56:31.126 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [ 2020-11-16T20:56:31.126 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:31.126 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:31.126 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:31.126 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:31.126 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:31.126 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:31.127 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:31.127 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000 2020-11-16T20:56:31.127 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:31.127 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:56:31.127 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:56:31.127 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:56:31.127 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:56:31.128 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": {} 2020-11-16T20:56:31.128 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.128 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:31.128 INFO:teuthology.orchestra.run.smithi166.stdout: "osds": [ 2020-11-16T20:56:31.128 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.128 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 0, 2020-11-16T20:56:31.128 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "35950122-efbd-420e-b07a-f5730f26df17", 2020-11-16T20:56:31.128 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:31.129 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:31.129 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:31.129 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:31.129 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:31.129 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:31.129 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:31.129 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 22, 2020-11-16T20:56:31.130 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:31.130 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:31.130 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:31.130 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.130 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.130 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.130 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6800", 2020-11-16T20:56:31.131 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:56:31.131 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.131 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.131 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.131 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:31.131 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.131 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.131 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.132 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6802", 2020-11-16T20:56:31.132 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:56:31.132 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.132 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.132 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.132 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:31.132 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.132 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.133 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.133 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6806", 2020-11-16T20:56:31.133 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:56:31.133 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.133 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.133 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.133 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:31.134 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.134 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.134 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.134 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6804", 2020-11-16T20:56:31.134 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:56:31.134 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.134 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.134 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.135 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6800/35293", 2020-11-16T20:56:31.135 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6802/35293", 2020-11-16T20:56:31.135 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6806/35293", 2020-11-16T20:56:31.135 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6804/35293", 2020-11-16T20:56:31.135 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:31.135 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:31.135 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:31.136 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.136 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.136 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.136 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 1, 2020-11-16T20:56:31.136 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "f768a1ff-3e8a-4131-a6ed-10f93b3ca900", 2020-11-16T20:56:31.136 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:31.136 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:31.136 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:31.137 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:31.137 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:31.137 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:31.137 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:31.137 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 66, 2020-11-16T20:56:31.137 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:31.137 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:31.137 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:31.138 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.138 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.138 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.138 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6808", 2020-11-16T20:56:31.138 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:56:31.138 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.138 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.139 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.139 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:31.139 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.139 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.139 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.139 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6809", 2020-11-16T20:56:31.139 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:56:31.139 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.140 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.140 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.140 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:31.140 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.140 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.140 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.140 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6811", 2020-11-16T20:56:31.141 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:56:31.141 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.141 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.141 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.141 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:31.141 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.141 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.141 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.142 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6810", 2020-11-16T20:56:31.142 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:56:31.142 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.142 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.142 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.142 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6808/35323", 2020-11-16T20:56:31.142 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6809/35323", 2020-11-16T20:56:31.143 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6811/35323", 2020-11-16T20:56:31.143 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6810/35323", 2020-11-16T20:56:31.143 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:31.143 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:31.143 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:31.143 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.143 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.143 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.144 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 2, 2020-11-16T20:56:31.144 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "88734179-84a6-4a9b-8af0-692805815875", 2020-11-16T20:56:31.144 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:31.144 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:31.144 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:31.144 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:31.144 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:31.145 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:31.145 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:31.145 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 34, 2020-11-16T20:56:31.145 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:31.145 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:31.145 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:31.145 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.145 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.146 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.146 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6801", 2020-11-16T20:56:31.146 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:56:31.146 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.146 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.146 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.146 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:31.147 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.147 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.147 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.147 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6803", 2020-11-16T20:56:31.147 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:56:31.147 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.147 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.147 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.148 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:31.148 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.148 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.148 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.148 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6807", 2020-11-16T20:56:31.148 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:56:31.148 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.149 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.149 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.149 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:31.149 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.149 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.149 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.149 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6805", 2020-11-16T20:56:31.149 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:56:31.150 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.150 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.150 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.150 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6801/35294", 2020-11-16T20:56:31.150 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6803/35294", 2020-11-16T20:56:31.150 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6807/35294", 2020-11-16T20:56:31.150 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6805/35294", 2020-11-16T20:56:31.151 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:31.151 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:31.151 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:31.151 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.151 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.151 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.151 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 3, 2020-11-16T20:56:31.151 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "319e54e8-3f03-4388-8de6-678d148e25d4", 2020-11-16T20:56:31.152 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:31.152 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:31.152 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:31.152 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:31.152 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:31.152 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:31.152 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:31.153 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 22, 2020-11-16T20:56:31.153 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:31.153 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:31.153 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:31.153 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.153 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.153 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.153 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6812", 2020-11-16T20:56:31.154 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:56:31.154 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.154 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.154 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.154 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:31.154 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.154 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.155 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.155 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6813", 2020-11-16T20:56:31.155 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:56:31.155 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.155 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.155 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.155 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:31.156 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.156 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.156 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.156 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6815", 2020-11-16T20:56:31.156 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:56:31.156 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.156 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.156 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.157 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:31.157 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.157 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.157 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.157 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6814", 2020-11-16T20:56:31.157 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:56:31.157 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.158 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.158 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.158 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6812/35324", 2020-11-16T20:56:31.158 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6813/35324", 2020-11-16T20:56:31.158 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6815/35324", 2020-11-16T20:56:31.158 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6814/35324", 2020-11-16T20:56:31.158 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:31.158 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:31.159 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:31.159 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.159 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.159 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.159 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 4, 2020-11-16T20:56:31.159 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "3edbb68e-e030-4379-891e-2412f1235ffb", 2020-11-16T20:56:31.159 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:31.160 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:31.160 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:31.160 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:31.160 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:31.160 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:31.160 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:31.160 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 63, 2020-11-16T20:56:31.160 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:31.161 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:31.161 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:31.161 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.161 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.161 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.161 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6804", 2020-11-16T20:56:31.161 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:56:31.162 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.162 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.162 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.162 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:31.162 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.162 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.162 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.162 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6805", 2020-11-16T20:56:31.163 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:56:31.163 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.163 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.163 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.163 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:31.163 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.163 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.164 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.164 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6807", 2020-11-16T20:56:31.164 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:56:31.164 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.164 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.164 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.164 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:31.164 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.165 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.165 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.165 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6806", 2020-11-16T20:56:31.165 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:56:31.165 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.165 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.165 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.165 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6804/31586", 2020-11-16T20:56:31.166 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6805/31586", 2020-11-16T20:56:31.166 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6807/31586", 2020-11-16T20:56:31.166 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6806/31586", 2020-11-16T20:56:31.166 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:31.166 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:31.166 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:31.166 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.167 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.167 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.167 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 5, 2020-11-16T20:56:31.167 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "44fbf5ac-4484-48a8-a846-1f5c01a6ec2c", 2020-11-16T20:56:31.167 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:31.167 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:31.167 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:31.168 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:31.168 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:31.168 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:31.168 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:31.168 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 63, 2020-11-16T20:56:31.168 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:31.168 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:31.168 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:31.169 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.169 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.169 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.169 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6808", 2020-11-16T20:56:31.169 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:56:31.169 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.169 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.169 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.170 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:31.170 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.170 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.170 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.170 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6810", 2020-11-16T20:56:31.170 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:56:31.170 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.171 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.171 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.171 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:31.171 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.171 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.171 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.171 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6813", 2020-11-16T20:56:31.172 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:56:31.172 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.172 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.172 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.172 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:31.172 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.172 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.172 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.173 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6812", 2020-11-16T20:56:31.173 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:56:31.173 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.173 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.173 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.173 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6808/31610", 2020-11-16T20:56:31.173 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6810/31610", 2020-11-16T20:56:31.174 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6813/31610", 2020-11-16T20:56:31.174 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6812/31610", 2020-11-16T20:56:31.174 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:31.174 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:31.174 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:31.174 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.174 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.174 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.175 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 6, 2020-11-16T20:56:31.175 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "f93b82df-f537-4601-8247-388bf100b5b5", 2020-11-16T20:56:31.175 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:31.175 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:31.175 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 0.5654754638671875, 2020-11-16T20:56:31.175 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:31.175 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:31.176 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:31.176 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:31.176 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 34, 2020-11-16T20:56:31.176 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:31.176 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:31.176 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:31.176 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.176 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.177 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.177 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6800", 2020-11-16T20:56:31.177 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:56:31.177 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.177 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.177 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.177 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:31.178 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.178 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.178 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.178 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6801", 2020-11-16T20:56:31.178 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:56:31.178 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.178 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.178 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.179 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:31.179 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.179 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.179 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.179 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6803", 2020-11-16T20:56:31.179 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:56:31.179 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.180 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.180 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.180 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:31.180 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.180 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.180 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.180 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6802", 2020-11-16T20:56:31.180 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:56:31.181 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.181 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.181 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.181 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6800/31587", 2020-11-16T20:56:31.181 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6801/31587", 2020-11-16T20:56:31.181 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6803/31587", 2020-11-16T20:56:31.181 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6802/31587", 2020-11-16T20:56:31.181 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:31.182 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:31.182 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:31.182 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.182 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.182 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.182 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 7, 2020-11-16T20:56:31.182 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "e5485c88-d267-4a6a-b9b6-15d869d28f28", 2020-11-16T20:56:31.183 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:31.183 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:31.183 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:31.183 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:31.183 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:31.183 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:31.183 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:31.183 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 34, 2020-11-16T20:56:31.184 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:31.184 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:31.184 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:31.184 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.184 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.184 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.184 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6809", 2020-11-16T20:56:31.185 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:56:31.185 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.185 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.185 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.185 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:31.185 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.185 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.185 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.186 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6811", 2020-11-16T20:56:31.186 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:56:31.186 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.186 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.186 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.186 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:31.186 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.187 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.187 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.187 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6815", 2020-11-16T20:56:31.187 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:56:31.187 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.187 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.187 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.187 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:31.188 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:31.188 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.188 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:31.188 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6814", 2020-11-16T20:56:31.188 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:56:31.188 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.188 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.189 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.189 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6809/31617", 2020-11-16T20:56:31.189 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6811/31617", 2020-11-16T20:56:31.189 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6815/31617", 2020-11-16T20:56:31.189 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6814/31617", 2020-11-16T20:56:31.189 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:31.189 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:31.189 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:31.190 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.190 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.190 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:31.190 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_xinfo": [ 2020-11-16T20:56:31.190 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.190 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 0, 2020-11-16T20:56:31.190 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:31.191 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:31.191 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:31.191 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:31.191 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:31.191 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:50.610058+0000", 2020-11-16T20:56:31.191 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:31.191 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.191 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.192 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 1, 2020-11-16T20:56:31.192 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:31.192 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:31.192 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:31.192 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:31.192 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:31.192 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:50.548086+0000", 2020-11-16T20:56:31.193 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:31.193 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.193 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.193 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 2, 2020-11-16T20:56:31.193 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:31.193 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:31.193 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:31.194 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:31.194 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:31.194 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:50.536944+0000", 2020-11-16T20:56:31.194 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:31.194 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.194 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.194 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 3, 2020-11-16T20:56:31.195 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:31.195 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:31.195 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:31.195 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:31.195 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:31.195 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:51.137739+0000", 2020-11-16T20:56:31.195 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:31.195 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.196 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.196 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 4, 2020-11-16T20:56:31.196 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:31.196 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:31.196 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:31.196 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:31.196 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:31.196 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:50.747840+0000", 2020-11-16T20:56:31.197 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:31.197 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.197 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.197 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 5, 2020-11-16T20:56:31.197 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:31.197 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:31.197 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:31.198 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:31.198 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:31.198 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:51.365378+0000", 2020-11-16T20:56:31.198 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:31.198 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.198 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.198 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 6, 2020-11-16T20:56:31.198 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:31.199 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:31.199 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:31.199 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:31.199 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:31.199 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:50.725150+0000", 2020-11-16T20:56:31.199 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:31.199 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.200 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.200 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 7, 2020-11-16T20:56:31.200 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:31.200 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:31.200 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:31.200 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:31.200 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:31.200 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:50.621411+0000", 2020-11-16T20:56:31.201 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:31.201 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.201 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:31.201 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_upmap": [ 2020-11-16T20:56:31.201 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.201 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "2.e", 2020-11-16T20:56:31.201 INFO:teuthology.orchestra.run.smithi166.stdout: "osds": [ 2020-11-16T20:56:31.201 INFO:teuthology.orchestra.run.smithi166.stdout: 1, 2020-11-16T20:56:31.202 INFO:teuthology.orchestra.run.smithi166.stdout: 7, 2020-11-16T20:56:31.202 INFO:teuthology.orchestra.run.smithi166.stdout: 0 2020-11-16T20:56:31.202 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.202 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.202 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:31.202 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_upmap_items": [ 2020-11-16T20:56:31.202 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.203 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "4.1", 2020-11-16T20:56:31.203 INFO:teuthology.orchestra.run.smithi166.stdout: "mappings": [ 2020-11-16T20:56:31.203 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.203 INFO:teuthology.orchestra.run.smithi166.stdout: "from": 5, 2020-11-16T20:56:31.203 INFO:teuthology.orchestra.run.smithi166.stdout: "to": 3 2020-11-16T20:56:31.203 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.203 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.203 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.204 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:31.204 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_temp": [], 2020-11-16T20:56:31.204 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_temp": [], 2020-11-16T20:56:31.204 INFO:teuthology.orchestra.run.smithi166.stdout: "blocklist": {}, 2020-11-16T20:56:31.204 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profiles": { 2020-11-16T20:56:31.204 INFO:teuthology.orchestra.run.smithi166.stdout: "default": { 2020-11-16T20:56:31.204 INFO:teuthology.orchestra.run.smithi166.stdout: "crush-failure-domain": "osd", 2020-11-16T20:56:31.204 INFO:teuthology.orchestra.run.smithi166.stdout: "k": "2", 2020-11-16T20:56:31.205 INFO:teuthology.orchestra.run.smithi166.stdout: "m": "1", 2020-11-16T20:56:31.205 INFO:teuthology.orchestra.run.smithi166.stdout: "plugin": "jerasure", 2020-11-16T20:56:31.205 INFO:teuthology.orchestra.run.smithi166.stdout: "ruleset-failure-domain": "osd", 2020-11-16T20:56:31.205 INFO:teuthology.orchestra.run.smithi166.stdout: "technique": "reed_sol_van" 2020-11-16T20:56:31.205 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.205 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.205 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps_queue": [ 2020-11-16T20:56:31.206 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.206 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 3, 2020-11-16T20:56:31.206 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:56:31.206 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.206 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 5, 2020-11-16T20:56:31.206 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:31.206 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.206 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.207 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 14, 2020-11-16T20:56:31.207 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:31.207 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.207 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.207 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 18, 2020-11-16T20:56:31.207 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:31.207 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.208 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.208 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 20, 2020-11-16T20:56:31.208 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:31.208 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.208 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.208 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 24, 2020-11-16T20:56:31.208 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 2 2020-11-16T20:56:31.208 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.209 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.209 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 29, 2020-11-16T20:56:31.209 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:31.209 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.209 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.209 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.209 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.210 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 4, 2020-11-16T20:56:31.210 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:56:31.210 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.210 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 5, 2020-11-16T20:56:31.210 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:31.210 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.210 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.210 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 14, 2020-11-16T20:56:31.211 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:31.211 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.211 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.211 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 18, 2020-11-16T20:56:31.211 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:31.211 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.211 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.211 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 20, 2020-11-16T20:56:31.212 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:31.212 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.212 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.212 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 24, 2020-11-16T20:56:31.212 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 2 2020-11-16T20:56:31.212 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:31.212 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:31.213 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 29, 2020-11-16T20:56:31.213 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:31.213 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.213 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:31.213 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.213 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:31.213 INFO:teuthology.orchestra.run.smithi166.stdout: "new_removed_snaps": [], 2020-11-16T20:56:31.213 INFO:teuthology.orchestra.run.smithi166.stdout: "new_purged_snaps": [], 2020-11-16T20:56:31.214 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_node_flags": {}, 2020-11-16T20:56:31.214 INFO:teuthology.orchestra.run.smithi166.stdout: "device_class_flags": {}, 2020-11-16T20:56:31.214 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode": { 2020-11-16T20:56:31.214 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode_enabled": false, 2020-11-16T20:56:31.214 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_bucket_count": 0, 2020-11-16T20:56:31.214 INFO:teuthology.orchestra.run.smithi166.stdout: "degraded_stretch_mode": 0, 2020-11-16T20:56:31.214 INFO:teuthology.orchestra.run.smithi166.stdout: "recovering_stretch_mode": 0, 2020-11-16T20:56:31.215 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode_bucket": 0 2020-11-16T20:56:31.215 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:31.215 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:31.216 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:31.217 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:56:31.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:56:31.217 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:56:31.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.217 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:37 4.1 e33/22 4:b6545a47:::smithi16641208-46:head v 33'28, mlcod=33'26)", 2020-11-16T20:56:31.217 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.515292+0000", 2020-11-16T20:56:31.218 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.662068407, 2020-11-16T20:56:31.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016898816000000001, 2020-11-16T20:56:31.218 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.218 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.218 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.219 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.515292+0000", 2020-11-16T20:56:31.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.219 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.219 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.515292+0000", 2020-11-16T20:56:31.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001749708 2020-11-16T20:56:31.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.220 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.517042+0000", 2020-11-16T20:56:31.220 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1926000000000001e-05 2020-11-16T20:56:31.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.517054+0000", 2020-11-16T20:56:31.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4791e-05 2020-11-16T20:56:31.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.517068+0000", 2020-11-16T20:56:31.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3440000000000001e-06 2020-11-16T20:56:31.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.517077+0000", 2020-11-16T20:56:31.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5005000000000005e-05 2020-11-16T20:56:31.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.517142+0000", 2020-11-16T20:56:31.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1109000000000003e-05 2020-11-16T20:56:31.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.517173+0000", 2020-11-16T20:56:31.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01497009 2020-11-16T20:56:31.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.224 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.224 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532143+0000", 2020-11-16T20:56:31.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7843000000000003e-05 2020-11-16T20:56:31.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.224 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532191+0000", 2020-11-16T20:56:31.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016898816000000001 2020-11-16T20:56:31.225 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.225 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.225 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.226 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:39 4.1 e33/22 4:81558809:::smithi16641208-47:head v 33'30, mlcod=33'26)", 2020-11-16T20:56:31.226 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.520522+0000", 2020-11-16T20:56:31.226 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.656838669999999, 2020-11-16T20:56:31.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014376866, 2020-11-16T20:56:31.226 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.226 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.226 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520522+0000", 2020-11-16T20:56:31.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520522+0000", 2020-11-16T20:56:31.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00038562500000000001 2020-11-16T20:56:31.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.228 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.228 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520907+0000", 2020-11-16T20:56:31.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0479000000000001e-05 2020-11-16T20:56:31.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520918+0000", 2020-11-16T20:56:31.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6376999999999999e-05 2020-11-16T20:56:31.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520934+0000", 2020-11-16T20:56:31.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1693e-05 2020-11-16T20:56:31.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.230 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.230 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520946+0000", 2020-11-16T20:56:31.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5083000000000002e-05 2020-11-16T20:56:31.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.231 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.231 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520991+0000", 2020-11-16T20:56:31.231 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2738000000000002e-05 2020-11-16T20:56:31.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.231 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.231 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.521014+0000", 2020-11-16T20:56:31.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013845266 2020-11-16T20:56:31.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.232 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.232 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534859+0000", 2020-11-16T20:56:31.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9604999999999998e-05 2020-11-16T20:56:31.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534899+0000", 2020-11-16T20:56:31.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014376866 2020-11-16T20:56:31.233 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.233 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.233 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.234 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:201 3.2 e35/19 3:515e6cf6:::smithi16641208-22:head v 35'123, mlcod=35'121)", 2020-11-16T20:56:31.234 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.975460+0000", 2020-11-16T20:56:31.234 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 36.201900053999999, 2020-11-16T20:56:31.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014831637, 2020-11-16T20:56:31.234 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.234 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.234 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.235 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.235 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.975460+0000", 2020-11-16T20:56:31.235 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.235 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.236 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.975460+0000", 2020-11-16T20:56:31.236 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0037792979999999999 2020-11-16T20:56:31.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.236 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.236 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.979240+0000", 2020-11-16T20:56:31.236 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1510000000000001e-06 2020-11-16T20:56:31.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.237 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.979246+0000", 2020-11-16T20:56:31.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0080000000000002e-06 2020-11-16T20:56:31.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.979254+0000", 2020-11-16T20:56:31.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9459999999999997e-06 2020-11-16T20:56:31.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.979259+0000", 2020-11-16T20:56:31.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6044999999999997e-05 2020-11-16T20:56:31.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.239 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.239 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.979305+0000", 2020-11-16T20:56:31.239 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8236999999999998e-05 2020-11-16T20:56:31.239 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.239 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.240 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.979323+0000", 2020-11-16T20:56:31.240 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010909350999999999 2020-11-16T20:56:31.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.240 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.240 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.240 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.990232+0000", 2020-11-16T20:56:31.240 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9601000000000001e-05 2020-11-16T20:56:31.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.241 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.241 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.990292+0000", 2020-11-16T20:56:31.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014831637 2020-11-16T20:56:31.241 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.241 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.241 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.242 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:202 3.2 e35/19 3:5723fd94:::smithi16641208-211:head v 35'124, mlcod=35'121)", 2020-11-16T20:56:31.242 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.981228+0000", 2020-11-16T20:56:31.242 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 36.196132499000001, 2020-11-16T20:56:31.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013558532, 2020-11-16T20:56:31.242 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.242 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.243 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.243 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.981228+0000", 2020-11-16T20:56:31.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.244 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.244 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.981228+0000", 2020-11-16T20:56:31.244 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052605159999999998 2020-11-16T20:56:31.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.244 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.244 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.986488+0000", 2020-11-16T20:56:31.244 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.52e-06 2020-11-16T20:56:31.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.245 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.245 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.245 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.986496+0000", 2020-11-16T20:56:31.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0351e-05 2020-11-16T20:56:31.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.245 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.246 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.986506+0000", 2020-11-16T20:56:31.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1437000000000001e-05 2020-11-16T20:56:31.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.246 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.986518+0000", 2020-11-16T20:56:31.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2643000000000002e-05 2020-11-16T20:56:31.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.986590+0000", 2020-11-16T20:56:31.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1520000000000001e-05 2020-11-16T20:56:31.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.248 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.248 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.986612+0000", 2020-11-16T20:56:31.248 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0081095630000000002 2020-11-16T20:56:31.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.248 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.248 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.994721+0000", 2020-11-16T20:56:31.248 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4981999999999995e-05 2020-11-16T20:56:31.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.249 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.994786+0000", 2020-11-16T20:56:31.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013558532 2020-11-16T20:56:31.249 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.249 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.249 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.250 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:547 3.2 e42/19 3:5f250a2b:::smithi16641208-75:head v 42'381, mlcod=42'379)", 2020-11-16T20:56:31.250 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.027376+0000", 2020-11-16T20:56:31.250 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.149984816, 2020-11-16T20:56:31.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017180708999999999, 2020-11-16T20:56:31.250 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.251 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.251 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.027376+0000", 2020-11-16T20:56:31.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.252 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.252 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.027376+0000", 2020-11-16T20:56:31.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064232990000000004 2020-11-16T20:56:31.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.252 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.252 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.252 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.033799+0000", 2020-11-16T20:56:31.253 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3679000000000001e-05 2020-11-16T20:56:31.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.253 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.253 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.033813+0000", 2020-11-16T20:56:31.253 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9789e-05 2020-11-16T20:56:31.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.033832+0000", 2020-11-16T20:56:31.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2969999999999999e-05 2020-11-16T20:56:31.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.033845+0000", 2020-11-16T20:56:31.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7311000000000007e-05 2020-11-16T20:56:31.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.033913+0000", 2020-11-16T20:56:31.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9128999999999998e-05 2020-11-16T20:56:31.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.033942+0000", 2020-11-16T20:56:31.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010563673000000001 2020-11-16T20:56:31.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.044505+0000", 2020-11-16T20:56:31.257 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0859000000000002e-05 2020-11-16T20:56:31.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.257 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.257 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.257 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.044556+0000", 2020-11-16T20:56:31.257 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017180708999999999 2020-11-16T20:56:31.257 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.257 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.258 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.258 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:548 3.2 e42/19 3:6173e90a:::smithi16641208-2:head v 42'382, mlcod=42'379)", 2020-11-16T20:56:31.258 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.033886+0000", 2020-11-16T20:56:31.258 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.143473965999998, 2020-11-16T20:56:31.258 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012946935999999999, 2020-11-16T20:56:31.259 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.259 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.259 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.259 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.259 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.033886+0000", 2020-11-16T20:56:31.259 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.033886+0000", 2020-11-16T20:56:31.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002622657 2020-11-16T20:56:31.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.261 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.036509+0000", 2020-11-16T20:56:31.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.187e-05 2020-11-16T20:56:31.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.261 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.036521+0000", 2020-11-16T20:56:31.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8457e-05 2020-11-16T20:56:31.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.262 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.262 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.036539+0000", 2020-11-16T20:56:31.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.349e-05 2020-11-16T20:56:31.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.262 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.263 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.036553+0000", 2020-11-16T20:56:31.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0016288100000000001 2020-11-16T20:56:31.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.263 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.263 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.038182+0000", 2020-11-16T20:56:31.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3382000000000001e-05 2020-11-16T20:56:31.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.038205+0000", 2020-11-16T20:56:31.264 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085366859999999999 2020-11-16T20:56:31.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.046742+0000", 2020-11-16T20:56:31.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1583999999999996e-05 2020-11-16T20:56:31.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.265 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.265 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.046833+0000", 2020-11-16T20:56:31.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012946935999999999 2020-11-16T20:56:31.265 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.266 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.266 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.266 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.266 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:554 3.2 e42/19 3:769099fd:::smithi16641208-247:head v 42'386, mlcod=42'384)", 2020-11-16T20:56:31.266 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.070944+0000", 2020-11-16T20:56:31.266 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.106416077999999, 2020-11-16T20:56:31.266 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019548482999999998, 2020-11-16T20:56:31.267 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.267 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.267 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.267 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.267 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.267 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070944+0000", 2020-11-16T20:56:31.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.268 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.268 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070944+0000", 2020-11-16T20:56:31.268 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0065296180000000001 2020-11-16T20:56:31.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.268 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.269 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077474+0000", 2020-11-16T20:56:31.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0669999999999999e-05 2020-11-16T20:56:31.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.269 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.269 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077485+0000", 2020-11-16T20:56:31.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4518999999999999e-05 2020-11-16T20:56:31.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.270 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.270 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077499+0000", 2020-11-16T20:56:31.270 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3319999999999992e-06 2020-11-16T20:56:31.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.270 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.271 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077507+0000", 2020-11-16T20:56:31.271 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3896e-05 2020-11-16T20:56:31.271 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.271 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.271 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.271 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077561+0000", 2020-11-16T20:56:31.271 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9446999999999999e-05 2020-11-16T20:56:31.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.272 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.272 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.272 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077581+0000", 2020-11-16T20:56:31.272 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012846296 2020-11-16T20:56:31.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.272 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.272 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.273 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.090427+0000", 2020-11-16T20:56:31.273 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5704999999999995e-05 2020-11-16T20:56:31.273 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.273 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.273 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.273 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.090493+0000", 2020-11-16T20:56:31.273 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019548482999999998 2020-11-16T20:56:31.274 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.274 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.274 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.274 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.274 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:555 3.2 e42/19 3:590e6edd:::smithi16641208-203:head v 42'387, mlcod=42'384)", 2020-11-16T20:56:31.274 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.077550+0000", 2020-11-16T20:56:31.274 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.099810636000001, 2020-11-16T20:56:31.275 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018403484000000001, 2020-11-16T20:56:31.275 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.275 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.275 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.275 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.275 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.275 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077550+0000", 2020-11-16T20:56:31.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.276 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.276 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077550+0000", 2020-11-16T20:56:31.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5414999999999998e-05 2020-11-16T20:56:31.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.277 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.277 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077595+0000", 2020-11-16T20:56:31.277 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1470000000000004e-06 2020-11-16T20:56:31.277 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.277 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.277 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.277 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077602+0000", 2020-11-16T20:56:31.278 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0637e-05 2020-11-16T20:56:31.278 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.278 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.278 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.278 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077613+0000", 2020-11-16T20:56:31.278 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9250000000000003e-06 2020-11-16T20:56:31.278 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.278 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.279 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.279 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077618+0000", 2020-11-16T20:56:31.279 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002591702 2020-11-16T20:56:31.279 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.279 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.279 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.279 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080210+0000", 2020-11-16T20:56:31.280 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2793000000000003e-05 2020-11-16T20:56:31.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.280 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.280 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.280 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080242+0000", 2020-11-16T20:56:31.280 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015665576000000001 2020-11-16T20:56:31.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.280 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.281 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.281 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.095908+0000", 2020-11-16T20:56:31.281 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5289e-05 2020-11-16T20:56:31.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.281 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.281 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.281 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.095953+0000", 2020-11-16T20:56:31.282 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018403484000000001 2020-11-16T20:56:31.282 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.282 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.282 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.282 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.282 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:485 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'94, mlcod=41'92)", 2020-11-16T20:56:31.282 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.078771+0000", 2020-11-16T20:56:31.283 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.098589474000001, 2020-11-16T20:56:31.283 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020640565999999999, 2020-11-16T20:56:31.283 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.283 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.283 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.283 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.283 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.284 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078771+0000", 2020-11-16T20:56:31.284 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.284 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.284 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.284 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078771+0000", 2020-11-16T20:56:31.284 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003089067 2020-11-16T20:56:31.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.285 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.285 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081860+0000", 2020-11-16T20:56:31.285 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.187e-05 2020-11-16T20:56:31.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.285 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081872+0000", 2020-11-16T20:56:31.286 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4426999999999999e-05 2020-11-16T20:56:31.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.286 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081886+0000", 2020-11-16T20:56:31.286 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5287999999999999e-05 2020-11-16T20:56:31.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.287 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.287 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.287 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081912+0000", 2020-11-16T20:56:31.287 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0007000000000003e-05 2020-11-16T20:56:31.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.287 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.287 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.288 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081972+0000", 2020-11-16T20:56:31.288 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7368e-05 2020-11-16T20:56:31.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.288 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.288 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.288 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081999+0000", 2020-11-16T20:56:31.288 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017350596999999999 2020-11-16T20:56:31.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.289 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099350+0000", 2020-11-16T20:56:31.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1941999999999997e-05 2020-11-16T20:56:31.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.290 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099412+0000", 2020-11-16T20:56:31.290 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020640565999999999 2020-11-16T20:56:31.290 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.290 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.290 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.290 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:556 3.2 e42/19 3:590e6edd:::smithi16641208-203:head v 42'388, mlcod=42'384)", 2020-11-16T20:56:31.291 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.081269+0000", 2020-11-16T20:56:31.291 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.096091056999999, 2020-11-16T20:56:31.291 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019299324, 2020-11-16T20:56:31.291 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.291 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.291 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.291 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.292 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.292 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081269+0000", 2020-11-16T20:56:31.292 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.292 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.292 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.292 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081269+0000", 2020-11-16T20:56:31.292 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048245409999999999 2020-11-16T20:56:31.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.293 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.293 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.086094+0000", 2020-11-16T20:56:31.293 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.995e-06 2020-11-16T20:56:31.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.293 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.294 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.086104+0000", 2020-11-16T20:56:31.294 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6529e-05 2020-11-16T20:56:31.294 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.294 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.294 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.294 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.086120+0000", 2020-11-16T20:56:31.294 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2890000000000003e-06 2020-11-16T20:56:31.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.295 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.295 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.295 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.086130+0000", 2020-11-16T20:56:31.295 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0926e-05 2020-11-16T20:56:31.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.295 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.296 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.296 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.086181+0000", 2020-11-16T20:56:31.296 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4405000000000001e-05 2020-11-16T20:56:31.296 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.296 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.296 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.296 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.086205+0000", 2020-11-16T20:56:31.296 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014305527 2020-11-16T20:56:31.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.297 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.297 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.297 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100511+0000", 2020-11-16T20:56:31.297 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8112000000000002e-05 2020-11-16T20:56:31.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.297 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.298 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.298 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100569+0000", 2020-11-16T20:56:31.298 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019299324 2020-11-16T20:56:31.298 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.298 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.298 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.298 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.299 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2370 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'95, mlcod=41'92)", 2020-11-16T20:56:31.299 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.083353+0000", 2020-11-16T20:56:31.299 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.094007683000001, 2020-11-16T20:56:31.299 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017054562999999998, 2020-11-16T20:56:31.299 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.299 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.299 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.300 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.300 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.300 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083353+0000", 2020-11-16T20:56:31.300 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.300 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.300 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.300 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.300 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083353+0000", 2020-11-16T20:56:31.301 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039019899999999998 2020-11-16T20:56:31.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.301 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.301 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.301 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083743+0000", 2020-11-16T20:56:31.301 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.098e-06 2020-11-16T20:56:31.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.302 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.302 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.302 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083752+0000", 2020-11-16T20:56:31.302 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2599000000000001e-05 2020-11-16T20:56:31.302 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.302 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.302 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.302 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083765+0000", 2020-11-16T20:56:31.303 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0224000000000001e-05 2020-11-16T20:56:31.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.303 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.303 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.303 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083775+0000", 2020-11-16T20:56:31.303 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056252819999999997 2020-11-16T20:56:31.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.304 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.304 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.304 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089400+0000", 2020-11-16T20:56:31.304 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4091000000000003e-05 2020-11-16T20:56:31.304 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.304 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.304 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.304 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089434+0000", 2020-11-16T20:56:31.305 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010917029999999999 2020-11-16T20:56:31.305 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.305 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.305 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.305 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100351+0000", 2020-11-16T20:56:31.305 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6039999999999999e-05 2020-11-16T20:56:31.305 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.306 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.306 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.306 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100407+0000", 2020-11-16T20:56:31.306 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017054562999999998 2020-11-16T20:56:31.306 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.306 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.306 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.307 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2371 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'96, mlcod=41'92)", 2020-11-16T20:56:31.307 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.084675+0000", 2020-11-16T20:56:31.307 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.092685789000001, 2020-11-16T20:56:31.307 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015773533999999999, 2020-11-16T20:56:31.307 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.307 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.308 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.308 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.308 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084675+0000", 2020-11-16T20:56:31.308 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.308 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.309 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084675+0000", 2020-11-16T20:56:31.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7421999999999999e-05 2020-11-16T20:56:31.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.309 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.309 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.309 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084702+0000", 2020-11-16T20:56:31.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9120000000000003e-06 2020-11-16T20:56:31.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084708+0000", 2020-11-16T20:56:31.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4649999999999994e-06 2020-11-16T20:56:31.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084716+0000", 2020-11-16T20:56:31.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0950000000000003e-06 2020-11-16T20:56:31.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084722+0000", 2020-11-16T20:56:31.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056083510000000001 2020-11-16T20:56:31.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.312 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.312 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.090330+0000", 2020-11-16T20:56:31.312 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9339000000000001e-05 2020-11-16T20:56:31.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.312 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.313 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.090359+0000", 2020-11-16T20:56:31.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010050811 2020-11-16T20:56:31.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.313 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.313 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100410+0000", 2020-11-16T20:56:31.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8139000000000002e-05 2020-11-16T20:56:31.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.314 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.314 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100448+0000", 2020-11-16T20:56:31.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015773533999999999 2020-11-16T20:56:31.314 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.314 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.314 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.315 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.315 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.315 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2580 3.2 e57/19 3:75836747:::smithi16641208-340:head v 57'492, mlcod=57'483)", 2020-11-16T20:56:31.315 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.768064+0000", 2020-11-16T20:56:31.315 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.409296579999999, 2020-11-16T20:56:31.315 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018062056, 2020-11-16T20:56:31.315 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.315 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.316 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.316 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.316 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.768064+0000", 2020-11-16T20:56:31.316 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.768064+0000", 2020-11-16T20:56:31.317 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00058317799999999995 2020-11-16T20:56:31.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.768647+0000", 2020-11-16T20:56:31.317 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0350000000000007e-06 2020-11-16T20:56:31.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.318 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.318 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.768656+0000", 2020-11-16T20:56:31.318 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2744e-05 2020-11-16T20:56:31.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.319 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.319 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.768669+0000", 2020-11-16T20:56:31.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7309999999999996e-06 2020-11-16T20:56:31.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.319 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.319 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.768676+0000", 2020-11-16T20:56:31.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0025689390000000001 2020-11-16T20:56:31.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.320 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.320 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.320 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.771244+0000", 2020-11-16T20:56:31.320 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8636000000000002e-05 2020-11-16T20:56:31.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.320 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.321 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.321 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.771273+0000", 2020-11-16T20:56:31.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014783734 2020-11-16T20:56:31.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.321 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.321 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786057+0000", 2020-11-16T20:56:31.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9059000000000004e-05 2020-11-16T20:56:31.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786126+0000", 2020-11-16T20:56:31.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018062056 2020-11-16T20:56:31.322 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.322 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.323 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.323 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2581 3.2 e57/19 3:75836747:::smithi16641208-340:head v 57'493, mlcod=57'483)", 2020-11-16T20:56:31.323 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.768987+0000", 2020-11-16T20:56:31.323 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.408373199, 2020-11-16T20:56:31.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017169609999999998, 2020-11-16T20:56:31.323 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.324 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.324 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.324 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.324 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.768987+0000", 2020-11-16T20:56:31.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.325 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.768987+0000", 2020-11-16T20:56:31.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001144267 2020-11-16T20:56:31.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.325 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.770131+0000", 2020-11-16T20:56:31.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6410000000000008e-06 2020-11-16T20:56:31.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.326 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.770140+0000", 2020-11-16T20:56:31.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2741999999999999e-05 2020-11-16T20:56:31.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.770153+0000", 2020-11-16T20:56:31.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3950000000000003e-06 2020-11-16T20:56:31.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.770160+0000", 2020-11-16T20:56:31.328 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054500110000000003 2020-11-16T20:56:31.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.775610+0000", 2020-11-16T20:56:31.328 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5126e-05 2020-11-16T20:56:31.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.329 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.329 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.775635+0000", 2020-11-16T20:56:31.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010494847999999999 2020-11-16T20:56:31.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.329 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.329 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786130+0000", 2020-11-16T20:56:31.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.658e-05 2020-11-16T20:56:31.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.330 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.330 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786157+0000", 2020-11-16T20:56:31.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017169609999999998 2020-11-16T20:56:31.330 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.331 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.331 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.331 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:603 3.2 e57/19 3:5a2e7c26:::smithi16641208-130:head v 57'494, mlcod=57'485)", 2020-11-16T20:56:31.331 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.772348+0000", 2020-11-16T20:56:31.331 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.405011922, 2020-11-16T20:56:31.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015150215999999999, 2020-11-16T20:56:31.332 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.332 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.332 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.332 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.332 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.772348+0000", 2020-11-16T20:56:31.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.333 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.333 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.772348+0000", 2020-11-16T20:56:31.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0039012650000000001 2020-11-16T20:56:31.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.333 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.776250+0000", 2020-11-16T20:56:31.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7919999999999998e-06 2020-11-16T20:56:31.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.334 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.776259+0000", 2020-11-16T20:56:31.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1582e-05 2020-11-16T20:56:31.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.335 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.335 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.335 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.776270+0000", 2020-11-16T20:56:31.335 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6779999999999997e-06 2020-11-16T20:56:31.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.335 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.335 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.336 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.776276+0000", 2020-11-16T20:56:31.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00067481599999999996 2020-11-16T20:56:31.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.336 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.336 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.336 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.776951+0000", 2020-11-16T20:56:31.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1649999999999997e-05 2020-11-16T20:56:31.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.776982+0000", 2020-11-16T20:56:31.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010457162000000001 2020-11-16T20:56:31.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787439+0000", 2020-11-16T20:56:31.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9271000000000002e-05 2020-11-16T20:56:31.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787499+0000", 2020-11-16T20:56:31.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015150215999999999 2020-11-16T20:56:31.339 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.339 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.339 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.339 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.339 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:609 3.2 e57/19 3:5eead97c:::smithi16641208-34:head v 57'498, mlcod=57'495)", 2020-11-16T20:56:31.339 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.810471+0000", 2020-11-16T20:56:31.339 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.366889787, 2020-11-16T20:56:31.340 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040749058999999997, 2020-11-16T20:56:31.340 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.340 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.340 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.340 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.340 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.340 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810471+0000", 2020-11-16T20:56:31.341 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.341 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.341 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810471+0000", 2020-11-16T20:56:31.341 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088055860000000007 2020-11-16T20:56:31.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819276+0000", 2020-11-16T20:56:31.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3659000000000002e-05 2020-11-16T20:56:31.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819300+0000", 2020-11-16T20:56:31.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9273e-05 2020-11-16T20:56:31.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819319+0000", 2020-11-16T20:56:31.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4292e-05 2020-11-16T20:56:31.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.344 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.344 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819333+0000", 2020-11-16T20:56:31.344 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2676999999999995e-05 2020-11-16T20:56:31.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.344 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.344 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.344 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819416+0000", 2020-11-16T20:56:31.344 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1479e-05 2020-11-16T20:56:31.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.345 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.345 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819458+0000", 2020-11-16T20:56:31.345 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.031704478000000001 2020-11-16T20:56:31.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851162+0000", 2020-11-16T20:56:31.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7615000000000003e-05 2020-11-16T20:56:31.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.346 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851220+0000", 2020-11-16T20:56:31.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040749058999999997 2020-11-16T20:56:31.347 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.347 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.347 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.347 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2593 3.3 e57/19 3:f5f8fa2a:::smithi16641208-144:head v 57'482, mlcod=57'478)", 2020-11-16T20:56:31.347 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.811262+0000", 2020-11-16T20:56:31.348 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.366098065999999, 2020-11-16T20:56:31.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039577978999999999, 2020-11-16T20:56:31.348 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.348 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.348 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.348 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.349 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.811262+0000", 2020-11-16T20:56:31.349 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.349 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.349 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.811262+0000", 2020-11-16T20:56:31.349 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0024992909999999998 2020-11-16T20:56:31.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813762+0000", 2020-11-16T20:56:31.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3520000000000007e-06 2020-11-16T20:56:31.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813770+0000", 2020-11-16T20:56:31.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6045999999999998e-05 2020-11-16T20:56:31.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.351 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813786+0000", 2020-11-16T20:56:31.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2719999999999997e-06 2020-11-16T20:56:31.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.352 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813794+0000", 2020-11-16T20:56:31.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7755000000000002e-05 2020-11-16T20:56:31.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813892+0000", 2020-11-16T20:56:31.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4265000000000003e-05 2020-11-16T20:56:31.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813946+0000", 2020-11-16T20:56:31.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036843977 2020-11-16T20:56:31.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.354 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.354 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.354 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.850790+0000", 2020-11-16T20:56:31.354 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0021000000000001e-05 2020-11-16T20:56:31.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.354 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.354 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.355 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.850840+0000", 2020-11-16T20:56:31.355 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039577978999999999 2020-11-16T20:56:31.355 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.355 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.355 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.355 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.13:618 3.3 e57/19 3:d775beee:::smithi16641208-10:head v 57'483, mlcod=57'478)", 2020-11-16T20:56:31.356 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.825375+0000", 2020-11-16T20:56:31.356 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.351985715, 2020-11-16T20:56:31.356 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.025928922, 2020-11-16T20:56:31.356 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.356 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.356 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.356 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.357 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.825375+0000", 2020-11-16T20:56:31.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.357 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.825375+0000", 2020-11-16T20:56:31.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001052641 2020-11-16T20:56:31.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.358 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.826427+0000", 2020-11-16T20:56:31.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.884e-06 2020-11-16T20:56:31.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.826436+0000", 2020-11-16T20:56:31.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2126999999999999e-05 2020-11-16T20:56:31.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.826448+0000", 2020-11-16T20:56:31.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5680000000000005e-06 2020-11-16T20:56:31.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.360 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.360 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.360 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.826458+0000", 2020-11-16T20:56:31.360 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8312e-05 2020-11-16T20:56:31.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.360 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.361 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.361 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.826516+0000", 2020-11-16T20:56:31.361 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3490999999999999e-05 2020-11-16T20:56:31.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.361 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.361 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.361 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.826540+0000", 2020-11-16T20:56:31.361 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024717156000000001 2020-11-16T20:56:31.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.362 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.362 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851257+0000", 2020-11-16T20:56:31.362 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6743000000000003e-05 2020-11-16T20:56:31.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.363 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.363 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851304+0000", 2020-11-16T20:56:31.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.025928922 2020-11-16T20:56:31.363 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.363 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.363 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.364 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.13:619 3.3 e57/19 3:d79d68cf:::smithi16641208-37:head v 57'484, mlcod=57'478)", 2020-11-16T20:56:31.364 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.827568+0000", 2020-11-16T20:56:31.364 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.349792634, 2020-11-16T20:56:31.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023912187000000001, 2020-11-16T20:56:31.364 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.364 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.364 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.827568+0000", 2020-11-16T20:56:31.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.827568+0000", 2020-11-16T20:56:31.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011559700000000001 2020-11-16T20:56:31.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.366 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.366 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.828724+0000", 2020-11-16T20:56:31.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7420000000000003e-06 2020-11-16T20:56:31.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.828732+0000", 2020-11-16T20:56:31.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2694000000000001e-05 2020-11-16T20:56:31.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.828745+0000", 2020-11-16T20:56:31.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7479999999999999e-06 2020-11-16T20:56:31.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.828754+0000", 2020-11-16T20:56:31.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011949338 2020-11-16T20:56:31.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.840703+0000", 2020-11-16T20:56:31.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2928000000000001e-05 2020-11-16T20:56:31.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.840726+0000", 2020-11-16T20:56:31.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010701949000000001 2020-11-16T20:56:31.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851428+0000", 2020-11-16T20:56:31.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1817999999999998e-05 2020-11-16T20:56:31.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851480+0000", 2020-11-16T20:56:31.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023912187000000001 2020-11-16T20:56:31.371 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.371 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.371 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.372 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2705 4.1 e63/53 4:b0e01256:::smithi16641208-225:head v 63'189, mlcod=61'185)", 2020-11-16T20:56:31.372 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:25.752150+0000", 2020-11-16T20:56:31.372 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.425210613, 2020-11-16T20:56:31.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017996993999999999, 2020-11-16T20:56:31.372 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.372 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.372 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.752150+0000", 2020-11-16T20:56:31.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.752150+0000", 2020-11-16T20:56:31.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020574230000000001 2020-11-16T20:56:31.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.754207+0000", 2020-11-16T20:56:31.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7051e-05 2020-11-16T20:56:31.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.375 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.754224+0000", 2020-11-16T20:56:31.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8719000000000002e-05 2020-11-16T20:56:31.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.754243+0000", 2020-11-16T20:56:31.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2979999999999999e-05 2020-11-16T20:56:31.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.754256+0000", 2020-11-16T20:56:31.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8647999999999996e-05 2020-11-16T20:56:31.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.754345+0000", 2020-11-16T20:56:31.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8513999999999998e-05 2020-11-16T20:56:31.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.754383+0000", 2020-11-16T20:56:31.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015688825 2020-11-16T20:56:31.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.770072+0000", 2020-11-16T20:56:31.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4833999999999995e-05 2020-11-16T20:56:31.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.770147+0000", 2020-11-16T20:56:31.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017996993999999999 2020-11-16T20:56:31.379 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.379 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.379 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.380 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.380 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.380 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:31.380 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:31.221+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:31.381 INFO:tasks.thrashosds.thrasher:j is {'epoch': 68, 'fsid': 'a14fd848-4cfe-4cd9-9140-5b3c4b4e904d', 'created': '2020-11-16T20:54:44.938121+0000', 'modified': '2020-11-16T20:56:30.736132+0000', 'last_up_change': '2020-11-16T20:54:52.080163+0000', 'last_in_change': '2020-11-16T20:54:52.080163+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-16T20:54:49.109999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-16T20:54:53.253680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 18, 'pg_placement_num': 18, 'pg_placement_num_target': 18, 'pg_num_target': 18, 'pg_num_pending': 18, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '32', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'base', 'create_time': '2020-11-16T20:55:23.597952+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 4, 'pg_placement_num': 4, 'pg_placement_num_target': 4, 'pg_num_target': 4, 'pg_num_pending': 4, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '27', 'last_force_op_resend_prenautilus': '27', 'last_force_op_resend_preluminous': '27', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 33, 'snap_epoch': 68, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [4], 'tier_of': -1, 'read_tier': 4, 'write_tier': 4, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 4, 'pool_name': 'cache', 'create_time': '2020-11-16T20:55:28.901773+0000', 'flags': 8201, 'flags_names': 'hashpspool,incomplete_clones,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 4, 'pg_placement_num': 4, 'pg_placement_num_target': 4, 'pg_num_target': 4, 'pg_num_pending': 4, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '27', 'last_force_op_resend_prenautilus': '27', 'last_force_op_resend_preluminous': '27', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 33, 'snap_epoch': 68, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': 3, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'writeback', 'target_max_bytes': 0, 'target_max_objects': 250, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'bloom', 'false_positive_probability': 0.05, 'target_size': 0, 'seed': 0}, 'hit_set_period': 3600, 'hit_set_count': 8, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 2, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [1000000, 1000000, 1000000, 1000000, 1000000, 1000000, 1000000, 1000000], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}}], 'osds': [{'osd': 0, 'uuid': '35950122-efbd-420e-b07a-f5730f26df17', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6800', 'nonce': 35293}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6802', 'nonce': 35293}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6806', 'nonce': 35293}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6804', 'nonce': 35293}]}, 'public_addr': '172.21.15.166:6800/35293', 'cluster_addr': '172.21.15.166:6802/35293', 'heartbeat_back_addr': '172.21.15.166:6806/35293', 'heartbeat_front_addr': '172.21.15.166:6804/35293', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f768a1ff-3e8a-4131-a6ed-10f93b3ca900', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 66, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6808', 'nonce': 35323}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6809', 'nonce': 35323}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6811', 'nonce': 35323}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6810', 'nonce': 35323}]}, 'public_addr': '172.21.15.166:6808/35323', 'cluster_addr': '172.21.15.166:6809/35323', 'heartbeat_back_addr': '172.21.15.166:6811/35323', 'heartbeat_front_addr': '172.21.15.166:6810/35323', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '88734179-84a6-4a9b-8af0-692805815875', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6801', 'nonce': 35294}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6803', 'nonce': 35294}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6807', 'nonce': 35294}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6805', 'nonce': 35294}]}, 'public_addr': '172.21.15.166:6801/35294', 'cluster_addr': '172.21.15.166:6803/35294', 'heartbeat_back_addr': '172.21.15.166:6807/35294', 'heartbeat_front_addr': '172.21.15.166:6805/35294', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '319e54e8-3f03-4388-8de6-678d148e25d4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6812', 'nonce': 35324}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6813', 'nonce': 35324}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6815', 'nonce': 35324}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6814', 'nonce': 35324}]}, 'public_addr': '172.21.15.166:6812/35324', 'cluster_addr': '172.21.15.166:6813/35324', 'heartbeat_back_addr': '172.21.15.166:6815/35324', 'heartbeat_front_addr': '172.21.15.166:6814/35324', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '3edbb68e-e030-4379-891e-2412f1235ffb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 63, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6804', 'nonce': 31586}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6805', 'nonce': 31586}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6807', 'nonce': 31586}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6806', 'nonce': 31586}]}, 'public_addr': '172.21.15.59:6804/31586', 'cluster_addr': '172.21.15.59:6805/31586', 'heartbeat_back_addr': '172.21.15.59:6807/31586', 'heartbeat_front_addr': '172.21.15.59:6806/31586', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '44fbf5ac-4484-48a8-a846-1f5c01a6ec2c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 63, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6808', 'nonce': 31610}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6810', 'nonce': 31610}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6813', 'nonce': 31610}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6812', 'nonce': 31610}]}, 'public_addr': '172.21.15.59:6808/31610', 'cluster_addr': '172.21.15.59:6810/31610', 'heartbeat_back_addr': '172.21.15.59:6813/31610', 'heartbeat_front_addr': '172.21.15.59:6812/31610', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'f93b82df-f537-4601-8247-388bf100b5b5', 'up': 1, 'in': 1, 'weight': 0.5654754638671875, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6800', 'nonce': 31587}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6801', 'nonce': 31587}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6803', 'nonce': 31587}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6802', 'nonce': 31587}]}, 'public_addr': '172.21.15.59:6800/31587', 'cluster_addr': '172.21.15.59:6801/31587', 'heartbeat_back_addr': '172.21.15.59:6803/31587', 'heartbeat_front_addr': '172.21.15.59:6802/31587', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'e5485c88-d267-4a6a-b9b6-15d869d28f28', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6809', 'nonce': 31617}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6811', 'nonce': 31617}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6815', 'nonce': 31617}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6814', 'nonce': 31617}]}, 'public_addr': '172.21.15.59:6809/31617', 'cluster_addr': '172.21.15.59:6811/31617', 'heartbeat_back_addr': '172.21.15.59:6815/31617', 'heartbeat_front_addr': '172.21.15.59:6814/31617', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:50.610058+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:50.548086+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:50.536944+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:51.137739+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:50.747840+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:51.365378+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:50.725150+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:50.621411+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.e', 'osds': [1, 7, 0]}], 'pg_upmap_items': [{'pgid': '4.1', 'mappings': [{'from': 5, 'to': 3}]}], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 5, 'length': 1}, {'begin': 14, 'length': 1}, {'begin': 18, 'length': 1}, {'begin': 20, 'length': 1}, {'begin': 24, 'length': 2}, {'begin': 29, 'length': 1}]}, {'pool': 4, 'snaps': [{'begin': 5, 'length': 1}, {'begin': 14, 'length': 1}, {'begin': 18, 'length': 1}, {'begin': 20, 'length': 1}, {'begin': 24, 'length': 2}, {'begin': 29, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2020-11-16T20:56:31.381 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-16T20:56:31.382 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:56:31.383 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:31.388+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:31.484 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:31.488+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:31.518 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:31.519 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:31.519 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:56:31.519 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:31.528 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:56:31.585 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:31.589+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:31.663 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:31.663 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:31.663 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:56:31.664 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:56:31.664 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:31.673 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:56:31.674 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:56:31.675 INFO:teuthology.orchestra.run.smithi166.stderr:dumped all 2020-11-16T20:56:31.684 INFO:teuthology.orchestra.run.smithi166.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2020-11-16T20:56:31.090931+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1883734636,"num_objects":703,"num_object_clones":45,"num_object_copies":2109,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":612,"num_whiteouts":10,"num_read":1523,"num_read_kb":367645,"num_write":2569,"num_write_kb":940865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":91753326,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":66,"num_flush_kb":182447,"num_evict":6,"num_evict_kb":13724,"num_promote":187,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3038,"ondisk_log_size":3038,"up":81,"acting":80,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3575588,"kb_used_data":3485036,"kb_used_omap":0,"kb_used_meta":89152,"kb_avail":751399132,"statfs":{"total":773094113280,"available":769432711168,"internally_reserved":0,"allocated":3568676864,"data_stored":3708669003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":91291648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11724355,"num_objects":6,"num_object_clones":6,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":55,"num_read_kb":51984,"num_write":12,"num_write_kb":18568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":4,"num_flush_kb":11114,"num_evict":0,"num_evict_kb":0,"num_promote":1,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000755"},"pg_stats":[{"pgid":"2.11","version":"0'0","reported_seq":"13","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-16T20:56:26.743586+0000","last_change":"2020-11-16T20:56:26.743586+0000","last_active":"2020-11-16T20:56:26.743586+0000","last_peered":"2020-11-16T20:56:26.743586+0000","last_clean":"2020-11-16T20:56:26.743586+0000","last_became_active":"2020-11-16T20:56:26.743063+0000","last_became_peered":"2020-11-16T20:56:26.743063+0000","last_unstale":"2020-11-16T20:56:26.743586+0000","last_undegraded":"2020-11-16T20:56:26.743586+0000","last_fullsized":"2020-11-16T20:56:26.743586+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:03.679641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:03.679641+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"42","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-16T20:56:25.744672+0000","last_change":"2020-11-16T20:55:59.416734+0000","last_active":"2020-11-16T20:56:25.744672+0000","last_peered":"2020-11-16T20:56:25.744672+0000","last_clean":"2020-11-16T20:56:25.744672+0000","last_became_active":"2020-11-16T20:55:52.921860+0000","last_became_peered":"2020-11-16T20:55:52.921860+0000","last_unstale":"2020-11-16T20:56:25.744672+0000","last_undegraded":"2020-11-16T20:56:25.744672+0000","last_fullsized":"2020-11-16T20:56:25.744672+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.416654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.416654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":"42","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-16T20:56:25.739500+0000","last_change":"2020-11-16T20:55:56.438524+0000","last_active":"2020-11-16T20:56:25.739500+0000","last_peered":"2020-11-16T20:56:25.739500+0000","last_clean":"2020-11-16T20:56:25.739500+0000","last_became_active":"2020-11-16T20:55:52.922023+0000","last_became_peered":"2020-11-16T20:55:52.922023+0000","last_unstale":"2020-11-16T20:56:25.739500+0000","last_undegraded":"2020-11-16T20:56:25.739500+0000","last_fullsized":"2020-11-16T20:56:25.739500+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:56.438428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:56.438428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":"16","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-16T20:56:25.742156+0000","last_change":"2020-11-16T20:56:20.755004+0000","last_active":"2020-11-16T20:56:25.742156+0000","last_peered":"2020-11-16T20:56:25.742156+0000","last_clean":"2020-11-16T20:56:25.742156+0000","last_became_active":"2020-11-16T20:56:20.754520+0000","last_became_peered":"2020-11-16T20:56:20.754520+0000","last_unstale":"2020-11-16T20:56:25.742156+0000","last_undegraded":"2020-11-16T20:56:25.742156+0000","last_fullsized":"2020-11-16T20:56:25.742156+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:04.388506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:04.388506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"42","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-16T20:56:25.741755+0000","last_change":"2020-11-16T20:56:11.940489+0000","last_active":"2020-11-16T20:56:25.741755+0000","last_peered":"2020-11-16T20:56:25.741755+0000","last_clean":"2020-11-16T20:56:25.741755+0000","last_became_active":"2020-11-16T20:55:52.922134+0000","last_became_peered":"2020-11-16T20:55:52.922134+0000","last_unstale":"2020-11-16T20:56:25.741755+0000","last_undegraded":"2020-11-16T20:56:25.741755+0000","last_fullsized":"2020-11-16T20:56:25.741755+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:11.940423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:11.940423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"42","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-16T20:56:25.744493+0000","last_change":"2020-11-16T20:56:02.387946+0000","last_active":"2020-11-16T20:56:25.744493+0000","last_peered":"2020-11-16T20:56:25.744493+0000","last_clean":"2020-11-16T20:56:25.744493+0000","last_became_active":"2020-11-16T20:55:52.920496+0000","last_became_peered":"2020-11-16T20:55:52.920496+0000","last_unstale":"2020-11-16T20:56:25.744493+0000","last_undegraded":"2020-11-16T20:56:25.744493+0000","last_fullsized":"2020-11-16T20:56:25.744493+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:02.387861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:02.387861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"68","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-16T20:56:25.733983+0000","last_change":"2020-11-16T20:56:02.565668+0000","last_active":"2020-11-16T20:56:25.733983+0000","last_peered":"2020-11-16T20:56:25.733983+0000","last_clean":"2020-11-16T20:56:25.733983+0000","last_became_active":"2020-11-16T20:55:52.917496+0000","last_became_peered":"2020-11-16T20:55:52.917496+0000","last_unstale":"2020-11-16T20:56:25.733983+0000","last_undegraded":"2020-11-16T20:56:25.733983+0000","last_fullsized":"2020-11-16T20:56:25.733983+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:02.565607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:56:02.565607+0000","last_clean_scrub_stamp":"2020-11-16T20:56:02.565607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"68","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-16T20:56:25.741745+0000","last_change":"2020-11-16T20:56:01.955760+0000","last_active":"2020-11-16T20:56:25.741745+0000","last_peered":"2020-11-16T20:56:25.741745+0000","last_clean":"2020-11-16T20:56:25.741745+0000","last_became_active":"2020-11-16T20:55:52.922447+0000","last_became_peered":"2020-11-16T20:55:52.922447+0000","last_unstale":"2020-11-16T20:56:25.741745+0000","last_undegraded":"2020-11-16T20:56:25.741745+0000","last_fullsized":"2020-11-16T20:56:25.741745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:01.955691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:01.955691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"51","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-16T20:56:25.742513+0000","last_change":"2020-11-16T20:56:18.755476+0000","last_active":"2020-11-16T20:56:25.742513+0000","last_peered":"2020-11-16T20:56:25.742513+0000","last_clean":"2020-11-16T20:56:25.742513+0000","last_became_active":"2020-11-16T20:56:18.754989+0000","last_became_peered":"2020-11-16T20:56:18.754989+0000","last_unstale":"2020-11-16T20:56:25.742513+0000","last_undegraded":"2020-11-16T20:56:25.742513+0000","last_fullsized":"2020-11-16T20:56:25.742513+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:00.967553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:00.967553+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"77","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-16T20:56:25.733950+0000","last_change":"2020-11-16T20:56:01.528273+0000","last_active":"2020-11-16T20:56:25.733950+0000","last_peered":"2020-11-16T20:56:25.733950+0000","last_clean":"2020-11-16T20:56:25.733950+0000","last_became_active":"2020-11-16T20:55:52.922303+0000","last_became_peered":"2020-11-16T20:55:52.922303+0000","last_unstale":"2020-11-16T20:56:25.733950+0000","last_undegraded":"2020-11-16T20:56:25.733950+0000","last_fullsized":"2020-11-16T20:56:25.733950+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:01.528217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:01.528217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"68","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-16T20:56:25.741742+0000","last_change":"2020-11-16T20:55:57.905062+0000","last_active":"2020-11-16T20:56:25.741742+0000","last_peered":"2020-11-16T20:56:25.741742+0000","last_clean":"2020-11-16T20:56:25.741742+0000","last_became_active":"2020-11-16T20:55:50.904146+0000","last_became_peered":"2020-11-16T20:55:50.904146+0000","last_unstale":"2020-11-16T20:56:25.741742+0000","last_undegraded":"2020-11-16T20:56:25.741742+0000","last_fullsized":"2020-11-16T20:56:25.741742+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:57.905004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:57.905004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"62'274","reported_seq":"425","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-16T20:56:25.742660+0000","last_change":"2020-11-16T20:56:24.753883+0000","last_active":"2020-11-16T20:56:25.742660+0000","last_peered":"2020-11-16T20:56:25.742660+0000","last_clean":"2020-11-16T20:56:25.742660+0000","last_became_active":"2020-11-16T20:55:30.828637+0000","last_became_peered":"2020-11-16T20:55:30.828637+0000","last_unstale":"2020-11-16T20:56:25.742660+0000","last_undegraded":"2020-11-16T20:56:25.742660+0000","last_fullsized":"2020-11-16T20:56:25.742660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":274,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":99913493,"num_objects":42,"num_object_clones":6,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":3,"num_read":49,"num_read_kb":43,"num_write":158,"num_write_kb":23115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":27,"num_flush_kb":71310,"num_evict":6,"num_evict_kb":13724,"num_promote":49,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"5","length":"1"},{"start":"e","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.2","version":"0'0","reported_seq":"78","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-16T20:56:26.744951+0000","last_change":"2020-11-16T20:56:26.743666+0000","last_active":"2020-11-16T20:56:26.744951+0000","last_peered":"2020-11-16T20:56:26.744951+0000","last_clean":"2020-11-16T20:56:26.744951+0000","last_became_active":"2020-11-16T20:56:26.743184+0000","last_became_peered":"2020-11-16T20:56:26.743184+0000","last_unstale":"2020-11-16T20:56:26.744951+0000","last_undegraded":"2020-11-16T20:56:26.744951+0000","last_fullsized":"2020-11-16T20:56:26.744951+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:57.606500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:57.606500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"62'543","reported_seq":"812","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-16T20:56:25.742518+0000","last_change":"2020-11-16T20:56:24.762659+0000","last_active":"2020-11-16T20:56:25.742518+0000","last_peered":"2020-11-16T20:56:25.742518+0000","last_clean":"2020-11-16T20:56:25.742518+0000","last_became_active":"2020-11-16T20:55:25.103851+0000","last_became_peered":"2020-11-16T20:55:25.103851+0000","last_unstale":"2020-11-16T20:56:25.742518+0000","last_undegraded":"2020-11-16T20:56:25.742518+0000","last_fullsized":"2020-11-16T20:56:25.742518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":543,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":353513705,"num_objects":130,"num_object_clones":7,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":1,"num_read":311,"num_read_kb":48357,"num_write":521,"num_write_kb":219679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"5","length":"1"},{"start":"e","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":"68","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-16T20:56:25.744497+0000","last_change":"2020-11-16T20:55:58.465447+0000","last_active":"2020-11-16T20:56:25.744497+0000","last_peered":"2020-11-16T20:56:25.744497+0000","last_clean":"2020-11-16T20:56:25.744497+0000","last_became_active":"2020-11-16T20:55:50.905925+0000","last_became_peered":"2020-11-16T20:55:50.905925+0000","last_unstale":"2020-11-16T20:56:25.744497+0000","last_undegraded":"2020-11-16T20:56:25.744497+0000","last_fullsized":"2020-11-16T20:56:25.744497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:58.465384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:58.465384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"62'485","reported_seq":"736","reported_epoch":"64","state":"remapped+peering","last_fresh":"2020-11-16T20:56:26.740042+0000","last_change":"2020-11-16T20:56:26.740364+0000","last_active":"2020-11-16T20:56:25.742167+0000","last_peered":"2020-11-16T20:56:24.752964+0000","last_clean":"2020-11-16T20:56:24.752964+0000","last_became_active":"2020-11-16T20:55:25.103928+0000","last_became_peered":"2020-11-16T20:55:25.103928+0000","last_unstale":"2020-11-16T20:56:26.740042+0000","last_undegraded":"2020-11-16T20:56:26.740042+0000","last_fullsized":"2020-11-16T20:56:26.740042+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":485,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":331229283,"num_objects":125,"num_object_clones":8,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":2,"num_read":256,"num_read_kb":12189,"num_write":484,"num_write_kb":178613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2,6],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"5","length":"1"},{"start":"e","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.3","version":"0'0","reported_seq":"69","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-16T20:56:26.739609+0000","last_change":"2020-11-16T20:55:59.611811+0000","last_active":"2020-11-16T20:56:26.739609+0000","last_peered":"2020-11-16T20:56:26.739609+0000","last_clean":"2020-11-16T20:56:26.739609+0000","last_became_active":"2020-11-16T20:55:50.903578+0000","last_became_peered":"2020-11-16T20:55:50.903578+0000","last_unstale":"2020-11-16T20:56:26.739609+0000","last_undegraded":"2020-11-16T20:56:26.739609+0000","last_fullsized":"2020-11-16T20:56:26.739609+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.611727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.611727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"64","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-16T20:56:25.734094+0000","last_change":"2020-11-16T20:56:03.542304+0000","last_active":"2020-11-16T20:56:25.734094+0000","last_peered":"2020-11-16T20:56:25.734094+0000","last_clean":"2020-11-16T20:56:25.734094+0000","last_became_active":"2020-11-16T20:54:53.112038+0000","last_became_peered":"2020-11-16T20:54:53.112038+0000","last_unstale":"2020-11-16T20:56:25.734094+0000","last_undegraded":"2020-11-16T20:56:25.734094+0000","last_fullsized":"2020-11-16T20:56:25.734094+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'2","last_scrub_stamp":"2020-11-16T20:56:03.542235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:50.068882+0000","last_clean_scrub_stamp":"2020-11-16T20:56:03.542235+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"62'533","reported_seq":"792","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-16T20:56:25.736789+0000","last_change":"2020-11-16T20:56:24.758131+0000","last_active":"2020-11-16T20:56:25.736789+0000","last_peered":"2020-11-16T20:56:25.736789+0000","last_clean":"2020-11-16T20:56:25.736789+0000","last_became_active":"2020-11-16T20:55:25.106302+0000","last_became_peered":"2020-11-16T20:55:25.106302+0000","last_unstale":"2020-11-16T20:56:25.736789+0000","last_undegraded":"2020-11-16T20:56:25.736789+0000","last_fullsized":"2020-11-16T20:56:25.736789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":533,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":327249391,"num_objects":122,"num_object_clones":6,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":306,"num_read_kb":70470,"num_write":490,"num_write_kb":226568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"5","length":"1"},{"start":"e","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":"69","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-16T20:56:25.734222+0000","last_change":"2020-11-16T20:55:56.657297+0000","last_active":"2020-11-16T20:56:25.734222+0000","last_peered":"2020-11-16T20:56:25.734222+0000","last_clean":"2020-11-16T20:56:25.734222+0000","last_became_active":"2020-11-16T20:55:50.908710+0000","last_became_peered":"2020-11-16T20:55:50.908710+0000","last_unstale":"2020-11-16T20:56:25.734222+0000","last_undegraded":"2020-11-16T20:56:25.734222+0000","last_fullsized":"2020-11-16T20:56:25.734222+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:56.657242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:56.657242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"61'609","reported_seq":"901","reported_epoch":"65","state":"active+clean","last_fresh":"2020-11-16T20:56:27.740124+0000","last_change":"2020-11-16T20:56:27.740124+0000","last_active":"2020-11-16T20:56:27.740124+0000","last_peered":"2020-11-16T20:56:27.740124+0000","last_clean":"2020-11-16T20:56:27.740124+0000","last_became_active":"2020-11-16T20:55:24.802649+0000","last_became_peered":"2020-11-16T20:55:24.802649+0000","last_unstale":"2020-11-16T20:56:27.740124+0000","last_undegraded":"2020-11-16T20:56:27.740124+0000","last_fullsized":"2020-11-16T20:56:27.740124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":609,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":392084522,"num_objects":139,"num_object_clones":5,"num_object_copies":417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":0,"num_read":371,"num_read_kb":89825,"num_write":582,"num_write_kb":230014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"5","length":"1"},{"start":"e","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"19","length":"1"},{"start":"1d","length":"1"}]},{"pgid":"4.3","version":"62'227","reported_seq":"393","reported_epoch":"65","state":"active+clean","last_fresh":"2020-11-16T20:56:27.739641+0000","last_change":"2020-11-16T20:56:27.740217+0000","last_active":"2020-11-16T20:56:27.739641+0000","last_peered":"2020-11-16T20:56:27.739641+0000","last_clean":"2020-11-16T20:56:27.739641+0000","last_became_active":"2020-11-16T20:55:30.829833+0000","last_became_peered":"2020-11-16T20:55:30.829833+0000","last_unstale":"2020-11-16T20:56:27.739641+0000","last_undegraded":"2020-11-16T20:56:27.739641+0000","last_fullsized":"2020-11-16T20:56:27.739641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":227,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":134891713,"num_objects":50,"num_object_clones":4,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":75,"num_read_kb":43472,"num_write":125,"num_write_kb":21359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":18,"num_flush_kb":49757,"num_evict":0,"num_evict_kb":0,"num_promote":49,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"5","length":"1"},{"start":"e","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"19","length":"1"},{"start":"1d","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":"69","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-16T20:56:25.734116+0000","last_change":"2020-11-16T20:55:59.571968+0000","last_active":"2020-11-16T20:56:25.734116+0000","last_peered":"2020-11-16T20:56:25.734116+0000","last_clean":"2020-11-16T20:56:25.734116+0000","last_became_active":"2020-11-16T20:55:50.901014+0000","last_became_peered":"2020-11-16T20:55:50.901014+0000","last_unstale":"2020-11-16T20:56:25.734116+0000","last_undegraded":"2020-11-16T20:56:25.734116+0000","last_fullsized":"2020-11-16T20:56:25.734116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.571892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.571892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"68","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-16T20:56:25.742259+0000","last_change":"2020-11-16T20:55:59.950321+0000","last_active":"2020-11-16T20:56:25.742259+0000","last_peered":"2020-11-16T20:56:25.742259+0000","last_clean":"2020-11-16T20:56:25.742259+0000","last_became_active":"2020-11-16T20:55:50.905408+0000","last_became_peered":"2020-11-16T20:55:50.905408+0000","last_unstale":"2020-11-16T20:56:25.742259+0000","last_undegraded":"2020-11-16T20:56:25.742259+0000","last_fullsized":"2020-11-16T20:56:25.742259+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.950219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.950219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"64'176","reported_seq":"321","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-16T20:56:26.737788+0000","last_change":"2020-11-16T20:56:24.757506+0000","last_active":"2020-11-16T20:56:26.737788+0000","last_peered":"2020-11-16T20:56:26.737788+0000","last_clean":"2020-11-16T20:56:26.737788+0000","last_became_active":"2020-11-16T20:55:30.827526+0000","last_became_peered":"2020-11-16T20:55:30.827526+0000","last_unstale":"2020-11-16T20:56:26.737788+0000","last_undegraded":"2020-11-16T20:56:26.737788+0000","last_fullsized":"2020-11-16T20:56:26.737788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":176,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114422485,"num_objects":45,"num_object_clones":5,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":1,"num_read":73,"num_read_kb":51148,"num_write":88,"num_write_kb":14909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":7,"num_flush_kb":20766,"num_evict":0,"num_evict_kb":0,"num_promote":44,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"5","length":"1"},{"start":"e","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"19","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":"68","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-16T20:56:25.742728+0000","last_change":"2020-11-16T20:55:59.645073+0000","last_active":"2020-11-16T20:56:25.742728+0000","last_peered":"2020-11-16T20:56:25.742728+0000","last_clean":"2020-11-16T20:56:25.742728+0000","last_became_active":"2020-11-16T20:55:50.905649+0000","last_became_peered":"2020-11-16T20:55:50.905649+0000","last_unstale":"2020-11-16T20:56:25.742728+0000","last_undegraded":"2020-11-16T20:56:25.742728+0000","last_fullsized":"2020-11-16T20:56:25.742728+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.644996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.644996+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"63'189","reported_seq":"455","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-16T20:56:25.770798+0000","last_change":"2020-11-16T20:56:24.746908+0000","last_active":"2020-11-16T20:56:25.770798+0000","last_peered":"2020-11-16T20:56:25.770798+0000","last_clean":"2020-11-16T20:56:25.770798+0000","last_became_active":"2020-11-16T20:56:16.750108+0000","last_became_peered":"2020-11-16T20:56:16.750108+0000","last_unstale":"2020-11-16T20:56:25.770798+0000","last_undegraded":"2020-11-16T20:56:25.770798+0000","last_fullsized":"2020-11-16T20:56:25.770798+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":189,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":130430044,"num_objects":48,"num_object_clones":4,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":3,"num_read":82,"num_read_kb":52141,"num_write":119,"num_write_kb":26598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":91753326,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":14,"num_flush_kb":40614,"num_evict":0,"num_evict_kb":0,"num_promote":45,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"5","length":"1"},{"start":"e","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"19","length":"1"}]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":479657735,"num_objects":185,"num_object_clones":19,"num_object_copies":555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":7,"num_read":279,"num_read_kb":146804,"num_write":490,"num_write_kb":85981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":91753326,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":66,"num_flush_kb":182447,"num_evict":6,"num_evict_kb":13724,"num_promote":187,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1225527296,"data_stored":1332309775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":866,"ondisk_log_size":866,"up":12,"acting":12,"num_store_stats":7},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":1404076901,"num_objects":516,"num_object_clones":26,"num_object_copies":1548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":516,"num_whiteouts":3,"num_read":1244,"num_read_kb":220841,"num_write":2077,"num_write_kb":854874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2402553856,"data_stored":2439356221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2170,"ondisk_log_size":2170,"up":12,"acting":11,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":18,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":213364,"kb_used_data":206828,"kb_used_omap":0,"kb_used_meta":6528,"kb_avail":94158476,"statfs":{"total":96636764160,"available":96418279424,"internally_reserved":0,"allocated":211791872,"data_stored":226088792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6684672},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.70099999999999996}]},{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.624},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.89700000000000002}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.0840000000000001}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.163},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.054}]},{"osd":4,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.2649999999999999}]},{"osd":5,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":1.369}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.395},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.341}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":675684,"kb_used_data":662364,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":93696156,"statfs":{"total":96636764160,"available":95944863744,"internally_reserved":0,"allocated":678260736,"data_stored":693092052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.3180000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.79000000000000004}]},{"osd":1,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":1.21}]},{"osd":2,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":1.1060000000000001}]},{"osd":3,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.2490000000000001}]},{"osd":4,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.0660000000000001}]},{"osd":5,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.002},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.3939999999999999}]},{"osd":7,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.343}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261672,"kb_used_data":250528,"kb_used_omap":0,"kb_used_meta":11136,"kb_avail":94110168,"statfs":{"total":96636764160,"available":96368812032,"internally_reserved":0,"allocated":256540672,"data_stored":273457828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11403264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.84199999999999997}]},{"osd":2,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.497}]},{"osd":3,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.677,"5min":2.677,"15min":2.677},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.73599999999999999}]},{"osd":4,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.81499999999999995}]},{"osd":5,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":0.995},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":0.79400000000000004}]},{"osd":6,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.129},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.083}]},{"osd":7,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"max":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":1.042},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.016}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":636660,"kb_used_data":622004,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":93735180,"statfs":{"total":96636764160,"available":95984824320,"internally_reserved":0,"allocated":636932096,"data_stored":657360754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":1.6859999999999999}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.4099999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":1.5800000000000001}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":1.3819999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.756}]},{"osd":4,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":3.3100000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.74}]},{"osd":5,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.617},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":2.0750000000000002}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":2.1400000000000001},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":2.5670000000000002}]},{"osd":7,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"max":{"1min":1.954,"5min":1.954,"15min":1.954},"last":2.2770000000000001},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.8580000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":175344,"kb_used_data":169128,"kb_used_omap":0,"kb_used_meta":6208,"kb_avail":94196496,"statfs":{"total":96636764160,"available":96457211904,"internally_reserved":0,"allocated":173187072,"data_stored":174452056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6356992},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.67300000000000004}]},{"osd":1,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.80600000000000005}]},{"osd":3,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.96099999999999997}]},{"osd":4,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.274},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.3360000000000001}]},{"osd":5,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.90000000000000002}]},{"osd":6,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.143},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.4219999999999999}]},{"osd":7,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.21}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":613148,"kb_used_data":600084,"kb_used_omap":0,"kb_used_meta":13056,"kb_avail":93758692,"statfs":{"total":96636764160,"available":96008900608,"internally_reserved":0,"allocated":614486016,"data_stored":635694497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13369344},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.93200000000000005}]},{"osd":1,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.1850000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":1.0600000000000001}]},{"osd":2,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.127}]},{"osd":4,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.923,"5min":2.923,"15min":2.923},"last":1.359},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.968,"5min":2.968,"15min":2.968},"last":1.851}]},{"osd":5,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.8479999999999999,"5min":2.8479999999999999,"15min":2.8479999999999999},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.405}]},{"osd":6,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.859,"5min":2.859,"15min":2.859},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":3.5390000000000001,"5min":3.5390000000000001,"15min":3.5390000000000001},"last":1.694}]},{"osd":7,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.327},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.9780000000000002,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":1.5169999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":602684,"kb_used_data":589492,"kb_used_omap":0,"kb_used_meta":13184,"kb_avail":93769156,"statfs":{"total":96636764160,"available":96019615744,"internally_reserved":0,"allocated":603639808,"data_stored":628177292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13500416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.095}]},{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.84099999999999997}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.002},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.81000000000000005}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.78000000000000003}]},{"osd":5,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.871}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":0.97299999999999998}]},{"osd":7,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":2.4369999999999998,"5min":2.4369999999999998,"15min":2.4369999999999998},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.91300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397032,"kb_used_data":384608,"kb_used_omap":0,"kb_used_meta":12416,"kb_avail":93974808,"statfs":{"total":96636764160,"available":96230203392,"internally_reserved":0,"allocated":393838592,"data_stored":420345732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12713984},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":2.1619999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.93799999999999994}]},{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.97099999999999997}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.77600000000000002}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":1.0649999999999999}]},{"osd":4,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.878}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.4910000000000001}]},{"osd":7,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":1.107,"5min":1.107,"15min":1.107},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.214}]}]}]}} 2020-11-16T20:56:31.688 INFO:tasks.thrashosds.thrasher:Setting 2.4 to [7, 1, 3, 6, 2, 4] 2020-11-16T20:56:31.688 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '2.4', '7', '1', '3', '6', '2', '4'] 2020-11-16T20:56:31.688 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 2.4 7 1 3 6 2 4 2020-11-16T20:56:31.717 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:31.722+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:31.738 INFO:tasks.rados.rados.0.smithi166.stdout:730: done (0 left) 2020-11-16T20:56:31.738 INFO:tasks.rados.rados.0.smithi166.stdout:731: write (excl) oid 284 current snap is 18 2020-11-16T20:56:31.738 INFO:tasks.rados.rados.0.smithi166.stdout:731: seq_num 560 ranges {611920=633209,1703328=634848,2812170=507386} 2020-11-16T20:56:31.744 INFO:teuthology.orchestra.run.smithi166.stderr:noscrub is set 2020-11-16T20:56:31.745 INFO:tasks.rados.rados.0.smithi166.stdout:731: writing smithi16641208-284 from 611920 to 1245129 tid 1 2020-11-16T20:56:31.752 INFO:tasks.rados.rados.0.smithi166.stdout:731: writing smithi16641208-284 from 1703328 to 2338176 tid 2 2020-11-16T20:56:31.758 INFO:tasks.rados.rados.0.smithi166.stdout:731: writing smithi16641208-284 from 2812170 to 3319556 tid 3 2020-11-16T20:56:31.758 INFO:tasks.rados.rados.0.smithi166.stdout:732: snap_create 2020-11-16T20:56:31.758 INFO:tasks.rados.rados.0.smithi166.stdout:731: finishing write tid 1 to smithi16641208-284 2020-11-16T20:56:31.778 INFO:tasks.rados.rados.0.smithi166.stdout:731: finishing write tid 2 to smithi16641208-284 2020-11-16T20:56:31.778 INFO:tasks.rados.rados.0.smithi166.stdout:731: finishing write tid 3 to smithi16641208-284 2020-11-16T20:56:31.778 INFO:tasks.rados.rados.0.smithi166.stdout:731: finishing write tid 4 to smithi16641208-284 2020-11-16T20:56:31.779 INFO:tasks.rados.rados.0.smithi166.stdout:731: finishing write tid 5 to smithi16641208-284 2020-11-16T20:56:31.779 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 284 v 562 (ObjNum 560 snap 18 seq_num 560) dirty exists 2020-11-16T20:56:31.779 INFO:tasks.rados.rados.0.smithi166.stdout:731: left oid 284 (ObjNum 560 snap 18 seq_num 560) 2020-11-16T20:56:31.791 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:31.796+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:31.822 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:31.822 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:56:31.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:56:31.823 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:56:31.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.823 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4237.0:1 1.0 1:04475aff:::INTEL_SSDPEDMD400G4_CVFT5330009L400BGN:head [omap-get-keys] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e13)", 2020-11-16T20:56:31.823 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:54:53.099987+0000", 2020-11-16T20:56:31.823 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.726159359999997, 2020-11-16T20:56:31.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013001067999999999, 2020-11-16T20:56:31.824 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.824 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2020-11-16T20:56:31.824 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:31.824 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4237", 2020-11-16T20:56:31.824 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/2773183201", 2020-11-16T20:56:31.824 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1 2020-11-16T20:56:31.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.825 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.099987+0000", 2020-11-16T20:56:31.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.099987+0000", 2020-11-16T20:56:31.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2502000000000001e-05 2020-11-16T20:56:31.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.100029+0000", 2020-11-16T20:56:31.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7090000000000002e-06 2020-11-16T20:56:31.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.100037+0000", 2020-11-16T20:56:31.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4844000000000001e-05 2020-11-16T20:56:31.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.100052+0000", 2020-11-16T20:56:31.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4450000000000002e-06 2020-11-16T20:56:31.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.100061+0000", 2020-11-16T20:56:31.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026660600000000002 2020-11-16T20:56:31.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.100328+0000", 2020-11-16T20:56:31.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7116e-05 2020-11-16T20:56:31.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for peered", 2020-11-16T20:56:31.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.100345+0000", 2020-11-16T20:56:31.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012477217000000001 2020-11-16T20:56:31.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.112822+0000", 2020-11-16T20:56:31.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016562900000000001 2020-11-16T20:56:31.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.112988+0000", 2020-11-16T20:56:31.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013001067999999999 2020-11-16T20:56:31.831 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.831 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.832 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.832 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:4 4.3 e33/22 4:fc3a32b3:::smithi16641208-6:head v 33'4, mlcod=33'2)", 2020-11-16T20:56:31.832 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:50.981105+0000", 2020-11-16T20:56:31.832 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 40.845041033000001, 2020-11-16T20:56:31.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011093057, 2020-11-16T20:56:31.833 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.833 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.833 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.981105+0000", 2020-11-16T20:56:31.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.981105+0000", 2020-11-16T20:56:31.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0021703450000000002 2020-11-16T20:56:31.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983276+0000", 2020-11-16T20:56:31.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3770000000000002e-06 2020-11-16T20:56:31.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983285+0000", 2020-11-16T20:56:31.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3261999999999999e-05 2020-11-16T20:56:31.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983298+0000", 2020-11-16T20:56:31.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4188999999999999e-05 2020-11-16T20:56:31.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983312+0000", 2020-11-16T20:56:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8090999999999997e-05 2020-11-16T20:56:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983360+0000", 2020-11-16T20:56:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2870999999999998e-05 2020-11-16T20:56:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.983383+0000", 2020-11-16T20:56:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0087614010000000003 2020-11-16T20:56:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.992145+0000", 2020-11-16T20:56:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3520999999999998e-05 2020-11-16T20:56:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:50.992198+0000", 2020-11-16T20:56:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011093057 2020-11-16T20:56:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:280 4.3 e35/22 4:c9fee0b4:::smithi16641208-235:head v 35'58, mlcod=35'56)", 2020-11-16T20:56:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.763935+0000", 2020-11-16T20:56:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 37.062210925000002, 2020-11-16T20:56:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013791523, 2020-11-16T20:56:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.763935+0000", 2020-11-16T20:56:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.763935+0000", 2020-11-16T20:56:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0042676880000000004 2020-11-16T20:56:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768203+0000", 2020-11-16T20:56:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7779999999999996e-06 2020-11-16T20:56:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768212+0000", 2020-11-16T20:56:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1191e-05 2020-11-16T20:56:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768223+0000", 2020-11-16T20:56:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.148e-06 2020-11-16T20:56:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768230+0000", 2020-11-16T20:56:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9489e-05 2020-11-16T20:56:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768280+0000", 2020-11-16T20:56:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9222e-05 2020-11-16T20:56:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768299+0000", 2020-11-16T20:56:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0093848479999999995 2020-11-16T20:56:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.777684+0000", 2020-11-16T20:56:31.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3158999999999998e-05 2020-11-16T20:56:31.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.777727+0000", 2020-11-16T20:56:31.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013791523 2020-11-16T20:56:31.848 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.848 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.848 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.848 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:1058 4.3 e35/22 4:c9fee0b4:::smithi16641208-235:head v 35'59, mlcod=35'56)", 2020-11-16T20:56:31.849 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.768272+0000", 2020-11-16T20:56:31.849 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 37.057874327, 2020-11-16T20:56:31.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011567512, 2020-11-16T20:56:31.849 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.849 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.849 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768272+0000", 2020-11-16T20:56:31.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768272+0000", 2020-11-16T20:56:31.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00087617900000000004 2020-11-16T20:56:31.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.769148+0000", 2020-11-16T20:56:31.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7769999999999997e-06 2020-11-16T20:56:31.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.769155+0000", 2020-11-16T20:56:31.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1951e-05 2020-11-16T20:56:31.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.769167+0000", 2020-11-16T20:56:31.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6080000000000001e-06 2020-11-16T20:56:31.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.769173+0000", 2020-11-16T20:56:31.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0022666840000000001 2020-11-16T20:56:31.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.771440+0000", 2020-11-16T20:56:31.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0822999999999999e-05 2020-11-16T20:56:31.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.771471+0000", 2020-11-16T20:56:31.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0083200759999999992 2020-11-16T20:56:31.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.779791+0000", 2020-11-16T20:56:31.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8414000000000001e-05 2020-11-16T20:56:31.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.779839+0000", 2020-11-16T20:56:31.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011567512 2020-11-16T20:56:31.856 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.856 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.856 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.857 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:1059 4.3 e35/22 4:c9fee0b4:::smithi16641208-235:head v 35'60, mlcod=35'56)", 2020-11-16T20:56:31.857 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.769209+0000", 2020-11-16T20:56:31.857 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 37.056937421000001, 2020-11-16T20:56:31.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010670076000000001, 2020-11-16T20:56:31.857 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.857 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.857 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.769209+0000", 2020-11-16T20:56:31.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.769209+0000", 2020-11-16T20:56:31.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4997000000000003e-05 2020-11-16T20:56:31.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.769254+0000", 2020-11-16T20:56:31.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6109999999999999e-06 2020-11-16T20:56:31.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.769260+0000", 2020-11-16T20:56:31.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4048000000000001e-05 2020-11-16T20:56:31.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.769284+0000", 2020-11-16T20:56:31.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.242e-06 2020-11-16T20:56:31.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.769290+0000", 2020-11-16T20:56:31.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0030006439999999998 2020-11-16T20:56:31.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.772290+0000", 2020-11-16T20:56:31.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7189000000000001e-05 2020-11-16T20:56:31.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.772308+0000", 2020-11-16T20:56:31.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0075352120000000003 2020-11-16T20:56:31.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.779843+0000", 2020-11-16T20:56:31.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6133000000000001e-05 2020-11-16T20:56:31.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.779879+0000", 2020-11-16T20:56:31.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010670076000000001 2020-11-16T20:56:31.864 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.864 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.864 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.865 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:286 4.3 e35/22 4:d76da88a:::smithi16641208-241:head v 35'61, mlcod=35'59)", 2020-11-16T20:56:31.865 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.874677+0000", 2020-11-16T20:56:31.865 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 36.951468882999997, 2020-11-16T20:56:31.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01129728, 2020-11-16T20:56:31.865 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.865 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.865 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.874677+0000", 2020-11-16T20:56:31.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.874677+0000", 2020-11-16T20:56:31.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0037049460000000002 2020-11-16T20:56:31.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.878382+0000", 2020-11-16T20:56:31.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6219999999999998e-06 2020-11-16T20:56:31.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.878391+0000", 2020-11-16T20:56:31.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2730000000000002e-06 2020-11-16T20:56:31.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.878399+0000", 2020-11-16T20:56:31.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3509999999999996e-06 2020-11-16T20:56:31.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.878407+0000", 2020-11-16T20:56:31.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8167999999999997e-05 2020-11-16T20:56:31.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.878455+0000", 2020-11-16T20:56:31.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4728000000000001e-05 2020-11-16T20:56:31.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.878479+0000", 2020-11-16T20:56:31.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074377230000000003 2020-11-16T20:56:31.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.885917+0000", 2020-11-16T20:56:31.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7469000000000002e-05 2020-11-16T20:56:31.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.885975+0000", 2020-11-16T20:56:31.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01129728 2020-11-16T20:56:31.872 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.872 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.872 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.873 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:288 4.3 e35/22 4:dafe2ce7:::smithi16641208-242:head v 35'63, mlcod=35'61)", 2020-11-16T20:56:31.873 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.896675+0000", 2020-11-16T20:56:31.873 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 36.929471290999999, 2020-11-16T20:56:31.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010032602999999999, 2020-11-16T20:56:31.873 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.873 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.874 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.896675+0000", 2020-11-16T20:56:31.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.896675+0000", 2020-11-16T20:56:31.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003212356 2020-11-16T20:56:31.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.899887+0000", 2020-11-16T20:56:31.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0545e-05 2020-11-16T20:56:31.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.899898+0000", 2020-11-16T20:56:31.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7331999999999999e-05 2020-11-16T20:56:31.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.899915+0000", 2020-11-16T20:56:31.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.08e-05 2020-11-16T20:56:31.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.899926+0000", 2020-11-16T20:56:31.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8739999999999997e-05 2020-11-16T20:56:31.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.899985+0000", 2020-11-16T20:56:31.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5568e-05 2020-11-16T20:56:31.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.900010+0000", 2020-11-16T20:56:31.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0066311709999999999 2020-11-16T20:56:31.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.906641+0000", 2020-11-16T20:56:31.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6091000000000001e-05 2020-11-16T20:56:31.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.906708+0000", 2020-11-16T20:56:31.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010032602999999999 2020-11-16T20:56:31.880 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.880 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.881 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.881 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:361 4.3 e36/22 4:c982201a:::smithi16641208-344:head v 36'68, mlcod=35'66)", 2020-11-16T20:56:31.881 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:56.539838+0000", 2020-11-16T20:56:31.881 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 35.286308036999998, 2020-11-16T20:56:31.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016918861, 2020-11-16T20:56:31.881 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.882 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.882 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.539838+0000", 2020-11-16T20:56:31.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.539838+0000", 2020-11-16T20:56:31.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0063033710000000003 2020-11-16T20:56:31.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.546142+0000", 2020-11-16T20:56:31.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1715e-05 2020-11-16T20:56:31.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.884 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.546153+0000", 2020-11-16T20:56:31.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0464e-05 2020-11-16T20:56:31.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.885 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.546164+0000", 2020-11-16T20:56:31.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1470000000000001e-06 2020-11-16T20:56:31.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.885 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.546172+0000", 2020-11-16T20:56:31.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8400999999999995e-05 2020-11-16T20:56:31.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.546270+0000", 2020-11-16T20:56:31.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0125999999999999e-05 2020-11-16T20:56:31.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.546300+0000", 2020-11-16T20:56:31.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010385676999999999 2020-11-16T20:56:31.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.556686+0000", 2020-11-16T20:56:31.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0959999999999998e-05 2020-11-16T20:56:31.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.888 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.888 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.556757+0000", 2020-11-16T20:56:31.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016918861 2020-11-16T20:56:31.888 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.888 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.889 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.889 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:537 4.3 e41/22 4:c97658cf:::smithi16641208-283:head v 41'94, mlcod=36'92)", 2020-11-16T20:56:31.889 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:04.013912+0000", 2020-11-16T20:56:31.889 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.812233897999999, 2020-11-16T20:56:31.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011964577000000001, 2020-11-16T20:56:31.890 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.890 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.890 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.890 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.890 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.013912+0000", 2020-11-16T20:56:31.890 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.891 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.891 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.013912+0000", 2020-11-16T20:56:31.891 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00537639 2020-11-16T20:56:31.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.891 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.892 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.019289+0000", 2020-11-16T20:56:31.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8269999999999993e-06 2020-11-16T20:56:31.892 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.892 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.892 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.892 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.019299+0000", 2020-11-16T20:56:31.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2023e-05 2020-11-16T20:56:31.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.893 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.019311+0000", 2020-11-16T20:56:31.893 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7510000000000003e-06 2020-11-16T20:56:31.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.894 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.019320+0000", 2020-11-16T20:56:31.894 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3052e-05 2020-11-16T20:56:31.894 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.894 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.894 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.894 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.019363+0000", 2020-11-16T20:56:31.894 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6609999999999999e-05 2020-11-16T20:56:31.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.895 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.895 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.895 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.019380+0000", 2020-11-16T20:56:31.895 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064317350000000001 2020-11-16T20:56:31.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.895 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.895 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.896 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.025812+0000", 2020-11-16T20:56:31.896 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5189000000000002e-05 2020-11-16T20:56:31.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.896 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.896 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.025877+0000", 2020-11-16T20:56:31.896 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011964577000000001 2020-11-16T20:56:31.897 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.897 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.897 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.897 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.897 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:538 4.3 e41/22 4:c9160c9c:::smithi16641208-411:head v 41'95, mlcod=37'93)", 2020-11-16T20:56:31.897 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:04.125639+0000", 2020-11-16T20:56:31.897 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.700507650999999, 2020-11-16T20:56:31.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017440449, 2020-11-16T20:56:31.898 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.898 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.898 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.898 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.898 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125639+0000", 2020-11-16T20:56:31.899 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.899 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.899 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.899 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125639+0000", 2020-11-16T20:56:31.899 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051874809999999999 2020-11-16T20:56:31.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.899 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.900 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.900 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130826+0000", 2020-11-16T20:56:31.900 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1416999999999999e-05 2020-11-16T20:56:31.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.900 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.900 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.900 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130837+0000", 2020-11-16T20:56:31.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1552999999999999e-05 2020-11-16T20:56:31.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130849+0000", 2020-11-16T20:56:31.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1341e-05 2020-11-16T20:56:31.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.902 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.902 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130860+0000", 2020-11-16T20:56:31.902 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4345000000000006e-05 2020-11-16T20:56:31.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.902 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.902 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130955+0000", 2020-11-16T20:56:31.903 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0686999999999997e-05 2020-11-16T20:56:31.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.903 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.903 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.131015+0000", 2020-11-16T20:56:31.903 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011987345999999999 2020-11-16T20:56:31.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.143003+0000", 2020-11-16T20:56:31.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6279000000000006e-05 2020-11-16T20:56:31.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.143079+0000", 2020-11-16T20:56:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017440449 2020-11-16T20:56:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:539 4.3 e41/22 4:c9160c9c:::smithi16641208-411:6 v 41'96, mlcod=37'93)", 2020-11-16T20:56:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:04.133431+0000", 2020-11-16T20:56:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.692715558, 2020-11-16T20:56:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012154900999999999, 2020-11-16T20:56:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.133431+0000", 2020-11-16T20:56:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.133431+0000", 2020-11-16T20:56:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004504325 2020-11-16T20:56:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.137935+0000", 2020-11-16T20:56:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9359999999999994e-06 2020-11-16T20:56:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.137945+0000", 2020-11-16T20:56:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4032999999999999e-05 2020-11-16T20:56:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.137959+0000", 2020-11-16T20:56:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1919999999999994e-06 2020-11-16T20:56:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.137968+0000", 2020-11-16T20:56:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2193000000000005e-05 2020-11-16T20:56:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.138040+0000", 2020-11-16T20:56:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4004999999999997e-05 2020-11-16T20:56:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.138074+0000", 2020-11-16T20:56:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074481130000000001 2020-11-16T20:56:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.145522+0000", 2020-11-16T20:56:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3103999999999998e-05 2020-11-16T20:56:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.145586+0000", 2020-11-16T20:56:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012154900999999999 2020-11-16T20:56:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:593 4.3 e46/22 4:c5716d1e:::smithi16641208-111:head v 46'121, mlcod=46'118)", 2020-11-16T20:56:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:09.075421+0000", 2020-11-16T20:56:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 22.750724775999998, 2020-11-16T20:56:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015644788999999999, 2020-11-16T20:56:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.915 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.075421+0000", 2020-11-16T20:56:31.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.915 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.915 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.075421+0000", 2020-11-16T20:56:31.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006661335 2020-11-16T20:56:31.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.916 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082083+0000", 2020-11-16T20:56:31.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1031e-05 2020-11-16T20:56:31.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082094+0000", 2020-11-16T20:56:31.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5427999999999999e-05 2020-11-16T20:56:31.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.917 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082109+0000", 2020-11-16T20:56:31.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7580000000000004e-06 2020-11-16T20:56:31.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.918 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082119+0000", 2020-11-16T20:56:31.918 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6067999999999999e-05 2020-11-16T20:56:31.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.919 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082175+0000", 2020-11-16T20:56:31.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4882e-05 2020-11-16T20:56:31.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.919 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.919 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082200+0000", 2020-11-16T20:56:31.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088139840000000004 2020-11-16T20:56:31.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.920 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.920 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.091014+0000", 2020-11-16T20:56:31.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2302999999999997e-05 2020-11-16T20:56:31.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.920 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.921 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.091066+0000", 2020-11-16T20:56:31.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015644788999999999 2020-11-16T20:56:31.921 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.921 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.921 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.921 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.3.0:498 4.0 e47/22 4:3b92f709:::smithi16641208-69:head v 47'94, mlcod=45'91)", 2020-11-16T20:56:31.922 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:10.026793+0000", 2020-11-16T20:56:31.922 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 21.799352984999999, 2020-11-16T20:56:31.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011324136, 2020-11-16T20:56:31.922 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.922 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.922 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.923 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.026793+0000", 2020-11-16T20:56:31.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.923 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.026793+0000", 2020-11-16T20:56:31.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0044730280000000004 2020-11-16T20:56:31.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.031266+0000", 2020-11-16T20:56:31.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3858e-05 2020-11-16T20:56:31.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.031280+0000", 2020-11-16T20:56:31.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.715e-05 2020-11-16T20:56:31.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.925 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.031297+0000", 2020-11-16T20:56:31.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2184999999999999e-05 2020-11-16T20:56:31.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.926 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.031309+0000", 2020-11-16T20:56:31.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1724999999999995e-05 2020-11-16T20:56:31.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.031381+0000", 2020-11-16T20:56:31.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6733e-05 2020-11-16T20:56:31.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.031408+0000", 2020-11-16T20:56:31.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0066279820000000001 2020-11-16T20:56:31.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.038036+0000", 2020-11-16T20:56:31.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1475000000000002e-05 2020-11-16T20:56:31.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.038117+0000", 2020-11-16T20:56:31.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011324136 2020-11-16T20:56:31.929 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.929 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.929 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.930 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:659 4.3 e57/22 4:d5f06b92:::smithi16641208-65:e v 57'176, mlcod=57'172)", 2020-11-16T20:56:31.930 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.759574+0000", 2020-11-16T20:56:31.930 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 12.066572683, 2020-11-16T20:56:31.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011751119000000001, 2020-11-16T20:56:31.930 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.930 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.930 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.931 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759574+0000", 2020-11-16T20:56:31.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.931 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759574+0000", 2020-11-16T20:56:31.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5672e-05 2020-11-16T20:56:31.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759609+0000", 2020-11-16T20:56:31.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1580000000000002e-06 2020-11-16T20:56:31.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.933 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.933 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759615+0000", 2020-11-16T20:56:31.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4220000000000003e-06 2020-11-16T20:56:31.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.933 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.933 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759623+0000", 2020-11-16T20:56:31.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3190000000000002e-06 2020-11-16T20:56:31.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759628+0000", 2020-11-16T20:56:31.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3109000000000003e-05 2020-11-16T20:56:31.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759681+0000", 2020-11-16T20:56:31.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9561000000000001e-05 2020-11-16T20:56:31.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759701+0000", 2020-11-16T20:56:31.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011559477 2020-11-16T20:56:31.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.771260+0000", 2020-11-16T20:56:31.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4400999999999995e-05 2020-11-16T20:56:31.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.771325+0000", 2020-11-16T20:56:31.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011751119000000001 2020-11-16T20:56:31.937 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.937 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.937 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.938 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:660 4.3 e57/22 4:fc3a32b3:::smithi16641208-6:14 v 57'178, mlcod=57'172)", 2020-11-16T20:56:31.938 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.759657+0000", 2020-11-16T20:56:31.938 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 12.066488999000001, 2020-11-16T20:56:31.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011717154, 2020-11-16T20:56:31.938 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.938 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.938 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759657+0000", 2020-11-16T20:56:31.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759657+0000", 2020-11-16T20:56:31.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1059999999999997e-05 2020-11-16T20:56:31.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759688+0000", 2020-11-16T20:56:31.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4467999999999999e-05 2020-11-16T20:56:31.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759703+0000", 2020-11-16T20:56:31.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7870000000000004e-06 2020-11-16T20:56:31.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759710+0000", 2020-11-16T20:56:31.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8199999999999998e-06 2020-11-16T20:56:31.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.942 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759713+0000", 2020-11-16T20:56:31.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0018547539999999999 2020-11-16T20:56:31.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.761568+0000", 2020-11-16T20:56:31.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5524000000000001e-05 2020-11-16T20:56:31.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.761604+0000", 2020-11-16T20:56:31.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0097264959999999994 2020-11-16T20:56:31.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.944 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.771330+0000", 2020-11-16T20:56:31.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4245000000000001e-05 2020-11-16T20:56:31.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.771374+0000", 2020-11-16T20:56:31.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011717154 2020-11-16T20:56:31.945 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.945 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.945 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.946 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:663 4.3 e57/22 4:f65e82cb:::smithi16641208-219:head v 57'179, mlcod=57'176)", 2020-11-16T20:56:31.946 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.796847+0000", 2020-11-16T20:56:31.946 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 12.029299314999999, 2020-11-16T20:56:31.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.053788638999999999, 2020-11-16T20:56:31.946 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.946 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.947 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.947 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.947 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796847+0000", 2020-11-16T20:56:31.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796847+0000", 2020-11-16T20:56:31.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016730294999999999 2020-11-16T20:56:31.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813577+0000", 2020-11-16T20:56:31.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3168e-05 2020-11-16T20:56:31.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813590+0000", 2020-11-16T20:56:31.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.203e-05 2020-11-16T20:56:31.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813602+0000", 2020-11-16T20:56:31.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4837999999999999e-05 2020-11-16T20:56:31.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813617+0000", 2020-11-16T20:56:31.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010021 2020-11-16T20:56:31.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813717+0000", 2020-11-16T20:56:31.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7735000000000003e-05 2020-11-16T20:56:31.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.952 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813765+0000", 2020-11-16T20:56:31.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036802020999999997 2020-11-16T20:56:31.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.952 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.952 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.850567+0000", 2020-11-16T20:56:31.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8342000000000004e-05 2020-11-16T20:56:31.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.953 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.953 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.850636+0000", 2020-11-16T20:56:31.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.053788638999999999 2020-11-16T20:56:31.953 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.953 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.953 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.954 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2589 4.3 e57/22 4:f65e82cb:::smithi16641208-219:head v 57'180, mlcod=57'176)", 2020-11-16T20:56:31.954 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.813687+0000", 2020-11-16T20:56:31.954 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 12.012458863000001, 2020-11-16T20:56:31.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.037630996, 2020-11-16T20:56:31.954 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.955 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.955 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813687+0000", 2020-11-16T20:56:31.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813687+0000", 2020-11-16T20:56:31.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010138436000000001 2020-11-16T20:56:31.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.823826+0000", 2020-11-16T20:56:31.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5939999999999996e-06 2020-11-16T20:56:31.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.823833+0000", 2020-11-16T20:56:31.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8019999999999998e-06 2020-11-16T20:56:31.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.823842+0000", 2020-11-16T20:56:31.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8880000000000002e-06 2020-11-16T20:56:31.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.823848+0000", 2020-11-16T20:56:31.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2058000000000002e-05 2020-11-16T20:56:31.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.823900+0000", 2020-11-16T20:56:31.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0489e-05 2020-11-16T20:56:31.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.823921+0000", 2020-11-16T20:56:31.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027347369 2020-11-16T20:56:31.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851268+0000", 2020-11-16T20:56:31.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0359999999999999e-05 2020-11-16T20:56:31.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851318+0000", 2020-11-16T20:56:31.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.037630996 2020-11-16T20:56:31.961 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.961 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.962 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.962 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2590 4.3 e57/22 4:f65e82cb:::smithi16641208-219:head v 57'181, mlcod=57'176)", 2020-11-16T20:56:31.962 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.823889+0000", 2020-11-16T20:56:31.962 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 12.002257117999999, 2020-11-16T20:56:31.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027470371, 2020-11-16T20:56:31.963 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.963 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.963 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.823889+0000", 2020-11-16T20:56:31.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.823889+0000", 2020-11-16T20:56:31.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030437800000000001 2020-11-16T20:56:31.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824193+0000", 2020-11-16T20:56:31.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7940000000000008e-06 2020-11-16T20:56:31.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824202+0000", 2020-11-16T20:56:31.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1396999999999999e-05 2020-11-16T20:56:31.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824214+0000", 2020-11-16T20:56:31.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2600000000000002e-06 2020-11-16T20:56:31.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824220+0000", 2020-11-16T20:56:31.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023416909999999999 2020-11-16T20:56:31.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.826562+0000", 2020-11-16T20:56:31.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8850999999999999e-05 2020-11-16T20:56:31.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.826590+0000", 2020-11-16T20:56:31.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024730210999999998 2020-11-16T20:56:31.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851321+0000", 2020-11-16T20:56:31.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8788999999999997e-05 2020-11-16T20:56:31.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851359+0000", 2020-11-16T20:56:31.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027470371 2020-11-16T20:56:31.969 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.970 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.970 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.970 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2591 4.3 e57/22 4:f65e82cb:::smithi16641208-219:head v 57'182, mlcod=57'176)", 2020-11-16T20:56:31.970 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.824255+0000", 2020-11-16T20:56:31.970 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 12.001890893000001, 2020-11-16T20:56:31.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027144567000000001, 2020-11-16T20:56:31.971 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.971 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.971 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824255+0000", 2020-11-16T20:56:31.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824255+0000", 2020-11-16T20:56:31.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8541999999999997e-05 2020-11-16T20:56:31.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824304+0000", 2020-11-16T20:56:31.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7320000000000003e-06 2020-11-16T20:56:31.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824310+0000", 2020-11-16T20:56:31.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0047000000000001e-05 2020-11-16T20:56:31.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824320+0000", 2020-11-16T20:56:31.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.279e-06 2020-11-16T20:56:31.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824324+0000", 2020-11-16T20:56:31.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0029814379999999999 2020-11-16T20:56:31.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.827305+0000", 2020-11-16T20:56:31.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8090000000000001e-05 2020-11-16T20:56:31.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.976 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.827323+0000", 2020-11-16T20:56:31.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024037699999999999 2020-11-16T20:56:31.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.976 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851361+0000", 2020-11-16T20:56:31.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8739000000000003e-05 2020-11-16T20:56:31.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851400+0000", 2020-11-16T20:56:31.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027144567000000001 2020-11-16T20:56:31.977 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.978 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.978 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.978 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:667 4.3 e57/22 4:f5f8fa2a:::smithi16641208-144:head v 57'183, mlcod=57'181)", 2020-11-16T20:56:31.978 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.861028+0000", 2020-11-16T20:56:31.978 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.965117969, 2020-11-16T20:56:31.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013994273999999999, 2020-11-16T20:56:31.979 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:31.979 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:31.979 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:31.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:31.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.861028+0000", 2020-11-16T20:56:31.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:31.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:31.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.861028+0000", 2020-11-16T20:56:31.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006986707 2020-11-16T20:56:31.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:31.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.868015+0000", 2020-11-16T20:56:31.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9870000000000005e-06 2020-11-16T20:56:31.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:31.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.868024+0000", 2020-11-16T20:56:31.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3794999999999999e-05 2020-11-16T20:56:31.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:31.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.868038+0000", 2020-11-16T20:56:31.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.268e-06 2020-11-16T20:56:31.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:31.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.868047+0000", 2020-11-16T20:56:31.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5488999999999997e-05 2020-11-16T20:56:31.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:31.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.868102+0000", 2020-11-16T20:56:31.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0601000000000001e-05 2020-11-16T20:56:31.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:31.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.868123+0000", 2020-11-16T20:56:31.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0068583079999999996 2020-11-16T20:56:31.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:31.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.874981+0000", 2020-11-16T20:56:31.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1118999999999997e-05 2020-11-16T20:56:31.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:31.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:31.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:31.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.875023+0000", 2020-11-16T20:56:31.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013994273999999999 2020-11-16T20:56:31.986 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.986 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.986 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.986 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:31.986 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:31.986 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:31.987 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:56:31.988 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:31.992+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:32.088 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:32.092+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:32.093 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:56:32.117 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:32.117 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:32.117 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:56:32.117 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:32.128 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:56:32.189 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:32.194+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:32.238 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:56:32.258 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:56:32.277 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:56:32.289 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:32.294+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:32.297 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:56:32.299 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:32.299 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:32.309 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:56:32.318 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:56:32.339 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:56:32.359 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:56:32.379 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:56:32.380 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:56:32.380 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:56:32.380 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:56:32.381 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:56:32.381 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:56:32.381 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:56:32.381 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:56:32.381 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:56:32.391 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:32.395+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:32.447 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:32.447 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:32.456 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:56:32.500 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:32.504+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:32.583 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:32.583 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:32.592 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:56:32.593 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:32.597+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:32.693 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:32.697+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:32.742 INFO:tasks.rados.rados.0.smithi166.stdout:731: done (1 left) 2020-11-16T20:56:32.742 INFO:tasks.rados.rados.0.smithi166.stdout:732: done (0 left) 2020-11-16T20:56:32.742 INFO:tasks.rados.rados.0.smithi166.stdout:733: write (excl) oid 107 current snap is 19 2020-11-16T20:56:32.742 INFO:tasks.rados.rados.0.smithi166.stdout:733: seq_num 561 ranges {628727=708458,2045457=494859,3123240=305487} 2020-11-16T20:56:32.744 INFO:teuthology.orchestra.run.smithi166.stderr:set 2.4 pg_upmap_items mapping to [7->1,3->6,2->4] 2020-11-16T20:56:32.750 INFO:tasks.rados.rados.0.smithi166.stdout:733: writing smithi16641208-107 from 628727 to 1337185 tid 1 2020-11-16T20:56:32.757 INFO:tasks.rados.rados.0.smithi166.stdout:733: writing smithi16641208-107 from 2045457 to 2540316 tid 2 2020-11-16T20:56:32.763 INFO:tasks.rados.rados.0.smithi166.stdout:733: writing smithi16641208-107 from 3123240 to 3428727 tid 3 2020-11-16T20:56:32.763 INFO:tasks.rados.rados.0.smithi166.stdout:734: read oid 408 snap 16 2020-11-16T20:56:32.763 INFO:tasks.rados.rados.0.smithi166.stdout:734: expect (ObjNum 407 snap 0 seq_num 407) 2020-11-16T20:56:32.764 INFO:tasks.rados.rados.0.smithi166.stdout:735: rollback oid 244 current snap is 19 2020-11-16T20:56:32.764 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 244 to 18 2020-11-16T20:56:32.764 INFO:tasks.rados.rados.0.smithi166.stdout:733: finishing write tid 1 to smithi16641208-107 2020-11-16T20:56:32.764 INFO:tasks.rados.rados.0.smithi166.stdout:736: cache_flush oid 441 snap -1 2020-11-16T20:56:32.764 INFO:tasks.rados.rados.0.smithi166.stdout:737: cache_evict oid 124 snap -1 2020-11-16T20:56:32.764 INFO:tasks.rados.rados.0.smithi166.stdout:738: cache_try_flush oid 220 snap -1 2020-11-16T20:56:32.764 INFO:tasks.rados.rados.0.smithi166.stdout:739: cache_evict oid 243 snap -1 2020-11-16T20:56:32.765 INFO:tasks.rados.rados.0.smithi166.stdout:740: cache_flush oid 305 snap -1 2020-11-16T20:56:32.765 INFO:tasks.rados.rados.0.smithi166.stdout:741: cache_flush oid 99 snap -1 2020-11-16T20:56:32.765 INFO:tasks.rados.rados.0.smithi166.stdout:742: read oid 22 snap 16 2020-11-16T20:56:32.765 INFO:tasks.rados.rados.0.smithi166.stdout:742: expect (ObjNum 21 snap 0 seq_num 21) 2020-11-16T20:56:32.765 INFO:tasks.rados.rados.0.smithi166.stdout:743: write (excl) oid 275 current snap is 19 2020-11-16T20:56:32.765 INFO:tasks.rados.rados.0.smithi166.stdout:743: seq_num 562 ranges {645534=783707,2103939=638517,3150663=294871} 2020-11-16T20:56:32.772 INFO:tasks.rados.rados.0.smithi166.stdout:743: writing smithi16641208-275 from 645534 to 1429241 tid 1 2020-11-16T20:56:32.781 INFO:tasks.rados.rados.0.smithi166.stdout:743: writing smithi16641208-275 from 2103939 to 2742456 tid 2 2020-11-16T20:56:32.786 INFO:tasks.rados.rados.0.smithi166.stdout:743: writing smithi16641208-275 from 3150663 to 3445534 tid 3 2020-11-16T20:56:32.786 INFO:tasks.rados.rados.0.smithi166.stdout:744: rollback oid 162 current snap is 19 2020-11-16T20:56:32.786 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 162 to 16 2020-11-16T20:56:32.786 INFO:tasks.rados.rados.0.smithi166.stdout:745: read oid 381 snap 16 2020-11-16T20:56:32.786 INFO:tasks.rados.rados.0.smithi166.stdout:745: expect (ObjNum 380 snap 0 seq_num 380) 2020-11-16T20:56:32.787 INFO:tasks.rados.rados.0.smithi166.stdout:746: rollback oid 38 current snap is 19 2020-11-16T20:56:32.787 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 38 to 9 2020-11-16T20:56:32.787 INFO:tasks.rados.rados.0.smithi166.stdout:738: got (2) No such file or directory 2020-11-16T20:56:32.787 INFO:tasks.rados.rados.0.smithi166.stdout:741: got (2) No such file or directory 2020-11-16T20:56:32.787 INFO:tasks.rados.rados.0.smithi166.stdout:735: finishing rollback tid 0 to smithi16641208-244 2020-11-16T20:56:32.787 INFO:tasks.rados.rados.0.smithi166.stdout:737: got (16) Device or resource busy 2020-11-16T20:56:32.787 INFO:tasks.rados.rados.0.smithi166.stdout:739: got (16) Device or resource busy 2020-11-16T20:56:32.788 INFO:tasks.rados.rados.0.smithi166.stdout:735: finishing rollback tid 1 to smithi16641208-244 2020-11-16T20:56:32.788 INFO:tasks.rados.rados.0.smithi166.stdout:735: finishing rollback tid 2 to smithi16641208-244 2020-11-16T20:56:32.788 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 244 v 497 (ObjNum 243 snap 0 seq_num 243) dirty exists 2020-11-16T20:56:32.788 INFO:tasks.rados.rados.0.smithi166.stdout:742: expect (ObjNum 21 snap 0 seq_num 21) 2020-11-16T20:56:32.788 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:32.789 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:32.794 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:32.798+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:32.807 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:56:32.884 INFO:tasks.rados.rados.0.smithi166.stdout:734: expect (ObjNum 407 snap 0 seq_num 407) 2020-11-16T20:56:32.894 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:32.898+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:32.980 INFO:tasks.rados.rados.0.smithi166.stdout:743: finishing write tid 1 to smithi16641208-275 2020-11-16T20:56:32.980 INFO:tasks.rados.rados.0.smithi166.stdout:744: finishing rollback tid 0 to smithi16641208-162 2020-11-16T20:56:32.980 INFO:tasks.rados.rados.0.smithi166.stdout:745: expect (ObjNum 380 snap 0 seq_num 380) 2020-11-16T20:56:32.987 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:32.987 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:32.996 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:33.000+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:32.997 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:56:33.057 INFO:tasks.rados.rados.0.smithi166.stdout:736: got (0) Success 2020-11-16T20:56:33.057 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 441 v 0 (ObjNum 440 snap 0 seq_num 440) dirty exists 2020-11-16T20:56:33.057 INFO:tasks.rados.rados.0.smithi166.stdout:746: finishing rollback tid 0 to smithi16641208-38 2020-11-16T20:56:33.057 INFO:tasks.rados.rados.0.smithi166.stdout:740: got (0) Success 2020-11-16T20:56:33.057 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 305 v 0 (ObjNum 549 snap 13 seq_num 549) dirty exists 2020-11-16T20:56:33.058 INFO:tasks.rados.rados.0.smithi166.stdout:734: done (13 left) 2020-11-16T20:56:33.058 INFO:tasks.rados.rados.0.smithi166.stdout:735: done (12 left) 2020-11-16T20:56:33.058 INFO:tasks.rados.rados.0.smithi166.stdout:736: done (11 left) 2020-11-16T20:56:33.058 INFO:tasks.rados.rados.0.smithi166.stdout:737: done (10 left) 2020-11-16T20:56:33.058 INFO:tasks.rados.rados.0.smithi166.stdout:738: done (9 left) 2020-11-16T20:56:33.058 INFO:tasks.rados.rados.0.smithi166.stdout:739: done (8 left) 2020-11-16T20:56:33.058 INFO:tasks.rados.rados.0.smithi166.stdout:740: done (7 left) 2020-11-16T20:56:33.059 INFO:tasks.rados.rados.0.smithi166.stdout:741: done (6 left) 2020-11-16T20:56:33.059 INFO:tasks.rados.rados.0.smithi166.stdout:742: done (5 left) 2020-11-16T20:56:33.059 INFO:tasks.rados.rados.0.smithi166.stdout:745: done (4 left) 2020-11-16T20:56:33.059 INFO:tasks.rados.rados.0.smithi166.stdout:747: cache_flush oid 386 snap 17 2020-11-16T20:56:33.059 INFO:tasks.rados.rados.0.smithi166.stdout:733: finishing write tid 2 to smithi16641208-107 2020-11-16T20:56:33.059 INFO:tasks.rados.rados.0.smithi166.stdout:733: finishing write tid 3 to smithi16641208-107 2020-11-16T20:56:33.059 INFO:tasks.rados.rados.0.smithi166.stdout:733: finishing write tid 4 to smithi16641208-107 2020-11-16T20:56:33.059 INFO:tasks.rados.rados.0.smithi166.stdout:733: finishing write tid 5 to smithi16641208-107 2020-11-16T20:56:33.060 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 107 v 565 (ObjNum 561 snap 19 seq_num 561) dirty exists 2020-11-16T20:56:33.060 INFO:tasks.rados.rados.0.smithi166.stdout:733: left oid 107 (ObjNum 561 snap 19 seq_num 561) 2020-11-16T20:56:33.060 INFO:tasks.rados.rados.0.smithi166.stdout:743: finishing write tid 2 to smithi16641208-275 2020-11-16T20:56:33.060 INFO:tasks.rados.rados.0.smithi166.stdout:743: finishing write tid 3 to smithi16641208-275 2020-11-16T20:56:33.060 INFO:tasks.rados.rados.0.smithi166.stdout:743: finishing write tid 4 to smithi16641208-275 2020-11-16T20:56:33.060 INFO:tasks.rados.rados.0.smithi166.stdout:743: finishing write tid 5 to smithi16641208-275 2020-11-16T20:56:33.060 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 275 v 627 (ObjNum 562 snap 19 seq_num 562) dirty exists 2020-11-16T20:56:33.061 INFO:tasks.rados.rados.0.smithi166.stdout:743: left oid 275 (ObjNum 562 snap 19 seq_num 562) 2020-11-16T20:56:33.061 INFO:tasks.rados.rados.0.smithi166.stdout:746: finishing rollback tid 1 to smithi16641208-38 2020-11-16T20:56:33.061 INFO:tasks.rados.rados.0.smithi166.stdout:746: finishing rollback tid 2 to smithi16641208-38 2020-11-16T20:56:33.061 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 38 v 537 (ObjNum 37 snap 0 seq_num 37) dirty exists 2020-11-16T20:56:33.061 INFO:tasks.rados.rados.0.smithi166.stdout:733: done (4 left) 2020-11-16T20:56:33.061 INFO:tasks.rados.rados.0.smithi166.stdout:743: done (3 left) 2020-11-16T20:56:33.061 INFO:tasks.rados.rados.0.smithi166.stdout:746: done (2 left) 2020-11-16T20:56:33.062 INFO:tasks.rados.rados.0.smithi166.stdout:748: cache_evict oid 417 snap -1 2020-11-16T20:56:33.062 INFO:tasks.rados.rados.0.smithi166.stdout:744: finishing rollback tid 1 to smithi16641208-162 2020-11-16T20:56:33.062 INFO:tasks.rados.rados.0.smithi166.stdout:744: finishing rollback tid 2 to smithi16641208-162 2020-11-16T20:56:33.062 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 162 v 629 (ObjNum 161 snap 0 seq_num 161) dirty exists 2020-11-16T20:56:33.062 INFO:tasks.rados.rados.0.smithi166.stdout:744: done (2 left) 2020-11-16T20:56:33.062 INFO:tasks.rados.rados.0.smithi166.stdout:749: cache_evict oid 321 snap 9 2020-11-16T20:56:33.062 INFO:tasks.rados.rados.0.smithi166.stdout:750: write (excl) oid 12 current snap is 19 2020-11-16T20:56:33.062 INFO:tasks.rados.rados.0.smithi166.stdout:750: seq_num 563 ranges {662341=575309,1878774=498528,2894439=457555} 2020-11-16T20:56:33.063 INFO:tasks.rados.rados.0.smithi166.stdout:750: writing smithi16641208-12 from 662341 to 1237650 tid 1 2020-11-16T20:56:33.070 INFO:tasks.rados.rados.0.smithi166.stdout:750: writing smithi16641208-12 from 1878774 to 2377302 tid 2 2020-11-16T20:56:33.077 INFO:tasks.rados.rados.0.smithi166.stdout:750: writing smithi16641208-12 from 2894439 to 3351994 tid 3 2020-11-16T20:56:33.077 INFO:tasks.rados.rados.0.smithi166.stdout:751: rollback oid 191 current snap is 19 2020-11-16T20:56:33.077 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 191 to 9 2020-11-16T20:56:33.077 INFO:tasks.rados.rados.0.smithi166.stdout:747: got (2) No such file or directory 2020-11-16T20:56:33.077 INFO:tasks.rados.rados.0.smithi166.stdout:747: done (4 left) 2020-11-16T20:56:33.077 INFO:tasks.rados.rados.0.smithi166.stdout:752: read oid 259 snap -1 2020-11-16T20:56:33.078 INFO:tasks.rados.rados.0.smithi166.stdout:752: expect (ObjNum 258 snap 0 seq_num 258) 2020-11-16T20:56:33.078 INFO:tasks.rados.rados.0.smithi166.stdout:753: write (excl) oid 489 current snap is 19 2020-11-16T20:56:33.078 INFO:tasks.rados.rados.0.smithi166.stdout:748: got (0) Success 2020-11-16T20:56:33.078 INFO:tasks.rados.rados.0.smithi166.stdout:749: got (0) Success 2020-11-16T20:56:33.078 INFO:tasks.rados.rados.0.smithi166.stdout:753: seq_num 564 ranges {679148=650558,1937256=642186,3321862=157286} 2020-11-16T20:56:33.086 INFO:tasks.rados.rados.0.smithi166.stdout:753: writing smithi16641208-489 from 679148 to 1329706 tid 1 2020-11-16T20:56:33.094 INFO:tasks.rados.rados.0.smithi166.stdout:753: writing smithi16641208-489 from 1937256 to 2579442 tid 2 2020-11-16T20:56:33.096 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:33.101+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:33.100 INFO:tasks.rados.rados.0.smithi166.stdout:753: writing smithi16641208-489 from 3321862 to 3479148 tid 3 2020-11-16T20:56:33.101 INFO:tasks.rados.rados.0.smithi166.stdout:748: done (5 left) 2020-11-16T20:56:33.101 INFO:tasks.rados.rados.0.smithi166.stdout:749: done (4 left) 2020-11-16T20:56:33.101 INFO:tasks.rados.rados.0.smithi166.stdout:754: rollback oid 175 current snap is 19 2020-11-16T20:56:33.101 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 175 to 9 2020-11-16T20:56:33.101 INFO:tasks.rados.rados.0.smithi166.stdout:750: finishing write tid 1 to smithi16641208-12 2020-11-16T20:56:33.101 INFO:tasks.rados.rados.0.smithi166.stdout:750: finishing write tid 2 to smithi16641208-12 2020-11-16T20:56:33.102 INFO:tasks.rados.rados.0.smithi166.stdout:750: finishing write tid 3 to smithi16641208-12 2020-11-16T20:56:33.102 INFO:tasks.rados.rados.0.smithi166.stdout:750: finishing write tid 4 to smithi16641208-12 2020-11-16T20:56:33.102 INFO:tasks.rados.rados.0.smithi166.stdout:751: finishing rollback tid 0 to smithi16641208-191 2020-11-16T20:56:33.102 INFO:tasks.rados.rados.0.smithi166.stdout:750: finishing write tid 5 to smithi16641208-12 2020-11-16T20:56:33.102 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 12 v 501 (ObjNum 563 snap 19 seq_num 563) dirty exists 2020-11-16T20:56:33.102 INFO:tasks.rados.rados.0.smithi166.stdout:750: left oid 12 (ObjNum 563 snap 19 seq_num 563) 2020-11-16T20:56:33.102 INFO:tasks.rados.rados.0.smithi166.stdout:752: expect (ObjNum 258 snap 0 seq_num 258) 2020-11-16T20:56:33.182 INFO:tasks.rados.rados.0.smithi166.stdout:753: finishing write tid 1 to smithi16641208-489 2020-11-16T20:56:33.182 INFO:tasks.rados.rados.0.smithi166.stdout:751: finishing rollback tid 1 to smithi16641208-191 2020-11-16T20:56:33.183 INFO:tasks.rados.rados.0.smithi166.stdout:751: finishing rollback tid 2 to smithi16641208-191 2020-11-16T20:56:33.183 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 191 v 636 (ObjNum 190 snap 0 seq_num 190) dirty exists 2020-11-16T20:56:33.183 INFO:tasks.rados.rados.0.smithi166.stdout:754: finishing rollback tid 0 to smithi16641208-175 2020-11-16T20:56:33.183 INFO:tasks.rados.rados.0.smithi166.stdout:750: done (4 left) 2020-11-16T20:56:33.183 INFO:tasks.rados.rados.0.smithi166.stdout:751: done (3 left) 2020-11-16T20:56:33.183 INFO:tasks.rados.rados.0.smithi166.stdout:752: done (2 left) 2020-11-16T20:56:33.183 INFO:tasks.rados.rados.0.smithi166.stdout:755: read oid 314 snap -1 2020-11-16T20:56:33.184 INFO:tasks.rados.rados.0.smithi166.stdout:755: expect (ObjNum 313 snap 0 seq_num 313) 2020-11-16T20:56:33.184 INFO:tasks.rados.rados.0.smithi166.stdout:756: read oid 5 snap 17 2020-11-16T20:56:33.184 INFO:tasks.rados.rados.0.smithi166.stdout:756: expect (ObjNum 4 snap 0 seq_num 4) 2020-11-16T20:56:33.184 INFO:tasks.rados.rados.0.smithi166.stdout:757: rollback oid 101 current snap is 19 2020-11-16T20:56:33.184 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 101 to 17 2020-11-16T20:56:33.184 INFO:tasks.rados.rados.0.smithi166.stdout:754: finishing rollback tid 1 to smithi16641208-175 2020-11-16T20:56:33.184 INFO:tasks.rados.rados.0.smithi166.stdout:754: finishing rollback tid 2 to smithi16641208-175 2020-11-16T20:56:33.185 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 175 v 639 (ObjNum 174 snap 0 seq_num 174) dirty exists 2020-11-16T20:56:33.185 INFO:tasks.rados.rados.0.smithi166.stdout:753: finishing write tid 2 to smithi16641208-489 2020-11-16T20:56:33.185 INFO:tasks.rados.rados.0.smithi166.stdout:753: finishing write tid 3 to smithi16641208-489 2020-11-16T20:56:33.185 INFO:tasks.rados.rados.0.smithi166.stdout:753: finishing write tid 4 to smithi16641208-489 2020-11-16T20:56:33.185 INFO:tasks.rados.rados.0.smithi166.stdout:753: finishing write tid 5 to smithi16641208-489 2020-11-16T20:56:33.185 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 489 v 568 (ObjNum 564 snap 19 seq_num 564) dirty exists 2020-11-16T20:56:33.185 INFO:tasks.rados.rados.0.smithi166.stdout:753: left oid 489 (ObjNum 564 snap 19 seq_num 564) 2020-11-16T20:56:33.185 INFO:tasks.rados.rados.0.smithi166.stdout:753: done (4 left) 2020-11-16T20:56:33.186 INFO:tasks.rados.rados.0.smithi166.stdout:754: done (3 left) 2020-11-16T20:56:33.186 INFO:tasks.rados.rados.0.smithi166.stdout:758: cache_try_flush oid 170 snap -1 2020-11-16T20:56:33.186 INFO:tasks.rados.rados.0.smithi166.stdout:759: cache_evict oid 253 snap -1 2020-11-16T20:56:33.186 INFO:tasks.rados.rados.0.smithi166.stdout:760: read oid 268 snap 18 2020-11-16T20:56:33.186 INFO:tasks.rados.rados.0.smithi166.stdout:760: expect (ObjNum 267 snap 0 seq_num 267) 2020-11-16T20:56:33.186 INFO:tasks.rados.rados.0.smithi166.stdout:761: snap_remove snap 16 2020-11-16T20:56:33.187 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:33.187 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:33.197 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:33.201+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:33.204 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:56:33.298 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:33.303+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:33.369 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:33.369 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:33.378 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:56:33.422 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:33.426+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:33.499 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:33.503+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:33.506 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:33.506 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:33.515 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:56:33.600 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:33.604+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:33.683 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:33.683 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:33.692 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:56:33.701 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:33.706+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:33.760 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2020-11-16T20:56:33.818 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:33.822+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:33.832 INFO:tasks.rados.rados.0.smithi166.stdout:761: done (6 left) 2020-11-16T20:56:33.832 INFO:tasks.rados.rados.0.smithi166.stdout:762: read oid 483 snap -1 2020-11-16T20:56:33.832 INFO:tasks.rados.rados.0.smithi166.stdout:762: expect (ObjNum 537 snap 11 seq_num 537) 2020-11-16T20:56:33.832 INFO:tasks.rados.rados.0.smithi166.stdout:763: cache_evict oid 84 snap -1 2020-11-16T20:56:33.832 INFO:tasks.rados.rados.0.smithi166.stdout:764: cache_try_flush oid 160 snap 18 2020-11-16T20:56:33.832 INFO:tasks.rados.rados.0.smithi166.stdout:765: rollback oid 65 current snap is 19 2020-11-16T20:56:33.833 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 65 to 9 2020-11-16T20:56:33.833 INFO:tasks.rados.rados.0.smithi166.stdout:766: read oid 124 snap -1 2020-11-16T20:56:33.833 INFO:tasks.rados.rados.0.smithi166.stdout:766: expect (ObjNum 538 snap 11 seq_num 538) 2020-11-16T20:56:33.833 INFO:tasks.rados.rados.0.smithi166.stdout:767: write oid 486 current snap is 19 2020-11-16T20:56:33.833 INFO:tasks.rados.rados.0.smithi166.stdout:767: seq_num 565 ranges {695955=725807,1879385=502197,2949285=480099} 2020-11-16T20:56:33.835 INFO:tasks.rados.rados.0.smithi166.stdout:767: writing smithi16641208-486 from 695955 to 1421762 tid 1 2020-11-16T20:56:33.841 INFO:tasks.rados.rados.0.smithi166.stdout:767: writing smithi16641208-486 from 1879385 to 2381582 tid 2 2020-11-16T20:56:33.848 INFO:tasks.rados.rados.0.smithi166.stdout:767: writing smithi16641208-486 from 2949285 to 3429384 tid 3 2020-11-16T20:56:33.848 INFO:tasks.rados.rados.0.smithi166.stdout:768: cache_evict oid 439 snap -1 2020-11-16T20:56:33.848 INFO:tasks.rados.rados.0.smithi166.stdout:769: copy_from oid 75 from oid 158 current snap is 19 2020-11-16T20:56:33.849 INFO:tasks.rados.rados.0.smithi166.stdout:758: got (2) No such file or directory 2020-11-16T20:56:33.849 INFO:tasks.rados.rados.0.smithi166.stdout:758: done (13 left) 2020-11-16T20:56:33.849 INFO:tasks.rados.rados.0.smithi166.stdout:770: write oid 9 current snap is 19 2020-11-16T20:56:33.849 INFO:tasks.rados.rados.0.smithi166.stdout:770: seq_num 566 ranges {712762=401056,1537867=645855,2860355=652407} 2020-11-16T20:56:33.854 INFO:tasks.rados.rados.0.smithi166.stdout:770: writing smithi16641208-9 from 712762 to 1113818 tid 1 2020-11-16T20:56:33.860 INFO:tasks.rados.rados.0.smithi166.stdout:770: writing smithi16641208-9 from 1537867 to 2183722 tid 2 2020-11-16T20:56:33.868 INFO:tasks.rados.rados.0.smithi166.stdout:770: writing smithi16641208-9 from 2860355 to 3512762 tid 3 2020-11-16T20:56:33.869 INFO:tasks.rados.rados.0.smithi166.stdout:771: read oid 26 snap -1 2020-11-16T20:56:33.869 INFO:tasks.rados.rados.0.smithi166.stdout:771: expect (ObjNum 25 snap 0 seq_num 25) 2020-11-16T20:56:33.869 INFO:tasks.rados.rados.0.smithi166.stdout:772: read oid 387 snap -1 2020-11-16T20:56:33.869 INFO:tasks.rados.rados.0.smithi166.stdout:772: expect (ObjNum 386 snap 0 seq_num 386) 2020-11-16T20:56:33.869 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:33.869 INFO:tasks.rados.rados.0.smithi166.stdout:759: got (2) No such file or directory 2020-11-16T20:56:33.869 INFO:tasks.rados.rados.0.smithi166.stdout:759: done (15 left) 2020-11-16T20:56:33.870 INFO:tasks.rados.rados.0.smithi166.stdout:773: copy_from oid 466 from oid 299 current snap is 19 2020-11-16T20:56:33.870 INFO:tasks.rados.rados.0.smithi166.stdout:756: expect (ObjNum 4 snap 0 seq_num 4) 2020-11-16T20:56:33.891 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:33.891 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:33.902 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:56:33.903 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:33.907+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:33.954 INFO:tasks.rados.rados.0.smithi166.stdout:756: done (15 left) 2020-11-16T20:56:33.955 INFO:tasks.rados.rados.0.smithi166.stdout:774: write (excl) oid 181 current snap is 19 2020-11-16T20:56:33.955 INFO:tasks.rados.rados.0.smithi166.stdout:774: seq_num 567 ranges {729569=476305,1996349=505866,3004131=525438} 2020-11-16T20:56:33.961 INFO:tasks.rados.rados.0.smithi166.stdout:774: writing smithi16641208-181 from 729569 to 1205874 tid 1 2020-11-16T20:56:33.969 INFO:tasks.rados.rados.0.smithi166.stdout:774: writing smithi16641208-181 from 1996349 to 2502215 tid 2 2020-11-16T20:56:33.976 INFO:tasks.rados.rados.0.smithi166.stdout:774: writing smithi16641208-181 from 3004131 to 3529569 tid 3 2020-11-16T20:56:33.976 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:33.976 INFO:tasks.rados.rados.0.smithi166.stdout:760: expect (ObjNum 267 snap 0 seq_num 267) 2020-11-16T20:56:34.004 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:34.008+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:34.063 INFO:tasks.rados.rados.0.smithi166.stdout:755: expect (ObjNum 313 snap 0 seq_num 313) 2020-11-16T20:56:34.100 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:34.100 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:34.104 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:34.109+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:34.110 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:56:34.168 INFO:tasks.rados.rados.0.smithi166.stdout:757: finishing rollback tid 0 to smithi16641208-101 2020-11-16T20:56:34.168 INFO:tasks.rados.rados.0.smithi166.stdout:757: finishing rollback tid 1 to smithi16641208-101 2020-11-16T20:56:34.168 INFO:tasks.rados.rados.0.smithi166.stdout:757: finishing rollback tid 2 to smithi16641208-101 2020-11-16T20:56:34.169 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 101 v 638 (ObjNum 522 snap 6 seq_num 522) dirty exists 2020-11-16T20:56:34.169 INFO:tasks.rados.rados.0.smithi166.stdout:764: got (2) No such file or directory 2020-11-16T20:56:34.169 INFO:tasks.rados.rados.0.smithi166.stdout:763: got (2) No such file or directory 2020-11-16T20:56:34.169 INFO:tasks.rados.rados.0.smithi166.stdout:765: finishing rollback tid 0 to smithi16641208-65 2020-11-16T20:56:34.169 INFO:tasks.rados.rados.0.smithi166.stdout:755: done (15 left) 2020-11-16T20:56:34.169 INFO:tasks.rados.rados.0.smithi166.stdout:757: done (14 left) 2020-11-16T20:56:34.169 INFO:tasks.rados.rados.0.smithi166.stdout:760: done (13 left) 2020-11-16T20:56:34.170 INFO:tasks.rados.rados.0.smithi166.stdout:763: done (12 left) 2020-11-16T20:56:34.170 INFO:tasks.rados.rados.0.smithi166.stdout:764: done (11 left) 2020-11-16T20:56:34.170 INFO:tasks.rados.rados.0.smithi166.stdout:775: snap_create 2020-11-16T20:56:34.170 INFO:tasks.rados.rados.0.smithi166.stdout:762: expect (ObjNum 537 snap 11 seq_num 537) 2020-11-16T20:56:34.205 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:34.210+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:34.247 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:34.247 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:34.256 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:56:34.294 INFO:tasks.rados.rados.0.smithi166.stdout:765: finishing rollback tid 1 to smithi16641208-65 2020-11-16T20:56:34.294 INFO:tasks.rados.rados.0.smithi166.stdout:765: finishing rollback tid 2 to smithi16641208-65 2020-11-16T20:56:34.295 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 65 v 571 (ObjNum 64 snap 0 seq_num 64) dirty exists 2020-11-16T20:56:34.295 INFO:tasks.rados.rados.0.smithi166.stdout:768: got (2) No such file or directory 2020-11-16T20:56:34.295 INFO:tasks.rados.rados.0.smithi166.stdout:766: expect (ObjNum 538 snap 11 seq_num 538) 2020-11-16T20:56:34.306 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:34.310+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:34.391 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:56:34.407 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:34.412+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:34.414 INFO:tasks.rados.rados.0.smithi166.stdout:770: finishing write tid 1 to smithi16641208-9 2020-11-16T20:56:34.414 INFO:tasks.rados.rados.0.smithi166.stdout:771: expect (ObjNum 25 snap 0 seq_num 25) 2020-11-16T20:56:34.433 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:34.433 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:34.443 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:56:34.493 INFO:tasks.rados.rados.0.smithi166.stdout:767: finishing write tid 1 to smithi16641208-486 2020-11-16T20:56:34.494 INFO:tasks.rados.rados.0.smithi166.stdout:767: finishing write tid 2 to smithi16641208-486 2020-11-16T20:56:34.494 INFO:tasks.rados.rados.0.smithi166.stdout:767: finishing write tid 3 to smithi16641208-486 2020-11-16T20:56:34.494 INFO:tasks.rados.rados.0.smithi166.stdout:767: finishing write tid 4 to smithi16641208-486 2020-11-16T20:56:34.494 INFO:tasks.rados.rados.0.smithi166.stdout:767: finishing write tid 5 to smithi16641208-486 2020-11-16T20:56:34.494 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 486 v 575 (ObjNum 565 snap 19 seq_num 565) dirty exists 2020-11-16T20:56:34.494 INFO:tasks.rados.rados.0.smithi166.stdout:767: left oid 486 (ObjNum 565 snap 19 seq_num 565) 2020-11-16T20:56:34.494 INFO:tasks.rados.rados.0.smithi166.stdout:770: finishing write tid 2 to smithi16641208-9 2020-11-16T20:56:34.495 INFO:tasks.rados.rados.0.smithi166.stdout:770: finishing write tid 3 to smithi16641208-9 2020-11-16T20:56:34.495 INFO:tasks.rados.rados.0.smithi166.stdout:770: finishing write tid 4 to smithi16641208-9 2020-11-16T20:56:34.495 INFO:tasks.rados.rados.0.smithi166.stdout:770: finishing write tid 5 to smithi16641208-9 2020-11-16T20:56:34.495 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 9 v 643 (ObjNum 566 snap 19 seq_num 566) dirty exists 2020-11-16T20:56:34.495 INFO:tasks.rados.rados.0.smithi166.stdout:770: left oid 9 (ObjNum 566 snap 19 seq_num 566) 2020-11-16T20:56:34.495 INFO:tasks.rados.rados.0.smithi166.stdout:772: expect (ObjNum 386 snap 0 seq_num 386) 2020-11-16T20:56:34.525 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:34.530+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:34.537 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:56:34.557 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:56:34.576 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:56:34.579 INFO:tasks.rados.rados.0.smithi166.stdout:769: finishing copy_from to smithi16641208-75 2020-11-16T20:56:34.579 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 75 v 443 (ObjNum 157 snap 0 seq_num 157) dirty exists 2020-11-16T20:56:34.579 INFO:tasks.rados.rados.0.smithi166.stdout:773: finishing copy_from to smithi16641208-466 2020-11-16T20:56:34.579 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 466 v 259 (ObjNum 298 snap 0 seq_num 298) dirty exists 2020-11-16T20:56:34.579 INFO:tasks.rados.rados.0.smithi166.stdout:769: finishing copy_from racing read to smithi16641208-75 2020-11-16T20:56:34.579 INFO:tasks.rados.rados.0.smithi166.stdout:773: finishing copy_from racing read to smithi16641208-466 2020-11-16T20:56:34.579 INFO:tasks.rados.rados.0.smithi166.stdout:774: finishing write tid 1 to smithi16641208-181 2020-11-16T20:56:34.580 INFO:tasks.rados.rados.0.smithi166.stdout:774: finishing write tid 2 to smithi16641208-181 2020-11-16T20:56:34.580 INFO:tasks.rados.rados.0.smithi166.stdout:774: finishing write tid 3 to smithi16641208-181 2020-11-16T20:56:34.580 INFO:tasks.rados.rados.0.smithi166.stdout:774: finishing write tid 4 to smithi16641208-181 2020-11-16T20:56:34.580 INFO:tasks.rados.rados.0.smithi166.stdout:774: finishing write tid 5 to smithi16641208-181 2020-11-16T20:56:34.580 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 181 v 578 (ObjNum 567 snap 19 seq_num 567) dirty exists 2020-11-16T20:56:34.580 INFO:tasks.rados.rados.0.smithi166.stdout:774: left oid 181 (ObjNum 567 snap 19 seq_num 567) 2020-11-16T20:56:34.596 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:56:34.609 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:34.613+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:34.616 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:56:34.620 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:34.620 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:56:34.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:56:34.621 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:56:34.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.621 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:184 4.1 4:b6545a47:::smithi16641208-46:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:56:34.621 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.503052+0000", 2020-11-16T20:56:34.621 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.120641448000001, 2020-11-16T20:56:34.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032452030999999999, 2020-11-16T20:56:34.622 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:34.622 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:34.622 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:34.622 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:34.622 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:34.622 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 184 2020-11-16T20:56:34.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.623 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:34.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:34.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503052+0000", 2020-11-16T20:56:34.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:34.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:34.624 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503052+0000", 2020-11-16T20:56:34.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7108999999999998e-05 2020-11-16T20:56:34.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:34.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503069+0000", 2020-11-16T20:56:34.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2590000000000001e-06 2020-11-16T20:56:34.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.625 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:34.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503072+0000", 2020-11-16T20:56:34.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3119999999999999e-06 2020-11-16T20:56:34.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:34.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503079+0000", 2020-11-16T20:56:34.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6520000000000002e-06 2020-11-16T20:56:34.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:34.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503081+0000", 2020-11-16T20:56:34.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000263331 2020-11-16T20:56:34.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503345+0000", 2020-11-16T20:56:34.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9370000000000002e-05 2020-11-16T20:56:34.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:34.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503404+0000", 2020-11-16T20:56:34.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016025681999999999 2020-11-16T20:56:34.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.629 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.629 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.629 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519430+0000", 2020-11-16T20:56:34.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114862 2020-11-16T20:56:34.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.629 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:34.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519545+0000", 2020-11-16T20:56:34.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013224174 2020-11-16T20:56:34.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532769+0000", 2020-11-16T20:56:34.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5945000000000006e-05 2020-11-16T20:56:34.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.631 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:34.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532845+0000", 2020-11-16T20:56:34.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0026593350000000001 2020-11-16T20:56:34.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.632 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.632 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:34.632 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.535504+0000", 2020-11-16T20:56:34.632 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032452030999999999 2020-11-16T20:56:34.632 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.632 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:34.632 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.633 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2370 4.1 4:82bb0fe7:::smithi16641208-101:head [write 2346424~426830] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:34.633 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:56:34.633 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.569410224999999, 2020-11-16T20:56:34.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04706581, 2020-11-16T20:56:34.633 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:34.634 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:34.634 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:34.634 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:34.634 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:34.634 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2370 2020-11-16T20:56:34.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.634 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:34.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:34.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:56:34.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:34.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:34.636 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:56:34.636 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011081520000000001 2020-11-16T20:56:34.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:34.636 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055391+0000", 2020-11-16T20:56:34.636 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8289999999999996e-06 2020-11-16T20:56:34.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.637 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.637 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:34.637 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055397+0000", 2020-11-16T20:56:34.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7599999999999997e-06 2020-11-16T20:56:34.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.638 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:34.638 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055407+0000", 2020-11-16T20:56:34.638 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4180000000000002e-06 2020-11-16T20:56:34.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.638 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:34.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055413+0000", 2020-11-16T20:56:34.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1767000000000001e-05 2020-11-16T20:56:34.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055465+0000", 2020-11-16T20:56:34.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1916999999999998e-05 2020-11-16T20:56:34.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:34.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055517+0000", 2020-11-16T20:56:34.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027302192999999999 2020-11-16T20:56:34.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.082819+0000", 2020-11-16T20:56:34.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013272199999999999 2020-11-16T20:56:34.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:34.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.082952+0000", 2020-11-16T20:56:34.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000218574 2020-11-16T20:56:34.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.642 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.642 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:34.642 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083171+0000", 2020-11-16T20:56:34.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016037374 2020-11-16T20:56:34.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.643 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:34.643 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099208+0000", 2020-11-16T20:56:34.643 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001621248 2020-11-16T20:56:34.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.643 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:34.644 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100829+0000", 2020-11-16T20:56:34.644 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039884700000000003 2020-11-16T20:56:34.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.644 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.644 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:34.644 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101228+0000", 2020-11-16T20:56:34.644 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1977000000000006e-05 2020-11-16T20:56:34.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:34.645 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101300+0000", 2020-11-16T20:56:34.645 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9032000000000001e-05 2020-11-16T20:56:34.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.646 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:34.646 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101349+0000", 2020-11-16T20:56:34.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04706581 2020-11-16T20:56:34.646 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.646 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:34.646 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.647 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.647 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2371 4.1 4:82bb0fe7:::smithi16641208-101:head [setxattr _header (57) in=7b,truncate 2773254] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:34.647 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.055441+0000", 2020-11-16T20:56:34.647 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.568252308000002, 2020-11-16T20:56:34.647 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046178253000000002, 2020-11-16T20:56:34.647 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:34.647 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:34.648 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:34.648 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:34.648 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:34.648 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2371 2020-11-16T20:56:34.648 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.648 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:34.648 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.649 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:34.649 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055441+0000", 2020-11-16T20:56:34.649 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:34.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.649 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.649 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:34.649 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055441+0000", 2020-11-16T20:56:34.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4688999999999999e-05 2020-11-16T20:56:34.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:34.650 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055476+0000", 2020-11-16T20:56:34.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8220000000000003e-06 2020-11-16T20:56:34.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.651 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.651 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:34.651 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055482+0000", 2020-11-16T20:56:34.651 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0340000000000002e-06 2020-11-16T20:56:34.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.651 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.651 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:34.652 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055488+0000", 2020-11-16T20:56:34.652 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.49e-06 2020-11-16T20:56:34.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.652 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.652 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:34.652 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055491+0000", 2020-11-16T20:56:34.652 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6255999999999998e-05 2020-11-16T20:56:34.653 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.653 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.653 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.653 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055547+0000", 2020-11-16T20:56:34.653 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6068000000000005e-05 2020-11-16T20:56:34.653 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.653 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.654 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:34.654 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055614+0000", 2020-11-16T20:56:34.654 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.028667674000000001 2020-11-16T20:56:34.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.654 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.654 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.654 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084281+0000", 2020-11-16T20:56:34.655 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000104868 2020-11-16T20:56:34.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.655 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.655 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:34.655 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084386+0000", 2020-11-16T20:56:34.655 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015165799999999999 2020-11-16T20:56:34.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.656 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.656 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:34.656 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084538+0000", 2020-11-16T20:56:34.656 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014678207 2020-11-16T20:56:34.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.656 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.657 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:34.657 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099216+0000", 2020-11-16T20:56:34.657 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0016622550000000001 2020-11-16T20:56:34.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.657 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.657 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:34.657 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100878+0000", 2020-11-16T20:56:34.657 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00061087000000000001 2020-11-16T20:56:34.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.658 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.658 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:34.658 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101489+0000", 2020-11-16T20:56:34.658 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0320000000000004e-05 2020-11-16T20:56:34.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.659 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.659 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:34.659 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101559+0000", 2020-11-16T20:56:34.659 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0041999999999999e-05 2020-11-16T20:56:34.659 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.659 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.659 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:34.659 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101619+0000", 2020-11-16T20:56:34.660 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046178253000000002 2020-11-16T20:56:34.660 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.660 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:34.660 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.660 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.660 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2372 4.1 4:82bb0fe7:::smithi16641208-101:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e42)", 2020-11-16T20:56:34.661 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:56:34.661 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.568181279000001, 2020-11-16T20:56:34.661 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046557016999999999, 2020-11-16T20:56:34.661 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:34.661 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:34.661 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:34.661 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:34.662 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:34.662 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2372 2020-11-16T20:56:34.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.662 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:34.662 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.662 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:34.662 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:56:34.663 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:34.663 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.663 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.663 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:34.663 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:56:34.663 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9907000000000001e-05 2020-11-16T20:56:34.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.664 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.664 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:34.664 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055532+0000", 2020-11-16T20:56:34.664 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0599999999999999e-06 2020-11-16T20:56:34.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.664 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.664 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:34.665 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055535+0000", 2020-11-16T20:56:34.665 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1430000000000003e-06 2020-11-16T20:56:34.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.665 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.665 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:34.665 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055541+0000", 2020-11-16T20:56:34.665 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6819999999999999e-06 2020-11-16T20:56:34.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.666 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.666 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:34.666 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055544+0000", 2020-11-16T20:56:34.666 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000102643 2020-11-16T20:56:34.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.667 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.667 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.667 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055647+0000", 2020-11-16T20:56:34.667 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7197000000000003e-05 2020-11-16T20:56:34.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.667 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.667 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:34.667 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055684+0000", 2020-11-16T20:56:34.668 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029347807 2020-11-16T20:56:34.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.668 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.668 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.668 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.085032+0000", 2020-11-16T20:56:34.668 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6130000000000005e-05 2020-11-16T20:56:34.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.669 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.669 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:34.669 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.085108+0000", 2020-11-16T20:56:34.669 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016542980999999998 2020-11-16T20:56:34.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.669 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.670 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.670 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101651+0000", 2020-11-16T20:56:34.670 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000118733 2020-11-16T20:56:34.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.670 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:34.670 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101769+0000", 2020-11-16T20:56:34.671 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029973400000000001 2020-11-16T20:56:34.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.671 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:34.671 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.102069+0000", 2020-11-16T20:56:34.671 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046557016999999999 2020-11-16T20:56:34.671 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.672 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:34.672 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.672 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.672 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2423 3.3 3:c5716d1e:::smithi16641208-111:head [copy-from ver 265] snapc 7=[7,5] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e46)", 2020-11-16T20:56:34.672 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:09.027460+0000", 2020-11-16T20:56:34.672 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.596233127000001, 2020-11-16T20:56:34.672 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.038337614999999998, 2020-11-16T20:56:34.673 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:34.673 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:34.673 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:34.673 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.673 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:34.673 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027460+0000", 2020-11-16T20:56:34.673 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:34.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.674 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:34.674 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027460+0000", 2020-11-16T20:56:34.674 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4963999999999998e-05 2020-11-16T20:56:34.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:34.675 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027505+0000", 2020-11-16T20:56:34.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.925e-05 2020-11-16T20:56:34.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:34.675 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027525+0000", 2020-11-16T20:56:34.676 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3959e-05 2020-11-16T20:56:34.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.676 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.676 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:34.676 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027539+0000", 2020-11-16T20:56:34.676 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8059999999999997e-06 2020-11-16T20:56:34.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.677 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:34.677 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027545+0000", 2020-11-16T20:56:34.677 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0037794289999999999 2020-11-16T20:56:34.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.677 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031325+0000", 2020-11-16T20:56:34.678 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000127613 2020-11-16T20:56:34.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:34.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031452+0000", 2020-11-16T20:56:34.678 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021049117999999999 2020-11-16T20:56:34.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.679 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:56:34.679 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.052502+0000", 2020-11-16T20:56:34.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012965061 2020-11-16T20:56:34.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.680 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:34.680 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065467+0000", 2020-11-16T20:56:34.680 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9788000000000003e-05 2020-11-16T20:56:34.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.680 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.680 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:34.680 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065536+0000", 2020-11-16T20:56:34.681 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013262699999999999 2020-11-16T20:56:34.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.681 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.681 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:34.681 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065669+0000", 2020-11-16T20:56:34.681 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4404999999999999e-05 2020-11-16T20:56:34.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.682 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.682 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:34.682 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065713+0000", 2020-11-16T20:56:34.682 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4594999999999999e-05 2020-11-16T20:56:34.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.682 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.682 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:34.682 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065798+0000", 2020-11-16T20:56:34.683 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.038337614999999998 2020-11-16T20:56:34.683 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.683 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:34.683 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.684 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:577 3.3 3:c5716d1e:::smithi16641208-111:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e46)", 2020-11-16T20:56:34.684 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:09.027581+0000", 2020-11-16T20:56:34.684 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.596112684000001, 2020-11-16T20:56:34.684 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.038487691999999997, 2020-11-16T20:56:34.684 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:34.684 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:34.684 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:34.685 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.685 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:34.685 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027581+0000", 2020-11-16T20:56:34.685 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:34.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.685 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.685 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:34.686 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027581+0000", 2020-11-16T20:56:34.686 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3422e-05 2020-11-16T20:56:34.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.686 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.686 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:34.686 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027614+0000", 2020-11-16T20:56:34.686 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1710000000000002e-06 2020-11-16T20:56:34.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.687 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.687 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:34.687 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027622+0000", 2020-11-16T20:56:34.687 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2265e-05 2020-11-16T20:56:34.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.687 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.688 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:34.688 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027635+0000", 2020-11-16T20:56:34.688 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4700000000000001e-06 2020-11-16T20:56:34.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.688 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.688 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:34.688 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027640+0000", 2020-11-16T20:56:34.689 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0040006759999999999 2020-11-16T20:56:34.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.689 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.689 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.689 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031641+0000", 2020-11-16T20:56:34.689 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4350000000000006e-05 2020-11-16T20:56:34.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.690 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.690 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:34.690 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031705+0000", 2020-11-16T20:56:34.690 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029225991999999999 2020-11-16T20:56:34.690 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.690 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.691 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.691 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.060931+0000", 2020-11-16T20:56:34.691 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013316099999999999 2020-11-16T20:56:34.691 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.691 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.691 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:34.691 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.061064+0000", 2020-11-16T20:56:34.691 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047860919999999996 2020-11-16T20:56:34.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.692 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.692 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065850+0000", 2020-11-16T20:56:34.692 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1691e-05 2020-11-16T20:56:34.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.693 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:34.693 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065942+0000", 2020-11-16T20:56:34.693 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012640199999999999 2020-11-16T20:56:34.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.693 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:34.694 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.066068+0000", 2020-11-16T20:56:34.694 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.038487691999999997 2020-11-16T20:56:34.694 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.694 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:34.694 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.694 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.695 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:578 3.3 3:c5716d1e:::smithi16641208-111:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e46)", 2020-11-16T20:56:34.695 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:09.027672+0000", 2020-11-16T20:56:34.695 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.596021570000001, 2020-11-16T20:56:34.695 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.043041498999999997, 2020-11-16T20:56:34.695 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:34.695 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:34.695 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:34.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.696 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:34.696 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027672+0000", 2020-11-16T20:56:34.696 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:34.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.696 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:34.697 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027672+0000", 2020-11-16T20:56:34.697 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2234000000000003e-05 2020-11-16T20:56:34.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.697 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.697 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:34.697 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027714+0000", 2020-11-16T20:56:34.697 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5910000000000001e-06 2020-11-16T20:56:34.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.698 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.698 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:34.698 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027721+0000", 2020-11-16T20:56:34.698 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1319e-05 2020-11-16T20:56:34.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.698 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.699 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:34.699 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027732+0000", 2020-11-16T20:56:34.699 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7919999999999998e-06 2020-11-16T20:56:34.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.699 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.699 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:34.699 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027738+0000", 2020-11-16T20:56:34.700 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0040456559999999999 2020-11-16T20:56:34.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.700 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.700 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.700 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031784+0000", 2020-11-16T20:56:34.700 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9271999999999999e-05 2020-11-16T20:56:34.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.701 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.701 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:34.701 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031833+0000", 2020-11-16T20:56:34.701 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029282580999999999 2020-11-16T20:56:34.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.701 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.701 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.702 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.061115+0000", 2020-11-16T20:56:34.702 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6058999999999998e-05 2020-11-16T20:56:34.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.702 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:34.702 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.061191+0000", 2020-11-16T20:56:34.703 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049009099999999996 2020-11-16T20:56:34.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.703 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.703 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.703 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.066092+0000", 2020-11-16T20:56:34.703 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7039999999999995e-05 2020-11-16T20:56:34.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.704 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.704 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:34.704 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.066159+0000", 2020-11-16T20:56:34.704 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045540449999999996 2020-11-16T20:56:34.704 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.704 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.704 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:34.705 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.070713+0000", 2020-11-16T20:56:34.705 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.043041498999999997 2020-11-16T20:56:34.705 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.705 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:34.705 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.705 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.705 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.706 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2427 4.1 4:a1b421f3:::smithi16641208-471:head [cache-flush] snapc 0=[] ondisk+read+ignore_cache+known_if_redirected e47)", 2020-11-16T20:56:34.706 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:10.015762+0000", 2020-11-16T20:56:34.706 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.607931131000001, 2020-11-16T20:56:34.706 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036562619999999997, 2020-11-16T20:56:34.706 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:34.706 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:34.706 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:34.707 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:34.707 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:34.707 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2427 2020-11-16T20:56:34.707 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.707 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:34.707 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.707 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:34.708 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015762+0000", 2020-11-16T20:56:34.708 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:34.708 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.708 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.708 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:34.708 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015762+0000", 2020-11-16T20:56:34.708 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8266999999999999e-05 2020-11-16T20:56:34.709 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.709 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.709 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:34.709 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015791+0000", 2020-11-16T20:56:34.709 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3263e-05 2020-11-16T20:56:34.709 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.709 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.710 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:34.710 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015804+0000", 2020-11-16T20:56:34.710 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1194e-05 2020-11-16T20:56:34.710 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.710 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.710 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:34.711 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015815+0000", 2020-11-16T20:56:34.711 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9799999999999998e-06 2020-11-16T20:56:34.711 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.711 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.711 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:34.711 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015823+0000", 2020-11-16T20:56:34.711 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0092000000000006e-05 2020-11-16T20:56:34.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.712 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.712 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.712 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015893+0000", 2020-11-16T20:56:34.712 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4109999999999996e-06 2020-11-16T20:56:34.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.712 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.712 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2020-11-16T20:56:34.713 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015902+0000", 2020-11-16T20:56:34.713 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0024786610000000001 2020-11-16T20:56:34.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.713 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.713 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.713 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.018380+0000", 2020-11-16T20:56:34.713 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016238599999999999 2020-11-16T20:56:34.714 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.714 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.714 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:34.714 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.018543+0000", 2020-11-16T20:56:34.714 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.033540168000000002 2020-11-16T20:56:34.714 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.715 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.715 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.715 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.052083+0000", 2020-11-16T20:56:34.715 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014603000000000001 2020-11-16T20:56:34.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.715 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.715 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:34.715 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.052229+0000", 2020-11-16T20:56:34.716 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6168000000000005e-05 2020-11-16T20:56:34.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.716 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.716 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:34.716 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.052325+0000", 2020-11-16T20:56:34.716 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036562619999999997 2020-11-16T20:56:34.716 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.717 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:34.717 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.717 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.717 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2502 4.1 4:b0538c7c:::smithi16641208-136:head [write 591745~402925] snapc f=[f,e,d,5] ondisk+write+known_if_redirected e52)", 2020-11-16T20:56:34.717 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.739037+0000", 2020-11-16T20:56:34.718 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.884656414999998, 2020-11-16T20:56:34.718 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.03132149, 2020-11-16T20:56:34.718 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:34.718 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:34.718 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:34.718 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:34.718 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:34.719 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2502 2020-11-16T20:56:34.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.719 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:34.719 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.719 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:34.719 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.739037+0000", 2020-11-16T20:56:34.719 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:34.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.720 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:34.720 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.739037+0000", 2020-11-16T20:56:34.720 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00062637499999999998 2020-11-16T20:56:34.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.721 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:34.721 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.739663+0000", 2020-11-16T20:56:34.721 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2360000000000001e-06 2020-11-16T20:56:34.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.721 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.721 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:34.721 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.739670+0000", 2020-11-16T20:56:34.722 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1943999999999999e-05 2020-11-16T20:56:34.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.722 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.722 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:34.722 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.739682+0000", 2020-11-16T20:56:34.722 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5809999999999999e-06 2020-11-16T20:56:34.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.723 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.723 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:34.723 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.739689+0000", 2020-11-16T20:56:34.723 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1656999999999996e-05 2020-11-16T20:56:34.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.723 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.723 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.724 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.739751+0000", 2020-11-16T20:56:34.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2281e-05 2020-11-16T20:56:34.724 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.724 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.724 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for peered", 2020-11-16T20:56:34.724 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.739763+0000", 2020-11-16T20:56:34.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085813090000000005 2020-11-16T20:56:34.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.725 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.725 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.725 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.748344+0000", 2020-11-16T20:56:34.725 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022008756000000001 2020-11-16T20:56:34.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.725 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:34.726 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.770353+0000", 2020-11-16T20:56:34.726 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3510000000000001e-06 2020-11-16T20:56:34.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.726 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:34.727 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.770359+0000", 2020-11-16T20:56:34.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.03132149 2020-11-16T20:56:34.727 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.727 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:34.727 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.727 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2503 4.1 4:b0538c7c:::smithi16641208-136:head [write 1790337~563515] snapc f=[f,e,d,5] ondisk+write+known_if_redirected e52)", 2020-11-16T20:56:34.728 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:56:34.728 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.876985776000001, 2020-11-16T20:56:34.728 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089724989000000005, 2020-11-16T20:56:34.728 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:34.728 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:34.728 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:34.728 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:34.729 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:34.729 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2503 2020-11-16T20:56:34.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.729 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:34.729 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.729 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:34.729 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:56:34.729 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:34.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.730 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.730 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:34.730 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:56:34.730 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00060419599999999999 2020-11-16T20:56:34.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.731 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:34.731 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747312+0000", 2020-11-16T20:56:34.731 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.319e-06 2020-11-16T20:56:34.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:34.732 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747318+0000", 2020-11-16T20:56:34.732 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5100000000000004e-06 2020-11-16T20:56:34.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.732 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:34.732 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747328+0000", 2020-11-16T20:56:34.733 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6369999999999999e-06 2020-11-16T20:56:34.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.733 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.733 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:34.733 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747335+0000", 2020-11-16T20:56:34.733 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001800479 2020-11-16T20:56:34.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.733 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.734 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.734 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749136+0000", 2020-11-16T20:56:34.734 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7970000000000002e-05 2020-11-16T20:56:34.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.734 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.734 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:34.735 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749194+0000", 2020-11-16T20:56:34.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030847998000000001 2020-11-16T20:56:34.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.735 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.735 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.735 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780042+0000", 2020-11-16T20:56:34.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013142199999999999 2020-11-16T20:56:34.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.736 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.736 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:34.736 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780173+0000", 2020-11-16T20:56:34.736 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022398200000000001 2020-11-16T20:56:34.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.737 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.737 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:56:34.737 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780397+0000", 2020-11-16T20:56:34.737 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061389269999999998 2020-11-16T20:56:34.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.737 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.737 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:34.737 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786536+0000", 2020-11-16T20:56:34.738 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3673999999999998e-05 2020-11-16T20:56:34.738 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.738 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.738 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:34.738 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786630+0000", 2020-11-16T20:56:34.738 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049513384000000001 2020-11-16T20:56:34.738 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.739 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:34.739 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836143+0000", 2020-11-16T20:56:34.739 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4713000000000001e-05 2020-11-16T20:56:34.739 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.740 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:34.740 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836218+0000", 2020-11-16T20:56:34.740 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000214778 2020-11-16T20:56:34.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.740 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.740 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:34.740 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836433+0000", 2020-11-16T20:56:34.740 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089724989000000005 2020-11-16T20:56:34.741 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.741 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:34.741 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.741 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.741 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.741 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2504 4.1 4:b0538c7c:::smithi16641208-136:head [setxattr _header (58) in=7b,truncate 2991745] snapc f=[f,e,d,5] ondisk+write+known_if_redirected e52)", 2020-11-16T20:56:34.742 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:56:34.742 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.876311405999999, 2020-11-16T20:56:34.742 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089341162000000002, 2020-11-16T20:56:34.742 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:34.742 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:34.742 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:34.742 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:34.743 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:34.743 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2504 2020-11-16T20:56:34.743 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.743 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:34.743 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.743 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:34.743 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:56:34.743 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:34.744 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.744 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.744 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:34.744 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:56:34.744 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5520999999999999e-05 2020-11-16T20:56:34.744 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.745 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.745 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:34.745 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747438+0000", 2020-11-16T20:56:34.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2020-11-16T20:56:34.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.745 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.745 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:34.746 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747444+0000", 2020-11-16T20:56:34.746 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.661e-06 2020-11-16T20:56:34.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.746 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:34.746 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747451+0000", 2020-11-16T20:56:34.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6920000000000001e-06 2020-11-16T20:56:34.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.747 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.747 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:34.747 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747456+0000", 2020-11-16T20:56:34.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0017949769999999999 2020-11-16T20:56:34.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749251+0000", 2020-11-16T20:56:34.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114708 2020-11-16T20:56:34.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:34.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749366+0000", 2020-11-16T20:56:34.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032215049000000003 2020-11-16T20:56:34.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.749 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.781581+0000", 2020-11-16T20:56:34.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000181452 2020-11-16T20:56:34.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.750 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.750 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:34.750 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.781762+0000", 2020-11-16T20:56:34.750 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024118300000000001 2020-11-16T20:56:34.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.750 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.751 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:56:34.751 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782003+0000", 2020-11-16T20:56:34.751 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045997939999999999 2020-11-16T20:56:34.751 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.751 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.751 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:34.751 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786603+0000", 2020-11-16T20:56:34.752 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8782000000000002e-05 2020-11-16T20:56:34.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.752 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.752 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:34.752 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786642+0000", 2020-11-16T20:56:34.752 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049869098000000001 2020-11-16T20:56:34.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:34.753 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836511+0000", 2020-11-16T20:56:34.753 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4498000000000005e-05 2020-11-16T20:56:34.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:34.754 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836576+0000", 2020-11-16T20:56:34.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000147615 2020-11-16T20:56:34.754 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.754 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.754 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:34.754 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836723+0000", 2020-11-16T20:56:34.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089341162000000002 2020-11-16T20:56:34.755 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.755 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:34.755 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.755 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2505 4.1 4:b0538c7c:::smithi16641208-136:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e52)", 2020-11-16T20:56:34.756 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:56:34.756 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.876202278000001, 2020-11-16T20:56:34.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089929617000000003, 2020-11-16T20:56:34.756 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:34.756 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:34.756 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:34.756 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:34.757 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:34.757 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2505 2020-11-16T20:56:34.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.757 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:34.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:34.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:56:34.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:34.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:34.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:56:34.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1894999999999999e-05 2020-11-16T20:56:34.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:34.759 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747523+0000", 2020-11-16T20:56:34.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3900000000000003e-06 2020-11-16T20:56:34.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:34.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747527+0000", 2020-11-16T20:56:34.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8169999999999999e-06 2020-11-16T20:56:34.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:34.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747535+0000", 2020-11-16T20:56:34.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6449999999999998e-06 2020-11-16T20:56:34.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.761 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:34.761 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747539+0000", 2020-11-16T20:56:34.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0018868209999999999 2020-11-16T20:56:34.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749426+0000", 2020-11-16T20:56:34.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4963000000000002e-05 2020-11-16T20:56:34.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:34.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749481+0000", 2020-11-16T20:56:34.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032915959000000002 2020-11-16T20:56:34.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782397+0000", 2020-11-16T20:56:34.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018449499999999999 2020-11-16T20:56:34.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:34.764 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782581+0000", 2020-11-16T20:56:34.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054195457000000002 2020-11-16T20:56:34.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836777+0000", 2020-11-16T20:56:34.765 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000214584 2020-11-16T20:56:34.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.765 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:34.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836991+0000", 2020-11-16T20:56:34.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000429591 2020-11-16T20:56:34.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:34.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.837421+0000", 2020-11-16T20:56:34.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089929617000000003 2020-11-16T20:56:34.766 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.767 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:34.767 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.767 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2593 3.3 3:f5f8fa2a:::smithi16641208-144:head [copy-from ver 64] snapc 14=[12,f,5] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e57)", 2020-11-16T20:56:34.767 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:56:34.767 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.837053417, 2020-11-16T20:56:34.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064638111999999998, 2020-11-16T20:56:34.768 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:34.768 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:34.768 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:34.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.768 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:34.768 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:56:34.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:34.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:34.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:56:34.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3655999999999998e-05 2020-11-16T20:56:34.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.770 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:34.770 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786664+0000", 2020-11-16T20:56:34.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1850000000000003e-06 2020-11-16T20:56:34.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.770 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:34.771 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786669+0000", 2020-11-16T20:56:34.771 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0861e-05 2020-11-16T20:56:34.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.771 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:34.771 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786680+0000", 2020-11-16T20:56:34.772 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6749999999999996e-06 2020-11-16T20:56:34.772 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.772 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.772 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:34.772 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786686+0000", 2020-11-16T20:56:34.772 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2327000000000003e-05 2020-11-16T20:56:34.772 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.773 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.773 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786729+0000", 2020-11-16T20:56:34.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000156143 2020-11-16T20:56:34.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.773 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:34.773 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786885+0000", 2020-11-16T20:56:34.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024103846000000002 2020-11-16T20:56:34.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:56:34.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810989+0000", 2020-11-16T20:56:34.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018870436000000001 2020-11-16T20:56:34.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:34.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829859+0000", 2020-11-16T20:56:34.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021210896 2020-11-16T20:56:34.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:34.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851070+0000", 2020-11-16T20:56:34.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3708e-05 2020-11-16T20:56:34.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:34.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851084+0000", 2020-11-16T20:56:34.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7329e-05 2020-11-16T20:56:34.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:34.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851131+0000", 2020-11-16T20:56:34.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014705 2020-11-16T20:56:34.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:34.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851278+0000", 2020-11-16T20:56:34.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064638111999999998 2020-11-16T20:56:34.778 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.778 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:34.778 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.779 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:616 3.3 3:f5f8fa2a:::smithi16641208-144:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e57)", 2020-11-16T20:56:34.779 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:56:34.779 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.836962763000001, 2020-11-16T20:56:34.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064784234999999996, 2020-11-16T20:56:34.779 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:34.779 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:34.780 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:34.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:34.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:56:34.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:34.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:34.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:56:34.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8559999999999998e-05 2020-11-16T20:56:34.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:34.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786749+0000", 2020-11-16T20:56:34.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4549999999999997e-06 2020-11-16T20:56:34.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.782 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:34.782 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786754+0000", 2020-11-16T20:56:34.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4980000000000006e-06 2020-11-16T20:56:34.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.783 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.783 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:34.783 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786762+0000", 2020-11-16T20:56:34.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9790000000000004e-06 2020-11-16T20:56:34.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.783 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.783 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:34.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786766+0000", 2020-11-16T20:56:34.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029976900000000002 2020-11-16T20:56:34.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787066+0000", 2020-11-16T20:56:34.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3581999999999998e-05 2020-11-16T20:56:34.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:34.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787100+0000", 2020-11-16T20:56:34.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.037252078000000001 2020-11-16T20:56:34.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.786 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.786 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824352+0000", 2020-11-16T20:56:34.786 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000124189 2020-11-16T20:56:34.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.786 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:34.787 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824476+0000", 2020-11-16T20:56:34.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026883987000000002 2020-11-16T20:56:34.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.787 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.787 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851360+0000", 2020-11-16T20:56:34.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6365999999999994e-05 2020-11-16T20:56:34.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:34.788 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851426+0000", 2020-11-16T20:56:34.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8771999999999996e-05 2020-11-16T20:56:34.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:34.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851515+0000", 2020-11-16T20:56:34.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064784234999999996 2020-11-16T20:56:34.789 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.789 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:34.789 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.790 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:617 3.3 3:f5f8fa2a:::smithi16641208-144:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e57)", 2020-11-16T20:56:34.790 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:56:34.790 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.836892448, 2020-11-16T20:56:34.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.069756316999999998, 2020-11-16T20:56:34.790 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:34.790 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:34.790 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:34.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.791 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:34.791 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:56:34.791 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:34.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.791 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:34.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:56:34.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3865000000000002e-05 2020-11-16T20:56:34.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:34.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786835+0000", 2020-11-16T20:56:34.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6949999999999999e-06 2020-11-16T20:56:34.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:34.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786840+0000", 2020-11-16T20:56:34.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3559999999999999e-06 2020-11-16T20:56:34.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:34.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786849+0000", 2020-11-16T20:56:34.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.045e-06 2020-11-16T20:56:34.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:34.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786854+0000", 2020-11-16T20:56:34.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026743999999999997 2020-11-16T20:56:34.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.795 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787121+0000", 2020-11-16T20:56:34.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8912000000000001e-05 2020-11-16T20:56:34.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.795 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:34.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787180+0000", 2020-11-16T20:56:34.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.042545010000000001 2020-11-16T20:56:34.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829725+0000", 2020-11-16T20:56:34.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3979000000000003e-05 2020-11-16T20:56:34.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:34.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829819+0000", 2020-11-16T20:56:34.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021745652000000001 2020-11-16T20:56:34.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851565+0000", 2020-11-16T20:56:34.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000102064 2020-11-16T20:56:34.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:34.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851667+0000", 2020-11-16T20:56:34.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048902989999999999 2020-11-16T20:56:34.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:34.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856557+0000", 2020-11-16T20:56:34.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.069756316999999998 2020-11-16T20:56:34.799 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.799 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:34.799 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.800 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:618 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'243, mlcod=57'241)", 2020-11-16T20:56:34.800 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:56:34.800 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.824073324, 2020-11-16T20:56:34.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048895281999999998, 2020-11-16T20:56:34.800 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:34.801 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:34.801 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:34.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:34.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:56:34.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:34.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:34.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:56:34.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017163861999999998 2020-11-16T20:56:34.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:34.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816784+0000", 2020-11-16T20:56:34.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7071e-05 2020-11-16T20:56:34.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:34.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816801+0000", 2020-11-16T20:56:34.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6405e-05 2020-11-16T20:56:34.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:34.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816818+0000", 2020-11-16T20:56:34.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3030999999999999e-05 2020-11-16T20:56:34.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:34.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816831+0000", 2020-11-16T20:56:34.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4610000000000007e-05 2020-11-16T20:56:34.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816895+0000", 2020-11-16T20:56:34.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4202999999999998e-05 2020-11-16T20:56:34.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:34.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816929+0000", 2020-11-16T20:56:34.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.031527016999999997 2020-11-16T20:56:34.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:34.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.848456+0000", 2020-11-16T20:56:34.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9083000000000003e-05 2020-11-16T20:56:34.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:34.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.848515+0000", 2020-11-16T20:56:34.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048895281999999998 2020-11-16T20:56:34.807 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.807 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:34.808 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.808 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:618 3.3 3:d775beee:::smithi16641208-10:head [copy-from ver 12] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:56:34.808 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:56:34.808 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.814891254999999, 2020-11-16T20:56:34.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047870862, 2020-11-16T20:56:34.809 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:34.809 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:34.809 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:34.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:34.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:56:34.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:34.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:34.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:56:34.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0958999999999999e-05 2020-11-16T20:56:34.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:34.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808843+0000", 2020-11-16T20:56:34.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1294000000000001e-05 2020-11-16T20:56:34.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:34.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808854+0000", 2020-11-16T20:56:34.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8553999999999997e-05 2020-11-16T20:56:34.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:34.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808893+0000", 2020-11-16T20:56:34.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1985e-05 2020-11-16T20:56:34.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:34.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808905+0000", 2020-11-16T20:56:34.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7309000000000001e-05 2020-11-16T20:56:34.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808982+0000", 2020-11-16T20:56:34.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016374099999999999 2020-11-16T20:56:34.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:34.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809146+0000", 2020-11-16T20:56:34.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015955815000000002 2020-11-16T20:56:34.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:56:34.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.825102+0000", 2020-11-16T20:56:34.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048434799999999998 2020-11-16T20:56:34.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:34.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829945+0000", 2020-11-16T20:56:34.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021349677000000001 2020-11-16T20:56:34.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:34.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851295+0000", 2020-11-16T20:56:34.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052994100000000001 2020-11-16T20:56:34.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:34.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856594+0000", 2020-11-16T20:56:34.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3349000000000001e-05 2020-11-16T20:56:34.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:34.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856638+0000", 2020-11-16T20:56:34.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5289e-05 2020-11-16T20:56:34.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:34.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856673+0000", 2020-11-16T20:56:34.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047870862 2020-11-16T20:56:34.818 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.818 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:34.818 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.819 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:619 3.3 3:d79d68cf:::smithi16641208-37:head [copy-from ver 27] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:56:34.819 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:56:34.819 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.814332665, 2020-11-16T20:56:34.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047415915000000003, 2020-11-16T20:56:34.819 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:34.819 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:34.820 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:34.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:34.820 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:56:34.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:34.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:34.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:56:34.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3012000000000002e-05 2020-11-16T20:56:34.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:34.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809394+0000", 2020-11-16T20:56:34.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1699999999999996e-06 2020-11-16T20:56:34.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:34.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809399+0000", 2020-11-16T20:56:34.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2390000000000008e-06 2020-11-16T20:56:34.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:34.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809408+0000", 2020-11-16T20:56:34.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0259999999999998e-06 2020-11-16T20:56:34.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:34.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809413+0000", 2020-11-16T20:56:34.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0359999999999996e-05 2020-11-16T20:56:34.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809494+0000", 2020-11-16T20:56:34.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019616600000000001 2020-11-16T20:56:34.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:34.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809690+0000", 2020-11-16T20:56:34.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017673003999999999 2020-11-16T20:56:34.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:56:34.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.827363+0000", 2020-11-16T20:56:34.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006463033 2020-11-16T20:56:34.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:34.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.833826+0000", 2020-11-16T20:56:34.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017479913999999999 2020-11-16T20:56:34.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:34.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851306+0000", 2020-11-16T20:56:34.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054026500000000002 2020-11-16T20:56:34.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:34.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856708+0000", 2020-11-16T20:56:34.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8121999999999999e-05 2020-11-16T20:56:34.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:34.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856747+0000", 2020-11-16T20:56:34.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0219e-05 2020-11-16T20:56:34.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:34.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856777+0000", 2020-11-16T20:56:34.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047415915000000003 2020-11-16T20:56:34.829 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.829 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:34.829 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.830 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2705 4.1 4:b0e01256:::smithi16641208-225:head [copy-from ver 29] snapc 1c=[1c,18,f] ondisk+write+known_if_redirected e63)", 2020-11-16T20:56:34.830 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:25.737789+0000", 2020-11-16T20:56:34.830 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 8.8859045850000005, 2020-11-16T20:56:34.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032698666000000001, 2020-11-16T20:56:34.830 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:34.830 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:34.830 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:34.831 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:34.831 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:34.831 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2705 2020-11-16T20:56:34.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.831 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:34.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:34.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737789+0000", 2020-11-16T20:56:34.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:34.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:34.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737789+0000", 2020-11-16T20:56:34.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5837999999999998e-05 2020-11-16T20:56:34.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:34.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737825+0000", 2020-11-16T20:56:34.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6170000000000001e-06 2020-11-16T20:56:34.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:34.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737832+0000", 2020-11-16T20:56:34.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.609e-05 2020-11-16T20:56:34.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:34.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737848+0000", 2020-11-16T20:56:34.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2239999999999995e-06 2020-11-16T20:56:34.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:34.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737857+0000", 2020-11-16T20:56:34.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1068e-05 2020-11-16T20:56:34.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737908+0000", 2020-11-16T20:56:34.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6070000000000008e-06 2020-11-16T20:56:34.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2020-11-16T20:56:34.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737916+0000", 2020-11-16T20:56:34.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002127337 2020-11-16T20:56:34.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.740044+0000", 2020-11-16T20:56:34.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014206099999999999 2020-11-16T20:56:34.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:34.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.740186+0000", 2020-11-16T20:56:34.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011728739 2020-11-16T20:56:34.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:56:34.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.751914+0000", 2020-11-16T20:56:34.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013621859 2020-11-16T20:56:34.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:34.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.765536+0000", 2020-11-16T20:56:34.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039751899999999999 2020-11-16T20:56:34.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:34.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.765934+0000", 2020-11-16T20:56:34.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0043966359999999998 2020-11-16T20:56:34.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:34.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.770331+0000", 2020-11-16T20:56:34.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6581000000000004e-05 2020-11-16T20:56:34.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:34.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.770407+0000", 2020-11-16T20:56:34.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0489999999999997e-05 2020-11-16T20:56:34.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:34.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.770488+0000", 2020-11-16T20:56:34.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032698666000000001 2020-11-16T20:56:34.842 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.842 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:34.842 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.842 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2706 4.1 4:b0e01256:::smithi16641208-225:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e63)", 2020-11-16T20:56:34.843 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:25.737898+0000", 2020-11-16T20:56:34.843 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 8.8857957699999996, 2020-11-16T20:56:34.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032962285000000001, 2020-11-16T20:56:34.843 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:34.843 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:34.843 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:34.843 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:34.843 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:34.844 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2706 2020-11-16T20:56:34.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.844 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:34.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:34.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737898+0000", 2020-11-16T20:56:34.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:34.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:34.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737898+0000", 2020-11-16T20:56:34.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2438999999999999e-05 2020-11-16T20:56:34.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:34.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737930+0000", 2020-11-16T20:56:34.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0101999999999999e-05 2020-11-16T20:56:34.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:34.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737940+0000", 2020-11-16T20:56:34.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3549999999999994e-06 2020-11-16T20:56:34.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:34.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737950+0000", 2020-11-16T20:56:34.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6650000000000001e-06 2020-11-16T20:56:34.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:34.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737953+0000", 2020-11-16T20:56:34.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9898999999999999e-05 2020-11-16T20:56:34.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737993+0000", 2020-11-16T20:56:34.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6890000000000001e-06 2020-11-16T20:56:34.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:34.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737999+0000", 2020-11-16T20:56:34.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0024181250000000001 2020-11-16T20:56:34.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.740417+0000", 2020-11-16T20:56:34.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1564999999999997e-05 2020-11-16T20:56:34.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:34.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.740489+0000", 2020-11-16T20:56:34.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019766418000000001 2020-11-16T20:56:34.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.760255+0000", 2020-11-16T20:56:34.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015687700000000001 2020-11-16T20:56:34.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:34.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.760412+0000", 2020-11-16T20:56:34.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010128422999999999 2020-11-16T20:56:34.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:34.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.770540+0000", 2020-11-16T20:56:34.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016931800000000001 2020-11-16T20:56:34.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:34.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.770710+0000", 2020-11-16T20:56:34.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015040999999999999 2020-11-16T20:56:34.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:34.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:34.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:34.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.770860+0000", 2020-11-16T20:56:34.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032962285000000001 2020-11-16T20:56:34.854 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.854 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:34.854 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.854 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:34.854 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:34.854 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:34.857 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:56:34.857 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:56:34.858 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:56:34.858 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:56:34.858 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:56:34.858 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:56:34.858 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:56:34.858 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:56:34.858 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:56:34.859 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:56:34.859 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:56:34.859 INFO:tasks.rados.rados.0.smithi166.stdout:762: done (11 left) 2020-11-16T20:56:34.859 INFO:tasks.rados.rados.0.smithi166.stdout:765: done (10 left) 2020-11-16T20:56:34.859 INFO:tasks.rados.rados.0.smithi166.stdout:766: done (9 left) 2020-11-16T20:56:34.859 INFO:tasks.rados.rados.0.smithi166.stdout:767: done (8 left) 2020-11-16T20:56:34.860 INFO:tasks.rados.rados.0.smithi166.stdout:768: done (7 left) 2020-11-16T20:56:34.860 INFO:tasks.rados.rados.0.smithi166.stdout:769: done (6 left) 2020-11-16T20:56:34.860 INFO:tasks.rados.rados.0.smithi166.stdout:770: done (5 left) 2020-11-16T20:56:34.860 INFO:tasks.rados.rados.0.smithi166.stdout:771: done (4 left) 2020-11-16T20:56:34.860 INFO:tasks.rados.rados.0.smithi166.stdout:772: done (3 left) 2020-11-16T20:56:34.860 INFO:tasks.rados.rados.0.smithi166.stdout:773: done (2 left) 2020-11-16T20:56:34.860 INFO:tasks.rados.rados.0.smithi166.stdout:774: done (1 left) 2020-11-16T20:56:34.861 INFO:tasks.rados.rados.0.smithi166.stdout:775: done (0 left) 2020-11-16T20:56:34.861 INFO:tasks.rados.rados.0.smithi166.stdout:776: cache_try_flush oid 261 snap -1 2020-11-16T20:56:34.861 INFO:tasks.rados.rados.0.smithi166.stdout:777: copy_from oid 355 from oid 169 current snap is 20 2020-11-16T20:56:34.861 INFO:tasks.rados.rados.0.smithi166.stdout:778: read oid 32 snap -1 2020-11-16T20:56:34.861 INFO:tasks.rados.rados.0.smithi166.stdout:778: expect (ObjNum 31 snap 0 seq_num 31) 2020-11-16T20:56:34.861 INFO:tasks.rados.rados.0.smithi166.stdout:779: delete oid 129 current snap is 20 2020-11-16T20:56:34.861 INFO:tasks.rados.rados.0.smithi166.stdout:776: got (2) No such file or directory 2020-11-16T20:56:34.861 INFO:tasks.rados.rados.0.smithi166.stdout:776: done (3 left) 2020-11-16T20:56:34.862 INFO:tasks.rados.rados.0.smithi166.stdout:779: done (2 left) 2020-11-16T20:56:34.862 INFO:tasks.rados.rados.0.smithi166.stdout:780: copy_from oid 173 from oid 116 current snap is 20 2020-11-16T20:56:34.862 INFO:tasks.rados.rados.0.smithi166.stdout:781: cache_evict oid 39 snap -1 2020-11-16T20:56:34.862 INFO:tasks.rados.rados.0.smithi166.stdout:782: copy_from oid 187 from oid 283 current snap is 20 2020-11-16T20:56:34.862 INFO:tasks.rados.rados.0.smithi166.stdout:783: snap_create 2020-11-16T20:56:34.862 INFO:tasks.rados.rados.0.smithi166.stdout:781: got (16) Device or resource busy 2020-11-16T20:56:34.862 INFO:tasks.rados.rados.0.smithi166.stdout:778: expect (ObjNum 31 snap 0 seq_num 31) 2020-11-16T20:56:34.863 INFO:tasks.rados.rados.0.smithi166.stdout:777: finishing copy_from to smithi16641208-355 2020-11-16T20:56:34.863 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 355 v 97 (ObjNum 168 snap 0 seq_num 168) dirty exists 2020-11-16T20:56:34.863 INFO:tasks.rados.rados.0.smithi166.stdout:777: finishing copy_from racing read to smithi16641208-355 2020-11-16T20:56:34.863 INFO:tasks.rados.rados.0.smithi166.stdout:782: finishing copy_from to smithi16641208-187 2020-11-16T20:56:34.863 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 187 v 402 (ObjNum 520 snap 6 seq_num 520) dirty exists 2020-11-16T20:56:34.863 INFO:tasks.rados.rados.0.smithi166.stdout:780: finishing copy_from to smithi16641208-173 2020-11-16T20:56:34.863 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 173 v 63 (ObjNum 115 snap 0 seq_num 115) dirty exists 2020-11-16T20:56:34.863 INFO:tasks.rados.rados.0.smithi166.stdout:782: finishing copy_from racing read to smithi16641208-187 2020-11-16T20:56:34.864 INFO:tasks.rados.rados.0.smithi166.stdout:780: finishing copy_from racing read to smithi16641208-173 2020-11-16T20:56:34.864 INFO:teuthology.orchestra.run.smithi166.stderr:nodeep-scrub is set 2020-11-16T20:56:34.864 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:34.860+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:34.865 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:56:34.957 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:34.961+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:35.033 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:35.034 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:35.034 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:56:35.034 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:35.043 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:56:35.057 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:35.062+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:35.158 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:35.163+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:35.218 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:35.218 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:35.218 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:56:35.218 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:56:35.218 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:35.227 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:56:35.260 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:35.264+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:35.360 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:35.365+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:35.363 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:35.363 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:56:35.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:56:35.364 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:56:35.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.364 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:37 4.1 e33/22 4:b6545a47:::smithi16641208-46:head v 33'28, mlcod=33'26)", 2020-11-16T20:56:35.364 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.515282+0000", 2020-11-16T20:56:35.364 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.852104378, 2020-11-16T20:56:35.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016792344000000001, 2020-11-16T20:56:35.365 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:35.365 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:35.365 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:35.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:35.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.515282+0000", 2020-11-16T20:56:35.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:35.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.366 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:35.366 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.515282+0000", 2020-11-16T20:56:35.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0010571840000000001 2020-11-16T20:56:35.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:35.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516339+0000", 2020-11-16T20:56:35.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3354e-05 2020-11-16T20:56:35.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:35.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516352+0000", 2020-11-16T20:56:35.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7071999999999998e-05 2020-11-16T20:56:35.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:35.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516369+0000", 2020-11-16T20:56:35.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1358e-05 2020-11-16T20:56:35.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:35.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516381+0000", 2020-11-16T20:56:35.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5952999999999998e-05 2020-11-16T20:56:35.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:35.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516437+0000", 2020-11-16T20:56:35.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5420999999999998e-05 2020-11-16T20:56:35.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:35.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516472+0000", 2020-11-16T20:56:35.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015544192 2020-11-16T20:56:35.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:35.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532016+0000", 2020-11-16T20:56:35.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7809999999999997e-05 2020-11-16T20:56:35.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:35.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532074+0000", 2020-11-16T20:56:35.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016792344000000001 2020-11-16T20:56:35.372 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.372 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:35.372 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.372 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:39 4.1 e33/22 4:81558809:::smithi16641208-47:head v 33'30, mlcod=33'26)", 2020-11-16T20:56:35.373 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.519956+0000", 2020-11-16T20:56:35.373 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.847430230999997, 2020-11-16T20:56:35.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017898104000000001, 2020-11-16T20:56:35.373 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:35.373 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:35.373 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:35.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:35.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519956+0000", 2020-11-16T20:56:35.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:35.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:35.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519956+0000", 2020-11-16T20:56:35.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00038710900000000001 2020-11-16T20:56:35.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:35.375 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520343+0000", 2020-11-16T20:56:35.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0797e-05 2020-11-16T20:56:35.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:35.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520354+0000", 2020-11-16T20:56:35.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5874000000000001e-05 2020-11-16T20:56:35.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:35.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520370+0000", 2020-11-16T20:56:35.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3580000000000003e-06 2020-11-16T20:56:35.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:35.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520378+0000", 2020-11-16T20:56:35.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5744000000000001e-05 2020-11-16T20:56:35.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:35.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520424+0000", 2020-11-16T20:56:35.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4641e-05 2020-11-16T20:56:35.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:35.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520449+0000", 2020-11-16T20:56:35.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01735014 2020-11-16T20:56:35.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:35.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.537799+0000", 2020-11-16T20:56:35.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5441e-05 2020-11-16T20:56:35.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:35.380 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.537854+0000", 2020-11-16T20:56:35.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017898104000000001 2020-11-16T20:56:35.380 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.380 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:35.380 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.381 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:202 3.2 e35/19 3:5723fd94:::smithi16641208-211:head v 35'124, mlcod=35'121)", 2020-11-16T20:56:35.381 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.980847+0000", 2020-11-16T20:56:35.381 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 40.386539472000003, 2020-11-16T20:56:35.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015747763000000001, 2020-11-16T20:56:35.381 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:35.381 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:35.381 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:35.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.382 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:35.382 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.980847+0000", 2020-11-16T20:56:35.382 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:35.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.382 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:35.382 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.980847+0000", 2020-11-16T20:56:35.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072722660000000003 2020-11-16T20:56:35.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.383 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:35.383 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988119+0000", 2020-11-16T20:56:35.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2539e-05 2020-11-16T20:56:35.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:35.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988132+0000", 2020-11-16T20:56:35.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3723000000000001e-05 2020-11-16T20:56:35.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:35.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988145+0000", 2020-11-16T20:56:35.385 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8379999999999998e-06 2020-11-16T20:56:35.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:35.385 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988151+0000", 2020-11-16T20:56:35.385 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2691000000000002e-05 2020-11-16T20:56:35.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.386 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.386 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:35.386 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988194+0000", 2020-11-16T20:56:35.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8366e-05 2020-11-16T20:56:35.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.386 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.386 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:35.386 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988212+0000", 2020-11-16T20:56:35.387 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0083214259999999998 2020-11-16T20:56:35.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.387 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:35.387 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.996534+0000", 2020-11-16T20:56:35.387 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0914e-05 2020-11-16T20:56:35.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.388 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:35.388 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.996595+0000", 2020-11-16T20:56:35.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015747763000000001 2020-11-16T20:56:35.388 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.388 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:35.388 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.389 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:538 4.3 e41/22 4:c9160c9c:::smithi16641208-411:head v 41'95, mlcod=37'93)", 2020-11-16T20:56:35.389 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:56:35.389 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 31.241740421999999, 2020-11-16T20:56:35.389 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021023377999999999, 2020-11-16T20:56:35.389 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:35.389 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:35.390 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:35.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.390 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:35.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:56:35.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:35.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.391 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.391 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:35.391 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:56:35.391 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052206140000000002 2020-11-16T20:56:35.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.391 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.391 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:35.392 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130866+0000", 2020-11-16T20:56:35.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0824e-05 2020-11-16T20:56:35.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.392 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.392 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:35.392 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130877+0000", 2020-11-16T20:56:35.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5384e-05 2020-11-16T20:56:35.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:35.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130893+0000", 2020-11-16T20:56:35.393 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0064999999999999e-05 2020-11-16T20:56:35.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:35.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130903+0000", 2020-11-16T20:56:35.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3051000000000003e-05 2020-11-16T20:56:35.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:35.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130966+0000", 2020-11-16T20:56:35.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9724e-05 2020-11-16T20:56:35.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.395 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:35.395 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130985+0000", 2020-11-16T20:56:35.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015638332000000001 2020-11-16T20:56:35.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.396 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:35.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.146624+0000", 2020-11-16T20:56:35.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5383999999999998e-05 2020-11-16T20:56:35.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.396 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:35.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.146669+0000", 2020-11-16T20:56:35.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021023377999999999 2020-11-16T20:56:35.397 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.397 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:35.397 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.397 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:547 3.2 e42/19 3:5f250a2b:::smithi16641208-75:head v 42'381, mlcod=42'379)", 2020-11-16T20:56:35.398 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.026221+0000", 2020-11-16T20:56:35.398 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.341164887000001, 2020-11-16T20:56:35.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014398213, 2020-11-16T20:56:35.398 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:35.398 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:35.398 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:35.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:35.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.026221+0000", 2020-11-16T20:56:35.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:35.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:35.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.026221+0000", 2020-11-16T20:56:35.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052355140000000001 2020-11-16T20:56:35.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.400 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:35.400 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031457+0000", 2020-11-16T20:56:35.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3457e-05 2020-11-16T20:56:35.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:35.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031470+0000", 2020-11-16T20:56:35.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6532e-05 2020-11-16T20:56:35.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:35.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031487+0000", 2020-11-16T20:56:35.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6479999999999992e-06 2020-11-16T20:56:35.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:35.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031496+0000", 2020-11-16T20:56:35.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5820000000000003e-05 2020-11-16T20:56:35.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.403 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:35.403 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031561+0000", 2020-11-16T20:56:35.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6701999999999999e-05 2020-11-16T20:56:35.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.403 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:35.403 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031588+0000", 2020-11-16T20:56:35.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089396879999999995 2020-11-16T20:56:35.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.404 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:35.404 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.040528+0000", 2020-11-16T20:56:35.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1852000000000001e-05 2020-11-16T20:56:35.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.405 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:35.405 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.040620+0000", 2020-11-16T20:56:35.405 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014398213 2020-11-16T20:56:35.405 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.405 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:35.405 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.406 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2367 4.2 e42/22 4:581c1e5b:::smithi16641208-124:head v 42'136, mlcod=42'133)", 2020-11-16T20:56:35.406 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:56:35.406 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.314042044000001, 2020-11-16T20:56:35.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021196474999999999, 2020-11-16T20:56:35.406 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:35.406 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:35.407 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:35.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:35.407 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:56:35.407 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:35.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:35.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:56:35.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070663000000000002 2020-11-16T20:56:35.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:35.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060411+0000", 2020-11-16T20:56:35.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0189999999999995e-06 2020-11-16T20:56:35.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.409 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.409 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:35.409 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060420+0000", 2020-11-16T20:56:35.409 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0069e-05 2020-11-16T20:56:35.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.409 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.409 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:35.410 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060430+0000", 2020-11-16T20:56:35.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6879999999999999e-06 2020-11-16T20:56:35.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.410 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:35.410 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060437+0000", 2020-11-16T20:56:35.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3671999999999995e-05 2020-11-16T20:56:35.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:35.411 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060511+0000", 2020-11-16T20:56:35.411 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6801999999999998e-05 2020-11-16T20:56:35.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:35.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060548+0000", 2020-11-16T20:56:35.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013927701000000001 2020-11-16T20:56:35.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:35.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074475+0000", 2020-11-16T20:56:35.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5223999999999998e-05 2020-11-16T20:56:35.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:35.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074541+0000", 2020-11-16T20:56:35.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021196474999999999 2020-11-16T20:56:35.413 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.413 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:35.413 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.414 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:507 4.2 e42/22 4:646fee8a:::smithi16641208-407:head v 42'137, mlcod=42'133)", 2020-11-16T20:56:35.414 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.060496+0000", 2020-11-16T20:56:35.414 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.306890717999998, 2020-11-16T20:56:35.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014098016999999999, 2020-11-16T20:56:35.414 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:35.415 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:35.415 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:35.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.415 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:35.415 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060496+0000", 2020-11-16T20:56:35.415 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:35.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.416 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:35.416 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060496+0000", 2020-11-16T20:56:35.416 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054601980000000003 2020-11-16T20:56:35.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.416 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:35.416 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.065956+0000", 2020-11-16T20:56:35.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0848e-05 2020-11-16T20:56:35.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.417 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:35.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.065967+0000", 2020-11-16T20:56:35.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2801e-05 2020-11-16T20:56:35.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:35.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.065979+0000", 2020-11-16T20:56:35.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0550999999999999e-05 2020-11-16T20:56:35.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:35.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.065990+0000", 2020-11-16T20:56:35.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6890000000000005e-05 2020-11-16T20:56:35.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.419 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:35.419 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.066057+0000", 2020-11-16T20:56:35.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4836000000000001e-05 2020-11-16T20:56:35.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.420 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:35.420 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.066082+0000", 2020-11-16T20:56:35.420 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084662330000000001 2020-11-16T20:56:35.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.420 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:35.420 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074548+0000", 2020-11-16T20:56:35.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.566e-05 2020-11-16T20:56:35.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.421 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:35.421 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074594+0000", 2020-11-16T20:56:35.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014098016999999999 2020-11-16T20:56:35.421 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.422 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:35.422 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.422 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:554 3.2 e42/19 3:769099fd:::smithi16641208-247:head v 42'386, mlcod=42'384)", 2020-11-16T20:56:35.422 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:56:35.422 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.297123071000001, 2020-11-16T20:56:35.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029531213000000001, 2020-11-16T20:56:35.423 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:35.423 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:35.423 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:35.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.423 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:35.423 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:56:35.423 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:35.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:35.424 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:56:35.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007828448 2020-11-16T20:56:35.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:35.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078092+0000", 2020-11-16T20:56:35.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2031000000000001e-05 2020-11-16T20:56:35.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.425 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:35.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078104+0000", 2020-11-16T20:56:35.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3950000000000001e-06 2020-11-16T20:56:35.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:35.426 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078112+0000", 2020-11-16T20:56:35.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.434e-06 2020-11-16T20:56:35.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:35.427 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078117+0000", 2020-11-16T20:56:35.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0217999999999999e-05 2020-11-16T20:56:35.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.427 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:35.427 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078168+0000", 2020-11-16T20:56:35.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6242e-05 2020-11-16T20:56:35.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.428 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:35.428 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078194+0000", 2020-11-16T20:56:35.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021550488 2020-11-16T20:56:35.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.428 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:35.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099744+0000", 2020-11-16T20:56:35.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9957000000000003e-05 2020-11-16T20:56:35.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:35.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099794+0000", 2020-11-16T20:56:35.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029531213000000001 2020-11-16T20:56:35.429 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.430 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:35.430 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.430 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2376 4.2 e42/22 4:540952ab:::smithi16641208-369:head v 42'142, mlcod=42'136)", 2020-11-16T20:56:35.430 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.077213+0000", 2020-11-16T20:56:35.431 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.290172975000001, 2020-11-16T20:56:35.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015666645, 2020-11-16T20:56:35.431 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:35.431 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:35.431 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:35.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:35.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077213+0000", 2020-11-16T20:56:35.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:35.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:35.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077213+0000", 2020-11-16T20:56:35.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9294e-05 2020-11-16T20:56:35.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.433 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:35.433 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077253+0000", 2020-11-16T20:56:35.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6004e-05 2020-11-16T20:56:35.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.433 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:35.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077279+0000", 2020-11-16T20:56:35.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.291e-05 2020-11-16T20:56:35.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:35.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077291+0000", 2020-11-16T20:56:35.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.225e-05 2020-11-16T20:56:35.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:35.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077304+0000", 2020-11-16T20:56:35.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9744e-05 2020-11-16T20:56:35.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:35.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077393+0000", 2020-11-16T20:56:35.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5826e-05 2020-11-16T20:56:35.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.436 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:35.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077419+0000", 2020-11-16T20:56:35.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015403659 2020-11-16T20:56:35.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:35.437 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.092823+0000", 2020-11-16T20:56:35.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6957999999999999e-05 2020-11-16T20:56:35.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:35.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.092880+0000", 2020-11-16T20:56:35.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015666645 2020-11-16T20:56:35.438 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.438 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:35.438 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.438 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:555 3.2 e42/19 3:590e6edd:::smithi16641208-203:head v 42'387, mlcod=42'384)", 2020-11-16T20:56:35.439 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:56:35.439 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.289242226999999, 2020-11-16T20:56:35.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021681786000000002, 2020-11-16T20:56:35.439 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:35.439 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:35.439 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:35.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:35.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:56:35.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:35.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:35.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:56:35.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6817999999999998e-05 2020-11-16T20:56:35.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:35.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078191+0000", 2020-11-16T20:56:35.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7800000000000003e-06 2020-11-16T20:56:35.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:35.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078198+0000", 2020-11-16T20:56:35.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0331e-05 2020-11-16T20:56:35.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:35.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078208+0000", 2020-11-16T20:56:35.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8429999999999998e-06 2020-11-16T20:56:35.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:35.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078214+0000", 2020-11-16T20:56:35.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0025044690000000001 2020-11-16T20:56:35.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:35.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080718+0000", 2020-11-16T20:56:35.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027441100000000001 2020-11-16T20:56:35.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:35.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080993+0000", 2020-11-16T20:56:35.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018806976999999999 2020-11-16T20:56:35.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:35.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099800+0000", 2020-11-16T20:56:35.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6157e-05 2020-11-16T20:56:35.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:35.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099826+0000", 2020-11-16T20:56:35.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021681786000000002 2020-11-16T20:56:35.446 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.446 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:35.446 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.447 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:485 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'94, mlcod=41'92)", 2020-11-16T20:56:35.447 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:56:35.447 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.288673259999999, 2020-11-16T20:56:35.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021768460999999999, 2020-11-16T20:56:35.447 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:35.447 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:35.447 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:35.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:35.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:56:35.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:35.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:35.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:56:35.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001603103 2020-11-16T20:56:35.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:35.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080316+0000", 2020-11-16T20:56:35.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4956e-05 2020-11-16T20:56:35.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:35.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080331+0000", 2020-11-16T20:56:35.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6291e-05 2020-11-16T20:56:35.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:35.451 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080347+0000", 2020-11-16T20:56:35.451 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3090000000000001e-06 2020-11-16T20:56:35.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.451 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:35.451 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080357+0000", 2020-11-16T20:56:35.451 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7073000000000001e-05 2020-11-16T20:56:35.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:35.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080414+0000", 2020-11-16T20:56:35.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5877e-05 2020-11-16T20:56:35.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:35.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080440+0000", 2020-11-16T20:56:35.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019927006000000001 2020-11-16T20:56:35.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:35.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100367+0000", 2020-11-16T20:56:35.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114846 2020-11-16T20:56:35.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:35.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100481+0000", 2020-11-16T20:56:35.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021768460999999999 2020-11-16T20:56:35.454 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.454 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:35.454 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.455 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:556 3.2 e42/19 3:590e6edd:::smithi16641208-203:head v 42'388, mlcod=42'384)", 2020-11-16T20:56:35.455 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.081175+0000", 2020-11-16T20:56:35.455 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.286211378000001, 2020-11-16T20:56:35.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020119680000000001, 2020-11-16T20:56:35.455 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:35.456 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:35.456 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:35.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:35.456 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081175+0000", 2020-11-16T20:56:35.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:35.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:35.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081175+0000", 2020-11-16T20:56:35.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084338599999999996 2020-11-16T20:56:35.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:35.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089609+0000", 2020-11-16T20:56:35.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1812e-05 2020-11-16T20:56:35.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:35.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089621+0000", 2020-11-16T20:56:35.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6175e-05 2020-11-16T20:56:35.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.459 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:35.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089637+0000", 2020-11-16T20:56:35.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2799999999999992e-06 2020-11-16T20:56:35.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.459 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:35.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089646+0000", 2020-11-16T20:56:35.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1341999999999998e-05 2020-11-16T20:56:35.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:35.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089687+0000", 2020-11-16T20:56:35.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3351999999999999e-05 2020-11-16T20:56:35.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:35.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089711+0000", 2020-11-16T20:56:35.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011527864000000001 2020-11-16T20:56:35.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:35.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101239+0000", 2020-11-16T20:56:35.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5995000000000002e-05 2020-11-16T20:56:35.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:35.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101295+0000", 2020-11-16T20:56:35.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020119680000000001 2020-11-16T20:56:35.462 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.462 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:35.463 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.463 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2370 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'95, mlcod=41'92)", 2020-11-16T20:56:35.463 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.083328+0000", 2020-11-16T20:56:35.463 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.284058677000001, 2020-11-16T20:56:35.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01719561, 2020-11-16T20:56:35.464 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:35.464 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:35.464 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:35.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:35.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083328+0000", 2020-11-16T20:56:35.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:35.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:35.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083328+0000", 2020-11-16T20:56:35.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00037936799999999999 2020-11-16T20:56:35.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:35.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083707+0000", 2020-11-16T20:56:35.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7088999999999999e-05 2020-11-16T20:56:35.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:35.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083724+0000", 2020-11-16T20:56:35.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6737999999999999e-05 2020-11-16T20:56:35.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:35.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083771+0000", 2020-11-16T20:56:35.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7869000000000001e-05 2020-11-16T20:56:35.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:35.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083789+0000", 2020-11-16T20:56:35.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0046429339999999996 2020-11-16T20:56:35.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.468 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:35.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.088432+0000", 2020-11-16T20:56:35.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7565999999999998e-05 2020-11-16T20:56:35.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:35.469 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.088479+0000", 2020-11-16T20:56:35.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012005706 2020-11-16T20:56:35.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:35.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100485+0000", 2020-11-16T20:56:35.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8340000000000002e-05 2020-11-16T20:56:35.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:35.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100523+0000", 2020-11-16T20:56:35.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01719561 2020-11-16T20:56:35.470 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.471 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:35.471 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.471 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2371 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'96, mlcod=41'92)", 2020-11-16T20:56:35.471 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.084682+0000", 2020-11-16T20:56:35.471 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.282704531, 2020-11-16T20:56:35.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015864851999999999, 2020-11-16T20:56:35.472 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:35.472 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:35.472 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:35.472 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.472 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:35.472 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084682+0000", 2020-11-16T20:56:35.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:35.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.473 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.473 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:35.473 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084682+0000", 2020-11-16T20:56:35.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1321e-05 2020-11-16T20:56:35.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.473 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:35.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084723+0000", 2020-11-16T20:56:35.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9310000000000008e-06 2020-11-16T20:56:35.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:35.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084731+0000", 2020-11-16T20:56:35.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1453e-05 2020-11-16T20:56:35.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.475 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:35.475 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084742+0000", 2020-11-16T20:56:35.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9670000000000004e-06 2020-11-16T20:56:35.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:35.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084749+0000", 2020-11-16T20:56:35.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048588700000000004 2020-11-16T20:56:35.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:35.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089608+0000", 2020-11-16T20:56:35.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3699999999999998e-05 2020-11-16T20:56:35.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.477 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:35.477 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089652+0000", 2020-11-16T20:56:35.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010873481000000001 2020-11-16T20:56:35.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.478 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:35.478 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100525+0000", 2020-11-16T20:56:35.478 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1129e-05 2020-11-16T20:56:35.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.478 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:35.478 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100547+0000", 2020-11-16T20:56:35.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015864851999999999 2020-11-16T20:56:35.479 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.479 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:35.479 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.479 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:663 4.3 e57/22 4:f65e82cb:::smithi16641208-219:head v 57'179, mlcod=57'176)", 2020-11-16T20:56:35.479 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:56:35.480 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.57055819, 2020-11-16T20:56:35.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022540092000000001, 2020-11-16T20:56:35.480 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:35.480 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:35.480 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:35.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:35.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:56:35.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:35.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:35.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:56:35.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013414394 2020-11-16T20:56:35.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.482 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:35.482 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810242+0000", 2020-11-16T20:56:35.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1864e-05 2020-11-16T20:56:35.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.482 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:35.483 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810254+0000", 2020-11-16T20:56:35.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3716e-05 2020-11-16T20:56:35.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.483 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:35.483 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810268+0000", 2020-11-16T20:56:35.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.064e-06 2020-11-16T20:56:35.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:35.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810277+0000", 2020-11-16T20:56:35.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0560999999999998e-05 2020-11-16T20:56:35.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:35.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810338+0000", 2020-11-16T20:56:35.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7523999999999999e-05 2020-11-16T20:56:35.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:35.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810365+0000", 2020-11-16T20:56:35.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089020890000000002 2020-11-16T20:56:35.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:35.486 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819267+0000", 2020-11-16T20:56:35.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010088 2020-11-16T20:56:35.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:35.487 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819368+0000", 2020-11-16T20:56:35.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022540092000000001 2020-11-16T20:56:35.487 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.487 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:35.487 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.488 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:618 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'243, mlcod=57'241)", 2020-11-16T20:56:35.488 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:56:35.488 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.567052114999999, 2020-11-16T20:56:35.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049183098000000001, 2020-11-16T20:56:35.488 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:35.488 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:35.488 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:35.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:35.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:56:35.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:35.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:35.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:56:35.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019114651 2020-11-16T20:56:35.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:35.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819449+0000", 2020-11-16T20:56:35.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.398e-05 2020-11-16T20:56:35.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.491 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:35.491 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819463+0000", 2020-11-16T20:56:35.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1139e-05 2020-11-16T20:56:35.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.491 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:35.491 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819474+0000", 2020-11-16T20:56:35.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1860000000000003e-06 2020-11-16T20:56:35.492 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.492 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.492 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:35.492 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819481+0000", 2020-11-16T20:56:35.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015472700000000001 2020-11-16T20:56:35.492 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.492 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:35.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819636+0000", 2020-11-16T20:56:35.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9632e-05 2020-11-16T20:56:35.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:35.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819665+0000", 2020-11-16T20:56:35.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029788289999999999 2020-11-16T20:56:35.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:35.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849454+0000", 2020-11-16T20:56:35.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3492999999999997e-05 2020-11-16T20:56:35.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.495 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:35.495 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849517+0000", 2020-11-16T20:56:35.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049183098000000001 2020-11-16T20:56:35.495 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.495 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:35.495 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.496 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:609 3.2 e57/19 3:5eead97c:::smithi16641208-34:head v 57'498, mlcod=57'495)", 2020-11-16T20:56:35.496 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:56:35.496 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.556772616, 2020-11-16T20:56:35.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039221579999999999, 2020-11-16T20:56:35.496 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:35.496 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:35.497 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:35.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:35.497 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:56:35.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:35.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:35.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:56:35.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008889859 2020-11-16T20:56:35.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:35.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819503+0000", 2020-11-16T20:56:35.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0149000000000001e-05 2020-11-16T20:56:35.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:35.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819514+0000", 2020-11-16T20:56:35.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1049999999999999e-05 2020-11-16T20:56:35.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:35.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819525+0000", 2020-11-16T20:56:35.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4829999999999999e-06 2020-11-16T20:56:35.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:35.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819533+0000", 2020-11-16T20:56:35.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031805760000000001 2020-11-16T20:56:35.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:35.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822714+0000", 2020-11-16T20:56:35.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0954000000000002e-05 2020-11-16T20:56:35.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:35.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822745+0000", 2020-11-16T20:56:35.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027044038999999999 2020-11-16T20:56:35.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:35.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849789+0000", 2020-11-16T20:56:35.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6470000000000001e-05 2020-11-16T20:56:35.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:35.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849835+0000", 2020-11-16T20:56:35.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039221579999999999 2020-11-16T20:56:35.503 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.503 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:35.503 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.504 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2583 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'244, mlcod=57'241)", 2020-11-16T20:56:35.504 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:56:35.504 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.547855081, 2020-11-16T20:56:35.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030101836999999999, 2020-11-16T20:56:35.504 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:35.505 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:35.505 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:35.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:35.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:56:35.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:35.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:35.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:56:35.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3781e-05 2020-11-16T20:56:35.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:35.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819575+0000", 2020-11-16T20:56:35.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3355e-05 2020-11-16T20:56:35.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:35.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819588+0000", 2020-11-16T20:56:35.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8198e-05 2020-11-16T20:56:35.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.508 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:35.508 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819657+0000", 2020-11-16T20:56:35.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5849999999999999e-05 2020-11-16T20:56:35.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.508 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:35.508 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819672+0000", 2020-11-16T20:56:35.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003042473 2020-11-16T20:56:35.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:35.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822715+0000", 2020-11-16T20:56:35.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9779999999999999e-05 2020-11-16T20:56:35.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:35.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822745+0000", 2020-11-16T20:56:35.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026828521000000001 2020-11-16T20:56:35.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:35.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849573+0000", 2020-11-16T20:56:35.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9879e-05 2020-11-16T20:56:35.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:35.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849633+0000", 2020-11-16T20:56:35.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030101836999999999 2020-11-16T20:56:35.511 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.512 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:35.512 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.512 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:728 4.3 e69/22 4:ccdf634d:::smithi16641208-284:head v 69'228, mlcod=61'226)", 2020-11-16T20:56:35.512 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:31.767600+0000", 2020-11-16T20:56:35.512 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.5997860159999999, 2020-11-16T20:56:35.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014161465, 2020-11-16T20:56:35.513 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:35.513 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:35.513 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:35.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.513 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:35.513 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.767600+0000", 2020-11-16T20:56:35.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:35.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.514 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:35.514 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.767600+0000", 2020-11-16T20:56:35.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053383129999999999 2020-11-16T20:56:35.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.514 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:35.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.772939+0000", 2020-11-16T20:56:35.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0958000000000001e-05 2020-11-16T20:56:35.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:35.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.772950+0000", 2020-11-16T20:56:35.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0628999999999999e-05 2020-11-16T20:56:35.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:35.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.772960+0000", 2020-11-16T20:56:35.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9689999999999999e-06 2020-11-16T20:56:35.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:35.517 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.772966+0000", 2020-11-16T20:56:35.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3246999999999999e-05 2020-11-16T20:56:35.517 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.517 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:35.517 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.773029+0000", 2020-11-16T20:56:35.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2042000000000003e-05 2020-11-16T20:56:35.517 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:35.518 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.773061+0000", 2020-11-16T20:56:35.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0086372619999999997 2020-11-16T20:56:35.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:35.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.781699+0000", 2020-11-16T20:56:35.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3045000000000004e-05 2020-11-16T20:56:35.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:35.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.781762+0000", 2020-11-16T20:56:35.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014161465 2020-11-16T20:56:35.519 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.520 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:35.520 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.520 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:779 4.3 e72/22 4:d9c18080:::smithi16641208-173:head v 72'266, mlcod=71'264)", 2020-11-16T20:56:35.520 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:34.786324+0000", 2020-11-16T20:56:35.520 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.58106259699999996, 2020-11-16T20:56:35.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017952486, 2020-11-16T20:56:35.521 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:35.521 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:35.521 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:35.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:35.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.786324+0000", 2020-11-16T20:56:35.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:35.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.522 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:35.522 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.786324+0000", 2020-11-16T20:56:35.522 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012598417000000001 2020-11-16T20:56:35.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:35.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.798922+0000", 2020-11-16T20:56:35.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1700000000000003e-06 2020-11-16T20:56:35.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:35.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.798931+0000", 2020-11-16T20:56:35.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2648e-05 2020-11-16T20:56:35.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.524 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.524 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:35.524 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.798944+0000", 2020-11-16T20:56:35.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0150000000000003e-06 2020-11-16T20:56:35.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.524 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.525 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:35.525 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.798952+0000", 2020-11-16T20:56:35.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4095999999999998e-05 2020-11-16T20:56:35.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.525 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:35.525 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.799006+0000", 2020-11-16T20:56:35.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2419e-05 2020-11-16T20:56:35.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.526 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:35.526 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.799028+0000", 2020-11-16T20:56:35.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051805050000000002 2020-11-16T20:56:35.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:35.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.804209+0000", 2020-11-16T20:56:35.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7216000000000002e-05 2020-11-16T20:56:35.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:35.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:35.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:35.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.804276+0000", 2020-11-16T20:56:35.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017952486 2020-11-16T20:56:35.528 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.528 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:35.528 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.528 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:35.528 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:35.528 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:35.529 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:56:35.530 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:35.534+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:35.631 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:35.635+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:35.707 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:35.708 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:35.708 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:56:35.708 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:35.717 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:56:35.736 INFO:tasks.rados.rados.0.smithi166.stdout:777: done (5 left) 2020-11-16T20:56:35.737 INFO:tasks.rados.rados.0.smithi166.stdout:778: done (4 left) 2020-11-16T20:56:35.737 INFO:tasks.rados.rados.0.smithi166.stdout:780: done (3 left) 2020-11-16T20:56:35.737 INFO:tasks.rados.rados.0.smithi166.stdout:781: done (2 left) 2020-11-16T20:56:35.737 INFO:tasks.rados.rados.0.smithi166.stdout:782: done (1 left) 2020-11-16T20:56:35.737 INFO:tasks.rados.rados.0.smithi166.stdout:783: done (0 left) 2020-11-16T20:56:35.737 INFO:tasks.rados.rados.0.smithi166.stdout:784: snap_create 2020-11-16T20:56:35.760 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:35.765+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:35.832 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:35.836+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:35.853 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:35.853 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:35.853 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:56:35.854 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:56:35.854 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:35.863 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:56:35.946 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:35.951+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:36.033 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:36.037+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:36.039 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:36.039 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:56:36.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:56:36.040 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:56:36.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.040 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:37 4.1 e33/22 4:b6545a47:::smithi16641208-46:head v 33'28, mlcod=33'26)", 2020-11-16T20:56:36.040 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.515292+0000", 2020-11-16T20:56:36.040 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 44.527694478999997, 2020-11-16T20:56:36.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016898816000000001, 2020-11-16T20:56:36.041 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.041 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.041 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.515292+0000", 2020-11-16T20:56:36.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.515292+0000", 2020-11-16T20:56:36.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001749708 2020-11-16T20:56:36.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.517042+0000", 2020-11-16T20:56:36.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1926000000000001e-05 2020-11-16T20:56:36.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.517054+0000", 2020-11-16T20:56:36.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4791e-05 2020-11-16T20:56:36.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.517068+0000", 2020-11-16T20:56:36.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3440000000000001e-06 2020-11-16T20:56:36.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.517077+0000", 2020-11-16T20:56:36.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5005000000000005e-05 2020-11-16T20:56:36.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.517142+0000", 2020-11-16T20:56:36.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1109000000000003e-05 2020-11-16T20:56:36.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.517173+0000", 2020-11-16T20:56:36.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01497009 2020-11-16T20:56:36.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532143+0000", 2020-11-16T20:56:36.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7843000000000003e-05 2020-11-16T20:56:36.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532191+0000", 2020-11-16T20:56:36.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016898816000000001 2020-11-16T20:56:36.049 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.049 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.049 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.050 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:39 4.1 e33/22 4:81558809:::smithi16641208-47:head v 33'30, mlcod=33'26)", 2020-11-16T20:56:36.050 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.520522+0000", 2020-11-16T20:56:36.050 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 44.522464741999997, 2020-11-16T20:56:36.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014376866, 2020-11-16T20:56:36.051 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.051 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.051 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.051 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520522+0000", 2020-11-16T20:56:36.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.052 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520522+0000", 2020-11-16T20:56:36.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00038562500000000001 2020-11-16T20:56:36.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.053 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520907+0000", 2020-11-16T20:56:36.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0479000000000001e-05 2020-11-16T20:56:36.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.053 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.054 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520918+0000", 2020-11-16T20:56:36.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6376999999999999e-05 2020-11-16T20:56:36.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.054 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.054 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520934+0000", 2020-11-16T20:56:36.055 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1693e-05 2020-11-16T20:56:36.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520946+0000", 2020-11-16T20:56:36.055 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5083000000000002e-05 2020-11-16T20:56:36.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.056 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.056 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520991+0000", 2020-11-16T20:56:36.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2738000000000002e-05 2020-11-16T20:56:36.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.056 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.521014+0000", 2020-11-16T20:56:36.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013845266 2020-11-16T20:56:36.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534859+0000", 2020-11-16T20:56:36.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9604999999999998e-05 2020-11-16T20:56:36.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.058 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.058 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.534899+0000", 2020-11-16T20:56:36.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014376866 2020-11-16T20:56:36.059 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.059 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.059 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.059 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:201 3.2 e35/19 3:515e6cf6:::smithi16641208-22:head v 35'123, mlcod=35'121)", 2020-11-16T20:56:36.060 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.975460+0000", 2020-11-16T20:56:36.060 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 41.067526125999997, 2020-11-16T20:56:36.060 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014831637, 2020-11-16T20:56:36.060 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.060 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.060 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.060 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.975460+0000", 2020-11-16T20:56:36.061 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.975460+0000", 2020-11-16T20:56:36.062 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0037792979999999999 2020-11-16T20:56:36.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.062 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.062 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.062 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.979240+0000", 2020-11-16T20:56:36.062 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1510000000000001e-06 2020-11-16T20:56:36.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.063 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.979246+0000", 2020-11-16T20:56:36.063 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0080000000000002e-06 2020-11-16T20:56:36.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.064 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.064 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.979254+0000", 2020-11-16T20:56:36.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9459999999999997e-06 2020-11-16T20:56:36.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.065 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.065 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.979259+0000", 2020-11-16T20:56:36.065 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6044999999999997e-05 2020-11-16T20:56:36.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.065 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.066 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.979305+0000", 2020-11-16T20:56:36.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8236999999999998e-05 2020-11-16T20:56:36.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.066 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.066 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.066 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.979323+0000", 2020-11-16T20:56:36.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010909350999999999 2020-11-16T20:56:36.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.067 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.067 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.990232+0000", 2020-11-16T20:56:36.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9601000000000001e-05 2020-11-16T20:56:36.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.068 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.990292+0000", 2020-11-16T20:56:36.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014831637 2020-11-16T20:56:36.069 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.069 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.069 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.069 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:202 3.2 e35/19 3:5723fd94:::smithi16641208-211:head v 35'124, mlcod=35'121)", 2020-11-16T20:56:36.069 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.981228+0000", 2020-11-16T20:56:36.070 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 41.061758570999999, 2020-11-16T20:56:36.070 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013558532, 2020-11-16T20:56:36.070 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.070 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.070 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.070 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.071 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.071 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.981228+0000", 2020-11-16T20:56:36.071 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.071 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.071 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.981228+0000", 2020-11-16T20:56:36.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052605159999999998 2020-11-16T20:56:36.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.072 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.072 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.986488+0000", 2020-11-16T20:56:36.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.52e-06 2020-11-16T20:56:36.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.073 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.073 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.986496+0000", 2020-11-16T20:56:36.073 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0351e-05 2020-11-16T20:56:36.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.986506+0000", 2020-11-16T20:56:36.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1437000000000001e-05 2020-11-16T20:56:36.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.075 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.075 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.986518+0000", 2020-11-16T20:56:36.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2643000000000002e-05 2020-11-16T20:56:36.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.075 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.076 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.986590+0000", 2020-11-16T20:56:36.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1520000000000001e-05 2020-11-16T20:56:36.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.076 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.076 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.986612+0000", 2020-11-16T20:56:36.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0081095630000000002 2020-11-16T20:56:36.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.994721+0000", 2020-11-16T20:56:36.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4981999999999995e-05 2020-11-16T20:56:36.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.078 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.078 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.994786+0000", 2020-11-16T20:56:36.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013558532 2020-11-16T20:56:36.078 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.078 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.078 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.079 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:547 3.2 e42/19 3:5f250a2b:::smithi16641208-75:head v 42'381, mlcod=42'379)", 2020-11-16T20:56:36.079 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.027376+0000", 2020-11-16T20:56:36.079 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 31.015610888000001, 2020-11-16T20:56:36.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017180708999999999, 2020-11-16T20:56:36.080 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.080 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.080 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.080 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.080 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.027376+0000", 2020-11-16T20:56:36.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.081 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.081 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.027376+0000", 2020-11-16T20:56:36.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064232990000000004 2020-11-16T20:56:36.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.033799+0000", 2020-11-16T20:56:36.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3679000000000001e-05 2020-11-16T20:56:36.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.033813+0000", 2020-11-16T20:56:36.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9789e-05 2020-11-16T20:56:36.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.033832+0000", 2020-11-16T20:56:36.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2969999999999999e-05 2020-11-16T20:56:36.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.033845+0000", 2020-11-16T20:56:36.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7311000000000007e-05 2020-11-16T20:56:36.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.085 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.085 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.033913+0000", 2020-11-16T20:56:36.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9128999999999998e-05 2020-11-16T20:56:36.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.086 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.033942+0000", 2020-11-16T20:56:36.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010563673000000001 2020-11-16T20:56:36.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.087 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.087 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.044505+0000", 2020-11-16T20:56:36.087 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0859000000000002e-05 2020-11-16T20:56:36.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.087 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.044556+0000", 2020-11-16T20:56:36.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017180708999999999 2020-11-16T20:56:36.088 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.088 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.088 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.089 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:554 3.2 e42/19 3:769099fd:::smithi16641208-247:head v 42'386, mlcod=42'384)", 2020-11-16T20:56:36.089 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.070944+0000", 2020-11-16T20:56:36.089 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.97204215, 2020-11-16T20:56:36.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019548482999999998, 2020-11-16T20:56:36.089 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.089 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.090 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.090 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.090 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.090 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070944+0000", 2020-11-16T20:56:36.090 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.091 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.091 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.091 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070944+0000", 2020-11-16T20:56:36.091 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0065296180000000001 2020-11-16T20:56:36.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.092 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.092 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.092 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077474+0000", 2020-11-16T20:56:36.092 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0669999999999999e-05 2020-11-16T20:56:36.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.092 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.092 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.093 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077485+0000", 2020-11-16T20:56:36.093 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4518999999999999e-05 2020-11-16T20:56:36.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.093 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.093 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.093 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077499+0000", 2020-11-16T20:56:36.093 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3319999999999992e-06 2020-11-16T20:56:36.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.094 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.094 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.094 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077507+0000", 2020-11-16T20:56:36.094 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3896e-05 2020-11-16T20:56:36.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.095 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.095 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.095 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077561+0000", 2020-11-16T20:56:36.095 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9446999999999999e-05 2020-11-16T20:56:36.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.095 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.096 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.096 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077581+0000", 2020-11-16T20:56:36.096 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012846296 2020-11-16T20:56:36.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.096 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.096 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.097 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.090427+0000", 2020-11-16T20:56:36.097 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5704999999999995e-05 2020-11-16T20:56:36.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.097 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.097 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.097 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.090493+0000", 2020-11-16T20:56:36.097 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019548482999999998 2020-11-16T20:56:36.098 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.098 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.098 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.098 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.098 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:555 3.2 e42/19 3:590e6edd:::smithi16641208-203:head v 42'387, mlcod=42'384)", 2020-11-16T20:56:36.098 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.077550+0000", 2020-11-16T20:56:36.099 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.965436707999999, 2020-11-16T20:56:36.099 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018403484000000001, 2020-11-16T20:56:36.099 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.099 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.099 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.099 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.100 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.100 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077550+0000", 2020-11-16T20:56:36.100 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.100 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.100 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.101 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077550+0000", 2020-11-16T20:56:36.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5414999999999998e-05 2020-11-16T20:56:36.101 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.101 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.101 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077595+0000", 2020-11-16T20:56:36.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1470000000000004e-06 2020-11-16T20:56:36.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.102 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.102 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.102 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077602+0000", 2020-11-16T20:56:36.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0637e-05 2020-11-16T20:56:36.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.103 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.103 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077613+0000", 2020-11-16T20:56:36.103 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9250000000000003e-06 2020-11-16T20:56:36.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077618+0000", 2020-11-16T20:56:36.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002591702 2020-11-16T20:56:36.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080210+0000", 2020-11-16T20:56:36.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2793000000000003e-05 2020-11-16T20:56:36.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.105 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.105 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080242+0000", 2020-11-16T20:56:36.106 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015665576000000001 2020-11-16T20:56:36.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.106 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.106 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.106 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.095908+0000", 2020-11-16T20:56:36.106 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5289e-05 2020-11-16T20:56:36.107 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.107 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.107 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.107 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.095953+0000", 2020-11-16T20:56:36.107 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018403484000000001 2020-11-16T20:56:36.107 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.107 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.108 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.108 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.108 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:485 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'94, mlcod=41'92)", 2020-11-16T20:56:36.108 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.078771+0000", 2020-11-16T20:56:36.108 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.964215545999998, 2020-11-16T20:56:36.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020640565999999999, 2020-11-16T20:56:36.109 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.109 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.109 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.109 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.109 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.109 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078771+0000", 2020-11-16T20:56:36.110 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.110 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.110 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.110 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078771+0000", 2020-11-16T20:56:36.110 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003089067 2020-11-16T20:56:36.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.111 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.111 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.111 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081860+0000", 2020-11-16T20:56:36.111 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.187e-05 2020-11-16T20:56:36.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.112 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.112 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.112 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081872+0000", 2020-11-16T20:56:36.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4426999999999999e-05 2020-11-16T20:56:36.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081886+0000", 2020-11-16T20:56:36.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5287999999999999e-05 2020-11-16T20:56:36.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081912+0000", 2020-11-16T20:56:36.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0007000000000003e-05 2020-11-16T20:56:36.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.114 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081972+0000", 2020-11-16T20:56:36.115 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7368e-05 2020-11-16T20:56:36.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.115 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.115 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.115 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081999+0000", 2020-11-16T20:56:36.115 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017350596999999999 2020-11-16T20:56:36.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.116 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099350+0000", 2020-11-16T20:56:36.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1941999999999997e-05 2020-11-16T20:56:36.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.116 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.117 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.117 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099412+0000", 2020-11-16T20:56:36.117 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020640565999999999 2020-11-16T20:56:36.117 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.117 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.118 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.118 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.118 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.118 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:556 3.2 e42/19 3:590e6edd:::smithi16641208-203:head v 42'388, mlcod=42'384)", 2020-11-16T20:56:36.118 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.081269+0000", 2020-11-16T20:56:36.118 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.961717129, 2020-11-16T20:56:36.118 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019299324, 2020-11-16T20:56:36.119 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.119 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.119 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.119 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081269+0000", 2020-11-16T20:56:36.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081269+0000", 2020-11-16T20:56:36.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048245409999999999 2020-11-16T20:56:36.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.086094+0000", 2020-11-16T20:56:36.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.995e-06 2020-11-16T20:56:36.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.122 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.122 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.086104+0000", 2020-11-16T20:56:36.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6529e-05 2020-11-16T20:56:36.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.123 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.123 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.123 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.086120+0000", 2020-11-16T20:56:36.123 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2890000000000003e-06 2020-11-16T20:56:36.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.123 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.124 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.124 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.086130+0000", 2020-11-16T20:56:36.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0926e-05 2020-11-16T20:56:36.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.124 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.086181+0000", 2020-11-16T20:56:36.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4405000000000001e-05 2020-11-16T20:56:36.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.126 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.086205+0000", 2020-11-16T20:56:36.126 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014305527 2020-11-16T20:56:36.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.127 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.127 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100511+0000", 2020-11-16T20:56:36.127 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8112000000000002e-05 2020-11-16T20:56:36.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.128 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.128 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.128 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100569+0000", 2020-11-16T20:56:36.128 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019299324 2020-11-16T20:56:36.128 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.128 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.129 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.129 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2370 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'95, mlcod=41'92)", 2020-11-16T20:56:36.129 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.083353+0000", 2020-11-16T20:56:36.129 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.959633754999999, 2020-11-16T20:56:36.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017054562999999998, 2020-11-16T20:56:36.130 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.130 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.130 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083353+0000", 2020-11-16T20:56:36.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.131 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.131 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.131 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083353+0000", 2020-11-16T20:56:36.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039019899999999998 2020-11-16T20:56:36.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.131 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.131 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083743+0000", 2020-11-16T20:56:36.132 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.098e-06 2020-11-16T20:56:36.132 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083752+0000", 2020-11-16T20:56:36.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2599000000000001e-05 2020-11-16T20:56:36.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.133 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083765+0000", 2020-11-16T20:56:36.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0224000000000001e-05 2020-11-16T20:56:36.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.134 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083775+0000", 2020-11-16T20:56:36.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056252819999999997 2020-11-16T20:56:36.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.135 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.135 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089400+0000", 2020-11-16T20:56:36.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4091000000000003e-05 2020-11-16T20:56:36.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.135 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089434+0000", 2020-11-16T20:56:36.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010917029999999999 2020-11-16T20:56:36.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100351+0000", 2020-11-16T20:56:36.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6039999999999999e-05 2020-11-16T20:56:36.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.137 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.137 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.137 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100407+0000", 2020-11-16T20:56:36.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017054562999999998 2020-11-16T20:56:36.137 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.137 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.138 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.138 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2371 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'96, mlcod=41'92)", 2020-11-16T20:56:36.138 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.084675+0000", 2020-11-16T20:56:36.138 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.958311860999999, 2020-11-16T20:56:36.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015773533999999999, 2020-11-16T20:56:36.139 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.139 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.139 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084675+0000", 2020-11-16T20:56:36.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.140 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084675+0000", 2020-11-16T20:56:36.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7421999999999999e-05 2020-11-16T20:56:36.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084702+0000", 2020-11-16T20:56:36.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9120000000000003e-06 2020-11-16T20:56:36.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.142 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084708+0000", 2020-11-16T20:56:36.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4649999999999994e-06 2020-11-16T20:56:36.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.142 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084716+0000", 2020-11-16T20:56:36.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0950000000000003e-06 2020-11-16T20:56:36.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.143 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084722+0000", 2020-11-16T20:56:36.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056083510000000001 2020-11-16T20:56:36.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.145 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.090330+0000", 2020-11-16T20:56:36.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9339000000000001e-05 2020-11-16T20:56:36.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.145 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.145 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.090359+0000", 2020-11-16T20:56:36.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010050811 2020-11-16T20:56:36.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.146 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.146 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.146 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100410+0000", 2020-11-16T20:56:36.146 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8139000000000002e-05 2020-11-16T20:56:36.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.146 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.147 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.147 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100448+0000", 2020-11-16T20:56:36.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015773533999999999 2020-11-16T20:56:36.147 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.147 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.147 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.148 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2580 3.2 e57/19 3:75836747:::smithi16641208-340:head v 57'492, mlcod=57'483)", 2020-11-16T20:56:36.148 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.768064+0000", 2020-11-16T20:56:36.148 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.274922652000001, 2020-11-16T20:56:36.148 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018062056, 2020-11-16T20:56:36.148 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.148 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.148 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.149 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.149 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.768064+0000", 2020-11-16T20:56:36.149 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.149 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.150 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.768064+0000", 2020-11-16T20:56:36.150 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00058317799999999995 2020-11-16T20:56:36.150 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.150 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.150 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.150 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.768647+0000", 2020-11-16T20:56:36.150 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0350000000000007e-06 2020-11-16T20:56:36.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.151 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.151 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.151 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.768656+0000", 2020-11-16T20:56:36.151 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2744e-05 2020-11-16T20:56:36.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.151 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.151 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.152 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.768669+0000", 2020-11-16T20:56:36.152 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7309999999999996e-06 2020-11-16T20:56:36.152 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.152 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.152 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.153 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.768676+0000", 2020-11-16T20:56:36.153 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0025689390000000001 2020-11-16T20:56:36.153 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.153 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.153 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.153 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.771244+0000", 2020-11-16T20:56:36.154 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8636000000000002e-05 2020-11-16T20:56:36.154 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.154 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.154 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.154 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.771273+0000", 2020-11-16T20:56:36.154 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014783734 2020-11-16T20:56:36.154 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.155 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.155 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786057+0000", 2020-11-16T20:56:36.155 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9059000000000004e-05 2020-11-16T20:56:36.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.155 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.156 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786126+0000", 2020-11-16T20:56:36.156 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018062056 2020-11-16T20:56:36.156 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.156 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.156 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.156 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.156 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.156 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2581 3.2 e57/19 3:75836747:::smithi16641208-340:head v 57'493, mlcod=57'483)", 2020-11-16T20:56:36.157 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.768987+0000", 2020-11-16T20:56:36.157 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.273999271000001, 2020-11-16T20:56:36.157 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017169609999999998, 2020-11-16T20:56:36.157 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.157 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.157 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.157 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.158 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.158 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.768987+0000", 2020-11-16T20:56:36.158 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.158 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.158 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.158 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.159 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.768987+0000", 2020-11-16T20:56:36.159 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001144267 2020-11-16T20:56:36.159 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.159 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.159 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.159 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.770131+0000", 2020-11-16T20:56:36.159 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6410000000000008e-06 2020-11-16T20:56:36.159 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.160 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.160 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.160 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.770140+0000", 2020-11-16T20:56:36.160 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2741999999999999e-05 2020-11-16T20:56:36.160 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.160 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.160 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.161 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.770153+0000", 2020-11-16T20:56:36.161 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3950000000000003e-06 2020-11-16T20:56:36.161 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.161 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.161 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.161 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.770160+0000", 2020-11-16T20:56:36.161 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054500110000000003 2020-11-16T20:56:36.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.162 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.163 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.775610+0000", 2020-11-16T20:56:36.163 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5126e-05 2020-11-16T20:56:36.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.163 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.163 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.164 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.775635+0000", 2020-11-16T20:56:36.164 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010494847999999999 2020-11-16T20:56:36.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.164 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.164 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.164 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786130+0000", 2020-11-16T20:56:36.164 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.658e-05 2020-11-16T20:56:36.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.165 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.165 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.165 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786157+0000", 2020-11-16T20:56:36.165 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017169609999999998 2020-11-16T20:56:36.165 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.165 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.166 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.166 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.166 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.166 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:603 3.2 e57/19 3:5a2e7c26:::smithi16641208-130:head v 57'494, mlcod=57'485)", 2020-11-16T20:56:36.166 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.772348+0000", 2020-11-16T20:56:36.166 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.270637994000001, 2020-11-16T20:56:36.166 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015150215999999999, 2020-11-16T20:56:36.167 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.167 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.167 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.167 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.167 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.167 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.772348+0000", 2020-11-16T20:56:36.167 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.168 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.168 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.168 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.168 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.772348+0000", 2020-11-16T20:56:36.168 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0039012650000000001 2020-11-16T20:56:36.168 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.168 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.169 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.169 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.776250+0000", 2020-11-16T20:56:36.169 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7919999999999998e-06 2020-11-16T20:56:36.169 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.169 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.169 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.170 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.776259+0000", 2020-11-16T20:56:36.170 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1582e-05 2020-11-16T20:56:36.170 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.170 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.170 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.170 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.776270+0000", 2020-11-16T20:56:36.170 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6779999999999997e-06 2020-11-16T20:56:36.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.171 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.171 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.171 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.776276+0000", 2020-11-16T20:56:36.171 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00067481599999999996 2020-11-16T20:56:36.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.171 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.171 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.172 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.776951+0000", 2020-11-16T20:56:36.172 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1649999999999997e-05 2020-11-16T20:56:36.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.172 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.172 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.173 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.776982+0000", 2020-11-16T20:56:36.173 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010457162000000001 2020-11-16T20:56:36.173 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.173 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.173 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.173 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787439+0000", 2020-11-16T20:56:36.173 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9271000000000002e-05 2020-11-16T20:56:36.174 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.174 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.174 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.174 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787499+0000", 2020-11-16T20:56:36.174 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015150215999999999 2020-11-16T20:56:36.174 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.175 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.175 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.175 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:609 3.2 e57/19 3:5eead97c:::smithi16641208-34:head v 57'498, mlcod=57'495)", 2020-11-16T20:56:36.175 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.810471+0000", 2020-11-16T20:56:36.175 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.232515858999999, 2020-11-16T20:56:36.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040749058999999997, 2020-11-16T20:56:36.176 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.176 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.176 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810471+0000", 2020-11-16T20:56:36.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.177 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810471+0000", 2020-11-16T20:56:36.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088055860000000007 2020-11-16T20:56:36.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.178 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.178 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819276+0000", 2020-11-16T20:56:36.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3659000000000002e-05 2020-11-16T20:56:36.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.179 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.179 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819300+0000", 2020-11-16T20:56:36.179 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9273e-05 2020-11-16T20:56:36.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819319+0000", 2020-11-16T20:56:36.181 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4292e-05 2020-11-16T20:56:36.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.181 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.181 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.182 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819333+0000", 2020-11-16T20:56:36.182 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2676999999999995e-05 2020-11-16T20:56:36.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.183 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.183 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.183 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819416+0000", 2020-11-16T20:56:36.183 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1479e-05 2020-11-16T20:56:36.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.184 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.184 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819458+0000", 2020-11-16T20:56:36.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.031704478000000001 2020-11-16T20:56:36.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.185 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851162+0000", 2020-11-16T20:56:36.185 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7615000000000003e-05 2020-11-16T20:56:36.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.185 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.186 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851220+0000", 2020-11-16T20:56:36.186 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.040749058999999997 2020-11-16T20:56:36.186 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.186 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.186 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.186 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.187 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2593 3.3 e57/19 3:f5f8fa2a:::smithi16641208-144:head v 57'482, mlcod=57'478)", 2020-11-16T20:56:36.187 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.811262+0000", 2020-11-16T20:56:36.187 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.231724138000001, 2020-11-16T20:56:36.187 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039577978999999999, 2020-11-16T20:56:36.187 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.187 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.187 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.188 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.811262+0000", 2020-11-16T20:56:36.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.811262+0000", 2020-11-16T20:56:36.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0024992909999999998 2020-11-16T20:56:36.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813762+0000", 2020-11-16T20:56:36.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3520000000000007e-06 2020-11-16T20:56:36.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.190 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.190 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813770+0000", 2020-11-16T20:56:36.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6045999999999998e-05 2020-11-16T20:56:36.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.190 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.191 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813786+0000", 2020-11-16T20:56:36.191 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2719999999999997e-06 2020-11-16T20:56:36.191 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.191 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.191 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.191 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813794+0000", 2020-11-16T20:56:36.191 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7755000000000002e-05 2020-11-16T20:56:36.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.192 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.192 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813892+0000", 2020-11-16T20:56:36.192 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4265000000000003e-05 2020-11-16T20:56:36.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.192 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813946+0000", 2020-11-16T20:56:36.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036843977 2020-11-16T20:56:36.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.850790+0000", 2020-11-16T20:56:36.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0021000000000001e-05 2020-11-16T20:56:36.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.194 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.194 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.850840+0000", 2020-11-16T20:56:36.194 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039577978999999999 2020-11-16T20:56:36.194 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.194 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.195 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.195 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.195 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.13:618 3.3 e57/19 3:d775beee:::smithi16641208-10:head v 57'483, mlcod=57'478)", 2020-11-16T20:56:36.195 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.825375+0000", 2020-11-16T20:56:36.195 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.217611786999999, 2020-11-16T20:56:36.195 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.025928922, 2020-11-16T20:56:36.196 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.196 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.196 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.196 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.196 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.196 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.825375+0000", 2020-11-16T20:56:36.196 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.825375+0000", 2020-11-16T20:56:36.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001052641 2020-11-16T20:56:36.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.826427+0000", 2020-11-16T20:56:36.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.884e-06 2020-11-16T20:56:36.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.826436+0000", 2020-11-16T20:56:36.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2126999999999999e-05 2020-11-16T20:56:36.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.199 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.199 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.826448+0000", 2020-11-16T20:56:36.199 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5680000000000005e-06 2020-11-16T20:56:36.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.200 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.200 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.826458+0000", 2020-11-16T20:56:36.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8312e-05 2020-11-16T20:56:36.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.200 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.200 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.200 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.826516+0000", 2020-11-16T20:56:36.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3490999999999999e-05 2020-11-16T20:56:36.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.826540+0000", 2020-11-16T20:56:36.201 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024717156000000001 2020-11-16T20:56:36.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851257+0000", 2020-11-16T20:56:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6743000000000003e-05 2020-11-16T20:56:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851304+0000", 2020-11-16T20:56:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.025928922 2020-11-16T20:56:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.13:619 3.3 e57/19 3:d79d68cf:::smithi16641208-37:head v 57'484, mlcod=57'478)", 2020-11-16T20:56:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.827568+0000", 2020-11-16T20:56:36.204 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.215418706000001, 2020-11-16T20:56:36.204 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023912187000000001, 2020-11-16T20:56:36.204 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.204 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.204 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.204 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.204 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.205 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.827568+0000", 2020-11-16T20:56:36.205 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.205 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.205 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.827568+0000", 2020-11-16T20:56:36.205 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011559700000000001 2020-11-16T20:56:36.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.206 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.206 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.206 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.828724+0000", 2020-11-16T20:56:36.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7420000000000003e-06 2020-11-16T20:56:36.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.206 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.206 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.207 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.828732+0000", 2020-11-16T20:56:36.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2694000000000001e-05 2020-11-16T20:56:36.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.207 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.828745+0000", 2020-11-16T20:56:36.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7479999999999999e-06 2020-11-16T20:56:36.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.828754+0000", 2020-11-16T20:56:36.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011949338 2020-11-16T20:56:36.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.209 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.840703+0000", 2020-11-16T20:56:36.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2928000000000001e-05 2020-11-16T20:56:36.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.209 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.840726+0000", 2020-11-16T20:56:36.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010701949000000001 2020-11-16T20:56:36.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851428+0000", 2020-11-16T20:56:36.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1817999999999998e-05 2020-11-16T20:56:36.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.211 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.211 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851480+0000", 2020-11-16T20:56:36.211 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023912187000000001 2020-11-16T20:56:36.211 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.211 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.211 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.212 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2705 4.1 e63/53 4:b0e01256:::smithi16641208-225:head v 63'189, mlcod=61'185)", 2020-11-16T20:56:36.212 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:25.752150+0000", 2020-11-16T20:56:36.212 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.290836685, 2020-11-16T20:56:36.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017996993999999999, 2020-11-16T20:56:36.212 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.212 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.212 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.213 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.213 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.752150+0000", 2020-11-16T20:56:36.213 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.752150+0000", 2020-11-16T20:56:36.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020574230000000001 2020-11-16T20:56:36.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.754207+0000", 2020-11-16T20:56:36.215 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7051e-05 2020-11-16T20:56:36.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.215 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.215 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.215 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.754224+0000", 2020-11-16T20:56:36.215 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8719000000000002e-05 2020-11-16T20:56:36.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.216 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.754243+0000", 2020-11-16T20:56:36.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2979999999999999e-05 2020-11-16T20:56:36.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.754256+0000", 2020-11-16T20:56:36.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8647999999999996e-05 2020-11-16T20:56:36.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.217 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.754345+0000", 2020-11-16T20:56:36.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8513999999999998e-05 2020-11-16T20:56:36.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.218 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.754383+0000", 2020-11-16T20:56:36.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015688825 2020-11-16T20:56:36.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.219 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.219 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.770072+0000", 2020-11-16T20:56:36.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4833999999999995e-05 2020-11-16T20:56:36.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.219 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.220 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.770147+0000", 2020-11-16T20:56:36.220 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017996993999999999 2020-11-16T20:56:36.220 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.220 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.220 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.221 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2871 3.3 e72/19 3:d9c18080:::smithi16641208-173:head v 72'579, mlcod=71'576)", 2020-11-16T20:56:36.221 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:34.761971+0000", 2020-11-16T20:56:36.221 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.2810152340000001, 2020-11-16T20:56:36.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014604449, 2020-11-16T20:56:36.221 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.221 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.222 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.761971+0000", 2020-11-16T20:56:36.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.761971+0000", 2020-11-16T20:56:36.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002118497 2020-11-16T20:56:36.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.764090+0000", 2020-11-16T20:56:36.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1749999999999999e-05 2020-11-16T20:56:36.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.224 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.224 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.764102+0000", 2020-11-16T20:56:36.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6631999999999999e-05 2020-11-16T20:56:36.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.764118+0000", 2020-11-16T20:56:36.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1910000000000006e-06 2020-11-16T20:56:36.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.764127+0000", 2020-11-16T20:56:36.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3256e-05 2020-11-16T20:56:36.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.764181+0000", 2020-11-16T20:56:36.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6090000000000002e-05 2020-11-16T20:56:36.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.764217+0000", 2020-11-16T20:56:36.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012292888 2020-11-16T20:56:36.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.228 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.228 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.776510+0000", 2020-11-16T20:56:36.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6144999999999998e-05 2020-11-16T20:56:36.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.228 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.228 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.776576+0000", 2020-11-16T20:56:36.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014604449 2020-11-16T20:56:36.229 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.229 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.229 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.229 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.229 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.229 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:36.230 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:56:36.231 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:36.235+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:36.331 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:36.336+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:36.408 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:36.408 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:36.408 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:56:36.409 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:36.418 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:56:36.461 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:36.466+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:36.533 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:36.537+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:36.553 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:36.554 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:36.554 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:56:36.554 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:56:36.554 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:36.563 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:56:36.646 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:36.651+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:36.734 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:36.739+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:36.739 INFO:tasks.rados.rados.0.smithi166.stdout:784: done (0 left) 2020-11-16T20:56:36.739 INFO:tasks.rados.rados.0.smithi166.stdout:785: delete oid 34 current snap is 22 2020-11-16T20:56:36.742 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:36.742 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:56:36.742 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:56:36.742 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:56:36.742 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.743 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4237.0:1 1.0 1:04475aff:::INTEL_SSDPEDMD400G4_CVFT5330009L400BGN:head [omap-get-keys] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e13)", 2020-11-16T20:56:36.743 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:54:53.099987+0000", 2020-11-16T20:56:36.743 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 103.645744131, 2020-11-16T20:56:36.743 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013001067999999999, 2020-11-16T20:56:36.743 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.743 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2020-11-16T20:56:36.743 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:36.744 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4237", 2020-11-16T20:56:36.744 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.59:0/2773183201", 2020-11-16T20:56:36.744 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 1 2020-11-16T20:56:36.744 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.744 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.744 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.744 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.744 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.099987+0000", 2020-11-16T20:56:36.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.745 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.745 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.745 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.099987+0000", 2020-11-16T20:56:36.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2502000000000001e-05 2020-11-16T20:56:36.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.746 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.746 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.100029+0000", 2020-11-16T20:56:36.746 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7090000000000002e-06 2020-11-16T20:56:36.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.746 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.747 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.100037+0000", 2020-11-16T20:56:36.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4844000000000001e-05 2020-11-16T20:56:36.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.747 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.747 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.747 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.100052+0000", 2020-11-16T20:56:36.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4450000000000002e-06 2020-11-16T20:56:36.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.100061+0000", 2020-11-16T20:56:36.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026660600000000002 2020-11-16T20:56:36.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.100328+0000", 2020-11-16T20:56:36.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7116e-05 2020-11-16T20:56:36.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.749 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for peered", 2020-11-16T20:56:36.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.100345+0000", 2020-11-16T20:56:36.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012477217000000001 2020-11-16T20:56:36.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.750 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.750 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.750 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.112822+0000", 2020-11-16T20:56:36.750 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016562900000000001 2020-11-16T20:56:36.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.750 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.750 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.751 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:54:53.112988+0000", 2020-11-16T20:56:36.751 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013001067999999999 2020-11-16T20:56:36.751 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.751 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.751 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.751 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.751 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.752 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:280 4.3 e35/22 4:c9fee0b4:::smithi16641208-235:head v 35'58, mlcod=35'56)", 2020-11-16T20:56:36.752 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.763935+0000", 2020-11-16T20:56:36.752 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 41.981795695999999, 2020-11-16T20:56:36.752 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013791523, 2020-11-16T20:56:36.752 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.752 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.752 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.753 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.763935+0000", 2020-11-16T20:56:36.753 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.753 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.763935+0000", 2020-11-16T20:56:36.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0042676880000000004 2020-11-16T20:56:36.754 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.754 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.754 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.754 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768203+0000", 2020-11-16T20:56:36.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7779999999999996e-06 2020-11-16T20:56:36.754 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.755 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.755 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768212+0000", 2020-11-16T20:56:36.755 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1191e-05 2020-11-16T20:56:36.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.755 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.756 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768223+0000", 2020-11-16T20:56:36.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.148e-06 2020-11-16T20:56:36.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.756 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.756 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.756 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768230+0000", 2020-11-16T20:56:36.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9489e-05 2020-11-16T20:56:36.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768280+0000", 2020-11-16T20:56:36.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9222e-05 2020-11-16T20:56:36.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768299+0000", 2020-11-16T20:56:36.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0093848479999999995 2020-11-16T20:56:36.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.777684+0000", 2020-11-16T20:56:36.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3158999999999998e-05 2020-11-16T20:56:36.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.759 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.777727+0000", 2020-11-16T20:56:36.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013791523 2020-11-16T20:56:36.759 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.759 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.760 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.760 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:1058 4.3 e35/22 4:c9fee0b4:::smithi16641208-235:head v 35'59, mlcod=35'56)", 2020-11-16T20:56:36.760 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.768272+0000", 2020-11-16T20:56:36.760 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 41.977459097999997, 2020-11-16T20:56:36.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011567512, 2020-11-16T20:56:36.760 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.761 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.761 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.761 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.761 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768272+0000", 2020-11-16T20:56:36.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.768272+0000", 2020-11-16T20:56:36.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00087617900000000004 2020-11-16T20:56:36.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.769148+0000", 2020-11-16T20:56:36.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7769999999999997e-06 2020-11-16T20:56:36.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.769155+0000", 2020-11-16T20:56:36.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1951e-05 2020-11-16T20:56:36.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.764 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.769167+0000", 2020-11-16T20:56:36.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6080000000000001e-06 2020-11-16T20:56:36.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.769173+0000", 2020-11-16T20:56:36.765 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0022666840000000001 2020-11-16T20:56:36.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.765 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.771440+0000", 2020-11-16T20:56:36.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0822999999999999e-05 2020-11-16T20:56:36.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.771471+0000", 2020-11-16T20:56:36.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0083200759999999992 2020-11-16T20:56:36.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.767 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.779791+0000", 2020-11-16T20:56:36.767 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8414000000000001e-05 2020-11-16T20:56:36.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.767 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.779839+0000", 2020-11-16T20:56:36.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011567512 2020-11-16T20:56:36.768 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.768 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.768 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.768 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:286 4.3 e35/22 4:d76da88a:::smithi16641208-241:head v 35'61, mlcod=35'59)", 2020-11-16T20:56:36.769 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.874677+0000", 2020-11-16T20:56:36.769 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 41.871053654000001, 2020-11-16T20:56:36.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01129728, 2020-11-16T20:56:36.769 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.769 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.769 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.770 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.874677+0000", 2020-11-16T20:56:36.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.770 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.770 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.874677+0000", 2020-11-16T20:56:36.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0037049460000000002 2020-11-16T20:56:36.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.771 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.771 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.878382+0000", 2020-11-16T20:56:36.771 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6219999999999998e-06 2020-11-16T20:56:36.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.771 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.772 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.878391+0000", 2020-11-16T20:56:36.772 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2730000000000002e-06 2020-11-16T20:56:36.772 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.772 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.772 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.772 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.878399+0000", 2020-11-16T20:56:36.772 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3509999999999996e-06 2020-11-16T20:56:36.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.773 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.773 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.878407+0000", 2020-11-16T20:56:36.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8167999999999997e-05 2020-11-16T20:56:36.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.773 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.878455+0000", 2020-11-16T20:56:36.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4728000000000001e-05 2020-11-16T20:56:36.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.878479+0000", 2020-11-16T20:56:36.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074377230000000003 2020-11-16T20:56:36.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.885917+0000", 2020-11-16T20:56:36.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7469000000000002e-05 2020-11-16T20:56:36.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.885975+0000", 2020-11-16T20:56:36.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01129728 2020-11-16T20:56:36.776 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.776 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.776 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.776 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:361 4.3 e36/22 4:c982201a:::smithi16641208-344:head v 36'68, mlcod=35'66)", 2020-11-16T20:56:36.777 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:56.539838+0000", 2020-11-16T20:56:36.777 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 40.205892808000002, 2020-11-16T20:56:36.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016918861, 2020-11-16T20:56:36.777 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.777 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.777 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.539838+0000", 2020-11-16T20:56:36.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.539838+0000", 2020-11-16T20:56:36.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0063033710000000003 2020-11-16T20:56:36.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.546142+0000", 2020-11-16T20:56:36.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1715e-05 2020-11-16T20:56:36.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.546153+0000", 2020-11-16T20:56:36.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0464e-05 2020-11-16T20:56:36.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.546164+0000", 2020-11-16T20:56:36.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1470000000000001e-06 2020-11-16T20:56:36.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.546172+0000", 2020-11-16T20:56:36.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8400999999999995e-05 2020-11-16T20:56:36.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.782 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.782 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.546270+0000", 2020-11-16T20:56:36.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0125999999999999e-05 2020-11-16T20:56:36.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.782 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.782 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.546300+0000", 2020-11-16T20:56:36.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010385676999999999 2020-11-16T20:56:36.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.783 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.783 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.783 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.556686+0000", 2020-11-16T20:56:36.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0959999999999998e-05 2020-11-16T20:56:36.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.783 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:56.556757+0000", 2020-11-16T20:56:36.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016918861 2020-11-16T20:56:36.784 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.784 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.784 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.785 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:537 4.3 e41/22 4:c97658cf:::smithi16641208-283:head v 41'94, mlcod=36'92)", 2020-11-16T20:56:36.785 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:04.013912+0000", 2020-11-16T20:56:36.785 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.731818668999999, 2020-11-16T20:56:36.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011964577000000001, 2020-11-16T20:56:36.785 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.785 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.786 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.786 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.786 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.013912+0000", 2020-11-16T20:56:36.786 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.787 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.787 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.013912+0000", 2020-11-16T20:56:36.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00537639 2020-11-16T20:56:36.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.787 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.787 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.019289+0000", 2020-11-16T20:56:36.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8269999999999993e-06 2020-11-16T20:56:36.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.788 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.019299+0000", 2020-11-16T20:56:36.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2023e-05 2020-11-16T20:56:36.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.019311+0000", 2020-11-16T20:56:36.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7510000000000003e-06 2020-11-16T20:56:36.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.019320+0000", 2020-11-16T20:56:36.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3052e-05 2020-11-16T20:56:36.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.790 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.790 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.019363+0000", 2020-11-16T20:56:36.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6609999999999999e-05 2020-11-16T20:56:36.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.791 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.791 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.019380+0000", 2020-11-16T20:56:36.791 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064317350000000001 2020-11-16T20:56:36.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.791 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.791 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.025812+0000", 2020-11-16T20:56:36.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5189000000000002e-05 2020-11-16T20:56:36.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.025877+0000", 2020-11-16T20:56:36.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011964577000000001 2020-11-16T20:56:36.792 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.793 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.793 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.793 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:538 4.3 e41/22 4:c9160c9c:::smithi16641208-411:head v 41'95, mlcod=37'93)", 2020-11-16T20:56:36.793 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:04.125639+0000", 2020-11-16T20:56:36.793 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.620092421999999, 2020-11-16T20:56:36.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017440449, 2020-11-16T20:56:36.794 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.794 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.794 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125639+0000", 2020-11-16T20:56:36.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.795 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125639+0000", 2020-11-16T20:56:36.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051874809999999999 2020-11-16T20:56:36.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130826+0000", 2020-11-16T20:56:36.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1416999999999999e-05 2020-11-16T20:56:36.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130837+0000", 2020-11-16T20:56:36.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1552999999999999e-05 2020-11-16T20:56:36.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130849+0000", 2020-11-16T20:56:36.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1341e-05 2020-11-16T20:56:36.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130860+0000", 2020-11-16T20:56:36.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4345000000000006e-05 2020-11-16T20:56:36.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130955+0000", 2020-11-16T20:56:36.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0686999999999997e-05 2020-11-16T20:56:36.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.131015+0000", 2020-11-16T20:56:36.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011987345999999999 2020-11-16T20:56:36.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.800 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.143003+0000", 2020-11-16T20:56:36.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6279000000000006e-05 2020-11-16T20:56:36.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.800 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.143079+0000", 2020-11-16T20:56:36.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017440449 2020-11-16T20:56:36.801 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.801 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.801 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.801 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:539 4.3 e41/22 4:c9160c9c:::smithi16641208-411:6 v 41'96, mlcod=37'93)", 2020-11-16T20:56:36.802 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:04.133431+0000", 2020-11-16T20:56:36.802 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.612300329, 2020-11-16T20:56:36.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012154900999999999, 2020-11-16T20:56:36.802 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.802 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.802 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.133431+0000", 2020-11-16T20:56:36.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.133431+0000", 2020-11-16T20:56:36.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004504325 2020-11-16T20:56:36.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.137935+0000", 2020-11-16T20:56:36.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9359999999999994e-06 2020-11-16T20:56:36.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.137945+0000", 2020-11-16T20:56:36.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4032999999999999e-05 2020-11-16T20:56:36.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.137959+0000", 2020-11-16T20:56:36.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1919999999999994e-06 2020-11-16T20:56:36.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.137968+0000", 2020-11-16T20:56:36.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2193000000000005e-05 2020-11-16T20:56:36.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.138040+0000", 2020-11-16T20:56:36.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4004999999999997e-05 2020-11-16T20:56:36.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.138074+0000", 2020-11-16T20:56:36.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074481130000000001 2020-11-16T20:56:36.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.145522+0000", 2020-11-16T20:56:36.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3103999999999998e-05 2020-11-16T20:56:36.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.145586+0000", 2020-11-16T20:56:36.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012154900999999999 2020-11-16T20:56:36.809 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.809 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.809 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.810 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:593 4.3 e46/22 4:c5716d1e:::smithi16641208-111:head v 46'121, mlcod=46'118)", 2020-11-16T20:56:36.810 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:09.075421+0000", 2020-11-16T20:56:36.810 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.670309546999999, 2020-11-16T20:56:36.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015644788999999999, 2020-11-16T20:56:36.810 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.810 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.810 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.075421+0000", 2020-11-16T20:56:36.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.075421+0000", 2020-11-16T20:56:36.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006661335 2020-11-16T20:56:36.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082083+0000", 2020-11-16T20:56:36.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1031e-05 2020-11-16T20:56:36.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082094+0000", 2020-11-16T20:56:36.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5427999999999999e-05 2020-11-16T20:56:36.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082109+0000", 2020-11-16T20:56:36.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7580000000000004e-06 2020-11-16T20:56:36.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082119+0000", 2020-11-16T20:56:36.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6067999999999999e-05 2020-11-16T20:56:36.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082175+0000", 2020-11-16T20:56:36.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4882e-05 2020-11-16T20:56:36.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.082200+0000", 2020-11-16T20:56:36.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088139840000000004 2020-11-16T20:56:36.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.091014+0000", 2020-11-16T20:56:36.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2302999999999997e-05 2020-11-16T20:56:36.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.091066+0000", 2020-11-16T20:56:36.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015644788999999999 2020-11-16T20:56:36.817 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.817 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.817 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.818 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.3.0:498 4.0 e47/22 4:3b92f709:::smithi16641208-69:head v 47'94, mlcod=45'91)", 2020-11-16T20:56:36.818 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:10.026793+0000", 2020-11-16T20:56:36.818 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.718937755999999, 2020-11-16T20:56:36.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011324136, 2020-11-16T20:56:36.818 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.818 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.818 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.026793+0000", 2020-11-16T20:56:36.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.026793+0000", 2020-11-16T20:56:36.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0044730280000000004 2020-11-16T20:56:36.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.820 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.031266+0000", 2020-11-16T20:56:36.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3858e-05 2020-11-16T20:56:36.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.031280+0000", 2020-11-16T20:56:36.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.715e-05 2020-11-16T20:56:36.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.031297+0000", 2020-11-16T20:56:36.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2184999999999999e-05 2020-11-16T20:56:36.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.031309+0000", 2020-11-16T20:56:36.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1724999999999995e-05 2020-11-16T20:56:36.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.031381+0000", 2020-11-16T20:56:36.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6733e-05 2020-11-16T20:56:36.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.031408+0000", 2020-11-16T20:56:36.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0066279820000000001 2020-11-16T20:56:36.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.038036+0000", 2020-11-16T20:56:36.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1475000000000002e-05 2020-11-16T20:56:36.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.038117+0000", 2020-11-16T20:56:36.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011324136 2020-11-16T20:56:36.825 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.825 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.826 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.826 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:659 4.3 e57/22 4:d5f06b92:::smithi16641208-65:e v 57'176, mlcod=57'172)", 2020-11-16T20:56:36.826 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.759574+0000", 2020-11-16T20:56:36.826 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.986157454000001, 2020-11-16T20:56:36.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011751119000000001, 2020-11-16T20:56:36.827 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.827 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.827 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759574+0000", 2020-11-16T20:56:36.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759574+0000", 2020-11-16T20:56:36.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5672e-05 2020-11-16T20:56:36.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759609+0000", 2020-11-16T20:56:36.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1580000000000002e-06 2020-11-16T20:56:36.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759615+0000", 2020-11-16T20:56:36.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4220000000000003e-06 2020-11-16T20:56:36.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759623+0000", 2020-11-16T20:56:36.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3190000000000002e-06 2020-11-16T20:56:36.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759628+0000", 2020-11-16T20:56:36.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3109000000000003e-05 2020-11-16T20:56:36.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759681+0000", 2020-11-16T20:56:36.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9561000000000001e-05 2020-11-16T20:56:36.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759701+0000", 2020-11-16T20:56:36.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011559477 2020-11-16T20:56:36.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.771260+0000", 2020-11-16T20:56:36.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4400999999999995e-05 2020-11-16T20:56:36.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.771325+0000", 2020-11-16T20:56:36.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011751119000000001 2020-11-16T20:56:36.833 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.834 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.834 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.834 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:660 4.3 e57/22 4:fc3a32b3:::smithi16641208-6:14 v 57'178, mlcod=57'172)", 2020-11-16T20:56:36.834 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.759657+0000", 2020-11-16T20:56:36.834 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.986073770000001, 2020-11-16T20:56:36.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011717154, 2020-11-16T20:56:36.835 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.835 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.835 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759657+0000", 2020-11-16T20:56:36.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759657+0000", 2020-11-16T20:56:36.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1059999999999997e-05 2020-11-16T20:56:36.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759688+0000", 2020-11-16T20:56:36.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4467999999999999e-05 2020-11-16T20:56:36.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759703+0000", 2020-11-16T20:56:36.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7870000000000004e-06 2020-11-16T20:56:36.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759710+0000", 2020-11-16T20:56:36.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8199999999999998e-06 2020-11-16T20:56:36.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.759713+0000", 2020-11-16T20:56:36.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0018547539999999999 2020-11-16T20:56:36.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.761568+0000", 2020-11-16T20:56:36.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5524000000000001e-05 2020-11-16T20:56:36.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.761604+0000", 2020-11-16T20:56:36.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0097264959999999994 2020-11-16T20:56:36.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.771330+0000", 2020-11-16T20:56:36.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4245000000000001e-05 2020-11-16T20:56:36.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.771374+0000", 2020-11-16T20:56:36.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011717154 2020-11-16T20:56:36.842 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.842 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.842 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.842 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:663 4.3 e57/22 4:f65e82cb:::smithi16641208-219:head v 57'179, mlcod=57'176)", 2020-11-16T20:56:36.842 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.796847+0000", 2020-11-16T20:56:36.843 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.948884086, 2020-11-16T20:56:36.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.053788638999999999, 2020-11-16T20:56:36.843 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.843 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.843 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796847+0000", 2020-11-16T20:56:36.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796847+0000", 2020-11-16T20:56:36.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016730294999999999 2020-11-16T20:56:36.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813577+0000", 2020-11-16T20:56:36.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3168e-05 2020-11-16T20:56:36.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813590+0000", 2020-11-16T20:56:36.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.203e-05 2020-11-16T20:56:36.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813602+0000", 2020-11-16T20:56:36.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4837999999999999e-05 2020-11-16T20:56:36.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813617+0000", 2020-11-16T20:56:36.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010021 2020-11-16T20:56:36.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813717+0000", 2020-11-16T20:56:36.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7735000000000003e-05 2020-11-16T20:56:36.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813765+0000", 2020-11-16T20:56:36.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036802020999999997 2020-11-16T20:56:36.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.850567+0000", 2020-11-16T20:56:36.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8342000000000004e-05 2020-11-16T20:56:36.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.850636+0000", 2020-11-16T20:56:36.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.053788638999999999 2020-11-16T20:56:36.850 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.850 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.850 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.851 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2589 4.3 e57/22 4:f65e82cb:::smithi16641208-219:head v 57'180, mlcod=57'176)", 2020-11-16T20:56:36.851 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.813687+0000", 2020-11-16T20:56:36.851 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.932043633999999, 2020-11-16T20:56:36.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.037630996, 2020-11-16T20:56:36.851 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.851 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.851 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813687+0000", 2020-11-16T20:56:36.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.813687+0000", 2020-11-16T20:56:36.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010138436000000001 2020-11-16T20:56:36.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.823826+0000", 2020-11-16T20:56:36.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5939999999999996e-06 2020-11-16T20:56:36.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.823833+0000", 2020-11-16T20:56:36.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8019999999999998e-06 2020-11-16T20:56:36.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.823842+0000", 2020-11-16T20:56:36.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8880000000000002e-06 2020-11-16T20:56:36.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.823848+0000", 2020-11-16T20:56:36.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2058000000000002e-05 2020-11-16T20:56:36.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.823900+0000", 2020-11-16T20:56:36.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0489e-05 2020-11-16T20:56:36.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.823921+0000", 2020-11-16T20:56:36.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027347369 2020-11-16T20:56:36.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851268+0000", 2020-11-16T20:56:36.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0359999999999999e-05 2020-11-16T20:56:36.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851318+0000", 2020-11-16T20:56:36.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.037630996 2020-11-16T20:56:36.858 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.858 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.858 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.859 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2590 4.3 e57/22 4:f65e82cb:::smithi16641208-219:head v 57'181, mlcod=57'176)", 2020-11-16T20:56:36.859 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.823889+0000", 2020-11-16T20:56:36.859 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.921841889, 2020-11-16T20:56:36.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027470371, 2020-11-16T20:56:36.859 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.860 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.860 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.823889+0000", 2020-11-16T20:56:36.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.823889+0000", 2020-11-16T20:56:36.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030437800000000001 2020-11-16T20:56:36.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824193+0000", 2020-11-16T20:56:36.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7940000000000008e-06 2020-11-16T20:56:36.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824202+0000", 2020-11-16T20:56:36.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1396999999999999e-05 2020-11-16T20:56:36.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824214+0000", 2020-11-16T20:56:36.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2600000000000002e-06 2020-11-16T20:56:36.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824220+0000", 2020-11-16T20:56:36.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023416909999999999 2020-11-16T20:56:36.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.826562+0000", 2020-11-16T20:56:36.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8850999999999999e-05 2020-11-16T20:56:36.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.826590+0000", 2020-11-16T20:56:36.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024730210999999998 2020-11-16T20:56:36.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851321+0000", 2020-11-16T20:56:36.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8788999999999997e-05 2020-11-16T20:56:36.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851359+0000", 2020-11-16T20:56:36.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027470371 2020-11-16T20:56:36.866 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.866 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.867 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.867 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2591 4.3 e57/22 4:f65e82cb:::smithi16641208-219:head v 57'182, mlcod=57'176)", 2020-11-16T20:56:36.867 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.824255+0000", 2020-11-16T20:56:36.867 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.921475663999999, 2020-11-16T20:56:36.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027144567000000001, 2020-11-16T20:56:36.868 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.868 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.868 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824255+0000", 2020-11-16T20:56:36.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824255+0000", 2020-11-16T20:56:36.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8541999999999997e-05 2020-11-16T20:56:36.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824304+0000", 2020-11-16T20:56:36.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7320000000000003e-06 2020-11-16T20:56:36.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824310+0000", 2020-11-16T20:56:36.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0047000000000001e-05 2020-11-16T20:56:36.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824320+0000", 2020-11-16T20:56:36.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.279e-06 2020-11-16T20:56:36.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824324+0000", 2020-11-16T20:56:36.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0029814379999999999 2020-11-16T20:56:36.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.827305+0000", 2020-11-16T20:56:36.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8090000000000001e-05 2020-11-16T20:56:36.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.827323+0000", 2020-11-16T20:56:36.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024037699999999999 2020-11-16T20:56:36.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851361+0000", 2020-11-16T20:56:36.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8739000000000003e-05 2020-11-16T20:56:36.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851400+0000", 2020-11-16T20:56:36.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027144567000000001 2020-11-16T20:56:36.874 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.875 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.875 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.875 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:667 4.3 e57/22 4:f5f8fa2a:::smithi16641208-144:head v 57'183, mlcod=57'181)", 2020-11-16T20:56:36.875 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.861028+0000", 2020-11-16T20:56:36.875 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.884702740000002, 2020-11-16T20:56:36.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013994273999999999, 2020-11-16T20:56:36.876 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.876 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.876 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.861028+0000", 2020-11-16T20:56:36.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.861028+0000", 2020-11-16T20:56:36.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006986707 2020-11-16T20:56:36.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.868015+0000", 2020-11-16T20:56:36.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9870000000000005e-06 2020-11-16T20:56:36.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.868024+0000", 2020-11-16T20:56:36.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3794999999999999e-05 2020-11-16T20:56:36.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.868038+0000", 2020-11-16T20:56:36.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.268e-06 2020-11-16T20:56:36.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.868047+0000", 2020-11-16T20:56:36.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5488999999999997e-05 2020-11-16T20:56:36.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.868102+0000", 2020-11-16T20:56:36.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0601000000000001e-05 2020-11-16T20:56:36.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.881 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.881 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.868123+0000", 2020-11-16T20:56:36.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0068583079999999996 2020-11-16T20:56:36.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.881 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.874981+0000", 2020-11-16T20:56:36.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1118999999999997e-05 2020-11-16T20:56:36.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.875023+0000", 2020-11-16T20:56:36.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013994273999999999 2020-11-16T20:56:36.883 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.883 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.883 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.883 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:728 4.3 e69/22 4:ccdf634d:::smithi16641208-284:head v 69'228, mlcod=61'226)", 2020-11-16T20:56:36.883 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:31.767942+0000", 2020-11-16T20:56:36.884 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.9777885949999998, 2020-11-16T20:56:36.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012602403, 2020-11-16T20:56:36.884 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.884 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.884 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.884 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.767942+0000", 2020-11-16T20:56:36.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.885 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.767942+0000", 2020-11-16T20:56:36.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049673809999999999 2020-11-16T20:56:36.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.772910+0000", 2020-11-16T20:56:36.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8200000000000008e-06 2020-11-16T20:56:36.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.772920+0000", 2020-11-16T20:56:36.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0332e-05 2020-11-16T20:56:36.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.772930+0000", 2020-11-16T20:56:36.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4120000000000001e-06 2020-11-16T20:56:36.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.888 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.888 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.772938+0000", 2020-11-16T20:56:36.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000281372 2020-11-16T20:56:36.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.889 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.773220+0000", 2020-11-16T20:56:36.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8614000000000002e-05 2020-11-16T20:56:36.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.889 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.773238+0000", 2020-11-16T20:56:36.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072611200000000002 2020-11-16T20:56:36.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.890 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.890 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.780499+0000", 2020-11-16T20:56:36.890 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5352000000000002e-05 2020-11-16T20:56:36.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.891 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.891 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.780545+0000", 2020-11-16T20:56:36.891 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012602403 2020-11-16T20:56:36.891 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.891 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.891 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.892 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2874 4.0 e72/22 4:055e14cb:::smithi16641208-187:head v 72'229, mlcod=71'226)", 2020-11-16T20:56:36.892 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:34.756668+0000", 2020-11-16T20:56:36.892 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.9890634359999999, 2020-11-16T20:56:36.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019908466, 2020-11-16T20:56:36.892 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.892 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.892 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.892 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.893 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.756668+0000", 2020-11-16T20:56:36.893 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.893 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.756668+0000", 2020-11-16T20:56:36.894 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067430670000000002 2020-11-16T20:56:36.894 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.894 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.894 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.894 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.763411+0000", 2020-11-16T20:56:36.894 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4307999999999999e-05 2020-11-16T20:56:36.894 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.894 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.895 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.895 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.763425+0000", 2020-11-16T20:56:36.895 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8484000000000001e-05 2020-11-16T20:56:36.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.895 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.895 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.895 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.763443+0000", 2020-11-16T20:56:36.896 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1095e-05 2020-11-16T20:56:36.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.896 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.896 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.763454+0000", 2020-11-16T20:56:36.896 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2473999999999999e-05 2020-11-16T20:56:36.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.897 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.897 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.763507+0000", 2020-11-16T20:56:36.897 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1716999999999999e-05 2020-11-16T20:56:36.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.897 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.897 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.897 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.763529+0000", 2020-11-16T20:56:36.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012979858 2020-11-16T20:56:36.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.898 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.898 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.776509+0000", 2020-11-16T20:56:36.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7463000000000001e-05 2020-11-16T20:56:36.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.899 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.899 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.776576+0000", 2020-11-16T20:56:36.899 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019908466 2020-11-16T20:56:36.899 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.899 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.899 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.900 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.900 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:779 4.3 e72/22 4:d9c18080:::smithi16641208-173:head v 72'266, mlcod=71'264)", 2020-11-16T20:56:36.900 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:34.786334+0000", 2020-11-16T20:56:36.900 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.959396559, 2020-11-16T20:56:36.900 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017795102, 2020-11-16T20:56:36.900 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:36.900 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:36.900 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:36.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:36.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.786334+0000", 2020-11-16T20:56:36.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:36.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.902 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:36.902 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.786334+0000", 2020-11-16T20:56:36.902 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0079172470000000005 2020-11-16T20:56:36.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.902 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:36.902 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.794252+0000", 2020-11-16T20:56:36.902 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.064e-06 2020-11-16T20:56:36.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.903 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:36.903 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.794261+0000", 2020-11-16T20:56:36.903 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2179e-05 2020-11-16T20:56:36.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:36.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.794273+0000", 2020-11-16T20:56:36.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1231e-05 2020-11-16T20:56:36.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:36.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.794284+0000", 2020-11-16T20:56:36.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4400000000000001e-05 2020-11-16T20:56:36.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.905 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:36.905 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.794339+0000", 2020-11-16T20:56:36.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4193e-05 2020-11-16T20:56:36.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.906 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:36.906 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.794363+0000", 2020-11-16T20:56:36.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0096983269999999996 2020-11-16T20:56:36.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.906 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:36.906 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.804061+0000", 2020-11-16T20:56:36.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8460999999999994e-05 2020-11-16T20:56:36.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:36.907 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:36.907 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:36.907 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.804130+0000", 2020-11-16T20:56:36.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017795102 2020-11-16T20:56:36.907 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.907 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.908 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.908 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:36.908 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:36.908 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:36.908 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:56:36.909 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2020-11-16T20:56:36.910 INFO:tasks.rados.rados.0.smithi166.stdout:785: done (0 left) 2020-11-16T20:56:36.910 INFO:tasks.rados.rados.0.smithi166.stdout:786: snap_remove snap 18 2020-11-16T20:56:36.911 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:36.914+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:36.911 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:56:37.010 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:37.015+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:37.071 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:56:37.091 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:56:37.111 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:37.115+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:37.112 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:56:37.114 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:37.114 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:37.124 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:56:37.132 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:56:37.153 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:56:37.174 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:56:37.193 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:56:37.211 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:37.216+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:37.213 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:56:37.215 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:56:37.215 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:56:37.215 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:56:37.215 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:56:37.216 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:56:37.216 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:56:37.216 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:56:37.216 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:56:37.274 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:37.274 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:37.284 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:56:37.312 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:37.317+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:37.409 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:37.409 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:37.413 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:37.418+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:37.418 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:56:37.514 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:37.519+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:37.544 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:37.544 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:37.554 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:56:37.615 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:37.619+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:37.679 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:37.679 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:37.688 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:56:37.731 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:37.735+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:37.741 INFO:tasks.rados.rados.0.smithi166.stdout:786: done (0 left) 2020-11-16T20:56:37.742 INFO:tasks.rados.rados.0.smithi166.stdout:787: cache_evict oid 299 snap 17 2020-11-16T20:56:37.742 INFO:tasks.rados.rados.0.smithi166.stdout:788: cache_evict oid 302 snap -1 2020-11-16T20:56:37.742 INFO:tasks.rados.rados.0.smithi166.stdout:789: snap_remove snap 20 2020-11-16T20:56:37.753 INFO:teuthology.orchestra.run.smithi166.stderr:noscrub is unset 2020-11-16T20:56:37.756 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:56:37.756 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:56:37.756 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2020-11-16T20:56:37.816 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:37.820+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:37.837 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:37.837 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:37.847 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:56:37.916 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:37.921+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:37.985 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:37.985 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:37.995 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:56:38.017 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:38.022+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:38.085 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:56:38.085 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:38.085 INFO:teuthology.orchestra.run.smithi166.stdout: "epoch": 75, 2020-11-16T20:56:38.085 INFO:teuthology.orchestra.run.smithi166.stdout: "fsid": "a14fd848-4cfe-4cd9-9140-5b3c4b4e904d", 2020-11-16T20:56:38.085 INFO:teuthology.orchestra.run.smithi166.stdout: "created": "2020-11-16T20:54:44.938121+0000", 2020-11-16T20:56:38.085 INFO:teuthology.orchestra.run.smithi166.stdout: "modified": "2020-11-16T20:56:37.739507+0000", 2020-11-16T20:56:38.086 INFO:teuthology.orchestra.run.smithi166.stdout: "last_up_change": "2020-11-16T20:54:52.080163+0000", 2020-11-16T20:56:38.086 INFO:teuthology.orchestra.run.smithi166.stdout: "last_in_change": "2020-11-16T20:54:52.080163+0000", 2020-11-16T20:56:38.086 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-11-16T20:56:38.086 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_num": 5804032, 2020-11-16T20:56:38.086 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_set": [ 2020-11-16T20:56:38.086 INFO:teuthology.orchestra.run.smithi166.stdout: "nodeep-scrub", 2020-11-16T20:56:38.086 INFO:teuthology.orchestra.run.smithi166.stdout: "pglog_hardlimit", 2020-11-16T20:56:38.087 INFO:teuthology.orchestra.run.smithi166.stdout: "purged_snapdirs", 2020-11-16T20:56:38.087 INFO:teuthology.orchestra.run.smithi166.stdout: "recovery_deletes", 2020-11-16T20:56:38.087 INFO:teuthology.orchestra.run.smithi166.stdout: "sortbitwise" 2020-11-16T20:56:38.087 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:38.087 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_version": 6, 2020-11-16T20:56:38.087 INFO:teuthology.orchestra.run.smithi166.stdout: "full_ratio": 0.94999998807907104, 2020-11-16T20:56:38.087 INFO:teuthology.orchestra.run.smithi166.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-11-16T20:56:38.088 INFO:teuthology.orchestra.run.smithi166.stdout: "nearfull_ratio": 0.85000002384185791, 2020-11-16T20:56:38.088 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_snapshot": "", 2020-11-16T20:56:38.088 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_max": 4, 2020-11-16T20:56:38.088 INFO:teuthology.orchestra.run.smithi166.stdout: "max_osd": 8, 2020-11-16T20:56:38.088 INFO:teuthology.orchestra.run.smithi166.stdout: "require_min_compat_client": "luminous", 2020-11-16T20:56:38.088 INFO:teuthology.orchestra.run.smithi166.stdout: "min_compat_client": "luminous", 2020-11-16T20:56:42.454 INFO:teuthology.orchestra.run.smithi166.stdout: "require_osd_release": "pacific", 2020-11-16T20:56:42.454 INFO:teuthology.orchestra.run.smithi166.stdout: "pools": [ 2020-11-16T20:56:42.454 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.455 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 1, 2020-11-16T20:56:42.455 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "device_health_metrics", 2020-11-16T20:56:42.455 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:54:49.109999+0000", 2020-11-16T20:56:42.455 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 1, 2020-11-16T20:56:42.455 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool", 2020-11-16T20:56:42.455 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:56:42.455 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:56:42.456 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:56:42.456 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:56:42.456 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:56:42.456 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:56:42.456 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:56:42.456 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:56:42.457 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:56:42.457 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:56:42.457 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 1, 2020-11-16T20:56:42.457 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 1, 2020-11-16T20:56:42.457 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 1, 2020-11-16T20:56:42.457 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 1, 2020-11-16T20:56:42.457 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 1, 2020-11-16T20:56:42.458 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:56:42.458 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:56:42.458 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:56:42.458 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:56:42.458 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:56:42.458 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:56:42.458 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:56:42.459 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.459 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "15", 2020-11-16T20:56:42.459 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "0", 2020-11-16T20:56:42.459 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-16T20:56:42.459 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "0", 2020-11-16T20:56:42.459 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:56:42.459 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:56:42.460 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 0, 2020-11-16T20:56:42.460 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 0, 2020-11-16T20:56:42.460 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:56:42.460 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:56:42.460 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:56:42.460 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:56:42.460 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:56:42.461 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:56:42.461 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:56:42.461 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:56:42.461 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:56:42.461 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:56:42.461 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:56:42.461 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:56:42.462 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:56:42.462 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:56:42.462 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:56:42.462 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:56:42.462 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:56:42.462 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:56:42.462 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:56:42.463 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.463 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:56:42.463 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:56:42.463 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:56:42.463 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:56:42.463 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:56:42.463 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:56:42.464 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:56:42.464 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:56:42.464 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:56:42.464 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:56:42.464 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:56:42.464 INFO:teuthology.orchestra.run.smithi166.stdout: "options": { 2020-11-16T20:56:42.464 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_min": 1 2020-11-16T20:56:42.464 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.465 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:56:42.465 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_devicehealth": {} 2020-11-16T20:56:42.465 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.465 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.465 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.465 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 2, 2020-11-16T20:56:42.465 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "rbd", 2020-11-16T20:56:42.466 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:54:53.253680+0000", 2020-11-16T20:56:42.466 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 1, 2020-11-16T20:56:42.466 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool", 2020-11-16T20:56:42.466 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:56:42.466 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:56:42.466 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:56:42.466 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:56:42.467 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:56:42.467 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:56:42.467 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:56:42.467 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:56:42.467 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:56:42.467 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:56:42.467 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 18, 2020-11-16T20:56:42.468 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 18, 2020-11-16T20:56:42.468 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 18, 2020-11-16T20:56:42.468 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 18, 2020-11-16T20:56:42.468 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 18, 2020-11-16T20:56:42.468 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:56:42.468 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:56:42.468 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:56:42.469 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:56:42.469 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:56:42.469 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:56:42.469 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:56:42.469 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.469 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "34", 2020-11-16T20:56:42.469 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "0", 2020-11-16T20:56:42.469 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-16T20:56:42.470 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "32", 2020-11-16T20:56:42.470 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:56:42.470 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:56:42.470 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 0, 2020-11-16T20:56:42.470 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 0, 2020-11-16T20:56:42.470 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:56:42.470 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:56:42.471 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:56:42.471 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:56:42.471 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:56:42.471 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:56:42.471 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:56:42.471 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:56:42.471 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:56:42.471 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:56:42.472 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:56:42.472 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:56:42.472 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:56:42.472 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:56:42.472 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:56:42.472 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:56:42.472 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:56:42.473 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:56:42.473 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:56:42.473 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.473 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:56:42.473 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:56:42.473 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:56:42.473 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:56:42.474 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:56:42.474 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:56:42.474 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:56:42.474 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:56:42.474 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:56:42.475 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:56:42.475 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:56:42.475 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:56:42.475 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:56:42.475 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd": {} 2020-11-16T20:56:42.475 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.475 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.476 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.476 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 3, 2020-11-16T20:56:42.476 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "base", 2020-11-16T20:56:42.476 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:55:23.597952+0000", 2020-11-16T20:56:42.476 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 8193, 2020-11-16T20:56:42.476 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2020-11-16T20:56:42.476 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:56:42.477 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:56:42.477 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:56:42.477 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:56:42.477 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:56:42.477 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:56:42.477 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:56:42.477 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:56:42.478 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:56:42.478 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:56:42.478 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 4, 2020-11-16T20:56:42.478 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 4, 2020-11-16T20:56:42.478 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 4, 2020-11-16T20:56:42.478 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 4, 2020-11-16T20:56:42.478 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 4, 2020-11-16T20:56:42.478 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:56:42.479 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:56:42.479 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:56:42.479 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:56:42.479 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:56:42.479 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:56:42.479 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:56:42.479 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.480 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "75", 2020-11-16T20:56:42.480 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "27", 2020-11-16T20:56:42.480 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "27", 2020-11-16T20:56:42.480 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "27", 2020-11-16T20:56:42.480 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:56:42.480 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:56:42.480 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 40, 2020-11-16T20:56:42.481 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 75, 2020-11-16T20:56:42.481 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:56:42.481 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:56:42.481 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:56:42.481 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:56:42.481 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [ 2020-11-16T20:56:42.481 INFO:teuthology.orchestra.run.smithi166.stdout: 4 2020-11-16T20:56:42.481 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:42.482 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:56:42.482 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": 4, 2020-11-16T20:56:42.482 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": 4, 2020-11-16T20:56:42.482 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:56:42.482 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:56:42.482 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:56:42.482 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:56:42.483 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:56:42.483 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:56:42.483 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:56:42.483 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:56:42.483 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:56:42.483 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:56:42.483 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:56:42.484 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.484 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:56:42.484 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:56:42.484 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:56:42.484 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:56:42.484 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:56:42.484 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:56:42.484 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:56:42.485 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:56:42.485 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:56:42.485 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:56:42.485 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:56:42.485 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:56:42.485 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:56:42.485 INFO:teuthology.orchestra.run.smithi166.stdout: "rados": {} 2020-11-16T20:56:42.486 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.486 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.486 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.486 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 4, 2020-11-16T20:56:42.486 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "cache", 2020-11-16T20:56:42.486 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:55:28.901773+0000", 2020-11-16T20:56:42.487 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 8201, 2020-11-16T20:56:42.487 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool,incomplete_clones,selfmanaged_snaps", 2020-11-16T20:56:42.487 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:56:42.487 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:56:42.487 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:56:42.487 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:56:42.487 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:56:42.488 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:56:42.488 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:56:42.488 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:56:42.488 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:56:42.488 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:56:42.488 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 4, 2020-11-16T20:56:42.489 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 4, 2020-11-16T20:56:42.489 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 4, 2020-11-16T20:56:42.489 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 4, 2020-11-16T20:56:42.489 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 4, 2020-11-16T20:56:42.489 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:56:42.489 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:56:42.489 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:56:42.490 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:56:42.490 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:56:42.490 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:56:42.490 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:56:42.490 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.490 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "75", 2020-11-16T20:56:42.490 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "27", 2020-11-16T20:56:42.491 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "27", 2020-11-16T20:56:42.491 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "27", 2020-11-16T20:56:42.491 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:56:42.491 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:56:42.491 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 40, 2020-11-16T20:56:42.491 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 75, 2020-11-16T20:56:42.491 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:56:42.491 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:56:42.492 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:56:42.492 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:56:42.492 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:56:42.492 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": 3, 2020-11-16T20:56:42.492 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:56:42.492 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:56:42.493 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "writeback", 2020-11-16T20:56:42.493 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:56:42.493 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 250, 2020-11-16T20:56:42.493 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:56:42.493 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:56:42.493 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:56:42.493 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:56:42.493 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:56:42.494 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:56:42.494 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:56:42.494 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "bloom", 2020-11-16T20:56:42.494 INFO:teuthology.orchestra.run.smithi166.stdout: "false_positive_probability": 0.050000000000000003, 2020-11-16T20:56:42.494 INFO:teuthology.orchestra.run.smithi166.stdout: "target_size": 0, 2020-11-16T20:56:42.494 INFO:teuthology.orchestra.run.smithi166.stdout: "seed": 0 2020-11-16T20:56:42.495 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.495 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 3600, 2020-11-16T20:56:42.495 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 8, 2020-11-16T20:56:42.495 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:56:42.495 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 2, 2020-11-16T20:56:42.495 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:56:42.495 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:56:42.495 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:56:42.496 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [ 2020-11-16T20:56:42.496 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:42.496 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:42.496 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:42.496 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:42.496 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:42.496 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:42.497 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:42.497 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000 2020-11-16T20:56:42.497 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:42.497 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:56:42.497 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:56:42.497 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:56:42.497 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:56:42.498 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": {} 2020-11-16T20:56:42.498 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.498 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:42.498 INFO:teuthology.orchestra.run.smithi166.stdout: "osds": [ 2020-11-16T20:56:42.498 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.498 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 0, 2020-11-16T20:56:42.499 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "35950122-efbd-420e-b07a-f5730f26df17", 2020-11-16T20:56:42.499 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:42.499 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:42.499 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:42.499 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:42.499 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:42.499 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:42.499 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:42.500 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 22, 2020-11-16T20:56:42.500 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:42.500 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:42.500 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:42.500 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.500 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.500 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.501 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6800", 2020-11-16T20:56:42.501 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:56:42.501 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.501 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.501 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.501 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:42.501 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.501 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.502 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.502 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6802", 2020-11-16T20:56:42.502 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:56:42.502 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.502 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.502 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.502 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:42.503 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.503 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.503 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.503 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6806", 2020-11-16T20:56:42.503 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:56:42.503 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.503 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.503 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.504 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:42.504 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.504 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.504 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.504 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6804", 2020-11-16T20:56:42.504 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:56:42.504 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.505 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.505 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.505 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6800/35293", 2020-11-16T20:56:42.505 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6802/35293", 2020-11-16T20:56:42.505 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6806/35293", 2020-11-16T20:56:42.505 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6804/35293", 2020-11-16T20:56:42.505 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:42.506 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:42.506 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:42.506 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.506 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.506 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.506 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 1, 2020-11-16T20:56:42.506 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "f768a1ff-3e8a-4131-a6ed-10f93b3ca900", 2020-11-16T20:56:42.507 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:42.507 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:42.507 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:42.507 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:42.507 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:42.507 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:42.507 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:42.507 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 66, 2020-11-16T20:56:42.508 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:42.508 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:42.508 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:42.508 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.508 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.508 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.508 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6808", 2020-11-16T20:56:42.509 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:56:42.509 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.509 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.509 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.509 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:42.509 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.509 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.509 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.510 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6809", 2020-11-16T20:56:42.510 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:56:42.510 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.510 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.510 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.510 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:42.510 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.511 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.511 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.511 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6811", 2020-11-16T20:56:42.511 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:56:42.511 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.511 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.511 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.511 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:42.512 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.512 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.512 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.512 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6810", 2020-11-16T20:56:42.512 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:56:42.512 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.512 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.513 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.513 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6808/35323", 2020-11-16T20:56:42.513 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6809/35323", 2020-11-16T20:56:42.513 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6811/35323", 2020-11-16T20:56:42.513 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6810/35323", 2020-11-16T20:56:42.513 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:42.513 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:42.513 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:42.514 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.514 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.514 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.514 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 2, 2020-11-16T20:56:42.514 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "88734179-84a6-4a9b-8af0-692805815875", 2020-11-16T20:56:42.514 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:42.514 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:42.515 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:42.515 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:42.515 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:42.515 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:42.515 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:42.515 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 34, 2020-11-16T20:56:42.515 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:42.515 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:42.516 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:42.516 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.516 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.516 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.516 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6801", 2020-11-16T20:56:42.516 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:56:42.517 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.517 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.517 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.517 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:42.517 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.517 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.517 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.517 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6803", 2020-11-16T20:56:42.518 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:56:42.518 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.518 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.518 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.518 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:42.518 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.518 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.519 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.519 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6807", 2020-11-16T20:56:42.519 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:56:42.519 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.519 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.519 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.520 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:42.520 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.520 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.520 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.520 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6805", 2020-11-16T20:56:42.520 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:56:42.520 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.521 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.521 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.521 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6801/35294", 2020-11-16T20:56:42.521 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6803/35294", 2020-11-16T20:56:42.521 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6807/35294", 2020-11-16T20:56:42.521 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6805/35294", 2020-11-16T20:56:42.521 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:42.521 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:42.522 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:42.522 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.522 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.522 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.522 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 3, 2020-11-16T20:56:42.522 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "319e54e8-3f03-4388-8de6-678d148e25d4", 2020-11-16T20:56:42.522 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:42.523 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:42.523 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:42.523 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:42.523 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:42.523 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:42.523 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:42.523 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 22, 2020-11-16T20:56:42.523 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:42.524 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:42.524 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:42.524 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.524 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.524 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.524 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6812", 2020-11-16T20:56:42.524 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:56:42.525 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.525 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.525 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.525 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:42.525 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.525 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.525 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.526 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6813", 2020-11-16T20:56:42.526 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:56:42.526 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.526 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.526 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.526 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:42.526 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.527 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.527 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.527 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6815", 2020-11-16T20:56:42.527 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:56:42.527 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.527 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.527 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.528 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:42.528 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.528 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.528 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.528 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6814", 2020-11-16T20:56:42.528 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:56:42.528 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.529 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.529 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.529 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6812/35324", 2020-11-16T20:56:42.529 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6813/35324", 2020-11-16T20:56:42.529 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6815/35324", 2020-11-16T20:56:42.529 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6814/35324", 2020-11-16T20:56:42.529 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:42.529 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:42.530 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:42.530 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.530 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.530 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.530 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 4, 2020-11-16T20:56:42.530 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "3edbb68e-e030-4379-891e-2412f1235ffb", 2020-11-16T20:56:42.530 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:42.531 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:42.531 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:42.531 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:42.531 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:42.531 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:42.531 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:42.531 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 63, 2020-11-16T20:56:42.532 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:42.532 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:42.532 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:42.532 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.532 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.532 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.532 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6804", 2020-11-16T20:56:42.532 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:56:42.533 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.533 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.533 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.533 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:42.533 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.533 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.533 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.533 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6805", 2020-11-16T20:56:42.534 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:56:42.534 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.534 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.534 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.534 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:42.534 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.534 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.535 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.535 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6807", 2020-11-16T20:56:42.535 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:56:42.535 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.535 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.535 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.535 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:42.536 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.536 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.536 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.536 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6806", 2020-11-16T20:56:42.536 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:56:42.536 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.536 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.537 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.537 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6804/31586", 2020-11-16T20:56:42.537 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6805/31586", 2020-11-16T20:56:42.537 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6807/31586", 2020-11-16T20:56:42.537 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6806/31586", 2020-11-16T20:56:42.537 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:42.537 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:42.537 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:42.538 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.538 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.538 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.538 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 5, 2020-11-16T20:56:42.538 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "44fbf5ac-4484-48a8-a846-1f5c01a6ec2c", 2020-11-16T20:56:42.539 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:42.539 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:42.539 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:42.539 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:42.539 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:42.539 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:42.539 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:42.540 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 63, 2020-11-16T20:56:42.540 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:42.540 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:42.540 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:42.540 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.540 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.540 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.541 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6808", 2020-11-16T20:56:42.541 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:56:42.541 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.541 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.541 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.541 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:42.541 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.541 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.542 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.542 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6810", 2020-11-16T20:56:42.542 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:56:42.542 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.542 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.542 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.542 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:42.543 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.543 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.543 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.543 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6813", 2020-11-16T20:56:42.543 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:56:42.543 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.543 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.543 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.544 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:42.544 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.544 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.544 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.544 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6812", 2020-11-16T20:56:42.544 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:56:42.544 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.545 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.545 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.545 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6808/31610", 2020-11-16T20:56:42.545 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6810/31610", 2020-11-16T20:56:42.545 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6813/31610", 2020-11-16T20:56:42.545 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6812/31610", 2020-11-16T20:56:42.545 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:42.545 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:42.546 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:42.546 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.546 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.546 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.546 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 6, 2020-11-16T20:56:42.546 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "f93b82df-f537-4601-8247-388bf100b5b5", 2020-11-16T20:56:42.547 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:42.547 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:42.547 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 0.5654754638671875, 2020-11-16T20:56:42.547 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:42.547 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:42.547 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:42.547 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:42.548 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 34, 2020-11-16T20:56:42.548 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:42.548 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:42.548 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:42.548 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.548 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.548 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.548 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6800", 2020-11-16T20:56:42.549 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:56:42.549 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.549 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.549 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.549 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:42.549 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.549 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.550 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.550 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6801", 2020-11-16T20:56:42.550 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:56:42.550 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.550 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.550 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.550 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:42.551 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.551 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.551 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.551 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6803", 2020-11-16T20:56:42.551 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:56:42.551 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.551 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.551 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.552 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:42.552 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.552 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.552 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.552 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6802", 2020-11-16T20:56:42.552 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:56:42.552 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.552 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.553 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.553 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6800/31587", 2020-11-16T20:56:42.553 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6801/31587", 2020-11-16T20:56:42.553 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6803/31587", 2020-11-16T20:56:42.553 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6802/31587", 2020-11-16T20:56:42.553 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:42.553 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:42.554 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:42.554 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.554 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.554 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.554 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 7, 2020-11-16T20:56:42.554 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "e5485c88-d267-4a6a-b9b6-15d869d28f28", 2020-11-16T20:56:42.554 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:42.555 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:42.555 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:42.555 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:42.555 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:42.555 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:42.555 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:42.555 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 34, 2020-11-16T20:56:42.556 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:42.556 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:42.556 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:42.556 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.556 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.556 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.556 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6809", 2020-11-16T20:56:42.557 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:56:42.557 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.557 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.557 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.557 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:42.557 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.557 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.557 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.558 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6811", 2020-11-16T20:56:42.558 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:56:42.558 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.558 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.558 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.558 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:42.559 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.559 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.559 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.559 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6815", 2020-11-16T20:56:42.559 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:56:42.559 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.559 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.559 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.560 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:42.560 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:42.560 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.560 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:42.560 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6814", 2020-11-16T20:56:42.560 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:56:42.560 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.561 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.561 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.561 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6809/31617", 2020-11-16T20:56:42.561 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6811/31617", 2020-11-16T20:56:42.561 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6815/31617", 2020-11-16T20:56:42.561 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6814/31617", 2020-11-16T20:56:42.561 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:42.561 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:42.562 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:42.562 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.562 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.562 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:42.562 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_xinfo": [ 2020-11-16T20:56:42.562 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.562 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 0, 2020-11-16T20:56:42.563 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:42.563 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:42.563 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:42.563 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:42.563 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:42.563 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:50.610058+0000", 2020-11-16T20:56:42.563 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:42.563 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.564 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.564 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 1, 2020-11-16T20:56:42.564 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:42.564 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:42.564 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:42.564 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:42.564 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:42.565 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:50.548086+0000", 2020-11-16T20:56:42.565 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:42.565 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.565 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.565 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 2, 2020-11-16T20:56:42.565 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:42.565 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:42.566 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:42.566 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:42.566 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:42.566 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:50.536944+0000", 2020-11-16T20:56:42.566 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:42.566 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.566 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.566 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 3, 2020-11-16T20:56:42.567 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:42.567 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:42.567 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:42.567 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:42.567 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:42.567 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:51.137739+0000", 2020-11-16T20:56:42.567 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:42.568 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.568 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.568 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 4, 2020-11-16T20:56:42.568 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:42.568 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:42.568 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:42.568 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:42.569 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:42.569 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:50.747840+0000", 2020-11-16T20:56:42.569 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:42.569 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.569 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.569 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 5, 2020-11-16T20:56:42.569 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:42.569 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:42.570 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:42.570 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:42.570 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:42.570 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:51.365378+0000", 2020-11-16T20:56:42.570 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:42.570 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.570 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.571 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 6, 2020-11-16T20:56:42.571 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:42.571 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:42.571 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:42.571 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:42.571 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:42.571 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:50.725150+0000", 2020-11-16T20:56:42.572 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:42.572 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.572 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.572 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 7, 2020-11-16T20:56:42.572 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:42.572 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:42.572 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:42.573 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:42.573 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:42.573 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:55:50.621411+0000", 2020-11-16T20:56:42.573 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:42.573 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.573 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:42.573 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_upmap": [ 2020-11-16T20:56:42.574 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.574 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "2.e", 2020-11-16T20:56:42.574 INFO:teuthology.orchestra.run.smithi166.stdout: "osds": [ 2020-11-16T20:56:42.574 INFO:teuthology.orchestra.run.smithi166.stdout: 1, 2020-11-16T20:56:42.574 INFO:teuthology.orchestra.run.smithi166.stdout: 7, 2020-11-16T20:56:42.574 INFO:teuthology.orchestra.run.smithi166.stdout: 0 2020-11-16T20:56:42.574 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.574 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.575 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:42.575 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_upmap_items": [ 2020-11-16T20:56:42.575 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.575 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "2.4", 2020-11-16T20:56:42.575 INFO:teuthology.orchestra.run.smithi166.stdout: "mappings": [ 2020-11-16T20:56:42.575 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.575 INFO:teuthology.orchestra.run.smithi166.stdout: "from": 7, 2020-11-16T20:56:42.576 INFO:teuthology.orchestra.run.smithi166.stdout: "to": 1 2020-11-16T20:56:42.576 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.576 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.576 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.576 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.576 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "4.1", 2020-11-16T20:56:42.576 INFO:teuthology.orchestra.run.smithi166.stdout: "mappings": [ 2020-11-16T20:56:42.577 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.577 INFO:teuthology.orchestra.run.smithi166.stdout: "from": 5, 2020-11-16T20:56:42.577 INFO:teuthology.orchestra.run.smithi166.stdout: "to": 3 2020-11-16T20:56:42.577 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.577 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.577 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.577 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:42.578 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_temp": [], 2020-11-16T20:56:42.578 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_temp": [], 2020-11-16T20:56:42.578 INFO:teuthology.orchestra.run.smithi166.stdout: "blocklist": {}, 2020-11-16T20:56:42.578 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profiles": { 2020-11-16T20:56:42.578 INFO:teuthology.orchestra.run.smithi166.stdout: "default": { 2020-11-16T20:56:42.578 INFO:teuthology.orchestra.run.smithi166.stdout: "crush-failure-domain": "osd", 2020-11-16T20:56:42.578 INFO:teuthology.orchestra.run.smithi166.stdout: "k": "2", 2020-11-16T20:56:42.578 INFO:teuthology.orchestra.run.smithi166.stdout: "m": "1", 2020-11-16T20:56:42.579 INFO:teuthology.orchestra.run.smithi166.stdout: "plugin": "jerasure", 2020-11-16T20:56:42.579 INFO:teuthology.orchestra.run.smithi166.stdout: "ruleset-failure-domain": "osd", 2020-11-16T20:56:42.579 INFO:teuthology.orchestra.run.smithi166.stdout: "technique": "reed_sol_van" 2020-11-16T20:56:42.579 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.579 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.579 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps_queue": [ 2020-11-16T20:56:42.579 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.580 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 3, 2020-11-16T20:56:42.580 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:56:42.580 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.580 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 24, 2020-11-16T20:56:42.580 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:42.580 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.580 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.580 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 28, 2020-11-16T20:56:42.581 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:42.581 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.581 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.581 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 32, 2020-11-16T20:56:42.581 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:42.581 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.581 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.582 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 35, 2020-11-16T20:56:42.582 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:42.582 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.582 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.582 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.582 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.582 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 4, 2020-11-16T20:56:42.582 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:56:42.583 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.583 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 24, 2020-11-16T20:56:42.583 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:42.583 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.583 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.583 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 28, 2020-11-16T20:56:42.583 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:42.584 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.584 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.584 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 32, 2020-11-16T20:56:42.584 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:42.584 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.584 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.584 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 35, 2020-11-16T20:56:42.584 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:42.585 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.585 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.585 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.585 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:42.585 INFO:teuthology.orchestra.run.smithi166.stdout: "new_removed_snaps": [ 2020-11-16T20:56:42.585 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.585 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 3, 2020-11-16T20:56:42.586 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:56:42.586 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.586 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 35, 2020-11-16T20:56:42.586 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:42.586 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.586 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.586 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:42.587 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.587 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 4, 2020-11-16T20:56:42.587 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:56:42.587 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:42.587 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 35, 2020-11-16T20:56:42.587 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:42.587 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.588 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:42.588 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.588 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:42.588 INFO:teuthology.orchestra.run.smithi166.stdout: "new_purged_snaps": [], 2020-11-16T20:56:42.588 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_node_flags": {}, 2020-11-16T20:56:42.588 INFO:teuthology.orchestra.run.smithi166.stdout: "device_class_flags": {}, 2020-11-16T20:56:42.589 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode": { 2020-11-16T20:56:42.589 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode_enabled": false, 2020-11-16T20:56:42.589 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_bucket_count": 0, 2020-11-16T20:56:42.589 INFO:teuthology.orchestra.run.smithi166.stdout: "degraded_stretch_mode": 0, 2020-11-16T20:56:42.589 INFO:teuthology.orchestra.run.smithi166.stdout: "recovering_stretch_mode": 0, 2020-11-16T20:56:42.589 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode_bucket": 0 2020-11-16T20:56:42.589 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:42.590 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:42.590 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:56:42.591 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2020-11-16T20:56:42.599 INFO:tasks.thrashosds.thrasher:j is {'epoch': 75, 'fsid': 'a14fd848-4cfe-4cd9-9140-5b3c4b4e904d', 'created': '2020-11-16T20:54:44.938121+0000', 'modified': '2020-11-16T20:56:37.739507+0000', 'last_up_change': '2020-11-16T20:54:52.080163+0000', 'last_in_change': '2020-11-16T20:54:52.080163+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-16T20:54:49.109999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-16T20:54:53.253680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 18, 'pg_placement_num': 18, 'pg_placement_num_target': 18, 'pg_num_target': 18, 'pg_num_pending': 18, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '32', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'base', 'create_time': '2020-11-16T20:55:23.597952+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 4, 'pg_placement_num': 4, 'pg_placement_num_target': 4, 'pg_num_target': 4, 'pg_num_pending': 4, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '27', 'last_force_op_resend_prenautilus': '27', 'last_force_op_resend_preluminous': '27', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 40, 'snap_epoch': 75, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [4], 'tier_of': -1, 'read_tier': 4, 'write_tier': 4, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 4, 'pool_name': 'cache', 'create_time': '2020-11-16T20:55:28.901773+0000', 'flags': 8201, 'flags_names': 'hashpspool,incomplete_clones,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 4, 'pg_placement_num': 4, 'pg_placement_num_target': 4, 'pg_num_target': 4, 'pg_num_pending': 4, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '27', 'last_force_op_resend_prenautilus': '27', 'last_force_op_resend_preluminous': '27', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 40, 'snap_epoch': 75, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': 3, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'writeback', 'target_max_bytes': 0, 'target_max_objects': 250, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'bloom', 'false_positive_probability': 0.05, 'target_size': 0, 'seed': 0}, 'hit_set_period': 3600, 'hit_set_count': 8, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 2, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [1000000, 1000000, 1000000, 1000000, 1000000, 1000000, 1000000, 1000000], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}}], 'osds': [{'osd': 0, 'uuid': '35950122-efbd-420e-b07a-f5730f26df17', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6800', 'nonce': 35293}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6802', 'nonce': 35293}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6806', 'nonce': 35293}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6804', 'nonce': 35293}]}, 'public_addr': '172.21.15.166:6800/35293', 'cluster_addr': '172.21.15.166:6802/35293', 'heartbeat_back_addr': '172.21.15.166:6806/35293', 'heartbeat_front_addr': '172.21.15.166:6804/35293', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f768a1ff-3e8a-4131-a6ed-10f93b3ca900', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 66, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6808', 'nonce': 35323}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6809', 'nonce': 35323}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6811', 'nonce': 35323}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6810', 'nonce': 35323}]}, 'public_addr': '172.21.15.166:6808/35323', 'cluster_addr': '172.21.15.166:6809/35323', 'heartbeat_back_addr': '172.21.15.166:6811/35323', 'heartbeat_front_addr': '172.21.15.166:6810/35323', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '88734179-84a6-4a9b-8af0-692805815875', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6801', 'nonce': 35294}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6803', 'nonce': 35294}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6807', 'nonce': 35294}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6805', 'nonce': 35294}]}, 'public_addr': '172.21.15.166:6801/35294', 'cluster_addr': '172.21.15.166:6803/35294', 'heartbeat_back_addr': '172.21.15.166:6807/35294', 'heartbeat_front_addr': '172.21.15.166:6805/35294', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '319e54e8-3f03-4388-8de6-678d148e25d4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6812', 'nonce': 35324}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6813', 'nonce': 35324}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6815', 'nonce': 35324}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6814', 'nonce': 35324}]}, 'public_addr': '172.21.15.166:6812/35324', 'cluster_addr': '172.21.15.166:6813/35324', 'heartbeat_back_addr': '172.21.15.166:6815/35324', 'heartbeat_front_addr': '172.21.15.166:6814/35324', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '3edbb68e-e030-4379-891e-2412f1235ffb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 63, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6804', 'nonce': 31586}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6805', 'nonce': 31586}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6807', 'nonce': 31586}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6806', 'nonce': 31586}]}, 'public_addr': '172.21.15.59:6804/31586', 'cluster_addr': '172.21.15.59:6805/31586', 'heartbeat_back_addr': '172.21.15.59:6807/31586', 'heartbeat_front_addr': '172.21.15.59:6806/31586', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '44fbf5ac-4484-48a8-a846-1f5c01a6ec2c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 63, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6808', 'nonce': 31610}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6810', 'nonce': 31610}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6813', 'nonce': 31610}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6812', 'nonce': 31610}]}, 'public_addr': '172.21.15.59:6808/31610', 'cluster_addr': '172.21.15.59:6810/31610', 'heartbeat_back_addr': '172.21.15.59:6813/31610', 'heartbeat_front_addr': '172.21.15.59:6812/31610', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'f93b82df-f537-4601-8247-388bf100b5b5', 'up': 1, 'in': 1, 'weight': 0.5654754638671875, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6800', 'nonce': 31587}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6801', 'nonce': 31587}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6803', 'nonce': 31587}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6802', 'nonce': 31587}]}, 'public_addr': '172.21.15.59:6800/31587', 'cluster_addr': '172.21.15.59:6801/31587', 'heartbeat_back_addr': '172.21.15.59:6803/31587', 'heartbeat_front_addr': '172.21.15.59:6802/31587', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'e5485c88-d267-4a6a-b9b6-15d869d28f28', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6809', 'nonce': 31617}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6811', 'nonce': 31617}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6815', 'nonce': 31617}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6814', 'nonce': 31617}]}, 'public_addr': '172.21.15.59:6809/31617', 'cluster_addr': '172.21.15.59:6811/31617', 'heartbeat_back_addr': '172.21.15.59:6815/31617', 'heartbeat_front_addr': '172.21.15.59:6814/31617', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:50.610058+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:50.548086+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:50.536944+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:51.137739+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:50.747840+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:51.365378+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:50.725150+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:55:50.621411+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.e', 'osds': [1, 7, 0]}], 'pg_upmap_items': [{'pgid': '2.4', 'mappings': [{'from': 7, 'to': 1}]}, {'pgid': '4.1', 'mappings': [{'from': 5, 'to': 3}]}], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 24, 'length': 1}, {'begin': 28, 'length': 1}, {'begin': 32, 'length': 1}, {'begin': 35, 'length': 1}]}, {'pool': 4, 'snaps': [{'begin': 24, 'length': 1}, {'begin': 28, 'length': 1}, {'begin': 32, 'length': 1}, {'begin': 35, 'length': 1}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 35, 'length': 1}]}, {'pool': 4, 'snaps': [{'begin': 35, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2020-11-16T20:56:42.600 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-16T20:56:42.600 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:42.601 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:42.601 INFO:tasks.rados.rados.0.smithi166.stdout:789: done (2 left) 2020-11-16T20:56:42.601 INFO:tasks.rados.rados.0.smithi166.stdout:790: cache_flush oid 179 snap 19 2020-11-16T20:56:42.601 INFO:tasks.rados.rados.0.smithi166.stdout:787: got (2) No such file or directory 2020-11-16T20:56:42.601 INFO:tasks.rados.rados.0.smithi166.stdout:788: got (2) No such file or directory 2020-11-16T20:56:42.602 INFO:tasks.rados.rados.0.smithi166.stdout:787: done (2 left) 2020-11-16T20:56:42.602 INFO:tasks.rados.rados.0.smithi166.stdout:788: done (1 left) 2020-11-16T20:56:42.602 INFO:tasks.rados.rados.0.smithi166.stdout:791: write oid 335 current snap is 22 2020-11-16T20:56:42.602 INFO:tasks.rados.rados.0.smithi166.stdout:791: seq_num 570 ranges {779990=702052,2055442=653193,3253694=326296} 2020-11-16T20:56:42.602 INFO:tasks.rados.rados.0.smithi166.stdout:791: writing smithi16641208-335 from 779990 to 1482042 tid 1 2020-11-16T20:56:42.602 INFO:tasks.rados.rados.0.smithi166.stdout:791: writing smithi16641208-335 from 2055442 to 2708635 tid 2 2020-11-16T20:56:42.602 INFO:tasks.rados.rados.0.smithi166.stdout:791: writing smithi16641208-335 from 3253694 to 3579990 tid 3 2020-11-16T20:56:42.603 INFO:tasks.rados.rados.0.smithi166.stdout:792: cache_flush oid 42 snap -1 2020-11-16T20:56:42.603 INFO:tasks.rados.rados.0.smithi166.stdout:790: got (2) No such file or directory 2020-11-16T20:56:42.603 INFO:tasks.rados.rados.0.smithi166.stdout:791: finishing write tid 1 to smithi16641208-335 2020-11-16T20:56:42.603 INFO:tasks.rados.rados.0.smithi166.stdout:790: done (2 left) 2020-11-16T20:56:42.603 INFO:tasks.rados.rados.0.smithi166.stdout:793: write oid 460 current snap is 22 2020-11-16T20:56:42.603 INFO:tasks.rados.rados.0.smithi166.stdout:793: seq_num 571 ranges {796797=493654,1830277=796851,3397470=199327} 2020-11-16T20:56:42.603 INFO:tasks.rados.rados.0.smithi166.stdout:793: writing smithi16641208-460 from 796797 to 1290451 tid 1 2020-11-16T20:56:42.604 INFO:tasks.rados.rados.0.smithi166.stdout:793: writing smithi16641208-460 from 1830277 to 2627128 tid 2 2020-11-16T20:56:42.604 INFO:tasks.rados.rados.0.smithi166.stdout:793: writing smithi16641208-460 from 3397470 to 3596797 tid 3 2020-11-16T20:56:42.604 INFO:tasks.rados.rados.0.smithi166.stdout:794: rollback oid 465 current snap is 22 2020-11-16T20:56:42.604 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 465 to 19 2020-11-16T20:56:42.604 INFO:tasks.rados.rados.0.smithi166.stdout:792: got (2) No such file or directory 2020-11-16T20:56:42.604 INFO:tasks.rados.rados.0.smithi166.stdout:792: done (3 left) 2020-11-16T20:56:42.604 INFO:tasks.rados.rados.0.smithi166.stdout:795: cache_evict oid 41 snap -1 2020-11-16T20:56:42.604 INFO:tasks.rados.rados.0.smithi166.stdout:796: write (excl) oid 212 current snap is 22 2020-11-16T20:56:42.605 INFO:tasks.rados.rados.0.smithi166.stdout:796: seq_num 572 ranges {413604=568903,1488759=656862,2624893=591709} 2020-11-16T20:56:42.605 INFO:tasks.rados.rados.0.smithi166.stdout:796: writing smithi16641208-212 from 413604 to 982507 tid 1 2020-11-16T20:56:42.605 INFO:tasks.rados.rados.0.smithi166.stdout:796: writing smithi16641208-212 from 1488759 to 2145621 tid 2 2020-11-16T20:56:42.605 INFO:tasks.rados.rados.0.smithi166.stdout:796: writing smithi16641208-212 from 2624893 to 3216602 tid 3 2020-11-16T20:56:42.605 INFO:tasks.rados.rados.0.smithi166.stdout:797: rollback oid 367 current snap is 22 2020-11-16T20:56:42.605 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 367 to 17 2020-11-16T20:56:42.605 INFO:tasks.rados.rados.0.smithi166.stdout:795: got (2) No such file or directory 2020-11-16T20:56:42.606 INFO:tasks.rados.rados.0.smithi166.stdout:793: finishing write tid 1 to smithi16641208-460 2020-11-16T20:56:42.606 INFO:tasks.rados.rados.0.smithi166.stdout:791: finishing write tid 2 to smithi16641208-335 2020-11-16T20:56:42.606 INFO:tasks.rados.rados.0.smithi166.stdout:791: finishing write tid 3 to smithi16641208-335 2020-11-16T20:56:42.606 INFO:tasks.rados.rados.0.smithi166.stdout:791: finishing write tid 4 to smithi16641208-335 2020-11-16T20:56:42.606 INFO:tasks.rados.rados.0.smithi166.stdout:791: finishing write tid 5 to smithi16641208-335 2020-11-16T20:56:42.606 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 335 v 592 (ObjNum 570 snap 22 seq_num 570) dirty exists 2020-11-16T20:56:42.606 INFO:tasks.rados.rados.0.smithi166.stdout:791: left oid 335 (ObjNum 570 snap 22 seq_num 570) 2020-11-16T20:56:42.607 INFO:tasks.rados.rados.0.smithi166.stdout:796: finishing write tid 1 to smithi16641208-212 2020-11-16T20:56:42.607 INFO:tasks.rados.rados.0.smithi166.stdout:791: done (5 left) 2020-11-16T20:56:42.607 INFO:tasks.rados.rados.0.smithi166.stdout:795: done (4 left) 2020-11-16T20:56:42.607 INFO:tasks.rados.rados.0.smithi166.stdout:798: copy_from oid 390 from oid 235 current snap is 22 2020-11-16T20:56:42.607 INFO:tasks.rados.rados.0.smithi166.stdout:794: finishing rollback tid 0 to smithi16641208-465 2020-11-16T20:56:42.607 INFO:tasks.rados.rados.0.smithi166.stdout:794: finishing rollback tid 1 to smithi16641208-465 2020-11-16T20:56:42.607 INFO:tasks.rados.rados.0.smithi166.stdout:794: finishing rollback tid 2 to smithi16641208-465 2020-11-16T20:56:42.607 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 465 v 504 (ObjNum 554 snap 16 seq_num 554) dirty exists 2020-11-16T20:56:42.608 INFO:tasks.rados.rados.0.smithi166.stdout:794: done (4 left) 2020-11-16T20:56:42.608 INFO:tasks.rados.rados.0.smithi166.stdout:799: snap_remove snap 21 2020-11-16T20:56:42.608 INFO:tasks.rados.rados.0.smithi166.stdout:799: done (4 left) 2020-11-16T20:56:42.608 INFO:tasks.rados.rados.0.smithi166.stdout:800: snap_create 2020-11-16T20:56:42.608 INFO:tasks.rados.rados.0.smithi166.stdout:793: finishing write tid 2 to smithi16641208-460 2020-11-16T20:56:42.608 INFO:tasks.rados.rados.0.smithi166.stdout:793: finishing write tid 3 to smithi16641208-460 2020-11-16T20:56:42.608 INFO:tasks.rados.rados.0.smithi166.stdout:793: finishing write tid 4 to smithi16641208-460 2020-11-16T20:56:42.609 INFO:tasks.rados.rados.0.smithi166.stdout:793: finishing write tid 5 to smithi16641208-460 2020-11-16T20:56:42.609 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 460 v 552 (ObjNum 571 snap 22 seq_num 571) dirty exists 2020-11-16T20:56:42.609 INFO:tasks.rados.rados.0.smithi166.stdout:793: left oid 460 (ObjNum 571 snap 22 seq_num 571) 2020-11-16T20:56:42.609 INFO:tasks.rados.rados.0.smithi166.stdout:797: finishing rollback tid 0 to smithi16641208-367 2020-11-16T20:56:42.609 INFO:tasks.rados.rados.0.smithi166.stdout:797: finishing rollback tid 1 to smithi16641208-367 2020-11-16T20:56:42.609 INFO:tasks.rados.rados.0.smithi166.stdout:798: finishing copy_from to smithi16641208-390 2020-11-16T20:56:42.609 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 390 v 165 (ObjNum 234 snap 0 seq_num 234) dirty exists 2020-11-16T20:56:42.609 INFO:tasks.rados.rados.0.smithi166.stdout:798: finishing copy_from racing read to smithi16641208-390 2020-11-16T20:56:42.610 INFO:tasks.rados.rados.0.smithi166.stdout:796: finishing write tid 2 to smithi16641208-212 2020-11-16T20:56:42.610 INFO:tasks.rados.rados.0.smithi166.stdout:796: finishing write tid 3 to smithi16641208-212 2020-11-16T20:56:42.610 INFO:tasks.rados.rados.0.smithi166.stdout:796: finishing write tid 4 to smithi16641208-212 2020-11-16T20:56:42.610 INFO:tasks.rados.rados.0.smithi166.stdout:796: finishing write tid 5 to smithi16641208-212 2020-11-16T20:56:42.610 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 212 v 595 (ObjNum 572 snap 22 seq_num 572) dirty exists 2020-11-16T20:56:42.610 INFO:tasks.rados.rados.0.smithi166.stdout:796: left oid 212 (ObjNum 572 snap 22 seq_num 572) 2020-11-16T20:56:42.610 INFO:tasks.rados.rados.0.smithi166.stdout:797: finishing rollback tid 2 to smithi16641208-367 2020-11-16T20:56:42.611 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 367 v 596 (ObjNum 366 snap 0 seq_num 366) dirty exists 2020-11-16T20:56:42.611 INFO:tasks.rados.rados.0.smithi166.stdout:793: done (4 left) 2020-11-16T20:56:42.611 INFO:tasks.rados.rados.0.smithi166.stdout:796: done (3 left) 2020-11-16T20:56:42.611 INFO:tasks.rados.rados.0.smithi166.stdout:797: done (2 left) 2020-11-16T20:56:42.611 INFO:tasks.rados.rados.0.smithi166.stdout:798: done (1 left) 2020-11-16T20:56:42.611 INFO:tasks.rados.rados.0.smithi166.stdout:800: done (0 left) 2020-11-16T20:56:42.611 INFO:tasks.rados.rados.0.smithi166.stdout:801: read oid 151 snap -1 2020-11-16T20:56:42.611 INFO:tasks.rados.rados.0.smithi166.stdout:801: expect (ObjNum 150 snap 0 seq_num 150) 2020-11-16T20:56:42.612 INFO:tasks.rados.rados.0.smithi166.stdout:802: write oid 437 current snap is 23 2020-11-16T20:56:42.612 INFO:tasks.rados.rados.0.smithi166.stdout:802: seq_num 573 ranges {430411=644152,1830888=400520,2935963=402981} 2020-11-16T20:56:42.612 INFO:tasks.rados.rados.0.smithi166.stdout:802: writing smithi16641208-437 from 430411 to 1074563 tid 1 2020-11-16T20:56:42.612 INFO:tasks.rados.rados.0.smithi166.stdout:802: writing smithi16641208-437 from 1830888 to 2231408 tid 2 2020-11-16T20:56:42.612 INFO:tasks.rados.rados.0.smithi166.stdout:802: writing smithi16641208-437 from 2935963 to 3338944 tid 3 2020-11-16T20:56:42.612 INFO:tasks.rados.rados.0.smithi166.stdout:803: cache_try_flush oid 191 snap -1 2020-11-16T20:56:42.612 INFO:tasks.rados.rados.0.smithi166.stdout:802: finishing write tid 1 to smithi16641208-437 2020-11-16T20:56:42.612 INFO:tasks.rados.rados.0.smithi166.stdout:804: rollback oid 491 current snap is 23 2020-11-16T20:56:42.613 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 491 to 9 2020-11-16T20:56:42.613 INFO:tasks.rados.rados.0.smithi166.stdout:805: read oid 321 snap 22 2020-11-16T20:56:42.613 INFO:tasks.rados.rados.0.smithi166.stdout:805: expect (ObjNum 320 snap 0 seq_num 320) 2020-11-16T20:56:42.613 INFO:tasks.rados.rados.0.smithi166.stdout:806: snap_remove snap 17 2020-11-16T20:56:42.613 INFO:tasks.rados.rados.0.smithi166.stdout:806: done (5 left) 2020-11-16T20:56:42.613 INFO:tasks.rados.rados.0.smithi166.stdout:807: rollback oid 413 current snap is 23 2020-11-16T20:56:42.613 INFO:tasks.rados.rados.0.smithi166.stdout:801: expect (ObjNum 150 snap 0 seq_num 150) 2020-11-16T20:56:42.614 INFO:tasks.rados.rados.0.smithi166.stdout:802: finishing write tid 2 to smithi16641208-437 2020-11-16T20:56:42.614 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 413 to 22 2020-11-16T20:56:42.614 INFO:tasks.rados.rados.0.smithi166.stdout:802: finishing write tid 3 to smithi16641208-437 2020-11-16T20:56:42.614 INFO:tasks.rados.rados.0.smithi166.stdout:802: finishing write tid 4 to smithi16641208-437 2020-11-16T20:56:42.614 INFO:tasks.rados.rados.0.smithi166.stdout:802: finishing write tid 5 to smithi16641208-437 2020-11-16T20:56:42.614 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 437 v 508 (ObjNum 573 snap 23 seq_num 573) dirty exists 2020-11-16T20:56:42.614 INFO:tasks.rados.rados.0.smithi166.stdout:802: left oid 437 (ObjNum 573 snap 23 seq_num 573) 2020-11-16T20:56:42.614 INFO:tasks.rados.rados.0.smithi166.stdout:804: finishing rollback tid 0 to smithi16641208-491 2020-11-16T20:56:42.615 INFO:tasks.rados.rados.0.smithi166.stdout:804: finishing rollback tid 1 to smithi16641208-491 2020-11-16T20:56:42.615 INFO:tasks.rados.rados.0.smithi166.stdout:804: finishing rollback tid 2 to smithi16641208-491 2020-11-16T20:56:42.615 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 491 v 511 (ObjNum 490 snap 0 seq_num 490) dirty exists 2020-11-16T20:56:42.615 INFO:tasks.rados.rados.0.smithi166.stdout:805: expect (ObjNum 320 snap 0 seq_num 320) 2020-11-16T20:56:42.615 INFO:tasks.rados.rados.0.smithi166.stdout:803: got (0) Success 2020-11-16T20:56:42.615 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 191 v 0 (ObjNum 190 snap 0 seq_num 190) dirty exists 2020-11-16T20:56:42.615 INFO:tasks.rados.rados.0.smithi166.stdout:801: done (5 left) 2020-11-16T20:56:42.616 INFO:tasks.rados.rados.0.smithi166.stdout:802: done (4 left) 2020-11-16T20:56:42.616 INFO:tasks.rados.rados.0.smithi166.stdout:803: done (3 left) 2020-11-16T20:56:42.616 INFO:tasks.rados.rados.0.smithi166.stdout:804: done (2 left) 2020-11-16T20:56:42.616 INFO:tasks.rados.rados.0.smithi166.stdout:805: done (1 left) 2020-11-16T20:56:42.616 INFO:tasks.rados.rados.0.smithi166.stdout:808: copy_from oid 146 from oid 459 current snap is 23 2020-11-16T20:56:42.616 INFO:tasks.rados.rados.0.smithi166.stdout:807: finishing rollback tid 0 to smithi16641208-413 2020-11-16T20:56:42.616 INFO:tasks.rados.rados.0.smithi166.stdout:807: finishing rollback tid 1 to smithi16641208-413 2020-11-16T20:56:42.616 INFO:tasks.rados.rados.0.smithi166.stdout:807: finishing rollback tid 2 to smithi16641208-413 2020-11-16T20:56:42.617 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 413 v 620 (ObjNum 412 snap 0 seq_num 412) dirty exists 2020-11-16T20:56:42.617 INFO:tasks.rados.rados.0.smithi166.stdout:807: done (1 left) 2020-11-16T20:56:42.617 INFO:tasks.rados.rados.0.smithi166.stdout:809: cache_try_flush oid 411 snap -1 2020-11-16T20:56:42.617 INFO:tasks.rados.rados.0.smithi166.stdout:810: read oid 238 snap -1 2020-11-16T20:56:42.617 INFO:tasks.rados.rados.0.smithi166.stdout:810: expect (ObjNum 237 snap 0 seq_num 237) 2020-11-16T20:56:42.617 INFO:tasks.rados.rados.0.smithi166.stdout:811: write oid 212 current snap is 23 2020-11-16T20:56:42.617 INFO:tasks.rados.rados.0.smithi166.stdout:811: seq_num 574 ranges {447218=719401,1889370=660531,2963386=614253} 2020-11-16T20:56:42.618 INFO:tasks.rados.rados.0.smithi166.stdout:811: writing smithi16641208-212 from 447218 to 1166619 tid 1 2020-11-16T20:56:42.618 INFO:tasks.rados.rados.0.smithi166.stdout:811: writing smithi16641208-212 from 1889370 to 2549901 tid 2 2020-11-16T20:56:42.618 INFO:tasks.rados.rados.0.smithi166.stdout:811: writing smithi16641208-212 from 2963386 to 3577639 tid 3 2020-11-16T20:56:42.618 INFO:tasks.rados.rados.0.smithi166.stdout:812: write (excl) oid 193 current snap is 23 2020-11-16T20:56:42.618 INFO:tasks.rados.rados.0.smithi166.stdout:812: seq_num 575 ranges {464025=794650,1947852=404189,2990809=425525} 2020-11-16T20:56:42.618 INFO:tasks.rados.rados.0.smithi166.stdout:812: writing smithi16641208-193 from 464025 to 1258675 tid 1 2020-11-16T20:56:42.618 INFO:tasks.rados.rados.0.smithi166.stdout:812: writing smithi16641208-193 from 1947852 to 2352041 tid 2 2020-11-16T20:56:42.618 INFO:tasks.rados.rados.0.smithi166.stdout:812: writing smithi16641208-193 from 2990809 to 3416334 tid 3 2020-11-16T20:56:42.619 INFO:tasks.rados.rados.0.smithi166.stdout:813: delete oid 202 current snap is 23 2020-11-16T20:56:42.619 INFO:tasks.rados.rados.0.smithi166.stdout:810: expect (ObjNum 237 snap 0 seq_num 237) 2020-11-16T20:56:42.619 INFO:tasks.rados.rados.0.smithi166.stdout:811: finishing write tid 1 to smithi16641208-212 2020-11-16T20:56:42.619 INFO:tasks.rados.rados.0.smithi166.stdout:810: done (5 left) 2020-11-16T20:56:42.619 INFO:tasks.rados.rados.0.smithi166.stdout:813: done (4 left) 2020-11-16T20:56:42.619 INFO:tasks.rados.rados.0.smithi166.stdout:814: write (excl) oid 69 current snap is 23 2020-11-16T20:56:42.619 INFO:tasks.rados.rados.0.smithi166.stdout:808: finishing copy_from to smithi16641208-146 2020-11-16T20:56:42.620 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 146 v 454 (ObjNum 458 snap 0 seq_num 458) dirty exists 2020-11-16T20:56:42.620 INFO:tasks.rados.rados.0.smithi166.stdout:811: finishing write tid 2 to smithi16641208-212 2020-11-16T20:56:42.620 INFO:tasks.rados.rados.0.smithi166.stdout:811: finishing write tid 3 to smithi16641208-212 2020-11-16T20:56:42.620 INFO:tasks.rados.rados.0.smithi166.stdout:814: seq_num 577 ranges {497639=545148,1548463=407858,2529302=564422,3528143=169496} 2020-11-16T20:56:42.620 INFO:tasks.rados.rados.0.smithi166.stdout:814: writing smithi16641208-69 from 497639 to 1042787 tid 1 2020-11-16T20:56:42.620 INFO:tasks.rados.rados.0.smithi166.stdout:814: writing smithi16641208-69 from 1548463 to 1956321 tid 2 2020-11-16T20:56:42.620 INFO:tasks.rados.rados.0.smithi166.stdout:814: writing smithi16641208-69 from 2529302 to 3093724 tid 3 2020-11-16T20:56:42.621 INFO:tasks.rados.rados.0.smithi166.stdout:814: writing smithi16641208-69 from 3528143 to 3697639 tid 4 2020-11-16T20:56:42.621 INFO:tasks.rados.rados.0.smithi166.stdout:815: write oid 380 current snap is 23 2020-11-16T20:56:42.621 INFO:tasks.rados.rados.0.smithi166.stdout:815: seq_num 578 ranges {514446=736750,1723298=667869,3073078=641368} 2020-11-16T20:56:42.621 INFO:tasks.rados.rados.0.smithi166.stdout:815: writing smithi16641208-380 from 514446 to 1251196 tid 1 2020-11-16T20:56:42.621 INFO:tasks.rados.rados.0.smithi166.stdout:815: writing smithi16641208-380 from 1723298 to 2391167 tid 2 2020-11-16T20:56:42.621 INFO:tasks.rados.rados.0.smithi166.stdout:815: writing smithi16641208-380 from 3073078 to 3714446 tid 3 2020-11-16T20:56:42.621 INFO:tasks.rados.rados.0.smithi166.stdout:816: snap_create 2020-11-16T20:56:42.621 INFO:tasks.rados.rados.0.smithi166.stdout:811: finishing write tid 4 to smithi16641208-212 2020-11-16T20:56:42.622 INFO:tasks.rados.rados.0.smithi166.stdout:811: finishing write tid 5 to smithi16641208-212 2020-11-16T20:56:42.622 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 212 v 624 (ObjNum 574 snap 23 seq_num 574) dirty exists 2020-11-16T20:56:42.622 INFO:tasks.rados.rados.0.smithi166.stdout:811: left oid 212 (ObjNum 574 snap 23 seq_num 574) 2020-11-16T20:56:42.622 INFO:tasks.rados.rados.0.smithi166.stdout:809: got (0) Success 2020-11-16T20:56:42.622 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 411 v 0 (ObjNum 410 snap 0 seq_num 410) dirty exists 2020-11-16T20:56:42.622 INFO:tasks.rados.rados.0.smithi166.stdout:812: finishing write tid 1 to smithi16641208-193 2020-11-16T20:56:42.622 INFO:tasks.rados.rados.0.smithi166.stdout:808: finishing copy_from racing read to smithi16641208-146 2020-11-16T20:56:42.623 INFO:tasks.rados.rados.0.smithi166.stdout:812: finishing write tid 2 to smithi16641208-193 2020-11-16T20:56:42.623 INFO:tasks.rados.rados.0.smithi166.stdout:812: finishing write tid 3 to smithi16641208-193 2020-11-16T20:56:42.623 INFO:tasks.rados.rados.0.smithi166.stdout:812: finishing write tid 4 to smithi16641208-193 2020-11-16T20:56:42.623 INFO:tasks.rados.rados.0.smithi166.stdout:812: finishing write tid 5 to smithi16641208-193 2020-11-16T20:56:42.623 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 193 v 662 (ObjNum 575 snap 23 seq_num 575) dirty exists 2020-11-16T20:56:42.623 INFO:tasks.rados.rados.0.smithi166.stdout:812: left oid 193 (ObjNum 575 snap 23 seq_num 575) 2020-11-16T20:56:42.623 INFO:tasks.rados.rados.0.smithi166.stdout:814: finishing write tid 1 to smithi16641208-69 2020-11-16T20:56:42.623 INFO:tasks.rados.rados.0.smithi166.stdout:814: finishing write tid 2 to smithi16641208-69 2020-11-16T20:56:42.624 INFO:tasks.rados.rados.0.smithi166.stdout:814: finishing write tid 3 to smithi16641208-69 2020-11-16T20:56:42.624 INFO:tasks.rados.rados.0.smithi166.stdout:814: finishing write tid 4 to smithi16641208-69 2020-11-16T20:56:42.624 INFO:tasks.rados.rados.0.smithi166.stdout:814: finishing write tid 5 to smithi16641208-69 2020-11-16T20:56:42.624 INFO:tasks.rados.rados.0.smithi166.stdout:814: finishing write tid 6 to smithi16641208-69 2020-11-16T20:56:42.624 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 69 v 517 (ObjNum 577 snap 23 seq_num 577) dirty exists 2020-11-16T20:56:42.624 INFO:tasks.rados.rados.0.smithi166.stdout:814: left oid 69 (ObjNum 577 snap 23 seq_num 577) 2020-11-16T20:56:42.624 INFO:tasks.rados.rados.0.smithi166.stdout:815: finishing write tid 1 to smithi16641208-380 2020-11-16T20:56:42.624 INFO:tasks.rados.rados.0.smithi166.stdout:815: finishing write tid 2 to smithi16641208-380 2020-11-16T20:56:42.625 INFO:tasks.rados.rados.0.smithi166.stdout:815: finishing write tid 3 to smithi16641208-380 2020-11-16T20:56:42.625 INFO:tasks.rados.rados.0.smithi166.stdout:815: finishing write tid 4 to smithi16641208-380 2020-11-16T20:56:42.625 INFO:tasks.rados.rados.0.smithi166.stdout:815: finishing write tid 5 to smithi16641208-380 2020-11-16T20:56:42.625 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 380 v 665 (ObjNum 578 snap 23 seq_num 578) dirty exists 2020-11-16T20:56:42.625 INFO:tasks.rados.rados.0.smithi166.stdout:815: left oid 380 (ObjNum 578 snap 23 seq_num 578) 2020-11-16T20:56:42.626 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:42.596+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:42.626 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:56:42.692 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:42.696+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:42.759 INFO:tasks.rados.rados.0.smithi166.stdout:808: done (6 left) 2020-11-16T20:56:42.759 INFO:tasks.rados.rados.0.smithi166.stdout:809: done (5 left) 2020-11-16T20:56:42.760 INFO:tasks.rados.rados.0.smithi166.stdout:811: done (4 left) 2020-11-16T20:56:42.760 INFO:tasks.rados.rados.0.smithi166.stdout:812: done (3 left) 2020-11-16T20:56:42.760 INFO:tasks.rados.rados.0.smithi166.stdout:814: done (2 left) 2020-11-16T20:56:42.760 INFO:tasks.rados.rados.0.smithi166.stdout:815: done (1 left) 2020-11-16T20:56:42.760 INFO:tasks.rados.rados.0.smithi166.stdout:816: done (0 left) 2020-11-16T20:56:42.760 INFO:tasks.rados.rados.0.smithi166.stdout:817: snap_remove snap 22 2020-11-16T20:56:42.777 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:42.777 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:42.789 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:56:42.792 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:42.797+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:42.816 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:56:42.844 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:56:42.868 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:56:42.889 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:56:42.893 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:42.897+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:42.910 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:56:42.930 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:56:42.950 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:56:42.959 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:42.959 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:42.959 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:56:42.959 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:42.969 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:56:42.971 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:56:42.972 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:56:42.973 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:56:42.973 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:56:42.973 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:56:42.973 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:56:42.973 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:56:42.973 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:56:42.974 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:56:42.977 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:56:42.979 INFO:teuthology.orchestra.run.smithi166.stderr:dumped all 2020-11-16T20:56:42.990 INFO:teuthology.orchestra.run.smithi166.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2020-11-16T20:56:42.763968+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1972199581,"num_objects":739,"num_object_clones":82,"num_object_copies":2217,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":641,"num_whiteouts":16,"num_read":1716,"num_read_kb":557299,"num_write":2741,"num_write_kb":1077444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":273426410,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":91,"num_flush_kb":252710,"num_evict":31,"num_evict_kb":85676,"num_promote":207,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3490,"ondisk_log_size":3490,"up":81,"acting":81,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3873276,"kb_used_data":3763140,"kb_used_omap":0,"kb_used_meta":95168,"kb_avail":751101444,"statfs":{"total":773094113280,"available":769127878656,"internally_reserved":0,"allocated":3853455360,"data_stored":4029967441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":97452032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":26556649,"num_objects":9,"num_object_clones":10,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":40,"num_read_kb":42311,"num_write":47,"num_write_kb":48314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":9,"num_flush_kb":22754,"num_evict":7,"num_evict_kb":22079,"num_promote":3,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.018046"},"pg_stats":[{"pgid":"2.11","version":"0'0","reported_seq":"31","reported_epoch":"78","state":"active+clean","last_fresh":"2020-11-16T20:56:40.774304+0000","last_change":"2020-11-16T20:56:30.376104+0000","last_active":"2020-11-16T20:56:40.774304+0000","last_peered":"2020-11-16T20:56:40.774304+0000","last_clean":"2020-11-16T20:56:40.774304+0000","last_became_active":"2020-11-16T20:56:26.743063+0000","last_became_peered":"2020-11-16T20:56:26.743063+0000","last_unstale":"2020-11-16T20:56:40.774304+0000","last_undegraded":"2020-11-16T20:56:40.774304+0000","last_fullsized":"2020-11-16T20:56:40.774304+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:30.376014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:30.376014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"57","reported_epoch":"78","state":"active+clean","last_fresh":"2020-11-16T20:56:41.650765+0000","last_change":"2020-11-16T20:55:59.416734+0000","last_active":"2020-11-16T20:56:41.650765+0000","last_peered":"2020-11-16T20:56:41.650765+0000","last_clean":"2020-11-16T20:56:41.650765+0000","last_became_active":"2020-11-16T20:55:52.921860+0000","last_became_peered":"2020-11-16T20:55:52.921860+0000","last_unstale":"2020-11-16T20:56:41.650765+0000","last_undegraded":"2020-11-16T20:56:41.650765+0000","last_fullsized":"2020-11-16T20:56:41.650765+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.416654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.416654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":"57","reported_epoch":"78","state":"active+clean","last_fresh":"2020-11-16T20:56:40.774214+0000","last_change":"2020-11-16T20:55:56.438524+0000","last_active":"2020-11-16T20:56:40.774214+0000","last_peered":"2020-11-16T20:56:40.774214+0000","last_clean":"2020-11-16T20:56:40.774214+0000","last_became_active":"2020-11-16T20:55:52.922023+0000","last_became_peered":"2020-11-16T20:55:52.922023+0000","last_unstale":"2020-11-16T20:56:40.774214+0000","last_undegraded":"2020-11-16T20:56:40.774214+0000","last_fullsized":"2020-11-16T20:56:40.774214+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:56.438428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:56.438428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":"31","reported_epoch":"78","state":"active+clean","last_fresh":"2020-11-16T20:56:40.761024+0000","last_change":"2020-11-16T20:56:20.755004+0000","last_active":"2020-11-16T20:56:40.761024+0000","last_peered":"2020-11-16T20:56:40.761024+0000","last_clean":"2020-11-16T20:56:40.761024+0000","last_became_active":"2020-11-16T20:56:20.754520+0000","last_became_peered":"2020-11-16T20:56:20.754520+0000","last_unstale":"2020-11-16T20:56:40.761024+0000","last_undegraded":"2020-11-16T20:56:40.761024+0000","last_fullsized":"2020-11-16T20:56:40.761024+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:04.388506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:04.388506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"57","reported_epoch":"78","state":"active+clean","last_fresh":"2020-11-16T20:56:40.762971+0000","last_change":"2020-11-16T20:56:11.940489+0000","last_active":"2020-11-16T20:56:40.762971+0000","last_peered":"2020-11-16T20:56:40.762971+0000","last_clean":"2020-11-16T20:56:40.762971+0000","last_became_active":"2020-11-16T20:55:52.922134+0000","last_became_peered":"2020-11-16T20:55:52.922134+0000","last_unstale":"2020-11-16T20:56:40.762971+0000","last_undegraded":"2020-11-16T20:56:40.762971+0000","last_fullsized":"2020-11-16T20:56:40.762971+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:11.940423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:11.940423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"57","reported_epoch":"78","state":"active+clean","last_fresh":"2020-11-16T20:56:41.650775+0000","last_change":"2020-11-16T20:56:02.387946+0000","last_active":"2020-11-16T20:56:41.650775+0000","last_peered":"2020-11-16T20:56:41.650775+0000","last_clean":"2020-11-16T20:56:41.650775+0000","last_became_active":"2020-11-16T20:55:52.920496+0000","last_became_peered":"2020-11-16T20:55:52.920496+0000","last_unstale":"2020-11-16T20:56:41.650775+0000","last_undegraded":"2020-11-16T20:56:41.650775+0000","last_fullsized":"2020-11-16T20:56:41.650775+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:02.387861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:02.387861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"83","reported_epoch":"78","state":"active+clean","last_fresh":"2020-11-16T20:56:40.750297+0000","last_change":"2020-11-16T20:56:02.565668+0000","last_active":"2020-11-16T20:56:40.750297+0000","last_peered":"2020-11-16T20:56:40.750297+0000","last_clean":"2020-11-16T20:56:40.750297+0000","last_became_active":"2020-11-16T20:55:52.917496+0000","last_became_peered":"2020-11-16T20:55:52.917496+0000","last_unstale":"2020-11-16T20:56:40.750297+0000","last_undegraded":"2020-11-16T20:56:40.750297+0000","last_fullsized":"2020-11-16T20:56:40.750297+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:02.565607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:56:02.565607+0000","last_clean_scrub_stamp":"2020-11-16T20:56:02.565607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"83","reported_epoch":"78","state":"active+clean","last_fresh":"2020-11-16T20:56:40.759447+0000","last_change":"2020-11-16T20:56:01.955760+0000","last_active":"2020-11-16T20:56:40.759447+0000","last_peered":"2020-11-16T20:56:40.759447+0000","last_clean":"2020-11-16T20:56:40.759447+0000","last_became_active":"2020-11-16T20:55:52.922447+0000","last_became_peered":"2020-11-16T20:55:52.922447+0000","last_unstale":"2020-11-16T20:56:40.759447+0000","last_undegraded":"2020-11-16T20:56:40.759447+0000","last_fullsized":"2020-11-16T20:56:40.759447+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:01.955691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:01.955691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"66","reported_epoch":"78","state":"active+clean","last_fresh":"2020-11-16T20:56:40.759444+0000","last_change":"2020-11-16T20:56:18.755476+0000","last_active":"2020-11-16T20:56:40.759444+0000","last_peered":"2020-11-16T20:56:40.759444+0000","last_clean":"2020-11-16T20:56:40.759444+0000","last_became_active":"2020-11-16T20:56:18.754989+0000","last_became_peered":"2020-11-16T20:56:18.754989+0000","last_unstale":"2020-11-16T20:56:40.759444+0000","last_undegraded":"2020-11-16T20:56:40.759444+0000","last_fullsized":"2020-11-16T20:56:40.759444+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:00.967553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:00.967553+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"92","reported_epoch":"78","state":"active+clean","last_fresh":"2020-11-16T20:56:40.750289+0000","last_change":"2020-11-16T20:56:01.528273+0000","last_active":"2020-11-16T20:56:40.750289+0000","last_peered":"2020-11-16T20:56:40.750289+0000","last_clean":"2020-11-16T20:56:40.750289+0000","last_became_active":"2020-11-16T20:55:52.922303+0000","last_became_peered":"2020-11-16T20:55:52.922303+0000","last_unstale":"2020-11-16T20:56:40.750289+0000","last_undegraded":"2020-11-16T20:56:40.750289+0000","last_fullsized":"2020-11-16T20:56:40.750289+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:01.528217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:01.528217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"83","reported_epoch":"78","state":"active+clean","last_fresh":"2020-11-16T20:56:40.760899+0000","last_change":"2020-11-16T20:55:57.905062+0000","last_active":"2020-11-16T20:56:40.760899+0000","last_peered":"2020-11-16T20:56:40.760899+0000","last_clean":"2020-11-16T20:56:40.760899+0000","last_became_active":"2020-11-16T20:55:50.904146+0000","last_became_peered":"2020-11-16T20:55:50.904146+0000","last_unstale":"2020-11-16T20:56:40.760899+0000","last_undegraded":"2020-11-16T20:56:40.760899+0000","last_fullsized":"2020-11-16T20:56:40.760899+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:57.905004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:57.905004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"79'319","reported_seq":"529","reported_epoch":"79","state":"active+clean","last_fresh":"2020-11-16T20:56:41.840846+0000","last_change":"2020-11-16T20:56:41.841172+0000","last_active":"2020-11-16T20:56:41.840846+0000","last_peered":"2020-11-16T20:56:41.840846+0000","last_clean":"2020-11-16T20:56:41.840846+0000","last_became_active":"2020-11-16T20:55:30.828637+0000","last_became_peered":"2020-11-16T20:55:30.828637+0000","last_unstale":"2020-11-16T20:56:41.840846+0000","last_undegraded":"2020-11-16T20:56:41.840846+0000","last_fullsized":"2020-11-16T20:56:41.840846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":319,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":113685576,"num_objects":48,"num_object_clones":9,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":4,"num_read":78,"num_read_kb":34183,"num_write":170,"num_write_kb":28300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":30,"num_flush_kb":80914,"num_evict":6,"num_evict_kb":13724,"num_promote":53,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"18","length":"1"},{"start":"1c","length":"1"},{"start":"20","length":"2"},{"start":"23","length":"1"},{"start":"26","length":"2"}]},{"pgid":"2.2","version":"0'0","reported_seq":"88","reported_epoch":"74","state":"active+clean","last_fresh":"2020-11-16T20:56:36.749307+0000","last_change":"2020-11-16T20:56:26.743666+0000","last_active":"2020-11-16T20:56:36.749307+0000","last_peered":"2020-11-16T20:56:36.749307+0000","last_clean":"2020-11-16T20:56:36.749307+0000","last_became_active":"2020-11-16T20:56:26.743184+0000","last_became_peered":"2020-11-16T20:56:26.743184+0000","last_unstale":"2020-11-16T20:56:36.749307+0000","last_undegraded":"2020-11-16T20:56:36.749307+0000","last_fullsized":"2020-11-16T20:56:36.749307+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:57.606500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:57.606500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"79'624","reported_seq":"951","reported_epoch":"79","state":"active+clean","last_fresh":"2020-11-16T20:56:41.967298+0000","last_change":"2020-11-16T20:56:41.861346+0000","last_active":"2020-11-16T20:56:41.967298+0000","last_peered":"2020-11-16T20:56:41.967298+0000","last_clean":"2020-11-16T20:56:41.967298+0000","last_became_active":"2020-11-16T20:55:25.103851+0000","last_became_peered":"2020-11-16T20:55:25.103851+0000","last_unstale":"2020-11-16T20:56:41.967298+0000","last_undegraded":"2020-11-16T20:56:41.967298+0000","last_fullsized":"2020-11-16T20:56:41.967298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":624,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":378261542,"num_objects":140,"num_object_clones":17,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":140,"num_whiteouts":2,"num_read":351,"num_read_kb":77745,"num_write":543,"num_write_kb":258136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"18","length":"1"},{"start":"1c","length":"1"},{"start":"20","length":"2"},{"start":"23","length":"1"},{"start":"26","length":"2"}]},{"pgid":"2.1","version":"0'0","reported_seq":"83","reported_epoch":"78","state":"active+clean","last_fresh":"2020-11-16T20:56:41.650861+0000","last_change":"2020-11-16T20:55:58.465447+0000","last_active":"2020-11-16T20:56:41.650861+0000","last_peered":"2020-11-16T20:56:41.650861+0000","last_clean":"2020-11-16T20:56:41.650861+0000","last_became_active":"2020-11-16T20:55:50.905925+0000","last_became_peered":"2020-11-16T20:55:50.905925+0000","last_unstale":"2020-11-16T20:56:41.650861+0000","last_undegraded":"2020-11-16T20:56:41.650861+0000","last_fullsized":"2020-11-16T20:56:41.650861+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:58.465384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:58.465384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"79'533","reported_seq":"1117","reported_epoch":"79","state":"active+clean","last_fresh":"2020-11-16T20:56:41.991563+0000","last_change":"2020-11-16T20:56:41.778299+0000","last_active":"2020-11-16T20:56:41.991563+0000","last_peered":"2020-11-16T20:56:41.991563+0000","last_clean":"2020-11-16T20:56:41.991563+0000","last_became_active":"2020-11-16T20:56:29.739968+0000","last_became_peered":"2020-11-16T20:56:29.739968+0000","last_unstale":"2020-11-16T20:56:41.991563+0000","last_undegraded":"2020-11-16T20:56:41.991563+0000","last_fullsized":"2020-11-16T20:56:41.991563+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":533,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358080047,"num_objects":132,"num_object_clones":15,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":4,"num_read":269,"num_read_kb":23351,"num_write":503,"num_write_kb":217350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":181673084,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"18","length":"1"},{"start":"1c","length":"1"},{"start":"20","length":"2"},{"start":"23","length":"1"},{"start":"26","length":"2"}]},{"pgid":"2.3","version":"0'0","reported_seq":"79","reported_epoch":"74","state":"active+clean","last_fresh":"2020-11-16T20:56:36.748686+0000","last_change":"2020-11-16T20:55:59.611811+0000","last_active":"2020-11-16T20:56:36.748686+0000","last_peered":"2020-11-16T20:56:36.748686+0000","last_clean":"2020-11-16T20:56:36.748686+0000","last_became_active":"2020-11-16T20:55:50.903578+0000","last_became_peered":"2020-11-16T20:55:50.903578+0000","last_unstale":"2020-11-16T20:56:36.748686+0000","last_undegraded":"2020-11-16T20:56:36.748686+0000","last_fullsized":"2020-11-16T20:56:36.748686+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.611727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.611727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"79","reported_epoch":"78","state":"active+clean","last_fresh":"2020-11-16T20:56:40.750531+0000","last_change":"2020-11-16T20:56:03.542304+0000","last_active":"2020-11-16T20:56:40.750531+0000","last_peered":"2020-11-16T20:56:40.750531+0000","last_clean":"2020-11-16T20:56:40.750531+0000","last_became_active":"2020-11-16T20:54:53.112038+0000","last_became_peered":"2020-11-16T20:54:53.112038+0000","last_unstale":"2020-11-16T20:56:40.750531+0000","last_undegraded":"2020-11-16T20:56:40.750531+0000","last_fullsized":"2020-11-16T20:56:40.750531+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'2","last_scrub_stamp":"2020-11-16T20:56:03.542235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:50.068882+0000","last_clean_scrub_stamp":"2020-11-16T20:56:03.542235+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"79'557","reported_seq":"872","reported_epoch":"79","state":"active+clean","last_fresh":"2020-11-16T20:56:41.777951+0000","last_change":"2020-11-16T20:56:41.778386+0000","last_active":"2020-11-16T20:56:41.777951+0000","last_peered":"2020-11-16T20:56:41.777951+0000","last_clean":"2020-11-16T20:56:41.777951+0000","last_became_active":"2020-11-16T20:55:25.106302+0000","last_became_peered":"2020-11-16T20:55:25.106302+0000","last_unstale":"2020-11-16T20:56:41.777951+0000","last_undegraded":"2020-11-16T20:56:41.777951+0000","last_fullsized":"2020-11-16T20:56:41.777951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'549","last_scrub_stamp":"2020-11-16T20:56:39.880955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:56:39.880955+0000","log_size":557,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":337105950,"num_objects":125,"num_object_clones":9,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":0,"num_read":319,"num_read_kb":84460,"num_write":497,"num_write_kb":239232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"18","length":"1"},{"start":"1c","length":"1"},{"start":"20","length":"2"},{"start":"23","length":"1"},{"start":"26","length":"2"}]},{"pgid":"2.0","version":"0'0","reported_seq":"84","reported_epoch":"78","state":"active+clean","last_fresh":"2020-11-16T20:56:40.750636+0000","last_change":"2020-11-16T20:55:56.657297+0000","last_active":"2020-11-16T20:56:40.750636+0000","last_peered":"2020-11-16T20:56:40.750636+0000","last_clean":"2020-11-16T20:56:40.750636+0000","last_became_active":"2020-11-16T20:55:50.908710+0000","last_became_peered":"2020-11-16T20:55:50.908710+0000","last_unstale":"2020-11-16T20:56:40.750636+0000","last_undegraded":"2020-11-16T20:56:40.750636+0000","last_fullsized":"2020-11-16T20:56:40.750636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:56.657242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:56.657242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'650","reported_seq":"983","reported_epoch":"75","state":"active+clean","last_fresh":"2020-11-16T20:56:37.941530+0000","last_change":"2020-11-16T20:56:37.941608+0000","last_active":"2020-11-16T20:56:37.941530+0000","last_peered":"2020-11-16T20:56:37.941530+0000","last_clean":"2020-11-16T20:56:37.941530+0000","last_became_active":"2020-11-16T20:55:24.802649+0000","last_became_peered":"2020-11-16T20:55:24.802649+0000","last_unstale":"2020-11-16T20:56:37.941530+0000","last_undegraded":"2020-11-16T20:56:37.941530+0000","last_fullsized":"2020-11-16T20:56:37.941530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'650","last_scrub_stamp":"2020-11-16T20:56:37.941529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:56:37.941529+0000","log_size":650,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":399294136,"num_objects":145,"num_object_clones":10,"num_object_copies":435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":1,"num_read":404,"num_read_kb":132711,"num_write":595,"num_write_kb":246224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"18","length":"1"},{"start":"1c","length":"1"},{"start":"20","length":"1"},{"start":"23","length":"1"}]},{"pgid":"4.3","version":"75'270","reported_seq":"481","reported_epoch":"75","state":"active+clean","last_fresh":"2020-11-16T20:56:37.761270+0000","last_change":"2020-11-16T20:56:37.761693+0000","last_active":"2020-11-16T20:56:37.761270+0000","last_peered":"2020-11-16T20:56:37.761270+0000","last_clean":"2020-11-16T20:56:37.761270+0000","last_became_active":"2020-11-16T20:55:30.829833+0000","last_became_peered":"2020-11-16T20:55:30.829833+0000","last_unstale":"2020-11-16T20:56:37.761270+0000","last_undegraded":"2020-11-16T20:56:37.761270+0000","last_fullsized":"2020-11-16T20:56:37.761270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":270,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":135423032,"num_objects":49,"num_object_clones":5,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":97,"num_read_kb":62353,"num_write":156,"num_write_kb":26718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":23,"num_flush_kb":64417,"num_evict":8,"num_evict_kb":20536,"num_promote":54,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"18","length":"1"},{"start":"1c","length":"1"},{"start":"20","length":"1"},{"start":"23","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":"84","reported_epoch":"78","state":"active+clean","last_fresh":"2020-11-16T20:56:40.750870+0000","last_change":"2020-11-16T20:55:59.571968+0000","last_active":"2020-11-16T20:56:40.750870+0000","last_peered":"2020-11-16T20:56:40.750870+0000","last_clean":"2020-11-16T20:56:40.750870+0000","last_became_active":"2020-11-16T20:55:50.901014+0000","last_became_peered":"2020-11-16T20:55:50.901014+0000","last_unstale":"2020-11-16T20:56:40.750870+0000","last_undegraded":"2020-11-16T20:56:40.750870+0000","last_fullsized":"2020-11-16T20:56:40.750870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.571892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.571892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"83","reported_epoch":"78","state":"active+clean","last_fresh":"2020-11-16T20:56:40.761132+0000","last_change":"2020-11-16T20:55:59.950321+0000","last_active":"2020-11-16T20:56:40.761132+0000","last_peered":"2020-11-16T20:56:40.761132+0000","last_clean":"2020-11-16T20:56:40.761132+0000","last_became_active":"2020-11-16T20:55:50.905408+0000","last_became_peered":"2020-11-16T20:55:50.905408+0000","last_unstale":"2020-11-16T20:56:40.761132+0000","last_undegraded":"2020-11-16T20:56:40.761132+0000","last_fullsized":"2020-11-16T20:56:40.761132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.950219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.950219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"79'276","reported_seq":"479","reported_epoch":"79","state":"active+clean","last_fresh":"2020-11-16T20:56:42.016124+0000","last_change":"2020-11-16T20:56:41.784710+0000","last_active":"2020-11-16T20:56:42.016124+0000","last_peered":"2020-11-16T20:56:42.016124+0000","last_clean":"2020-11-16T20:56:42.016124+0000","last_became_active":"2020-11-16T20:55:30.827526+0000","last_became_peered":"2020-11-16T20:55:30.827526+0000","last_unstale":"2020-11-16T20:56:42.016124+0000","last_undegraded":"2020-11-16T20:56:42.016124+0000","last_fullsized":"2020-11-16T20:56:42.016124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":276,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":130287362,"num_objects":50,"num_object_clones":10,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":2,"num_read":104,"num_read_kb":81903,"num_write":126,"num_write_kb":30401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":18,"num_flush_kb":48674,"num_evict":8,"num_evict_kb":23623,"num_promote":48,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"18","length":"1"},{"start":"1c","length":"1"},{"start":"20","length":"2"},{"start":"23","length":"1"},{"start":"26","length":"2"}]},{"pgid":"2.7","version":"0'0","reported_seq":"83","reported_epoch":"78","state":"active+clean","last_fresh":"2020-11-16T20:56:40.750352+0000","last_change":"2020-11-16T20:55:59.645073+0000","last_active":"2020-11-16T20:56:40.750352+0000","last_peered":"2020-11-16T20:56:40.750352+0000","last_clean":"2020-11-16T20:56:40.750352+0000","last_became_active":"2020-11-16T20:55:50.905649+0000","last_became_peered":"2020-11-16T20:55:50.905649+0000","last_unstale":"2020-11-16T20:56:40.750352+0000","last_undegraded":"2020-11-16T20:56:40.750352+0000","last_fullsized":"2020-11-16T20:56:40.750352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.644996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.644996+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"79'259","reported_seq":"580","reported_epoch":"79","state":"active+clean","last_fresh":"2020-11-16T20:56:42.027254+0000","last_change":"2020-11-16T20:56:41.847129+0000","last_active":"2020-11-16T20:56:42.027254+0000","last_peered":"2020-11-16T20:56:42.027254+0000","last_clean":"2020-11-16T20:56:42.027254+0000","last_became_active":"2020-11-16T20:56:16.750108+0000","last_became_peered":"2020-11-16T20:56:16.750108+0000","last_unstale":"2020-11-16T20:56:42.027254+0000","last_undegraded":"2020-11-16T20:56:42.027254+0000","last_fullsized":"2020-11-16T20:56:42.027254+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":259,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":120061936,"num_objects":48,"num_object_clones":7,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":3,"num_read":94,"num_read_kb":60593,"num_write":149,"num_write_kb":31073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":91753326,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":20,"num_flush_kb":58705,"num_evict":9,"num_evict_kb":27793,"num_promote":52,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"18","length":"1"},{"start":"1c","length":"1"},{"start":"20","length":"2"},{"start":"23","length":"1"},{"start":"26","length":"2"}]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":499457906,"num_objects":195,"num_object_clones":31,"num_object_copies":585,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":9,"num_read":373,"num_read_kb":239032,"num_write":601,"num_write_kb":116492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":91753326,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":91,"num_flush_kb":252710,"num_evict":31,"num_evict_kb":85676,"num_promote":207,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1276715008,"data_stored":1410140526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1124,"ondisk_log_size":1124,"up":12,"acting":12,"num_store_stats":7},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":1472741675,"num_objects":542,"num_object_clones":51,"num_object_copies":1626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":542,"num_whiteouts":7,"num_read":1343,"num_read_kb":318267,"num_write":2138,"num_write_kb":960942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":181673084,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2581315584,"data_stored":2633108646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2364,"ondisk_log_size":2364,"up":12,"acting":12,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":18,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":240140,"kb_used_data":220156,"kb_used_omap":0,"kb_used_meta":7232,"kb_avail":94131700,"statfs":{"total":96636764160,"available":96390860800,"internally_reserved":0,"allocated":225439744,"data_stored":238224476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7405568},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":1.7050000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.1719999999999999}]},{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.29}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.323}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.208},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.5229999999999999}]},{"osd":4,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.123}]},{"osd":5,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":1.4730000000000001}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.393},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.417}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":545452,"kb_used_data":531492,"kb_used_omap":0,"kb_used_meta":13952,"kb_avail":93826388,"statfs":{"total":96636764160,"available":96078221312,"internally_reserved":0,"allocated":544247808,"data_stored":569460768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14286848},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.3640000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.1839999999999999}]},{"osd":1,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.038},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":1.4950000000000001}]},{"osd":2,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":1.609}]},{"osd":3,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.339}]},{"osd":4,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.751},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.86099999999999999}]},{"osd":5,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.734}]},{"osd":7,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.1699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305636,"kb_used_data":292964,"kb_used_omap":0,"kb_used_meta":11584,"kb_avail":94066204,"statfs":{"total":96636764160,"available":96323792896,"internally_reserved":0,"allocated":299995136,"data_stored":315599186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11862016},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.69699999999999995}]},{"osd":2,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.56100000000000005}]},{"osd":3,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.677,"5min":2.677,"15min":2.677},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.79100000000000004}]},{"osd":4,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.0669999999999999}]},{"osd":5,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":1.208},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.1259999999999999}]},{"osd":6,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.272}]},{"osd":7,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"max":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.1060000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":857648,"kb_used_data":842408,"kb_used_omap":0,"kb_used_meta":15232,"kb_avail":93514192,"statfs":{"total":96636764160,"available":95758532608,"internally_reserved":0,"allocated":862625792,"data_stored":883623678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15597568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.752},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.92900000000000005}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.68999999999999995}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.80100000000000005}]},{"osd":4,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.361}]},{"osd":5,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.47},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.21}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.278},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":1.444}]},{"osd":7,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"max":{"1min":1.954,"5min":1.954,"15min":1.954},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.54}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":205204,"kb_used_data":198668,"kb_used_omap":0,"kb_used_meta":6528,"kb_avail":94166636,"statfs":{"total":96636764160,"available":96426635264,"internally_reserved":0,"allocated":203436032,"data_stored":203051624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6684672},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":1.131},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.94899999999999995}]},{"osd":1,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.77300000000000002}]},{"osd":3,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.92000000000000004}]},{"osd":4,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.212}]},{"osd":5,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.244}]},{"osd":6,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.349}]},{"osd":7,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.107},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.0840000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":648968,"kb_used_data":635072,"kb_used_omap":0,"kb_used_meta":13888,"kb_avail":93722872,"statfs":{"total":96636764160,"available":95972220928,"internally_reserved":0,"allocated":650313728,"data_stored":682822899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14221312},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.53500000000000003}]},{"osd":1,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.70799999999999996}]},{"osd":2,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.89100000000000001}]},{"osd":4,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.923,"5min":2.923,"15min":2.923},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.968,"5min":2.968,"15min":2.968},"last":0.85999999999999999}]},{"osd":5,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.8479999999999999,"5min":2.8479999999999999,"15min":2.8479999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.0489999999999999}]},{"osd":6,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.859,"5min":2.859,"15min":2.859},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":3.5390000000000001,"5min":3.5390000000000001,"15min":3.5390000000000001},"last":1.0289999999999999}]},{"osd":7,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.9780000000000002,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":1.008}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":658188,"kb_used_data":643148,"kb_used_omap":0,"kb_used_meta":13952,"kb_avail":93713652,"statfs":{"total":96636764160,"available":95962779648,"internally_reserved":0,"allocated":658583552,"data_stored":699332067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14286848},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.504},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.0569999999999999}]},{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":1.1879999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.61699999999999999}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.78000000000000003}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.319},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.90900000000000003}]},{"osd":5,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.429}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.089},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":0.995}]},{"osd":7,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":2.4369999999999998,"5min":2.4369999999999998,"15min":2.4369999999999998},"last":1.827},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.2290000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":412040,"kb_used_data":399232,"kb_used_omap":0,"kb_used_meta":12800,"kb_avail":93959800,"statfs":{"total":96636764160,"available":96214835200,"internally_reserved":0,"allocated":408813568,"data_stored":437852743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13107200},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.2230000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.2689999999999999}]},{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.0900000000000001}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.1739999999999999}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.875},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":1.115}]},{"osd":4,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.59199999999999997}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.95099999999999996}]},{"osd":7,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":1.107,"5min":1.107,"15min":1.107},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.75900000000000001}]}]}]}} 2020-11-16T20:56:42.995 INFO:tasks.thrashosds.thrasher:Setting 4.0 to [2, 1, 0] 2020-11-16T20:56:42.995 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.0', '2', '1', '0'] 2020-11-16T20:56:42.995 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.0 2 1 0 2020-11-16T20:56:43.032 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:43.036+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:43.099 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:43.104+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:43.103 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:43.103 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:43.104 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:56:43.104 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:56:43.104 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:43.114 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:56:43.200 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:43.204+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:43.247 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:43.247 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:56:43.247 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:56:43.248 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:56:43.248 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.248 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:202 3.2 3:5723fd94:::smithi16641208-211:head [copy-from ver 110] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e35)", 2020-11-16T20:56:43.248 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:56:43.248 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 48.281352574000003, 2020-11-16T20:56:43.248 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027790216999999999, 2020-11-16T20:56:43.248 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:43.249 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:43.249 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:43.249 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.249 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:43.249 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:56:43.249 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:43.249 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.250 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.250 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:43.250 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:56:43.250 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1907999999999998e-05 2020-11-16T20:56:43.250 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.250 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.250 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:43.251 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969232+0000", 2020-11-16T20:56:43.251 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5270000000000004e-06 2020-11-16T20:56:43.251 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.251 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.251 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:43.251 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969239+0000", 2020-11-16T20:56:43.251 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3062e-05 2020-11-16T20:56:43.251 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.252 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.252 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:43.252 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969252+0000", 2020-11-16T20:56:43.252 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8919999999999997e-06 2020-11-16T20:56:43.252 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.252 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.252 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:43.253 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969258+0000", 2020-11-16T20:56:43.253 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00040859799999999998 2020-11-16T20:56:43.253 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.253 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.253 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.253 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969666+0000", 2020-11-16T20:56:43.253 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0932000000000003e-05 2020-11-16T20:56:43.253 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.254 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.254 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:43.254 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969757+0000", 2020-11-16T20:56:43.254 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010999395 2020-11-16T20:56:43.254 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.254 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.254 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:43.255 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.980757+0000", 2020-11-16T20:56:43.255 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006260659 2020-11-16T20:56:43.255 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.255 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.255 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:43.255 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987017+0000", 2020-11-16T20:56:43.255 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0080836880000000003 2020-11-16T20:56:43.255 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.256 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.256 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:43.256 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995101+0000", 2020-11-16T20:56:43.256 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001796829 2020-11-16T20:56:43.256 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.256 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.256 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:43.257 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996898+0000", 2020-11-16T20:56:43.257 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2086000000000003e-05 2020-11-16T20:56:43.257 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.257 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.257 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:43.257 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996940+0000", 2020-11-16T20:56:43.257 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0641e-05 2020-11-16T20:56:43.257 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.258 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.258 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:43.258 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996971+0000", 2020-11-16T20:56:43.258 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027790216999999999 2020-11-16T20:56:43.258 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.258 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:43.258 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.259 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.259 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.259 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:547 3.2 3:5f250a2b:::smithi16641208-75:head [copy-from ver 38] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:43.259 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:56:43.259 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.232965270999998, 2020-11-16T20:56:43.259 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027400430999999999, 2020-11-16T20:56:43.259 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:43.259 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:43.260 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:43.260 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.260 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:43.260 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:56:43.260 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:43.260 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.260 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.261 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:43.261 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:56:43.261 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5093999999999999e-05 2020-11-16T20:56:43.261 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.261 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.261 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:43.261 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017613+0000", 2020-11-16T20:56:43.262 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6150000000000003e-06 2020-11-16T20:56:43.262 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.262 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.262 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:43.262 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017623+0000", 2020-11-16T20:56:43.262 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6934000000000001e-05 2020-11-16T20:56:43.262 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.262 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.263 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:43.263 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017639+0000", 2020-11-16T20:56:43.263 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1892000000000001e-05 2020-11-16T20:56:43.263 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.263 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.263 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:43.263 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017651+0000", 2020-11-16T20:56:43.264 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2955999999999998e-05 2020-11-16T20:56:43.264 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.264 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.264 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.264 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017714+0000", 2020-11-16T20:56:43.264 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019352400000000001 2020-11-16T20:56:43.264 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.265 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.265 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:43.265 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017908+0000", 2020-11-16T20:56:43.265 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0073901349999999999 2020-11-16T20:56:43.265 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.265 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.265 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:43.265 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025298+0000", 2020-11-16T20:56:43.266 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0082133799999999993 2020-11-16T20:56:43.266 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.266 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.266 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:43.266 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033511+0000", 2020-11-16T20:56:43.266 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0074347629999999996 2020-11-16T20:56:43.266 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.267 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.267 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:43.267 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.040946+0000", 2020-11-16T20:56:43.267 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039404669999999996 2020-11-16T20:56:43.267 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.267 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.267 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:43.267 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044887+0000", 2020-11-16T20:56:43.268 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7098000000000002e-05 2020-11-16T20:56:43.268 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.268 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.268 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:43.268 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044934+0000", 2020-11-16T20:56:43.268 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4573000000000003e-05 2020-11-16T20:56:43.268 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.269 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.269 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:43.269 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044968+0000", 2020-11-16T20:56:43.269 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027400430999999999 2020-11-16T20:56:43.269 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.269 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:43.269 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.269 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.270 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.270 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:548 3.2 3:6173e90a:::smithi16641208-2:head [copy-from ver 3] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:43.270 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:56:43.270 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.232833937999999, 2020-11-16T20:56:43.270 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029556911000000002, 2020-11-16T20:56:43.270 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:43.270 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:43.271 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:43.271 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.271 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:43.271 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:56:43.271 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:43.271 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.271 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.272 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:43.272 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:56:43.272 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2478000000000002e-05 2020-11-16T20:56:43.272 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.272 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.272 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:43.272 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017742+0000", 2020-11-16T20:56:43.272 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3060000000000003e-06 2020-11-16T20:56:43.273 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.273 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.273 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:43.273 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017748+0000", 2020-11-16T20:56:43.273 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1102e-05 2020-11-16T20:56:43.273 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.273 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.274 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:43.274 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017759+0000", 2020-11-16T20:56:43.274 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.118e-06 2020-11-16T20:56:43.274 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.274 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.274 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:43.274 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017764+0000", 2020-11-16T20:56:43.275 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032233700000000001 2020-11-16T20:56:43.275 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.275 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.275 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.275 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.018086+0000", 2020-11-16T20:56:43.275 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000128374 2020-11-16T20:56:43.275 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.275 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.276 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:43.276 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.018215+0000", 2020-11-16T20:56:43.276 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012971355 2020-11-16T20:56:43.276 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.276 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.276 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:43.276 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.031186+0000", 2020-11-16T20:56:43.277 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044142890000000001 2020-11-16T20:56:43.277 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.277 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.277 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:43.277 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.035600+0000", 2020-11-16T20:56:43.277 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092372719999999995 2020-11-16T20:56:43.277 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.277 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.278 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:43.278 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044838+0000", 2020-11-16T20:56:43.278 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0023022049999999999 2020-11-16T20:56:43.278 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.278 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.278 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:43.278 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047140+0000", 2020-11-16T20:56:43.279 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0380999999999997e-05 2020-11-16T20:56:43.279 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.279 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.279 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:43.279 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047200+0000", 2020-11-16T20:56:43.279 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5693999999999999e-05 2020-11-16T20:56:43.279 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.279 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.280 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:43.280 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047256+0000", 2020-11-16T20:56:43.280 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029556911000000002 2020-11-16T20:56:43.280 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.280 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:43.280 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.280 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.281 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.281 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:554 3.2 3:769099fd:::smithi16641208-247:head [copy-from ver 123] snapc 1=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:43.281 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:56:43.281 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.200430619999999, 2020-11-16T20:56:43.281 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998, 2020-11-16T20:56:43.281 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:43.281 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:43.281 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:43.282 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.282 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:43.282 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:56:43.282 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:43.282 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.282 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.282 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:43.283 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:56:43.283 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6705999999999997e-05 2020-11-16T20:56:43.283 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.283 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.283 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:43.283 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050139+0000", 2020-11-16T20:56:43.283 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6199999999999998e-06 2020-11-16T20:56:43.283 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.284 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.284 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:43.284 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050144+0000", 2020-11-16T20:56:43.284 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.944e-06 2020-11-16T20:56:43.284 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.284 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.284 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:43.285 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050154+0000", 2020-11-16T20:56:43.285 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4043999999999999e-05 2020-11-16T20:56:43.285 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.285 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.285 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:43.285 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050178+0000", 2020-11-16T20:56:43.285 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078971409999999999 2020-11-16T20:56:43.285 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.286 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.286 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.286 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058075+0000", 2020-11-16T20:56:43.286 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012776500000000001 2020-11-16T20:56:43.286 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.286 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.286 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:43.286 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058203+0000", 2020-11-16T20:56:43.287 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011807013 2020-11-16T20:56:43.287 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.287 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.287 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:43.287 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070010+0000", 2020-11-16T20:56:43.287 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029522160000000001 2020-11-16T20:56:43.287 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.288 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.288 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:43.288 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.072962+0000", 2020-11-16T20:56:43.288 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017845006 2020-11-16T20:56:43.288 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.288 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.288 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:43.288 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.090807+0000", 2020-11-16T20:56:43.289 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.009301808 2020-11-16T20:56:43.289 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.289 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.289 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:43.289 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100109+0000", 2020-11-16T20:56:43.289 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7076999999999995e-05 2020-11-16T20:56:43.289 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.290 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.290 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:43.290 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100176+0000", 2020-11-16T20:56:43.290 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9790999999999999e-05 2020-11-16T20:56:43.290 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.290 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.290 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:43.290 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100216+0000", 2020-11-16T20:56:43.291 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998 2020-11-16T20:56:43.291 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.291 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:43.291 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.291 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.291 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.291 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:555 3.2 3:590e6edd:::smithi16641208-203:head [delete] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:43.292 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.076366+0000", 2020-11-16T20:56:43.292 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.174166763000002, 2020-11-16T20:56:43.292 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024009968, 2020-11-16T20:56:43.292 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:43.292 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:43.292 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:43.292 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.292 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:43.293 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076366+0000", 2020-11-16T20:56:43.293 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:43.293 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.293 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.293 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:43.293 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076366+0000", 2020-11-16T20:56:43.293 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2963999999999998e-05 2020-11-16T20:56:43.294 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.294 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.294 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:43.294 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076399+0000", 2020-11-16T20:56:43.294 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6879999999999999e-06 2020-11-16T20:56:43.294 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.294 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.294 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:43.295 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076407+0000", 2020-11-16T20:56:43.295 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4088999999999999e-05 2020-11-16T20:56:43.295 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.295 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.295 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:43.295 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076431+0000", 2020-11-16T20:56:43.295 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.4280000000000002e-06 2020-11-16T20:56:43.296 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.296 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.296 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:43.296 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076440+0000", 2020-11-16T20:56:43.296 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3467999999999998e-05 2020-11-16T20:56:43.296 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.296 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.296 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.297 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076484+0000", 2020-11-16T20:56:43.297 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011613 2020-11-16T20:56:43.297 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.297 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.297 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:43.297 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076600+0000", 2020-11-16T20:56:43.297 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8172999999999998e-05 2020-11-16T20:56:43.297 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.298 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.298 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:43.298 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076678+0000", 2020-11-16T20:56:43.298 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0009822749999999999 2020-11-16T20:56:43.298 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.298 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.298 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:43.299 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.077661+0000", 2020-11-16T20:56:43.299 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018605739999999999 2020-11-16T20:56:43.299 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.299 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.299 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:43.299 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.096266+0000", 2020-11-16T20:56:43.299 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039876709999999999 2020-11-16T20:56:43.300 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.300 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.300 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:43.300 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100254+0000", 2020-11-16T20:56:43.300 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4382999999999996e-05 2020-11-16T20:56:43.300 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.300 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.300 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:43.301 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100328+0000", 2020-11-16T20:56:43.301 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7958999999999999e-05 2020-11-16T20:56:43.301 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.301 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.301 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:43.301 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100376+0000", 2020-11-16T20:56:43.301 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024009968 2020-11-16T20:56:43.302 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.302 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:43.302 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.302 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.302 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.302 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:556 3.2 3:590e6edd:::smithi16641208-203:head [copy-from ver 105] snapc 1=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:43.302 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.076482+0000", 2020-11-16T20:56:43.302 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.174051313, 2020-11-16T20:56:43.303 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025150006999999999, 2020-11-16T20:56:43.303 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:43.303 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:43.303 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:43.303 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.303 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:43.303 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076482+0000", 2020-11-16T20:56:43.304 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:43.304 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.304 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.304 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:43.304 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076482+0000", 2020-11-16T20:56:43.304 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0086000000000006e-05 2020-11-16T20:56:43.304 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.304 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.305 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:43.305 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076552+0000", 2020-11-16T20:56:43.305 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7299999999999999e-06 2020-11-16T20:56:43.305 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.305 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.305 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:43.305 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076559+0000", 2020-11-16T20:56:43.306 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5905000000000001e-05 2020-11-16T20:56:43.306 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.306 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.306 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:43.306 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076574+0000", 2020-11-16T20:56:43.306 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9369999999999993e-06 2020-11-16T20:56:43.306 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.306 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.307 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:43.307 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076583+0000", 2020-11-16T20:56:43.307 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00064848599999999998 2020-11-16T20:56:43.307 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.307 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.307 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.307 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.077232+0000", 2020-11-16T20:56:43.308 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8629999999999999e-05 2020-11-16T20:56:43.308 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.308 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.308 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:43.308 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.077291+0000", 2020-11-16T20:56:43.308 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003820773 2020-11-16T20:56:43.308 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.308 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.309 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:43.309 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.081111+0000", 2020-11-16T20:56:43.309 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033171849999999998 2020-11-16T20:56:43.309 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.309 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.309 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:43.309 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.084428+0000", 2020-11-16T20:56:43.309 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016400174 2020-11-16T20:56:43.310 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.310 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.310 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:43.310 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100829+0000", 2020-11-16T20:56:43.310 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00071628499999999999 2020-11-16T20:56:43.310 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.310 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.311 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:43.311 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.101545+0000", 2020-11-16T20:56:43.311 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7249e-05 2020-11-16T20:56:43.311 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.311 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.311 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:43.311 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.101602+0000", 2020-11-16T20:56:43.311 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9567e-05 2020-11-16T20:56:43.312 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.312 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.312 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:43.312 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.101632+0000", 2020-11-16T20:56:43.312 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025150006999999999 2020-11-16T20:56:43.312 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.312 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:43.313 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.313 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.313 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2429 4.0 4:3b92f709:::smithi16641208-69:head [rollback 7] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:56:43.313 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:56:43.313 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 33.234512358000003, 2020-11-16T20:56:43.313 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003, 2020-11-16T20:56:43.313 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:43.314 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:43.314 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:43.314 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:43.314 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:43.314 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2429 2020-11-16T20:56:43.314 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.314 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:43.315 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.315 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:43.315 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:56:43.315 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:43.315 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.315 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.315 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:43.315 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:56:43.316 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3710000000000002e-05 2020-11-16T20:56:43.316 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.316 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.316 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:43.316 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016044+0000", 2020-11-16T20:56:43.316 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7090000000000001e-06 2020-11-16T20:56:43.316 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.317 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.317 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:43.317 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016049+0000", 2020-11-16T20:56:43.317 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8820000000000003e-06 2020-11-16T20:56:43.317 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.317 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.317 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:43.317 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016056+0000", 2020-11-16T20:56:43.318 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.27e-06 2020-11-16T20:56:43.318 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.318 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.318 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:43.318 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016059+0000", 2020-11-16T20:56:43.318 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.537e-05 2020-11-16T20:56:43.318 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.319 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.319 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.319 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016115+0000", 2020-11-16T20:56:43.319 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8690000000000003e-06 2020-11-16T20:56:43.319 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.319 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.319 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:43.319 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016120+0000", 2020-11-16T20:56:43.320 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021405730000000002 2020-11-16T20:56:43.320 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.320 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.320 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.320 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018260+0000", 2020-11-16T20:56:43.320 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0137999999999999e-05 2020-11-16T20:56:43.320 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.321 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.321 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:43.321 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018320+0000", 2020-11-16T20:56:43.321 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011799352000000001 2020-11-16T20:56:43.321 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.321 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.321 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.321 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030120+0000", 2020-11-16T20:56:43.322 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000163139 2020-11-16T20:56:43.322 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.322 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.322 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:43.322 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030283+0000", 2020-11-16T20:56:43.322 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029657000000000002 2020-11-16T20:56:43.322 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.323 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.323 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:43.323 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030579+0000", 2020-11-16T20:56:43.323 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3058000000000001e-05 2020-11-16T20:56:43.323 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.323 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.323 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:43.323 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030612+0000", 2020-11-16T20:56:43.324 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0075168259999999999 2020-11-16T20:56:43.324 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.324 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.324 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.324 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038129+0000", 2020-11-16T20:56:43.324 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012914299999999999 2020-11-16T20:56:43.324 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.325 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.325 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:43.325 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038258+0000", 2020-11-16T20:56:43.325 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034292799999999999 2020-11-16T20:56:43.325 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.325 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.325 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:56:43.325 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038601+0000", 2020-11-16T20:56:43.326 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0025181159999999999 2020-11-16T20:56:43.326 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.326 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.326 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.326 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041119+0000", 2020-11-16T20:56:43.326 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2331999999999997e-05 2020-11-16T20:56:43.326 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.327 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.327 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for ondisk", 2020-11-16T20:56:43.327 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041202+0000", 2020-11-16T20:56:43.327 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028481750000000001 2020-11-16T20:56:43.327 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.327 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.327 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:43.327 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044050+0000", 2020-11-16T20:56:43.328 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001269921 2020-11-16T20:56:43.328 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.328 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.328 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:43.328 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045320+0000", 2020-11-16T20:56:43.328 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054215490000000003 2020-11-16T20:56:43.328 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.329 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.329 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:43.329 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050741+0000", 2020-11-16T20:56:43.329 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6981000000000001e-05 2020-11-16T20:56:43.329 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.329 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.329 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:43.329 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050808+0000", 2020-11-16T20:56:43.330 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8841e-05 2020-11-16T20:56:43.330 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.330 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.330 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:43.330 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050877+0000", 2020-11-16T20:56:43.330 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003 2020-11-16T20:56:43.330 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.331 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:43.331 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.331 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.331 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.331 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2430 4.0 4:3b92f709:::smithi16641208-69:head [append 0~0] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:56:43.331 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:56:43.331 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 33.234456035000001, 2020-11-16T20:56:43.331 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001, 2020-11-16T20:56:43.332 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:43.332 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:43.332 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:43.332 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:43.332 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:43.332 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2430 2020-11-16T20:56:43.332 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.332 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:43.333 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.333 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:43.333 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:56:43.333 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:43.333 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.333 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.333 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:43.334 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:56:43.334 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0857e-05 2020-11-16T20:56:43.334 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.334 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.334 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:43.334 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016098+0000", 2020-11-16T20:56:43.334 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9179999999999999e-06 2020-11-16T20:56:43.335 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:43.335 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016104+0000", 2020-11-16T20:56:43.335 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8230000000000006e-06 2020-11-16T20:56:43.335 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:43.336 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016114+0000", 2020-11-16T20:56:43.336 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2180000000000001e-06 2020-11-16T20:56:43.336 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.336 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.336 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:43.336 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016118+0000", 2020-11-16T20:56:43.336 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3547999999999995e-05 2020-11-16T20:56:43.337 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.337 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.337 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.337 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016181+0000", 2020-11-16T20:56:43.337 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8730000000000007e-06 2020-11-16T20:56:43.337 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.337 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.337 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:43.338 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016189+0000", 2020-11-16T20:56:43.338 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021577200000000001 2020-11-16T20:56:43.338 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.338 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.338 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.338 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018347+0000", 2020-11-16T20:56:43.338 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6832000000000001e-05 2020-11-16T20:56:43.339 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.339 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.339 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:43.339 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018404+0000", 2020-11-16T20:56:43.339 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012272913999999999 2020-11-16T20:56:43.339 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.339 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.339 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.340 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030677+0000", 2020-11-16T20:56:43.340 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2555000000000002e-05 2020-11-16T20:56:43.340 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.340 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.340 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:43.340 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030719+0000", 2020-11-16T20:56:43.340 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010518684 2020-11-16T20:56:43.341 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.341 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.341 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.341 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041238+0000", 2020-11-16T20:56:43.341 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000144723 2020-11-16T20:56:43.341 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.341 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.341 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:43.342 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041383+0000", 2020-11-16T20:56:43.342 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000214575 2020-11-16T20:56:43.342 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.342 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.342 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:56:43.342 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041597+0000", 2020-11-16T20:56:43.342 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002463196 2020-11-16T20:56:43.343 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.343 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.343 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:43.343 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044060+0000", 2020-11-16T20:56:43.343 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001654066 2020-11-16T20:56:43.343 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.343 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.343 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:43.344 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045715+0000", 2020-11-16T20:56:43.344 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053780599999999996 2020-11-16T20:56:43.344 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.344 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.344 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:43.344 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051093+0000", 2020-11-16T20:56:43.344 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8189999999999996e-05 2020-11-16T20:56:43.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.345 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.345 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:43.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051161+0000", 2020-11-16T20:56:43.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4910000000000001e-05 2020-11-16T20:56:43.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.345 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.345 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:43.346 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051216+0000", 2020-11-16T20:56:43.346 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001 2020-11-16T20:56:43.346 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.346 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:43.346 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.346 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.346 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.347 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "MOSDPGPush(4.1 52/51 [PushOp(4:9ab04c4a:::smithi16641208-1:head, version: 33'3, data_included: [0~892056,1542129~156520], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:9ab04c4a:::smithi16641208-1:head@33'3, size: 2016807, copy_subset: [0~2016807], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1698649, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:a1eef07d:::smithi16641208-13:head, version: 33'9, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:a1eef07d:::smithi16641208-13:head@33'9, size: 2201684, copy_subset: [0~2201684], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:929564f0:::smithi16641208-24:head, version: 33'18, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:929564f0:::smithi16641208-24:head@33'18, size: 2386561, copy_subset: [0~2386561], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b565f7d2:::smithi16641208-35:head, version: 33'27, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b565f7d2:::smithi16641208-35:head@33'27, size: 2571438, copy_subset: [0~2571438], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b6545a47:::smithi16641208-46:head, version: 33'29, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b6545a47:::smithi16641208-46:head@33'29, size: 2756315, copy_subset: [0~2756315], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:9bd9f31d:::smithi16641208-48:head, version: 33'35, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:9bd9f31d:::smithi16641208-48:head@33'35, size: 2789929, copy_subset: [0~2789929], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:83205103:::smithi16641208-103:head, version: 34'38, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:83205103:::smithi16641208-103:head@34'38, size: 3714314, copy_subset: [0~3714314], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:86a0a5b7:::smithi16641208-108:head, version: 34'42, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:86a0a5b7:::smithi16641208-108:head@34'42, size: 3798349, copy_subset: [0~3798349], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-16T20:56:43.347 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:56:43.347 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 28.479859429000001, 2020-11-16T20:56:43.347 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032552672999999997, 2020-11-16T20:56:43.347 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:43.347 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:43.347 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:43.348 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.348 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:43.348 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:56:43.348 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:43.348 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.348 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.348 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:43.348 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:56:43.349 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017498692999999999 2020-11-16T20:56:43.349 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.349 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.349 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:43.349 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788172+0000", 2020-11-16T20:56:43.349 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4147999999999999e-05 2020-11-16T20:56:43.349 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.350 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:43.350 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788206+0000", 2020-11-16T20:56:43.350 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0016000000000002e-05 2020-11-16T20:56:43.350 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.350 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:43.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788276+0000", 2020-11-16T20:56:43.351 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2172000000000002e-05 2020-11-16T20:56:43.351 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.351 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.351 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:43.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788319+0000", 2020-11-16T20:56:43.351 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000154337 2020-11-16T20:56:43.351 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.352 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.352 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788473+0000", 2020-11-16T20:56:43.352 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7690000000000002e-06 2020-11-16T20:56:43.352 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.352 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:43.352 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788482+0000", 2020-11-16T20:56:43.353 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014744538 2020-11-16T20:56:43.353 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.353 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.353 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:43.353 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803226+0000", 2020-11-16T20:56:43.353 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032552672999999997 2020-11-16T20:56:43.353 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.354 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:43.354 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.354 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.354 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.354 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.0:552 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'128, mlcod=0'0)", 2020-11-16T20:56:43.354 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:56:43.354 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 28.459894010999999, 2020-11-16T20:56:43.354 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038033168999999999, 2020-11-16T20:56:43.355 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:43.355 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:43.355 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:43.355 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.355 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:43.355 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:56:43.355 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:43.356 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.356 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.356 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:43.356 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:56:43.356 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0031023880000000002 2020-11-16T20:56:43.356 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.356 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.356 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:43.357 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793741+0000", 2020-11-16T20:56:43.357 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1496e-05 2020-11-16T20:56:43.357 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.357 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.357 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:43.357 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793753+0000", 2020-11-16T20:56:43.357 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9009999999999999e-05 2020-11-16T20:56:43.358 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.358 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.358 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:43.358 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793772+0000", 2020-11-16T20:56:43.358 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3318e-05 2020-11-16T20:56:43.358 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.358 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.359 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:43.359 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793785+0000", 2020-11-16T20:56:43.359 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012534775 2020-11-16T20:56:43.359 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.359 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.359 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.359 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806320+0000", 2020-11-16T20:56:43.359 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8144999999999999e-05 2020-11-16T20:56:43.360 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.360 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.360 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:43.360 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806348+0000", 2020-11-16T20:56:43.360 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022285688000000001 2020-11-16T20:56:43.360 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.360 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.361 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:43.361 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828634+0000", 2020-11-16T20:56:43.361 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8349000000000002e-05 2020-11-16T20:56:43.361 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.361 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.361 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:43.361 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828672+0000", 2020-11-16T20:56:43.362 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038033168999999999 2020-11-16T20:56:43.362 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.362 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:43.362 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.362 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.362 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.362 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2503 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'129, mlcod=0'0)", 2020-11-16T20:56:43.363 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:56:43.363 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 28.456705831000001, 2020-11-16T20:56:43.363 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034870998, 2020-11-16T20:56:43.363 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:43.363 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:43.363 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:43.363 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.363 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:43.364 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:56:43.364 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:43.364 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.364 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.364 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:43.364 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:56:43.364 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00093048899999999995 2020-11-16T20:56:43.365 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.365 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.365 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:43.365 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794758+0000", 2020-11-16T20:56:43.365 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.169e-05 2020-11-16T20:56:43.365 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.365 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.365 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:43.366 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794769+0000", 2020-11-16T20:56:43.366 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3998999999999999e-05 2020-11-16T20:56:43.366 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.366 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.366 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:43.366 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794783+0000", 2020-11-16T20:56:43.366 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.481e-06 2020-11-16T20:56:43.367 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.367 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.367 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:43.367 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794791+0000", 2020-11-16T20:56:43.367 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.02524036 2020-11-16T20:56:43.367 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.367 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.367 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.368 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820031+0000", 2020-11-16T20:56:43.368 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.811e-05 2020-11-16T20:56:43.368 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.368 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.368 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:43.368 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820059+0000", 2020-11-16T20:56:43.368 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.008614577 2020-11-16T20:56:43.369 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.369 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.369 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:43.369 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828674+0000", 2020-11-16T20:56:43.369 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4292000000000001e-05 2020-11-16T20:56:43.369 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.369 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.369 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:43.370 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828698+0000", 2020-11-16T20:56:43.370 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034870998 2020-11-16T20:56:43.370 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.370 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:43.370 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.370 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.370 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.371 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2504 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'130, mlcod=0'0)", 2020-11-16T20:56:43.371 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:56:43.371 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 28.455700148999998, 2020-11-16T20:56:43.371 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033888776000000002, 2020-11-16T20:56:43.371 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:43.371 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:43.371 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:43.371 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.372 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:43.372 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:56:43.372 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:43.372 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.372 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.372 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:43.372 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:56:43.373 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3896999999999997e-05 2020-11-16T20:56:43.373 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.373 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.373 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:43.373 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794877+0000", 2020-11-16T20:56:43.373 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7019999999999998e-06 2020-11-16T20:56:43.373 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.373 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.374 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:43.374 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794883+0000", 2020-11-16T20:56:43.374 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.789e-06 2020-11-16T20:56:43.374 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.374 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.374 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:43.374 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794888+0000", 2020-11-16T20:56:43.375 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.852e-06 2020-11-16T20:56:43.375 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.375 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.375 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:43.375 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794891+0000", 2020-11-16T20:56:43.375 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026152822999999999 2020-11-16T20:56:43.375 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.375 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.376 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.376 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.821044+0000", 2020-11-16T20:56:43.376 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6900999999999999e-05 2020-11-16T20:56:43.376 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.376 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.376 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:43.376 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.821071+0000", 2020-11-16T20:56:43.376 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0076283210000000004 2020-11-16T20:56:43.377 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.377 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.377 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:43.377 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828699+0000", 2020-11-16T20:56:43.377 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2490999999999999e-05 2020-11-16T20:56:43.377 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.377 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.378 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:43.378 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828722+0000", 2020-11-16T20:56:43.378 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033888776000000002 2020-11-16T20:56:43.378 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.378 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:43.378 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.378 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.379 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.379 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.13:681 3.1 e52/19 3:afc69464:::smithi16641208-110:head v 52'546, mlcod=52'544)", 2020-11-16T20:56:43.379 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:56:43.379 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 28.453040079000001, 2020-11-16T20:56:43.379 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.03113606, 2020-11-16T20:56:43.379 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:43.379 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:43.379 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:43.380 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.380 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:43.380 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:56:43.380 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:43.380 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.380 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.380 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:43.380 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:56:43.381 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0026681809999999999 2020-11-16T20:56:43.381 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.381 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.381 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:43.381 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800161+0000", 2020-11-16T20:56:43.381 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3499000000000001e-05 2020-11-16T20:56:43.381 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.382 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:43.382 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800175+0000", 2020-11-16T20:56:43.382 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8301999999999999e-05 2020-11-16T20:56:43.382 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.382 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:43.382 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800193+0000", 2020-11-16T20:56:43.383 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0465999999999999e-05 2020-11-16T20:56:43.383 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.383 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.383 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:43.383 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800203+0000", 2020-11-16T20:56:43.383 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061432479999999996 2020-11-16T20:56:43.383 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.384 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.384 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806347+0000", 2020-11-16T20:56:43.384 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.641e-05 2020-11-16T20:56:43.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.384 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:43.384 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806373+0000", 2020-11-16T20:56:43.385 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022190887999999999 2020-11-16T20:56:43.385 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.385 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.385 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:43.385 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828564+0000", 2020-11-16T20:56:43.385 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5066000000000003e-05 2020-11-16T20:56:43.385 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.386 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.386 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:43.386 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828629+0000", 2020-11-16T20:56:43.386 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.03113606 2020-11-16T20:56:43.386 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.386 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:43.386 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.386 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.387 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.387 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.13:682 3.1 e52/19 3:b3ae2c4d:::smithi16641208-463:head v 52'547, mlcod=52'544)", 2020-11-16T20:56:43.387 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.802222+0000", 2020-11-16T20:56:43.387 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 28.448311175000001, 2020-11-16T20:56:43.387 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026721733000000001, 2020-11-16T20:56:43.387 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:43.387 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:43.388 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:43.388 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.388 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:43.388 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.802222+0000", 2020-11-16T20:56:43.388 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:43.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.388 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.388 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:43.389 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.802222+0000", 2020-11-16T20:56:43.389 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001333442 2020-11-16T20:56:43.389 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.389 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:43.389 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803555+0000", 2020-11-16T20:56:43.389 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0971999999999999e-05 2020-11-16T20:56:43.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.390 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.390 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:43.390 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803566+0000", 2020-11-16T20:56:43.390 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5973000000000001e-05 2020-11-16T20:56:43.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.390 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.390 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:43.391 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803582+0000", 2020-11-16T20:56:43.391 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2969999999999998e-06 2020-11-16T20:56:43.391 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.391 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:43.391 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803590+0000", 2020-11-16T20:56:43.391 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016424259 2020-11-16T20:56:43.392 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.392 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.392 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.392 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820014+0000", 2020-11-16T20:56:43.392 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9485999999999999e-05 2020-11-16T20:56:43.392 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.392 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.392 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:43.393 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820033+0000", 2020-11-16T20:56:43.393 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0088553179999999992 2020-11-16T20:56:43.393 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.393 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.393 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:43.393 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828889+0000", 2020-11-16T20:56:43.393 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4985999999999998e-05 2020-11-16T20:56:43.394 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.394 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.394 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:43.394 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828944+0000", 2020-11-16T20:56:43.394 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026721733000000001 2020-11-16T20:56:43.394 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.394 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:43.394 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.395 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.395 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.395 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:602 3.2 3:5a2aa7df:::smithi16641208-248:head [copy-from ver 124] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:56:43.395 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.751134+0000", 2020-11-16T20:56:43.395 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 23.499398671000002, 2020-11-16T20:56:43.395 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026671776000000001, 2020-11-16T20:56:43.395 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:43.396 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:43.396 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:43.396 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.396 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:43.396 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751134+0000", 2020-11-16T20:56:43.396 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:43.396 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.396 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.397 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:43.397 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751134+0000", 2020-11-16T20:56:43.397 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2177e-05 2020-11-16T20:56:43.397 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.397 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.397 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:43.397 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751177+0000", 2020-11-16T20:56:43.398 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8199999999999999e-06 2020-11-16T20:56:43.398 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.398 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.398 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:43.398 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751183+0000", 2020-11-16T20:56:43.398 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3193999999999999e-05 2020-11-16T20:56:43.398 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.398 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.399 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:43.399 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751197+0000", 2020-11-16T20:56:43.399 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.823e-06 2020-11-16T20:56:43.399 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.399 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.399 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:43.399 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751202+0000", 2020-11-16T20:56:43.400 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3791000000000001e-05 2020-11-16T20:56:43.400 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.400 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.400 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.400 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751246+0000", 2020-11-16T20:56:43.400 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019541200000000001 2020-11-16T20:56:43.400 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.400 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.401 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:43.401 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751442+0000", 2020-11-16T20:56:43.401 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0098138649999999997 2020-11-16T20:56:43.401 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.401 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.401 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:43.401 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.761255+0000", 2020-11-16T20:56:43.401 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0093475569999999994 2020-11-16T20:56:43.402 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.402 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.402 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:43.402 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770603+0000", 2020-11-16T20:56:43.402 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053967829999999996 2020-11-16T20:56:43.402 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.402 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.403 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:43.403 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.776000+0000", 2020-11-16T20:56:43.403 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001679687 2020-11-16T20:56:43.403 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.403 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.403 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:43.403 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.777680+0000", 2020-11-16T20:56:43.403 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5221000000000005e-05 2020-11-16T20:56:43.404 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.404 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.404 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:43.404 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.777745+0000", 2020-11-16T20:56:43.404 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1445999999999994e-05 2020-11-16T20:56:43.404 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.404 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.405 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:43.405 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.777806+0000", 2020-11-16T20:56:43.405 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026671776000000001 2020-11-16T20:56:43.405 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.405 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:43.405 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.405 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.405 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.406 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:603 3.2 3:5a2e7c26:::smithi16641208-130:head [copy-from ver 67] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:56:43.406 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:56:43.406 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 23.499292085, 2020-11-16T20:56:43.406 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036631116999999998, 2020-11-16T20:56:43.406 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:43.406 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:43.406 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:43.407 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.407 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:43.407 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:56:43.407 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:43.407 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.407 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.407 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:43.407 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:56:43.408 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9854000000000002e-05 2020-11-16T20:56:43.408 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.408 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.408 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:43.408 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751281+0000", 2020-11-16T20:56:43.408 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1840000000000004e-06 2020-11-16T20:56:43.408 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.409 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.409 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:43.409 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751287+0000", 2020-11-16T20:56:43.409 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0231000000000001e-05 2020-11-16T20:56:43.409 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.409 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.409 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:43.409 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751297+0000", 2020-11-16T20:56:43.410 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.639e-06 2020-11-16T20:56:43.410 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.410 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.410 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:43.410 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751302+0000", 2020-11-16T20:56:43.410 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030012000000000002 2020-11-16T20:56:43.410 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.411 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.411 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.411 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751602+0000", 2020-11-16T20:56:43.411 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013830200000000001 2020-11-16T20:56:43.411 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.411 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.411 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:43.411 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751740+0000", 2020-11-16T20:56:43.412 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019538969999999999 2020-11-16T20:56:43.412 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.412 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.412 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:43.412 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771279+0000", 2020-11-16T20:56:43.412 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007630403 2020-11-16T20:56:43.412 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.413 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.413 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:43.413 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.778910+0000", 2020-11-16T20:56:43.413 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0065002009999999997 2020-11-16T20:56:43.413 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.413 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.413 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:43.413 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.785410+0000", 2020-11-16T20:56:43.414 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0023914140000000001 2020-11-16T20:56:43.414 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.414 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.414 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:43.414 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787801+0000", 2020-11-16T20:56:43.414 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9629999999999998e-05 2020-11-16T20:56:43.414 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.415 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.415 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:43.415 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787841+0000", 2020-11-16T20:56:43.415 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1168999999999999e-05 2020-11-16T20:56:43.415 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.415 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.415 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:43.415 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787872+0000", 2020-11-16T20:56:43.416 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036631116999999998 2020-11-16T20:56:43.416 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.416 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:43.416 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.416 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.416 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.416 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:609 3.2 3:5eead97c:::smithi16641208-34:head [copy-from ver 27] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:56:43.417 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:56:43.417 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 23.461494955999999, 2020-11-16T20:56:43.417 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.062626424, 2020-11-16T20:56:43.417 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:43.417 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:43.417 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:43.417 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.417 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:43.418 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:56:43.418 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:43.418 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.418 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.418 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:43.418 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:56:43.418 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3596000000000001e-05 2020-11-16T20:56:43.419 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.419 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.419 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:43.419 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789082+0000", 2020-11-16T20:56:43.419 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3209999999999999e-06 2020-11-16T20:56:43.419 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.419 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.419 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:43.420 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789089+0000", 2020-11-16T20:56:43.420 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3498e-05 2020-11-16T20:56:43.420 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.420 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.420 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:43.420 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789103+0000", 2020-11-16T20:56:43.420 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3679999999999998e-06 2020-11-16T20:56:43.421 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.421 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.421 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:43.421 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789109+0000", 2020-11-16T20:56:43.421 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007399638 2020-11-16T20:56:43.421 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.421 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.421 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.422 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.796509+0000", 2020-11-16T20:56:43.422 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000181168 2020-11-16T20:56:43.422 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.422 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.422 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:43.422 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.796690+0000", 2020-11-16T20:56:43.422 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01336562 2020-11-16T20:56:43.423 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.423 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.423 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:43.423 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.810055+0000", 2020-11-16T20:56:43.423 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044828350000000001 2020-11-16T20:56:43.423 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.423 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.423 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:43.424 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.814538+0000", 2020-11-16T20:56:43.424 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035609628999999997 2020-11-16T20:56:43.424 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.424 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.424 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:43.424 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850148+0000", 2020-11-16T20:56:43.424 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0013754730000000001 2020-11-16T20:56:43.425 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.425 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.425 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:43.425 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851523+0000", 2020-11-16T20:56:43.425 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9935e-05 2020-11-16T20:56:43.425 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.425 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.425 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:43.426 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851603+0000", 2020-11-16T20:56:43.426 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1342999999999999e-05 2020-11-16T20:56:43.426 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.426 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.426 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:43.426 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851665+0000", 2020-11-16T20:56:43.426 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.062626424 2020-11-16T20:56:43.427 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.427 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:43.427 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.427 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.427 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.427 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2605 4.0 4:2294fced:::smithi16641208-278:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:56:43.427 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:56:43.427 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 23.333659839999999, 2020-11-16T20:56:43.428 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032301128999999998, 2020-11-16T20:56:43.428 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:43.428 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:43.428 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:43.428 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:43.428 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:43.428 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2605 2020-11-16T20:56:43.429 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.429 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:43.429 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.429 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:43.429 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:56:43.429 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:43.429 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.429 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.430 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:43.430 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:56:43.430 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.811e-05 2020-11-16T20:56:43.430 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.430 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.430 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:43.430 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916901+0000", 2020-11-16T20:56:43.431 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2939999999999996e-06 2020-11-16T20:56:43.431 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.431 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.431 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:43.431 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916907+0000", 2020-11-16T20:56:43.431 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0589e-05 2020-11-16T20:56:43.431 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.431 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.432 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:43.432 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916917+0000", 2020-11-16T20:56:43.432 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2549999999999999e-06 2020-11-16T20:56:43.432 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.432 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.432 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:43.432 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916921+0000", 2020-11-16T20:56:43.433 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033789099999999999 2020-11-16T20:56:43.433 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.433 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.433 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.433 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.917259+0000", 2020-11-16T20:56:43.433 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.25e-05 2020-11-16T20:56:43.433 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.433 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.434 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:43.434 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.917332+0000", 2020-11-16T20:56:43.434 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.028336376999999999 2020-11-16T20:56:43.434 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.434 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.434 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.434 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.945668+0000", 2020-11-16T20:56:43.435 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0983000000000006e-05 2020-11-16T20:56:43.435 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.435 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.435 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:43.435 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.945759+0000", 2020-11-16T20:56:43.435 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00324756 2020-11-16T20:56:43.435 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.435 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.436 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.436 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949007+0000", 2020-11-16T20:56:43.436 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0583999999999999e-05 2020-11-16T20:56:43.436 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.436 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.436 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:43.436 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949097+0000", 2020-11-16T20:56:43.437 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6985999999999998e-05 2020-11-16T20:56:43.437 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.437 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.437 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:43.437 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949174+0000", 2020-11-16T20:56:43.437 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032301128999999998 2020-11-16T20:56:43.437 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.437 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:43.438 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.438 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.438 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.438 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2874 4.0 4:055e14cb:::smithi16641208-187:head [copy-from ver 402] snapc 25=[25,23,21,f] ondisk+write+known_if_redirected e72)", 2020-11-16T20:56:43.438 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:56:43.438 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.5051361700000001, 2020-11-16T20:56:43.438 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031663616999999998, 2020-11-16T20:56:43.439 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:43.439 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:43.439 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:43.439 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:43.439 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:43.439 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2874 2020-11-16T20:56:43.439 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.439 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:43.440 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.440 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:43.440 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:56:43.440 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:43.440 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.440 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.440 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:43.441 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:56:43.441 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6754000000000001e-05 2020-11-16T20:56:43.441 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.441 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.441 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:43.441 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745434+0000", 2020-11-16T20:56:43.441 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5049999999999998e-06 2020-11-16T20:56:43.441 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.442 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.442 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:43.442 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745439+0000", 2020-11-16T20:56:43.442 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0803e-05 2020-11-16T20:56:43.442 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.442 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.442 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:43.443 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745450+0000", 2020-11-16T20:56:43.443 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8810000000000004e-06 2020-11-16T20:56:43.443 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.443 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.443 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:43.443 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745455+0000", 2020-11-16T20:56:43.443 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022866499999999999 2020-11-16T20:56:43.443 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.444 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.444 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.444 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745684+0000", 2020-11-16T20:56:43.444 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000132714 2020-11-16T20:56:43.444 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.445 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.445 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:43.445 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745816+0000", 2020-11-16T20:56:43.445 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050117850000000004 2020-11-16T20:56:43.445 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.445 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.445 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:56:43.445 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.750828+0000", 2020-11-16T20:56:43.446 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010413489 2020-11-16T20:56:43.446 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.446 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.446 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:43.446 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.761241+0000", 2020-11-16T20:56:43.446 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028274289999999998 2020-11-16T20:56:43.447 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.447 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.447 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:43.447 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.764069+0000", 2020-11-16T20:56:43.447 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012880057 2020-11-16T20:56:43.447 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.447 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.448 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:43.448 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.776949+0000", 2020-11-16T20:56:43.448 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2536e-05 2020-11-16T20:56:43.448 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.448 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.448 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:43.448 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777002+0000", 2020-11-16T20:56:43.448 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8999000000000002e-05 2020-11-16T20:56:43.449 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.449 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.449 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:43.449 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777061+0000", 2020-11-16T20:56:43.449 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031663616999999998 2020-11-16T20:56:43.449 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.449 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:43.450 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.450 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.450 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.450 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2875 4.0 4:055e14cb:::smithi16641208-187:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-11-16T20:56:43.450 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:56:43.450 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.5050469440000001, 2020-11-16T20:56:43.450 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031888061000000002, 2020-11-16T20:56:43.451 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:43.451 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:43.451 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:43.451 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:43.451 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:43.451 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2875 2020-11-16T20:56:43.451 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.452 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:43.452 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.452 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:43.452 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:56:43.452 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:43.452 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.452 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.452 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:43.453 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:56:43.453 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0239000000000001e-05 2020-11-16T20:56:43.453 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.453 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.453 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:43.453 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745506+0000", 2020-11-16T20:56:43.453 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.252e-06 2020-11-16T20:56:43.454 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.454 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.454 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:43.454 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745510+0000", 2020-11-16T20:56:43.454 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3670000000000002e-06 2020-11-16T20:56:43.454 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.454 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.454 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:43.455 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745516+0000", 2020-11-16T20:56:43.455 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1089999999999998e-06 2020-11-16T20:56:43.455 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.455 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.455 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:43.455 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745519+0000", 2020-11-16T20:56:43.455 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045188999999999998 2020-11-16T20:56:43.456 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.456 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.456 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.456 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745971+0000", 2020-11-16T20:56:43.456 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7822999999999998e-05 2020-11-16T20:56:43.456 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.456 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.457 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:43.457 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.746029+0000", 2020-11-16T20:56:43.457 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013333563999999999 2020-11-16T20:56:43.457 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.457 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.457 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.457 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.759362+0000", 2020-11-16T20:56:43.457 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000170896 2020-11-16T20:56:43.458 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.458 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.458 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:43.458 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.759533+0000", 2020-11-16T20:56:43.458 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017572878 2020-11-16T20:56:43.458 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.458 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.459 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:43.459 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777106+0000", 2020-11-16T20:56:43.459 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014436399999999999 2020-11-16T20:56:43.459 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.459 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.459 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:43.459 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777251+0000", 2020-11-16T20:56:43.459 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012367899999999999 2020-11-16T20:56:43.460 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:43.460 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:43.460 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:43.460 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777374+0000", 2020-11-16T20:56:43.460 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031888061000000002 2020-11-16T20:56:43.460 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.460 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:43.460 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.461 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:43.461 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:43.461 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:43.462 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:56:43.463 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:43.467+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:43.563 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:43.568+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:43.611 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:43.611 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:43.611 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:56:43.611 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:43.621 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:56:43.703 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:43.708+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:43.765 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:43.770+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:43.773 INFO:tasks.rados.rados.0.smithi166.stdout:817: done (0 left) 2020-11-16T20:56:43.773 INFO:tasks.rados.rados.0.smithi166.stdout:818: snap_remove snap 9 2020-11-16T20:56:43.777 INFO:teuthology.orchestra.run.smithi166.stderr:nodeep-scrub is unset 2020-11-16T20:56:43.781 INFO:teuthology.orchestra.run.smithi166.stderr:set 4.0 pg_upmap mapping to [2,1,0] 2020-11-16T20:56:43.801 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:43.802 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:43.802 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:56:43.802 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:56:43.802 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:43.811 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:56:43.866 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:43.871+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:43.967 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:43.972+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:43.988 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:43.989 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:56:43.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:56:43.989 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:56:43.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:43.989 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:184 4.1 4:b6545a47:::smithi16641208-46:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e33)", 2020-11-16T20:56:43.990 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.503052+0000", 2020-11-16T20:56:43.990 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.488725850999998, 2020-11-16T20:56:43.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032452030999999999, 2020-11-16T20:56:43.990 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:43.990 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:43.990 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:43.991 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:43.991 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:43.991 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 184 2020-11-16T20:56:43.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:43.991 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:43.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:43.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:43.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503052+0000", 2020-11-16T20:56:43.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:43.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:43.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:43.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:43.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503052+0000", 2020-11-16T20:56:43.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7108999999999998e-05 2020-11-16T20:56:43.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:43.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:43.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:43.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503069+0000", 2020-11-16T20:56:43.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2590000000000001e-06 2020-11-16T20:56:43.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:43.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:43.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:43.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503072+0000", 2020-11-16T20:56:43.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3119999999999999e-06 2020-11-16T20:56:43.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:43.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:43.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:43.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503079+0000", 2020-11-16T20:56:43.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6520000000000002e-06 2020-11-16T20:56:43.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:43.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:43.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:43.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503081+0000", 2020-11-16T20:56:43.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000263331 2020-11-16T20:56:43.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:43.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:43.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:43.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503345+0000", 2020-11-16T20:56:43.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9370000000000002e-05 2020-11-16T20:56:43.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:43.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:43.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:43.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.503404+0000", 2020-11-16T20:56:43.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016025681999999999 2020-11-16T20:56:43.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:43.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:43.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:43.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519430+0000", 2020-11-16T20:56:43.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114862 2020-11-16T20:56:43.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:43.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:43.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:43.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519545+0000", 2020-11-16T20:56:43.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013224174 2020-11-16T20:56:43.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:43.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:43.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:43.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532769+0000", 2020-11-16T20:56:43.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5945000000000006e-05 2020-11-16T20:56:43.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:43.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:43.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532845+0000", 2020-11-16T20:56:44.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0026593350000000001 2020-11-16T20:56:44.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.535504+0000", 2020-11-16T20:56:44.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032452030999999999 2020-11-16T20:56:44.001 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.001 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.001 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.001 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2370 4.1 4:82bb0fe7:::smithi16641208-101:head [write 2346424~426830] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:44.002 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:56:44.002 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 38.937494628000003, 2020-11-16T20:56:44.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04706581, 2020-11-16T20:56:44.002 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.002 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.002 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:44.002 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:44.003 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:44.003 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2370 2020-11-16T20:56:44.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.003 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:56:44.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:56:44.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011081520000000001 2020-11-16T20:56:44.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055391+0000", 2020-11-16T20:56:44.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8289999999999996e-06 2020-11-16T20:56:44.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055397+0000", 2020-11-16T20:56:44.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7599999999999997e-06 2020-11-16T20:56:44.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055407+0000", 2020-11-16T20:56:44.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4180000000000002e-06 2020-11-16T20:56:44.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055413+0000", 2020-11-16T20:56:44.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1767000000000001e-05 2020-11-16T20:56:44.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055465+0000", 2020-11-16T20:56:44.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1916999999999998e-05 2020-11-16T20:56:44.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:44.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055517+0000", 2020-11-16T20:56:44.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027302192999999999 2020-11-16T20:56:44.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.082819+0000", 2020-11-16T20:56:44.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013272199999999999 2020-11-16T20:56:44.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.082952+0000", 2020-11-16T20:56:44.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000218574 2020-11-16T20:56:44.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:44.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083171+0000", 2020-11-16T20:56:44.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016037374 2020-11-16T20:56:44.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:44.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099208+0000", 2020-11-16T20:56:44.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001621248 2020-11-16T20:56:44.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:44.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100829+0000", 2020-11-16T20:56:44.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039884700000000003 2020-11-16T20:56:44.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:44.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101228+0000", 2020-11-16T20:56:44.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1977000000000006e-05 2020-11-16T20:56:44.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101300+0000", 2020-11-16T20:56:44.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9032000000000001e-05 2020-11-16T20:56:44.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101349+0000", 2020-11-16T20:56:44.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04706581 2020-11-16T20:56:44.014 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.014 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.014 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.015 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2371 4.1 4:82bb0fe7:::smithi16641208-101:head [setxattr _header (57) in=7b,truncate 2773254] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:44.015 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.055441+0000", 2020-11-16T20:56:44.015 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 38.936336711000003, 2020-11-16T20:56:44.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046178253000000002, 2020-11-16T20:56:44.015 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.015 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.015 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:44.015 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:44.016 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:44.016 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2371 2020-11-16T20:56:44.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.016 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.016 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.016 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055441+0000", 2020-11-16T20:56:44.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055441+0000", 2020-11-16T20:56:44.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4688999999999999e-05 2020-11-16T20:56:44.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055476+0000", 2020-11-16T20:56:44.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8220000000000003e-06 2020-11-16T20:56:44.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055482+0000", 2020-11-16T20:56:44.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0340000000000002e-06 2020-11-16T20:56:44.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055488+0000", 2020-11-16T20:56:44.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.49e-06 2020-11-16T20:56:44.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055491+0000", 2020-11-16T20:56:44.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6255999999999998e-05 2020-11-16T20:56:44.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055547+0000", 2020-11-16T20:56:44.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6068000000000005e-05 2020-11-16T20:56:44.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:44.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055614+0000", 2020-11-16T20:56:44.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.028667674000000001 2020-11-16T20:56:44.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084281+0000", 2020-11-16T20:56:44.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000104868 2020-11-16T20:56:44.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084386+0000", 2020-11-16T20:56:44.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015165799999999999 2020-11-16T20:56:44.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:44.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084538+0000", 2020-11-16T20:56:44.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014678207 2020-11-16T20:56:44.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:44.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099216+0000", 2020-11-16T20:56:44.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0016622550000000001 2020-11-16T20:56:44.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:44.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100878+0000", 2020-11-16T20:56:44.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00061087000000000001 2020-11-16T20:56:44.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:44.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101489+0000", 2020-11-16T20:56:44.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0320000000000004e-05 2020-11-16T20:56:44.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101559+0000", 2020-11-16T20:56:44.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0041999999999999e-05 2020-11-16T20:56:44.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101619+0000", 2020-11-16T20:56:44.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046178253000000002 2020-11-16T20:56:44.027 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.027 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.027 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.027 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2372 4.1 4:82bb0fe7:::smithi16641208-101:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e42)", 2020-11-16T20:56:44.028 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:56:44.028 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 38.936265681999998, 2020-11-16T20:56:44.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046557016999999999, 2020-11-16T20:56:44.028 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.028 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:44.028 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:44.028 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:44.029 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:44.029 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2372 2020-11-16T20:56:44.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.029 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.029 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:56:44.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:56:44.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9907000000000001e-05 2020-11-16T20:56:44.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055532+0000", 2020-11-16T20:56:44.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0599999999999999e-06 2020-11-16T20:56:44.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055535+0000", 2020-11-16T20:56:44.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1430000000000003e-06 2020-11-16T20:56:44.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055541+0000", 2020-11-16T20:56:44.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6819999999999999e-06 2020-11-16T20:56:44.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.033 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055544+0000", 2020-11-16T20:56:44.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000102643 2020-11-16T20:56:44.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.033 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055647+0000", 2020-11-16T20:56:44.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7197000000000003e-05 2020-11-16T20:56:44.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:44.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055684+0000", 2020-11-16T20:56:44.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029347807 2020-11-16T20:56:44.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.085032+0000", 2020-11-16T20:56:44.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6130000000000005e-05 2020-11-16T20:56:44.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:44.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.085108+0000", 2020-11-16T20:56:44.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016542980999999998 2020-11-16T20:56:44.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101651+0000", 2020-11-16T20:56:44.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000118733 2020-11-16T20:56:44.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101769+0000", 2020-11-16T20:56:44.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029973400000000001 2020-11-16T20:56:44.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.102069+0000", 2020-11-16T20:56:44.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046557016999999999 2020-11-16T20:56:44.038 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.038 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.038 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.039 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2423 3.3 3:c5716d1e:::smithi16641208-111:head [copy-from ver 265] snapc 7=[7,5] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e46)", 2020-11-16T20:56:44.039 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:09.027460+0000", 2020-11-16T20:56:44.039 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 34.964317530000002, 2020-11-16T20:56:44.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.038337614999999998, 2020-11-16T20:56:44.039 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.039 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.039 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027460+0000", 2020-11-16T20:56:44.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027460+0000", 2020-11-16T20:56:44.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4963999999999998e-05 2020-11-16T20:56:44.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027505+0000", 2020-11-16T20:56:44.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.925e-05 2020-11-16T20:56:44.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027525+0000", 2020-11-16T20:56:44.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3959e-05 2020-11-16T20:56:44.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027539+0000", 2020-11-16T20:56:44.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8059999999999997e-06 2020-11-16T20:56:44.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027545+0000", 2020-11-16T20:56:44.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0037794289999999999 2020-11-16T20:56:44.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031325+0000", 2020-11-16T20:56:44.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000127613 2020-11-16T20:56:44.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031452+0000", 2020-11-16T20:56:44.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021049117999999999 2020-11-16T20:56:44.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:56:44.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.052502+0000", 2020-11-16T20:56:44.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012965061 2020-11-16T20:56:44.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:44.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065467+0000", 2020-11-16T20:56:44.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9788000000000003e-05 2020-11-16T20:56:44.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:44.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065536+0000", 2020-11-16T20:56:44.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013262699999999999 2020-11-16T20:56:44.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:44.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065669+0000", 2020-11-16T20:56:44.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4404999999999999e-05 2020-11-16T20:56:44.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065713+0000", 2020-11-16T20:56:44.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4594999999999999e-05 2020-11-16T20:56:44.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065798+0000", 2020-11-16T20:56:44.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.038337614999999998 2020-11-16T20:56:44.049 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.049 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.049 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.049 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:577 3.3 3:c5716d1e:::smithi16641208-111:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e46)", 2020-11-16T20:56:44.050 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:09.027581+0000", 2020-11-16T20:56:44.050 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 34.964197087000002, 2020-11-16T20:56:44.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.038487691999999997, 2020-11-16T20:56:44.050 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.050 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:44.050 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027581+0000", 2020-11-16T20:56:44.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.051 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027581+0000", 2020-11-16T20:56:44.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3422e-05 2020-11-16T20:56:44.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.052 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027614+0000", 2020-11-16T20:56:44.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1710000000000002e-06 2020-11-16T20:56:44.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.053 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027622+0000", 2020-11-16T20:56:44.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2265e-05 2020-11-16T20:56:44.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.053 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027635+0000", 2020-11-16T20:56:44.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4700000000000001e-06 2020-11-16T20:56:44.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.054 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.054 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027640+0000", 2020-11-16T20:56:44.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0040006759999999999 2020-11-16T20:56:44.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031641+0000", 2020-11-16T20:56:44.055 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4350000000000006e-05 2020-11-16T20:56:44.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:44.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031705+0000", 2020-11-16T20:56:44.055 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029225991999999999 2020-11-16T20:56:44.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.056 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.056 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.060931+0000", 2020-11-16T20:56:44.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013316099999999999 2020-11-16T20:56:44.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:44.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.061064+0000", 2020-11-16T20:56:44.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047860919999999996 2020-11-16T20:56:44.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065850+0000", 2020-11-16T20:56:44.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1691e-05 2020-11-16T20:56:44.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.058 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.058 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065942+0000", 2020-11-16T20:56:44.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012640199999999999 2020-11-16T20:56:44.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.059 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.059 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.066068+0000", 2020-11-16T20:56:44.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.038487691999999997 2020-11-16T20:56:44.059 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.059 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.059 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.060 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:578 3.3 3:c5716d1e:::smithi16641208-111:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e46)", 2020-11-16T20:56:44.060 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:09.027672+0000", 2020-11-16T20:56:44.060 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 34.964105973000002, 2020-11-16T20:56:44.060 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.043041498999999997, 2020-11-16T20:56:44.060 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.060 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:44.060 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027672+0000", 2020-11-16T20:56:44.061 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027672+0000", 2020-11-16T20:56:44.062 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2234000000000003e-05 2020-11-16T20:56:44.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.062 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.062 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.062 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027714+0000", 2020-11-16T20:56:44.062 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5910000000000001e-06 2020-11-16T20:56:44.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.063 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027721+0000", 2020-11-16T20:56:44.063 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1319e-05 2020-11-16T20:56:44.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.063 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027732+0000", 2020-11-16T20:56:44.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7919999999999998e-06 2020-11-16T20:56:44.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.064 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.064 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027738+0000", 2020-11-16T20:56:44.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0040456559999999999 2020-11-16T20:56:44.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.065 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.065 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031784+0000", 2020-11-16T20:56:44.065 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9271999999999999e-05 2020-11-16T20:56:44.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.065 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:44.065 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031833+0000", 2020-11-16T20:56:44.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029282580999999999 2020-11-16T20:56:44.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.066 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.066 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.066 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.061115+0000", 2020-11-16T20:56:44.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6058999999999998e-05 2020-11-16T20:56:44.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.067 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:44.067 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.061191+0000", 2020-11-16T20:56:44.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049009099999999996 2020-11-16T20:56:44.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.067 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.067 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.066092+0000", 2020-11-16T20:56:44.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7039999999999995e-05 2020-11-16T20:56:44.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.068 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.066159+0000", 2020-11-16T20:56:44.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045540449999999996 2020-11-16T20:56:44.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.069 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.069 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.070713+0000", 2020-11-16T20:56:44.069 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.043041498999999997 2020-11-16T20:56:44.069 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.069 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.069 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.070 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.070 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2427 4.1 4:a1b421f3:::smithi16641208-471:head [cache-flush] snapc 0=[] ondisk+read+ignore_cache+known_if_redirected e47)", 2020-11-16T20:56:44.070 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:10.015762+0000", 2020-11-16T20:56:44.070 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 33.976015533999998, 2020-11-16T20:56:44.070 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036562619999999997, 2020-11-16T20:56:44.070 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.070 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:44.071 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:44.071 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:44.071 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:44.071 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2427 2020-11-16T20:56:44.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.071 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.071 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.072 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015762+0000", 2020-11-16T20:56:44.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.072 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.072 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015762+0000", 2020-11-16T20:56:44.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8266999999999999e-05 2020-11-16T20:56:44.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.073 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.073 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015791+0000", 2020-11-16T20:56:44.073 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3263e-05 2020-11-16T20:56:44.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.073 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015804+0000", 2020-11-16T20:56:44.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1194e-05 2020-11-16T20:56:44.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015815+0000", 2020-11-16T20:56:44.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9799999999999998e-06 2020-11-16T20:56:44.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.075 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.075 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015823+0000", 2020-11-16T20:56:44.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0092000000000006e-05 2020-11-16T20:56:44.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.075 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.076 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015893+0000", 2020-11-16T20:56:44.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4109999999999996e-06 2020-11-16T20:56:44.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.076 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2020-11-16T20:56:44.076 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015902+0000", 2020-11-16T20:56:44.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0024786610000000001 2020-11-16T20:56:44.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.018380+0000", 2020-11-16T20:56:44.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016238599999999999 2020-11-16T20:56:44.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.078 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.018543+0000", 2020-11-16T20:56:44.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.033540168000000002 2020-11-16T20:56:44.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.078 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.078 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.052083+0000", 2020-11-16T20:56:44.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014603000000000001 2020-11-16T20:56:44.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.052229+0000", 2020-11-16T20:56:44.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6168000000000005e-05 2020-11-16T20:56:44.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.080 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.052325+0000", 2020-11-16T20:56:44.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036562619999999997 2020-11-16T20:56:44.080 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.080 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.080 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.081 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2503 4.1 4:b0538c7c:::smithi16641208-136:head [write 1790337~563515] snapc f=[f,e,d,5] ondisk+write+known_if_redirected e52)", 2020-11-16T20:56:44.081 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:56:44.081 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.245070178999999, 2020-11-16T20:56:44.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089724989000000005, 2020-11-16T20:56:44.081 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.081 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.081 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:44.081 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:44.082 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:44.082 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2503 2020-11-16T20:56:44.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.082 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:56:44.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:56:44.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00060419599999999999 2020-11-16T20:56:44.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747312+0000", 2020-11-16T20:56:44.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.319e-06 2020-11-16T20:56:44.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747318+0000", 2020-11-16T20:56:44.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5100000000000004e-06 2020-11-16T20:56:44.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.085 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.085 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747328+0000", 2020-11-16T20:56:44.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6369999999999999e-06 2020-11-16T20:56:44.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.086 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747335+0000", 2020-11-16T20:56:44.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001800479 2020-11-16T20:56:44.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.086 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749136+0000", 2020-11-16T20:56:44.087 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7970000000000002e-05 2020-11-16T20:56:44.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.087 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:44.087 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749194+0000", 2020-11-16T20:56:44.087 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030847998000000001 2020-11-16T20:56:44.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780042+0000", 2020-11-16T20:56:44.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013142199999999999 2020-11-16T20:56:44.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780173+0000", 2020-11-16T20:56:44.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022398200000000001 2020-11-16T20:56:44.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.089 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.089 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:56:44.089 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780397+0000", 2020-11-16T20:56:44.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061389269999999998 2020-11-16T20:56:44.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.090 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.090 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:44.090 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786536+0000", 2020-11-16T20:56:44.090 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3673999999999998e-05 2020-11-16T20:56:44.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.090 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.090 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:44.090 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786630+0000", 2020-11-16T20:56:44.091 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049513384000000001 2020-11-16T20:56:44.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.091 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.091 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:44.091 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836143+0000", 2020-11-16T20:56:44.091 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4713000000000001e-05 2020-11-16T20:56:44.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.092 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.092 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.092 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836218+0000", 2020-11-16T20:56:44.092 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000214778 2020-11-16T20:56:44.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.092 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.092 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.092 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836433+0000", 2020-11-16T20:56:44.093 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089724989000000005 2020-11-16T20:56:44.093 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.093 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.093 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.093 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.093 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2504 4.1 4:b0538c7c:::smithi16641208-136:head [setxattr _header (58) in=7b,truncate 2991745] snapc f=[f,e,d,5] ondisk+write+known_if_redirected e52)", 2020-11-16T20:56:44.094 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:56:44.094 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.244395809, 2020-11-16T20:56:44.094 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089341162000000002, 2020-11-16T20:56:44.094 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.094 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.094 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:44.094 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:44.094 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:44.095 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2504 2020-11-16T20:56:44.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.095 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.095 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.095 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.095 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:56:44.095 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.096 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.096 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.096 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:56:44.096 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5520999999999999e-05 2020-11-16T20:56:44.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.096 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.096 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.097 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747438+0000", 2020-11-16T20:56:44.097 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2020-11-16T20:56:44.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.097 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.097 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.097 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747444+0000", 2020-11-16T20:56:44.097 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.661e-06 2020-11-16T20:56:44.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.098 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.098 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.098 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747451+0000", 2020-11-16T20:56:44.098 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6920000000000001e-06 2020-11-16T20:56:44.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.098 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.098 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.099 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747456+0000", 2020-11-16T20:56:44.099 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0017949769999999999 2020-11-16T20:56:44.099 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.099 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.099 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.099 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749251+0000", 2020-11-16T20:56:44.099 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114708 2020-11-16T20:56:44.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.100 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.100 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:44.100 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749366+0000", 2020-11-16T20:56:44.100 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032215049000000003 2020-11-16T20:56:44.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.100 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.100 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.101 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.781581+0000", 2020-11-16T20:56:44.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000181452 2020-11-16T20:56:44.101 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.101 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.101 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.781762+0000", 2020-11-16T20:56:44.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024118300000000001 2020-11-16T20:56:44.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.102 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.102 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:56:44.102 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782003+0000", 2020-11-16T20:56:44.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045997939999999999 2020-11-16T20:56:44.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.102 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.102 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:44.103 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786603+0000", 2020-11-16T20:56:44.103 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8782000000000002e-05 2020-11-16T20:56:44.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.103 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:44.103 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786642+0000", 2020-11-16T20:56:44.103 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049869098000000001 2020-11-16T20:56:44.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:44.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836511+0000", 2020-11-16T20:56:44.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4498000000000005e-05 2020-11-16T20:56:44.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.105 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836576+0000", 2020-11-16T20:56:44.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000147615 2020-11-16T20:56:44.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.105 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.105 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836723+0000", 2020-11-16T20:56:44.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089341162000000002 2020-11-16T20:56:44.105 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.106 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.106 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.106 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.106 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2505 4.1 4:b0538c7c:::smithi16641208-136:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e52)", 2020-11-16T20:56:44.106 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:56:44.106 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.244286680999998, 2020-11-16T20:56:44.107 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089929617000000003, 2020-11-16T20:56:44.107 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.107 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:44.107 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:44.107 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:44.107 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:44.107 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2505 2020-11-16T20:56:44.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.108 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.108 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.108 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.108 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:56:44.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.108 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.109 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.109 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:56:44.109 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1894999999999999e-05 2020-11-16T20:56:44.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.109 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.109 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.109 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747523+0000", 2020-11-16T20:56:44.110 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3900000000000003e-06 2020-11-16T20:56:44.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.110 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.110 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.110 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747527+0000", 2020-11-16T20:56:44.110 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8169999999999999e-06 2020-11-16T20:56:44.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.110 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.111 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.111 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747535+0000", 2020-11-16T20:56:44.111 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6449999999999998e-06 2020-11-16T20:56:44.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.111 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.111 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.111 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747539+0000", 2020-11-16T20:56:44.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0018868209999999999 2020-11-16T20:56:44.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.112 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.112 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.112 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749426+0000", 2020-11-16T20:56:44.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4963000000000002e-05 2020-11-16T20:56:44.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:44.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749481+0000", 2020-11-16T20:56:44.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032915959000000002 2020-11-16T20:56:44.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782397+0000", 2020-11-16T20:56:44.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018449499999999999 2020-11-16T20:56:44.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.114 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:44.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782581+0000", 2020-11-16T20:56:44.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054195457000000002 2020-11-16T20:56:44.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.115 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.115 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.115 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836777+0000", 2020-11-16T20:56:44.115 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000214584 2020-11-16T20:56:44.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.115 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.115 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836991+0000", 2020-11-16T20:56:44.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000429591 2020-11-16T20:56:44.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.116 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.837421+0000", 2020-11-16T20:56:44.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089929617000000003 2020-11-16T20:56:44.116 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.117 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.117 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.117 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.117 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.117 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2593 3.3 3:f5f8fa2a:::smithi16641208-144:head [copy-from ver 64] snapc 14=[12,f,5] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e57)", 2020-11-16T20:56:44.117 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:56:44.117 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.205137820000001, 2020-11-16T20:56:44.118 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064638111999999998, 2020-11-16T20:56:44.118 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.118 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.118 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.118 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.118 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.118 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:56:44.119 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.119 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.119 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:56:44.119 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3655999999999998e-05 2020-11-16T20:56:44.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786664+0000", 2020-11-16T20:56:44.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1850000000000003e-06 2020-11-16T20:56:44.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786669+0000", 2020-11-16T20:56:44.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0861e-05 2020-11-16T20:56:44.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786680+0000", 2020-11-16T20:56:44.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6749999999999996e-06 2020-11-16T20:56:44.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.122 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.122 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786686+0000", 2020-11-16T20:56:44.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2327000000000003e-05 2020-11-16T20:56:44.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.122 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.122 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786729+0000", 2020-11-16T20:56:44.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000156143 2020-11-16T20:56:44.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.123 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.123 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.123 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786885+0000", 2020-11-16T20:56:44.123 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024103846000000002 2020-11-16T20:56:44.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.123 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.124 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:56:44.124 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810989+0000", 2020-11-16T20:56:44.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018870436000000001 2020-11-16T20:56:44.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.124 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:44.124 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829859+0000", 2020-11-16T20:56:44.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021210896 2020-11-16T20:56:44.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:44.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851070+0000", 2020-11-16T20:56:44.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3708e-05 2020-11-16T20:56:44.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.126 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:44.126 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851084+0000", 2020-11-16T20:56:44.126 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7329e-05 2020-11-16T20:56:44.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.126 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.126 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851131+0000", 2020-11-16T20:56:44.126 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014705 2020-11-16T20:56:44.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.127 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.127 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.127 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851278+0000", 2020-11-16T20:56:44.127 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064638111999999998 2020-11-16T20:56:44.127 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.127 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.128 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.128 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.128 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:616 3.3 3:f5f8fa2a:::smithi16641208-144:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e57)", 2020-11-16T20:56:44.128 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:56:44.128 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.205047166, 2020-11-16T20:56:44.128 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064784234999999996, 2020-11-16T20:56:44.128 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.129 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:44.129 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:56:44.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:56:44.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8559999999999998e-05 2020-11-16T20:56:44.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786749+0000", 2020-11-16T20:56:44.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4549999999999997e-06 2020-11-16T20:56:44.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.131 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.131 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.131 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786754+0000", 2020-11-16T20:56:44.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4980000000000006e-06 2020-11-16T20:56:44.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786762+0000", 2020-11-16T20:56:44.132 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9790000000000004e-06 2020-11-16T20:56:44.132 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786766+0000", 2020-11-16T20:56:44.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029976900000000002 2020-11-16T20:56:44.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.133 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787066+0000", 2020-11-16T20:56:44.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3581999999999998e-05 2020-11-16T20:56:44.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.134 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:44.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787100+0000", 2020-11-16T20:56:44.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.037252078000000001 2020-11-16T20:56:44.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.134 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824352+0000", 2020-11-16T20:56:44.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000124189 2020-11-16T20:56:44.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.135 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:44.135 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824476+0000", 2020-11-16T20:56:44.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026883987000000002 2020-11-16T20:56:44.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851360+0000", 2020-11-16T20:56:44.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6365999999999994e-05 2020-11-16T20:56:44.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851426+0000", 2020-11-16T20:56:44.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8771999999999996e-05 2020-11-16T20:56:44.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.137 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.137 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.137 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851515+0000", 2020-11-16T20:56:44.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064784234999999996 2020-11-16T20:56:44.137 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.138 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.138 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.138 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:617 3.3 3:f5f8fa2a:::smithi16641208-144:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e57)", 2020-11-16T20:56:44.138 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:56:44.138 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.204976851000001, 2020-11-16T20:56:44.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.069756316999999998, 2020-11-16T20:56:44.139 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.139 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:44.139 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:56:44.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.140 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:56:44.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3865000000000002e-05 2020-11-16T20:56:44.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786835+0000", 2020-11-16T20:56:44.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6949999999999999e-06 2020-11-16T20:56:44.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786840+0000", 2020-11-16T20:56:44.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3559999999999999e-06 2020-11-16T20:56:44.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.142 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786849+0000", 2020-11-16T20:56:44.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.045e-06 2020-11-16T20:56:44.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786854+0000", 2020-11-16T20:56:44.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026743999999999997 2020-11-16T20:56:44.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.143 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787121+0000", 2020-11-16T20:56:44.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8912000000000001e-05 2020-11-16T20:56:44.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:44.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787180+0000", 2020-11-16T20:56:44.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.042545010000000001 2020-11-16T20:56:44.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.145 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829725+0000", 2020-11-16T20:56:44.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3979000000000003e-05 2020-11-16T20:56:44.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.145 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:44.145 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829819+0000", 2020-11-16T20:56:44.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021745652000000001 2020-11-16T20:56:44.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.146 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.146 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.146 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851565+0000", 2020-11-16T20:56:44.146 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000102064 2020-11-16T20:56:44.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.146 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.146 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.147 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851667+0000", 2020-11-16T20:56:44.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048902989999999999 2020-11-16T20:56:44.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.147 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.147 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856557+0000", 2020-11-16T20:56:44.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.069756316999999998 2020-11-16T20:56:44.148 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.148 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.148 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.148 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:618 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'243, mlcod=57'241)", 2020-11-16T20:56:44.148 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:56:44.148 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.192157727000001, 2020-11-16T20:56:44.149 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048895281999999998, 2020-11-16T20:56:44.149 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.149 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.149 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.149 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.149 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:56:44.149 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.150 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.150 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.150 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.150 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:56:44.150 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017163861999999998 2020-11-16T20:56:44.150 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.150 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.151 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.151 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816784+0000", 2020-11-16T20:56:44.151 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7071e-05 2020-11-16T20:56:44.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.151 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.151 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.151 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816801+0000", 2020-11-16T20:56:44.152 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6405e-05 2020-11-16T20:56:44.152 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.152 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.152 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.152 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816818+0000", 2020-11-16T20:56:44.152 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3030999999999999e-05 2020-11-16T20:56:44.152 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.152 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.153 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.153 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816831+0000", 2020-11-16T20:56:44.153 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4610000000000007e-05 2020-11-16T20:56:44.153 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.153 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.153 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.153 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816895+0000", 2020-11-16T20:56:44.153 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4202999999999998e-05 2020-11-16T20:56:44.154 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.154 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.154 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.154 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816929+0000", 2020-11-16T20:56:44.154 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.031527016999999997 2020-11-16T20:56:44.154 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.154 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.155 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.155 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.848456+0000", 2020-11-16T20:56:44.155 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9083000000000003e-05 2020-11-16T20:56:44.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.155 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.155 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.848515+0000", 2020-11-16T20:56:44.156 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048895281999999998 2020-11-16T20:56:44.156 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.156 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.156 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.156 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.156 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.156 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:618 3.3 3:d775beee:::smithi16641208-10:head [copy-from ver 12] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:56:44.156 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:56:44.157 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.182975658, 2020-11-16T20:56:44.157 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047870862, 2020-11-16T20:56:44.157 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.157 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.157 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.157 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.157 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.157 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:56:44.158 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.158 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.158 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.158 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.158 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:56:44.158 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0958999999999999e-05 2020-11-16T20:56:44.158 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.159 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.159 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.159 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808843+0000", 2020-11-16T20:56:44.159 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1294000000000001e-05 2020-11-16T20:56:44.159 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.159 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.159 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.160 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808854+0000", 2020-11-16T20:56:44.160 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8553999999999997e-05 2020-11-16T20:56:44.160 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.160 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.160 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.160 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808893+0000", 2020-11-16T20:56:44.160 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1985e-05 2020-11-16T20:56:44.160 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.161 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.161 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.161 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808905+0000", 2020-11-16T20:56:44.161 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7309000000000001e-05 2020-11-16T20:56:44.161 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.161 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.161 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.162 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808982+0000", 2020-11-16T20:56:44.162 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016374099999999999 2020-11-16T20:56:44.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.162 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.162 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809146+0000", 2020-11-16T20:56:44.162 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015955815000000002 2020-11-16T20:56:44.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.163 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.163 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:56:44.163 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.825102+0000", 2020-11-16T20:56:44.163 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048434799999999998 2020-11-16T20:56:44.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.163 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.163 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:44.164 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829945+0000", 2020-11-16T20:56:44.164 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021349677000000001 2020-11-16T20:56:44.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.164 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.164 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:44.164 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851295+0000", 2020-11-16T20:56:44.164 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052994100000000001 2020-11-16T20:56:44.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.165 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.165 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:44.165 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856594+0000", 2020-11-16T20:56:44.165 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3349000000000001e-05 2020-11-16T20:56:44.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.165 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.165 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.166 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856638+0000", 2020-11-16T20:56:44.166 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5289e-05 2020-11-16T20:56:44.166 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.166 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.166 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.166 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856673+0000", 2020-11-16T20:56:44.166 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047870862 2020-11-16T20:56:44.167 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.167 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.167 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.167 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.167 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.167 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:619 3.3 3:d79d68cf:::smithi16641208-37:head [copy-from ver 27] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:56:44.167 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:56:44.167 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.182417067999999, 2020-11-16T20:56:44.168 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047415915000000003, 2020-11-16T20:56:44.168 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.168 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.168 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.168 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.168 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.168 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:56:44.169 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.169 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.169 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.169 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.169 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:56:44.169 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3012000000000002e-05 2020-11-16T20:56:44.169 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.169 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.170 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.170 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809394+0000", 2020-11-16T20:56:44.170 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1699999999999996e-06 2020-11-16T20:56:44.170 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.170 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.170 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.170 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809399+0000", 2020-11-16T20:56:44.171 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2390000000000008e-06 2020-11-16T20:56:44.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.171 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.171 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.171 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809408+0000", 2020-11-16T20:56:44.171 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0259999999999998e-06 2020-11-16T20:56:44.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.171 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.172 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.172 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809413+0000", 2020-11-16T20:56:44.172 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0359999999999996e-05 2020-11-16T20:56:44.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.172 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.172 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.172 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809494+0000", 2020-11-16T20:56:44.173 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019616600000000001 2020-11-16T20:56:44.173 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.173 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.173 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.173 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809690+0000", 2020-11-16T20:56:44.173 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017673003999999999 2020-11-16T20:56:44.173 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.173 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.174 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:56:44.174 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.827363+0000", 2020-11-16T20:56:44.174 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006463033 2020-11-16T20:56:44.174 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.174 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.174 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:44.174 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.833826+0000", 2020-11-16T20:56:44.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017479913999999999 2020-11-16T20:56:44.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.175 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:44.175 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851306+0000", 2020-11-16T20:56:44.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054026500000000002 2020-11-16T20:56:44.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:44.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856708+0000", 2020-11-16T20:56:44.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8121999999999999e-05 2020-11-16T20:56:44.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856747+0000", 2020-11-16T20:56:44.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0219e-05 2020-11-16T20:56:44.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.177 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856777+0000", 2020-11-16T20:56:44.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047415915000000003 2020-11-16T20:56:44.177 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.177 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.178 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.178 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2705 4.1 4:b0e01256:::smithi16641208-225:head [copy-from ver 29] snapc 1c=[1c,18,f] ondisk+write+known_if_redirected e63)", 2020-11-16T20:56:44.178 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:25.737789+0000", 2020-11-16T20:56:44.178 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.253988988, 2020-11-16T20:56:44.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032698666000000001, 2020-11-16T20:56:44.179 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.179 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.179 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:44.179 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:44.179 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:44.179 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2705 2020-11-16T20:56:44.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.179 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737789+0000", 2020-11-16T20:56:44.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.181 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737789+0000", 2020-11-16T20:56:44.181 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5837999999999998e-05 2020-11-16T20:56:44.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.181 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.181 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.181 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737825+0000", 2020-11-16T20:56:44.181 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6170000000000001e-06 2020-11-16T20:56:44.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.182 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.182 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.182 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737832+0000", 2020-11-16T20:56:44.182 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.609e-05 2020-11-16T20:56:44.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.182 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.182 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.183 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737848+0000", 2020-11-16T20:56:44.183 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2239999999999995e-06 2020-11-16T20:56:44.183 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.183 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.183 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.183 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737857+0000", 2020-11-16T20:56:44.183 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1068e-05 2020-11-16T20:56:44.183 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.184 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.184 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737908+0000", 2020-11-16T20:56:44.184 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6070000000000008e-06 2020-11-16T20:56:44.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.184 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2020-11-16T20:56:44.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737916+0000", 2020-11-16T20:56:44.185 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002127337 2020-11-16T20:56:44.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.185 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.740044+0000", 2020-11-16T20:56:44.185 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014206099999999999 2020-11-16T20:56:44.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.186 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.186 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.186 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.740186+0000", 2020-11-16T20:56:44.186 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011728739 2020-11-16T20:56:44.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.186 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.186 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:56:44.187 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.751914+0000", 2020-11-16T20:56:44.187 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013621859 2020-11-16T20:56:44.187 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.187 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.187 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:44.187 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.765536+0000", 2020-11-16T20:56:44.187 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039751899999999999 2020-11-16T20:56:44.187 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:44.188 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.765934+0000", 2020-11-16T20:56:44.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0043966359999999998 2020-11-16T20:56:44.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:44.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.770331+0000", 2020-11-16T20:56:44.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6581000000000004e-05 2020-11-16T20:56:44.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.770407+0000", 2020-11-16T20:56:44.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0489999999999997e-05 2020-11-16T20:56:44.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.190 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.190 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.770488+0000", 2020-11-16T20:56:44.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032698666000000001 2020-11-16T20:56:44.190 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.190 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.190 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.191 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.191 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.191 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2706 4.1 4:b0e01256:::smithi16641208-225:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e63)", 2020-11-16T20:56:44.191 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:25.737898+0000", 2020-11-16T20:56:44.191 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.253880172999999, 2020-11-16T20:56:44.191 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032962285000000001, 2020-11-16T20:56:44.191 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.191 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:44.192 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:44.192 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:44.192 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:44.192 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2706 2020-11-16T20:56:44.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.192 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737898+0000", 2020-11-16T20:56:44.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737898+0000", 2020-11-16T20:56:44.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2438999999999999e-05 2020-11-16T20:56:44.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.194 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.194 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737930+0000", 2020-11-16T20:56:44.194 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0101999999999999e-05 2020-11-16T20:56:44.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.195 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.195 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737940+0000", 2020-11-16T20:56:44.195 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3549999999999994e-06 2020-11-16T20:56:44.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.195 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.195 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.195 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737950+0000", 2020-11-16T20:56:44.196 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6650000000000001e-06 2020-11-16T20:56:44.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.196 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.196 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.196 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737953+0000", 2020-11-16T20:56:44.196 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9898999999999999e-05 2020-11-16T20:56:44.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.196 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737993+0000", 2020-11-16T20:56:44.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6890000000000001e-06 2020-11-16T20:56:44.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:44.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737999+0000", 2020-11-16T20:56:44.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0024181250000000001 2020-11-16T20:56:44.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.740417+0000", 2020-11-16T20:56:44.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1564999999999997e-05 2020-11-16T20:56:44.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.199 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:44.199 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.740489+0000", 2020-11-16T20:56:44.199 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019766418000000001 2020-11-16T20:56:44.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.199 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.199 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.760255+0000", 2020-11-16T20:56:44.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015687700000000001 2020-11-16T20:56:44.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.200 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.200 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:44.200 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.760412+0000", 2020-11-16T20:56:44.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010128422999999999 2020-11-16T20:56:44.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.200 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.770540+0000", 2020-11-16T20:56:44.201 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016931800000000001 2020-11-16T20:56:44.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.770710+0000", 2020-11-16T20:56:44.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015040999999999999 2020-11-16T20:56:44.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.202 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.770860+0000", 2020-11-16T20:56:44.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032962285000000001 2020-11-16T20:56:44.202 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.202 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.203 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.203 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.203 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:687 3.3 3:d9c18080:::smithi16641208-173:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e72)", 2020-11-16T20:56:44.203 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:34.746403+0000", 2020-11-16T20:56:44.203 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.2453750229999994, 2020-11-16T20:56:44.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.035160709999999998, 2020-11-16T20:56:44.204 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.204 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:44.204 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.204 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.204 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.204 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.746403+0000", 2020-11-16T20:56:44.204 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.204 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.205 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.205 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.746403+0000", 2020-11-16T20:56:44.205 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3402999999999998e-05 2020-11-16T20:56:44.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.205 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.206 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.746446+0000", 2020-11-16T20:56:44.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8259999999999998e-06 2020-11-16T20:56:44.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.206 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.206 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.206 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.746452+0000", 2020-11-16T20:56:44.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1222e-05 2020-11-16T20:56:44.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.207 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.746463+0000", 2020-11-16T20:56:44.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.78e-06 2020-11-16T20:56:44.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.746468+0000", 2020-11-16T20:56:44.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015534199999999999 2020-11-16T20:56:44.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.746623+0000", 2020-11-16T20:56:44.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1946999999999997e-05 2020-11-16T20:56:44.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:44.209 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.746665+0000", 2020-11-16T20:56:44.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023302178 2020-11-16T20:56:44.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.769968+0000", 2020-11-16T20:56:44.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3629999999999999e-05 2020-11-16T20:56:44.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:44.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.770031+0000", 2020-11-16T20:56:44.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007234809 2020-11-16T20:56:44.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.211 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.211 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.777266+0000", 2020-11-16T20:56:44.211 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000102111 2020-11-16T20:56:44.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.211 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.777368+0000", 2020-11-16T20:56:44.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0041954619999999996 2020-11-16T20:56:44.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.212 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.781564+0000", 2020-11-16T20:56:44.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.035160709999999998 2020-11-16T20:56:44.213 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.213 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.213 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.213 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.213 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.213 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:44.215 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:56:44.215 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:44.219+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:44.315 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:44.320+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:44.390 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:44.391 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:44.391 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:56:44.391 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:44.400 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:56:44.443 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:44.448+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:44.516 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:44.520+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:44.535 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:44.535 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:44.535 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:56:44.535 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:56:44.536 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:44.544 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:56:44.616 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:44.621+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:44.717 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:44.722+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:44.720 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:44.720 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:56:44.721 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:56:44.721 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:56:44.721 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.721 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:37 4.1 e33/22 4:b6545a47:::smithi16641208-46:head v 33'28, mlcod=33'26)", 2020-11-16T20:56:44.721 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.515282+0000", 2020-11-16T20:56:44.721 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 53.208976106000001, 2020-11-16T20:56:44.721 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016792344000000001, 2020-11-16T20:56:44.722 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.722 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.722 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.722 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.722 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.722 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.515282+0000", 2020-11-16T20:56:44.722 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.723 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.723 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.723 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.515282+0000", 2020-11-16T20:56:44.723 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0010571840000000001 2020-11-16T20:56:44.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.723 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.724 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.724 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516339+0000", 2020-11-16T20:56:44.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3354e-05 2020-11-16T20:56:44.724 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.724 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.724 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.724 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516352+0000", 2020-11-16T20:56:44.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7071999999999998e-05 2020-11-16T20:56:44.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.725 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.725 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.725 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516369+0000", 2020-11-16T20:56:44.725 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1358e-05 2020-11-16T20:56:44.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.725 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.726 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516381+0000", 2020-11-16T20:56:44.726 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5952999999999998e-05 2020-11-16T20:56:44.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.726 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.726 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516437+0000", 2020-11-16T20:56:44.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5420999999999998e-05 2020-11-16T20:56:44.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.727 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.727 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516472+0000", 2020-11-16T20:56:44.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015544192 2020-11-16T20:56:44.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.728 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.728 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532016+0000", 2020-11-16T20:56:44.728 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7809999999999997e-05 2020-11-16T20:56:44.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.728 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.728 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.728 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532074+0000", 2020-11-16T20:56:44.729 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016792344000000001 2020-11-16T20:56:44.729 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.729 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.729 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.729 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.729 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:39 4.1 e33/22 4:81558809:::smithi16641208-47:head v 33'30, mlcod=33'26)", 2020-11-16T20:56:44.729 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.519956+0000", 2020-11-16T20:56:44.730 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 53.204301958999999, 2020-11-16T20:56:44.730 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017898104000000001, 2020-11-16T20:56:44.730 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.730 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.730 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.730 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.730 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.731 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519956+0000", 2020-11-16T20:56:44.731 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.731 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.731 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519956+0000", 2020-11-16T20:56:44.731 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00038710900000000001 2020-11-16T20:56:44.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.732 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.732 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520343+0000", 2020-11-16T20:56:44.732 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0797e-05 2020-11-16T20:56:44.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.732 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.733 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520354+0000", 2020-11-16T20:56:44.733 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5874000000000001e-05 2020-11-16T20:56:44.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.733 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.733 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.733 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520370+0000", 2020-11-16T20:56:44.733 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3580000000000003e-06 2020-11-16T20:56:44.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.734 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.734 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.734 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520378+0000", 2020-11-16T20:56:44.734 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5744000000000001e-05 2020-11-16T20:56:44.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.734 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.734 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.735 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520424+0000", 2020-11-16T20:56:44.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4641e-05 2020-11-16T20:56:44.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.735 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.735 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.735 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520449+0000", 2020-11-16T20:56:44.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01735014 2020-11-16T20:56:44.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.736 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.736 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.736 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.537799+0000", 2020-11-16T20:56:44.736 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5441e-05 2020-11-16T20:56:44.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.736 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.736 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.737 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.537854+0000", 2020-11-16T20:56:44.737 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017898104000000001 2020-11-16T20:56:44.737 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.737 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.737 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.737 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.738 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:202 3.2 e35/19 3:5723fd94:::smithi16641208-211:head v 35'124, mlcod=35'121)", 2020-11-16T20:56:44.738 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.980847+0000", 2020-11-16T20:56:44.738 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 49.743411199999997, 2020-11-16T20:56:44.738 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015747763000000001, 2020-11-16T20:56:44.738 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.738 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.738 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.739 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.739 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.980847+0000", 2020-11-16T20:56:44.739 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.739 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.739 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.739 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.980847+0000", 2020-11-16T20:56:44.740 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072722660000000003 2020-11-16T20:56:44.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.740 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.740 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.740 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988119+0000", 2020-11-16T20:56:44.740 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2539e-05 2020-11-16T20:56:44.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.741 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.741 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.741 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988132+0000", 2020-11-16T20:56:44.741 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3723000000000001e-05 2020-11-16T20:56:44.741 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.741 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.741 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.741 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988145+0000", 2020-11-16T20:56:44.742 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8379999999999998e-06 2020-11-16T20:56:44.742 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.742 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.742 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.742 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988151+0000", 2020-11-16T20:56:44.742 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2691000000000002e-05 2020-11-16T20:56:44.742 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.743 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.743 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.743 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988194+0000", 2020-11-16T20:56:44.743 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8366e-05 2020-11-16T20:56:44.743 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.743 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.743 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.743 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988212+0000", 2020-11-16T20:56:44.744 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0083214259999999998 2020-11-16T20:56:44.744 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.744 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.744 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.744 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.996534+0000", 2020-11-16T20:56:44.744 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0914e-05 2020-11-16T20:56:44.744 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.745 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.745 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.745 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.996595+0000", 2020-11-16T20:56:44.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015747763000000001 2020-11-16T20:56:44.745 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.745 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.745 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.746 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:538 4.3 e41/22 4:c9160c9c:::smithi16641208-411:head v 41'95, mlcod=37'93)", 2020-11-16T20:56:44.746 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:56:44.746 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 40.598612150000001, 2020-11-16T20:56:44.746 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021023377999999999, 2020-11-16T20:56:44.746 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.746 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.747 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.747 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.747 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.747 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:56:44.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.747 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:56:44.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052206140000000002 2020-11-16T20:56:44.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130866+0000", 2020-11-16T20:56:44.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0824e-05 2020-11-16T20:56:44.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.749 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130877+0000", 2020-11-16T20:56:44.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5384e-05 2020-11-16T20:56:44.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.750 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.750 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130893+0000", 2020-11-16T20:56:44.750 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0064999999999999e-05 2020-11-16T20:56:44.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.750 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.750 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.750 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130903+0000", 2020-11-16T20:56:44.751 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3051000000000003e-05 2020-11-16T20:56:44.751 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.751 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.751 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.751 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130966+0000", 2020-11-16T20:56:44.751 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9724e-05 2020-11-16T20:56:44.751 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.751 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.752 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.752 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130985+0000", 2020-11-16T20:56:44.752 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015638332000000001 2020-11-16T20:56:44.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.752 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.752 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.752 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.146624+0000", 2020-11-16T20:56:44.753 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5383999999999998e-05 2020-11-16T20:56:44.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.753 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.146669+0000", 2020-11-16T20:56:44.753 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021023377999999999 2020-11-16T20:56:44.753 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.754 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.754 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.754 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.754 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.754 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:547 3.2 e42/19 3:5f250a2b:::smithi16641208-75:head v 42'381, mlcod=42'379)", 2020-11-16T20:56:44.754 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.026221+0000", 2020-11-16T20:56:44.754 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.698036614999999, 2020-11-16T20:56:44.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014398213, 2020-11-16T20:56:44.755 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.755 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.755 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.755 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.755 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.026221+0000", 2020-11-16T20:56:44.755 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.756 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.756 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.756 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.026221+0000", 2020-11-16T20:56:44.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052355140000000001 2020-11-16T20:56:44.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.756 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.756 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031457+0000", 2020-11-16T20:56:44.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3457e-05 2020-11-16T20:56:44.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031470+0000", 2020-11-16T20:56:44.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6532e-05 2020-11-16T20:56:44.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031487+0000", 2020-11-16T20:56:44.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6479999999999992e-06 2020-11-16T20:56:44.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.759 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031496+0000", 2020-11-16T20:56:44.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5820000000000003e-05 2020-11-16T20:56:44.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.759 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031561+0000", 2020-11-16T20:56:44.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6701999999999999e-05 2020-11-16T20:56:44.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031588+0000", 2020-11-16T20:56:44.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089396879999999995 2020-11-16T20:56:44.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.761 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.040528+0000", 2020-11-16T20:56:44.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1852000000000001e-05 2020-11-16T20:56:44.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.761 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.761 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.040620+0000", 2020-11-16T20:56:44.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014398213 2020-11-16T20:56:44.762 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.762 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.762 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.762 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2367 4.2 e42/22 4:581c1e5b:::smithi16641208-124:head v 42'136, mlcod=42'133)", 2020-11-16T20:56:44.762 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:56:44.763 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.670913771999999, 2020-11-16T20:56:44.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021196474999999999, 2020-11-16T20:56:44.763 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.763 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.763 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:56:44.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.764 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:56:44.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070663000000000002 2020-11-16T20:56:44.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.765 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060411+0000", 2020-11-16T20:56:44.765 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0189999999999995e-06 2020-11-16T20:56:44.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.765 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060420+0000", 2020-11-16T20:56:44.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0069e-05 2020-11-16T20:56:44.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060430+0000", 2020-11-16T20:56:44.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6879999999999999e-06 2020-11-16T20:56:44.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.767 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060437+0000", 2020-11-16T20:56:44.767 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3671999999999995e-05 2020-11-16T20:56:44.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.767 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060511+0000", 2020-11-16T20:56:44.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6801999999999998e-05 2020-11-16T20:56:44.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.768 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.768 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060548+0000", 2020-11-16T20:56:44.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013927701000000001 2020-11-16T20:56:44.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074475+0000", 2020-11-16T20:56:44.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5223999999999998e-05 2020-11-16T20:56:44.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074541+0000", 2020-11-16T20:56:44.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021196474999999999 2020-11-16T20:56:44.770 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.770 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.770 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.770 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:507 4.2 e42/22 4:646fee8a:::smithi16641208-407:head v 42'137, mlcod=42'133)", 2020-11-16T20:56:44.771 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.060496+0000", 2020-11-16T20:56:44.771 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.663762446, 2020-11-16T20:56:44.771 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014098016999999999, 2020-11-16T20:56:44.771 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.771 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.771 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.772 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.772 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060496+0000", 2020-11-16T20:56:44.772 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.772 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.772 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.772 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.772 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060496+0000", 2020-11-16T20:56:44.772 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054601980000000003 2020-11-16T20:56:44.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.773 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.773 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.065956+0000", 2020-11-16T20:56:44.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0848e-05 2020-11-16T20:56:44.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.065967+0000", 2020-11-16T20:56:44.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2801e-05 2020-11-16T20:56:44.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.065979+0000", 2020-11-16T20:56:44.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0550999999999999e-05 2020-11-16T20:56:44.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.065990+0000", 2020-11-16T20:56:44.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6890000000000005e-05 2020-11-16T20:56:44.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.066057+0000", 2020-11-16T20:56:44.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4836000000000001e-05 2020-11-16T20:56:44.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.066082+0000", 2020-11-16T20:56:44.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084662330000000001 2020-11-16T20:56:44.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074548+0000", 2020-11-16T20:56:44.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.566e-05 2020-11-16T20:56:44.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074594+0000", 2020-11-16T20:56:44.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014098016999999999 2020-11-16T20:56:44.778 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.778 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.778 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.779 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:554 3.2 e42/19 3:769099fd:::smithi16641208-247:head v 42'386, mlcod=42'384)", 2020-11-16T20:56:44.779 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:56:44.779 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.653994799000003, 2020-11-16T20:56:44.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029531213000000001, 2020-11-16T20:56:44.779 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.779 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.779 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:56:44.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:56:44.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007828448 2020-11-16T20:56:44.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078092+0000", 2020-11-16T20:56:44.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2031000000000001e-05 2020-11-16T20:56:44.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.782 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.782 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078104+0000", 2020-11-16T20:56:44.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3950000000000001e-06 2020-11-16T20:56:44.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.782 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.783 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078112+0000", 2020-11-16T20:56:44.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.434e-06 2020-11-16T20:56:44.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.783 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.783 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.783 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078117+0000", 2020-11-16T20:56:44.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0217999999999999e-05 2020-11-16T20:56:44.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078168+0000", 2020-11-16T20:56:44.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6242e-05 2020-11-16T20:56:44.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078194+0000", 2020-11-16T20:56:44.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021550488 2020-11-16T20:56:44.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099744+0000", 2020-11-16T20:56:44.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9957000000000003e-05 2020-11-16T20:56:44.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.786 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.786 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099794+0000", 2020-11-16T20:56:44.786 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029531213000000001 2020-11-16T20:56:44.786 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.786 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.786 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.787 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2376 4.2 e42/22 4:540952ab:::smithi16641208-369:head v 42'142, mlcod=42'136)", 2020-11-16T20:56:44.787 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.077213+0000", 2020-11-16T20:56:44.787 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.647044702999999, 2020-11-16T20:56:44.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015666645, 2020-11-16T20:56:44.787 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.788 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.788 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.788 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077213+0000", 2020-11-16T20:56:44.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077213+0000", 2020-11-16T20:56:44.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9294e-05 2020-11-16T20:56:44.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077253+0000", 2020-11-16T20:56:44.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6004e-05 2020-11-16T20:56:44.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.790 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.790 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077279+0000", 2020-11-16T20:56:44.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.291e-05 2020-11-16T20:56:44.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.791 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.791 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077291+0000", 2020-11-16T20:56:44.791 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.225e-05 2020-11-16T20:56:44.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.791 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.791 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077304+0000", 2020-11-16T20:56:44.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9744e-05 2020-11-16T20:56:44.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077393+0000", 2020-11-16T20:56:44.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5826e-05 2020-11-16T20:56:44.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077419+0000", 2020-11-16T20:56:44.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015403659 2020-11-16T20:56:44.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.092823+0000", 2020-11-16T20:56:44.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6957999999999999e-05 2020-11-16T20:56:44.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.092880+0000", 2020-11-16T20:56:44.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015666645 2020-11-16T20:56:44.794 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.795 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.795 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.795 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:555 3.2 e42/19 3:590e6edd:::smithi16641208-203:head v 42'387, mlcod=42'384)", 2020-11-16T20:56:44.795 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:56:44.795 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.646113954999997, 2020-11-16T20:56:44.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021681786000000002, 2020-11-16T20:56:44.796 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.796 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.796 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:56:44.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:56:44.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6817999999999998e-05 2020-11-16T20:56:44.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078191+0000", 2020-11-16T20:56:44.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7800000000000003e-06 2020-11-16T20:56:44.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078198+0000", 2020-11-16T20:56:44.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0331e-05 2020-11-16T20:56:44.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078208+0000", 2020-11-16T20:56:44.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8429999999999998e-06 2020-11-16T20:56:44.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078214+0000", 2020-11-16T20:56:44.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0025044690000000001 2020-11-16T20:56:44.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.800 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080718+0000", 2020-11-16T20:56:44.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027441100000000001 2020-11-16T20:56:44.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080993+0000", 2020-11-16T20:56:44.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018806976999999999 2020-11-16T20:56:44.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099800+0000", 2020-11-16T20:56:44.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6157e-05 2020-11-16T20:56:44.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099826+0000", 2020-11-16T20:56:44.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021681786000000002 2020-11-16T20:56:44.806 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.806 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.806 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.807 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:485 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'94, mlcod=41'92)", 2020-11-16T20:56:44.807 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:56:44.807 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.645544987999997, 2020-11-16T20:56:44.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021768460999999999, 2020-11-16T20:56:44.807 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.807 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.807 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:56:44.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:56:44.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001603103 2020-11-16T20:56:44.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080316+0000", 2020-11-16T20:56:44.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4956e-05 2020-11-16T20:56:44.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080331+0000", 2020-11-16T20:56:44.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6291e-05 2020-11-16T20:56:44.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080347+0000", 2020-11-16T20:56:44.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3090000000000001e-06 2020-11-16T20:56:44.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080357+0000", 2020-11-16T20:56:44.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7073000000000001e-05 2020-11-16T20:56:44.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080414+0000", 2020-11-16T20:56:44.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5877e-05 2020-11-16T20:56:44.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080440+0000", 2020-11-16T20:56:44.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019927006000000001 2020-11-16T20:56:44.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100367+0000", 2020-11-16T20:56:44.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114846 2020-11-16T20:56:44.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100481+0000", 2020-11-16T20:56:44.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021768460999999999 2020-11-16T20:56:44.814 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.814 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.814 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.815 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:556 3.2 e42/19 3:590e6edd:::smithi16641208-203:head v 42'388, mlcod=42'384)", 2020-11-16T20:56:44.815 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.081175+0000", 2020-11-16T20:56:44.815 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.643083105999999, 2020-11-16T20:56:44.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020119680000000001, 2020-11-16T20:56:44.815 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.816 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.816 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081175+0000", 2020-11-16T20:56:44.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081175+0000", 2020-11-16T20:56:44.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084338599999999996 2020-11-16T20:56:44.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089609+0000", 2020-11-16T20:56:44.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1812e-05 2020-11-16T20:56:44.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089621+0000", 2020-11-16T20:56:44.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6175e-05 2020-11-16T20:56:44.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089637+0000", 2020-11-16T20:56:44.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2799999999999992e-06 2020-11-16T20:56:44.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089646+0000", 2020-11-16T20:56:44.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1341999999999998e-05 2020-11-16T20:56:44.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.820 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089687+0000", 2020-11-16T20:56:44.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3351999999999999e-05 2020-11-16T20:56:44.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089711+0000", 2020-11-16T20:56:44.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011527864000000001 2020-11-16T20:56:44.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101239+0000", 2020-11-16T20:56:44.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5995000000000002e-05 2020-11-16T20:56:44.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101295+0000", 2020-11-16T20:56:44.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020119680000000001 2020-11-16T20:56:44.822 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.823 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.823 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.823 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2370 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'95, mlcod=41'92)", 2020-11-16T20:56:44.823 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.083328+0000", 2020-11-16T20:56:44.823 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.640930404999999, 2020-11-16T20:56:44.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01719561, 2020-11-16T20:56:44.824 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.824 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.824 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083328+0000", 2020-11-16T20:56:44.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083328+0000", 2020-11-16T20:56:44.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00037936799999999999 2020-11-16T20:56:44.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083707+0000", 2020-11-16T20:56:44.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7088999999999999e-05 2020-11-16T20:56:44.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083724+0000", 2020-11-16T20:56:44.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6737999999999999e-05 2020-11-16T20:56:44.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083771+0000", 2020-11-16T20:56:44.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7869000000000001e-05 2020-11-16T20:56:44.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083789+0000", 2020-11-16T20:56:44.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0046429339999999996 2020-11-16T20:56:44.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.088432+0000", 2020-11-16T20:56:44.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7565999999999998e-05 2020-11-16T20:56:44.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.088479+0000", 2020-11-16T20:56:44.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012005706 2020-11-16T20:56:44.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100485+0000", 2020-11-16T20:56:44.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8340000000000002e-05 2020-11-16T20:56:44.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100523+0000", 2020-11-16T20:56:44.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01719561 2020-11-16T20:56:44.831 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.831 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.831 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.831 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2371 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'96, mlcod=41'92)", 2020-11-16T20:56:44.831 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.084682+0000", 2020-11-16T20:56:44.832 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.639576259000002, 2020-11-16T20:56:44.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015864851999999999, 2020-11-16T20:56:44.832 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.832 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.832 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084682+0000", 2020-11-16T20:56:44.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084682+0000", 2020-11-16T20:56:44.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1321e-05 2020-11-16T20:56:44.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084723+0000", 2020-11-16T20:56:44.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9310000000000008e-06 2020-11-16T20:56:44.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084731+0000", 2020-11-16T20:56:44.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1453e-05 2020-11-16T20:56:44.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084742+0000", 2020-11-16T20:56:44.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9670000000000004e-06 2020-11-16T20:56:44.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084749+0000", 2020-11-16T20:56:44.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048588700000000004 2020-11-16T20:56:44.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089608+0000", 2020-11-16T20:56:44.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3699999999999998e-05 2020-11-16T20:56:44.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089652+0000", 2020-11-16T20:56:44.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010873481000000001 2020-11-16T20:56:44.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100525+0000", 2020-11-16T20:56:44.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1129e-05 2020-11-16T20:56:44.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100547+0000", 2020-11-16T20:56:44.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015864851999999999 2020-11-16T20:56:44.839 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.839 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.839 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.839 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:663 4.3 e57/22 4:f65e82cb:::smithi16641208-219:head v 57'179, mlcod=57'176)", 2020-11-16T20:56:44.840 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:56:44.840 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.927429918000001, 2020-11-16T20:56:44.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022540092000000001, 2020-11-16T20:56:44.840 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.840 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.840 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:56:44.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:56:44.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013414394 2020-11-16T20:56:44.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810242+0000", 2020-11-16T20:56:44.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1864e-05 2020-11-16T20:56:44.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810254+0000", 2020-11-16T20:56:44.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3716e-05 2020-11-16T20:56:44.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810268+0000", 2020-11-16T20:56:44.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.064e-06 2020-11-16T20:56:44.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810277+0000", 2020-11-16T20:56:44.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0560999999999998e-05 2020-11-16T20:56:44.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810338+0000", 2020-11-16T20:56:44.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7523999999999999e-05 2020-11-16T20:56:44.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810365+0000", 2020-11-16T20:56:44.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089020890000000002 2020-11-16T20:56:44.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819267+0000", 2020-11-16T20:56:44.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010088 2020-11-16T20:56:44.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819368+0000", 2020-11-16T20:56:44.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022540092000000001 2020-11-16T20:56:44.847 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.847 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.847 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.848 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:618 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'243, mlcod=57'241)", 2020-11-16T20:56:44.848 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:56:44.848 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.923923843000001, 2020-11-16T20:56:44.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049183098000000001, 2020-11-16T20:56:44.848 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.848 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.848 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:56:44.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:56:44.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019114651 2020-11-16T20:56:44.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819449+0000", 2020-11-16T20:56:44.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.398e-05 2020-11-16T20:56:44.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819463+0000", 2020-11-16T20:56:44.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1139e-05 2020-11-16T20:56:44.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819474+0000", 2020-11-16T20:56:44.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1860000000000003e-06 2020-11-16T20:56:44.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819481+0000", 2020-11-16T20:56:44.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015472700000000001 2020-11-16T20:56:44.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819636+0000", 2020-11-16T20:56:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9632e-05 2020-11-16T20:56:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819665+0000", 2020-11-16T20:56:44.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029788289999999999 2020-11-16T20:56:44.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849454+0000", 2020-11-16T20:56:44.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3492999999999997e-05 2020-11-16T20:56:44.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849517+0000", 2020-11-16T20:56:44.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049183098000000001 2020-11-16T20:56:44.855 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.855 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.855 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.856 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:609 3.2 e57/19 3:5eead97c:::smithi16641208-34:head v 57'498, mlcod=57'495)", 2020-11-16T20:56:44.856 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:56:44.856 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.913644344000001, 2020-11-16T20:56:44.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039221579999999999, 2020-11-16T20:56:44.856 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.856 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.857 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:56:44.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:56:44.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008889859 2020-11-16T20:56:44.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819503+0000", 2020-11-16T20:56:44.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0149000000000001e-05 2020-11-16T20:56:44.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819514+0000", 2020-11-16T20:56:44.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1049999999999999e-05 2020-11-16T20:56:44.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819525+0000", 2020-11-16T20:56:44.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4829999999999999e-06 2020-11-16T20:56:44.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819533+0000", 2020-11-16T20:56:44.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031805760000000001 2020-11-16T20:56:44.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822714+0000", 2020-11-16T20:56:44.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0954000000000002e-05 2020-11-16T20:56:44.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822745+0000", 2020-11-16T20:56:44.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027044038999999999 2020-11-16T20:56:44.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849789+0000", 2020-11-16T20:56:44.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6470000000000001e-05 2020-11-16T20:56:44.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849835+0000", 2020-11-16T20:56:44.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039221579999999999 2020-11-16T20:56:44.863 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.863 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.863 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.864 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2583 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'244, mlcod=57'241)", 2020-11-16T20:56:44.864 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:56:44.864 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.904726809, 2020-11-16T20:56:44.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030101836999999999, 2020-11-16T20:56:44.864 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.865 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.865 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:56:44.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:56:44.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3781e-05 2020-11-16T20:56:44.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819575+0000", 2020-11-16T20:56:44.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3355e-05 2020-11-16T20:56:44.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819588+0000", 2020-11-16T20:56:44.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8198e-05 2020-11-16T20:56:44.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819657+0000", 2020-11-16T20:56:44.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5849999999999999e-05 2020-11-16T20:56:44.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819672+0000", 2020-11-16T20:56:44.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003042473 2020-11-16T20:56:44.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822715+0000", 2020-11-16T20:56:44.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9779999999999999e-05 2020-11-16T20:56:44.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822745+0000", 2020-11-16T20:56:44.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026828521000000001 2020-11-16T20:56:44.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849573+0000", 2020-11-16T20:56:44.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9879e-05 2020-11-16T20:56:44.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849633+0000", 2020-11-16T20:56:44.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030101836999999999 2020-11-16T20:56:44.871 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.872 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.872 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.872 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:728 4.3 e69/22 4:ccdf634d:::smithi16641208-284:head v 69'228, mlcod=61'226)", 2020-11-16T20:56:44.872 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:31.767600+0000", 2020-11-16T20:56:44.872 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 12.956657743999999, 2020-11-16T20:56:44.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014161465, 2020-11-16T20:56:44.873 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.873 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.873 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.767600+0000", 2020-11-16T20:56:44.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.767600+0000", 2020-11-16T20:56:44.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053383129999999999 2020-11-16T20:56:44.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.772939+0000", 2020-11-16T20:56:44.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0958000000000001e-05 2020-11-16T20:56:44.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.772950+0000", 2020-11-16T20:56:44.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0628999999999999e-05 2020-11-16T20:56:44.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.772960+0000", 2020-11-16T20:56:44.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9689999999999999e-06 2020-11-16T20:56:44.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.772966+0000", 2020-11-16T20:56:44.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3246999999999999e-05 2020-11-16T20:56:44.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.773029+0000", 2020-11-16T20:56:44.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2042000000000003e-05 2020-11-16T20:56:44.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.773061+0000", 2020-11-16T20:56:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0086372619999999997 2020-11-16T20:56:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.781699+0000", 2020-11-16T20:56:44.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3045000000000004e-05 2020-11-16T20:56:44.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.781762+0000", 2020-11-16T20:56:44.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014161465 2020-11-16T20:56:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:779 4.3 e72/22 4:d9c18080:::smithi16641208-173:head v 72'266, mlcod=71'264)", 2020-11-16T20:56:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:34.786324+0000", 2020-11-16T20:56:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.9379343250000005, 2020-11-16T20:56:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017952486, 2020-11-16T20:56:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.786324+0000", 2020-11-16T20:56:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.786324+0000", 2020-11-16T20:56:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012598417000000001 2020-11-16T20:56:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:44.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.798922+0000", 2020-11-16T20:56:44.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1700000000000003e-06 2020-11-16T20:56:44.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:44.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.798931+0000", 2020-11-16T20:56:44.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2648e-05 2020-11-16T20:56:44.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.884 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:44.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.798944+0000", 2020-11-16T20:56:44.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0150000000000003e-06 2020-11-16T20:56:44.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.885 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:44.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.798952+0000", 2020-11-16T20:56:44.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4095999999999998e-05 2020-11-16T20:56:44.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.885 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:44.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.799006+0000", 2020-11-16T20:56:44.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2419e-05 2020-11-16T20:56:44.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:44.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.799028+0000", 2020-11-16T20:56:44.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051805050000000002 2020-11-16T20:56:44.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:44.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.804209+0000", 2020-11-16T20:56:44.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7216000000000002e-05 2020-11-16T20:56:44.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:44.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:44.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:44.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.804276+0000", 2020-11-16T20:56:44.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017952486 2020-11-16T20:56:44.888 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.888 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.888 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.888 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:44.888 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:44.888 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:44.891 INFO:tasks.rados.rados.0.smithi166.stdout:818: done (0 left) 2020-11-16T20:56:44.891 INFO:tasks.rados.rados.0.smithi166.stdout:819: write (excl) oid 375 current snap is 24 2020-11-16T20:56:44.891 INFO:tasks.rados.rados.0.smithi166.stdout:819: seq_num 579 ranges {531253=411999,1381780=411527,2300501=586966,3376974=354279} 2020-11-16T20:56:44.891 INFO:tasks.rados.rados.0.smithi166.stdout:819: writing smithi16641208-375 from 531253 to 943252 tid 1 2020-11-16T20:56:44.892 INFO:tasks.rados.rados.0.smithi166.stdout:819: writing smithi16641208-375 from 1381780 to 1793307 tid 2 2020-11-16T20:56:44.892 INFO:tasks.rados.rados.0.smithi166.stdout:819: writing smithi16641208-375 from 2300501 to 2887467 tid 3 2020-11-16T20:56:44.892 INFO:tasks.rados.rados.0.smithi166.stdout:819: writing smithi16641208-375 from 3376974 to 3731253 tid 4 2020-11-16T20:56:44.892 INFO:tasks.rados.rados.0.smithi166.stdout:820: rollback oid 371 current snap is 24 2020-11-16T20:56:44.892 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 371 to 19 2020-11-16T20:56:44.892 INFO:tasks.rados.rados.0.smithi166.stdout:821: delete oid 8 current snap is 24 2020-11-16T20:56:44.892 INFO:tasks.rados.rados.0.smithi166.stdout:819: finishing write tid 1 to smithi16641208-375 2020-11-16T20:56:44.893 INFO:tasks.rados.rados.0.smithi166.stdout:820: finishing rollback tid 0 to smithi16641208-371 2020-11-16T20:56:44.893 INFO:tasks.rados.rados.0.smithi166.stdout:820: finishing rollback tid 1 to smithi16641208-371 2020-11-16T20:56:44.893 INFO:tasks.rados.rados.0.smithi166.stdout:820: finishing rollback tid 2 to smithi16641208-371 2020-11-16T20:56:44.893 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 371 v 627 (ObjNum 370 snap 0 seq_num 370) dirty exists 2020-11-16T20:56:44.893 INFO:tasks.rados.rados.0.smithi166.stdout:819: finishing write tid 2 to smithi16641208-375 2020-11-16T20:56:44.893 INFO:tasks.rados.rados.0.smithi166.stdout:819: finishing write tid 3 to smithi16641208-375 2020-11-16T20:56:44.893 INFO:tasks.rados.rados.0.smithi166.stdout:819: finishing write tid 4 to smithi16641208-375 2020-11-16T20:56:44.893 INFO:tasks.rados.rados.0.smithi166.stdout:819: finishing write tid 5 to smithi16641208-375 2020-11-16T20:56:44.894 INFO:tasks.rados.rados.0.smithi166.stdout:819: finishing write tid 6 to smithi16641208-375 2020-11-16T20:56:44.894 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 375 v 636 (ObjNum 579 snap 24 seq_num 579) dirty exists 2020-11-16T20:56:44.894 INFO:tasks.rados.rados.0.smithi166.stdout:819: left oid 375 (ObjNum 579 snap 24 seq_num 579) 2020-11-16T20:56:44.894 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:44.764+0000 7ff3cda4b700 -1 osd.0 pg_epoch: 82 pg[3.1( v 82'675 (0'0,82'675] local-lis/les=19/20 n=145 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [0,4,3] r=0 lpr=19 luod=82'673 crt=82'675 lcod 82'671 mlcod 82'671 active+clean+snaptrim trimq=[f~1] ps=[21~1,26~2,2b~1]] removing snap head 2020-11-16T20:56:44.894 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:44.790+0000 7f868ad23700 -1 osd.1 pg_epoch: 82 pg[3.0( v 82'554 (0'0,82'554] local-lis/les=66/67 n=128 ec=19/19 lis/c=66/66 les/c/f=67/67/0 sis=66) [1,2,0] r=0 lpr=66 luod=82'552 crt=82'554 lcod 82'550 mlcod 82'550 active+clean+snaptrim trimq=[f~1] ps=[21~1,26~2,2b~1]] removing snap head 2020-11-16T20:56:44.894 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:44.815+0000 7f868ad23700 -1 osd.1 pg_epoch: 82 pg[3.0( v 82'568 (0'0,82'568] local-lis/les=66/67 n=122 ec=19/19 lis/c=66/66 les/c/f=67/67/0 sis=66) [1,2,0] r=0 lpr=66 crt=82'568 lcod 82'566 mlcod 82'566 active+clean+snaptrim trimq=[f~1] ps=[21~1,26~2,2b~1]] removing snap head 2020-11-16T20:56:44.895 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:44.816+0000 7f868ad23700 -1 osd.1 pg_epoch: 82 pg[3.0( v 82'570 (0'0,82'570] local-lis/les=66/67 n=120 ec=19/19 lis/c=66/66 les/c/f=67/67/0 sis=66) [1,2,0] r=0 lpr=66 luod=82'568 crt=82'570 lcod 82'566 mlcod 82'566 active+clean+snaptrim trimq=[f~1] ps=[21~1,26~2,2b~1]] removing snap head 2020-11-16T20:56:44.895 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:44.894+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:44.895 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:56:44.896 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:44.794+0000 7f1837789700 -1 osd.4 pg_epoch: 82 pg[3.3( v 82'640 (0'0,82'640] local-lis/les=19/20 n=137 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [4,0,6] r=0 lpr=19 crt=82'640 lcod 82'638 mlcod 82'638 active+clean+snaptrim trimq=[f~1] ps=[21~1,26~2,2b~1]] removing snap head 2020-11-16T20:56:44.896 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:44.821+0000 7f1837789700 -1 osd.4 pg_epoch: 82 pg[3.3( v 82'656 (0'0,82'656] local-lis/les=19/20 n=130 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [4,0,6] r=0 lpr=19 crt=82'656 lcod 82'654 mlcod 82'654 active+clean+snaptrim trimq=[f~1] ps=[21~1,26~2,2b~1]] removing snap head 2020-11-16T20:56:44.986 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:56:44.990 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:44.995+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:45.031 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:45.032 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:45.032 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:56:45.032 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:45.041 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:56:45.091 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:45.095+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:45.129 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:56:45.148 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:56:45.167 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:56:45.186 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:56:45.192 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:45.196+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:45.205 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:56:45.216 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:45.217 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:45.217 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:56:45.217 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:56:45.217 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:45.225 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:56:45.227 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:56:45.245 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:56:45.265 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:56:45.266 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:56:45.267 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:56:45.267 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:56:45.267 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:56:45.267 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:56:45.267 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:56:45.267 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:56:45.267 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:56:45.292 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:45.297+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:45.362 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:45.363 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:45.372 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:56:45.413 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:45.418+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:45.494 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:45.498+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:45.547 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:45.548 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:45.557 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:56:45.598 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:45.603+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:45.696 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:45.701+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:45.732 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:45.733 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:45.743 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:56:45.792 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2020-11-16T20:56:45.836 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:45.840+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:45.880 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:45.880 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:45.890 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:56:45.917 INFO:tasks.rados.rados.0.smithi166.stdout:819: done (2 left) 2020-11-16T20:56:45.917 INFO:tasks.rados.rados.0.smithi166.stdout:820: done (1 left) 2020-11-16T20:56:45.917 INFO:tasks.rados.rados.0.smithi166.stdout:821: done (0 left) 2020-11-16T20:56:45.917 INFO:tasks.rados.rados.0.smithi166.stdout:822: write oid 89 current snap is 24 2020-11-16T20:56:45.918 INFO:tasks.rados.rados.0.smithi166.stdout:822: seq_num 581 ranges {564867=562497,1898744=415196,2755347=725863} 2020-11-16T20:56:45.918 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:45.921+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:45.923 INFO:tasks.rados.rados.0.smithi166.stdout:822: writing smithi16641208-89 from 564867 to 1127364 tid 1 2020-11-16T20:56:45.931 INFO:tasks.rados.rados.0.smithi166.stdout:822: writing smithi16641208-89 from 1898744 to 2313940 tid 2 2020-11-16T20:56:45.938 INFO:tasks.rados.rados.0.smithi166.stdout:822: writing smithi16641208-89 from 2755347 to 3481210 tid 3 2020-11-16T20:56:45.938 INFO:tasks.rados.rados.0.smithi166.stdout:823: snap_create 2020-11-16T20:56:45.938 INFO:tasks.rados.rados.0.smithi166.stdout:822: finishing write tid 1 to smithi16641208-89 2020-11-16T20:56:45.938 INFO:tasks.rados.rados.0.smithi166.stdout:822: finishing write tid 2 to smithi16641208-89 2020-11-16T20:56:45.942 INFO:tasks.rados.rados.0.smithi166.stdout:822: finishing write tid 3 to smithi16641208-89 2020-11-16T20:56:45.942 INFO:tasks.rados.rados.0.smithi166.stdout:822: finishing write tid 4 to smithi16641208-89 2020-11-16T20:56:45.943 INFO:tasks.rados.rados.0.smithi166.stdout:822: finishing write tid 5 to smithi16641208-89 2020-11-16T20:56:45.943 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 89 v 669 (ObjNum 581 snap 24 seq_num 581) dirty exists 2020-11-16T20:56:45.943 INFO:tasks.rados.rados.0.smithi166.stdout:822: left oid 89 (ObjNum 581 snap 24 seq_num 581) 2020-11-16T20:56:45.999 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:46.003+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:46.076 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:46.076 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:46.089 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:56:46.100 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:46.104+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:46.201 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:46.205+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:46.297 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:46.297 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:46.302 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:46.306+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:46.310 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:56:46.403 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:46.407+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:46.486 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:46.486 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:46.495 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:56:46.504 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:46.508+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:46.604 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:46.609+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:46.661 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:46.662 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:46.671 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:56:46.705 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:46.709+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:46.789 INFO:tasks.rados.rados.0.smithi166.stdout:822: done (1 left) 2020-11-16T20:56:46.789 INFO:tasks.rados.rados.0.smithi166.stdout:823: done (0 left) 2020-11-16T20:56:46.789 INFO:tasks.rados.rados.0.smithi166.stdout:824: snap_remove snap 23 2020-11-16T20:56:46.790 INFO:teuthology.orchestra.run.smithi166.stderr:noscrub is set 2020-11-16T20:56:46.798 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:46.799 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:46.805 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:46.809+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:46.809 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:56:46.906 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:46.910+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:46.977 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:46.977 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:46.986 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:56:47.007 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:47.012+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:47.108 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:47.112+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:47.152 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:47.152 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:47.161 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:56:47.209 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:47.213+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:47.277 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:56:47.288 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:47.289 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:47.299 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:56:47.310 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:47.314+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:47.411 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:47.415+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:47.424 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:56:47.444 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:56:47.464 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:56:47.474 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:47.474 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:56:47.474 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:56:47.474 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:56:47.474 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.474 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:170 3.0 e33/19 3:1e260d0e:::smithi16641208-43:head v 33'12, mlcod=33'10)", 2020-11-16T20:56:47.475 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:51.458057+0000", 2020-11-16T20:56:47.475 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 56.019839011999998, 2020-11-16T20:56:47.475 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040611839999999998, 2020-11-16T20:56:47.475 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:47.475 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:47.475 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:47.475 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.476 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:47.476 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458057+0000", 2020-11-16T20:56:47.476 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:47.476 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.476 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.476 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:47.476 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458057+0000", 2020-11-16T20:56:47.477 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000227333 2020-11-16T20:56:47.477 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.477 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.477 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:47.477 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458284+0000", 2020-11-16T20:56:47.477 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8389999999999996e-06 2020-11-16T20:56:47.477 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.478 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.478 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:47.478 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458293+0000", 2020-11-16T20:56:47.478 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9907999999999998e-05 2020-11-16T20:56:47.478 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.478 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.478 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:47.479 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458333+0000", 2020-11-16T20:56:47.479 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2132e-05 2020-11-16T20:56:47.479 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.479 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.479 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:47.479 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458345+0000", 2020-11-16T20:56:47.479 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0157000000000001e-05 2020-11-16T20:56:47.479 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.480 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.480 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:47.480 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458395+0000", 2020-11-16T20:56:47.480 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6659e-05 2020-11-16T20:56:47.480 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.480 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.480 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:47.481 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.458422+0000", 2020-11-16T20:56:47.481 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0036338049999999999 2020-11-16T20:56:47.481 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.481 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.481 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:47.481 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.462056+0000", 2020-11-16T20:56:47.481 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2351e-05 2020-11-16T20:56:47.481 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.482 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.482 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:47.482 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:51.462118+0000", 2020-11-16T20:56:47.482 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040611839999999998 2020-11-16T20:56:47.482 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.482 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:47.482 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.483 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.483 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.483 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:901 3.0 e35/19 3:29e07ad2:::smithi16641208-204:head v 35'134, mlcod=35'132)", 2020-11-16T20:56:47.483 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.128152+0000", 2020-11-16T20:56:47.483 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 53.349743754000002, 2020-11-16T20:56:47.483 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042710120000000002, 2020-11-16T20:56:47.483 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:47.484 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:47.484 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:47.484 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.484 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:47.484 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128152+0000", 2020-11-16T20:56:47.484 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:47.484 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.484 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.485 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:47.485 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128152+0000", 2020-11-16T20:56:47.485 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019783600000000001 2020-11-16T20:56:47.485 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.485 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.485 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:47.485 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128350+0000", 2020-11-16T20:56:47.486 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6030000000000005e-06 2020-11-16T20:56:47.486 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.486 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.486 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:47.486 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128358+0000", 2020-11-16T20:56:47.486 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2595999999999999e-05 2020-11-16T20:56:47.486 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.486 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.487 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:47.487 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128371+0000", 2020-11-16T20:56:47.487 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3209999999999999e-06 2020-11-16T20:56:47.487 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.487 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.487 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:47.487 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128378+0000", 2020-11-16T20:56:47.488 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4047e-05 2020-11-16T20:56:47.488 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.488 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.488 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:47.488 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128422+0000", 2020-11-16T20:56:47.488 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9796000000000001e-05 2020-11-16T20:56:47.488 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.488 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.489 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:47.489 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128452+0000", 2020-11-16T20:56:47.489 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039150929999999997 2020-11-16T20:56:47.489 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.489 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.489 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:47.489 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.132367+0000", 2020-11-16T20:56:47.490 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5720000000000002e-05 2020-11-16T20:56:47.490 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.490 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.490 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:47.490 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.132423+0000", 2020-11-16T20:56:47.490 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042710120000000002 2020-11-16T20:56:47.490 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.491 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:47.491 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.491 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.491 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.491 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1028 3.0 e35/19 3:2e3eb594:::smithi16641208-229:head v 35'159, mlcod=35'157)", 2020-11-16T20:56:47.491 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.635550+0000", 2020-11-16T20:56:47.491 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 52.842345311999999, 2020-11-16T20:56:47.491 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042338380000000002, 2020-11-16T20:56:47.492 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:47.492 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:47.492 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:47.492 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.492 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:47.492 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635550+0000", 2020-11-16T20:56:47.492 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:47.493 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.493 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.493 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:47.493 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635550+0000", 2020-11-16T20:56:47.493 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018653699999999999 2020-11-16T20:56:47.493 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.493 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.493 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:47.494 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635737+0000", 2020-11-16T20:56:47.494 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.037e-06 2020-11-16T20:56:47.494 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.494 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.494 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:47.494 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635746+0000", 2020-11-16T20:56:47.494 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3001e-05 2020-11-16T20:56:47.495 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.495 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.495 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:47.495 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635759+0000", 2020-11-16T20:56:47.495 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7740000000000004e-06 2020-11-16T20:56:47.495 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.495 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.495 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:47.496 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635767+0000", 2020-11-16T20:56:47.496 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1385999999999999e-05 2020-11-16T20:56:47.496 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.496 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.496 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:47.496 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635818+0000", 2020-11-16T20:56:47.496 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6427e-05 2020-11-16T20:56:47.497 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.497 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.497 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:47.497 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635845+0000", 2020-11-16T20:56:47.497 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003885164 2020-11-16T20:56:47.497 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.497 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.497 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:47.498 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.639730+0000", 2020-11-16T20:56:47.498 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4512000000000003e-05 2020-11-16T20:56:47.498 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.498 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.499 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:47.499 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.639784+0000", 2020-11-16T20:56:47.499 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042338380000000002 2020-11-16T20:56:47.499 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.499 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:47.499 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.499 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.500 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.500 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1102 3.0 e35/19 3:1c1ecb34:::smithi16641208-245:head v 35'172, mlcod=35'170)", 2020-11-16T20:56:47.500 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.920148+0000", 2020-11-16T20:56:47.500 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 52.557747427000002, 2020-11-16T20:56:47.500 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053854699999999998, 2020-11-16T20:56:47.500 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:47.500 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:47.501 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:47.501 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.501 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:47.501 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920148+0000", 2020-11-16T20:56:47.501 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:47.501 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.502 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.502 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:47.502 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920148+0000", 2020-11-16T20:56:47.502 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019421400000000001 2020-11-16T20:56:47.502 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.502 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.503 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:47.503 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920342+0000", 2020-11-16T20:56:47.503 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6169999999999996e-06 2020-11-16T20:56:47.503 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.503 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.503 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:47.503 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920352+0000", 2020-11-16T20:56:47.504 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3684e-05 2020-11-16T20:56:47.504 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.504 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.504 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:47.504 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920366+0000", 2020-11-16T20:56:47.504 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7789999999999996e-06 2020-11-16T20:56:47.504 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.504 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.505 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:47.505 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920374+0000", 2020-11-16T20:56:47.505 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8783999999999995e-05 2020-11-16T20:56:47.505 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.505 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.505 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:47.505 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920472+0000", 2020-11-16T20:56:47.506 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6865000000000001e-05 2020-11-16T20:56:47.506 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.506 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.506 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:47.506 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920499+0000", 2020-11-16T20:56:47.506 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004975246 2020-11-16T20:56:47.506 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.506 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.507 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:47.507 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.925474+0000", 2020-11-16T20:56:47.507 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9280999999999997e-05 2020-11-16T20:56:47.507 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.507 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.507 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:47.507 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.925534+0000", 2020-11-16T20:56:47.508 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053854699999999998 2020-11-16T20:56:47.508 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.508 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:47.508 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.508 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.508 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.508 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1198 3.0 e35/19 3:1b4407ea:::smithi16641208-269:head v 35'184, mlcod=35'182)", 2020-11-16T20:56:47.508 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.231667+0000", 2020-11-16T20:56:47.509 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 52.246228269, 2020-11-16T20:56:47.509 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041081770000000002, 2020-11-16T20:56:47.509 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:47.509 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:47.509 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:47.509 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.509 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:47.510 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231667+0000", 2020-11-16T20:56:47.510 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:47.510 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.510 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.510 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:47.510 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231667+0000", 2020-11-16T20:56:47.510 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018666399999999999 2020-11-16T20:56:47.511 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.511 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.511 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:47.511 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231854+0000", 2020-11-16T20:56:47.511 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.152e-05 2020-11-16T20:56:47.511 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.511 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.512 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:47.512 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231866+0000", 2020-11-16T20:56:47.512 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2456000000000002e-05 2020-11-16T20:56:47.512 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.512 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.512 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:47.513 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231898+0000", 2020-11-16T20:56:47.513 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6789999999999994e-06 2020-11-16T20:56:47.513 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.513 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.513 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:47.513 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231907+0000", 2020-11-16T20:56:47.513 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0732999999999997e-05 2020-11-16T20:56:47.514 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.514 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.514 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:47.514 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231957+0000", 2020-11-16T20:56:47.514 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9028000000000001e-05 2020-11-16T20:56:47.514 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.514 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.515 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:47.515 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231987+0000", 2020-11-16T20:56:47.515 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037323830000000001 2020-11-16T20:56:47.515 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.515 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.515 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:47.515 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.235719+0000", 2020-11-16T20:56:47.515 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6713999999999999e-05 2020-11-16T20:56:47.516 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.516 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.516 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:47.516 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.235776+0000", 2020-11-16T20:56:47.516 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041081770000000002 2020-11-16T20:56:47.516 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.516 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:47.517 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.517 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.517 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.517 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1235 3.0 e35/19 3:2294fced:::smithi16641208-278:head v 35'188, mlcod=35'185)", 2020-11-16T20:56:47.517 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.354799+0000", 2020-11-16T20:56:47.517 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 52.123096314000001, 2020-11-16T20:56:47.517 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050791389999999999, 2020-11-16T20:56:47.517 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:47.518 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:47.518 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:47.518 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.518 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:47.518 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354799+0000", 2020-11-16T20:56:47.518 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:47.518 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.519 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.519 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:47.519 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354799+0000", 2020-11-16T20:56:47.519 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2141000000000002e-05 2020-11-16T20:56:47.519 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.519 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.519 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:47.519 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354842+0000", 2020-11-16T20:56:47.520 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.601e-06 2020-11-16T20:56:47.520 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.520 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.520 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:47.520 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354848+0000", 2020-11-16T20:56:47.520 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.028e-05 2020-11-16T20:56:47.520 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.521 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.521 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:47.521 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354858+0000", 2020-11-16T20:56:47.521 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2959999999999998e-06 2020-11-16T20:56:47.521 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.521 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.521 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:47.521 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354864+0000", 2020-11-16T20:56:47.522 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3279999999999999e-05 2020-11-16T20:56:47.522 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.522 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.522 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:47.522 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354907+0000", 2020-11-16T20:56:47.522 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3655e-05 2020-11-16T20:56:47.522 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.523 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.523 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:47.523 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354931+0000", 2020-11-16T20:56:47.523 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004888875 2020-11-16T20:56:47.523 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.523 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.523 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:47.523 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.359820+0000", 2020-11-16T20:56:47.524 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9011000000000001e-05 2020-11-16T20:56:47.524 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.524 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.524 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:47.524 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.359879+0000", 2020-11-16T20:56:47.524 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050791389999999999 2020-11-16T20:56:47.524 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.525 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:47.525 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.525 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.525 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.525 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1237 3.0 e35/19 3:0b7cd9c0:::smithi16641208-279:head v 35'189, mlcod=35'187)", 2020-11-16T20:56:47.525 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.361967+0000", 2020-11-16T20:56:47.525 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 52.115929072, 2020-11-16T20:56:47.525 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041733320000000001, 2020-11-16T20:56:47.526 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:47.526 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:47.526 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:47.526 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.526 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:47.526 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.361967+0000", 2020-11-16T20:56:47.526 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:47.527 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.527 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.527 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:47.527 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.361967+0000", 2020-11-16T20:56:47.527 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045453300000000002 2020-11-16T20:56:47.527 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.527 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.528 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:47.528 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362421+0000", 2020-11-16T20:56:47.528 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1178999999999999e-05 2020-11-16T20:56:47.528 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.528 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.528 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:47.528 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362432+0000", 2020-11-16T20:56:47.528 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5865000000000001e-05 2020-11-16T20:56:47.529 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.529 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.529 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:47.529 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362448+0000", 2020-11-16T20:56:47.529 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9809999999999992e-06 2020-11-16T20:56:47.529 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.529 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.530 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:47.530 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362457+0000", 2020-11-16T20:56:47.530 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9304e-05 2020-11-16T20:56:47.530 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.530 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.530 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:47.530 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362516+0000", 2020-11-16T20:56:47.531 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2886000000000003e-05 2020-11-16T20:56:47.531 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.531 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.531 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:47.531 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362549+0000", 2020-11-16T20:56:47.531 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035249809999999999 2020-11-16T20:56:47.531 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.531 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.532 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:47.532 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.366074+0000", 2020-11-16T20:56:47.532 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5603000000000002e-05 2020-11-16T20:56:47.532 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.532 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.532 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:47.532 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.366140+0000", 2020-11-16T20:56:47.533 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041733320000000001 2020-11-16T20:56:47.533 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.533 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:47.533 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.533 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.533 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.533 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1423 3.0 e36/19 3:1e5364a0:::smithi16641208-320:head v 36'221, mlcod=35'219)", 2020-11-16T20:56:47.533 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.033789+0000", 2020-11-16T20:56:47.534 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 51.444106681999997, 2020-11-16T20:56:47.534 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041251339999999999, 2020-11-16T20:56:47.534 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:47.534 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:47.534 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:47.534 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.534 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:47.535 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033789+0000", 2020-11-16T20:56:47.535 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:47.535 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.535 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.535 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:47.535 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033789+0000", 2020-11-16T20:56:47.535 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015644000000000001 2020-11-16T20:56:47.535 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.536 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.536 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:47.536 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033945+0000", 2020-11-16T20:56:47.536 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0270000000000003e-06 2020-11-16T20:56:47.536 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.536 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.536 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:47.536 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033950+0000", 2020-11-16T20:56:47.537 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6420000000000007e-06 2020-11-16T20:56:47.537 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.537 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.537 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:47.537 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033958+0000", 2020-11-16T20:56:47.537 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.477e-06 2020-11-16T20:56:47.537 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.538 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.538 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:47.538 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033965+0000", 2020-11-16T20:56:47.538 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9178999999999998e-05 2020-11-16T20:56:47.538 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.538 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.538 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:47.539 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.034014+0000", 2020-11-16T20:56:47.539 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2172e-05 2020-11-16T20:56:47.539 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.539 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.539 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:47.539 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.034036+0000", 2020-11-16T20:56:47.539 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0038237190000000002 2020-11-16T20:56:47.540 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.540 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.540 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:47.540 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.037860+0000", 2020-11-16T20:56:47.540 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4478000000000003e-05 2020-11-16T20:56:47.540 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.540 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.540 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:47.541 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.037914+0000", 2020-11-16T20:56:47.541 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041251339999999999 2020-11-16T20:56:47.541 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.541 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:47.541 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.541 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.541 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.541 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1468 3.0 e36/19 3:1852173c:::smithi16641208-329:head v 36'238, mlcod=36'236)", 2020-11-16T20:56:47.542 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.208167+0000", 2020-11-16T20:56:47.542 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 51.269728907999998, 2020-11-16T20:56:47.542 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052481979999999999, 2020-11-16T20:56:47.542 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:47.542 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:47.542 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:47.542 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.543 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:47.543 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208167+0000", 2020-11-16T20:56:47.543 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:47.543 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.543 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.543 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:47.543 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208167+0000", 2020-11-16T20:56:47.544 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013521900000000001 2020-11-16T20:56:47.544 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.544 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.544 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:47.544 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208302+0000", 2020-11-16T20:56:47.544 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1307e-05 2020-11-16T20:56:47.544 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.544 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.545 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:47.545 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208313+0000", 2020-11-16T20:56:47.545 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2828e-05 2020-11-16T20:56:47.545 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.545 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.545 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:47.545 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208326+0000", 2020-11-16T20:56:47.545 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8889999999999996e-06 2020-11-16T20:56:47.546 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.546 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.546 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:47.546 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208333+0000", 2020-11-16T20:56:47.546 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2843999999999999e-05 2020-11-16T20:56:47.546 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.546 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.547 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:47.547 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208366+0000", 2020-11-16T20:56:47.547 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4986e-05 2020-11-16T20:56:47.547 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.547 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.547 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:47.547 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208381+0000", 2020-11-16T20:56:47.547 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0049810990000000001 2020-11-16T20:56:47.548 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.548 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.548 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:47.548 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.213362+0000", 2020-11-16T20:56:47.548 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3025999999999997e-05 2020-11-16T20:56:47.548 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.548 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.549 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:47.549 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.213415+0000", 2020-11-16T20:56:47.549 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052481979999999999 2020-11-16T20:56:47.549 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.549 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:47.549 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.549 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.549 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.550 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1490 3.0 e36/19 3:10845e0e:::smithi16641208-333:head v 36'252, mlcod=36'250)", 2020-11-16T20:56:47.550 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.301912+0000", 2020-11-16T20:56:47.550 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 51.175983905999999, 2020-11-16T20:56:47.550 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044835179999999997, 2020-11-16T20:56:47.550 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:47.550 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:47.550 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:47.551 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.551 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:47.551 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.301912+0000", 2020-11-16T20:56:47.551 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:47.551 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.551 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.551 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:47.551 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.301912+0000", 2020-11-16T20:56:47.552 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114265 2020-11-16T20:56:47.552 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.552 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.552 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:47.552 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302026+0000", 2020-11-16T20:56:47.552 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7940000000000008e-06 2020-11-16T20:56:47.552 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.552 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.553 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:47.553 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302035+0000", 2020-11-16T20:56:47.553 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5187e-05 2020-11-16T20:56:47.553 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.553 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.553 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:47.553 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302050+0000", 2020-11-16T20:56:47.554 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.653e-06 2020-11-16T20:56:47.554 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.554 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.554 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:47.554 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302059+0000", 2020-11-16T20:56:47.554 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8010000000000003e-05 2020-11-16T20:56:47.554 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.555 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.555 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:47.555 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302107+0000", 2020-11-16T20:56:47.555 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5335000000000001e-05 2020-11-16T20:56:47.555 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.555 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.555 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:47.555 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302132+0000", 2020-11-16T20:56:47.556 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042049239999999996 2020-11-16T20:56:47.556 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.556 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.556 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:47.556 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.306337+0000", 2020-11-16T20:56:47.556 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8350000000000002e-05 2020-11-16T20:56:47.556 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.556 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.557 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:47.557 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.306395+0000", 2020-11-16T20:56:47.557 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044835179999999997 2020-11-16T20:56:47.557 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.557 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:47.557 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.557 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.558 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.558 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:534 3.0 e46/19 3:10845e0e:::smithi16641208-333:5 v 46'391, mlcod=45'385)", 2020-11-16T20:56:47.558 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.013124+0000", 2020-11-16T20:56:47.558 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.464771333999998, 2020-11-16T20:56:47.558 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050053900000000002, 2020-11-16T20:56:47.558 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:47.558 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:47.558 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:47.559 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.559 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:47.559 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013124+0000", 2020-11-16T20:56:47.559 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:47.559 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.559 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.559 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:47.560 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013124+0000", 2020-11-16T20:56:47.560 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9255999999999997e-05 2020-11-16T20:56:47.560 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.560 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.560 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:47.560 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013174+0000", 2020-11-16T20:56:47.560 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5140000000000004e-06 2020-11-16T20:56:47.560 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.561 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.561 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:47.561 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013181+0000", 2020-11-16T20:56:47.561 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1279e-05 2020-11-16T20:56:47.561 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.561 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.561 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:47.562 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013192+0000", 2020-11-16T20:56:47.562 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0970000000000002e-06 2020-11-16T20:56:47.562 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.562 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.562 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:47.562 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013199+0000", 2020-11-16T20:56:47.562 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5442e-05 2020-11-16T20:56:47.562 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.563 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.563 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:47.563 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013284+0000", 2020-11-16T20:56:47.563 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8368e-05 2020-11-16T20:56:47.563 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.563 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.563 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:47.564 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013312+0000", 2020-11-16T20:56:47.564 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0047640549999999997 2020-11-16T20:56:47.564 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.564 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.564 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:47.564 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.018076+0000", 2020-11-16T20:56:47.564 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3378999999999998e-05 2020-11-16T20:56:47.564 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.565 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.565 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:47.565 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.018130+0000", 2020-11-16T20:56:47.565 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050053900000000002 2020-11-16T20:56:47.565 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.565 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:47.565 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.565 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.566 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.566 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:553 3.0 e51/19 3:0980614a:::smithi16641208-158:d v 51'399, mlcod=48'395)", 2020-11-16T20:56:47.566 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.036559+0000", 2020-11-16T20:56:47.566 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 33.441336272999997, 2020-11-16T20:56:47.566 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0057593829999999999, 2020-11-16T20:56:47.566 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:47.566 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:47.567 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:47.567 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.567 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:47.567 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036559+0000", 2020-11-16T20:56:47.567 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:47.567 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.567 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.567 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:47.568 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036559+0000", 2020-11-16T20:56:47.568 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3611000000000001e-05 2020-11-16T20:56:47.568 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.568 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.568 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:47.568 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036593+0000", 2020-11-16T20:56:47.568 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6789999999999996e-06 2020-11-16T20:56:47.569 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.569 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.569 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:47.569 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036598+0000", 2020-11-16T20:56:47.569 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1350000000000003e-06 2020-11-16T20:56:47.569 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.569 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.569 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:47.570 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036605+0000", 2020-11-16T20:56:47.570 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5200000000000003e-06 2020-11-16T20:56:47.570 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.570 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.570 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:47.570 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036611+0000", 2020-11-16T20:56:47.570 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1322000000000001e-05 2020-11-16T20:56:47.571 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.571 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.571 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:47.571 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036663+0000", 2020-11-16T20:56:47.571 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8333000000000001e-05 2020-11-16T20:56:47.571 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.571 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.572 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:47.572 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036691+0000", 2020-11-16T20:56:47.572 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0055720800000000001 2020-11-16T20:56:47.572 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.572 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.572 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:47.572 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.042263+0000", 2020-11-16T20:56:47.572 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5702999999999998e-05 2020-11-16T20:56:47.573 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.573 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.573 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:47.573 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.042319+0000", 2020-11-16T20:56:47.573 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0057593829999999999 2020-11-16T20:56:47.573 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.573 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:47.574 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.574 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.574 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.574 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:556 3.0 e51/19 3:03c93966:::smithi16641208-422:e v 51'401, mlcod=48'395)", 2020-11-16T20:56:47.574 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.037559+0000", 2020-11-16T20:56:47.574 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 33.440336569000003, 2020-11-16T20:56:47.574 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052553039999999997, 2020-11-16T20:56:47.574 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:47.575 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:47.575 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:47.575 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.575 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:47.575 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037559+0000", 2020-11-16T20:56:47.575 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:47.575 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.576 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.576 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:47.576 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037559+0000", 2020-11-16T20:56:47.576 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2685999999999998e-05 2020-11-16T20:56:47.576 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.576 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.576 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:47.576 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037592+0000", 2020-11-16T20:56:47.577 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1830000000000002e-06 2020-11-16T20:56:47.577 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.577 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.577 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:47.577 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037597+0000", 2020-11-16T20:56:47.577 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0809999999999996e-06 2020-11-16T20:56:47.577 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.577 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.578 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:47.578 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037604+0000", 2020-11-16T20:56:47.578 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.361e-06 2020-11-16T20:56:47.578 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.578 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.578 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:47.578 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037609+0000", 2020-11-16T20:56:47.579 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00041286099999999999 2020-11-16T20:56:47.579 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.579 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.579 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:47.579 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.038022+0000", 2020-11-16T20:56:47.579 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4833000000000001e-05 2020-11-16T20:56:47.579 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.579 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.580 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:47.580 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.038047+0000", 2020-11-16T20:56:47.580 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0047145110000000002 2020-11-16T20:56:47.580 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.580 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.580 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:47.580 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.042762+0000", 2020-11-16T20:56:47.581 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2787999999999997e-05 2020-11-16T20:56:47.581 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.581 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.581 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:47.581 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.042814+0000", 2020-11-16T20:56:47.581 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052553039999999997 2020-11-16T20:56:47.581 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.581 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:47.582 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.582 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.582 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.582 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:559 3.0 e52/19 3:0980614a:::smithi16641208-158:d v 52'405, mlcod=51'401)", 2020-11-16T20:56:47.582 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:15.014239+0000", 2020-11-16T20:56:47.582 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 32.463656696000001, 2020-11-16T20:56:47.582 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0060540699999999999, 2020-11-16T20:56:47.583 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:47.583 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:47.583 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:47.583 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.583 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:47.583 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014239+0000", 2020-11-16T20:56:47.583 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:47.583 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.584 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.584 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:47.584 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014239+0000", 2020-11-16T20:56:47.584 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1819000000000001e-05 2020-11-16T20:56:47.584 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.584 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.584 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:47.585 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014281+0000", 2020-11-16T20:56:47.585 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6719999999999998e-06 2020-11-16T20:56:47.585 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.585 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.585 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:47.585 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014288+0000", 2020-11-16T20:56:47.585 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0564000000000001e-05 2020-11-16T20:56:47.585 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.586 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.586 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:47.586 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014298+0000", 2020-11-16T20:56:47.586 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1902000000000001e-05 2020-11-16T20:56:47.586 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.586 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.586 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:47.587 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014310+0000", 2020-11-16T20:56:47.587 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4212999999999997e-05 2020-11-16T20:56:47.587 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.587 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.587 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:47.587 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014364+0000", 2020-11-16T20:56:47.587 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9425e-05 2020-11-16T20:56:47.587 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.588 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.588 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:47.588 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014394+0000", 2020-11-16T20:56:47.588 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0058527630000000004 2020-11-16T20:56:47.588 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.588 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.588 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:47.588 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.020246+0000", 2020-11-16T20:56:47.589 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6712000000000003e-05 2020-11-16T20:56:47.589 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.589 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.589 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:47.589 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.020293+0000", 2020-11-16T20:56:47.589 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0060540699999999999 2020-11-16T20:56:47.589 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.590 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:47.590 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.590 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.590 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.590 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:561 3.0 e52/19 3:03c93966:::smithi16641208-422:e v 52'407, mlcod=51'401)", 2020-11-16T20:56:47.590 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:15.015143+0000", 2020-11-16T20:56:47.590 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 32.462752475000002, 2020-11-16T20:56:47.590 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0073835719999999997, 2020-11-16T20:56:47.591 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:47.591 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:47.591 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:47.591 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.591 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:47.591 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015143+0000", 2020-11-16T20:56:47.591 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:47.591 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.592 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.592 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:47.592 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015143+0000", 2020-11-16T20:56:47.592 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4036999999999999e-05 2020-11-16T20:56:47.592 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.592 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.592 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:47.593 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015187+0000", 2020-11-16T20:56:47.593 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8350000000000004e-06 2020-11-16T20:56:47.593 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.593 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.593 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:47.593 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015195+0000", 2020-11-16T20:56:47.593 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1216999999999999e-05 2020-11-16T20:56:47.593 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.594 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.594 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:47.594 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015206+0000", 2020-11-16T20:56:47.594 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9390000000000002e-06 2020-11-16T20:56:47.594 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.594 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.594 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:47.595 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015212+0000", 2020-11-16T20:56:47.595 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.066e-05 2020-11-16T20:56:47.595 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.595 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.595 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:47.595 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015253+0000", 2020-11-16T20:56:47.595 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1534000000000001e-05 2020-11-16T20:56:47.595 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.596 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.596 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:47.596 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015274+0000", 2020-11-16T20:56:47.596 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0072086629999999997 2020-11-16T20:56:47.596 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.596 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.596 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:47.597 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.022483+0000", 2020-11-16T20:56:47.597 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3686999999999997e-05 2020-11-16T20:56:47.597 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.597 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.597 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:47.597 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.022527+0000", 2020-11-16T20:56:47.597 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0073835719999999997 2020-11-16T20:56:47.597 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.598 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:47.598 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.598 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.598 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.598 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2604 3.0 e57/19 3:2294fced:::smithi16641208-278:head v 57'440, mlcod=57'436)", 2020-11-16T20:56:47.598 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.930849+0000", 2020-11-16T20:56:47.598 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 27.54704671, 2020-11-16T20:56:47.599 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054406599999999999, 2020-11-16T20:56:47.599 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:47.599 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:47.599 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:47.599 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.599 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:47.599 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.930849+0000", 2020-11-16T20:56:47.599 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:47.600 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.600 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.600 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:47.600 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.930849+0000", 2020-11-16T20:56:47.600 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000849838 2020-11-16T20:56:47.600 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.600 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.601 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:47.601 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.931699+0000", 2020-11-16T20:56:47.601 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2410000000000001e-06 2020-11-16T20:56:47.601 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.601 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.601 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:47.601 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.931708+0000", 2020-11-16T20:56:47.601 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.764e-06 2020-11-16T20:56:47.602 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.602 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.602 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:47.602 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.931718+0000", 2020-11-16T20:56:47.602 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2930000000000003e-06 2020-11-16T20:56:47.602 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.602 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.603 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:47.603 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.931725+0000", 2020-11-16T20:56:47.603 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0489999999999999e-05 2020-11-16T20:56:47.603 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.603 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.603 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:47.603 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.931786+0000", 2020-11-16T20:56:47.603 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8841000000000001e-05 2020-11-16T20:56:47.604 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.604 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.604 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:47.604 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.931814+0000", 2020-11-16T20:56:47.604 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044240770000000002 2020-11-16T20:56:47.604 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.604 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.604 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:47.605 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.936239+0000", 2020-11-16T20:56:47.605 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1116000000000003e-05 2020-11-16T20:56:47.605 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.605 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.605 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:47.605 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.936290+0000", 2020-11-16T20:56:47.605 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054406599999999999 2020-11-16T20:56:47.606 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.606 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:47.606 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.606 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.606 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.606 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:725 3.0 e81/66 3:3297596a:::smithi16641208-146:2b v 81'540, mlcod=79'536)", 2020-11-16T20:56:47.606 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:43.785646+0000", 2020-11-16T20:56:47.607 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.6922492079999998, 2020-11-16T20:56:47.607 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041616179999999997, 2020-11-16T20:56:47.607 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:47.607 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:47.607 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:47.607 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.607 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:47.607 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:43.785646+0000", 2020-11-16T20:56:47.608 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:47.608 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.608 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.608 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:47.608 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:43.785646+0000", 2020-11-16T20:56:47.608 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2994000000000002e-05 2020-11-16T20:56:47.608 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.608 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.609 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:47.609 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:43.785689+0000", 2020-11-16T20:56:47.609 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7069999999999992e-06 2020-11-16T20:56:47.609 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.609 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.609 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:47.609 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:43.785697+0000", 2020-11-16T20:56:47.610 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0876999999999999e-05 2020-11-16T20:56:47.610 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.610 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.610 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:47.610 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:43.785708+0000", 2020-11-16T20:56:47.610 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.601e-06 2020-11-16T20:56:47.610 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.610 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.611 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:47.611 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:43.785715+0000", 2020-11-16T20:56:47.611 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034364600000000002 2020-11-16T20:56:47.611 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.611 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.611 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:47.611 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:43.786058+0000", 2020-11-16T20:56:47.612 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7617000000000001e-05 2020-11-16T20:56:47.612 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.612 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.612 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:47.612 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:43.786076+0000", 2020-11-16T20:56:47.612 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0036507419999999998 2020-11-16T20:56:47.612 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.613 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.613 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:47.613 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:43.789727+0000", 2020-11-16T20:56:47.613 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.1434000000000007e-05 2020-11-16T20:56:47.613 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.613 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.614 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:47.614 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:43.789808+0000", 2020-11-16T20:56:47.614 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041616179999999997 2020-11-16T20:56:47.614 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.614 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:47.614 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.614 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.615 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.615 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:730 3.0 e82/66 3:2294fced:::smithi16641208-278:14 v 82'546, mlcod=82'542)", 2020-11-16T20:56:47.615 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.758635+0000", 2020-11-16T20:56:47.615 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 2.7192602090000002, 2020-11-16T20:56:47.615 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061572399999999996, 2020-11-16T20:56:47.615 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:47.615 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:47.615 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:47.616 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.616 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:47.616 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.758635+0000", 2020-11-16T20:56:47.616 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:47.616 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.616 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.616 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:47.617 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.758635+0000", 2020-11-16T20:56:47.617 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4821999999999999e-05 2020-11-16T20:56:47.617 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.617 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.617 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:47.617 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.758680+0000", 2020-11-16T20:56:47.617 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.5219999999999996e-06 2020-11-16T20:56:47.617 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.618 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.618 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:47.618 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.758690+0000", 2020-11-16T20:56:47.618 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6467e-05 2020-11-16T20:56:47.618 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.618 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.618 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:47.619 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.758706+0000", 2020-11-16T20:56:47.619 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8881999999999999e-05 2020-11-16T20:56:47.619 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.619 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.619 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:47.619 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.758735+0000", 2020-11-16T20:56:47.619 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3925999999999997e-05 2020-11-16T20:56:47.619 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.620 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.620 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:47.620 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.758799+0000", 2020-11-16T20:56:47.620 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9947e-05 2020-11-16T20:56:47.620 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.620 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.620 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:47.621 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.758829+0000", 2020-11-16T20:56:47.621 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0058938139999999998 2020-11-16T20:56:47.621 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.621 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.621 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:47.621 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.764723+0000", 2020-11-16T20:56:47.621 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9859999999999999e-05 2020-11-16T20:56:47.621 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.622 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.622 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:47.622 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.764793+0000", 2020-11-16T20:56:47.622 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061572399999999996 2020-11-16T20:56:47.622 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.622 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:47.622 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.623 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.623 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.623 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:731 3.0 e82/66 3:26512967:::smithi16641208-466:23 v 82'548, mlcod=82'542)", 2020-11-16T20:56:47.623 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.759542+0000", 2020-11-16T20:56:47.623 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 2.7183538739999999, 2020-11-16T20:56:47.623 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0055834719999999999, 2020-11-16T20:56:47.623 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:47.623 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:47.624 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:47.624 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.624 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:47.624 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759542+0000", 2020-11-16T20:56:47.624 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:47.624 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.625 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.625 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:47.625 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759542+0000", 2020-11-16T20:56:47.625 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6737000000000002e-05 2020-11-16T20:56:47.625 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.625 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.625 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:47.625 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759569+0000", 2020-11-16T20:56:47.626 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0726e-05 2020-11-16T20:56:47.626 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.626 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.626 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:47.626 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759579+0000", 2020-11-16T20:56:47.626 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.117e-05 2020-11-16T20:56:47.626 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.627 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.627 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:47.627 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759590+0000", 2020-11-16T20:56:47.627 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8179999999999998e-06 2020-11-16T20:56:47.627 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.627 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.627 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:47.627 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759597+0000", 2020-11-16T20:56:47.628 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019832300000000001 2020-11-16T20:56:47.628 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.628 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.628 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:47.628 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759796+0000", 2020-11-16T20:56:47.628 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4968e-05 2020-11-16T20:56:47.628 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.629 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.629 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:47.629 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759841+0000", 2020-11-16T20:56:47.629 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052313209999999997 2020-11-16T20:56:47.629 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.629 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.629 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:47.630 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.765072+0000", 2020-11-16T20:56:47.630 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3409000000000003e-05 2020-11-16T20:56:47.630 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.630 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.630 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:47.630 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.765125+0000", 2020-11-16T20:56:47.630 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0055834719999999999 2020-11-16T20:56:47.630 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.631 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:47.631 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.631 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.631 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.631 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:740 3.0 e82/66 3:10c8e08d:::smithi16641208-23:1d v 82'554, mlcod=82'550)", 2020-11-16T20:56:47.631 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.790318+0000", 2020-11-16T20:56:47.631 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 2.6875780809999998, 2020-11-16T20:56:47.632 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0048854110000000001, 2020-11-16T20:56:47.632 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:47.632 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:47.632 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:47.632 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.632 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:47.632 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790318+0000", 2020-11-16T20:56:47.632 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:47.633 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.633 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.633 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:47.633 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790318+0000", 2020-11-16T20:56:47.633 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7818000000000002e-05 2020-11-16T20:56:47.633 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.633 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.634 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:47.634 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790365+0000", 2020-11-16T20:56:47.634 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3859999999999996e-06 2020-11-16T20:56:47.634 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.634 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.634 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:47.634 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790375+0000", 2020-11-16T20:56:47.634 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3345e-05 2020-11-16T20:56:47.635 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.635 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.635 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:47.635 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790388+0000", 2020-11-16T20:56:47.635 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8689999999999993e-06 2020-11-16T20:56:47.635 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.635 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.636 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:47.636 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790397+0000", 2020-11-16T20:56:47.636 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0379e-05 2020-11-16T20:56:47.636 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.636 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.636 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:47.636 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790447+0000", 2020-11-16T20:56:47.636 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3439000000000003e-05 2020-11-16T20:56:47.637 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.637 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.637 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:47.637 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790481+0000", 2020-11-16T20:56:47.637 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0046606199999999999 2020-11-16T20:56:47.637 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.637 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.637 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:47.638 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.795141+0000", 2020-11-16T20:56:47.638 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1555000000000003e-05 2020-11-16T20:56:47.638 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:47.638 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:47.638 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:47.638 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.795203+0000", 2020-11-16T20:56:47.638 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0048854110000000001 2020-11-16T20:56:47.639 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.639 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:47.639 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.639 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:47.639 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:47.639 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:47.641 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:56:47.642 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:56:47.642 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:56:47.642 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:56:47.642 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:56:47.642 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:56:47.642 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:56:47.643 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:56:47.643 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:56:47.643 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:56:47.643 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:56:47.643 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:56:47.643 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:56:47.643 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:56:47.644 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:47.645+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:47.742 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:47.747+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:47.791 INFO:tasks.rados.rados.0.smithi166.stdout:824: done (0 left) 2020-11-16T20:56:47.791 INFO:tasks.rados.rados.0.smithi166.stdout:825: snap_remove snap 24 2020-11-16T20:56:47.820 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:47.820 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:47.821 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:56:47.821 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:47.833 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:56:47.843 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:47.848+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:47.943 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:47.948+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:47.959 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:47.959 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:47.960 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:56:47.960 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:56:47.960 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:47.968 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:56:48.051 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:48.056+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:48.136 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:48.136 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:56:48.137 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:56:48.137 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:56:48.137 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.137 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:202 3.2 3:5723fd94:::smithi16641208-211:head [copy-from ver 110] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e35)", 2020-11-16T20:56:48.137 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:56:48.137 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 53.170670944999998, 2020-11-16T20:56:48.137 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027790216999999999, 2020-11-16T20:56:48.138 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:48.138 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.138 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:48.138 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.138 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:48.138 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:56:48.138 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:48.139 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.139 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.139 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:48.139 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:56:48.139 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1907999999999998e-05 2020-11-16T20:56:48.139 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.139 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.140 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:48.140 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969232+0000", 2020-11-16T20:56:48.140 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5270000000000004e-06 2020-11-16T20:56:48.140 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.140 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.140 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:48.140 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969239+0000", 2020-11-16T20:56:48.141 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3062e-05 2020-11-16T20:56:48.141 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.141 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.141 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:48.141 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969252+0000", 2020-11-16T20:56:48.141 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8919999999999997e-06 2020-11-16T20:56:48.141 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.142 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.142 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.142 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969258+0000", 2020-11-16T20:56:48.142 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00040859799999999998 2020-11-16T20:56:48.142 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.142 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.142 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.143 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969666+0000", 2020-11-16T20:56:48.143 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0932000000000003e-05 2020-11-16T20:56:48.143 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.143 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.143 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:48.143 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969757+0000", 2020-11-16T20:56:48.143 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010999395 2020-11-16T20:56:48.144 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.144 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.144 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:48.144 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.980757+0000", 2020-11-16T20:56:48.144 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006260659 2020-11-16T20:56:48.144 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.144 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.144 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:48.145 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987017+0000", 2020-11-16T20:56:48.145 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0080836880000000003 2020-11-16T20:56:48.145 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.145 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.145 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.145 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995101+0000", 2020-11-16T20:56:48.145 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001796829 2020-11-16T20:56:48.146 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.146 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.146 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.146 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996898+0000", 2020-11-16T20:56:48.146 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2086000000000003e-05 2020-11-16T20:56:48.146 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.146 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.147 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:48.147 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996940+0000", 2020-11-16T20:56:48.147 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0641e-05 2020-11-16T20:56:48.147 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.147 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.147 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:48.147 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996971+0000", 2020-11-16T20:56:48.147 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027790216999999999 2020-11-16T20:56:48.148 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.148 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:48.148 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.148 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.148 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.148 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:547 3.2 3:5f250a2b:::smithi16641208-75:head [copy-from ver 38] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:48.148 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:56:48.149 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 43.122283641999999, 2020-11-16T20:56:48.149 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027400430999999999, 2020-11-16T20:56:48.149 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:48.149 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.149 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:48.149 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.149 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:48.149 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:56:48.150 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:48.150 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.150 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.150 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:48.150 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:56:48.150 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5093999999999999e-05 2020-11-16T20:56:48.150 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.151 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.151 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:48.151 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017613+0000", 2020-11-16T20:56:48.151 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6150000000000003e-06 2020-11-16T20:56:48.151 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.151 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.151 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:48.152 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017623+0000", 2020-11-16T20:56:48.152 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6934000000000001e-05 2020-11-16T20:56:48.152 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.152 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.152 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:48.152 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017639+0000", 2020-11-16T20:56:48.152 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1892000000000001e-05 2020-11-16T20:56:48.152 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.153 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.153 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.153 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017651+0000", 2020-11-16T20:56:48.153 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2955999999999998e-05 2020-11-16T20:56:48.153 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.153 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.153 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.154 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017714+0000", 2020-11-16T20:56:48.154 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019352400000000001 2020-11-16T20:56:48.154 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.154 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.154 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:48.154 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017908+0000", 2020-11-16T20:56:48.154 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0073901349999999999 2020-11-16T20:56:48.154 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.155 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.155 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:48.155 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025298+0000", 2020-11-16T20:56:48.155 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0082133799999999993 2020-11-16T20:56:48.155 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.155 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.155 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:48.156 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033511+0000", 2020-11-16T20:56:48.156 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0074347629999999996 2020-11-16T20:56:48.156 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.156 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.156 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.156 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.040946+0000", 2020-11-16T20:56:48.156 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039404669999999996 2020-11-16T20:56:48.156 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.157 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.157 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.157 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044887+0000", 2020-11-16T20:56:48.157 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7098000000000002e-05 2020-11-16T20:56:48.157 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.157 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.157 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:48.158 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044934+0000", 2020-11-16T20:56:48.158 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4573000000000003e-05 2020-11-16T20:56:48.158 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.158 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.158 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:48.158 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044968+0000", 2020-11-16T20:56:48.158 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027400430999999999 2020-11-16T20:56:48.159 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.159 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:48.159 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.159 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.159 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.159 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:548 3.2 3:6173e90a:::smithi16641208-2:head [copy-from ver 3] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:48.159 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:56:48.160 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 43.122152309000001, 2020-11-16T20:56:48.160 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029556911000000002, 2020-11-16T20:56:48.160 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:48.160 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.160 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:48.160 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.160 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:48.161 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:56:48.161 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:48.161 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.161 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.161 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:48.161 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:56:48.161 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2478000000000002e-05 2020-11-16T20:56:48.161 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.162 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.162 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:48.162 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017742+0000", 2020-11-16T20:56:48.162 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3060000000000003e-06 2020-11-16T20:56:48.162 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.162 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.162 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:48.163 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017748+0000", 2020-11-16T20:56:48.163 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1102e-05 2020-11-16T20:56:48.163 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.163 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.163 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:48.163 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017759+0000", 2020-11-16T20:56:48.163 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.118e-06 2020-11-16T20:56:48.164 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.164 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.164 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.164 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017764+0000", 2020-11-16T20:56:48.164 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032233700000000001 2020-11-16T20:56:48.164 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.164 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.164 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.165 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.018086+0000", 2020-11-16T20:56:48.165 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000128374 2020-11-16T20:56:48.165 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.165 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.165 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:48.165 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.018215+0000", 2020-11-16T20:56:48.165 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012971355 2020-11-16T20:56:48.166 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.166 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.166 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:48.166 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.031186+0000", 2020-11-16T20:56:48.166 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044142890000000001 2020-11-16T20:56:48.166 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.166 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.167 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:48.167 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.035600+0000", 2020-11-16T20:56:48.167 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092372719999999995 2020-11-16T20:56:48.167 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.167 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.167 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.167 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044838+0000", 2020-11-16T20:56:48.167 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0023022049999999999 2020-11-16T20:56:48.168 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.168 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.168 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.168 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047140+0000", 2020-11-16T20:56:48.168 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0380999999999997e-05 2020-11-16T20:56:48.168 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.168 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.168 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:48.169 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047200+0000", 2020-11-16T20:56:48.169 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5693999999999999e-05 2020-11-16T20:56:48.169 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.169 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.169 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:48.169 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047256+0000", 2020-11-16T20:56:48.169 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029556911000000002 2020-11-16T20:56:48.170 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.170 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:48.170 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.170 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.170 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.170 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:554 3.2 3:769099fd:::smithi16641208-247:head [copy-from ver 123] snapc 1=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:48.170 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:56:48.171 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 43.089748991, 2020-11-16T20:56:48.171 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998, 2020-11-16T20:56:48.171 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:48.171 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.171 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:48.171 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.171 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:48.172 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:56:48.172 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:48.172 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.172 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.172 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:48.172 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:56:48.172 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6705999999999997e-05 2020-11-16T20:56:48.172 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.173 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.173 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:48.173 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050139+0000", 2020-11-16T20:56:48.173 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6199999999999998e-06 2020-11-16T20:56:48.173 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.173 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.173 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:48.174 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050144+0000", 2020-11-16T20:56:48.174 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.944e-06 2020-11-16T20:56:48.174 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.174 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.174 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:48.174 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050154+0000", 2020-11-16T20:56:48.174 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4043999999999999e-05 2020-11-16T20:56:48.174 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.175 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.175 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.175 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050178+0000", 2020-11-16T20:56:48.175 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078971409999999999 2020-11-16T20:56:48.175 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.175 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.175 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.176 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058075+0000", 2020-11-16T20:56:48.176 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012776500000000001 2020-11-16T20:56:48.176 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.176 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.176 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:48.176 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058203+0000", 2020-11-16T20:56:48.176 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011807013 2020-11-16T20:56:48.176 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.177 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.177 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:48.177 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070010+0000", 2020-11-16T20:56:48.177 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029522160000000001 2020-11-16T20:56:48.177 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.177 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.177 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:48.178 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.072962+0000", 2020-11-16T20:56:48.178 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017845006 2020-11-16T20:56:48.178 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.178 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.178 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.178 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.090807+0000", 2020-11-16T20:56:48.178 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.009301808 2020-11-16T20:56:48.178 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.179 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.179 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.179 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100109+0000", 2020-11-16T20:56:48.179 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7076999999999995e-05 2020-11-16T20:56:48.179 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.179 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.179 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:48.180 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100176+0000", 2020-11-16T20:56:48.180 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9790999999999999e-05 2020-11-16T20:56:48.180 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.180 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.180 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:48.180 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100216+0000", 2020-11-16T20:56:48.180 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998 2020-11-16T20:56:48.180 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.181 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:48.181 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.181 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.181 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.181 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:555 3.2 3:590e6edd:::smithi16641208-203:head [delete] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:48.181 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.076366+0000", 2020-11-16T20:56:48.181 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 43.063485133999997, 2020-11-16T20:56:48.182 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024009968, 2020-11-16T20:56:48.182 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:48.182 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.182 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:48.182 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.182 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:48.182 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076366+0000", 2020-11-16T20:56:48.183 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:48.183 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.183 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.183 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:48.183 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076366+0000", 2020-11-16T20:56:48.183 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2963999999999998e-05 2020-11-16T20:56:48.183 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.183 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.184 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:48.184 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076399+0000", 2020-11-16T20:56:48.184 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6879999999999999e-06 2020-11-16T20:56:48.184 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.184 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.184 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:48.184 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076407+0000", 2020-11-16T20:56:48.185 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4088999999999999e-05 2020-11-16T20:56:48.185 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.185 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.185 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:48.185 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076431+0000", 2020-11-16T20:56:48.185 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.4280000000000002e-06 2020-11-16T20:56:48.185 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.186 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.186 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.186 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076440+0000", 2020-11-16T20:56:48.186 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3467999999999998e-05 2020-11-16T20:56:48.186 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.186 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.186 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.186 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076484+0000", 2020-11-16T20:56:48.187 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011613 2020-11-16T20:56:48.187 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.187 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.187 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:48.187 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076600+0000", 2020-11-16T20:56:48.187 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8172999999999998e-05 2020-11-16T20:56:48.187 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.188 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.188 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:48.188 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076678+0000", 2020-11-16T20:56:48.188 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0009822749999999999 2020-11-16T20:56:48.188 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.188 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.188 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:48.189 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.077661+0000", 2020-11-16T20:56:48.189 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018605739999999999 2020-11-16T20:56:48.189 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.189 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.189 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.189 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.096266+0000", 2020-11-16T20:56:48.189 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039876709999999999 2020-11-16T20:56:48.189 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.190 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.190 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.190 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100254+0000", 2020-11-16T20:56:48.190 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4382999999999996e-05 2020-11-16T20:56:48.190 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.190 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.190 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:48.191 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100328+0000", 2020-11-16T20:56:48.191 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7958999999999999e-05 2020-11-16T20:56:48.191 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.191 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.191 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:48.191 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100376+0000", 2020-11-16T20:56:48.191 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024009968 2020-11-16T20:56:48.192 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.192 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:48.192 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.192 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.192 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.192 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:556 3.2 3:590e6edd:::smithi16641208-203:head [copy-from ver 105] snapc 1=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:48.192 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.076482+0000", 2020-11-16T20:56:48.192 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 43.063369684000001, 2020-11-16T20:56:48.193 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025150006999999999, 2020-11-16T20:56:48.193 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:48.193 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.193 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:48.193 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.193 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:48.193 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076482+0000", 2020-11-16T20:56:48.194 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:48.194 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.194 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.194 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:48.194 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076482+0000", 2020-11-16T20:56:48.194 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0086000000000006e-05 2020-11-16T20:56:48.194 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.195 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.195 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:48.195 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076552+0000", 2020-11-16T20:56:48.195 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7299999999999999e-06 2020-11-16T20:56:48.195 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.195 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.195 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:48.195 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076559+0000", 2020-11-16T20:56:48.196 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5905000000000001e-05 2020-11-16T20:56:48.196 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.196 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.196 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:48.196 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076574+0000", 2020-11-16T20:56:48.196 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9369999999999993e-06 2020-11-16T20:56:48.196 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.197 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.197 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.197 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.076583+0000", 2020-11-16T20:56:48.197 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00064848599999999998 2020-11-16T20:56:48.197 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.197 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.197 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.197 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.077232+0000", 2020-11-16T20:56:48.198 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8629999999999999e-05 2020-11-16T20:56:48.198 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.198 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.198 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:48.198 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.077291+0000", 2020-11-16T20:56:48.198 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003820773 2020-11-16T20:56:48.198 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.199 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.199 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:48.199 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.081111+0000", 2020-11-16T20:56:48.199 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033171849999999998 2020-11-16T20:56:48.199 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.199 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.199 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:48.199 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.084428+0000", 2020-11-16T20:56:48.200 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016400174 2020-11-16T20:56:48.200 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.200 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.200 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.200 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100829+0000", 2020-11-16T20:56:48.200 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00071628499999999999 2020-11-16T20:56:48.200 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.201 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.201 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.201 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.101545+0000", 2020-11-16T20:56:48.201 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7249e-05 2020-11-16T20:56:48.201 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.201 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.201 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:48.201 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.101602+0000", 2020-11-16T20:56:48.202 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9567e-05 2020-11-16T20:56:48.202 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.202 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.202 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:48.202 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.101632+0000", 2020-11-16T20:56:48.202 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025150006999999999 2020-11-16T20:56:48.202 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.203 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:48.203 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.203 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.203 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.203 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2429 4.0 4:3b92f709:::smithi16641208-69:head [rollback 7] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:56:48.203 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:56:48.203 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.123830728999998, 2020-11-16T20:56:48.203 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003, 2020-11-16T20:56:48.204 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:48.204 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.204 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:48.204 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:48.204 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:48.204 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2429 2020-11-16T20:56:48.204 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.205 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:48.205 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.205 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:48.205 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:56:48.205 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:48.205 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.205 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.205 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:48.206 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:56:48.206 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3710000000000002e-05 2020-11-16T20:56:48.206 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.206 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.206 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:48.206 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016044+0000", 2020-11-16T20:56:48.206 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7090000000000001e-06 2020-11-16T20:56:48.207 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.207 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.207 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:48.207 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016049+0000", 2020-11-16T20:56:48.207 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8820000000000003e-06 2020-11-16T20:56:48.207 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.207 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.208 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:48.208 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016056+0000", 2020-11-16T20:56:48.208 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.27e-06 2020-11-16T20:56:48.208 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.208 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.208 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.208 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016059+0000", 2020-11-16T20:56:48.208 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.537e-05 2020-11-16T20:56:48.209 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.209 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.209 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.209 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016115+0000", 2020-11-16T20:56:48.209 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8690000000000003e-06 2020-11-16T20:56:48.209 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.209 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.210 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:48.210 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016120+0000", 2020-11-16T20:56:48.210 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021405730000000002 2020-11-16T20:56:48.210 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.210 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.211 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.211 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018260+0000", 2020-11-16T20:56:48.211 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0137999999999999e-05 2020-11-16T20:56:48.211 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.211 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.211 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:48.212 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018320+0000", 2020-11-16T20:56:48.212 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011799352000000001 2020-11-16T20:56:48.212 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.212 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.212 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.212 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030120+0000", 2020-11-16T20:56:48.212 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000163139 2020-11-16T20:56:48.212 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.213 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.213 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:48.213 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030283+0000", 2020-11-16T20:56:48.213 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029657000000000002 2020-11-16T20:56:48.213 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.213 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.213 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:48.214 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030579+0000", 2020-11-16T20:56:48.214 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3058000000000001e-05 2020-11-16T20:56:48.214 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.214 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.214 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:48.214 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030612+0000", 2020-11-16T20:56:48.214 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0075168259999999999 2020-11-16T20:56:48.215 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.215 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.215 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.215 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038129+0000", 2020-11-16T20:56:48.215 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012914299999999999 2020-11-16T20:56:48.215 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.215 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.216 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:48.216 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038258+0000", 2020-11-16T20:56:48.216 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034292799999999999 2020-11-16T20:56:48.216 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.216 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.216 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:56:48.216 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038601+0000", 2020-11-16T20:56:48.216 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0025181159999999999 2020-11-16T20:56:48.217 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.217 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.217 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.217 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041119+0000", 2020-11-16T20:56:48.217 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2331999999999997e-05 2020-11-16T20:56:48.217 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.217 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.218 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for ondisk", 2020-11-16T20:56:48.218 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041202+0000", 2020-11-16T20:56:48.218 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028481750000000001 2020-11-16T20:56:48.218 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.218 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.218 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:48.219 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044050+0000", 2020-11-16T20:56:48.219 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001269921 2020-11-16T20:56:48.219 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.219 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.219 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.219 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045320+0000", 2020-11-16T20:56:48.219 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054215490000000003 2020-11-16T20:56:48.219 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.220 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.220 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.220 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050741+0000", 2020-11-16T20:56:48.220 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6981000000000001e-05 2020-11-16T20:56:48.220 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.220 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.220 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:48.221 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050808+0000", 2020-11-16T20:56:48.221 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8841e-05 2020-11-16T20:56:48.221 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.221 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.221 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:48.221 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050877+0000", 2020-11-16T20:56:48.221 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003 2020-11-16T20:56:48.221 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.222 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:48.222 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.222 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.222 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.222 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2430 4.0 4:3b92f709:::smithi16641208-69:head [append 0~0] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:56:48.222 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:56:48.222 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.123774406000003, 2020-11-16T20:56:48.223 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001, 2020-11-16T20:56:48.223 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:48.223 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.223 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:48.223 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:48.223 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:48.223 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2430 2020-11-16T20:56:48.224 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.224 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:48.224 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.224 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:48.224 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:56:48.224 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:48.224 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.224 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.225 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:48.225 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:56:48.225 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0857e-05 2020-11-16T20:56:48.225 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.225 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.225 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:48.225 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016098+0000", 2020-11-16T20:56:48.226 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9179999999999999e-06 2020-11-16T20:56:48.226 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.226 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.226 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:48.226 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016104+0000", 2020-11-16T20:56:48.226 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8230000000000006e-06 2020-11-16T20:56:48.226 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.226 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.227 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:48.227 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016114+0000", 2020-11-16T20:56:48.227 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2180000000000001e-06 2020-11-16T20:56:48.227 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.227 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.227 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.227 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016118+0000", 2020-11-16T20:56:48.228 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3547999999999995e-05 2020-11-16T20:56:48.228 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.228 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.228 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.228 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016181+0000", 2020-11-16T20:56:48.228 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8730000000000007e-06 2020-11-16T20:56:48.228 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.228 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.229 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:48.229 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016189+0000", 2020-11-16T20:56:48.229 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021577200000000001 2020-11-16T20:56:48.229 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.229 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.229 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.229 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018347+0000", 2020-11-16T20:56:48.230 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6832000000000001e-05 2020-11-16T20:56:48.230 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.230 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.230 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:48.230 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018404+0000", 2020-11-16T20:56:48.230 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012272913999999999 2020-11-16T20:56:48.230 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.231 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.231 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.231 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030677+0000", 2020-11-16T20:56:48.231 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2555000000000002e-05 2020-11-16T20:56:48.231 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.231 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.231 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:48.232 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030719+0000", 2020-11-16T20:56:48.232 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010518684 2020-11-16T20:56:48.232 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.232 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.232 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.232 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041238+0000", 2020-11-16T20:56:48.232 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000144723 2020-11-16T20:56:48.232 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.233 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.233 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:48.233 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041383+0000", 2020-11-16T20:56:48.233 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000214575 2020-11-16T20:56:48.233 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.233 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.233 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:56:48.234 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041597+0000", 2020-11-16T20:56:48.234 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002463196 2020-11-16T20:56:48.234 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.234 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.234 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:48.234 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044060+0000", 2020-11-16T20:56:48.234 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001654066 2020-11-16T20:56:48.234 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.235 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.235 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.235 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045715+0000", 2020-11-16T20:56:48.235 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053780599999999996 2020-11-16T20:56:48.235 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.235 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.235 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.236 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051093+0000", 2020-11-16T20:56:48.236 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8189999999999996e-05 2020-11-16T20:56:48.236 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.236 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.236 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:48.236 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051161+0000", 2020-11-16T20:56:48.236 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4910000000000001e-05 2020-11-16T20:56:48.236 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.237 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.237 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:48.237 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051216+0000", 2020-11-16T20:56:48.237 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001 2020-11-16T20:56:48.237 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.237 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:48.237 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.238 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.238 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.238 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "MOSDPGPush(4.1 52/51 [PushOp(4:9ab04c4a:::smithi16641208-1:head, version: 33'3, data_included: [0~892056,1542129~156520], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:9ab04c4a:::smithi16641208-1:head@33'3, size: 2016807, copy_subset: [0~2016807], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1698649, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:a1eef07d:::smithi16641208-13:head, version: 33'9, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:a1eef07d:::smithi16641208-13:head@33'9, size: 2201684, copy_subset: [0~2201684], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:929564f0:::smithi16641208-24:head, version: 33'18, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:929564f0:::smithi16641208-24:head@33'18, size: 2386561, copy_subset: [0~2386561], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b565f7d2:::smithi16641208-35:head, version: 33'27, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b565f7d2:::smithi16641208-35:head@33'27, size: 2571438, copy_subset: [0~2571438], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b6545a47:::smithi16641208-46:head, version: 33'29, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b6545a47:::smithi16641208-46:head@33'29, size: 2756315, copy_subset: [0~2756315], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:9bd9f31d:::smithi16641208-48:head, version: 33'35, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:9bd9f31d:::smithi16641208-48:head@33'35, size: 2789929, copy_subset: [0~2789929], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:83205103:::smithi16641208-103:head, version: 34'38, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:83205103:::smithi16641208-103:head@34'38, size: 3714314, copy_subset: [0~3714314], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:86a0a5b7:::smithi16641208-108:head, version: 34'42, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:86a0a5b7:::smithi16641208-108:head@34'42, size: 3798349, copy_subset: [0~3798349], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-16T20:56:48.238 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:56:48.238 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 33.369177800000003, 2020-11-16T20:56:48.238 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032552672999999997, 2020-11-16T20:56:48.239 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:48.239 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:48.239 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:48.239 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.239 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:48.239 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:56:48.239 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:48.240 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.240 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.240 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:48.240 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:56:48.240 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017498692999999999 2020-11-16T20:56:48.240 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.240 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.240 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:48.241 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788172+0000", 2020-11-16T20:56:48.241 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4147999999999999e-05 2020-11-16T20:56:48.241 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.241 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.241 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:48.241 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788206+0000", 2020-11-16T20:56:48.241 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0016000000000002e-05 2020-11-16T20:56:48.242 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.242 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.242 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:48.242 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788276+0000", 2020-11-16T20:56:48.242 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2172000000000002e-05 2020-11-16T20:56:48.242 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.242 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.242 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.243 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788319+0000", 2020-11-16T20:56:48.243 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000154337 2020-11-16T20:56:48.243 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.243 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.243 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.243 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788473+0000", 2020-11-16T20:56:48.243 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7690000000000002e-06 2020-11-16T20:56:48.244 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.244 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.244 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:48.244 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788482+0000", 2020-11-16T20:56:48.244 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014744538 2020-11-16T20:56:48.244 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.244 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.245 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:48.245 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803226+0000", 2020-11-16T20:56:48.245 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032552672999999997 2020-11-16T20:56:48.245 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.245 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:48.245 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.245 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.245 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.246 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.0:552 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'128, mlcod=0'0)", 2020-11-16T20:56:48.246 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:56:48.246 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 33.349212381999997, 2020-11-16T20:56:48.246 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038033168999999999, 2020-11-16T20:56:48.246 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:48.246 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.246 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:48.247 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.247 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:48.247 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:56:48.247 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:48.247 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.247 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.247 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:48.248 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:56:48.248 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0031023880000000002 2020-11-16T20:56:48.248 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.248 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.248 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:48.248 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793741+0000", 2020-11-16T20:56:48.248 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1496e-05 2020-11-16T20:56:48.248 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.249 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.249 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:48.249 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793753+0000", 2020-11-16T20:56:48.249 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9009999999999999e-05 2020-11-16T20:56:48.249 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.249 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.249 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:48.249 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793772+0000", 2020-11-16T20:56:48.250 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3318e-05 2020-11-16T20:56:48.250 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.250 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.250 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.250 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793785+0000", 2020-11-16T20:56:48.250 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012534775 2020-11-16T20:56:48.251 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.251 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.251 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.251 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806320+0000", 2020-11-16T20:56:48.251 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8144999999999999e-05 2020-11-16T20:56:48.251 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.251 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.251 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:48.252 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806348+0000", 2020-11-16T20:56:48.252 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022285688000000001 2020-11-16T20:56:48.252 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.252 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.252 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:48.252 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828634+0000", 2020-11-16T20:56:48.252 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8349000000000002e-05 2020-11-16T20:56:48.252 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.253 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.253 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:48.253 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828672+0000", 2020-11-16T20:56:48.253 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038033168999999999 2020-11-16T20:56:48.253 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.253 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:48.253 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.254 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.254 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.254 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2503 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'129, mlcod=0'0)", 2020-11-16T20:56:48.254 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:56:48.254 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 33.346024202000002, 2020-11-16T20:56:48.254 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034870998, 2020-11-16T20:56:48.254 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:48.254 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.255 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:48.255 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.255 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:48.255 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:56:48.255 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:48.255 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.255 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.256 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:48.256 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:56:48.256 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00093048899999999995 2020-11-16T20:56:48.256 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.256 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.256 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:48.256 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794758+0000", 2020-11-16T20:56:48.256 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.169e-05 2020-11-16T20:56:48.257 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.257 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.257 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:48.257 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794769+0000", 2020-11-16T20:56:48.257 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3998999999999999e-05 2020-11-16T20:56:48.257 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.257 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.258 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:48.258 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794783+0000", 2020-11-16T20:56:48.258 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.481e-06 2020-11-16T20:56:48.258 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.258 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.258 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.258 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794791+0000", 2020-11-16T20:56:48.258 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.02524036 2020-11-16T20:56:48.259 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.259 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.259 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.259 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820031+0000", 2020-11-16T20:56:48.259 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.811e-05 2020-11-16T20:56:48.259 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.260 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.260 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:48.260 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820059+0000", 2020-11-16T20:56:48.260 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.008614577 2020-11-16T20:56:48.260 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.260 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.260 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:48.260 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828674+0000", 2020-11-16T20:56:48.261 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4292000000000001e-05 2020-11-16T20:56:48.261 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.261 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.261 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:48.261 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828698+0000", 2020-11-16T20:56:48.261 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034870998 2020-11-16T20:56:48.261 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.262 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:48.262 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.262 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.262 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.262 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2504 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'130, mlcod=0'0)", 2020-11-16T20:56:48.262 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:56:48.262 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 33.345018520000004, 2020-11-16T20:56:48.263 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033888776000000002, 2020-11-16T20:56:48.263 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:48.263 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.263 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:48.263 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.263 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:48.263 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:56:48.263 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:48.264 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.264 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.264 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:48.264 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:56:48.264 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3896999999999997e-05 2020-11-16T20:56:48.264 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.264 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.265 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:48.265 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794877+0000", 2020-11-16T20:56:48.265 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7019999999999998e-06 2020-11-16T20:56:48.265 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.265 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.265 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:48.265 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794883+0000", 2020-11-16T20:56:48.265 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.789e-06 2020-11-16T20:56:48.266 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.266 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.266 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:48.266 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794888+0000", 2020-11-16T20:56:48.266 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.852e-06 2020-11-16T20:56:48.266 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.266 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.267 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.267 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794891+0000", 2020-11-16T20:56:48.267 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026152822999999999 2020-11-16T20:56:48.267 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.267 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.267 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.267 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.821044+0000", 2020-11-16T20:56:48.268 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6900999999999999e-05 2020-11-16T20:56:48.268 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.268 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.268 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:48.268 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.821071+0000", 2020-11-16T20:56:48.268 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0076283210000000004 2020-11-16T20:56:48.268 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.269 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.269 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:48.269 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828699+0000", 2020-11-16T20:56:48.269 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2490999999999999e-05 2020-11-16T20:56:48.269 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.269 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.269 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:48.269 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828722+0000", 2020-11-16T20:56:48.270 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033888776000000002 2020-11-16T20:56:48.270 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.270 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:48.270 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.270 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.270 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.271 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.13:681 3.1 e52/19 3:afc69464:::smithi16641208-110:head v 52'546, mlcod=52'544)", 2020-11-16T20:56:48.271 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:56:48.271 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 33.342358449999999, 2020-11-16T20:56:48.271 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.03113606, 2020-11-16T20:56:48.271 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:48.271 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.271 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:48.271 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.272 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:48.272 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:56:48.272 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:48.272 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.272 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.272 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:48.272 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:56:48.273 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0026681809999999999 2020-11-16T20:56:48.273 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.273 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.273 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:48.273 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800161+0000", 2020-11-16T20:56:48.273 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3499000000000001e-05 2020-11-16T20:56:48.273 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.273 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.274 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:48.274 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800175+0000", 2020-11-16T20:56:48.274 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8301999999999999e-05 2020-11-16T20:56:48.274 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.274 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.274 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:48.274 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800193+0000", 2020-11-16T20:56:48.275 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0465999999999999e-05 2020-11-16T20:56:48.275 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.275 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.275 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.275 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800203+0000", 2020-11-16T20:56:48.275 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061432479999999996 2020-11-16T20:56:48.275 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.275 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.276 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.276 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806347+0000", 2020-11-16T20:56:48.276 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.641e-05 2020-11-16T20:56:48.276 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.276 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.276 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:48.276 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806373+0000", 2020-11-16T20:56:48.277 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022190887999999999 2020-11-16T20:56:48.277 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.277 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.277 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:48.277 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828564+0000", 2020-11-16T20:56:48.277 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5066000000000003e-05 2020-11-16T20:56:48.277 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.278 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.278 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:48.278 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828629+0000", 2020-11-16T20:56:48.278 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.03113606 2020-11-16T20:56:48.278 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.278 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:48.278 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.278 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.279 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.279 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.13:682 3.1 e52/19 3:b3ae2c4d:::smithi16641208-463:head v 52'547, mlcod=52'544)", 2020-11-16T20:56:48.279 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.802222+0000", 2020-11-16T20:56:48.279 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 33.337629546000002, 2020-11-16T20:56:48.279 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026721733000000001, 2020-11-16T20:56:48.279 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:48.279 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.280 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:48.280 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.280 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:48.280 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.802222+0000", 2020-11-16T20:56:48.280 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:48.280 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.280 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.280 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:48.281 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.802222+0000", 2020-11-16T20:56:48.281 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001333442 2020-11-16T20:56:48.281 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.281 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.281 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:48.281 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803555+0000", 2020-11-16T20:56:48.281 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0971999999999999e-05 2020-11-16T20:56:48.282 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.282 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.282 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:48.282 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803566+0000", 2020-11-16T20:56:48.282 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5973000000000001e-05 2020-11-16T20:56:48.282 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.282 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.282 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:48.283 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803582+0000", 2020-11-16T20:56:48.283 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2969999999999998e-06 2020-11-16T20:56:48.283 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.283 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.283 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.283 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803590+0000", 2020-11-16T20:56:48.283 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016424259 2020-11-16T20:56:48.284 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.284 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.284 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.284 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820014+0000", 2020-11-16T20:56:48.284 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9485999999999999e-05 2020-11-16T20:56:48.284 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.284 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.284 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:48.285 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820033+0000", 2020-11-16T20:56:48.285 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0088553179999999992 2020-11-16T20:56:48.285 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.285 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.285 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:48.285 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828889+0000", 2020-11-16T20:56:48.285 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4985999999999998e-05 2020-11-16T20:56:48.286 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.286 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.286 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:48.286 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828944+0000", 2020-11-16T20:56:48.286 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026721733000000001 2020-11-16T20:56:48.286 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.286 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:48.286 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.287 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.287 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.287 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:602 3.2 3:5a2aa7df:::smithi16641208-248:head [copy-from ver 124] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:56:48.287 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.751134+0000", 2020-11-16T20:56:48.287 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 28.388717042, 2020-11-16T20:56:48.287 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026671776000000001, 2020-11-16T20:56:48.287 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:48.288 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.288 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:48.288 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.288 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:48.288 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751134+0000", 2020-11-16T20:56:48.288 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:48.288 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.288 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.289 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:48.289 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751134+0000", 2020-11-16T20:56:48.289 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2177e-05 2020-11-16T20:56:48.289 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.289 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.289 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:48.289 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751177+0000", 2020-11-16T20:56:48.290 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8199999999999999e-06 2020-11-16T20:56:48.290 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.290 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.290 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:48.290 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751183+0000", 2020-11-16T20:56:48.290 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3193999999999999e-05 2020-11-16T20:56:48.290 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.291 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.291 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:48.291 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751197+0000", 2020-11-16T20:56:48.291 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.823e-06 2020-11-16T20:56:48.291 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.291 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.291 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.292 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751202+0000", 2020-11-16T20:56:48.292 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3791000000000001e-05 2020-11-16T20:56:48.292 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.292 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.292 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.292 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751246+0000", 2020-11-16T20:56:48.292 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019541200000000001 2020-11-16T20:56:48.292 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.293 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.293 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:48.293 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751442+0000", 2020-11-16T20:56:48.293 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0098138649999999997 2020-11-16T20:56:48.293 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.293 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.293 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:48.293 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.761255+0000", 2020-11-16T20:56:48.294 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0093475569999999994 2020-11-16T20:56:48.294 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.294 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.294 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:48.294 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770603+0000", 2020-11-16T20:56:48.294 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053967829999999996 2020-11-16T20:56:48.294 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.295 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.295 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.295 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.776000+0000", 2020-11-16T20:56:48.295 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001679687 2020-11-16T20:56:48.295 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.295 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.295 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.295 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.777680+0000", 2020-11-16T20:56:48.296 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5221000000000005e-05 2020-11-16T20:56:48.296 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.296 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.296 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:48.296 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.777745+0000", 2020-11-16T20:56:48.296 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1445999999999994e-05 2020-11-16T20:56:48.296 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.297 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.297 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:48.297 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.777806+0000", 2020-11-16T20:56:48.297 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026671776000000001 2020-11-16T20:56:48.297 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.297 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:48.297 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.297 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.298 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.298 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:603 3.2 3:5a2e7c26:::smithi16641208-130:head [copy-from ver 67] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:56:48.298 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:56:48.298 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 28.388610455999999, 2020-11-16T20:56:48.298 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036631116999999998, 2020-11-16T20:56:48.298 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:48.298 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.299 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:48.299 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.299 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:48.299 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:56:48.299 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:48.299 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.299 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.300 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:48.300 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:56:48.300 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9854000000000002e-05 2020-11-16T20:56:48.300 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.300 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.300 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:48.300 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751281+0000", 2020-11-16T20:56:48.300 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1840000000000004e-06 2020-11-16T20:56:48.301 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.301 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.301 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:48.301 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751287+0000", 2020-11-16T20:56:48.301 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0231000000000001e-05 2020-11-16T20:56:48.301 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.301 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.302 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:48.302 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751297+0000", 2020-11-16T20:56:48.302 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.639e-06 2020-11-16T20:56:48.302 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.302 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.302 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.302 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751302+0000", 2020-11-16T20:56:48.302 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030012000000000002 2020-11-16T20:56:48.303 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.303 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.303 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.303 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751602+0000", 2020-11-16T20:56:48.303 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013830200000000001 2020-11-16T20:56:48.303 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.303 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.304 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:48.304 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751740+0000", 2020-11-16T20:56:48.304 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019538969999999999 2020-11-16T20:56:48.304 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.304 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.304 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:48.304 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771279+0000", 2020-11-16T20:56:48.305 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007630403 2020-11-16T20:56:48.305 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.305 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.305 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:48.305 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.778910+0000", 2020-11-16T20:56:48.305 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0065002009999999997 2020-11-16T20:56:48.305 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.306 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.306 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.306 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.785410+0000", 2020-11-16T20:56:48.306 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0023914140000000001 2020-11-16T20:56:48.306 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.306 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.307 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.307 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787801+0000", 2020-11-16T20:56:48.307 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9629999999999998e-05 2020-11-16T20:56:48.307 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.307 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.307 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:48.307 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787841+0000", 2020-11-16T20:56:48.308 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1168999999999999e-05 2020-11-16T20:56:48.308 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.308 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.308 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:48.308 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787872+0000", 2020-11-16T20:56:48.308 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036631116999999998 2020-11-16T20:56:48.308 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.309 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:48.309 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.309 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.309 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.309 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:609 3.2 3:5eead97c:::smithi16641208-34:head [copy-from ver 27] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:56:48.309 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:56:48.309 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 28.350813327000001, 2020-11-16T20:56:48.309 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.062626424, 2020-11-16T20:56:48.310 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:48.310 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.310 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:48.310 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.310 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:48.310 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:56:48.310 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:48.311 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.311 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.311 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:48.311 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:56:48.311 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3596000000000001e-05 2020-11-16T20:56:48.311 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.311 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.311 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:48.312 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789082+0000", 2020-11-16T20:56:48.312 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3209999999999999e-06 2020-11-16T20:56:48.312 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.312 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.312 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:48.312 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789089+0000", 2020-11-16T20:56:48.312 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3498e-05 2020-11-16T20:56:48.313 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.313 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:48.313 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789103+0000", 2020-11-16T20:56:48.313 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3679999999999998e-06 2020-11-16T20:56:48.313 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.313 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.314 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789109+0000", 2020-11-16T20:56:48.314 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007399638 2020-11-16T20:56:48.314 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.314 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.314 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.314 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.796509+0000", 2020-11-16T20:56:48.314 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000181168 2020-11-16T20:56:48.315 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.315 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.315 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:48.315 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.796690+0000", 2020-11-16T20:56:48.315 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01336562 2020-11-16T20:56:48.315 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.315 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.315 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:48.316 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.810055+0000", 2020-11-16T20:56:48.316 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044828350000000001 2020-11-16T20:56:48.316 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.316 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.316 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:48.316 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.814538+0000", 2020-11-16T20:56:48.316 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035609628999999997 2020-11-16T20:56:48.317 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.317 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.317 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.317 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850148+0000", 2020-11-16T20:56:48.317 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0013754730000000001 2020-11-16T20:56:48.317 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.317 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.317 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.318 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851523+0000", 2020-11-16T20:56:48.318 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9935e-05 2020-11-16T20:56:48.318 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.318 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.318 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:48.318 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851603+0000", 2020-11-16T20:56:48.318 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1342999999999999e-05 2020-11-16T20:56:48.319 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.319 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.319 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:48.319 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851665+0000", 2020-11-16T20:56:48.319 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.062626424 2020-11-16T20:56:48.319 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.319 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:48.320 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.320 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.320 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.320 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2605 4.0 4:2294fced:::smithi16641208-278:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:56:48.320 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:56:48.320 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 28.222978211000001, 2020-11-16T20:56:48.320 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032301128999999998, 2020-11-16T20:56:48.321 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:48.321 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:48.321 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:48.321 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:48.321 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:48.321 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2605 2020-11-16T20:56:48.321 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.321 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:48.322 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.322 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:48.322 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:56:48.322 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:48.322 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.322 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.322 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:48.323 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:56:48.323 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.811e-05 2020-11-16T20:56:48.323 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.323 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.323 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:48.323 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916901+0000", 2020-11-16T20:56:48.323 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2939999999999996e-06 2020-11-16T20:56:48.324 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.324 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.324 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:48.324 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916907+0000", 2020-11-16T20:56:48.324 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0589e-05 2020-11-16T20:56:48.324 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.324 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.324 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:48.325 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916917+0000", 2020-11-16T20:56:48.325 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2549999999999999e-06 2020-11-16T20:56:48.325 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.325 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.325 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.325 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916921+0000", 2020-11-16T20:56:48.325 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033789099999999999 2020-11-16T20:56:48.326 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.326 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.326 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.326 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.917259+0000", 2020-11-16T20:56:48.326 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.25e-05 2020-11-16T20:56:48.326 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.326 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.326 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:48.327 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.917332+0000", 2020-11-16T20:56:48.327 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.028336376999999999 2020-11-16T20:56:48.327 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.327 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.327 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.327 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.945668+0000", 2020-11-16T20:56:48.327 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0983000000000006e-05 2020-11-16T20:56:48.328 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.328 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.328 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:48.328 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.945759+0000", 2020-11-16T20:56:48.328 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00324756 2020-11-16T20:56:48.328 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.328 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.328 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.329 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949007+0000", 2020-11-16T20:56:48.329 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0583999999999999e-05 2020-11-16T20:56:48.329 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.329 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.329 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:48.329 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949097+0000", 2020-11-16T20:56:48.329 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6985999999999998e-05 2020-11-16T20:56:48.330 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.330 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.330 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:48.330 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949174+0000", 2020-11-16T20:56:48.330 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032301128999999998 2020-11-16T20:56:48.330 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.330 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:48.331 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.331 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.331 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.331 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2874 4.0 4:055e14cb:::smithi16641208-187:head [copy-from ver 402] snapc 25=[25,23,21,f] ondisk+write+known_if_redirected e72)", 2020-11-16T20:56:48.331 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:56:48.331 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 13.394454541, 2020-11-16T20:56:48.331 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031663616999999998, 2020-11-16T20:56:48.332 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:48.332 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.332 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:48.332 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:48.332 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:48.332 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2874 2020-11-16T20:56:48.332 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.332 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:48.333 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.333 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:48.333 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:56:48.333 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:48.333 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.333 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.333 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:48.334 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:56:48.334 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6754000000000001e-05 2020-11-16T20:56:48.334 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.334 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.334 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:48.334 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745434+0000", 2020-11-16T20:56:48.334 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5049999999999998e-06 2020-11-16T20:56:48.335 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:48.335 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745439+0000", 2020-11-16T20:56:48.335 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0803e-05 2020-11-16T20:56:48.335 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:48.336 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745450+0000", 2020-11-16T20:56:48.336 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8810000000000004e-06 2020-11-16T20:56:48.336 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.336 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.336 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.336 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745455+0000", 2020-11-16T20:56:48.336 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022866499999999999 2020-11-16T20:56:48.337 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.337 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.337 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.337 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745684+0000", 2020-11-16T20:56:48.337 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000132714 2020-11-16T20:56:48.337 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.337 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.338 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:48.338 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745816+0000", 2020-11-16T20:56:48.338 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050117850000000004 2020-11-16T20:56:48.338 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.338 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.338 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:56:48.338 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.750828+0000", 2020-11-16T20:56:48.339 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010413489 2020-11-16T20:56:48.339 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.339 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.339 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:48.339 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.761241+0000", 2020-11-16T20:56:48.339 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028274289999999998 2020-11-16T20:56:48.339 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.339 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.340 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.340 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.764069+0000", 2020-11-16T20:56:48.340 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012880057 2020-11-16T20:56:48.340 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.340 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.340 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.340 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.776949+0000", 2020-11-16T20:56:48.341 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2536e-05 2020-11-16T20:56:48.341 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.341 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.341 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:48.341 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777002+0000", 2020-11-16T20:56:48.341 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8999000000000002e-05 2020-11-16T20:56:48.341 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.341 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.342 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:48.342 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777061+0000", 2020-11-16T20:56:48.342 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031663616999999998 2020-11-16T20:56:48.342 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.342 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:48.342 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.342 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.343 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.343 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2875 4.0 4:055e14cb:::smithi16641208-187:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-11-16T20:56:48.343 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:56:48.343 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 13.394365315, 2020-11-16T20:56:48.343 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031888061000000002, 2020-11-16T20:56:48.343 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:48.343 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:48.344 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:48.344 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:48.344 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:48.344 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2875 2020-11-16T20:56:48.344 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.344 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:48.344 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.344 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:48.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:56:48.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:48.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.345 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.345 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:48.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:56:48.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0239000000000001e-05 2020-11-16T20:56:48.346 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.346 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.346 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:48.346 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745506+0000", 2020-11-16T20:56:48.346 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.252e-06 2020-11-16T20:56:48.346 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.346 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.347 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:48.347 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745510+0000", 2020-11-16T20:56:48.347 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3670000000000002e-06 2020-11-16T20:56:48.347 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.347 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.347 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:48.347 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745516+0000", 2020-11-16T20:56:48.347 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1089999999999998e-06 2020-11-16T20:56:48.348 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.348 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.348 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.348 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745519+0000", 2020-11-16T20:56:48.348 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045188999999999998 2020-11-16T20:56:48.348 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.348 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.348 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.349 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745971+0000", 2020-11-16T20:56:48.349 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7822999999999998e-05 2020-11-16T20:56:48.349 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.349 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.349 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:48.349 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.746029+0000", 2020-11-16T20:56:48.349 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013333563999999999 2020-11-16T20:56:48.350 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.350 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.350 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.759362+0000", 2020-11-16T20:56:48.350 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000170896 2020-11-16T20:56:48.350 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.351 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:48.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.759533+0000", 2020-11-16T20:56:48.351 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017572878 2020-11-16T20:56:48.351 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.351 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.351 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:48.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777106+0000", 2020-11-16T20:56:48.352 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014436399999999999 2020-11-16T20:56:48.352 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.352 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:48.352 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777251+0000", 2020-11-16T20:56:48.352 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012367899999999999 2020-11-16T20:56:48.352 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:48.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:48.353 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:48.353 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777374+0000", 2020-11-16T20:56:48.353 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031888061000000002 2020-11-16T20:56:48.353 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.353 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:48.353 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.353 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:48.353 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:48.354 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:48.355 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:56:48.356 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:48.359+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:48.456 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:48.461+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:48.502 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:48.503 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:48.503 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:56:48.503 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:48.512 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:56:48.556 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:48.561+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:48.647 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:48.647 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:48.647 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:56:48.648 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:56:48.648 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:48.657 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:56:48.657 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:48.661+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:48.757 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:48.762+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:48.790 INFO:tasks.rados.rados.0.smithi166.stdout:825: done (0 left) 2020-11-16T20:56:48.791 INFO:tasks.rados.rados.0.smithi166.stdout:826: write (excl) oid 329 current snap is 25 2020-11-16T20:56:48.791 INFO:tasks.rados.rados.0.smithi166.stdout:826: seq_num 582 ranges {581674=637746,1840873=558854,3066417=537135} 2020-11-16T20:56:48.794 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:56:48.794 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:56:48.795 INFO:tasks.thrashosds.thrasher:fixing pg num pool device_health_metrics 2020-11-16T20:56:48.795 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-16T20:56:48.797 INFO:tasks.rados.rados.0.smithi166.stdout:826: writing smithi16641208-329 from 581674 to 1219420 tid 1 2020-11-16T20:56:48.802 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2020-11-16T20:56:48.804 INFO:tasks.rados.rados.0.smithi166.stdout:826: writing smithi16641208-329 from 1840873 to 2399727 tid 2 2020-11-16T20:56:48.811 INFO:tasks.rados.rados.0.smithi166.stdout:826: writing smithi16641208-329 from 3066417 to 3603552 tid 3 2020-11-16T20:56:48.811 INFO:tasks.rados.rados.0.smithi166.stdout:827: write (excl) oid 386 current snap is 25 2020-11-16T20:56:48.811 INFO:tasks.rados.rados.0.smithi166.stdout:827: seq_num 583 ranges {598481=712995,1899355=418865,3093840=704641} 2020-11-16T20:56:48.818 INFO:tasks.rados.rados.0.smithi166.stdout:827: writing smithi16641208-386 from 598481 to 1311476 tid 1 2020-11-16T20:56:48.824 INFO:tasks.rados.rados.0.smithi166.stdout:827: writing smithi16641208-386 from 1899355 to 2318220 tid 2 2020-11-16T20:56:48.835 INFO:tasks.rados.rados.0.smithi166.stdout:827: writing smithi16641208-386 from 3093840 to 3798481 tid 3 2020-11-16T20:56:48.836 INFO:tasks.rados.rados.0.smithi166.stdout:828: rollback oid 359 current snap is 25 2020-11-16T20:56:48.836 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 359 to 19 2020-11-16T20:56:48.836 INFO:tasks.rados.rados.0.smithi166.stdout:829: cache_evict oid 399 snap -1 2020-11-16T20:56:48.836 INFO:tasks.rados.rados.0.smithi166.stdout:830: rollback oid 76 current snap is 25 2020-11-16T20:56:48.836 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 76 to 19 2020-11-16T20:56:48.836 INFO:tasks.rados.rados.0.smithi166.stdout:831: copy_from oid 361 from oid 340 current snap is 25 2020-11-16T20:56:48.836 INFO:tasks.rados.rados.0.smithi166.stdout:832: cache_evict oid 405 snap 19 2020-11-16T20:56:48.837 INFO:tasks.rados.rados.0.smithi166.stdout:833: snap_create 2020-11-16T20:56:48.837 INFO:tasks.rados.rados.0.smithi166.stdout:832: got (2) No such file or directory 2020-11-16T20:56:48.838 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:48.838 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:56:48.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:56:48.839 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:56:48.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.839 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2370 4.1 4:82bb0fe7:::smithi16641208-101:head [write 2346424~426830] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:48.839 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:56:48.839 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.78426769, 2020-11-16T20:56:48.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04706581, 2020-11-16T20:56:48.839 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:48.840 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.840 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:48.840 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:48.840 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:48.840 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2370 2020-11-16T20:56:48.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.840 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:48.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:48.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:56:48.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:48.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:48.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:56:48.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011081520000000001 2020-11-16T20:56:48.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:48.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055391+0000", 2020-11-16T20:56:48.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8289999999999996e-06 2020-11-16T20:56:48.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:48.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055397+0000", 2020-11-16T20:56:48.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7599999999999997e-06 2020-11-16T20:56:48.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:48.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055407+0000", 2020-11-16T20:56:48.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4180000000000002e-06 2020-11-16T20:56:48.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055413+0000", 2020-11-16T20:56:48.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1767000000000001e-05 2020-11-16T20:56:48.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055465+0000", 2020-11-16T20:56:48.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1916999999999998e-05 2020-11-16T20:56:48.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:48.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055517+0000", 2020-11-16T20:56:48.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027302192999999999 2020-11-16T20:56:48.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.082819+0000", 2020-11-16T20:56:48.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013272199999999999 2020-11-16T20:56:48.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:48.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.082952+0000", 2020-11-16T20:56:48.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000218574 2020-11-16T20:56:48.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:48.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083171+0000", 2020-11-16T20:56:48.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016037374 2020-11-16T20:56:48.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:48.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099208+0000", 2020-11-16T20:56:48.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001621248 2020-11-16T20:56:48.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100829+0000", 2020-11-16T20:56:48.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039884700000000003 2020-11-16T20:56:48.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101228+0000", 2020-11-16T20:56:48.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1977000000000006e-05 2020-11-16T20:56:48.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:48.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101300+0000", 2020-11-16T20:56:48.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9032000000000001e-05 2020-11-16T20:56:48.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:48.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101349+0000", 2020-11-16T20:56:48.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04706581 2020-11-16T20:56:48.852 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.852 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:48.852 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.852 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2371 4.1 4:82bb0fe7:::smithi16641208-101:head [setxattr _header (57) in=7b,truncate 2773254] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:48.853 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.055441+0000", 2020-11-16T20:56:48.853 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.783109773, 2020-11-16T20:56:48.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046178253000000002, 2020-11-16T20:56:48.853 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:48.853 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.853 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:48.853 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:48.854 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:48.854 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2371 2020-11-16T20:56:48.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.854 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:48.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:48.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055441+0000", 2020-11-16T20:56:48.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:48.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:48.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055441+0000", 2020-11-16T20:56:48.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4688999999999999e-05 2020-11-16T20:56:48.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:48.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055476+0000", 2020-11-16T20:56:48.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8220000000000003e-06 2020-11-16T20:56:48.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:48.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055482+0000", 2020-11-16T20:56:48.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0340000000000002e-06 2020-11-16T20:56:48.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:48.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055488+0000", 2020-11-16T20:56:48.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.49e-06 2020-11-16T20:56:48.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055491+0000", 2020-11-16T20:56:48.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6255999999999998e-05 2020-11-16T20:56:48.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055547+0000", 2020-11-16T20:56:48.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6068000000000005e-05 2020-11-16T20:56:48.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:48.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055614+0000", 2020-11-16T20:56:48.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.028667674000000001 2020-11-16T20:56:48.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084281+0000", 2020-11-16T20:56:48.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000104868 2020-11-16T20:56:48.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:48.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084386+0000", 2020-11-16T20:56:48.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015165799999999999 2020-11-16T20:56:48.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:48.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084538+0000", 2020-11-16T20:56:48.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014678207 2020-11-16T20:56:48.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:48.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099216+0000", 2020-11-16T20:56:48.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0016622550000000001 2020-11-16T20:56:48.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100878+0000", 2020-11-16T20:56:48.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00061087000000000001 2020-11-16T20:56:48.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101489+0000", 2020-11-16T20:56:48.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0320000000000004e-05 2020-11-16T20:56:48.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:48.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101559+0000", 2020-11-16T20:56:48.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0041999999999999e-05 2020-11-16T20:56:48.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:48.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101619+0000", 2020-11-16T20:56:48.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046178253000000002 2020-11-16T20:56:48.865 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.865 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:48.865 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.865 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2372 4.1 4:82bb0fe7:::smithi16641208-101:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e42)", 2020-11-16T20:56:48.866 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:56:48.866 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.783038744000002, 2020-11-16T20:56:48.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046557016999999999, 2020-11-16T20:56:48.866 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:48.866 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:48.866 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:48.866 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:48.866 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:48.867 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2372 2020-11-16T20:56:48.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.867 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:48.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:48.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:56:48.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:48.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:48.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:56:48.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9907000000000001e-05 2020-11-16T20:56:48.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:48.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055532+0000", 2020-11-16T20:56:48.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0599999999999999e-06 2020-11-16T20:56:48.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:48.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055535+0000", 2020-11-16T20:56:48.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1430000000000003e-06 2020-11-16T20:56:48.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:48.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055541+0000", 2020-11-16T20:56:48.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6819999999999999e-06 2020-11-16T20:56:48.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055544+0000", 2020-11-16T20:56:48.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000102643 2020-11-16T20:56:48.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055647+0000", 2020-11-16T20:56:48.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7197000000000003e-05 2020-11-16T20:56:48.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:48.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055684+0000", 2020-11-16T20:56:48.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029347807 2020-11-16T20:56:48.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.085032+0000", 2020-11-16T20:56:48.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6130000000000005e-05 2020-11-16T20:56:48.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:48.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.085108+0000", 2020-11-16T20:56:48.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016542980999999998 2020-11-16T20:56:48.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101651+0000", 2020-11-16T20:56:48.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000118733 2020-11-16T20:56:48.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:48.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101769+0000", 2020-11-16T20:56:48.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029973400000000001 2020-11-16T20:56:48.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:48.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.102069+0000", 2020-11-16T20:56:48.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046557016999999999 2020-11-16T20:56:48.875 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.876 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:48.876 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.876 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2423 3.3 3:c5716d1e:::smithi16641208-111:head [copy-from ver 265] snapc 7=[7,5] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e46)", 2020-11-16T20:56:48.876 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:09.027460+0000", 2020-11-16T20:56:48.876 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.811090591999999, 2020-11-16T20:56:48.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.038337614999999998, 2020-11-16T20:56:48.877 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:48.877 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.877 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:48.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:48.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027460+0000", 2020-11-16T20:56:48.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:48.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:48.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027460+0000", 2020-11-16T20:56:48.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4963999999999998e-05 2020-11-16T20:56:48.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:48.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027505+0000", 2020-11-16T20:56:48.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.925e-05 2020-11-16T20:56:48.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:48.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027525+0000", 2020-11-16T20:56:48.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3959e-05 2020-11-16T20:56:48.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:48.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027539+0000", 2020-11-16T20:56:48.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8059999999999997e-06 2020-11-16T20:56:48.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.881 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027545+0000", 2020-11-16T20:56:48.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0037794289999999999 2020-11-16T20:56:48.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.881 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.881 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031325+0000", 2020-11-16T20:56:48.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000127613 2020-11-16T20:56:48.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:48.882 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031452+0000", 2020-11-16T20:56:48.882 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021049117999999999 2020-11-16T20:56:48.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.882 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:56:48.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.052502+0000", 2020-11-16T20:56:48.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012965061 2020-11-16T20:56:48.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065467+0000", 2020-11-16T20:56:48.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9788000000000003e-05 2020-11-16T20:56:48.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.884 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065536+0000", 2020-11-16T20:56:48.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013262699999999999 2020-11-16T20:56:48.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.884 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:48.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065669+0000", 2020-11-16T20:56:48.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4404999999999999e-05 2020-11-16T20:56:48.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.885 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:48.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065713+0000", 2020-11-16T20:56:48.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4594999999999999e-05 2020-11-16T20:56:48.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:48.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065798+0000", 2020-11-16T20:56:48.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.038337614999999998 2020-11-16T20:56:48.886 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.886 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:48.886 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.887 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:577 3.3 3:c5716d1e:::smithi16641208-111:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e46)", 2020-11-16T20:56:48.887 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:09.027581+0000", 2020-11-16T20:56:48.887 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.810970148999999, 2020-11-16T20:56:48.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.038487691999999997, 2020-11-16T20:56:48.887 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:48.888 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:48.888 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:48.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.888 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:48.888 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027581+0000", 2020-11-16T20:56:48.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:48.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:48.889 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027581+0000", 2020-11-16T20:56:48.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3422e-05 2020-11-16T20:56:48.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:48.889 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027614+0000", 2020-11-16T20:56:48.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1710000000000002e-06 2020-11-16T20:56:48.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.890 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:48.890 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027622+0000", 2020-11-16T20:56:48.890 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2265e-05 2020-11-16T20:56:48.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.891 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:48.891 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027635+0000", 2020-11-16T20:56:48.891 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4700000000000001e-06 2020-11-16T20:56:48.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.891 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.891 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027640+0000", 2020-11-16T20:56:48.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0040006759999999999 2020-11-16T20:56:48.892 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.892 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.892 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.892 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031641+0000", 2020-11-16T20:56:48.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4350000000000006e-05 2020-11-16T20:56:48.892 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:48.893 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031705+0000", 2020-11-16T20:56:48.893 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029225991999999999 2020-11-16T20:56:48.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.893 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.060931+0000", 2020-11-16T20:56:48.894 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013316099999999999 2020-11-16T20:56:48.894 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.894 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.894 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:48.894 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.061064+0000", 2020-11-16T20:56:48.894 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047860919999999996 2020-11-16T20:56:48.894 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.895 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.895 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.895 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065850+0000", 2020-11-16T20:56:48.895 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1691e-05 2020-11-16T20:56:48.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.895 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.895 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:48.895 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065942+0000", 2020-11-16T20:56:48.896 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012640199999999999 2020-11-16T20:56:48.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.896 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:48.896 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.066068+0000", 2020-11-16T20:56:48.896 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.038487691999999997 2020-11-16T20:56:48.896 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.896 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:48.897 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.897 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.897 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:578 3.3 3:c5716d1e:::smithi16641208-111:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e46)", 2020-11-16T20:56:48.897 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:09.027672+0000", 2020-11-16T20:56:48.897 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.810879034999999, 2020-11-16T20:56:48.897 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.043041498999999997, 2020-11-16T20:56:48.898 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:48.898 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:48.898 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:48.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.898 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:48.898 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027672+0000", 2020-11-16T20:56:48.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:48.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.899 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.899 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:48.899 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027672+0000", 2020-11-16T20:56:48.899 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2234000000000003e-05 2020-11-16T20:56:48.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.899 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.899 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:48.900 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027714+0000", 2020-11-16T20:56:48.900 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5910000000000001e-06 2020-11-16T20:56:48.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.900 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.900 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:48.900 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027721+0000", 2020-11-16T20:56:48.900 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1319e-05 2020-11-16T20:56:48.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:48.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027732+0000", 2020-11-16T20:56:48.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7919999999999998e-06 2020-11-16T20:56:48.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.902 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027738+0000", 2020-11-16T20:56:48.902 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0040456559999999999 2020-11-16T20:56:48.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.902 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.902 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031784+0000", 2020-11-16T20:56:48.902 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9271999999999999e-05 2020-11-16T20:56:48.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.903 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:48.903 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031833+0000", 2020-11-16T20:56:48.903 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029282580999999999 2020-11-16T20:56:48.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.903 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.903 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.061115+0000", 2020-11-16T20:56:48.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6058999999999998e-05 2020-11-16T20:56:48.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:48.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.061191+0000", 2020-11-16T20:56:48.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049009099999999996 2020-11-16T20:56:48.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.905 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.905 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.066092+0000", 2020-11-16T20:56:48.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7039999999999995e-05 2020-11-16T20:56:48.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.905 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:48.905 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.066159+0000", 2020-11-16T20:56:48.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045540449999999996 2020-11-16T20:56:48.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.906 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:48.906 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.070713+0000", 2020-11-16T20:56:48.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.043041498999999997 2020-11-16T20:56:48.906 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.907 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:48.907 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.907 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.907 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2427 4.1 4:a1b421f3:::smithi16641208-471:head [cache-flush] snapc 0=[] ondisk+read+ignore_cache+known_if_redirected e47)", 2020-11-16T20:56:48.907 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:10.015762+0000", 2020-11-16T20:56:48.907 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 38.822788596000002, 2020-11-16T20:56:48.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036562619999999997, 2020-11-16T20:56:48.908 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:48.908 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:48.908 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:48.908 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:48.908 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:48.908 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2427 2020-11-16T20:56:48.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.909 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:48.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.909 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:48.909 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015762+0000", 2020-11-16T20:56:48.909 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:48.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.909 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:48.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015762+0000", 2020-11-16T20:56:48.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8266999999999999e-05 2020-11-16T20:56:48.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:48.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015791+0000", 2020-11-16T20:56:48.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3263e-05 2020-11-16T20:56:48.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.911 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:48.911 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015804+0000", 2020-11-16T20:56:48.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1194e-05 2020-11-16T20:56:48.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.911 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:48.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015815+0000", 2020-11-16T20:56:48.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9799999999999998e-06 2020-11-16T20:56:48.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.912 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015823+0000", 2020-11-16T20:56:48.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0092000000000006e-05 2020-11-16T20:56:48.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.913 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.913 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015893+0000", 2020-11-16T20:56:48.913 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4109999999999996e-06 2020-11-16T20:56:48.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.913 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2020-11-16T20:56:48.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015902+0000", 2020-11-16T20:56:48.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0024786610000000001 2020-11-16T20:56:48.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.018380+0000", 2020-11-16T20:56:48.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016238599999999999 2020-11-16T20:56:48.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.915 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:48.915 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.018543+0000", 2020-11-16T20:56:48.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.033540168000000002 2020-11-16T20:56:48.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.915 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.916 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.052083+0000", 2020-11-16T20:56:48.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014603000000000001 2020-11-16T20:56:48.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:48.916 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.052229+0000", 2020-11-16T20:56:48.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6168000000000005e-05 2020-11-16T20:56:48.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.917 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:48.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.052325+0000", 2020-11-16T20:56:48.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036562619999999997 2020-11-16T20:56:48.917 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.917 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:48.917 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.918 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2503 4.1 4:b0538c7c:::smithi16641208-136:head [write 1790337~563515] snapc f=[f,e,d,5] ondisk+write+known_if_redirected e52)", 2020-11-16T20:56:48.918 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:56:48.918 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 34.091843240999999, 2020-11-16T20:56:48.918 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089724989000000005, 2020-11-16T20:56:48.918 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:48.918 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.919 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:48.919 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:48.919 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:48.919 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2503 2020-11-16T20:56:48.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.919 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:48.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.920 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:48.920 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:56:48.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:48.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.920 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:48.920 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:56:48.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00060419599999999999 2020-11-16T20:56:48.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:48.921 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747312+0000", 2020-11-16T20:56:48.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.319e-06 2020-11-16T20:56:48.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:48.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747318+0000", 2020-11-16T20:56:48.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5100000000000004e-06 2020-11-16T20:56:48.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.922 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:48.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747328+0000", 2020-11-16T20:56:48.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6369999999999999e-06 2020-11-16T20:56:48.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.923 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747335+0000", 2020-11-16T20:56:48.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001800479 2020-11-16T20:56:48.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749136+0000", 2020-11-16T20:56:48.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7970000000000002e-05 2020-11-16T20:56:48.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:48.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749194+0000", 2020-11-16T20:56:48.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030847998000000001 2020-11-16T20:56:48.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.925 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780042+0000", 2020-11-16T20:56:48.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013142199999999999 2020-11-16T20:56:48.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:48.926 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780173+0000", 2020-11-16T20:56:48.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022398200000000001 2020-11-16T20:56:48.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:56:48.926 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780397+0000", 2020-11-16T20:56:48.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061389269999999998 2020-11-16T20:56:48.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786536+0000", 2020-11-16T20:56:48.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3673999999999998e-05 2020-11-16T20:56:48.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:48.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786630+0000", 2020-11-16T20:56:48.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049513384000000001 2020-11-16T20:56:48.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836143+0000", 2020-11-16T20:56:48.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4713000000000001e-05 2020-11-16T20:56:48.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:48.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836218+0000", 2020-11-16T20:56:48.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000214778 2020-11-16T20:56:48.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:48.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836433+0000", 2020-11-16T20:56:48.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089724989000000005 2020-11-16T20:56:48.930 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.930 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:48.930 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.931 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2504 4.1 4:b0538c7c:::smithi16641208-136:head [setxattr _header (58) in=7b,truncate 2991745] snapc f=[f,e,d,5] ondisk+write+known_if_redirected e52)", 2020-11-16T20:56:48.931 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:56:48.931 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 34.091168871000001, 2020-11-16T20:56:48.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089341162000000002, 2020-11-16T20:56:48.931 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:48.931 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.931 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:48.931 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:48.932 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:48.932 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2504 2020-11-16T20:56:48.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.932 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:48.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:48.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:56:48.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:48.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.933 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:48.933 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:56:48.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5520999999999999e-05 2020-11-16T20:56:48.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:48.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747438+0000", 2020-11-16T20:56:48.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2020-11-16T20:56:48.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:48.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747444+0000", 2020-11-16T20:56:48.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.661e-06 2020-11-16T20:56:48.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:48.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747451+0000", 2020-11-16T20:56:48.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6920000000000001e-06 2020-11-16T20:56:48.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747456+0000", 2020-11-16T20:56:48.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0017949769999999999 2020-11-16T20:56:48.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749251+0000", 2020-11-16T20:56:48.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114708 2020-11-16T20:56:48.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:48.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749366+0000", 2020-11-16T20:56:48.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032215049000000003 2020-11-16T20:56:48.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.781581+0000", 2020-11-16T20:56:48.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000181452 2020-11-16T20:56:48.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:48.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.781762+0000", 2020-11-16T20:56:48.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024118300000000001 2020-11-16T20:56:48.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:56:48.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782003+0000", 2020-11-16T20:56:48.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045997939999999999 2020-11-16T20:56:48.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786603+0000", 2020-11-16T20:56:48.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8782000000000002e-05 2020-11-16T20:56:48.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:48.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786642+0000", 2020-11-16T20:56:48.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049869098000000001 2020-11-16T20:56:48.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836511+0000", 2020-11-16T20:56:48.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4498000000000005e-05 2020-11-16T20:56:48.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:48.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836576+0000", 2020-11-16T20:56:48.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000147615 2020-11-16T20:56:48.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.942 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:48.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836723+0000", 2020-11-16T20:56:48.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089341162000000002 2020-11-16T20:56:48.943 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.943 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:48.943 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.943 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2505 4.1 4:b0538c7c:::smithi16641208-136:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e52)", 2020-11-16T20:56:48.943 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:56:48.944 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 34.091059743000002, 2020-11-16T20:56:48.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089929617000000003, 2020-11-16T20:56:48.944 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:48.944 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:48.944 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:48.944 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:48.944 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:48.944 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2505 2020-11-16T20:56:48.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.945 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:48.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:48.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:56:48.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:48.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:48.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:56:48.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1894999999999999e-05 2020-11-16T20:56:48.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:48.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747523+0000", 2020-11-16T20:56:48.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3900000000000003e-06 2020-11-16T20:56:48.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.947 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:48.947 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747527+0000", 2020-11-16T20:56:48.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8169999999999999e-06 2020-11-16T20:56:48.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:48.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747535+0000", 2020-11-16T20:56:48.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6449999999999998e-06 2020-11-16T20:56:48.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747539+0000", 2020-11-16T20:56:48.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0018868209999999999 2020-11-16T20:56:48.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749426+0000", 2020-11-16T20:56:48.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4963000000000002e-05 2020-11-16T20:56:48.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:48.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749481+0000", 2020-11-16T20:56:48.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032915959000000002 2020-11-16T20:56:48.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782397+0000", 2020-11-16T20:56:48.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018449499999999999 2020-11-16T20:56:48.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:48.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782581+0000", 2020-11-16T20:56:48.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054195457000000002 2020-11-16T20:56:48.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.952 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.952 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836777+0000", 2020-11-16T20:56:48.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000214584 2020-11-16T20:56:48.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.952 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:48.952 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836991+0000", 2020-11-16T20:56:48.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000429591 2020-11-16T20:56:48.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.953 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.953 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:48.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.837421+0000", 2020-11-16T20:56:48.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089929617000000003 2020-11-16T20:56:48.953 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.953 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:48.954 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.954 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2593 3.3 3:f5f8fa2a:::smithi16641208-144:head [copy-from ver 64] snapc 14=[12,f,5] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e57)", 2020-11-16T20:56:48.954 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:56:48.954 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.051910882000001, 2020-11-16T20:56:48.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064638111999999998, 2020-11-16T20:56:48.955 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:48.955 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.955 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:48.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:48.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:56:48.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:48.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:48.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:56:48.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3655999999999998e-05 2020-11-16T20:56:48.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:48.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786664+0000", 2020-11-16T20:56:48.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1850000000000003e-06 2020-11-16T20:56:48.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:48.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786669+0000", 2020-11-16T20:56:48.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0861e-05 2020-11-16T20:56:48.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:48.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786680+0000", 2020-11-16T20:56:48.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6749999999999996e-06 2020-11-16T20:56:48.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786686+0000", 2020-11-16T20:56:48.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2327000000000003e-05 2020-11-16T20:56:48.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786729+0000", 2020-11-16T20:56:48.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000156143 2020-11-16T20:56:48.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:48.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786885+0000", 2020-11-16T20:56:48.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024103846000000002 2020-11-16T20:56:48.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:56:48.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810989+0000", 2020-11-16T20:56:48.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018870436000000001 2020-11-16T20:56:48.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829859+0000", 2020-11-16T20:56:48.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021210896 2020-11-16T20:56:48.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:48.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851070+0000", 2020-11-16T20:56:48.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3708e-05 2020-11-16T20:56:48.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:48.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851084+0000", 2020-11-16T20:56:48.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7329e-05 2020-11-16T20:56:48.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:48.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851131+0000", 2020-11-16T20:56:48.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014705 2020-11-16T20:56:48.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:48.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851278+0000", 2020-11-16T20:56:48.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064638111999999998 2020-11-16T20:56:48.964 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.964 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:48.964 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.965 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:616 3.3 3:f5f8fa2a:::smithi16641208-144:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e57)", 2020-11-16T20:56:48.965 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:56:48.965 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.051820228, 2020-11-16T20:56:48.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064784234999999996, 2020-11-16T20:56:48.965 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:48.965 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:48.965 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:48.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:48.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:56:48.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:48.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:48.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:56:48.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8559999999999998e-05 2020-11-16T20:56:48.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:48.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786749+0000", 2020-11-16T20:56:48.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4549999999999997e-06 2020-11-16T20:56:48.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:48.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786754+0000", 2020-11-16T20:56:48.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4980000000000006e-06 2020-11-16T20:56:48.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:48.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786762+0000", 2020-11-16T20:56:48.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9790000000000004e-06 2020-11-16T20:56:48.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786766+0000", 2020-11-16T20:56:48.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029976900000000002 2020-11-16T20:56:48.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787066+0000", 2020-11-16T20:56:48.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3581999999999998e-05 2020-11-16T20:56:48.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:48.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787100+0000", 2020-11-16T20:56:48.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.037252078000000001 2020-11-16T20:56:48.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824352+0000", 2020-11-16T20:56:48.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000124189 2020-11-16T20:56:48.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:48.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824476+0000", 2020-11-16T20:56:48.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026883987000000002 2020-11-16T20:56:48.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851360+0000", 2020-11-16T20:56:48.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6365999999999994e-05 2020-11-16T20:56:48.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:48.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851426+0000", 2020-11-16T20:56:48.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8771999999999996e-05 2020-11-16T20:56:48.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:48.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851515+0000", 2020-11-16T20:56:48.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064784234999999996 2020-11-16T20:56:48.974 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.974 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:48.974 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.975 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:617 3.3 3:f5f8fa2a:::smithi16641208-144:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e57)", 2020-11-16T20:56:48.975 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:56:48.975 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.051749912999998, 2020-11-16T20:56:48.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.069756316999999998, 2020-11-16T20:56:48.975 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:48.975 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:48.976 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:48.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.976 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:48.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:56:48.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:48.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.976 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:48.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:56:48.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3865000000000002e-05 2020-11-16T20:56:48.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:48.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786835+0000", 2020-11-16T20:56:48.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6949999999999999e-06 2020-11-16T20:56:48.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:48.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786840+0000", 2020-11-16T20:56:48.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3559999999999999e-06 2020-11-16T20:56:48.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:48.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786849+0000", 2020-11-16T20:56:48.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.045e-06 2020-11-16T20:56:48.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786854+0000", 2020-11-16T20:56:48.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026743999999999997 2020-11-16T20:56:48.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787121+0000", 2020-11-16T20:56:48.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8912000000000001e-05 2020-11-16T20:56:48.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:48.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787180+0000", 2020-11-16T20:56:48.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.042545010000000001 2020-11-16T20:56:48.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829725+0000", 2020-11-16T20:56:48.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3979000000000003e-05 2020-11-16T20:56:48.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:48.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829819+0000", 2020-11-16T20:56:48.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021745652000000001 2020-11-16T20:56:48.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851565+0000", 2020-11-16T20:56:48.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000102064 2020-11-16T20:56:48.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:48.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851667+0000", 2020-11-16T20:56:48.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048902989999999999 2020-11-16T20:56:48.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:48.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856557+0000", 2020-11-16T20:56:48.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.069756316999999998 2020-11-16T20:56:48.984 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.984 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:48.984 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.985 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:618 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'243, mlcod=57'241)", 2020-11-16T20:56:48.985 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:56:48.985 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.038930788999998, 2020-11-16T20:56:48.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048895281999999998, 2020-11-16T20:56:48.985 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:48.986 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.986 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:48.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:48.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:56:48.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:48.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:48.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:56:48.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017163861999999998 2020-11-16T20:56:48.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:48.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816784+0000", 2020-11-16T20:56:48.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7071e-05 2020-11-16T20:56:48.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:48.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816801+0000", 2020-11-16T20:56:48.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6405e-05 2020-11-16T20:56:48.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:48.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816818+0000", 2020-11-16T20:56:48.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3030999999999999e-05 2020-11-16T20:56:48.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816831+0000", 2020-11-16T20:56:48.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4610000000000007e-05 2020-11-16T20:56:48.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816895+0000", 2020-11-16T20:56:48.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4202999999999998e-05 2020-11-16T20:56:48.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:48.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816929+0000", 2020-11-16T20:56:48.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.031527016999999997 2020-11-16T20:56:48.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:48.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.848456+0000", 2020-11-16T20:56:48.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9083000000000003e-05 2020-11-16T20:56:48.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:48.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.848515+0000", 2020-11-16T20:56:48.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048895281999999998 2020-11-16T20:56:48.992 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.992 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:48.993 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:48.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.993 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:618 3.3 3:d775beee:::smithi16641208-10:head [copy-from ver 12] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:56:48.993 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:56:48.993 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.029748720000001, 2020-11-16T20:56:48.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047870862, 2020-11-16T20:56:48.993 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:48.994 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:48.994 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:48.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:48.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:56:48.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:48.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:48.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:56:48.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0958999999999999e-05 2020-11-16T20:56:48.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:48.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808843+0000", 2020-11-16T20:56:48.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1294000000000001e-05 2020-11-16T20:56:48.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:48.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808854+0000", 2020-11-16T20:56:48.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8553999999999997e-05 2020-11-16T20:56:48.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:48.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808893+0000", 2020-11-16T20:56:48.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1985e-05 2020-11-16T20:56:48.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:48.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808905+0000", 2020-11-16T20:56:48.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7309000000000001e-05 2020-11-16T20:56:48.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:48.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808982+0000", 2020-11-16T20:56:48.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016374099999999999 2020-11-16T20:56:48.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:48.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809146+0000", 2020-11-16T20:56:48.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015955815000000002 2020-11-16T20:56:48.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:48.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:48.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:56:48.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.825102+0000", 2020-11-16T20:56:49.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048434799999999998 2020-11-16T20:56:49.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:49.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829945+0000", 2020-11-16T20:56:49.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021349677000000001 2020-11-16T20:56:49.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:49.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851295+0000", 2020-11-16T20:56:49.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052994100000000001 2020-11-16T20:56:49.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:49.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856594+0000", 2020-11-16T20:56:49.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3349000000000001e-05 2020-11-16T20:56:49.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:49.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856638+0000", 2020-11-16T20:56:49.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5289e-05 2020-11-16T20:56:49.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856673+0000", 2020-11-16T20:56:49.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047870862 2020-11-16T20:56:49.003 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.003 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.003 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.004 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:619 3.3 3:d79d68cf:::smithi16641208-37:head [copy-from ver 27] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:56:49.004 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:56:49.004 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.02919013, 2020-11-16T20:56:49.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047415915000000003, 2020-11-16T20:56:49.004 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.004 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:49.004 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:56:49.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:56:49.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3012000000000002e-05 2020-11-16T20:56:49.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809394+0000", 2020-11-16T20:56:49.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1699999999999996e-06 2020-11-16T20:56:49.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809399+0000", 2020-11-16T20:56:49.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2390000000000008e-06 2020-11-16T20:56:49.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809408+0000", 2020-11-16T20:56:49.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0259999999999998e-06 2020-11-16T20:56:49.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809413+0000", 2020-11-16T20:56:49.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0359999999999996e-05 2020-11-16T20:56:49.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809494+0000", 2020-11-16T20:56:49.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019616600000000001 2020-11-16T20:56:49.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809690+0000", 2020-11-16T20:56:49.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017673003999999999 2020-11-16T20:56:49.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:56:49.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.827363+0000", 2020-11-16T20:56:49.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006463033 2020-11-16T20:56:49.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:49.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.833826+0000", 2020-11-16T20:56:49.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017479913999999999 2020-11-16T20:56:49.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:49.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851306+0000", 2020-11-16T20:56:49.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054026500000000002 2020-11-16T20:56:49.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:49.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856708+0000", 2020-11-16T20:56:49.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8121999999999999e-05 2020-11-16T20:56:49.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:49.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856747+0000", 2020-11-16T20:56:49.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0219e-05 2020-11-16T20:56:49.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856777+0000", 2020-11-16T20:56:49.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047415915000000003 2020-11-16T20:56:49.014 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.015 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.015 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.015 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2706 4.1 4:b0e01256:::smithi16641208-225:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e63)", 2020-11-16T20:56:49.015 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:25.737898+0000", 2020-11-16T20:56:49.015 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.100653234999999, 2020-11-16T20:56:49.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032962285000000001, 2020-11-16T20:56:49.016 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.016 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:49.016 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:49.016 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:49.016 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:49.016 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2706 2020-11-16T20:56:49.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.017 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737898+0000", 2020-11-16T20:56:49.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737898+0000", 2020-11-16T20:56:49.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2438999999999999e-05 2020-11-16T20:56:49.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737930+0000", 2020-11-16T20:56:49.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0101999999999999e-05 2020-11-16T20:56:49.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737940+0000", 2020-11-16T20:56:49.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3549999999999994e-06 2020-11-16T20:56:49.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737950+0000", 2020-11-16T20:56:49.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6650000000000001e-06 2020-11-16T20:56:49.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737953+0000", 2020-11-16T20:56:49.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9898999999999999e-05 2020-11-16T20:56:49.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737993+0000", 2020-11-16T20:56:49.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6890000000000001e-06 2020-11-16T20:56:49.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:49.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.737999+0000", 2020-11-16T20:56:49.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0024181250000000001 2020-11-16T20:56:49.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.740417+0000", 2020-11-16T20:56:49.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1564999999999997e-05 2020-11-16T20:56:49.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:49.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.740489+0000", 2020-11-16T20:56:49.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019766418000000001 2020-11-16T20:56:49.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.760255+0000", 2020-11-16T20:56:49.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015687700000000001 2020-11-16T20:56:49.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:49.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.760412+0000", 2020-11-16T20:56:49.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010128422999999999 2020-11-16T20:56:49.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.770540+0000", 2020-11-16T20:56:49.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016931800000000001 2020-11-16T20:56:49.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.770710+0000", 2020-11-16T20:56:49.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015040999999999999 2020-11-16T20:56:49.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:25.770860+0000", 2020-11-16T20:56:49.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032962285000000001 2020-11-16T20:56:49.027 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.027 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.027 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.027 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:687 3.3 3:d9c18080:::smithi16641208-173:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e72)", 2020-11-16T20:56:49.028 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:34.746403+0000", 2020-11-16T20:56:49.028 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.092148085, 2020-11-16T20:56:49.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.035160709999999998, 2020-11-16T20:56:49.028 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.028 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:49.028 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.028 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.746403+0000", 2020-11-16T20:56:49.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.029 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.746403+0000", 2020-11-16T20:56:49.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3402999999999998e-05 2020-11-16T20:56:49.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.746446+0000", 2020-11-16T20:56:49.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8259999999999998e-06 2020-11-16T20:56:49.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.746452+0000", 2020-11-16T20:56:49.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1222e-05 2020-11-16T20:56:49.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.746463+0000", 2020-11-16T20:56:49.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.78e-06 2020-11-16T20:56:49.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.746468+0000", 2020-11-16T20:56:49.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015534199999999999 2020-11-16T20:56:49.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.746623+0000", 2020-11-16T20:56:49.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1946999999999997e-05 2020-11-16T20:56:49.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.033 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:49.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.746665+0000", 2020-11-16T20:56:49.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023302178 2020-11-16T20:56:49.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.769968+0000", 2020-11-16T20:56:49.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3629999999999999e-05 2020-11-16T20:56:49.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:49.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.770031+0000", 2020-11-16T20:56:49.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007234809 2020-11-16T20:56:49.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.777266+0000", 2020-11-16T20:56:49.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000102111 2020-11-16T20:56:49.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.777368+0000", 2020-11-16T20:56:49.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0041954619999999996 2020-11-16T20:56:49.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.781564+0000", 2020-11-16T20:56:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.035160709999999998 2020-11-16T20:56:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.037 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2961 3.3 3:c925a80f:::smithi16641208-375:head [write 531253~411999,stat] snapc 2d=[2d,25] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e82)", 2020-11-16T20:56:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:44.746849+0000", 2020-11-16T20:56:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.091701799, 2020-11-16T20:56:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032818384999999999, 2020-11-16T20:56:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.746849+0000", 2020-11-16T20:56:49.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.746849+0000", 2020-11-16T20:56:49.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00064775399999999995 2020-11-16T20:56:49.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.747497+0000", 2020-11-16T20:56:49.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1040000000000007e-06 2020-11-16T20:56:49.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.747505+0000", 2020-11-16T20:56:49.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4191e-05 2020-11-16T20:56:49.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.747519+0000", 2020-11-16T20:56:49.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3200000000000002e-06 2020-11-16T20:56:49.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.747527+0000", 2020-11-16T20:56:49.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024500999999999999 2020-11-16T20:56:49.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.747772+0000", 2020-11-16T20:56:49.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000161948 2020-11-16T20:56:49.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.747933+0000", 2020-11-16T20:56:49.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025252199999999998 2020-11-16T20:56:49.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:56:49.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.748186+0000", 2020-11-16T20:56:49.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0099194810000000008 2020-11-16T20:56:49.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:49.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.758105+0000", 2020-11-16T20:56:49.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6261999999999996e-05 2020-11-16T20:56:49.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:49.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.758182+0000", 2020-11-16T20:56:49.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021382588000000001 2020-11-16T20:56:49.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:49.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.779564+0000", 2020-11-16T20:56:49.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3071999999999997e-05 2020-11-16T20:56:49.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:49.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.779607+0000", 2020-11-16T20:56:49.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0133000000000002e-05 2020-11-16T20:56:49.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.779668+0000", 2020-11-16T20:56:49.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032818384999999999 2020-11-16T20:56:49.049 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.049 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.049 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.050 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:717 3.3 3:c925a80f:::smithi16641208-375:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e82)", 2020-11-16T20:56:49.050 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:44.747661+0000", 2020-11-16T20:56:49.050 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.0908897050000004, 2020-11-16T20:56:49.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036211121999999998, 2020-11-16T20:56:49.050 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.051 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:49.051 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.051 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.747661+0000", 2020-11-16T20:56:49.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.052 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.747661+0000", 2020-11-16T20:56:49.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5145999999999998e-05 2020-11-16T20:56:49.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.747706+0000", 2020-11-16T20:56:49.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.485e-06 2020-11-16T20:56:49.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.053 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.747712+0000", 2020-11-16T20:56:49.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1314999999999999e-05 2020-11-16T20:56:49.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.054 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.054 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.747723+0000", 2020-11-16T20:56:49.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4329999999999997e-06 2020-11-16T20:56:49.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.054 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.747728+0000", 2020-11-16T20:56:49.055 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0026635449999999998 2020-11-16T20:56:49.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.750391+0000", 2020-11-16T20:56:49.055 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011654600000000001 2020-11-16T20:56:49.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.056 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:49.056 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.750508+0000", 2020-11-16T20:56:49.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029802149 2020-11-16T20:56:49.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.056 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.780310+0000", 2020-11-16T20:56:49.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3328000000000001e-05 2020-11-16T20:56:49.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.780373+0000", 2020-11-16T20:56:49.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0034991750000000002 2020-11-16T20:56:49.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.058 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.058 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:44.783872+0000", 2020-11-16T20:56:49.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036211121999999998 2020-11-16T20:56:49.058 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.058 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.059 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.059 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.059 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.059 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:49.061 INFO:tasks.rados.rados.0.smithi166.stdout:828: finishing rollback tid 0 to smithi16641208-359 2020-11-16T20:56:49.061 INFO:tasks.rados.rados.0.smithi166.stdout:830: finishing rollback tid 0 to smithi16641208-76 2020-11-16T20:56:49.061 INFO:tasks.rados.rados.0.smithi166.stdout:831: finishing copy_from to smithi16641208-361 2020-11-16T20:56:49.061 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 361 v 499 (ObjNum 545 snap 12 seq_num 545) dirty exists 2020-11-16T20:56:49.061 INFO:tasks.rados.rados.0.smithi166.stdout:828: finishing rollback tid 1 to smithi16641208-359 2020-11-16T20:56:49.062 INFO:tasks.rados.rados.0.smithi166.stdout:828: finishing rollback tid 2 to smithi16641208-359 2020-11-16T20:56:49.062 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 359 v 697 (ObjNum 358 snap 0 seq_num 358) dirty exists 2020-11-16T20:56:49.062 INFO:tasks.rados.rados.0.smithi166.stdout:831: finishing copy_from racing read to smithi16641208-361 2020-11-16T20:56:49.062 INFO:tasks.rados.rados.0.smithi166.stdout:830: finishing rollback tid 1 to smithi16641208-76 2020-11-16T20:56:49.062 INFO:tasks.rados.rados.0.smithi166.stdout:830: finishing rollback tid 2 to smithi16641208-76 2020-11-16T20:56:49.062 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 76 v 699 (ObjNum 75 snap 0 seq_num 75) dirty exists 2020-11-16T20:56:49.063 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:56:49.063 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:49.065+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:49.112 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:56:49.114 INFO:teuthology.orchestra.run.smithi166.stderr:dumped all 2020-11-16T20:56:49.125 INFO:teuthology.orchestra.run.smithi166.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2020-11-16T20:56:49.094637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1886586091,"num_objects":683,"num_object_clones":29,"num_object_copies":2049,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":589,"num_whiteouts":10,"num_read":1729,"num_read_kb":557306,"num_write":2794,"num_write_kb":1111269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":280776422,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":102,"num_flush_kb":287774,"num_evict":35,"num_evict_kb":97906,"num_promote":214,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3735,"ondisk_log_size":3735,"up":81,"acting":81,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4027908,"kb_used_data":3919404,"kb_used_omap":0,"kb_used_meta":107648,"kb_avail":750946812,"statfs":{"total":773094113280,"available":768969535488,"internally_reserved":0,"allocated":4013469696,"data_stored":4063256884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110231552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-96723784,"num_objects":-59,"num_object_clones":-55,"num_object_copies":-177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-53,"num_whiteouts":-6,"num_read":7,"num_read_kb":4,"num_write":27,"num_write_kb":15660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":7350012,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":6,"num_flush_kb":18763,"num_evict":0,"num_evict_kb":0,"num_promote":2,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000817"},"pg_stats":[{"pgid":"2.11","version":"0'0","reported_seq":"35","reported_epoch":"82","state":"active+clean","last_fresh":"2020-11-16T20:56:44.743824+0000","last_change":"2020-11-16T20:56:30.376104+0000","last_active":"2020-11-16T20:56:44.743824+0000","last_peered":"2020-11-16T20:56:44.743824+0000","last_clean":"2020-11-16T20:56:44.743824+0000","last_became_active":"2020-11-16T20:56:26.743063+0000","last_became_peered":"2020-11-16T20:56:26.743063+0000","last_unstale":"2020-11-16T20:56:44.743824+0000","last_undegraded":"2020-11-16T20:56:44.743824+0000","last_fullsized":"2020-11-16T20:56:44.743824+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:30.376014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:30.376014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"62","reported_epoch":"83","state":"active+clean","last_fresh":"2020-11-16T20:56:45.743541+0000","last_change":"2020-11-16T20:55:59.416734+0000","last_active":"2020-11-16T20:56:45.743541+0000","last_peered":"2020-11-16T20:56:45.743541+0000","last_clean":"2020-11-16T20:56:45.743541+0000","last_became_active":"2020-11-16T20:55:52.921860+0000","last_became_peered":"2020-11-16T20:55:52.921860+0000","last_unstale":"2020-11-16T20:56:45.743541+0000","last_undegraded":"2020-11-16T20:56:45.743541+0000","last_fullsized":"2020-11-16T20:56:45.743541+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.416654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.416654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":"61","reported_epoch":"82","state":"active+clean","last_fresh":"2020-11-16T20:56:44.743242+0000","last_change":"2020-11-16T20:55:56.438524+0000","last_active":"2020-11-16T20:56:44.743242+0000","last_peered":"2020-11-16T20:56:44.743242+0000","last_clean":"2020-11-16T20:56:44.743242+0000","last_became_active":"2020-11-16T20:55:52.922023+0000","last_became_peered":"2020-11-16T20:55:52.922023+0000","last_unstale":"2020-11-16T20:56:44.743242+0000","last_undegraded":"2020-11-16T20:56:44.743242+0000","last_fullsized":"2020-11-16T20:56:44.743242+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:56.438428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:56.438428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":"36","reported_epoch":"83","state":"active+clean","last_fresh":"2020-11-16T20:56:45.793111+0000","last_change":"2020-11-16T20:56:20.755004+0000","last_active":"2020-11-16T20:56:45.793111+0000","last_peered":"2020-11-16T20:56:45.793111+0000","last_clean":"2020-11-16T20:56:45.793111+0000","last_became_active":"2020-11-16T20:56:20.754520+0000","last_became_peered":"2020-11-16T20:56:20.754520+0000","last_unstale":"2020-11-16T20:56:45.793111+0000","last_undegraded":"2020-11-16T20:56:45.793111+0000","last_fullsized":"2020-11-16T20:56:45.793111+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:04.388506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:04.388506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"62","reported_epoch":"83","state":"active+clean","last_fresh":"2020-11-16T20:56:45.793035+0000","last_change":"2020-11-16T20:56:11.940489+0000","last_active":"2020-11-16T20:56:45.793035+0000","last_peered":"2020-11-16T20:56:45.793035+0000","last_clean":"2020-11-16T20:56:45.793035+0000","last_became_active":"2020-11-16T20:55:52.922134+0000","last_became_peered":"2020-11-16T20:55:52.922134+0000","last_unstale":"2020-11-16T20:56:45.793035+0000","last_undegraded":"2020-11-16T20:56:45.793035+0000","last_fullsized":"2020-11-16T20:56:45.793035+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:11.940423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:11.940423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"62","reported_epoch":"83","state":"active+clean","last_fresh":"2020-11-16T20:56:45.743819+0000","last_change":"2020-11-16T20:56:02.387946+0000","last_active":"2020-11-16T20:56:45.743819+0000","last_peered":"2020-11-16T20:56:45.743819+0000","last_clean":"2020-11-16T20:56:45.743819+0000","last_became_active":"2020-11-16T20:55:52.920496+0000","last_became_peered":"2020-11-16T20:55:52.920496+0000","last_unstale":"2020-11-16T20:56:45.743819+0000","last_undegraded":"2020-11-16T20:56:45.743819+0000","last_fullsized":"2020-11-16T20:56:45.743819+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:02.387861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:02.387861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"88","reported_epoch":"83","state":"active+clean","last_fresh":"2020-11-16T20:56:45.748958+0000","last_change":"2020-11-16T20:56:02.565668+0000","last_active":"2020-11-16T20:56:45.748958+0000","last_peered":"2020-11-16T20:56:45.748958+0000","last_clean":"2020-11-16T20:56:45.748958+0000","last_became_active":"2020-11-16T20:55:52.917496+0000","last_became_peered":"2020-11-16T20:55:52.917496+0000","last_unstale":"2020-11-16T20:56:45.748958+0000","last_undegraded":"2020-11-16T20:56:45.748958+0000","last_fullsized":"2020-11-16T20:56:45.748958+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:02.565607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:56:02.565607+0000","last_clean_scrub_stamp":"2020-11-16T20:56:02.565607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"88","reported_epoch":"83","state":"active+clean","last_fresh":"2020-11-16T20:56:45.792991+0000","last_change":"2020-11-16T20:56:01.955760+0000","last_active":"2020-11-16T20:56:45.792991+0000","last_peered":"2020-11-16T20:56:45.792991+0000","last_clean":"2020-11-16T20:56:45.792991+0000","last_became_active":"2020-11-16T20:55:52.922447+0000","last_became_peered":"2020-11-16T20:55:52.922447+0000","last_unstale":"2020-11-16T20:56:45.792991+0000","last_undegraded":"2020-11-16T20:56:45.792991+0000","last_fullsized":"2020-11-16T20:56:45.792991+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:01.955691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:01.955691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"71","reported_epoch":"83","state":"active+clean","last_fresh":"2020-11-16T20:56:45.792976+0000","last_change":"2020-11-16T20:56:18.755476+0000","last_active":"2020-11-16T20:56:45.792976+0000","last_peered":"2020-11-16T20:56:45.792976+0000","last_clean":"2020-11-16T20:56:45.792976+0000","last_became_active":"2020-11-16T20:56:18.754989+0000","last_became_peered":"2020-11-16T20:56:18.754989+0000","last_unstale":"2020-11-16T20:56:45.792976+0000","last_undegraded":"2020-11-16T20:56:45.792976+0000","last_fullsized":"2020-11-16T20:56:45.792976+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:00.967553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:00.967553+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"97","reported_epoch":"83","state":"active+clean","last_fresh":"2020-11-16T20:56:45.748891+0000","last_change":"2020-11-16T20:56:01.528273+0000","last_active":"2020-11-16T20:56:45.748891+0000","last_peered":"2020-11-16T20:56:45.748891+0000","last_clean":"2020-11-16T20:56:45.748891+0000","last_became_active":"2020-11-16T20:55:52.922303+0000","last_became_peered":"2020-11-16T20:55:52.922303+0000","last_unstale":"2020-11-16T20:56:45.748891+0000","last_undegraded":"2020-11-16T20:56:45.748891+0000","last_fullsized":"2020-11-16T20:56:45.748891+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:01.528217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:01.528217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"88","reported_epoch":"83","state":"active+clean","last_fresh":"2020-11-16T20:56:45.793034+0000","last_change":"2020-11-16T20:55:57.905062+0000","last_active":"2020-11-16T20:56:45.793034+0000","last_peered":"2020-11-16T20:56:45.793034+0000","last_clean":"2020-11-16T20:56:45.793034+0000","last_became_active":"2020-11-16T20:55:50.904146+0000","last_became_peered":"2020-11-16T20:55:50.904146+0000","last_unstale":"2020-11-16T20:56:45.793034+0000","last_undegraded":"2020-11-16T20:56:45.793034+0000","last_fullsized":"2020-11-16T20:56:45.793034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:57.905004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:57.905004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"82'335","reported_seq":"555","reported_epoch":"83","state":"active+clean","last_fresh":"2020-11-16T20:56:45.793096+0000","last_change":"2020-11-16T20:56:44.801926+0000","last_active":"2020-11-16T20:56:45.793096+0000","last_peered":"2020-11-16T20:56:45.793096+0000","last_clean":"2020-11-16T20:56:45.793096+0000","last_became_active":"2020-11-16T20:55:30.828637+0000","last_became_peered":"2020-11-16T20:55:30.828637+0000","last_unstale":"2020-11-16T20:56:45.793096+0000","last_undegraded":"2020-11-16T20:56:45.793096+0000","last_fullsized":"2020-11-16T20:56:45.793096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":335,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108439886,"num_objects":41,"num_object_clones":2,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":4,"num_read":78,"num_read_kb":34183,"num_write":170,"num_write_kb":28300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":30,"num_flush_kb":80914,"num_evict":6,"num_evict_kb":13724,"num_promote":53,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"f","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"2"},{"start":"2b","length":"1"}]},{"pgid":"2.2","version":"0'0","reported_seq":"98","reported_epoch":"84","state":"active+clean","last_fresh":"2020-11-16T20:56:47.287191+0000","last_change":"2020-11-16T20:56:26.743666+0000","last_active":"2020-11-16T20:56:47.287191+0000","last_peered":"2020-11-16T20:56:47.287191+0000","last_clean":"2020-11-16T20:56:47.287191+0000","last_became_active":"2020-11-16T20:56:26.743184+0000","last_became_peered":"2020-11-16T20:56:26.743184+0000","last_unstale":"2020-11-16T20:56:47.287191+0000","last_undegraded":"2020-11-16T20:56:47.287191+0000","last_fullsized":"2020-11-16T20:56:47.287191+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:57.606500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:57.606500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"82'662","reported_seq":"995","reported_epoch":"82","state":"active+clean","last_fresh":"2020-11-16T20:56:44.828986+0000","last_change":"2020-11-16T20:56:44.828986+0000","last_active":"2020-11-16T20:56:44.828986+0000","last_peered":"2020-11-16T20:56:44.828986+0000","last_clean":"2020-11-16T20:56:44.828986+0000","last_became_active":"2020-11-16T20:55:25.103851+0000","last_became_peered":"2020-11-16T20:55:25.103851+0000","last_unstale":"2020-11-16T20:56:44.828986+0000","last_undegraded":"2020-11-16T20:56:44.828986+0000","last_fullsized":"2020-11-16T20:56:44.828986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":662,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":348106278,"num_objects":127,"num_object_clones":6,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":0,"num_read":353,"num_read_kb":77745,"num_write":544,"num_write_kb":258539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"f","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"2"},{"start":"2b","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":"88","reported_epoch":"83","state":"active+clean","last_fresh":"2020-11-16T20:56:45.743617+0000","last_change":"2020-11-16T20:55:58.465447+0000","last_active":"2020-11-16T20:56:45.743617+0000","last_peered":"2020-11-16T20:56:45.743617+0000","last_clean":"2020-11-16T20:56:45.743617+0000","last_became_active":"2020-11-16T20:55:50.905925+0000","last_became_peered":"2020-11-16T20:55:50.905925+0000","last_unstale":"2020-11-16T20:56:45.743617+0000","last_undegraded":"2020-11-16T20:56:45.743617+0000","last_fullsized":"2020-11-16T20:56:45.743617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:58.465384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:58.465384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"82'572","reported_seq":"1160","reported_epoch":"83","state":"active+clean","last_fresh":"2020-11-16T20:56:45.797183+0000","last_change":"2020-11-16T20:56:44.822113+0000","last_active":"2020-11-16T20:56:45.797183+0000","last_peered":"2020-11-16T20:56:45.797183+0000","last_clean":"2020-11-16T20:56:45.797183+0000","last_became_active":"2020-11-16T20:56:29.739968+0000","last_became_peered":"2020-11-16T20:56:29.739968+0000","last_unstale":"2020-11-16T20:56:45.797183+0000","last_undegraded":"2020-11-16T20:56:45.797183+0000","last_fullsized":"2020-11-16T20:56:45.797183+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":572,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":329669823,"num_objects":118,"num_object_clones":4,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":1,"num_read":269,"num_read_kb":23351,"num_write":506,"num_write_kb":226690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":181673084,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"f","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"2"},{"start":"2b","length":"1"}]},{"pgid":"2.3","version":"0'0","reported_seq":"89","reported_epoch":"84","state":"active+clean","last_fresh":"2020-11-16T20:56:47.287108+0000","last_change":"2020-11-16T20:55:59.611811+0000","last_active":"2020-11-16T20:56:47.287108+0000","last_peered":"2020-11-16T20:56:47.287108+0000","last_clean":"2020-11-16T20:56:47.287108+0000","last_became_active":"2020-11-16T20:55:50.903578+0000","last_became_peered":"2020-11-16T20:55:50.903578+0000","last_unstale":"2020-11-16T20:56:47.287108+0000","last_undegraded":"2020-11-16T20:56:47.287108+0000","last_fullsized":"2020-11-16T20:56:47.287108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.611727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.611727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"84","reported_epoch":"83","state":"active+clean","last_fresh":"2020-11-16T20:56:45.749421+0000","last_change":"2020-11-16T20:56:03.542304+0000","last_active":"2020-11-16T20:56:45.749421+0000","last_peered":"2020-11-16T20:56:45.749421+0000","last_clean":"2020-11-16T20:56:45.749421+0000","last_became_active":"2020-11-16T20:54:53.112038+0000","last_became_peered":"2020-11-16T20:54:53.112038+0000","last_unstale":"2020-11-16T20:56:45.749421+0000","last_undegraded":"2020-11-16T20:56:45.749421+0000","last_fullsized":"2020-11-16T20:56:45.749421+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'2","last_scrub_stamp":"2020-11-16T20:56:03.542235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:50.068882+0000","last_clean_scrub_stamp":"2020-11-16T20:56:03.542235+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"82'575","reported_seq":"900","reported_epoch":"83","state":"active+clean","last_fresh":"2020-11-16T20:56:45.745946+0000","last_change":"2020-11-16T20:56:44.802879+0000","last_active":"2020-11-16T20:56:45.745946+0000","last_peered":"2020-11-16T20:56:45.745946+0000","last_clean":"2020-11-16T20:56:45.745946+0000","last_became_active":"2020-11-16T20:55:25.106302+0000","last_became_peered":"2020-11-16T20:55:25.106302+0000","last_unstale":"2020-11-16T20:56:45.745946+0000","last_undegraded":"2020-11-16T20:56:45.745946+0000","last_fullsized":"2020-11-16T20:56:45.745946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'549","last_scrub_stamp":"2020-11-16T20:56:39.880955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:56:39.880955+0000","log_size":575,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":323421498,"num_objects":117,"num_object_clones":1,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":0,"num_read":319,"num_read_kb":84460,"num_write":497,"num_write_kb":239232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"f","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"2"},{"start":"2b","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":"89","reported_epoch":"83","state":"active+clean","last_fresh":"2020-11-16T20:56:45.749432+0000","last_change":"2020-11-16T20:55:56.657297+0000","last_active":"2020-11-16T20:56:45.749432+0000","last_peered":"2020-11-16T20:56:45.749432+0000","last_clean":"2020-11-16T20:56:45.749432+0000","last_became_active":"2020-11-16T20:55:50.908710+0000","last_became_peered":"2020-11-16T20:55:50.908710+0000","last_unstale":"2020-11-16T20:56:45.749432+0000","last_undegraded":"2020-11-16T20:56:45.749432+0000","last_fullsized":"2020-11-16T20:56:45.749432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:56.657242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:56.657242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'693","reported_seq":"1055","reported_epoch":"85","state":"active+clean","last_fresh":"2020-11-16T20:56:47.794682+0000","last_change":"2020-11-16T20:56:47.795115+0000","last_active":"2020-11-16T20:56:47.794682+0000","last_peered":"2020-11-16T20:56:47.794682+0000","last_clean":"2020-11-16T20:56:47.794682+0000","last_became_active":"2020-11-16T20:55:24.802649+0000","last_became_peered":"2020-11-16T20:55:24.802649+0000","last_unstale":"2020-11-16T20:56:47.794682+0000","last_undegraded":"2020-11-16T20:56:47.794682+0000","last_fullsized":"2020-11-16T20:56:47.794682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'650","last_scrub_stamp":"2020-11-16T20:56:37.941529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:56:37.941529+0000","log_size":693,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":384834577,"num_objects":136,"num_object_clones":2,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":0,"num_read":407,"num_read_kb":132711,"num_write":602,"num_write_kb":260263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"f","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"2"},{"start":"2b","length":"1"},{"start":"2d","length":"1"}]},{"pgid":"4.3","version":"85'325","reported_seq":"576","reported_epoch":"85","state":"active+clean","last_fresh":"2020-11-16T20:56:47.798482+0000","last_change":"2020-11-16T20:56:47.798942+0000","last_active":"2020-11-16T20:56:47.798482+0000","last_peered":"2020-11-16T20:56:47.798482+0000","last_clean":"2020-11-16T20:56:47.798482+0000","last_became_active":"2020-11-16T20:55:30.829833+0000","last_became_peered":"2020-11-16T20:55:30.829833+0000","last_unstale":"2020-11-16T20:56:47.798482+0000","last_undegraded":"2020-11-16T20:56:47.798482+0000","last_fullsized":"2020-11-16T20:56:47.798482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":325,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":138105132,"num_objects":48,"num_object_clones":2,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":101,"num_read_kb":62357,"num_write":182,"num_write_kb":32166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":28,"num_flush_kb":80718,"num_evict":12,"num_evict_kb":32766,"num_promote":60,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"f","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"2"},{"start":"2b","length":"1"},{"start":"2d","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":"89","reported_epoch":"83","state":"active+clean","last_fresh":"2020-11-16T20:56:45.749029+0000","last_change":"2020-11-16T20:55:59.571968+0000","last_active":"2020-11-16T20:56:45.749029+0000","last_peered":"2020-11-16T20:56:45.749029+0000","last_clean":"2020-11-16T20:56:45.749029+0000","last_became_active":"2020-11-16T20:55:50.901014+0000","last_became_peered":"2020-11-16T20:55:50.901014+0000","last_unstale":"2020-11-16T20:56:45.749029+0000","last_undegraded":"2020-11-16T20:56:45.749029+0000","last_fullsized":"2020-11-16T20:56:45.749029+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.571892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.571892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"88","reported_epoch":"83","state":"active+clean","last_fresh":"2020-11-16T20:56:45.793166+0000","last_change":"2020-11-16T20:55:59.950321+0000","last_active":"2020-11-16T20:56:45.793166+0000","last_peered":"2020-11-16T20:56:45.793166+0000","last_clean":"2020-11-16T20:56:45.793166+0000","last_became_active":"2020-11-16T20:55:50.905408+0000","last_became_peered":"2020-11-16T20:55:50.905408+0000","last_unstale":"2020-11-16T20:56:45.793166+0000","last_undegraded":"2020-11-16T20:56:45.793166+0000","last_fullsized":"2020-11-16T20:56:45.793166+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.950219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.950219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"83'286","reported_seq":"513","reported_epoch":"84","state":"creating+peering","last_fresh":"2020-11-16T20:56:46.792365+0000","last_change":"2020-11-16T20:56:46.792215+0000","last_active":"2020-11-16T20:55:29.809179+0000","last_peered":"2020-11-16T20:55:29.809179+0000","last_clean":"2020-11-16T20:55:29.809179+0000","last_became_active":"2020-11-16T20:56:45.798139+0000","last_became_peered":"2020-11-16T20:56:45.798139+0000","last_unstale":"2020-11-16T20:56:46.792365+0000","last_undegraded":"2020-11-16T20:56:46.792365+0000","last_fullsized":"2020-11-16T20:56:46.792365+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":286,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":133985001,"num_objects":51,"num_object_clones":11,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":2,"num_read":106,"num_read_kb":81904,"num_write":133,"num_write_kb":32051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":7350012,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":21,"num_flush_kb":58014,"num_evict":8,"num_evict_kb":23623,"num_promote":48,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"21","length":"1"},{"start":"26","length":"2"}]},{"pgid":"2.7","version":"0'0","reported_seq":"87","reported_epoch":"82","state":"active+clean","last_fresh":"2020-11-16T20:56:44.739286+0000","last_change":"2020-11-16T20:55:59.645073+0000","last_active":"2020-11-16T20:56:44.739286+0000","last_peered":"2020-11-16T20:56:44.739286+0000","last_clean":"2020-11-16T20:56:44.739286+0000","last_became_active":"2020-11-16T20:55:50.905649+0000","last_became_peered":"2020-11-16T20:55:50.905649+0000","last_unstale":"2020-11-16T20:56:44.739286+0000","last_undegraded":"2020-11-16T20:56:44.739286+0000","last_fullsized":"2020-11-16T20:56:44.739286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.644996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.644996+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"83'285","reported_seq":"623","reported_epoch":"83","state":"active+clean","last_fresh":"2020-11-16T20:56:45.948296+0000","last_change":"2020-11-16T20:56:44.796712+0000","last_active":"2020-11-16T20:56:45.948296+0000","last_peered":"2020-11-16T20:56:45.948296+0000","last_clean":"2020-11-16T20:56:45.948296+0000","last_became_active":"2020-11-16T20:56:16.750108+0000","last_became_peered":"2020-11-16T20:56:16.750108+0000","last_unstale":"2020-11-16T20:56:45.948296+0000","last_undegraded":"2020-11-16T20:56:45.948296+0000","last_fullsized":"2020-11-16T20:56:45.948296+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'266","last_scrub_stamp":"2020-11-16T20:56:42.351294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:56:42.351294+0000","log_size":285,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":120023896,"num_objects":43,"num_object_clones":1,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":3,"num_read":96,"num_read_kb":60595,"num_write":158,"num_write_kb":34018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":91753326,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":23,"num_flush_kb":68128,"num_evict":9,"num_evict_kb":27793,"num_promote":53,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"f","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"2"},{"start":"2b","length":"1"}]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":500553915,"num_objects":183,"num_object_clones":16,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":9,"num_read":381,"num_read_kb":239039,"num_write":643,"num_write_kb":126535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":99103338,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":102,"num_flush_kb":287774,"num_evict":35,"num_evict_kb":97906,"num_promote":214,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1505517568,"data_stored":1543885867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1231,"ondisk_log_size":1231,"up":12,"acting":12,"num_store_stats":8},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":1386032176,"num_objects":498,"num_object_clones":13,"num_object_copies":1494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":498,"num_whiteouts":1,"num_read":1348,"num_read_kb":318267,"num_write":2149,"num_write_kb":984724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":181673084,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2500247552,"data_stored":2515777791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2502,"ondisk_log_size":2502,"up":12,"acting":12,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":18,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":237180,"kb_used_data":229352,"kb_used_omap":0,"kb_used_meta":7424,"kb_avail":94134660,"statfs":{"total":96636764160,"available":96393891840,"internally_reserved":0,"allocated":234856448,"data_stored":246253112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7602176},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.66300000000000003}]},{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.3180000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.90900000000000003}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.0449999999999999}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.179},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.98999999999999999}]},{"osd":4,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.252},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.85599999999999998}]},{"osd":5,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":1.151},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.95899999999999996}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.079}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":518984,"kb_used_data":504704,"kb_used_omap":0,"kb_used_meta":14272,"kb_avail":93852856,"statfs":{"total":96636764160,"available":96105324544,"internally_reserved":0,"allocated":516816896,"data_stored":523445576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14614528},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.2250000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.65400000000000003}]},{"osd":1,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":1.0940000000000001}]},{"osd":2,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":1.1719999999999999}]},{"osd":3,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.82699999999999996}]},{"osd":4,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.028},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.0049999999999999}]},{"osd":5,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.2789999999999999}]},{"osd":7,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.96799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":414052,"kb_used_data":401564,"kb_used_omap":0,"kb_used_meta":12480,"kb_avail":93957788,"statfs":{"total":96636764160,"available":96212774912,"internally_reserved":0,"allocated":411201536,"data_stored":409298124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12779520},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.875},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.746}]},{"osd":2,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.63600000000000001}]},{"osd":3,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.677,"5min":2.677,"15min":2.677},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.2470000000000001}]},{"osd":4,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.048},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":2.3010000000000002}]},{"osd":5,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":0.90500000000000003}]},{"osd":6,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.552}]},{"osd":7,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"max":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.1419999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":852712,"kb_used_data":832480,"kb_used_omap":0,"kb_used_meta":20224,"kb_avail":93519128,"statfs":{"total":96636764160,"available":95763587072,"internally_reserved":0,"allocated":852459520,"data_stored":867692634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20709376},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.745}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.621}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.72499999999999998}]},{"osd":4,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.03}]},{"osd":5,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.139},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.83199999999999996}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":1.0569999999999999}]},{"osd":7,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"max":{"1min":1.954,"5min":1.954,"15min":1.954},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.238}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":323448,"kb_used_data":311984,"kb_used_omap":0,"kb_used_meta":11456,"kb_avail":94048392,"statfs":{"total":96636764160,"available":96305553408,"internally_reserved":0,"allocated":319471616,"data_stored":317774871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11730944},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.60399999999999998}]},{"osd":1,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.73899999999999999}]},{"osd":3,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.871}]},{"osd":4,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.82299999999999995}]},{"osd":5,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.89900000000000002}]},{"osd":6,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.155}]},{"osd":7,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.026},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.1220000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":635980,"kb_used_data":621764,"kb_used_omap":0,"kb_used_meta":14208,"kb_avail":93735860,"statfs":{"total":96636764160,"available":95985520640,"internally_reserved":0,"allocated":636686336,"data_stored":646301905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14548992},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.54700000000000004}]},{"osd":1,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.69599999999999995}]},{"osd":2,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.81599999999999995}]},{"osd":4,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.923,"5min":2.923,"15min":2.923},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.968,"5min":2.968,"15min":2.968},"last":0.76200000000000001}]},{"osd":5,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.8479999999999999,"5min":2.8479999999999999,"15min":2.8479999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.0389999999999999}]},{"osd":6,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.859,"5min":2.859,"15min":2.859},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":3.5390000000000001,"5min":3.5390000000000001,"15min":3.5390000000000001},"last":0.93200000000000005}]},{"osd":7,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.9780000000000002,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":0.98599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":631780,"kb_used_data":617436,"kb_used_omap":0,"kb_used_meta":14336,"kb_avail":93740060,"statfs":{"total":96636764160,"available":95989821440,"internally_reserved":0,"allocated":632254464,"data_stored":638793755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14680064},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.92100000000000004}]},{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.58799999999999997}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":1.167}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.62},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.873}]},{"osd":5,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.76400000000000001}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.2949999999999999}]},{"osd":7,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":2.4369999999999998,"5min":2.4369999999999998,"15min":2.4369999999999998},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.004}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413772,"kb_used_data":400120,"kb_used_omap":0,"kb_used_meta":13248,"kb_avail":93958068,"statfs":{"total":96636764160,"available":96213061632,"internally_reserved":0,"allocated":409722880,"data_stored":413696907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13565952},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.90700000000000003}]},{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.70499999999999996}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.054}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":1.0820000000000001}]},{"osd":4,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.002},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.98599999999999999}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.84699999999999998}]},{"osd":7,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":1.107,"5min":1.107,"15min":1.107},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.385}]}]}]}} 2020-11-16T20:56:49.179 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:49.183+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:49.237 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:49.237 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:49.237 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:56:49.237 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:49.246 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:56:49.287 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:49.292+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:49.381 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:49.385+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:49.420 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:49.420 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:49.421 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:56:49.421 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:56:49.421 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:49.430 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:56:49.482 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:49.487+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:49.566 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:49.566 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:56:49.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:56:49.567 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:56:49.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.567 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:37 4.1 e33/22 4:b6545a47:::smithi16641208-46:head v 33'28, mlcod=33'26)", 2020-11-16T20:56:49.567 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.515282+0000", 2020-11-16T20:56:49.567 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 58.054658674999999, 2020-11-16T20:56:49.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016792344000000001, 2020-11-16T20:56:49.568 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.568 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:49.568 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.515282+0000", 2020-11-16T20:56:49.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.515282+0000", 2020-11-16T20:56:49.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0010571840000000001 2020-11-16T20:56:49.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516339+0000", 2020-11-16T20:56:49.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3354e-05 2020-11-16T20:56:49.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516352+0000", 2020-11-16T20:56:49.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7071999999999998e-05 2020-11-16T20:56:49.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.571 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516369+0000", 2020-11-16T20:56:49.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1358e-05 2020-11-16T20:56:49.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516381+0000", 2020-11-16T20:56:49.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5952999999999998e-05 2020-11-16T20:56:49.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516437+0000", 2020-11-16T20:56:49.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5420999999999998e-05 2020-11-16T20:56:49.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516472+0000", 2020-11-16T20:56:49.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015544192 2020-11-16T20:56:49.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:49.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532016+0000", 2020-11-16T20:56:49.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7809999999999997e-05 2020-11-16T20:56:49.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532074+0000", 2020-11-16T20:56:49.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016792344000000001 2020-11-16T20:56:49.575 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.575 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.575 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.575 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:39 4.1 e33/22 4:81558809:::smithi16641208-47:head v 33'30, mlcod=33'26)", 2020-11-16T20:56:49.575 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.519956+0000", 2020-11-16T20:56:49.576 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 58.049984528000003, 2020-11-16T20:56:49.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017898104000000001, 2020-11-16T20:56:49.576 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.576 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:49.576 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519956+0000", 2020-11-16T20:56:49.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519956+0000", 2020-11-16T20:56:49.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00038710900000000001 2020-11-16T20:56:49.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520343+0000", 2020-11-16T20:56:49.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0797e-05 2020-11-16T20:56:49.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520354+0000", 2020-11-16T20:56:49.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5874000000000001e-05 2020-11-16T20:56:49.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520370+0000", 2020-11-16T20:56:49.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3580000000000003e-06 2020-11-16T20:56:49.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520378+0000", 2020-11-16T20:56:49.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5744000000000001e-05 2020-11-16T20:56:49.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520424+0000", 2020-11-16T20:56:49.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4641e-05 2020-11-16T20:56:49.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520449+0000", 2020-11-16T20:56:49.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01735014 2020-11-16T20:56:49.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:49.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.537799+0000", 2020-11-16T20:56:49.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5441e-05 2020-11-16T20:56:49.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.537854+0000", 2020-11-16T20:56:49.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017898104000000001 2020-11-16T20:56:49.583 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.583 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.583 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.584 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:202 3.2 e35/19 3:5723fd94:::smithi16641208-211:head v 35'124, mlcod=35'121)", 2020-11-16T20:56:49.584 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.980847+0000", 2020-11-16T20:56:49.584 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 54.589093769000002, 2020-11-16T20:56:49.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015747763000000001, 2020-11-16T20:56:49.584 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.584 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:49.584 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.980847+0000", 2020-11-16T20:56:49.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.980847+0000", 2020-11-16T20:56:49.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072722660000000003 2020-11-16T20:56:49.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988119+0000", 2020-11-16T20:56:49.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2539e-05 2020-11-16T20:56:49.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988132+0000", 2020-11-16T20:56:49.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3723000000000001e-05 2020-11-16T20:56:49.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988145+0000", 2020-11-16T20:56:49.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8379999999999998e-06 2020-11-16T20:56:49.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988151+0000", 2020-11-16T20:56:49.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2691000000000002e-05 2020-11-16T20:56:49.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988194+0000", 2020-11-16T20:56:49.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8366e-05 2020-11-16T20:56:49.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988212+0000", 2020-11-16T20:56:49.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0083214259999999998 2020-11-16T20:56:49.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:49.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.996534+0000", 2020-11-16T20:56:49.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0914e-05 2020-11-16T20:56:49.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.996595+0000", 2020-11-16T20:56:49.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015747763000000001 2020-11-16T20:56:49.591 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.591 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.591 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.592 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:538 4.3 e41/22 4:c9160c9c:::smithi16641208-411:head v 41'95, mlcod=37'93)", 2020-11-16T20:56:49.592 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:56:49.592 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 45.444294718999998, 2020-11-16T20:56:49.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021023377999999999, 2020-11-16T20:56:49.592 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.592 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:49.593 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:56:49.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:56:49.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052206140000000002 2020-11-16T20:56:49.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130866+0000", 2020-11-16T20:56:49.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0824e-05 2020-11-16T20:56:49.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130877+0000", 2020-11-16T20:56:49.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5384e-05 2020-11-16T20:56:49.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130893+0000", 2020-11-16T20:56:49.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0064999999999999e-05 2020-11-16T20:56:49.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130903+0000", 2020-11-16T20:56:49.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3051000000000003e-05 2020-11-16T20:56:49.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130966+0000", 2020-11-16T20:56:49.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9724e-05 2020-11-16T20:56:49.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130985+0000", 2020-11-16T20:56:49.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015638332000000001 2020-11-16T20:56:49.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:49.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.146624+0000", 2020-11-16T20:56:49.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5383999999999998e-05 2020-11-16T20:56:49.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.146669+0000", 2020-11-16T20:56:49.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021023377999999999 2020-11-16T20:56:49.599 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.599 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.600 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.600 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:547 3.2 e42/19 3:5f250a2b:::smithi16641208-75:head v 42'381, mlcod=42'379)", 2020-11-16T20:56:49.600 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.026221+0000", 2020-11-16T20:56:49.600 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 44.543719183999997, 2020-11-16T20:56:49.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014398213, 2020-11-16T20:56:49.600 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.601 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:49.601 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.026221+0000", 2020-11-16T20:56:49.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.026221+0000", 2020-11-16T20:56:49.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052355140000000001 2020-11-16T20:56:49.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031457+0000", 2020-11-16T20:56:49.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3457e-05 2020-11-16T20:56:49.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031470+0000", 2020-11-16T20:56:49.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6532e-05 2020-11-16T20:56:49.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031487+0000", 2020-11-16T20:56:49.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6479999999999992e-06 2020-11-16T20:56:49.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031496+0000", 2020-11-16T20:56:49.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5820000000000003e-05 2020-11-16T20:56:49.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031561+0000", 2020-11-16T20:56:49.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6701999999999999e-05 2020-11-16T20:56:49.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031588+0000", 2020-11-16T20:56:49.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089396879999999995 2020-11-16T20:56:49.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:49.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.040528+0000", 2020-11-16T20:56:49.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1852000000000001e-05 2020-11-16T20:56:49.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.040620+0000", 2020-11-16T20:56:49.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014398213 2020-11-16T20:56:49.607 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.608 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.608 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.608 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2367 4.2 e42/22 4:581c1e5b:::smithi16641208-124:head v 42'136, mlcod=42'133)", 2020-11-16T20:56:49.608 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:56:49.608 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 44.516596341000003, 2020-11-16T20:56:49.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021196474999999999, 2020-11-16T20:56:49.609 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.609 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:49.609 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:56:49.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:56:49.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070663000000000002 2020-11-16T20:56:49.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060411+0000", 2020-11-16T20:56:49.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0189999999999995e-06 2020-11-16T20:56:49.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060420+0000", 2020-11-16T20:56:49.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0069e-05 2020-11-16T20:56:49.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060430+0000", 2020-11-16T20:56:49.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6879999999999999e-06 2020-11-16T20:56:49.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060437+0000", 2020-11-16T20:56:49.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3671999999999995e-05 2020-11-16T20:56:49.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060511+0000", 2020-11-16T20:56:49.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6801999999999998e-05 2020-11-16T20:56:49.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060548+0000", 2020-11-16T20:56:49.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013927701000000001 2020-11-16T20:56:49.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:49.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074475+0000", 2020-11-16T20:56:49.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5223999999999998e-05 2020-11-16T20:56:49.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074541+0000", 2020-11-16T20:56:49.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021196474999999999 2020-11-16T20:56:49.616 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.616 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.616 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.616 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:507 4.2 e42/22 4:646fee8a:::smithi16641208-407:head v 42'137, mlcod=42'133)", 2020-11-16T20:56:49.616 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.060496+0000", 2020-11-16T20:56:49.617 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 44.509445014999997, 2020-11-16T20:56:49.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014098016999999999, 2020-11-16T20:56:49.617 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.617 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:49.617 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060496+0000", 2020-11-16T20:56:49.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060496+0000", 2020-11-16T20:56:49.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054601980000000003 2020-11-16T20:56:49.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.065956+0000", 2020-11-16T20:56:49.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0848e-05 2020-11-16T20:56:49.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.620 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.065967+0000", 2020-11-16T20:56:49.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2801e-05 2020-11-16T20:56:49.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.620 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.620 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.065979+0000", 2020-11-16T20:56:49.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0550999999999999e-05 2020-11-16T20:56:49.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.065990+0000", 2020-11-16T20:56:49.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6890000000000005e-05 2020-11-16T20:56:49.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.066057+0000", 2020-11-16T20:56:49.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4836000000000001e-05 2020-11-16T20:56:49.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.066082+0000", 2020-11-16T20:56:49.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084662330000000001 2020-11-16T20:56:49.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:49.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074548+0000", 2020-11-16T20:56:49.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.566e-05 2020-11-16T20:56:49.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.624 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074594+0000", 2020-11-16T20:56:49.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014098016999999999 2020-11-16T20:56:49.624 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.624 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.624 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.624 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:554 3.2 e42/19 3:769099fd:::smithi16641208-247:head v 42'386, mlcod=42'384)", 2020-11-16T20:56:49.625 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:56:49.625 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 44.499677368, 2020-11-16T20:56:49.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029531213000000001, 2020-11-16T20:56:49.625 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.625 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:49.625 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:56:49.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:56:49.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007828448 2020-11-16T20:56:49.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078092+0000", 2020-11-16T20:56:49.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2031000000000001e-05 2020-11-16T20:56:49.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078104+0000", 2020-11-16T20:56:49.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3950000000000001e-06 2020-11-16T20:56:49.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.628 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.628 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078112+0000", 2020-11-16T20:56:49.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.434e-06 2020-11-16T20:56:49.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.629 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.629 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.629 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078117+0000", 2020-11-16T20:56:49.629 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0217999999999999e-05 2020-11-16T20:56:49.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.629 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078168+0000", 2020-11-16T20:56:49.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6242e-05 2020-11-16T20:56:49.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078194+0000", 2020-11-16T20:56:49.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021550488 2020-11-16T20:56:49.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.631 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:49.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099744+0000", 2020-11-16T20:56:49.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9957000000000003e-05 2020-11-16T20:56:49.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.632 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.632 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099794+0000", 2020-11-16T20:56:49.632 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029531213000000001 2020-11-16T20:56:49.632 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.632 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.632 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.632 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.633 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2376 4.2 e42/22 4:540952ab:::smithi16641208-369:head v 42'142, mlcod=42'136)", 2020-11-16T20:56:49.633 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.077213+0000", 2020-11-16T20:56:49.633 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 44.492727272000003, 2020-11-16T20:56:49.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015666645, 2020-11-16T20:56:49.633 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.633 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:49.633 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.634 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.634 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077213+0000", 2020-11-16T20:56:49.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.634 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.634 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077213+0000", 2020-11-16T20:56:49.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9294e-05 2020-11-16T20:56:49.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.635 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.635 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077253+0000", 2020-11-16T20:56:49.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6004e-05 2020-11-16T20:56:49.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.636 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077279+0000", 2020-11-16T20:56:49.636 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.291e-05 2020-11-16T20:56:49.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.636 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.636 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.636 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077291+0000", 2020-11-16T20:56:49.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.225e-05 2020-11-16T20:56:49.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.637 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.637 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.637 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077304+0000", 2020-11-16T20:56:49.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9744e-05 2020-11-16T20:56:49.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.638 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.638 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077393+0000", 2020-11-16T20:56:49.638 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5826e-05 2020-11-16T20:56:49.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.638 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077419+0000", 2020-11-16T20:56:49.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015403659 2020-11-16T20:56:49.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:49.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.092823+0000", 2020-11-16T20:56:49.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6957999999999999e-05 2020-11-16T20:56:49.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.092880+0000", 2020-11-16T20:56:49.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015666645 2020-11-16T20:56:49.640 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.640 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.640 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.641 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:555 3.2 e42/19 3:590e6edd:::smithi16641208-203:head v 42'387, mlcod=42'384)", 2020-11-16T20:56:49.641 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:56:49.641 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 44.491796524000002, 2020-11-16T20:56:49.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021681786000000002, 2020-11-16T20:56:49.641 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.641 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:49.642 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.642 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.642 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.642 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:56:49.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.642 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.643 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.643 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:56:49.643 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6817999999999998e-05 2020-11-16T20:56:49.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.643 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.643 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078191+0000", 2020-11-16T20:56:49.643 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7800000000000003e-06 2020-11-16T20:56:49.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.644 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.644 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.644 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078198+0000", 2020-11-16T20:56:49.644 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0331e-05 2020-11-16T20:56:49.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.644 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.645 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078208+0000", 2020-11-16T20:56:49.645 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8429999999999998e-06 2020-11-16T20:56:49.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.645 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078214+0000", 2020-11-16T20:56:49.645 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0025044690000000001 2020-11-16T20:56:49.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.646 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.646 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.646 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080718+0000", 2020-11-16T20:56:49.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027441100000000001 2020-11-16T20:56:49.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.646 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.647 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.647 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080993+0000", 2020-11-16T20:56:49.647 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018806976999999999 2020-11-16T20:56:49.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.647 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.647 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:49.647 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099800+0000", 2020-11-16T20:56:49.647 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6157e-05 2020-11-16T20:56:49.648 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.648 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.648 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.648 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099826+0000", 2020-11-16T20:56:49.648 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021681786000000002 2020-11-16T20:56:49.648 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.648 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.649 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.649 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.649 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:485 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'94, mlcod=41'92)", 2020-11-16T20:56:49.649 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:56:49.649 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 44.491227557000002, 2020-11-16T20:56:49.649 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021768460999999999, 2020-11-16T20:56:49.649 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.650 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:49.650 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.650 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:56:49.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.651 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.651 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.651 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:56:49.651 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001603103 2020-11-16T20:56:49.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.651 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.651 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.652 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080316+0000", 2020-11-16T20:56:49.652 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4956e-05 2020-11-16T20:56:49.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.652 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.652 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.652 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080331+0000", 2020-11-16T20:56:49.652 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6291e-05 2020-11-16T20:56:49.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.653 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.653 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.653 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080347+0000", 2020-11-16T20:56:49.653 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3090000000000001e-06 2020-11-16T20:56:49.653 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.653 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.653 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.654 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080357+0000", 2020-11-16T20:56:49.654 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7073000000000001e-05 2020-11-16T20:56:49.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.654 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.654 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.654 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080414+0000", 2020-11-16T20:56:49.654 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5877e-05 2020-11-16T20:56:49.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.655 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.655 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.655 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080440+0000", 2020-11-16T20:56:49.655 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019927006000000001 2020-11-16T20:56:49.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.655 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.655 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:49.656 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100367+0000", 2020-11-16T20:56:49.656 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114846 2020-11-16T20:56:49.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.656 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.656 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.656 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100481+0000", 2020-11-16T20:56:49.656 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021768460999999999 2020-11-16T20:56:49.656 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.657 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.657 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.657 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.657 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:556 3.2 e42/19 3:590e6edd:::smithi16641208-203:head v 42'388, mlcod=42'384)", 2020-11-16T20:56:49.657 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.081175+0000", 2020-11-16T20:56:49.657 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 44.488765675000003, 2020-11-16T20:56:49.658 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020119680000000001, 2020-11-16T20:56:49.658 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.658 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:49.658 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.658 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.658 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.658 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081175+0000", 2020-11-16T20:56:49.659 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.659 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.659 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.659 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.659 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081175+0000", 2020-11-16T20:56:49.659 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084338599999999996 2020-11-16T20:56:49.659 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.659 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.660 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.660 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089609+0000", 2020-11-16T20:56:49.660 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1812e-05 2020-11-16T20:56:49.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.660 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.660 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.660 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089621+0000", 2020-11-16T20:56:49.661 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6175e-05 2020-11-16T20:56:49.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.661 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.661 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.661 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089637+0000", 2020-11-16T20:56:49.661 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2799999999999992e-06 2020-11-16T20:56:49.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.661 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.662 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.662 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089646+0000", 2020-11-16T20:56:49.662 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1341999999999998e-05 2020-11-16T20:56:49.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.662 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.662 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.662 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089687+0000", 2020-11-16T20:56:49.663 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3351999999999999e-05 2020-11-16T20:56:49.663 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.663 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.663 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.663 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089711+0000", 2020-11-16T20:56:49.663 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011527864000000001 2020-11-16T20:56:49.663 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.663 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.664 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:49.664 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101239+0000", 2020-11-16T20:56:49.664 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5995000000000002e-05 2020-11-16T20:56:49.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.664 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.664 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.664 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101295+0000", 2020-11-16T20:56:49.665 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020119680000000001 2020-11-16T20:56:49.665 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.665 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.665 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.665 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.665 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2370 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'95, mlcod=41'92)", 2020-11-16T20:56:49.665 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.083328+0000", 2020-11-16T20:56:49.666 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 44.486612974000003, 2020-11-16T20:56:49.666 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01719561, 2020-11-16T20:56:49.666 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.666 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:49.666 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.666 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.666 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.667 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083328+0000", 2020-11-16T20:56:49.667 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.667 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.667 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.667 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083328+0000", 2020-11-16T20:56:49.667 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00037936799999999999 2020-11-16T20:56:49.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.668 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.668 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.668 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083707+0000", 2020-11-16T20:56:49.668 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7088999999999999e-05 2020-11-16T20:56:49.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.668 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.668 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.669 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083724+0000", 2020-11-16T20:56:49.669 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6737999999999999e-05 2020-11-16T20:56:49.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.669 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.669 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.669 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083771+0000", 2020-11-16T20:56:49.669 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7869000000000001e-05 2020-11-16T20:56:49.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.670 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.670 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083789+0000", 2020-11-16T20:56:49.670 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0046429339999999996 2020-11-16T20:56:49.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.670 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.671 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.088432+0000", 2020-11-16T20:56:49.671 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7565999999999998e-05 2020-11-16T20:56:49.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.671 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.671 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.088479+0000", 2020-11-16T20:56:49.671 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012005706 2020-11-16T20:56:49.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.672 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.672 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:49.672 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100485+0000", 2020-11-16T20:56:49.672 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8340000000000002e-05 2020-11-16T20:56:49.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.672 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.672 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.673 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100523+0000", 2020-11-16T20:56:49.673 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01719561 2020-11-16T20:56:49.673 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.673 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.673 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.673 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.674 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2371 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'96, mlcod=41'92)", 2020-11-16T20:56:49.674 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.084682+0000", 2020-11-16T20:56:49.674 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 44.485258827999999, 2020-11-16T20:56:49.674 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015864851999999999, 2020-11-16T20:56:49.674 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.674 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:49.674 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.675 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084682+0000", 2020-11-16T20:56:49.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.675 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084682+0000", 2020-11-16T20:56:49.676 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1321e-05 2020-11-16T20:56:49.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.676 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.676 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.676 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084723+0000", 2020-11-16T20:56:49.676 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9310000000000008e-06 2020-11-16T20:56:49.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.677 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.677 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084731+0000", 2020-11-16T20:56:49.677 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1453e-05 2020-11-16T20:56:49.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.677 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.677 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084742+0000", 2020-11-16T20:56:49.678 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9670000000000004e-06 2020-11-16T20:56:49.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084749+0000", 2020-11-16T20:56:49.678 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048588700000000004 2020-11-16T20:56:49.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.679 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.679 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089608+0000", 2020-11-16T20:56:49.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3699999999999998e-05 2020-11-16T20:56:49.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.679 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.679 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089652+0000", 2020-11-16T20:56:49.680 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010873481000000001 2020-11-16T20:56:49.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.680 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.680 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:49.680 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100525+0000", 2020-11-16T20:56:49.680 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1129e-05 2020-11-16T20:56:49.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.681 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.681 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.681 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100547+0000", 2020-11-16T20:56:49.681 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015864851999999999 2020-11-16T20:56:49.681 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.681 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.681 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.682 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.682 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:663 4.3 e57/22 4:f65e82cb:::smithi16641208-219:head v 57'179, mlcod=57'176)", 2020-11-16T20:56:49.682 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:56:49.682 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.773112486999999, 2020-11-16T20:56:49.682 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022540092000000001, 2020-11-16T20:56:49.682 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.682 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:49.683 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.683 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.683 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:56:49.683 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.684 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.684 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:56:49.684 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013414394 2020-11-16T20:56:49.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.684 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.684 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.684 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810242+0000", 2020-11-16T20:56:49.684 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1864e-05 2020-11-16T20:56:49.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.685 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.685 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.685 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810254+0000", 2020-11-16T20:56:49.685 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3716e-05 2020-11-16T20:56:49.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.685 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.686 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.686 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810268+0000", 2020-11-16T20:56:49.686 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.064e-06 2020-11-16T20:56:49.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.686 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.686 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.686 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810277+0000", 2020-11-16T20:56:49.687 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0560999999999998e-05 2020-11-16T20:56:49.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.687 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.687 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.687 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810338+0000", 2020-11-16T20:56:49.687 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7523999999999999e-05 2020-11-16T20:56:49.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.687 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.688 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.688 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810365+0000", 2020-11-16T20:56:49.688 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089020890000000002 2020-11-16T20:56:49.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.688 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.688 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:49.688 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819267+0000", 2020-11-16T20:56:49.688 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010088 2020-11-16T20:56:49.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.689 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.689 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.689 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819368+0000", 2020-11-16T20:56:49.689 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022540092000000001 2020-11-16T20:56:49.689 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.689 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.690 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.690 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.690 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.690 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:618 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'243, mlcod=57'241)", 2020-11-16T20:56:49.690 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:56:49.690 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.769606412000002, 2020-11-16T20:56:49.690 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049183098000000001, 2020-11-16T20:56:49.690 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.691 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:49.691 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.691 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.691 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.691 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:56:49.691 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.691 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.692 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.692 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:56:49.692 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019114651 2020-11-16T20:56:49.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.692 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.692 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819449+0000", 2020-11-16T20:56:49.693 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.398e-05 2020-11-16T20:56:49.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.693 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.693 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819463+0000", 2020-11-16T20:56:49.693 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1139e-05 2020-11-16T20:56:49.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.694 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.694 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.694 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819474+0000", 2020-11-16T20:56:49.694 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1860000000000003e-06 2020-11-16T20:56:49.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.694 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.694 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.694 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819481+0000", 2020-11-16T20:56:49.695 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015472700000000001 2020-11-16T20:56:49.695 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.695 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.695 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.695 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819636+0000", 2020-11-16T20:56:49.695 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9632e-05 2020-11-16T20:56:49.695 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.696 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.696 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819665+0000", 2020-11-16T20:56:49.696 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029788289999999999 2020-11-16T20:56:49.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.696 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:49.696 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849454+0000", 2020-11-16T20:56:49.697 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3492999999999997e-05 2020-11-16T20:56:49.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.697 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.697 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.697 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849517+0000", 2020-11-16T20:56:49.697 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049183098000000001 2020-11-16T20:56:49.697 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.698 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.698 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.698 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.698 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:609 3.2 e57/19 3:5eead97c:::smithi16641208-34:head v 57'498, mlcod=57'495)", 2020-11-16T20:56:49.698 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:56:49.698 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.759326912999999, 2020-11-16T20:56:49.699 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039221579999999999, 2020-11-16T20:56:49.699 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.699 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:49.699 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.699 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.699 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.699 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:56:49.699 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.700 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.700 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.700 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:56:49.700 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008889859 2020-11-16T20:56:49.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.700 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.701 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.701 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819503+0000", 2020-11-16T20:56:49.701 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0149000000000001e-05 2020-11-16T20:56:49.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.701 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.701 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.701 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819514+0000", 2020-11-16T20:56:49.701 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1049999999999999e-05 2020-11-16T20:56:49.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.702 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.702 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819525+0000", 2020-11-16T20:56:49.702 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4829999999999999e-06 2020-11-16T20:56:49.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.703 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.703 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819533+0000", 2020-11-16T20:56:49.703 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031805760000000001 2020-11-16T20:56:49.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.703 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.703 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.703 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822714+0000", 2020-11-16T20:56:49.703 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0954000000000002e-05 2020-11-16T20:56:49.704 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.704 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.704 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.704 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822745+0000", 2020-11-16T20:56:49.704 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027044038999999999 2020-11-16T20:56:49.704 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.704 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.705 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:49.705 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849789+0000", 2020-11-16T20:56:49.705 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6470000000000001e-05 2020-11-16T20:56:49.705 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.705 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.705 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.705 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849835+0000", 2020-11-16T20:56:49.705 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039221579999999999 2020-11-16T20:56:49.706 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.706 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.706 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.706 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.706 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.706 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2583 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'244, mlcod=57'241)", 2020-11-16T20:56:49.706 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:56:49.707 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 29.750409378000001, 2020-11-16T20:56:49.707 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030101836999999999, 2020-11-16T20:56:49.707 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.707 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:49.707 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.707 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.707 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.707 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:56:49.708 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.708 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.708 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.708 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.708 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:56:49.708 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3781e-05 2020-11-16T20:56:49.708 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.709 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.709 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.709 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819575+0000", 2020-11-16T20:56:49.709 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3355e-05 2020-11-16T20:56:49.709 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.709 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.709 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.710 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819588+0000", 2020-11-16T20:56:49.710 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8198e-05 2020-11-16T20:56:49.710 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.710 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.710 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.710 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819657+0000", 2020-11-16T20:56:49.710 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5849999999999999e-05 2020-11-16T20:56:49.710 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.711 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.711 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.711 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819672+0000", 2020-11-16T20:56:49.711 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003042473 2020-11-16T20:56:49.711 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.711 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.711 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.712 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822715+0000", 2020-11-16T20:56:49.712 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9779999999999999e-05 2020-11-16T20:56:49.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.712 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.712 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.712 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822745+0000", 2020-11-16T20:56:49.712 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026828521000000001 2020-11-16T20:56:49.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.713 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.713 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:49.713 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849573+0000", 2020-11-16T20:56:49.713 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9879e-05 2020-11-16T20:56:49.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.713 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.713 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.714 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849633+0000", 2020-11-16T20:56:49.714 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030101836999999999 2020-11-16T20:56:49.714 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.714 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.714 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.714 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.714 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.714 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:728 4.3 e69/22 4:ccdf634d:::smithi16641208-284:head v 69'228, mlcod=61'226)", 2020-11-16T20:56:49.715 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:31.767600+0000", 2020-11-16T20:56:49.715 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 17.802340312999998, 2020-11-16T20:56:49.715 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014161465, 2020-11-16T20:56:49.715 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.715 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:49.715 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.715 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.716 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.716 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.767600+0000", 2020-11-16T20:56:49.716 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.716 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.716 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.716 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.767600+0000", 2020-11-16T20:56:49.716 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053383129999999999 2020-11-16T20:56:49.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.717 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.717 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.717 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.772939+0000", 2020-11-16T20:56:49.717 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0958000000000001e-05 2020-11-16T20:56:49.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.717 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.718 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.718 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.772950+0000", 2020-11-16T20:56:49.718 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0628999999999999e-05 2020-11-16T20:56:49.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.718 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.718 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.718 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.772960+0000", 2020-11-16T20:56:49.718 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9689999999999999e-06 2020-11-16T20:56:49.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.719 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.719 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.719 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.772966+0000", 2020-11-16T20:56:49.719 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3246999999999999e-05 2020-11-16T20:56:49.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.719 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.720 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.720 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.773029+0000", 2020-11-16T20:56:49.720 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2042000000000003e-05 2020-11-16T20:56:49.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.720 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.720 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.773061+0000", 2020-11-16T20:56:49.720 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0086372619999999997 2020-11-16T20:56:49.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.721 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.721 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:49.721 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.781699+0000", 2020-11-16T20:56:49.721 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3045000000000004e-05 2020-11-16T20:56:49.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.721 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.722 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.722 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.781762+0000", 2020-11-16T20:56:49.722 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014161465 2020-11-16T20:56:49.722 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.722 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.722 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.722 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.723 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:779 4.3 e72/22 4:d9c18080:::smithi16641208-173:head v 72'266, mlcod=71'264)", 2020-11-16T20:56:49.723 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:34.786324+0000", 2020-11-16T20:56:49.723 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.783616894, 2020-11-16T20:56:49.723 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017952486, 2020-11-16T20:56:49.723 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:49.723 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:49.723 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:49.724 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.724 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:49.724 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.786324+0000", 2020-11-16T20:56:49.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:49.724 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.724 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.724 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:49.725 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.786324+0000", 2020-11-16T20:56:49.725 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012598417000000001 2020-11-16T20:56:49.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.725 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.725 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:49.725 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.798922+0000", 2020-11-16T20:56:49.725 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1700000000000003e-06 2020-11-16T20:56:49.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.726 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:49.726 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.798931+0000", 2020-11-16T20:56:49.726 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2648e-05 2020-11-16T20:56:49.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.726 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:49.727 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.798944+0000", 2020-11-16T20:56:49.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0150000000000003e-06 2020-11-16T20:56:49.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.727 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:49.727 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.798952+0000", 2020-11-16T20:56:49.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4095999999999998e-05 2020-11-16T20:56:49.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.728 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.728 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:49.728 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.799006+0000", 2020-11-16T20:56:49.728 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2419e-05 2020-11-16T20:56:49.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.728 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.728 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:49.729 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.799028+0000", 2020-11-16T20:56:49.729 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051805050000000002 2020-11-16T20:56:49.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.729 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.729 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:49.729 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.804209+0000", 2020-11-16T20:56:49.729 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7216000000000002e-05 2020-11-16T20:56:49.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:49.730 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:49.730 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:49.730 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.804276+0000", 2020-11-16T20:56:49.730 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017952486 2020-11-16T20:56:49.730 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.730 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.730 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.731 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:49.731 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:49.731 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:49.731 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:56:49.733 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:49.736+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:49.733 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:56:49.802 INFO:tasks.rados.rados.0.smithi166.stdout:828: done (7 left) 2020-11-16T20:56:49.802 INFO:tasks.rados.rados.0.smithi166.stdout:830: done (6 left) 2020-11-16T20:56:49.802 INFO:tasks.rados.rados.0.smithi166.stdout:831: done (5 left) 2020-11-16T20:56:49.803 INFO:tasks.rados.rados.0.smithi166.stdout:832: done (4 left) 2020-11-16T20:56:49.803 INFO:tasks.rados.rados.0.smithi166.stdout:833: done (3 left) 2020-11-16T20:56:49.803 INFO:tasks.rados.rados.0.smithi166.stdout:834: copy_from oid 428 from oid 203 current snap is 26 2020-11-16T20:56:49.803 INFO:tasks.rados.rados.0.smithi166.stdout:835: delete oid 113 current snap is 26 2020-11-16T20:56:49.805 INFO:teuthology.orchestra.run.smithi166.stderr:nodeep-scrub is set 2020-11-16T20:56:49.809 INFO:tasks.rados.rados.0.smithi166.stdout:834: finishing copy_from to smithi16641208-428 2020-11-16T20:56:49.810 INFO:tasks.rados.rados.0.smithi166.stdout:834: got expected ENOENT (src dne) 2020-11-16T20:56:49.810 INFO:tasks.rados.rados.0.smithi166.stdout:835: done (4 left) 2020-11-16T20:56:49.810 INFO:tasks.rados.rados.0.smithi166.stdout:836: cache_flush oid 405 snap -1 2020-11-16T20:56:49.810 INFO:tasks.rados.rados.0.smithi166.stdout:837: copy_from oid 419 from oid 429 current snap is 26 2020-11-16T20:56:49.810 INFO:tasks.rados.rados.0.smithi166.stdout:838: read oid 210 snap 19 2020-11-16T20:56:49.810 INFO:tasks.rados.rados.0.smithi166.stdout:838: expect (ObjNum 209 snap 0 seq_num 209) 2020-11-16T20:56:49.811 INFO:tasks.rados.rados.0.smithi166.stdout:839: write (excl) oid 289 current snap is 26 2020-11-16T20:56:49.811 INFO:tasks.rados.rados.0.smithi166.stdout:834: finishing copy_from racing read to smithi16641208-428 2020-11-16T20:56:49.811 INFO:tasks.rados.rados.0.smithi166.stdout:839: seq_num 585 ranges {632095=463493,1616319=422534,2748686=487304} 2020-11-16T20:56:49.815 INFO:tasks.rados.rados.0.smithi166.stdout:839: writing smithi16641208-289 from 632095 to 1095588 tid 1 2020-11-16T20:56:49.822 INFO:tasks.rados.rados.0.smithi166.stdout:839: writing smithi16641208-289 from 1616319 to 2038853 tid 2 2020-11-16T20:56:49.829 INFO:tasks.rados.rados.0.smithi166.stdout:839: writing smithi16641208-289 from 2748686 to 3235990 tid 3 2020-11-16T20:56:49.829 INFO:tasks.rados.rados.0.smithi166.stdout:834: done (7 left) 2020-11-16T20:56:49.829 INFO:tasks.rados.rados.0.smithi166.stdout:840: write (excl) oid 389 current snap is 26 2020-11-16T20:56:49.829 INFO:tasks.rados.rados.0.smithi166.stdout:840: seq_num 586 ranges {648902=655095,2074801=566192,3176109=672793} 2020-11-16T20:56:49.834 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:49.837+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:49.837 INFO:tasks.rados.rados.0.smithi166.stdout:840: writing smithi16641208-389 from 648902 to 1303997 tid 1 2020-11-16T20:56:49.846 INFO:tasks.rados.rados.0.smithi166.stdout:840: writing smithi16641208-389 from 2074801 to 2640993 tid 2 2020-11-16T20:56:49.853 INFO:tasks.rados.rados.0.smithi166.stdout:840: writing smithi16641208-389 from 3176109 to 3848902 tid 3 2020-11-16T20:56:49.853 INFO:tasks.rados.rados.0.smithi166.stdout:841: snap_remove snap 25 2020-11-16T20:56:49.897 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:56:49.916 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:56:49.929 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:49.929 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:49.929 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:56:49.930 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:49.934 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:49.938+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:49.935 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:56:49.939 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:56:49.954 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:56:49.974 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:56:49.995 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:56:50.014 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:56:50.034 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:50.039+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:50.035 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:56:50.035 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:56:50.036 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:56:50.036 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:56:50.036 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:56:50.036 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:56:50.036 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:56:50.036 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:56:50.037 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:56:50.115 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:50.115 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:50.125 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:56:50.168 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:50.173+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:50.237 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:50.242+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:50.259 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:50.259 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:50.269 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:56:50.338 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:50.343+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:50.439 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:50.443+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:50.445 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:50.445 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:50.455 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:56:50.540 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:50.544+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:50.629 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:50.630 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:50.639 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:56:50.641 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:50.646+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:50.742 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:50.746+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:50.807 INFO:tasks.rados.rados.0.smithi166.stdout:841: done (8 left) 2020-11-16T20:56:50.807 INFO:tasks.rados.rados.0.smithi166.stdout:842: delete oid 442 current snap is 26 2020-11-16T20:56:50.807 INFO:tasks.rados.rados.0.smithi166.stdout:836: got (2) No such file or directory 2020-11-16T20:56:50.807 INFO:tasks.rados.rados.0.smithi166.stdout:839: finishing write tid 1 to smithi16641208-289 2020-11-16T20:56:50.807 INFO:tasks.rados.rados.0.smithi166.stdout:838: expect (ObjNum 209 snap 0 seq_num 209) 2020-11-16T20:56:50.821 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:50.822 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:50.832 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:56:50.876 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:50.880+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:50.922 INFO:tasks.rados.rados.0.smithi166.stdout:839: finishing write tid 2 to smithi16641208-289 2020-11-16T20:56:50.922 INFO:tasks.rados.rados.0.smithi166.stdout:839: finishing write tid 3 to smithi16641208-289 2020-11-16T20:56:50.922 INFO:tasks.rados.rados.0.smithi166.stdout:836: done (8 left) 2020-11-16T20:56:50.923 INFO:tasks.rados.rados.0.smithi166.stdout:838: done (7 left) 2020-11-16T20:56:50.923 INFO:tasks.rados.rados.0.smithi166.stdout:842: done (6 left) 2020-11-16T20:56:50.923 INFO:tasks.rados.rados.0.smithi166.stdout:843: cache_flush oid 118 snap 19 2020-11-16T20:56:50.923 INFO:tasks.rados.rados.0.smithi166.stdout:840: finishing write tid 1 to smithi16641208-389 2020-11-16T20:56:50.923 INFO:tasks.rados.rados.0.smithi166.stdout:839: finishing write tid 4 to smithi16641208-289 2020-11-16T20:56:50.923 INFO:tasks.rados.rados.0.smithi166.stdout:839: finishing write tid 5 to smithi16641208-289 2020-11-16T20:56:50.923 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 289 v 580 (ObjNum 585 snap 26 seq_num 585) dirty exists 2020-11-16T20:56:50.924 INFO:tasks.rados.rados.0.smithi166.stdout:839: left oid 289 (ObjNum 585 snap 26 seq_num 585) 2020-11-16T20:56:50.924 INFO:tasks.rados.rados.0.smithi166.stdout:840: finishing write tid 2 to smithi16641208-389 2020-11-16T20:56:50.924 INFO:tasks.rados.rados.0.smithi166.stdout:840: finishing write tid 3 to smithi16641208-389 2020-11-16T20:56:50.924 INFO:tasks.rados.rados.0.smithi166.stdout:840: finishing write tid 4 to smithi16641208-389 2020-11-16T20:56:50.924 INFO:tasks.rados.rados.0.smithi166.stdout:840: finishing write tid 5 to smithi16641208-389 2020-11-16T20:56:50.924 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 389 v 640 (ObjNum 586 snap 26 seq_num 586) dirty exists 2020-11-16T20:56:50.924 INFO:tasks.rados.rados.0.smithi166.stdout:840: left oid 389 (ObjNum 586 snap 26 seq_num 586) 2020-11-16T20:56:50.924 INFO:tasks.rados.rados.0.smithi166.stdout:837: finishing copy_from to smithi16641208-419 2020-11-16T20:56:50.925 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 419 v 366 (ObjNum 428 snap 0 seq_num 428) dirty exists 2020-11-16T20:56:50.925 INFO:tasks.rados.rados.0.smithi166.stdout:837: finishing copy_from racing read to smithi16641208-419 2020-11-16T20:56:50.925 INFO:tasks.rados.rados.0.smithi166.stdout:837: done (6 left) 2020-11-16T20:56:50.925 INFO:tasks.rados.rados.0.smithi166.stdout:839: done (5 left) 2020-11-16T20:56:50.925 INFO:tasks.rados.rados.0.smithi166.stdout:840: done (4 left) 2020-11-16T20:56:50.925 INFO:tasks.rados.rados.0.smithi166.stdout:844: rollback oid 400 current snap is 26 2020-11-16T20:56:50.925 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 400 to 19 2020-11-16T20:56:50.926 INFO:tasks.rados.rados.0.smithi166.stdout:845: read oid 179 snap 19 2020-11-16T20:56:50.926 INFO:tasks.rados.rados.0.smithi166.stdout:845: expect (ObjNum 178 snap 0 seq_num 178) 2020-11-16T20:56:50.926 INFO:tasks.rados.rados.0.smithi166.stdout:846: cache_try_flush oid 473 snap -1 2020-11-16T20:56:50.926 INFO:tasks.rados.rados.0.smithi166.stdout:847: cache_try_flush oid 123 snap -1 2020-11-16T20:56:50.926 INFO:tasks.rados.rados.0.smithi166.stdout:848: write oid 235 current snap is 26 2020-11-16T20:56:50.926 INFO:tasks.rados.rados.0.smithi166.stdout:848: seq_num 588 ranges {682516=405593,1791765=569861,2830955=721120} 2020-11-16T20:56:50.928 INFO:tasks.rados.rados.0.smithi166.stdout:848: writing smithi16641208-235 from 682516 to 1088109 tid 1 2020-11-16T20:56:50.936 INFO:tasks.rados.rados.0.smithi166.stdout:848: writing smithi16641208-235 from 1791765 to 2361626 tid 2 2020-11-16T20:56:50.943 INFO:tasks.rados.rados.0.smithi166.stdout:848: writing smithi16641208-235 from 2830955 to 3552075 tid 3 2020-11-16T20:56:50.943 INFO:tasks.rados.rados.0.smithi166.stdout:849: cache_flush oid 1 snap 19 2020-11-16T20:56:50.944 INFO:tasks.rados.rados.0.smithi166.stdout:850: cache_flush oid 92 snap -1 2020-11-16T20:56:50.944 INFO:tasks.rados.rados.0.smithi166.stdout:843: got (2) No such file or directory 2020-11-16T20:56:50.944 INFO:tasks.rados.rados.0.smithi166.stdout:843: done (10 left) 2020-11-16T20:56:50.944 INFO:tasks.rados.rados.0.smithi166.stdout:851: rollback oid 140 current snap is 26 2020-11-16T20:56:50.944 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 140 to 19 2020-11-16T20:56:50.944 INFO:tasks.rados.rados.0.smithi166.stdout:844: finishing rollback tid 0 to smithi16641208-400 2020-11-16T20:56:50.944 INFO:tasks.rados.rados.0.smithi166.stdout:844: finishing rollback tid 1 to smithi16641208-400 2020-11-16T20:56:50.945 INFO:tasks.rados.rados.0.smithi166.stdout:844: finishing rollback tid 2 to smithi16641208-400 2020-11-16T20:56:50.945 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 400 v 702 (ObjNum 43 snap 0 seq_num 43) dirty exists 2020-11-16T20:56:50.945 INFO:tasks.rados.rados.0.smithi166.stdout:848: finishing write tid 1 to smithi16641208-235 2020-11-16T20:56:50.945 INFO:tasks.rados.rados.0.smithi166.stdout:845: expect (ObjNum 178 snap 0 seq_num 178) 2020-11-16T20:56:50.945 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:50.947+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:50.980 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:50.981 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:50.995 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:56:51.044 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:51.049+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:51.051 INFO:tasks.rados.rados.0.smithi166.stdout:844: done (10 left) 2020-11-16T20:56:51.051 INFO:tasks.rados.rados.0.smithi166.stdout:845: done (9 left) 2020-11-16T20:56:51.051 INFO:tasks.rados.rados.0.smithi166.stdout:852: read oid 293 snap -1 2020-11-16T20:56:51.052 INFO:tasks.rados.rados.0.smithi166.stdout:852: expect (ObjNum 292 snap 0 seq_num 292) 2020-11-16T20:56:51.052 INFO:tasks.rados.rados.0.smithi166.stdout:853: copy_from oid 251 from oid 109 current snap is 26 2020-11-16T20:56:51.052 INFO:tasks.rados.rados.0.smithi166.stdout:848: finishing write tid 2 to smithi16641208-235 2020-11-16T20:56:51.052 INFO:tasks.rados.rados.0.smithi166.stdout:850: got (0) Success 2020-11-16T20:56:51.052 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 92 v 0 (ObjNum 1727687136 snap 22090 seq_num 1727687136) clean dne 2020-11-16T20:56:51.052 INFO:tasks.rados.rados.0.smithi166.stdout:848: finishing write tid 3 to smithi16641208-235 2020-11-16T20:56:51.053 INFO:tasks.rados.rados.0.smithi166.stdout:848: finishing write tid 4 to smithi16641208-235 2020-11-16T20:56:51.053 INFO:tasks.rados.rados.0.smithi166.stdout:848: finishing write tid 5 to smithi16641208-235 2020-11-16T20:56:51.053 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 235 v 644 (ObjNum 588 snap 26 seq_num 588) dirty exists 2020-11-16T20:56:51.053 INFO:tasks.rados.rados.0.smithi166.stdout:848: left oid 235 (ObjNum 588 snap 26 seq_num 588) 2020-11-16T20:56:51.053 INFO:tasks.rados.rados.0.smithi166.stdout:851: finishing rollback tid 0 to smithi16641208-140 2020-11-16T20:56:51.053 INFO:tasks.rados.rados.0.smithi166.stdout:851: finishing rollback tid 1 to smithi16641208-140 2020-11-16T20:56:51.053 INFO:tasks.rados.rados.0.smithi166.stdout:851: finishing rollback tid 2 to smithi16641208-140 2020-11-16T20:56:51.053 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 140 v 705 (ObjNum 525 snap 6 seq_num 525) dirty exists 2020-11-16T20:56:51.054 INFO:tasks.rados.rados.0.smithi166.stdout:849: got (0) Success 2020-11-16T20:56:51.054 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 1 v 0 (ObjNum 0 snap 0 seq_num 0) dirty exists 2020-11-16T20:56:51.054 INFO:tasks.rados.rados.0.smithi166.stdout:848: done (10 left) 2020-11-16T20:56:51.055 INFO:tasks.rados.rados.0.smithi166.stdout:849: done (9 left) 2020-11-16T20:56:51.055 INFO:tasks.rados.rados.0.smithi166.stdout:850: done (8 left) 2020-11-16T20:56:51.055 INFO:tasks.rados.rados.0.smithi166.stdout:851: done (7 left) 2020-11-16T20:56:51.055 INFO:tasks.rados.rados.0.smithi166.stdout:854: snap_create 2020-11-16T20:56:51.055 INFO:tasks.rados.rados.0.smithi166.stdout:853: finishing copy_from to smithi16641208-251 2020-11-16T20:56:51.055 INFO:tasks.rados.rados.0.smithi166.stdout:853: got expected ENOENT (src dne) 2020-11-16T20:56:51.069 INFO:tasks.rados.rados.0.smithi166.stdout:853: finishing copy_from racing read to smithi16641208-251 2020-11-16T20:56:51.070 INFO:tasks.rados.rados.0.smithi166.stdout:852: expect (ObjNum 292 snap 0 seq_num 292) 2020-11-16T20:56:51.145 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:51.149+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:51.166 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:51.166 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:51.175 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:56:51.259 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:51.263+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:51.341 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:51.341 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:51.347 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:51.352+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:51.351 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:56:51.448 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:51.452+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:51.516 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:51.516 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:51.525 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:56:51.548 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:51.553+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:51.649 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:51.654+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:51.651 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:51.651 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:51.660 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:56:51.749 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:51.754+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:51.786 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:51.786 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:51.795 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:56:51.811 INFO:tasks.rados.rados.0.smithi166.stdout:852: done (7 left) 2020-11-16T20:56:51.811 INFO:tasks.rados.rados.0.smithi166.stdout:853: done (6 left) 2020-11-16T20:56:51.812 INFO:tasks.rados.rados.0.smithi166.stdout:854: done (5 left) 2020-11-16T20:56:51.812 INFO:tasks.rados.rados.0.smithi166.stdout:855: snap_remove snap 26 2020-11-16T20:56:51.818 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2020-11-16T20:56:51.862 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:51.868+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:51.932 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:51.932 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:51.943 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:56:51.951 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:51.956+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:52.047 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:56:52.051 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:52.056+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:52.127 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:52.127 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:52.137 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:56:52.181 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:52.186+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:52.211 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:56:52.230 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:56:52.250 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:56:52.253 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:52.258+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:52.270 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:56:52.282 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:52.282 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:56:52.282 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:56:52.282 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:56:52.283 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.283 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:901 3.0 e35/19 3:29e07ad2:::smithi16641208-204:head v 35'134, mlcod=35'132)", 2020-11-16T20:56:52.283 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.128152+0000", 2020-11-16T20:56:52.283 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 58.157836214, 2020-11-16T20:56:52.283 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042710120000000002, 2020-11-16T20:56:52.283 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.283 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.284 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.284 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.284 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.284 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128152+0000", 2020-11-16T20:56:52.284 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.284 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.284 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.285 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.285 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128152+0000", 2020-11-16T20:56:52.285 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019783600000000001 2020-11-16T20:56:52.285 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.285 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.285 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.285 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128350+0000", 2020-11-16T20:56:52.286 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6030000000000005e-06 2020-11-16T20:56:52.286 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.286 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.286 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.286 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128358+0000", 2020-11-16T20:56:52.286 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2595999999999999e-05 2020-11-16T20:56:52.286 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.286 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.287 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.287 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128371+0000", 2020-11-16T20:56:52.287 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3209999999999999e-06 2020-11-16T20:56:52.287 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.287 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.287 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.287 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128378+0000", 2020-11-16T20:56:52.288 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4047e-05 2020-11-16T20:56:52.288 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.288 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.288 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.288 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128422+0000", 2020-11-16T20:56:52.288 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9796000000000001e-05 2020-11-16T20:56:52.288 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.289 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.289 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.289 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128452+0000", 2020-11-16T20:56:52.289 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039150929999999997 2020-11-16T20:56:52.289 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.289 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.289 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:52.289 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.132367+0000", 2020-11-16T20:56:52.290 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5720000000000002e-05 2020-11-16T20:56:52.290 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.290 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.290 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.290 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.132423+0000", 2020-11-16T20:56:52.290 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042710120000000002 2020-11-16T20:56:52.290 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.291 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.291 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.291 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.291 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.291 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1028 3.0 e35/19 3:2e3eb594:::smithi16641208-229:head v 35'159, mlcod=35'157)", 2020-11-16T20:56:52.291 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.635550+0000", 2020-11-16T20:56:52.291 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 57.650437771999997, 2020-11-16T20:56:52.292 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042338380000000002, 2020-11-16T20:56:52.292 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.292 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.292 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.292 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.292 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.292 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635550+0000", 2020-11-16T20:56:52.293 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.293 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.293 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.293 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.293 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635550+0000", 2020-11-16T20:56:52.293 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018653699999999999 2020-11-16T20:56:52.293 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.293 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.294 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.294 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635737+0000", 2020-11-16T20:56:52.294 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.037e-06 2020-11-16T20:56:52.294 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.294 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.294 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.294 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635746+0000", 2020-11-16T20:56:52.295 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3001e-05 2020-11-16T20:56:52.295 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.295 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.295 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.295 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635759+0000", 2020-11-16T20:56:52.295 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7740000000000004e-06 2020-11-16T20:56:52.295 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.296 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.296 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.296 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635767+0000", 2020-11-16T20:56:52.296 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1385999999999999e-05 2020-11-16T20:56:52.296 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.296 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.296 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.296 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635818+0000", 2020-11-16T20:56:52.297 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6427e-05 2020-11-16T20:56:52.297 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.297 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.297 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.297 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635845+0000", 2020-11-16T20:56:52.297 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003885164 2020-11-16T20:56:52.297 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.298 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.298 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:52.298 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.639730+0000", 2020-11-16T20:56:52.298 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4512000000000003e-05 2020-11-16T20:56:52.298 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.298 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.298 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.298 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.639784+0000", 2020-11-16T20:56:52.299 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042338380000000002 2020-11-16T20:56:52.299 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.299 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.299 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.299 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.299 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.299 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1102 3.0 e35/19 3:1c1ecb34:::smithi16641208-245:head v 35'172, mlcod=35'170)", 2020-11-16T20:56:52.300 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.920148+0000", 2020-11-16T20:56:52.300 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 57.365839887, 2020-11-16T20:56:52.300 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053854699999999998, 2020-11-16T20:56:52.300 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.300 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.300 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.300 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.301 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.301 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920148+0000", 2020-11-16T20:56:52.301 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.301 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.301 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.301 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.301 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920148+0000", 2020-11-16T20:56:52.302 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019421400000000001 2020-11-16T20:56:52.302 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.302 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.302 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.302 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920342+0000", 2020-11-16T20:56:52.302 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6169999999999996e-06 2020-11-16T20:56:52.302 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.302 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.303 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.303 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920352+0000", 2020-11-16T20:56:52.303 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3684e-05 2020-11-16T20:56:52.303 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.303 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.303 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.303 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920366+0000", 2020-11-16T20:56:52.304 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7789999999999996e-06 2020-11-16T20:56:52.304 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.304 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.304 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.304 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920374+0000", 2020-11-16T20:56:52.304 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8783999999999995e-05 2020-11-16T20:56:52.304 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.305 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.305 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.305 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920472+0000", 2020-11-16T20:56:52.305 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6865000000000001e-05 2020-11-16T20:56:52.305 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.305 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.305 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.305 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920499+0000", 2020-11-16T20:56:52.306 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004975246 2020-11-16T20:56:52.306 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.306 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.306 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:52.306 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.925474+0000", 2020-11-16T20:56:52.306 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9280999999999997e-05 2020-11-16T20:56:52.306 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.307 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.307 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.307 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.925534+0000", 2020-11-16T20:56:52.307 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053854699999999998 2020-11-16T20:56:52.307 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.307 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.307 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.307 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.308 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.308 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1198 3.0 e35/19 3:1b4407ea:::smithi16641208-269:head v 35'184, mlcod=35'182)", 2020-11-16T20:56:52.308 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.231667+0000", 2020-11-16T20:56:52.308 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 57.054320728999997, 2020-11-16T20:56:52.308 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041081770000000002, 2020-11-16T20:56:52.308 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.308 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.309 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.309 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.309 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.309 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231667+0000", 2020-11-16T20:56:52.309 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.309 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.309 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.310 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.310 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231667+0000", 2020-11-16T20:56:52.310 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018666399999999999 2020-11-16T20:56:52.310 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.310 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.310 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.310 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231854+0000", 2020-11-16T20:56:52.311 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.152e-05 2020-11-16T20:56:52.311 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.311 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.311 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.311 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231866+0000", 2020-11-16T20:56:52.311 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2456000000000002e-05 2020-11-16T20:56:52.311 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.311 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.312 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.312 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231898+0000", 2020-11-16T20:56:52.312 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6789999999999994e-06 2020-11-16T20:56:52.312 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.312 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.312 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.312 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231907+0000", 2020-11-16T20:56:52.313 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0732999999999997e-05 2020-11-16T20:56:52.313 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.313 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.313 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231957+0000", 2020-11-16T20:56:52.313 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9028000000000001e-05 2020-11-16T20:56:52.313 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.314 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.314 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.231987+0000", 2020-11-16T20:56:52.314 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037323830000000001 2020-11-16T20:56:52.314 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.314 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.314 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:52.314 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.235719+0000", 2020-11-16T20:56:52.315 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6713999999999999e-05 2020-11-16T20:56:52.315 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.315 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.315 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.315 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.235776+0000", 2020-11-16T20:56:52.315 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041081770000000002 2020-11-16T20:56:52.315 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.316 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.316 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.316 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.316 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.316 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1235 3.0 e35/19 3:2294fced:::smithi16641208-278:head v 35'188, mlcod=35'185)", 2020-11-16T20:56:52.316 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.354799+0000", 2020-11-16T20:56:52.316 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 56.931188773999999, 2020-11-16T20:56:52.316 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050791389999999999, 2020-11-16T20:56:52.317 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.317 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.317 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.317 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.317 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.317 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354799+0000", 2020-11-16T20:56:52.317 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.318 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.318 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.318 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.318 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354799+0000", 2020-11-16T20:56:52.318 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2141000000000002e-05 2020-11-16T20:56:52.318 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.318 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.319 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.319 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354842+0000", 2020-11-16T20:56:52.319 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.601e-06 2020-11-16T20:56:52.319 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.319 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.319 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.319 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354848+0000", 2020-11-16T20:56:52.319 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.028e-05 2020-11-16T20:56:52.320 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.320 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.320 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.320 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354858+0000", 2020-11-16T20:56:52.320 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2959999999999998e-06 2020-11-16T20:56:52.320 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.320 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.321 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.321 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354864+0000", 2020-11-16T20:56:52.321 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3279999999999999e-05 2020-11-16T20:56:52.321 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.321 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.321 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.321 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354907+0000", 2020-11-16T20:56:52.321 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3655e-05 2020-11-16T20:56:52.322 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.322 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.322 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.322 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354931+0000", 2020-11-16T20:56:52.322 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004888875 2020-11-16T20:56:52.322 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.322 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.323 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:52.323 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.359820+0000", 2020-11-16T20:56:52.323 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9011000000000001e-05 2020-11-16T20:56:52.323 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.323 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.323 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.323 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.359879+0000", 2020-11-16T20:56:52.323 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050791389999999999 2020-11-16T20:56:52.324 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.324 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.324 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.324 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.324 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.324 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1237 3.0 e35/19 3:0b7cd9c0:::smithi16641208-279:head v 35'189, mlcod=35'187)", 2020-11-16T20:56:52.324 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.361967+0000", 2020-11-16T20:56:52.325 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 56.924021531999998, 2020-11-16T20:56:52.325 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041733320000000001, 2020-11-16T20:56:52.325 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.325 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.325 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.325 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.325 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.325 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.361967+0000", 2020-11-16T20:56:52.326 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.326 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.326 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.326 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.326 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.361967+0000", 2020-11-16T20:56:52.326 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045453300000000002 2020-11-16T20:56:52.326 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.327 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.327 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.327 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362421+0000", 2020-11-16T20:56:52.327 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1178999999999999e-05 2020-11-16T20:56:52.327 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.327 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.327 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.327 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362432+0000", 2020-11-16T20:56:52.328 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5865000000000001e-05 2020-11-16T20:56:52.328 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.328 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.328 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.328 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362448+0000", 2020-11-16T20:56:52.328 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9809999999999992e-06 2020-11-16T20:56:52.328 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.329 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.329 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.329 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362457+0000", 2020-11-16T20:56:52.329 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9304e-05 2020-11-16T20:56:52.329 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.329 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.329 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.329 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362516+0000", 2020-11-16T20:56:52.330 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2886000000000003e-05 2020-11-16T20:56:52.330 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.330 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.330 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.330 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362549+0000", 2020-11-16T20:56:52.330 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035249809999999999 2020-11-16T20:56:52.330 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.331 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.331 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:52.331 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.366074+0000", 2020-11-16T20:56:52.331 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5603000000000002e-05 2020-11-16T20:56:52.331 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.331 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.331 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.331 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.366140+0000", 2020-11-16T20:56:52.332 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041733320000000001 2020-11-16T20:56:52.332 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.332 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.332 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.332 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.332 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.332 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1423 3.0 e36/19 3:1e5364a0:::smithi16641208-320:head v 36'221, mlcod=35'219)", 2020-11-16T20:56:52.333 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.033789+0000", 2020-11-16T20:56:52.333 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 56.252199142000002, 2020-11-16T20:56:52.333 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041251339999999999, 2020-11-16T20:56:52.333 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.333 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.333 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.333 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.334 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.334 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033789+0000", 2020-11-16T20:56:52.334 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.334 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.334 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.334 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.334 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033789+0000", 2020-11-16T20:56:52.334 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015644000000000001 2020-11-16T20:56:52.335 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.335 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033945+0000", 2020-11-16T20:56:52.335 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0270000000000003e-06 2020-11-16T20:56:52.335 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.336 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.336 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033950+0000", 2020-11-16T20:56:52.336 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6420000000000007e-06 2020-11-16T20:56:52.336 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.336 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.336 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.336 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033958+0000", 2020-11-16T20:56:52.337 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.477e-06 2020-11-16T20:56:52.337 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.337 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.337 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.337 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.033965+0000", 2020-11-16T20:56:52.337 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9178999999999998e-05 2020-11-16T20:56:52.337 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.337 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.338 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.338 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.034014+0000", 2020-11-16T20:56:52.338 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2172e-05 2020-11-16T20:56:52.338 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.338 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.338 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.338 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.034036+0000", 2020-11-16T20:56:52.339 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0038237190000000002 2020-11-16T20:56:52.339 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.339 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.339 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:52.339 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.037860+0000", 2020-11-16T20:56:52.339 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4478000000000003e-05 2020-11-16T20:56:52.339 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.339 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.340 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.340 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.037914+0000", 2020-11-16T20:56:52.340 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041251339999999999 2020-11-16T20:56:52.340 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.340 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.340 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.340 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.341 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.341 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1468 3.0 e36/19 3:1852173c:::smithi16641208-329:head v 36'238, mlcod=36'236)", 2020-11-16T20:56:52.341 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.208167+0000", 2020-11-16T20:56:52.341 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 56.077821368000002, 2020-11-16T20:56:52.341 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052481979999999999, 2020-11-16T20:56:52.341 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.341 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.341 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.342 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.342 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.342 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208167+0000", 2020-11-16T20:56:52.342 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.342 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.342 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.342 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.343 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208167+0000", 2020-11-16T20:56:52.343 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013521900000000001 2020-11-16T20:56:52.343 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.343 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.343 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.343 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208302+0000", 2020-11-16T20:56:52.343 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1307e-05 2020-11-16T20:56:52.343 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.344 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.344 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.344 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208313+0000", 2020-11-16T20:56:52.344 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2828e-05 2020-11-16T20:56:52.344 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.344 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.344 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208326+0000", 2020-11-16T20:56:52.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8889999999999996e-06 2020-11-16T20:56:52.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.345 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.345 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208333+0000", 2020-11-16T20:56:52.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2843999999999999e-05 2020-11-16T20:56:52.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.346 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.346 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.346 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208366+0000", 2020-11-16T20:56:52.346 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4986e-05 2020-11-16T20:56:52.346 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.346 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.346 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.347 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208381+0000", 2020-11-16T20:56:52.347 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0049810990000000001 2020-11-16T20:56:52.347 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.347 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.347 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:52.347 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.213362+0000", 2020-11-16T20:56:52.347 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3025999999999997e-05 2020-11-16T20:56:52.347 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.348 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.348 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.348 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.213415+0000", 2020-11-16T20:56:52.348 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052481979999999999 2020-11-16T20:56:52.348 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.348 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.348 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.349 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.349 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.349 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1490 3.0 e36/19 3:10845e0e:::smithi16641208-333:head v 36'252, mlcod=36'250)", 2020-11-16T20:56:52.349 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.301912+0000", 2020-11-16T20:56:52.349 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 55.984076365999996, 2020-11-16T20:56:52.349 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044835179999999997, 2020-11-16T20:56:52.349 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.349 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.350 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.350 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.350 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.301912+0000", 2020-11-16T20:56:52.350 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.350 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.351 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.301912+0000", 2020-11-16T20:56:52.351 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114265 2020-11-16T20:56:52.351 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.351 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.351 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302026+0000", 2020-11-16T20:56:52.352 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7940000000000008e-06 2020-11-16T20:56:52.352 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.352 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.352 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302035+0000", 2020-11-16T20:56:52.352 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5187e-05 2020-11-16T20:56:52.352 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.353 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.353 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302050+0000", 2020-11-16T20:56:52.353 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.653e-06 2020-11-16T20:56:52.353 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.353 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.353 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.353 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302059+0000", 2020-11-16T20:56:52.354 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8010000000000003e-05 2020-11-16T20:56:52.354 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.354 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.354 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.354 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302107+0000", 2020-11-16T20:56:52.354 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5335000000000001e-05 2020-11-16T20:56:52.354 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.354 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.355 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.355 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302132+0000", 2020-11-16T20:56:52.355 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042049239999999996 2020-11-16T20:56:52.355 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.355 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.355 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:52.355 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.306337+0000", 2020-11-16T20:56:52.356 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8350000000000002e-05 2020-11-16T20:56:52.356 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.356 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.356 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.356 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.306395+0000", 2020-11-16T20:56:52.356 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044835179999999997 2020-11-16T20:56:52.356 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.356 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.357 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.357 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.357 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.357 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:534 3.0 e46/19 3:10845e0e:::smithi16641208-333:5 v 46'391, mlcod=45'385)", 2020-11-16T20:56:52.357 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.013124+0000", 2020-11-16T20:56:52.357 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 43.272863794000003, 2020-11-16T20:56:52.357 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050053900000000002, 2020-11-16T20:56:52.358 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.358 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.358 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.358 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.358 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.358 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013124+0000", 2020-11-16T20:56:52.358 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.358 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.359 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.359 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.359 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013124+0000", 2020-11-16T20:56:52.359 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9255999999999997e-05 2020-11-16T20:56:52.359 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.359 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.359 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.360 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013174+0000", 2020-11-16T20:56:52.360 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5140000000000004e-06 2020-11-16T20:56:52.360 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.360 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.360 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.360 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013181+0000", 2020-11-16T20:56:52.360 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1279e-05 2020-11-16T20:56:52.360 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.361 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.361 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.361 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013192+0000", 2020-11-16T20:56:52.361 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0970000000000002e-06 2020-11-16T20:56:52.361 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.361 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.361 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.362 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013199+0000", 2020-11-16T20:56:52.362 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5442e-05 2020-11-16T20:56:52.362 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.362 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.362 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.362 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013284+0000", 2020-11-16T20:56:52.362 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8368e-05 2020-11-16T20:56:52.363 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.363 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.363 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.363 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013312+0000", 2020-11-16T20:56:52.363 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0047640549999999997 2020-11-16T20:56:52.363 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.363 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.363 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:52.364 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.018076+0000", 2020-11-16T20:56:52.364 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3378999999999998e-05 2020-11-16T20:56:52.364 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.364 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.364 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.364 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.018130+0000", 2020-11-16T20:56:52.364 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050053900000000002 2020-11-16T20:56:52.365 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.365 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.365 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.365 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.365 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.365 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:553 3.0 e51/19 3:0980614a:::smithi16641208-158:d v 51'399, mlcod=48'395)", 2020-11-16T20:56:52.365 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.036559+0000", 2020-11-16T20:56:52.365 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.249428733000002, 2020-11-16T20:56:52.366 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0057593829999999999, 2020-11-16T20:56:52.366 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.366 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.366 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.366 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.366 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.366 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036559+0000", 2020-11-16T20:56:52.367 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.367 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.367 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.367 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.367 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036559+0000", 2020-11-16T20:56:52.367 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3611000000000001e-05 2020-11-16T20:56:52.367 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.367 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.368 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.368 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036593+0000", 2020-11-16T20:56:52.368 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6789999999999996e-06 2020-11-16T20:56:52.368 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.368 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.368 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.368 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036598+0000", 2020-11-16T20:56:52.369 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1350000000000003e-06 2020-11-16T20:56:52.369 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.369 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.369 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.369 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036605+0000", 2020-11-16T20:56:52.369 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5200000000000003e-06 2020-11-16T20:56:52.369 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.370 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.370 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.370 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036611+0000", 2020-11-16T20:56:52.370 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1322000000000001e-05 2020-11-16T20:56:52.370 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.370 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.370 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.370 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036663+0000", 2020-11-16T20:56:52.371 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8333000000000001e-05 2020-11-16T20:56:52.371 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.371 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.371 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.371 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036691+0000", 2020-11-16T20:56:52.371 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0055720800000000001 2020-11-16T20:56:52.371 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.372 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.372 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:52.372 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.042263+0000", 2020-11-16T20:56:52.372 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5702999999999998e-05 2020-11-16T20:56:52.372 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.372 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.372 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.372 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.042319+0000", 2020-11-16T20:56:52.373 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0057593829999999999 2020-11-16T20:56:52.373 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.373 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.373 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.373 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.373 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.373 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:556 3.0 e51/19 3:03c93966:::smithi16641208-422:e v 51'401, mlcod=48'395)", 2020-11-16T20:56:52.374 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.037559+0000", 2020-11-16T20:56:52.374 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.248429029, 2020-11-16T20:56:52.374 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052553039999999997, 2020-11-16T20:56:52.374 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.374 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.374 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.374 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.375 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.375 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037559+0000", 2020-11-16T20:56:52.375 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.375 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.375 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.375 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.375 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037559+0000", 2020-11-16T20:56:52.375 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2685999999999998e-05 2020-11-16T20:56:52.376 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.376 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.376 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.376 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037592+0000", 2020-11-16T20:56:52.376 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1830000000000002e-06 2020-11-16T20:56:52.376 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.376 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.377 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.377 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037597+0000", 2020-11-16T20:56:52.377 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0809999999999996e-06 2020-11-16T20:56:52.377 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.377 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.377 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.377 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037604+0000", 2020-11-16T20:56:52.377 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.361e-06 2020-11-16T20:56:52.378 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.378 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.378 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.378 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037609+0000", 2020-11-16T20:56:52.378 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00041286099999999999 2020-11-16T20:56:52.378 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.379 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.379 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.379 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.038022+0000", 2020-11-16T20:56:52.379 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4833000000000001e-05 2020-11-16T20:56:52.379 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.379 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.379 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.379 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.038047+0000", 2020-11-16T20:56:52.380 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0047145110000000002 2020-11-16T20:56:52.380 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.380 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.380 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:52.380 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.042762+0000", 2020-11-16T20:56:52.380 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2787999999999997e-05 2020-11-16T20:56:52.380 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.381 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.381 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.381 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.042814+0000", 2020-11-16T20:56:52.381 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052553039999999997 2020-11-16T20:56:52.381 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.381 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.381 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.381 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.382 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:559 3.0 e52/19 3:0980614a:::smithi16641208-158:d v 52'405, mlcod=51'401)", 2020-11-16T20:56:52.382 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:15.014239+0000", 2020-11-16T20:56:52.382 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 37.271749155999998, 2020-11-16T20:56:52.382 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0060540699999999999, 2020-11-16T20:56:52.382 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.382 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.383 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.383 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.383 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.383 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014239+0000", 2020-11-16T20:56:52.383 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.383 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.383 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.384 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.384 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014239+0000", 2020-11-16T20:56:52.384 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1819000000000001e-05 2020-11-16T20:56:52.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.384 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.384 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014281+0000", 2020-11-16T20:56:52.384 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6719999999999998e-06 2020-11-16T20:56:52.385 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.385 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.385 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.385 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014288+0000", 2020-11-16T20:56:52.385 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0564000000000001e-05 2020-11-16T20:56:52.385 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.385 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.386 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.386 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014298+0000", 2020-11-16T20:56:52.386 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1902000000000001e-05 2020-11-16T20:56:52.386 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.386 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.386 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.386 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014310+0000", 2020-11-16T20:56:52.386 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4212999999999997e-05 2020-11-16T20:56:52.387 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.387 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.387 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.387 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014364+0000", 2020-11-16T20:56:52.387 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9425e-05 2020-11-16T20:56:52.387 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.387 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.388 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.388 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014394+0000", 2020-11-16T20:56:52.388 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0058527630000000004 2020-11-16T20:56:52.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.388 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.388 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:52.388 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.020246+0000", 2020-11-16T20:56:52.389 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6712000000000003e-05 2020-11-16T20:56:52.389 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.389 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.389 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.020293+0000", 2020-11-16T20:56:52.389 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0060540699999999999 2020-11-16T20:56:52.389 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.389 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.390 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.390 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.390 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:561 3.0 e52/19 3:03c93966:::smithi16641208-422:e v 52'407, mlcod=51'401)", 2020-11-16T20:56:52.390 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:15.015143+0000", 2020-11-16T20:56:52.390 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 37.270844935, 2020-11-16T20:56:52.390 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0073835719999999997, 2020-11-16T20:56:52.391 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.391 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.391 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.391 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.391 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015143+0000", 2020-11-16T20:56:52.391 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.391 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.392 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.392 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.392 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015143+0000", 2020-11-16T20:56:52.392 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4036999999999999e-05 2020-11-16T20:56:52.392 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.392 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.392 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.393 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015187+0000", 2020-11-16T20:56:52.393 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8350000000000004e-06 2020-11-16T20:56:52.393 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.393 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.393 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.393 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015195+0000", 2020-11-16T20:56:52.393 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1216999999999999e-05 2020-11-16T20:56:52.393 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.394 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.394 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.394 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015206+0000", 2020-11-16T20:56:52.394 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9390000000000002e-06 2020-11-16T20:56:52.394 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.394 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.394 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.395 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015212+0000", 2020-11-16T20:56:52.395 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.066e-05 2020-11-16T20:56:52.395 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.395 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.395 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.395 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015253+0000", 2020-11-16T20:56:52.395 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1534000000000001e-05 2020-11-16T20:56:52.395 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.396 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.396 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.396 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015274+0000", 2020-11-16T20:56:52.396 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0072086629999999997 2020-11-16T20:56:52.396 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.396 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.396 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:52.397 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.022483+0000", 2020-11-16T20:56:52.397 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3686999999999997e-05 2020-11-16T20:56:52.397 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.397 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.397 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.397 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.022527+0000", 2020-11-16T20:56:52.397 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0073835719999999997 2020-11-16T20:56:52.397 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.398 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.398 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.398 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.398 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.398 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2604 3.0 e57/19 3:2294fced:::smithi16641208-278:head v 57'440, mlcod=57'436)", 2020-11-16T20:56:52.398 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.930849+0000", 2020-11-16T20:56:52.398 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 32.355139170000001, 2020-11-16T20:56:52.399 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054406599999999999, 2020-11-16T20:56:52.399 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.399 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.399 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.399 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.399 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.399 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.930849+0000", 2020-11-16T20:56:52.400 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.400 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.400 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.400 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.400 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.930849+0000", 2020-11-16T20:56:52.400 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000849838 2020-11-16T20:56:52.400 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.400 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.401 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.401 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.931699+0000", 2020-11-16T20:56:52.401 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2410000000000001e-06 2020-11-16T20:56:52.401 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.401 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.401 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.401 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.931708+0000", 2020-11-16T20:56:52.402 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.764e-06 2020-11-16T20:56:52.402 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.402 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.402 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.402 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.931718+0000", 2020-11-16T20:56:52.402 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2930000000000003e-06 2020-11-16T20:56:52.402 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.402 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.403 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.403 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.931725+0000", 2020-11-16T20:56:52.403 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0489999999999999e-05 2020-11-16T20:56:52.403 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.403 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.403 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.403 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.931786+0000", 2020-11-16T20:56:52.404 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8841000000000001e-05 2020-11-16T20:56:52.404 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.404 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.404 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.404 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.931814+0000", 2020-11-16T20:56:52.404 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044240770000000002 2020-11-16T20:56:52.404 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.404 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.405 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:52.405 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.936239+0000", 2020-11-16T20:56:52.405 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1116000000000003e-05 2020-11-16T20:56:52.405 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.405 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.405 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.405 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.936290+0000", 2020-11-16T20:56:52.406 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054406599999999999 2020-11-16T20:56:52.406 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.406 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.406 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.406 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.406 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.406 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:725 3.0 e81/66 3:3297596a:::smithi16641208-146:2b v 81'540, mlcod=79'536)", 2020-11-16T20:56:52.406 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:43.785646+0000", 2020-11-16T20:56:52.407 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.5003416680000008, 2020-11-16T20:56:52.407 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041616179999999997, 2020-11-16T20:56:52.407 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.407 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.407 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.407 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.407 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.408 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:43.785646+0000", 2020-11-16T20:56:52.408 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.408 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.408 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.408 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.408 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:43.785646+0000", 2020-11-16T20:56:52.408 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2994000000000002e-05 2020-11-16T20:56:52.408 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.409 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.409 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.409 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:43.785689+0000", 2020-11-16T20:56:52.409 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7069999999999992e-06 2020-11-16T20:56:52.409 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.409 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.409 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.410 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:43.785697+0000", 2020-11-16T20:56:52.410 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0876999999999999e-05 2020-11-16T20:56:52.410 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.410 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.410 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.410 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:43.785708+0000", 2020-11-16T20:56:52.410 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.601e-06 2020-11-16T20:56:52.410 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.411 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.411 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.411 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:43.785715+0000", 2020-11-16T20:56:52.411 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034364600000000002 2020-11-16T20:56:52.411 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.411 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.411 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.412 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:43.786058+0000", 2020-11-16T20:56:52.412 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7617000000000001e-05 2020-11-16T20:56:52.412 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.412 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.412 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.412 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:43.786076+0000", 2020-11-16T20:56:52.412 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0036507419999999998 2020-11-16T20:56:52.412 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.413 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.413 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:52.413 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:43.789727+0000", 2020-11-16T20:56:52.413 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.1434000000000007e-05 2020-11-16T20:56:52.413 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.413 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.413 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.414 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:43.789808+0000", 2020-11-16T20:56:52.414 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041616179999999997 2020-11-16T20:56:52.414 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.414 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.414 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.414 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.414 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.415 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:730 3.0 e82/66 3:2294fced:::smithi16641208-278:14 v 82'546, mlcod=82'542)", 2020-11-16T20:56:52.415 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.758635+0000", 2020-11-16T20:56:52.415 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 7.5273526689999999, 2020-11-16T20:56:52.415 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061572399999999996, 2020-11-16T20:56:52.415 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.415 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.415 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.415 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.416 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.416 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.758635+0000", 2020-11-16T20:56:52.416 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.416 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.416 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.416 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.416 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.758635+0000", 2020-11-16T20:56:52.417 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4821999999999999e-05 2020-11-16T20:56:52.417 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.417 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.417 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.417 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.758680+0000", 2020-11-16T20:56:52.417 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.5219999999999996e-06 2020-11-16T20:56:52.417 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.418 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.418 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.418 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.758690+0000", 2020-11-16T20:56:52.418 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6467e-05 2020-11-16T20:56:52.418 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.418 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.418 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.418 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.758706+0000", 2020-11-16T20:56:52.419 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8881999999999999e-05 2020-11-16T20:56:52.419 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.419 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.419 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.419 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.758735+0000", 2020-11-16T20:56:52.419 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3925999999999997e-05 2020-11-16T20:56:52.419 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.420 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.420 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.420 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.758799+0000", 2020-11-16T20:56:52.420 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9947e-05 2020-11-16T20:56:52.420 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.420 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.420 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.420 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.758829+0000", 2020-11-16T20:56:52.421 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0058938139999999998 2020-11-16T20:56:52.421 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.421 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.421 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:52.421 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.764723+0000", 2020-11-16T20:56:52.421 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9859999999999999e-05 2020-11-16T20:56:52.421 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.422 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.422 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.422 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.764793+0000", 2020-11-16T20:56:52.422 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061572399999999996 2020-11-16T20:56:52.422 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.422 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.422 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.422 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.423 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.423 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:731 3.0 e82/66 3:26512967:::smithi16641208-466:23 v 82'548, mlcod=82'542)", 2020-11-16T20:56:52.423 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.759542+0000", 2020-11-16T20:56:52.423 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 7.5264463340000001, 2020-11-16T20:56:52.423 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0055834719999999999, 2020-11-16T20:56:52.423 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.423 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.424 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.424 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.424 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.424 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759542+0000", 2020-11-16T20:56:52.424 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.424 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.424 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.424 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.425 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759542+0000", 2020-11-16T20:56:52.425 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6737000000000002e-05 2020-11-16T20:56:52.425 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.425 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.425 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.425 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759569+0000", 2020-11-16T20:56:52.425 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0726e-05 2020-11-16T20:56:52.425 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.426 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.426 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.426 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759579+0000", 2020-11-16T20:56:52.426 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.117e-05 2020-11-16T20:56:52.426 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.426 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.426 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.427 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759590+0000", 2020-11-16T20:56:52.427 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8179999999999998e-06 2020-11-16T20:56:52.427 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.427 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.427 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.427 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759597+0000", 2020-11-16T20:56:52.427 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019832300000000001 2020-11-16T20:56:52.427 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.428 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.428 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.428 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759796+0000", 2020-11-16T20:56:52.428 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4968e-05 2020-11-16T20:56:52.428 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.428 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.428 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.429 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759841+0000", 2020-11-16T20:56:52.429 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052313209999999997 2020-11-16T20:56:52.429 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.429 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.429 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:52.429 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.765072+0000", 2020-11-16T20:56:52.429 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3409000000000003e-05 2020-11-16T20:56:52.429 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.430 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.430 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.430 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.765125+0000", 2020-11-16T20:56:52.430 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0055834719999999999 2020-11-16T20:56:52.430 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.430 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.430 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.431 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.431 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.431 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:740 3.0 e82/66 3:10c8e08d:::smithi16641208-23:1d v 82'554, mlcod=82'550)", 2020-11-16T20:56:52.431 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.790318+0000", 2020-11-16T20:56:52.431 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 7.495670541, 2020-11-16T20:56:52.431 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0048854110000000001, 2020-11-16T20:56:52.431 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.432 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.432 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.432 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.432 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.432 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790318+0000", 2020-11-16T20:56:52.432 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.432 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.432 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.433 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.433 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790318+0000", 2020-11-16T20:56:52.433 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7818000000000002e-05 2020-11-16T20:56:52.433 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.433 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.433 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.433 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790365+0000", 2020-11-16T20:56:52.433 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3859999999999996e-06 2020-11-16T20:56:52.434 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.434 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.434 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.434 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790375+0000", 2020-11-16T20:56:52.434 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3345e-05 2020-11-16T20:56:52.434 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.434 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.435 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.435 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790388+0000", 2020-11-16T20:56:52.435 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8689999999999993e-06 2020-11-16T20:56:52.435 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.435 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.435 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.435 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790397+0000", 2020-11-16T20:56:52.435 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0379e-05 2020-11-16T20:56:52.436 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.436 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.436 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.436 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790447+0000", 2020-11-16T20:56:52.436 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3439000000000003e-05 2020-11-16T20:56:52.436 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.436 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.437 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.437 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790481+0000", 2020-11-16T20:56:52.437 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0046606199999999999 2020-11-16T20:56:52.437 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.437 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.437 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:52.437 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.795141+0000", 2020-11-16T20:56:52.437 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1555000000000003e-05 2020-11-16T20:56:52.438 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.438 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.438 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.438 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.795203+0000", 2020-11-16T20:56:52.438 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0048854110000000001 2020-11-16T20:56:52.438 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.438 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.439 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.439 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.439 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.439 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4201.0:4 2.1 2.3e6a8311 (undecoded) ondisk+read+known_if_redirected e31)", 2020-11-16T20:56:52.439 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.118498+0000", 2020-11-16T20:56:52.439 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.1674904380000002, 2020-11-16T20:56:52.439 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0047454460000000004, 2020-11-16T20:56:52.439 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.440 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:56:52.440 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:52.440 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4201", 2020-11-16T20:56:52.440 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.59:0/1179787522", 2020-11-16T20:56:52.440 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4 2020-11-16T20:56:52.440 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.440 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.441 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.441 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.441 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.118498+0000", 2020-11-16T20:56:52.441 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.441 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.441 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.441 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.442 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.118498+0000", 2020-11-16T20:56:52.442 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5562999999999999e-05 2020-11-16T20:56:52.442 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.442 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.442 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.442 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.118523+0000", 2020-11-16T20:56:52.442 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8754e-05 2020-11-16T20:56:52.442 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.443 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.443 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.443 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.118542+0000", 2020-11-16T20:56:52.443 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5423000000000001e-05 2020-11-16T20:56:52.443 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.443 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.443 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.444 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.118557+0000", 2020-11-16T20:56:52.444 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.084e-05 2020-11-16T20:56:52.444 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.444 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.444 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.444 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.118568+0000", 2020-11-16T20:56:52.444 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0046516040000000002 2020-11-16T20:56:52.444 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.445 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.445 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.445 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.123220+0000", 2020-11-16T20:56:52.445 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3261999999999999e-05 2020-11-16T20:56:52.445 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.445 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.445 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.446 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.123243+0000", 2020-11-16T20:56:52.446 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0047454460000000004 2020-11-16T20:56:52.446 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.446 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.446 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.446 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.446 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.446 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:52.448 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:56:52.449 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:56:52.449 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:56:52.449 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:56:52.449 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:56:52.449 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:56:52.450 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:56:52.450 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:56:52.450 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:56:52.450 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:56:52.450 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:56:52.450 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:56:52.450 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:56:52.451 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:52.453+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:52.548 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:52.553+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:52.615 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:52.615 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:52.615 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:56:52.616 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:52.624 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:56:52.649 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:52.654+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:52.749 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:52.755+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:52.750 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:52.750 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:52.750 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:56:52.751 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:56:52.751 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:52.760 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:56:52.818 INFO:tasks.rados.rados.0.smithi166.stdout:855: done (5 left) 2020-11-16T20:56:52.819 INFO:tasks.rados.rados.0.smithi166.stdout:856: snap_remove snap 19 2020-11-16T20:56:52.820 INFO:teuthology.orchestra.run.smithi166.stderr:noscrub is unset 2020-11-16T20:56:52.850 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:52.855+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:52.932 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:52.932 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:56:52.933 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:56:52.933 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:56:52.933 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.933 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:202 3.2 3:5723fd94:::smithi16641208-211:head [copy-from ver 110] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e35)", 2020-11-16T20:56:52.933 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:56:52.933 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 57.966753052000001, 2020-11-16T20:56:52.933 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027790216999999999, 2020-11-16T20:56:52.934 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.934 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.934 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.934 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.934 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.934 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:56:52.934 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.935 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.935 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.935 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.935 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:56:52.935 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1907999999999998e-05 2020-11-16T20:56:52.935 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.935 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.935 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.936 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969232+0000", 2020-11-16T20:56:52.936 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5270000000000004e-06 2020-11-16T20:56:52.936 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.936 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.936 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.936 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969239+0000", 2020-11-16T20:56:52.937 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3062e-05 2020-11-16T20:56:52.937 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.937 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.937 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.937 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969252+0000", 2020-11-16T20:56:52.937 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8919999999999997e-06 2020-11-16T20:56:52.937 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.937 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.938 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.938 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969258+0000", 2020-11-16T20:56:52.938 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00040859799999999998 2020-11-16T20:56:52.938 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.938 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.938 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.938 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969666+0000", 2020-11-16T20:56:52.939 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0932000000000003e-05 2020-11-16T20:56:52.939 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.939 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.939 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.939 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969757+0000", 2020-11-16T20:56:52.939 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010999395 2020-11-16T20:56:52.939 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.940 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.940 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:52.940 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.980757+0000", 2020-11-16T20:56:52.940 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006260659 2020-11-16T20:56:52.940 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.940 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.940 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:52.940 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987017+0000", 2020-11-16T20:56:52.941 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0080836880000000003 2020-11-16T20:56:52.941 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.941 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.941 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:52.941 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995101+0000", 2020-11-16T20:56:52.941 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001796829 2020-11-16T20:56:52.941 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.942 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.942 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:52.942 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996898+0000", 2020-11-16T20:56:52.942 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2086000000000003e-05 2020-11-16T20:56:52.942 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.942 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.942 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:52.942 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996940+0000", 2020-11-16T20:56:52.943 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0641e-05 2020-11-16T20:56:52.943 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.943 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.943 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.943 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996971+0000", 2020-11-16T20:56:52.943 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027790216999999999 2020-11-16T20:56:52.943 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.944 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.944 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.944 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.944 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.944 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:547 3.2 3:5f250a2b:::smithi16641208-75:head [copy-from ver 38] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:52.944 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:56:52.944 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 47.918365749000003, 2020-11-16T20:56:52.944 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027400430999999999, 2020-11-16T20:56:52.945 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.945 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.945 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.945 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.945 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.945 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:56:52.945 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.946 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.946 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.946 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.946 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:56:52.946 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5093999999999999e-05 2020-11-16T20:56:52.946 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.946 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.947 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.947 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017613+0000", 2020-11-16T20:56:52.947 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6150000000000003e-06 2020-11-16T20:56:52.947 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.947 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.947 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.947 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017623+0000", 2020-11-16T20:56:52.947 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6934000000000001e-05 2020-11-16T20:56:52.948 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.948 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.948 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.948 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017639+0000", 2020-11-16T20:56:52.948 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1892000000000001e-05 2020-11-16T20:56:52.948 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.948 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.948 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.949 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017651+0000", 2020-11-16T20:56:52.949 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2955999999999998e-05 2020-11-16T20:56:52.949 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.949 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.949 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.949 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017714+0000", 2020-11-16T20:56:52.949 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019352400000000001 2020-11-16T20:56:52.950 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.950 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.950 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.950 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017908+0000", 2020-11-16T20:56:52.950 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0073901349999999999 2020-11-16T20:56:52.950 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.950 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.951 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:52.951 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025298+0000", 2020-11-16T20:56:52.951 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0082133799999999993 2020-11-16T20:56:52.951 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.951 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.951 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:52.951 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033511+0000", 2020-11-16T20:56:52.951 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0074347629999999996 2020-11-16T20:56:52.952 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.952 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.952 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:52.952 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.040946+0000", 2020-11-16T20:56:52.952 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039404669999999996 2020-11-16T20:56:52.952 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.952 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.953 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:52.953 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044887+0000", 2020-11-16T20:56:52.953 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7098000000000002e-05 2020-11-16T20:56:52.953 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.953 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.953 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:52.953 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044934+0000", 2020-11-16T20:56:52.953 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4573000000000003e-05 2020-11-16T20:56:52.954 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.954 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.954 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.954 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044968+0000", 2020-11-16T20:56:52.954 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027400430999999999 2020-11-16T20:56:52.954 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.954 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.955 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.955 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.955 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.955 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:548 3.2 3:6173e90a:::smithi16641208-2:head [copy-from ver 3] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:52.955 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:56:52.955 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 47.918234415999997, 2020-11-16T20:56:52.955 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029556911000000002, 2020-11-16T20:56:52.955 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.956 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.956 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.956 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.956 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.956 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:56:52.956 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.956 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.957 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.957 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.957 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:56:52.957 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2478000000000002e-05 2020-11-16T20:56:52.957 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.957 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.957 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.957 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017742+0000", 2020-11-16T20:56:52.958 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3060000000000003e-06 2020-11-16T20:56:52.958 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.958 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.958 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.958 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017748+0000", 2020-11-16T20:56:52.958 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1102e-05 2020-11-16T20:56:52.958 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.959 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.959 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.959 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017759+0000", 2020-11-16T20:56:52.959 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.118e-06 2020-11-16T20:56:52.959 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.959 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.959 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.960 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017764+0000", 2020-11-16T20:56:52.960 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032233700000000001 2020-11-16T20:56:52.960 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.960 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.960 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.960 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.018086+0000", 2020-11-16T20:56:52.960 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000128374 2020-11-16T20:56:52.960 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.961 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.961 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.961 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.018215+0000", 2020-11-16T20:56:52.961 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012971355 2020-11-16T20:56:52.961 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.961 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.961 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:52.962 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.031186+0000", 2020-11-16T20:56:52.962 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044142890000000001 2020-11-16T20:56:52.962 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.962 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.962 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:52.962 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.035600+0000", 2020-11-16T20:56:52.962 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092372719999999995 2020-11-16T20:56:52.962 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.963 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.963 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:52.963 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044838+0000", 2020-11-16T20:56:52.963 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0023022049999999999 2020-11-16T20:56:52.963 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.963 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.963 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:52.964 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047140+0000", 2020-11-16T20:56:52.964 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0380999999999997e-05 2020-11-16T20:56:52.964 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.964 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.964 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:52.964 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047200+0000", 2020-11-16T20:56:52.964 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5693999999999999e-05 2020-11-16T20:56:52.964 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.965 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.965 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.965 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047256+0000", 2020-11-16T20:56:52.965 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029556911000000002 2020-11-16T20:56:52.965 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.965 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.965 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.966 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.966 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.966 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:554 3.2 3:769099fd:::smithi16641208-247:head [copy-from ver 123] snapc 1=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:52.966 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:56:52.966 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 47.885831097999997, 2020-11-16T20:56:52.966 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998, 2020-11-16T20:56:52.966 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.966 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.967 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.967 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.967 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.967 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:56:52.967 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.967 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.967 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.968 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.968 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:56:52.968 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6705999999999997e-05 2020-11-16T20:56:52.968 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.968 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.968 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.968 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050139+0000", 2020-11-16T20:56:52.968 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6199999999999998e-06 2020-11-16T20:56:52.969 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.969 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.969 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.969 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050144+0000", 2020-11-16T20:56:52.969 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.944e-06 2020-11-16T20:56:52.969 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.969 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.970 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.970 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050154+0000", 2020-11-16T20:56:52.970 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4043999999999999e-05 2020-11-16T20:56:52.970 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.970 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.970 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.970 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050178+0000", 2020-11-16T20:56:52.971 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078971409999999999 2020-11-16T20:56:52.971 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.971 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.971 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.971 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058075+0000", 2020-11-16T20:56:52.971 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012776500000000001 2020-11-16T20:56:52.971 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.971 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.972 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.972 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058203+0000", 2020-11-16T20:56:52.972 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011807013 2020-11-16T20:56:52.972 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.972 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.972 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:52.972 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070010+0000", 2020-11-16T20:56:52.973 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029522160000000001 2020-11-16T20:56:52.973 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.973 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.973 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:52.973 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.072962+0000", 2020-11-16T20:56:52.973 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017845006 2020-11-16T20:56:52.973 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.973 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.974 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:52.974 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.090807+0000", 2020-11-16T20:56:52.974 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.009301808 2020-11-16T20:56:52.974 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.974 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.974 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:52.974 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100109+0000", 2020-11-16T20:56:52.975 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7076999999999995e-05 2020-11-16T20:56:52.975 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.975 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.975 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:52.975 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100176+0000", 2020-11-16T20:56:52.975 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9790999999999999e-05 2020-11-16T20:56:52.975 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.975 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.976 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.976 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100216+0000", 2020-11-16T20:56:52.976 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998 2020-11-16T20:56:52.976 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.976 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.976 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.977 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.977 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.977 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2429 4.0 4:3b92f709:::smithi16641208-69:head [rollback 7] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:56:52.977 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:56:52.977 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 42.919912836000002, 2020-11-16T20:56:52.977 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003, 2020-11-16T20:56:52.977 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.977 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.978 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:52.978 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:52.978 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:52.978 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2429 2020-11-16T20:56:52.978 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.978 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.978 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.979 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.979 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:56:52.979 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.979 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.979 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.979 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.979 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:56:52.980 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3710000000000002e-05 2020-11-16T20:56:52.980 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.980 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.980 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.980 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016044+0000", 2020-11-16T20:56:52.980 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7090000000000001e-06 2020-11-16T20:56:52.980 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.980 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.981 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.981 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016049+0000", 2020-11-16T20:56:52.981 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8820000000000003e-06 2020-11-16T20:56:52.981 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.981 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.981 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:52.981 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016056+0000", 2020-11-16T20:56:52.982 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.27e-06 2020-11-16T20:56:52.982 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.982 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.982 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:52.982 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016059+0000", 2020-11-16T20:56:52.982 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.537e-05 2020-11-16T20:56:52.982 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.983 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.983 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.983 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016115+0000", 2020-11-16T20:56:52.983 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8690000000000003e-06 2020-11-16T20:56:52.983 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.983 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.983 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:52.984 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016120+0000", 2020-11-16T20:56:52.984 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021405730000000002 2020-11-16T20:56:52.984 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.984 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.984 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.984 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018260+0000", 2020-11-16T20:56:52.984 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0137999999999999e-05 2020-11-16T20:56:52.985 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.985 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.985 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:52.985 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018320+0000", 2020-11-16T20:56:52.985 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011799352000000001 2020-11-16T20:56:52.985 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.985 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.985 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.986 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030120+0000", 2020-11-16T20:56:52.986 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000163139 2020-11-16T20:56:52.986 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.986 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.986 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.986 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030283+0000", 2020-11-16T20:56:52.986 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029657000000000002 2020-11-16T20:56:52.987 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.987 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.987 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:52.987 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030579+0000", 2020-11-16T20:56:52.987 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3058000000000001e-05 2020-11-16T20:56:52.987 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.987 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.987 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:52.988 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030612+0000", 2020-11-16T20:56:52.988 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0075168259999999999 2020-11-16T20:56:52.988 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.988 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.988 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.988 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038129+0000", 2020-11-16T20:56:52.988 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012914299999999999 2020-11-16T20:56:52.989 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.989 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.989 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:52.989 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038258+0000", 2020-11-16T20:56:52.989 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034292799999999999 2020-11-16T20:56:52.989 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.989 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.989 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:56:52.990 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038601+0000", 2020-11-16T20:56:52.990 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0025181159999999999 2020-11-16T20:56:52.990 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.990 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.990 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:52.990 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041119+0000", 2020-11-16T20:56:52.990 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2331999999999997e-05 2020-11-16T20:56:52.991 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.991 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.991 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for ondisk", 2020-11-16T20:56:52.991 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041202+0000", 2020-11-16T20:56:52.991 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028481750000000001 2020-11-16T20:56:52.991 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.991 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.991 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:52.992 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044050+0000", 2020-11-16T20:56:52.992 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001269921 2020-11-16T20:56:52.992 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.992 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.992 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:52.992 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045320+0000", 2020-11-16T20:56:52.992 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054215490000000003 2020-11-16T20:56:52.993 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.993 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.993 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:52.993 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050741+0000", 2020-11-16T20:56:52.993 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6981000000000001e-05 2020-11-16T20:56:52.993 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.993 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.993 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:52.994 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050808+0000", 2020-11-16T20:56:52.994 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8841e-05 2020-11-16T20:56:52.994 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.994 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.994 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:52.994 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050877+0000", 2020-11-16T20:56:52.994 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003 2020-11-16T20:56:52.995 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.995 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:52.995 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:52.995 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.995 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.995 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2430 4.0 4:3b92f709:::smithi16641208-69:head [append 0~0] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:56:52.995 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:56:52.995 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 42.919856512999999, 2020-11-16T20:56:52.996 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001, 2020-11-16T20:56:52.996 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:52.996 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:52.996 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:52.996 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:52.996 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:52.996 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2430 2020-11-16T20:56:52.997 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.997 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:52.997 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.997 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:52.997 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:56:52.997 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:52.997 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.997 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.998 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:52.998 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:56:52.998 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0857e-05 2020-11-16T20:56:52.998 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.998 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.998 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:52.998 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016098+0000", 2020-11-16T20:56:52.999 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9179999999999999e-06 2020-11-16T20:56:52.999 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:52.999 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:52.999 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:52.999 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016104+0000", 2020-11-16T20:56:52.999 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8230000000000006e-06 2020-11-16T20:56:52.999 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.000 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.000 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:53.000 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016114+0000", 2020-11-16T20:56:53.000 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2180000000000001e-06 2020-11-16T20:56:53.000 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.000 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.000 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.000 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016118+0000", 2020-11-16T20:56:53.001 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3547999999999995e-05 2020-11-16T20:56:53.001 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.001 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.001 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.001 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016181+0000", 2020-11-16T20:56:53.001 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8730000000000007e-06 2020-11-16T20:56:53.001 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.002 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.002 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:53.002 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016189+0000", 2020-11-16T20:56:53.002 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021577200000000001 2020-11-16T20:56:53.002 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.002 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.002 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.002 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018347+0000", 2020-11-16T20:56:53.003 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6832000000000001e-05 2020-11-16T20:56:53.003 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.003 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.003 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.003 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018404+0000", 2020-11-16T20:56:53.003 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012272913999999999 2020-11-16T20:56:53.003 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.004 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.004 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.004 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030677+0000", 2020-11-16T20:56:53.004 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2555000000000002e-05 2020-11-16T20:56:53.004 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.004 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.004 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.004 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030719+0000", 2020-11-16T20:56:53.005 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010518684 2020-11-16T20:56:53.005 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.005 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.005 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.005 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041238+0000", 2020-11-16T20:56:53.005 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000144723 2020-11-16T20:56:53.005 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.006 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.006 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:53.006 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041383+0000", 2020-11-16T20:56:53.006 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000214575 2020-11-16T20:56:53.006 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.006 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.006 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:56:53.006 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041597+0000", 2020-11-16T20:56:53.007 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002463196 2020-11-16T20:56:53.007 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.007 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.007 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:53.007 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044060+0000", 2020-11-16T20:56:53.007 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001654066 2020-11-16T20:56:53.007 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.008 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.008 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.008 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045715+0000", 2020-11-16T20:56:53.008 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053780599999999996 2020-11-16T20:56:53.008 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.008 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.008 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.008 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051093+0000", 2020-11-16T20:56:53.009 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8189999999999996e-05 2020-11-16T20:56:53.009 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.009 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.009 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:53.009 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051161+0000", 2020-11-16T20:56:53.009 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4910000000000001e-05 2020-11-16T20:56:53.009 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.010 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.010 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:53.010 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051216+0000", 2020-11-16T20:56:53.010 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001 2020-11-16T20:56:53.010 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.010 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:53.010 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.011 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.011 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.011 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "MOSDPGPush(4.1 52/51 [PushOp(4:9ab04c4a:::smithi16641208-1:head, version: 33'3, data_included: [0~892056,1542129~156520], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:9ab04c4a:::smithi16641208-1:head@33'3, size: 2016807, copy_subset: [0~2016807], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1698649, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:a1eef07d:::smithi16641208-13:head, version: 33'9, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:a1eef07d:::smithi16641208-13:head@33'9, size: 2201684, copy_subset: [0~2201684], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:929564f0:::smithi16641208-24:head, version: 33'18, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:929564f0:::smithi16641208-24:head@33'18, size: 2386561, copy_subset: [0~2386561], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b565f7d2:::smithi16641208-35:head, version: 33'27, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b565f7d2:::smithi16641208-35:head@33'27, size: 2571438, copy_subset: [0~2571438], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b6545a47:::smithi16641208-46:head, version: 33'29, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b6545a47:::smithi16641208-46:head@33'29, size: 2756315, copy_subset: [0~2756315], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:9bd9f31d:::smithi16641208-48:head, version: 33'35, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:9bd9f31d:::smithi16641208-48:head@33'35, size: 2789929, copy_subset: [0~2789929], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:83205103:::smithi16641208-103:head, version: 34'38, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:83205103:::smithi16641208-103:head@34'38, size: 3714314, copy_subset: [0~3714314], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:86a0a5b7:::smithi16641208-108:head, version: 34'42, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:86a0a5b7:::smithi16641208-108:head@34'42, size: 3798349, copy_subset: [0~3798349], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-16T20:56:53.011 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:56:53.011 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.165259906999999, 2020-11-16T20:56:53.011 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032552672999999997, 2020-11-16T20:56:53.011 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:53.012 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:53.012 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:53.012 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.012 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:53.012 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:56:53.012 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:53.012 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.012 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.013 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:53.013 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:56:53.013 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017498692999999999 2020-11-16T20:56:53.013 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.013 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.013 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:53.013 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788172+0000", 2020-11-16T20:56:53.014 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4147999999999999e-05 2020-11-16T20:56:53.014 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.014 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.014 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:53.014 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788206+0000", 2020-11-16T20:56:53.014 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0016000000000002e-05 2020-11-16T20:56:53.014 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.014 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.015 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:53.015 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788276+0000", 2020-11-16T20:56:53.015 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2172000000000002e-05 2020-11-16T20:56:53.015 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.015 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.015 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.015 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788319+0000", 2020-11-16T20:56:53.016 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000154337 2020-11-16T20:56:53.016 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.016 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.016 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788473+0000", 2020-11-16T20:56:53.016 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7690000000000002e-06 2020-11-16T20:56:53.016 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.017 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:53.017 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788482+0000", 2020-11-16T20:56:53.017 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014744538 2020-11-16T20:56:53.017 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.017 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.017 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:53.017 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803226+0000", 2020-11-16T20:56:53.018 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032552672999999997 2020-11-16T20:56:53.018 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.018 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:53.018 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.018 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.018 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.018 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.0:552 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'128, mlcod=0'0)", 2020-11-16T20:56:53.019 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:56:53.019 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.145294489000001, 2020-11-16T20:56:53.019 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038033168999999999, 2020-11-16T20:56:53.019 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:53.019 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:53.019 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:53.019 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.019 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:53.020 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:56:53.020 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:53.020 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.020 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.020 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:53.020 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:56:53.020 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0031023880000000002 2020-11-16T20:56:53.021 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.021 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.021 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:53.021 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793741+0000", 2020-11-16T20:56:53.021 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1496e-05 2020-11-16T20:56:53.021 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.021 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.021 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:53.022 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793753+0000", 2020-11-16T20:56:53.022 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9009999999999999e-05 2020-11-16T20:56:53.022 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.022 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.022 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:53.022 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793772+0000", 2020-11-16T20:56:53.022 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3318e-05 2020-11-16T20:56:53.023 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.023 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.023 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.023 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793785+0000", 2020-11-16T20:56:53.023 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012534775 2020-11-16T20:56:53.023 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.023 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.024 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.024 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806320+0000", 2020-11-16T20:56:53.024 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8144999999999999e-05 2020-11-16T20:56:53.024 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.024 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.024 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:53.024 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806348+0000", 2020-11-16T20:56:53.024 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022285688000000001 2020-11-16T20:56:53.025 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.025 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.025 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:53.025 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828634+0000", 2020-11-16T20:56:53.025 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8349000000000002e-05 2020-11-16T20:56:53.025 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.025 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.026 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:53.026 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828672+0000", 2020-11-16T20:56:53.026 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038033168999999999 2020-11-16T20:56:53.026 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.026 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:53.026 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.026 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.026 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.027 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2503 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'129, mlcod=0'0)", 2020-11-16T20:56:53.027 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:56:53.027 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.142106308999999, 2020-11-16T20:56:53.027 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034870998, 2020-11-16T20:56:53.027 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:53.027 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:53.027 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:53.028 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.028 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:53.028 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:56:53.028 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:53.028 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.028 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.028 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:53.028 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:56:53.029 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00093048899999999995 2020-11-16T20:56:53.029 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.029 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.029 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:53.029 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794758+0000", 2020-11-16T20:56:53.029 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.169e-05 2020-11-16T20:56:53.029 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.030 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.030 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:53.030 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794769+0000", 2020-11-16T20:56:53.030 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3998999999999999e-05 2020-11-16T20:56:53.030 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.030 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.030 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:53.031 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794783+0000", 2020-11-16T20:56:53.031 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.481e-06 2020-11-16T20:56:53.031 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.031 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.031 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.031 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794791+0000", 2020-11-16T20:56:53.031 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.02524036 2020-11-16T20:56:53.031 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.032 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.032 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.032 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820031+0000", 2020-11-16T20:56:53.032 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.811e-05 2020-11-16T20:56:53.032 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.032 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.032 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:53.033 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820059+0000", 2020-11-16T20:56:53.033 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.008614577 2020-11-16T20:56:53.033 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.033 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.033 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:53.033 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828674+0000", 2020-11-16T20:56:53.033 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4292000000000001e-05 2020-11-16T20:56:53.033 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.034 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.034 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:53.034 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828698+0000", 2020-11-16T20:56:53.034 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034870998 2020-11-16T20:56:53.034 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.034 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:53.034 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.035 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.035 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.035 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2504 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'130, mlcod=0'0)", 2020-11-16T20:56:53.035 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:56:53.035 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.141100627, 2020-11-16T20:56:53.035 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033888776000000002, 2020-11-16T20:56:53.035 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:53.036 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:53.036 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:53.036 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.036 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:53.036 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:56:53.036 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:53.036 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.036 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.037 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:53.037 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:56:53.037 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3896999999999997e-05 2020-11-16T20:56:53.037 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.037 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.037 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:53.037 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794877+0000", 2020-11-16T20:56:53.038 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7019999999999998e-06 2020-11-16T20:56:53.038 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.038 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.038 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:53.038 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794883+0000", 2020-11-16T20:56:53.038 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.789e-06 2020-11-16T20:56:53.038 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.038 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.039 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:53.039 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794888+0000", 2020-11-16T20:56:53.039 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.852e-06 2020-11-16T20:56:53.039 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.039 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.039 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.039 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794891+0000", 2020-11-16T20:56:53.040 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026152822999999999 2020-11-16T20:56:53.040 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.040 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.040 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.040 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.821044+0000", 2020-11-16T20:56:53.040 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6900999999999999e-05 2020-11-16T20:56:53.040 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.040 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.041 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:53.041 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.821071+0000", 2020-11-16T20:56:53.041 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0076283210000000004 2020-11-16T20:56:53.041 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.041 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.041 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:53.041 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828699+0000", 2020-11-16T20:56:53.042 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2490999999999999e-05 2020-11-16T20:56:53.042 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.042 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.042 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:53.042 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828722+0000", 2020-11-16T20:56:53.042 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033888776000000002 2020-11-16T20:56:53.042 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.042 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:53.043 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.043 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.043 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.043 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.13:681 3.1 e52/19 3:afc69464:::smithi16641208-110:head v 52'546, mlcod=52'544)", 2020-11-16T20:56:53.043 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:56:53.043 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.138440557000003, 2020-11-16T20:56:53.043 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.03113606, 2020-11-16T20:56:53.044 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:53.044 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:53.044 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:53.044 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.044 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:53.044 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:56:53.044 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:53.044 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.045 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.045 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:53.045 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:56:53.045 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0026681809999999999 2020-11-16T20:56:53.045 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.045 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.045 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:53.046 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800161+0000", 2020-11-16T20:56:53.046 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3499000000000001e-05 2020-11-16T20:56:53.046 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.046 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.046 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:53.046 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800175+0000", 2020-11-16T20:56:53.046 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8301999999999999e-05 2020-11-16T20:56:53.047 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.047 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.047 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:53.047 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800193+0000", 2020-11-16T20:56:53.047 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0465999999999999e-05 2020-11-16T20:56:53.047 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.047 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.047 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.048 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800203+0000", 2020-11-16T20:56:53.048 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061432479999999996 2020-11-16T20:56:53.048 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.048 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.048 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.048 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806347+0000", 2020-11-16T20:56:53.048 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.641e-05 2020-11-16T20:56:53.049 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.049 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.049 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:53.049 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806373+0000", 2020-11-16T20:56:53.049 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022190887999999999 2020-11-16T20:56:53.049 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.049 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.049 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:53.050 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828564+0000", 2020-11-16T20:56:53.050 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5066000000000003e-05 2020-11-16T20:56:53.050 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.050 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.050 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:53.050 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828629+0000", 2020-11-16T20:56:53.050 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.03113606 2020-11-16T20:56:53.051 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.051 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:53.051 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.051 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.051 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.051 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.13:682 3.1 e52/19 3:b3ae2c4d:::smithi16641208-463:head v 52'547, mlcod=52'544)", 2020-11-16T20:56:53.051 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.802222+0000", 2020-11-16T20:56:53.051 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.133711652999999, 2020-11-16T20:56:53.052 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026721733000000001, 2020-11-16T20:56:53.052 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:53.052 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:53.052 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:53.052 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.052 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:53.052 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.802222+0000", 2020-11-16T20:56:53.053 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:53.053 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.053 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.053 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:53.053 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.802222+0000", 2020-11-16T20:56:53.053 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001333442 2020-11-16T20:56:53.053 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.053 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.054 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:53.054 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803555+0000", 2020-11-16T20:56:53.054 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0971999999999999e-05 2020-11-16T20:56:53.054 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.054 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.054 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:53.054 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803566+0000", 2020-11-16T20:56:53.055 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5973000000000001e-05 2020-11-16T20:56:53.055 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.055 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.055 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:53.055 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803582+0000", 2020-11-16T20:56:53.055 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2969999999999998e-06 2020-11-16T20:56:53.055 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.055 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.056 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.056 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803590+0000", 2020-11-16T20:56:53.056 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016424259 2020-11-16T20:56:53.056 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.056 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.056 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.056 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820014+0000", 2020-11-16T20:56:53.057 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9485999999999999e-05 2020-11-16T20:56:53.057 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.057 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.057 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:53.057 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820033+0000", 2020-11-16T20:56:53.057 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0088553179999999992 2020-11-16T20:56:53.057 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.057 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.058 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:53.058 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828889+0000", 2020-11-16T20:56:53.058 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4985999999999998e-05 2020-11-16T20:56:53.058 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.058 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.058 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:53.058 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828944+0000", 2020-11-16T20:56:53.059 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026721733000000001 2020-11-16T20:56:53.059 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.059 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:53.059 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.059 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.059 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.059 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:603 3.2 3:5a2e7c26:::smithi16641208-130:head [copy-from ver 67] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:56:53.060 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:56:53.060 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 33.184692562999999, 2020-11-16T20:56:53.060 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036631116999999998, 2020-11-16T20:56:53.060 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:53.060 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:53.060 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:53.060 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.061 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:53.061 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:56:53.061 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:53.061 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.061 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.061 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:53.061 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:56:53.061 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9854000000000002e-05 2020-11-16T20:56:53.062 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.062 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.062 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:53.062 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751281+0000", 2020-11-16T20:56:53.062 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1840000000000004e-06 2020-11-16T20:56:53.062 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.062 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.063 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:53.063 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751287+0000", 2020-11-16T20:56:53.063 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0231000000000001e-05 2020-11-16T20:56:53.063 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.063 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.063 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:53.063 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751297+0000", 2020-11-16T20:56:53.063 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.639e-06 2020-11-16T20:56:53.064 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.064 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.064 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.064 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751302+0000", 2020-11-16T20:56:53.064 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030012000000000002 2020-11-16T20:56:53.064 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.064 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.065 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751602+0000", 2020-11-16T20:56:53.065 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013830200000000001 2020-11-16T20:56:53.065 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:53.065 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751740+0000", 2020-11-16T20:56:53.065 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019538969999999999 2020-11-16T20:56:53.066 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.066 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.066 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:53.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771279+0000", 2020-11-16T20:56:53.066 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007630403 2020-11-16T20:56:53.066 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.066 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.067 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:53.067 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.778910+0000", 2020-11-16T20:56:53.067 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0065002009999999997 2020-11-16T20:56:53.067 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.067 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.067 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.067 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.785410+0000", 2020-11-16T20:56:53.067 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0023914140000000001 2020-11-16T20:56:53.068 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.068 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.068 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.068 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787801+0000", 2020-11-16T20:56:53.068 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9629999999999998e-05 2020-11-16T20:56:53.068 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.068 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.069 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:53.069 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787841+0000", 2020-11-16T20:56:53.069 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1168999999999999e-05 2020-11-16T20:56:53.069 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.069 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.069 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:53.069 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787872+0000", 2020-11-16T20:56:53.069 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036631116999999998 2020-11-16T20:56:53.070 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.070 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:53.070 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.070 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.070 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.070 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:609 3.2 3:5eead97c:::smithi16641208-34:head [copy-from ver 27] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:56:53.070 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:56:53.071 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 33.146895434000001, 2020-11-16T20:56:53.071 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.062626424, 2020-11-16T20:56:53.071 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:53.071 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:53.071 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:53.071 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.071 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:53.072 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:56:53.072 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:53.072 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.072 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.072 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:53.072 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:56:53.072 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3596000000000001e-05 2020-11-16T20:56:53.072 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.073 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.073 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:53.073 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789082+0000", 2020-11-16T20:56:53.073 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3209999999999999e-06 2020-11-16T20:56:53.073 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.073 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.073 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:53.074 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789089+0000", 2020-11-16T20:56:53.074 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3498e-05 2020-11-16T20:56:53.074 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.074 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.074 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:53.074 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789103+0000", 2020-11-16T20:56:53.074 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3679999999999998e-06 2020-11-16T20:56:53.074 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.075 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.075 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.075 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789109+0000", 2020-11-16T20:56:53.075 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007399638 2020-11-16T20:56:53.075 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.075 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.075 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.076 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.796509+0000", 2020-11-16T20:56:53.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000181168 2020-11-16T20:56:53.076 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.076 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.076 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:53.076 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.796690+0000", 2020-11-16T20:56:53.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01336562 2020-11-16T20:56:53.076 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.077 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.077 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:53.077 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.810055+0000", 2020-11-16T20:56:53.077 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044828350000000001 2020-11-16T20:56:53.077 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.077 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.077 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:53.078 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.814538+0000", 2020-11-16T20:56:53.078 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035609628999999997 2020-11-16T20:56:53.078 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.078 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.078 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.078 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850148+0000", 2020-11-16T20:56:53.078 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0013754730000000001 2020-11-16T20:56:53.079 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.079 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.079 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.079 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851523+0000", 2020-11-16T20:56:53.079 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9935e-05 2020-11-16T20:56:53.079 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.079 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.079 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:53.080 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851603+0000", 2020-11-16T20:56:53.080 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1342999999999999e-05 2020-11-16T20:56:53.080 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.080 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.080 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:53.080 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851665+0000", 2020-11-16T20:56:53.080 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.062626424 2020-11-16T20:56:53.080 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.081 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:53.081 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.081 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.081 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.081 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2605 4.0 4:2294fced:::smithi16641208-278:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:56:53.081 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:56:53.081 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 33.019060318000001, 2020-11-16T20:56:53.082 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032301128999999998, 2020-11-16T20:56:53.082 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:53.082 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:53.082 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:53.082 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:53.082 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:53.082 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2605 2020-11-16T20:56:53.082 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.083 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:53.083 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.083 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:53.083 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:56:53.083 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:53.083 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.083 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.084 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:53.084 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:56:53.084 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.811e-05 2020-11-16T20:56:53.084 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.084 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.084 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:53.084 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916901+0000", 2020-11-16T20:56:53.084 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2939999999999996e-06 2020-11-16T20:56:53.085 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.085 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.085 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:53.085 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916907+0000", 2020-11-16T20:56:53.085 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0589e-05 2020-11-16T20:56:53.085 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.085 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.086 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:53.086 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916917+0000", 2020-11-16T20:56:53.086 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2549999999999999e-06 2020-11-16T20:56:53.086 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.086 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.086 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.086 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916921+0000", 2020-11-16T20:56:53.086 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033789099999999999 2020-11-16T20:56:53.087 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.087 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.087 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.087 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.917259+0000", 2020-11-16T20:56:53.088 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.25e-05 2020-11-16T20:56:53.088 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.088 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.088 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.088 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.917332+0000", 2020-11-16T20:56:53.088 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.028336376999999999 2020-11-16T20:56:53.088 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.089 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.089 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.089 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.945668+0000", 2020-11-16T20:56:53.089 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0983000000000006e-05 2020-11-16T20:56:53.089 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.089 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.089 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:53.090 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.945759+0000", 2020-11-16T20:56:53.090 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00324756 2020-11-16T20:56:53.090 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.090 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.090 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.090 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949007+0000", 2020-11-16T20:56:53.090 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0583999999999999e-05 2020-11-16T20:56:53.091 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.091 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.091 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:53.091 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949097+0000", 2020-11-16T20:56:53.091 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6985999999999998e-05 2020-11-16T20:56:53.091 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.091 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.092 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:53.092 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949174+0000", 2020-11-16T20:56:53.092 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032301128999999998 2020-11-16T20:56:53.092 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.092 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:53.092 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.092 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.092 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.093 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2874 4.0 4:055e14cb:::smithi16641208-187:head [copy-from ver 402] snapc 25=[25,23,21,f] ondisk+write+known_if_redirected e72)", 2020-11-16T20:56:53.093 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:56:53.093 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 18.190536647999998, 2020-11-16T20:56:53.093 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031663616999999998, 2020-11-16T20:56:53.093 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:53.093 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:53.093 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:53.094 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:53.094 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:53.094 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2874 2020-11-16T20:56:53.094 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.094 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:53.094 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.094 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:53.095 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:56:53.095 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:53.095 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.095 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.095 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:53.095 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:56:53.095 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6754000000000001e-05 2020-11-16T20:56:53.096 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.096 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.096 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:53.096 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745434+0000", 2020-11-16T20:56:53.096 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5049999999999998e-06 2020-11-16T20:56:53.096 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.096 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.096 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:53.097 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745439+0000", 2020-11-16T20:56:53.097 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0803e-05 2020-11-16T20:56:53.097 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.097 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.097 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:53.097 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745450+0000", 2020-11-16T20:56:53.097 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8810000000000004e-06 2020-11-16T20:56:53.098 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.098 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.098 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.098 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745455+0000", 2020-11-16T20:56:53.098 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022866499999999999 2020-11-16T20:56:53.098 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.098 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.099 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.099 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745684+0000", 2020-11-16T20:56:53.099 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000132714 2020-11-16T20:56:53.099 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.099 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.099 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:53.099 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745816+0000", 2020-11-16T20:56:53.099 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050117850000000004 2020-11-16T20:56:53.100 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.100 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.100 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:56:53.100 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.750828+0000", 2020-11-16T20:56:53.100 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010413489 2020-11-16T20:56:53.100 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.100 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.101 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:53.101 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.761241+0000", 2020-11-16T20:56:53.101 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028274289999999998 2020-11-16T20:56:53.101 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.101 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.101 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.101 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.764069+0000", 2020-11-16T20:56:53.101 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012880057 2020-11-16T20:56:53.102 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.102 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.102 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.102 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.776949+0000", 2020-11-16T20:56:53.102 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2536e-05 2020-11-16T20:56:53.102 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.102 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.103 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:53.103 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777002+0000", 2020-11-16T20:56:53.103 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8999000000000002e-05 2020-11-16T20:56:53.103 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.103 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.103 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:53.103 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777061+0000", 2020-11-16T20:56:53.103 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031663616999999998 2020-11-16T20:56:53.104 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.104 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:53.104 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.104 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.104 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.104 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2875 4.0 4:055e14cb:::smithi16641208-187:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-11-16T20:56:53.104 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:56:53.105 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 18.190447421999998, 2020-11-16T20:56:53.105 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031888061000000002, 2020-11-16T20:56:53.105 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:53.105 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:53.105 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:53.105 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:53.105 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:53.106 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2875 2020-11-16T20:56:53.106 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.106 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:53.106 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.106 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:53.106 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:56:53.106 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:53.106 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.107 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.107 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:53.107 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:56:53.107 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0239000000000001e-05 2020-11-16T20:56:53.107 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.107 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.107 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:53.108 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745506+0000", 2020-11-16T20:56:53.108 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.252e-06 2020-11-16T20:56:53.108 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.108 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.108 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:53.108 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745510+0000", 2020-11-16T20:56:53.108 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3670000000000002e-06 2020-11-16T20:56:53.108 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.109 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.109 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:53.109 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745516+0000", 2020-11-16T20:56:53.109 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1089999999999998e-06 2020-11-16T20:56:53.109 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.109 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.109 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.110 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745519+0000", 2020-11-16T20:56:53.110 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045188999999999998 2020-11-16T20:56:53.110 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.110 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.110 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.110 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745971+0000", 2020-11-16T20:56:53.110 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7822999999999998e-05 2020-11-16T20:56:53.110 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.111 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.111 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.111 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.746029+0000", 2020-11-16T20:56:53.111 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013333563999999999 2020-11-16T20:56:53.111 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.111 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.111 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.112 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.759362+0000", 2020-11-16T20:56:53.112 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000170896 2020-11-16T20:56:53.112 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.112 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.112 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:53.112 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.759533+0000", 2020-11-16T20:56:53.112 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017572878 2020-11-16T20:56:53.113 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.113 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.113 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777106+0000", 2020-11-16T20:56:53.113 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014436399999999999 2020-11-16T20:56:53.113 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.113 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:53.114 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777251+0000", 2020-11-16T20:56:53.114 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012367899999999999 2020-11-16T20:56:53.114 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.114 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.114 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:53.114 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777374+0000", 2020-11-16T20:56:53.114 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031888061000000002 2020-11-16T20:56:53.115 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.115 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:53.115 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.115 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.115 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.115 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3004 3.2 3:4fbd4ff5:::smithi16641208-419:head [copy-from ver 366] snapc 33=[33,25] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e87)", 2020-11-16T20:56:53.115 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.815968+0000", 2020-11-16T20:56:53.116 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.119965809, 2020-11-16T20:56:53.116 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042048220999999997, 2020-11-16T20:56:53.116 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:53.116 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:53.116 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:53.116 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.116 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:53.116 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.815968+0000", 2020-11-16T20:56:53.117 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:53.117 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.117 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.117 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:53.117 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.815968+0000", 2020-11-16T20:56:53.117 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3235000000000002e-05 2020-11-16T20:56:53.117 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.118 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.118 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:53.118 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816011+0000", 2020-11-16T20:56:53.118 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.303e-06 2020-11-16T20:56:53.118 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.118 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.118 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:53.119 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816019+0000", 2020-11-16T20:56:53.119 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9714999999999999e-05 2020-11-16T20:56:53.119 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.119 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.119 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:53.119 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816049+0000", 2020-11-16T20:56:53.119 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2960000000000001e-06 2020-11-16T20:56:53.119 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.120 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.120 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.120 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816056+0000", 2020-11-16T20:56:53.120 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000241606 2020-11-16T20:56:53.120 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.120 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.120 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.121 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816298+0000", 2020-11-16T20:56:53.121 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016421599999999999 2020-11-16T20:56:53.121 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.121 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.121 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:53.121 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816462+0000", 2020-11-16T20:56:53.121 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025803994 2020-11-16T20:56:53.121 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.122 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.122 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:53.122 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.842266+0000", 2020-11-16T20:56:53.122 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0072860549999999996 2020-11-16T20:56:53.122 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.122 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.122 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:53.123 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.849552+0000", 2020-11-16T20:56:53.123 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0077911389999999999 2020-11-16T20:56:53.123 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.123 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.123 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.123 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.857343+0000", 2020-11-16T20:56:53.123 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00049728000000000001 2020-11-16T20:56:53.123 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.124 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.124 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.124 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.857841+0000", 2020-11-16T20:56:53.124 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.1997999999999997e-05 2020-11-16T20:56:53.124 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.124 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.124 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:53.125 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.857923+0000", 2020-11-16T20:56:53.125 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3383999999999999e-05 2020-11-16T20:56:53.125 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.125 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.125 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:53.125 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858016+0000", 2020-11-16T20:56:53.125 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042048220999999997 2020-11-16T20:56:53.126 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.126 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:53.126 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.126 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.126 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.126 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:650 3.2 3:4fbd4ff5:::smithi16641208-419:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e87)", 2020-11-16T20:56:53.126 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.816105+0000", 2020-11-16T20:56:53.126 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.1198281790000002, 2020-11-16T20:56:53.127 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042242304000000001, 2020-11-16T20:56:53.127 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:53.127 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:53.127 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:53.127 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.127 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:53.127 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816105+0000", 2020-11-16T20:56:53.128 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:53.128 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.128 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.128 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:53.128 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816105+0000", 2020-11-16T20:56:53.128 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6486999999999999e-05 2020-11-16T20:56:53.128 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.128 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.129 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:53.129 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816132+0000", 2020-11-16T20:56:53.129 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5230000000000003e-06 2020-11-16T20:56:53.129 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.129 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.129 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:53.129 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816137+0000", 2020-11-16T20:56:53.130 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1498000000000001e-05 2020-11-16T20:56:53.130 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.130 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.130 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:53.130 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816149+0000", 2020-11-16T20:56:53.130 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5789999999999997e-06 2020-11-16T20:56:53.130 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.131 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.131 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.131 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816153+0000", 2020-11-16T20:56:53.131 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00044901199999999999 2020-11-16T20:56:53.131 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.131 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.131 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.131 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816602+0000", 2020-11-16T20:56:53.132 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6134000000000002e-05 2020-11-16T20:56:53.132 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.132 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.132 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.132 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816649+0000", 2020-11-16T20:56:53.132 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032065206999999998 2020-11-16T20:56:53.132 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.133 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.133 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.133 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848714+0000", 2020-11-16T20:56:53.133 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000103695 2020-11-16T20:56:53.133 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.133 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.133 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:53.133 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848818+0000", 2020-11-16T20:56:53.134 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092315220000000007 2020-11-16T20:56:53.134 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.134 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.134 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.134 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858049+0000", 2020-11-16T20:56:53.134 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000104415 2020-11-16T20:56:53.134 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.135 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.135 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:53.135 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858153+0000", 2020-11-16T20:56:53.135 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019423199999999999 2020-11-16T20:56:53.135 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.135 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.135 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:53.135 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858348+0000", 2020-11-16T20:56:53.136 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042242304000000001 2020-11-16T20:56:53.136 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.136 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:53.136 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.136 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.136 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.136 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:651 3.2 3:4fbd4ff5:::smithi16641208-419:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e87)", 2020-11-16T20:56:53.137 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.816182+0000", 2020-11-16T20:56:53.137 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.1197516840000001, 2020-11-16T20:56:53.137 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047784220000000002, 2020-11-16T20:56:53.137 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:53.137 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:53.137 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:53.137 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.137 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:53.138 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816182+0000", 2020-11-16T20:56:53.138 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:53.138 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.138 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.138 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:53.138 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816182+0000", 2020-11-16T20:56:53.138 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6310999999999998e-05 2020-11-16T20:56:53.139 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.139 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.139 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:53.139 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816218+0000", 2020-11-16T20:56:53.139 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6110000000000001e-06 2020-11-16T20:56:53.139 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.139 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.140 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:53.140 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816224+0000", 2020-11-16T20:56:53.140 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9189999999999994e-06 2020-11-16T20:56:53.140 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.140 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.140 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:53.140 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816234+0000", 2020-11-16T20:56:53.140 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3220000000000003e-06 2020-11-16T20:56:53.141 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.141 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.141 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.141 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816238+0000", 2020-11-16T20:56:53.141 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00043294900000000002 2020-11-16T20:56:53.141 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.141 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.142 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.142 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816671+0000", 2020-11-16T20:56:53.142 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3359999999999998e-05 2020-11-16T20:56:53.142 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.142 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.142 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.142 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816714+0000", 2020-11-16T20:56:53.142 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032137410999999998 2020-11-16T20:56:53.143 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.143 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.143 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.143 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848852+0000", 2020-11-16T20:56:53.143 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000103235 2020-11-16T20:56:53.143 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.143 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.144 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:53.144 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848955+0000", 2020-11-16T20:56:53.144 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094266409999999995 2020-11-16T20:56:53.144 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.144 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.144 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:53.144 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858382+0000", 2020-11-16T20:56:53.144 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7973999999999995e-05 2020-11-16T20:56:53.145 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.145 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.145 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:53.145 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858470+0000", 2020-11-16T20:56:53.145 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054964870000000004 2020-11-16T20:56:53.145 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:53.145 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:53.146 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:53.146 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.863966+0000", 2020-11-16T20:56:53.146 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047784220000000002 2020-11-16T20:56:53.146 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.146 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:53.146 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.146 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:53.146 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:53.147 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:53.148 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:53.153+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:53.148 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:56:53.249 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:53.254+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:53.297 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:53.297 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:53.297 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:56:53.297 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:53.307 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:56:53.350 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:53.354+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:53.450 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:53.454+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:53.483 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:53.483 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:53.483 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:56:53.483 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:56:53.484 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:53.492 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:56:53.551 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:53.556+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:53.651 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:53.656+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:53.669 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:53.670 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:56:53.670 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:56:53.670 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:56:53.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.670 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2370 4.1 4:82bb0fe7:::smithi16641208-101:head [write 2346424~426830] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:53.670 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:56:53.671 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 48.618572428999997, 2020-11-16T20:56:53.671 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04706581, 2020-11-16T20:56:53.671 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:53.671 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:53.671 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:53.671 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:53.671 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:53.672 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2370 2020-11-16T20:56:53.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.672 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:53.672 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.672 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:53.672 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:56:53.672 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:53.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.673 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.673 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:53.673 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:56:53.673 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011081520000000001 2020-11-16T20:56:53.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.673 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.673 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:53.674 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055391+0000", 2020-11-16T20:56:53.674 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8289999999999996e-06 2020-11-16T20:56:53.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.674 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:53.674 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055397+0000", 2020-11-16T20:56:53.674 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7599999999999997e-06 2020-11-16T20:56:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055407+0000", 2020-11-16T20:56:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4180000000000002e-06 2020-11-16T20:56:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055413+0000", 2020-11-16T20:56:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1767000000000001e-05 2020-11-16T20:56:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055465+0000", 2020-11-16T20:56:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1916999999999998e-05 2020-11-16T20:56:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055517+0000", 2020-11-16T20:56:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027302192999999999 2020-11-16T20:56:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.082819+0000", 2020-11-16T20:56:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013272199999999999 2020-11-16T20:56:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.082952+0000", 2020-11-16T20:56:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000218574 2020-11-16T20:56:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083171+0000", 2020-11-16T20:56:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016037374 2020-11-16T20:56:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099208+0000", 2020-11-16T20:56:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001621248 2020-11-16T20:56:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100829+0000", 2020-11-16T20:56:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039884700000000003 2020-11-16T20:56:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101228+0000", 2020-11-16T20:56:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1977000000000006e-05 2020-11-16T20:56:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.682 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:53.682 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101300+0000", 2020-11-16T20:56:53.682 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9032000000000001e-05 2020-11-16T20:56:53.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.682 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.682 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:53.682 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101349+0000", 2020-11-16T20:56:53.683 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04706581 2020-11-16T20:56:53.683 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.683 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:53.683 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.683 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2371 4.1 4:82bb0fe7:::smithi16641208-101:head [setxattr _header (57) in=7b,truncate 2773254] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:53.684 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.055441+0000", 2020-11-16T20:56:53.684 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 48.617414512000003, 2020-11-16T20:56:53.684 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046178253000000002, 2020-11-16T20:56:53.684 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:53.684 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:53.684 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:53.684 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:53.684 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:53.685 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2371 2020-11-16T20:56:53.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.685 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:53.685 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.685 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:53.685 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055441+0000", 2020-11-16T20:56:53.685 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:53.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.686 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.686 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:53.686 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055441+0000", 2020-11-16T20:56:53.686 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4688999999999999e-05 2020-11-16T20:56:53.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.686 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.687 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:53.687 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055476+0000", 2020-11-16T20:56:53.687 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8220000000000003e-06 2020-11-16T20:56:53.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.687 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.687 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:53.687 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055482+0000", 2020-11-16T20:56:53.687 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0340000000000002e-06 2020-11-16T20:56:53.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.688 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.688 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:53.688 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055488+0000", 2020-11-16T20:56:53.688 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.49e-06 2020-11-16T20:56:53.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.688 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.689 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.689 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055491+0000", 2020-11-16T20:56:53.689 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6255999999999998e-05 2020-11-16T20:56:53.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.689 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.689 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.689 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055547+0000", 2020-11-16T20:56:53.689 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6068000000000005e-05 2020-11-16T20:56:53.690 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.690 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.690 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.690 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055614+0000", 2020-11-16T20:56:53.690 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.028667674000000001 2020-11-16T20:56:53.690 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.690 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.691 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.691 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084281+0000", 2020-11-16T20:56:53.691 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000104868 2020-11-16T20:56:53.691 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.691 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.691 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:53.691 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084386+0000", 2020-11-16T20:56:53.691 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015165799999999999 2020-11-16T20:56:53.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.692 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:53.692 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084538+0000", 2020-11-16T20:56:53.692 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014678207 2020-11-16T20:56:53.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.693 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:53.693 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099216+0000", 2020-11-16T20:56:53.693 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0016622550000000001 2020-11-16T20:56:53.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.693 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.693 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100878+0000", 2020-11-16T20:56:53.693 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00061087000000000001 2020-11-16T20:56:53.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.694 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.694 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.694 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101489+0000", 2020-11-16T20:56:53.694 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0320000000000004e-05 2020-11-16T20:56:53.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.694 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.695 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:53.695 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101559+0000", 2020-11-16T20:56:53.695 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0041999999999999e-05 2020-11-16T20:56:53.695 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.695 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.695 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:53.695 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101619+0000", 2020-11-16T20:56:53.696 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046178253000000002 2020-11-16T20:56:53.696 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.696 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:53.696 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.696 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2372 4.1 4:82bb0fe7:::smithi16641208-101:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e42)", 2020-11-16T20:56:53.696 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:56:53.697 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 48.617343482999999, 2020-11-16T20:56:53.697 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046557016999999999, 2020-11-16T20:56:53.697 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:53.697 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:53.697 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:53.697 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:53.697 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:53.698 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2372 2020-11-16T20:56:53.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.698 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:53.698 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.698 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:53.698 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:56:53.698 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:53.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.699 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.699 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:53.699 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:56:53.699 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9907000000000001e-05 2020-11-16T20:56:53.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.699 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.699 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:53.700 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055532+0000", 2020-11-16T20:56:53.700 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0599999999999999e-06 2020-11-16T20:56:53.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.700 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.700 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:53.700 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055535+0000", 2020-11-16T20:56:53.700 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1430000000000003e-06 2020-11-16T20:56:53.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.701 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.701 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:53.701 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055541+0000", 2020-11-16T20:56:53.701 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6819999999999999e-06 2020-11-16T20:56:53.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.701 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.701 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.702 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055544+0000", 2020-11-16T20:56:53.702 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000102643 2020-11-16T20:56:53.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.702 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.702 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055647+0000", 2020-11-16T20:56:53.702 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7197000000000003e-05 2020-11-16T20:56:53.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.703 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.703 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.703 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055684+0000", 2020-11-16T20:56:53.703 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029347807 2020-11-16T20:56:53.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.703 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.704 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.704 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.085032+0000", 2020-11-16T20:56:53.704 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6130000000000005e-05 2020-11-16T20:56:53.704 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.704 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.704 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:53.704 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.085108+0000", 2020-11-16T20:56:53.704 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016542980999999998 2020-11-16T20:56:53.705 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.705 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.705 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.705 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101651+0000", 2020-11-16T20:56:53.705 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000118733 2020-11-16T20:56:53.705 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.705 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.706 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:53.706 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101769+0000", 2020-11-16T20:56:53.706 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029973400000000001 2020-11-16T20:56:53.706 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.706 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.706 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:53.706 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.102069+0000", 2020-11-16T20:56:53.706 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046557016999999999 2020-11-16T20:56:53.707 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.707 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:53.707 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.707 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.707 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.707 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2423 3.3 3:c5716d1e:::smithi16641208-111:head [copy-from ver 265] snapc 7=[7,5] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e46)", 2020-11-16T20:56:53.707 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:09.027460+0000", 2020-11-16T20:56:53.708 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 44.645395331000003, 2020-11-16T20:56:53.708 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.038337614999999998, 2020-11-16T20:56:53.708 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:53.708 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:53.708 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:53.708 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.708 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:53.708 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027460+0000", 2020-11-16T20:56:53.709 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:53.709 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.709 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.709 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:53.709 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027460+0000", 2020-11-16T20:56:53.709 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4963999999999998e-05 2020-11-16T20:56:53.709 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.710 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.710 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:53.710 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027505+0000", 2020-11-16T20:56:53.710 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.925e-05 2020-11-16T20:56:53.710 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.710 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.710 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:53.710 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027525+0000", 2020-11-16T20:56:53.711 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3959e-05 2020-11-16T20:56:53.711 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.711 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.711 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:53.711 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027539+0000", 2020-11-16T20:56:53.711 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8059999999999997e-06 2020-11-16T20:56:53.711 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.712 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.712 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.712 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027545+0000", 2020-11-16T20:56:53.712 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0037794289999999999 2020-11-16T20:56:53.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.712 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.712 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.713 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031325+0000", 2020-11-16T20:56:53.713 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000127613 2020-11-16T20:56:53.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.713 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.713 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:53.713 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031452+0000", 2020-11-16T20:56:53.713 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021049117999999999 2020-11-16T20:56:53.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.714 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.714 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:56:53.714 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.052502+0000", 2020-11-16T20:56:53.714 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012965061 2020-11-16T20:56:53.714 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.714 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.714 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.715 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065467+0000", 2020-11-16T20:56:53.715 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9788000000000003e-05 2020-11-16T20:56:53.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.715 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.715 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.715 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065536+0000", 2020-11-16T20:56:53.715 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013262699999999999 2020-11-16T20:56:53.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.716 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.716 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:53.716 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065669+0000", 2020-11-16T20:56:53.716 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4404999999999999e-05 2020-11-16T20:56:53.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.716 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.716 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:53.717 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065713+0000", 2020-11-16T20:56:53.717 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4594999999999999e-05 2020-11-16T20:56:53.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.717 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.717 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:53.717 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065798+0000", 2020-11-16T20:56:53.717 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.038337614999999998 2020-11-16T20:56:53.717 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.718 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:53.718 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.718 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.718 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:577 3.3 3:c5716d1e:::smithi16641208-111:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e46)", 2020-11-16T20:56:53.718 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:09.027581+0000", 2020-11-16T20:56:53.718 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 44.645274888000003, 2020-11-16T20:56:53.719 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.038487691999999997, 2020-11-16T20:56:53.719 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:53.719 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:53.719 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:53.719 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.719 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:53.719 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027581+0000", 2020-11-16T20:56:53.720 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:53.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.720 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:53.720 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027581+0000", 2020-11-16T20:56:53.720 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3422e-05 2020-11-16T20:56:53.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.721 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:53.721 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027614+0000", 2020-11-16T20:56:53.721 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1710000000000002e-06 2020-11-16T20:56:53.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.721 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.721 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:53.721 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027622+0000", 2020-11-16T20:56:53.722 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2265e-05 2020-11-16T20:56:53.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.722 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.722 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:53.722 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027635+0000", 2020-11-16T20:56:53.722 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4700000000000001e-06 2020-11-16T20:56:53.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.723 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.723 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.723 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027640+0000", 2020-11-16T20:56:53.723 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0040006759999999999 2020-11-16T20:56:53.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.723 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.723 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.723 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031641+0000", 2020-11-16T20:56:53.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4350000000000006e-05 2020-11-16T20:56:53.724 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.724 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.724 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.724 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031705+0000", 2020-11-16T20:56:53.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029225991999999999 2020-11-16T20:56:53.724 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.725 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.725 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.725 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.060931+0000", 2020-11-16T20:56:53.725 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013316099999999999 2020-11-16T20:56:53.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.725 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.725 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:53.725 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.061064+0000", 2020-11-16T20:56:53.726 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047860919999999996 2020-11-16T20:56:53.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.726 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.726 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065850+0000", 2020-11-16T20:56:53.726 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1691e-05 2020-11-16T20:56:53.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.727 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:53.727 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065942+0000", 2020-11-16T20:56:53.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012640199999999999 2020-11-16T20:56:53.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.727 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:53.728 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.066068+0000", 2020-11-16T20:56:53.728 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.038487691999999997 2020-11-16T20:56:53.728 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.728 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:53.728 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.728 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.728 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:578 3.3 3:c5716d1e:::smithi16641208-111:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e46)", 2020-11-16T20:56:53.729 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:09.027672+0000", 2020-11-16T20:56:53.729 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 44.645183774000003, 2020-11-16T20:56:53.729 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.043041498999999997, 2020-11-16T20:56:53.729 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:53.729 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:53.729 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:53.729 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.730 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:53.730 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027672+0000", 2020-11-16T20:56:53.730 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:53.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.730 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.730 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:53.730 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027672+0000", 2020-11-16T20:56:53.730 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2234000000000003e-05 2020-11-16T20:56:53.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.731 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:53.731 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027714+0000", 2020-11-16T20:56:53.731 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5910000000000001e-06 2020-11-16T20:56:53.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:53.732 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027721+0000", 2020-11-16T20:56:53.732 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1319e-05 2020-11-16T20:56:53.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.732 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:53.732 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027732+0000", 2020-11-16T20:56:53.733 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7919999999999998e-06 2020-11-16T20:56:53.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.733 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.733 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.733 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027738+0000", 2020-11-16T20:56:53.733 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0040456559999999999 2020-11-16T20:56:53.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.733 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.734 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.734 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031784+0000", 2020-11-16T20:56:53.734 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9271999999999999e-05 2020-11-16T20:56:53.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.734 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.734 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.734 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031833+0000", 2020-11-16T20:56:53.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029282580999999999 2020-11-16T20:56:53.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.735 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.735 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.735 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.061115+0000", 2020-11-16T20:56:53.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6058999999999998e-05 2020-11-16T20:56:53.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.735 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.736 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:53.736 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.061191+0000", 2020-11-16T20:56:53.736 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049009099999999996 2020-11-16T20:56:53.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.736 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.736 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.736 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.066092+0000", 2020-11-16T20:56:53.737 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7039999999999995e-05 2020-11-16T20:56:53.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.737 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.737 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:53.737 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.066159+0000", 2020-11-16T20:56:53.737 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045540449999999996 2020-11-16T20:56:53.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.737 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.738 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:53.738 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.070713+0000", 2020-11-16T20:56:53.738 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.043041498999999997 2020-11-16T20:56:53.738 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.738 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:53.738 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.738 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.739 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2427 4.1 4:a1b421f3:::smithi16641208-471:head [cache-flush] snapc 0=[] ondisk+read+ignore_cache+known_if_redirected e47)", 2020-11-16T20:56:53.739 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:10.015762+0000", 2020-11-16T20:56:53.739 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.657093334999999, 2020-11-16T20:56:53.739 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036562619999999997, 2020-11-16T20:56:53.739 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:53.739 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:53.739 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:53.740 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:53.740 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:53.740 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2427 2020-11-16T20:56:53.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.740 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:53.740 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.740 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:53.741 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015762+0000", 2020-11-16T20:56:53.741 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:53.741 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.741 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.741 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:53.741 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015762+0000", 2020-11-16T20:56:53.741 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8266999999999999e-05 2020-11-16T20:56:53.741 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.742 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.742 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:53.742 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015791+0000", 2020-11-16T20:56:53.742 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3263e-05 2020-11-16T20:56:53.742 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.742 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.742 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:53.743 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015804+0000", 2020-11-16T20:56:53.743 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1194e-05 2020-11-16T20:56:53.743 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.743 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.743 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:53.743 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015815+0000", 2020-11-16T20:56:53.743 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9799999999999998e-06 2020-11-16T20:56:53.744 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.744 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.744 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.744 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015823+0000", 2020-11-16T20:56:53.744 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0092000000000006e-05 2020-11-16T20:56:53.744 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.744 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.744 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.745 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015893+0000", 2020-11-16T20:56:53.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4109999999999996e-06 2020-11-16T20:56:53.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.745 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.745 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2020-11-16T20:56:53.745 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015902+0000", 2020-11-16T20:56:53.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0024786610000000001 2020-11-16T20:56:53.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.746 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.746 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.018380+0000", 2020-11-16T20:56:53.746 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016238599999999999 2020-11-16T20:56:53.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.746 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:53.747 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.018543+0000", 2020-11-16T20:56:53.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.033540168000000002 2020-11-16T20:56:53.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.747 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.747 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.747 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.052083+0000", 2020-11-16T20:56:53.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014603000000000001 2020-11-16T20:56:53.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:53.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.052229+0000", 2020-11-16T20:56:53.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6168000000000005e-05 2020-11-16T20:56:53.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:53.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.052325+0000", 2020-11-16T20:56:53.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036562619999999997 2020-11-16T20:56:53.749 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.749 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:53.749 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.750 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2503 4.1 4:b0538c7c:::smithi16641208-136:head [write 1790337~563515] snapc f=[f,e,d,5] ondisk+write+known_if_redirected e52)", 2020-11-16T20:56:53.750 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:56:53.750 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 38.926147980000003, 2020-11-16T20:56:53.750 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089724989000000005, 2020-11-16T20:56:53.750 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:53.750 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:53.750 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:53.751 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:53.751 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:53.751 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2503 2020-11-16T20:56:53.751 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.751 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:53.751 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.751 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:53.752 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:56:53.752 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:53.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.752 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.752 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:53.752 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:56:53.752 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00060419599999999999 2020-11-16T20:56:53.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:53.753 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747312+0000", 2020-11-16T20:56:53.753 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.319e-06 2020-11-16T20:56:53.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:53.754 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747318+0000", 2020-11-16T20:56:53.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5100000000000004e-06 2020-11-16T20:56:53.754 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.754 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.754 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:53.754 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747328+0000", 2020-11-16T20:56:53.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6369999999999999e-06 2020-11-16T20:56:53.754 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.755 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.755 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747335+0000", 2020-11-16T20:56:53.755 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001800479 2020-11-16T20:56:53.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.755 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.756 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749136+0000", 2020-11-16T20:56:53.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7970000000000002e-05 2020-11-16T20:56:53.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.756 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.756 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.756 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749194+0000", 2020-11-16T20:56:53.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030847998000000001 2020-11-16T20:56:53.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780042+0000", 2020-11-16T20:56:53.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013142199999999999 2020-11-16T20:56:53.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:53.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780173+0000", 2020-11-16T20:56:53.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022398200000000001 2020-11-16T20:56:53.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:56:53.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780397+0000", 2020-11-16T20:56:53.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061389269999999998 2020-11-16T20:56:53.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.759 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786536+0000", 2020-11-16T20:56:53.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3673999999999998e-05 2020-11-16T20:56:53.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:53.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786630+0000", 2020-11-16T20:56:53.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049513384000000001 2020-11-16T20:56:53.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836143+0000", 2020-11-16T20:56:53.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4713000000000001e-05 2020-11-16T20:56:53.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.761 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:53.761 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836218+0000", 2020-11-16T20:56:53.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000214778 2020-11-16T20:56:53.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.761 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:53.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836433+0000", 2020-11-16T20:56:53.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089724989000000005 2020-11-16T20:56:53.762 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.762 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:53.762 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.762 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2504 4.1 4:b0538c7c:::smithi16641208-136:head [setxattr _header (58) in=7b,truncate 2991745] snapc f=[f,e,d,5] ondisk+write+known_if_redirected e52)", 2020-11-16T20:56:53.763 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:56:53.763 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 38.925473609999997, 2020-11-16T20:56:53.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089341162000000002, 2020-11-16T20:56:53.763 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:53.763 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:53.763 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:53.763 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:53.764 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:53.764 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2504 2020-11-16T20:56:53.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.764 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:53.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:53.764 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:56:53.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:53.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.765 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:53.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:56:53.765 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5520999999999999e-05 2020-11-16T20:56:53.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:53.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747438+0000", 2020-11-16T20:56:53.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2020-11-16T20:56:53.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:53.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747444+0000", 2020-11-16T20:56:53.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.661e-06 2020-11-16T20:56:53.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.767 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:53.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747451+0000", 2020-11-16T20:56:53.767 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6920000000000001e-06 2020-11-16T20:56:53.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.768 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.768 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747456+0000", 2020-11-16T20:56:53.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0017949769999999999 2020-11-16T20:56:53.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.768 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.768 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749251+0000", 2020-11-16T20:56:53.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114708 2020-11-16T20:56:53.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749366+0000", 2020-11-16T20:56:53.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032215049000000003 2020-11-16T20:56:53.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.770 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.770 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.781581+0000", 2020-11-16T20:56:53.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000181452 2020-11-16T20:56:53.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.770 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:53.770 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.781762+0000", 2020-11-16T20:56:53.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024118300000000001 2020-11-16T20:56:53.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.771 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:56:53.771 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782003+0000", 2020-11-16T20:56:53.771 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045997939999999999 2020-11-16T20:56:53.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.772 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.772 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786603+0000", 2020-11-16T20:56:53.772 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8782000000000002e-05 2020-11-16T20:56:53.772 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.772 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.772 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:53.772 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786642+0000", 2020-11-16T20:56:53.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049869098000000001 2020-11-16T20:56:53.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.773 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.773 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836511+0000", 2020-11-16T20:56:53.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4498000000000005e-05 2020-11-16T20:56:53.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:53.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836576+0000", 2020-11-16T20:56:53.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000147615 2020-11-16T20:56:53.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:53.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836723+0000", 2020-11-16T20:56:53.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089341162000000002 2020-11-16T20:56:53.775 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.775 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:53.775 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.775 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2505 4.1 4:b0538c7c:::smithi16641208-136:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e52)", 2020-11-16T20:56:53.776 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:56:53.776 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 38.925364481999999, 2020-11-16T20:56:53.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089929617000000003, 2020-11-16T20:56:53.776 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:53.776 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:53.776 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:53.776 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:53.776 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:53.777 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2505 2020-11-16T20:56:53.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.777 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:53.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:53.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:56:53.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:53.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:53.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:56:53.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1894999999999999e-05 2020-11-16T20:56:53.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:53.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747523+0000", 2020-11-16T20:56:53.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3900000000000003e-06 2020-11-16T20:56:53.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:53.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747527+0000", 2020-11-16T20:56:53.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8169999999999999e-06 2020-11-16T20:56:53.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:53.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747535+0000", 2020-11-16T20:56:53.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6449999999999998e-06 2020-11-16T20:56:53.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747539+0000", 2020-11-16T20:56:53.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0018868209999999999 2020-11-16T20:56:53.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749426+0000", 2020-11-16T20:56:53.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4963000000000002e-05 2020-11-16T20:56:53.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.782 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.782 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749481+0000", 2020-11-16T20:56:53.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032915959000000002 2020-11-16T20:56:53.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.782 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.783 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782397+0000", 2020-11-16T20:56:53.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018449499999999999 2020-11-16T20:56:53.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.783 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.783 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:53.783 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782581+0000", 2020-11-16T20:56:53.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054195457000000002 2020-11-16T20:56:53.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836777+0000", 2020-11-16T20:56:53.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000214584 2020-11-16T20:56:53.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:53.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836991+0000", 2020-11-16T20:56:53.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000429591 2020-11-16T20:56:53.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:53.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.837421+0000", 2020-11-16T20:56:53.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089929617000000003 2020-11-16T20:56:53.786 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.786 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:53.786 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.786 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2593 3.3 3:f5f8fa2a:::smithi16641208-144:head [copy-from ver 64] snapc 14=[12,f,5] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e57)", 2020-11-16T20:56:53.786 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:56:53.786 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 33.886215620999998, 2020-11-16T20:56:53.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064638111999999998, 2020-11-16T20:56:53.787 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:53.787 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:53.787 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:53.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.787 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:53.787 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:56:53.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:53.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:53.788 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:56:53.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3655999999999998e-05 2020-11-16T20:56:53.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:53.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786664+0000", 2020-11-16T20:56:53.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1850000000000003e-06 2020-11-16T20:56:53.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:53.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786669+0000", 2020-11-16T20:56:53.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0861e-05 2020-11-16T20:56:53.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.790 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:53.790 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786680+0000", 2020-11-16T20:56:53.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6749999999999996e-06 2020-11-16T20:56:53.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.791 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.791 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786686+0000", 2020-11-16T20:56:53.791 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2327000000000003e-05 2020-11-16T20:56:53.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.791 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.791 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786729+0000", 2020-11-16T20:56:53.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000156143 2020-11-16T20:56:53.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:53.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786885+0000", 2020-11-16T20:56:53.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024103846000000002 2020-11-16T20:56:53.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:56:53.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810989+0000", 2020-11-16T20:56:53.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018870436000000001 2020-11-16T20:56:53.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829859+0000", 2020-11-16T20:56:53.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021210896 2020-11-16T20:56:53.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851070+0000", 2020-11-16T20:56:53.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3708e-05 2020-11-16T20:56:53.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.795 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:53.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851084+0000", 2020-11-16T20:56:53.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7329e-05 2020-11-16T20:56:53.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.795 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:53.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851131+0000", 2020-11-16T20:56:53.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014705 2020-11-16T20:56:53.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:53.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851278+0000", 2020-11-16T20:56:53.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064638111999999998 2020-11-16T20:56:53.796 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.796 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:53.797 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.797 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:616 3.3 3:f5f8fa2a:::smithi16641208-144:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e57)", 2020-11-16T20:56:53.797 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:56:53.797 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 33.886124967000001, 2020-11-16T20:56:53.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064784234999999996, 2020-11-16T20:56:53.798 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:53.798 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:53.798 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:53.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:53.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:56:53.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:53.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:53.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:56:53.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8559999999999998e-05 2020-11-16T20:56:53.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:53.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786749+0000", 2020-11-16T20:56:53.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4549999999999997e-06 2020-11-16T20:56:53.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.800 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:53.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786754+0000", 2020-11-16T20:56:53.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4980000000000006e-06 2020-11-16T20:56:53.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:53.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786762+0000", 2020-11-16T20:56:53.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9790000000000004e-06 2020-11-16T20:56:53.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786766+0000", 2020-11-16T20:56:53.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029976900000000002 2020-11-16T20:56:53.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787066+0000", 2020-11-16T20:56:53.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3581999999999998e-05 2020-11-16T20:56:53.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787100+0000", 2020-11-16T20:56:53.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.037252078000000001 2020-11-16T20:56:53.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824352+0000", 2020-11-16T20:56:53.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000124189 2020-11-16T20:56:53.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:53.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824476+0000", 2020-11-16T20:56:53.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026883987000000002 2020-11-16T20:56:53.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851360+0000", 2020-11-16T20:56:53.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6365999999999994e-05 2020-11-16T20:56:53.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:53.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851426+0000", 2020-11-16T20:56:53.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8771999999999996e-05 2020-11-16T20:56:53.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:53.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851515+0000", 2020-11-16T20:56:53.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064784234999999996 2020-11-16T20:56:53.807 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.807 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:53.807 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.807 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:617 3.3 3:f5f8fa2a:::smithi16641208-144:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e57)", 2020-11-16T20:56:53.807 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:56:53.807 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 33.886054651999999, 2020-11-16T20:56:53.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.069756316999999998, 2020-11-16T20:56:53.808 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:53.808 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:53.808 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:53.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:53.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:56:53.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:53.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:53.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:56:53.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3865000000000002e-05 2020-11-16T20:56:53.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:53.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786835+0000", 2020-11-16T20:56:53.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6949999999999999e-06 2020-11-16T20:56:53.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:53.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786840+0000", 2020-11-16T20:56:53.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3559999999999999e-06 2020-11-16T20:56:53.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:53.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786849+0000", 2020-11-16T20:56:53.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.045e-06 2020-11-16T20:56:53.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786854+0000", 2020-11-16T20:56:53.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026743999999999997 2020-11-16T20:56:53.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787121+0000", 2020-11-16T20:56:53.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8912000000000001e-05 2020-11-16T20:56:53.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787180+0000", 2020-11-16T20:56:53.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.042545010000000001 2020-11-16T20:56:53.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829725+0000", 2020-11-16T20:56:53.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3979000000000003e-05 2020-11-16T20:56:53.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:53.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829819+0000", 2020-11-16T20:56:53.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021745652000000001 2020-11-16T20:56:53.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851565+0000", 2020-11-16T20:56:53.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000102064 2020-11-16T20:56:53.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:53.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851667+0000", 2020-11-16T20:56:53.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048902989999999999 2020-11-16T20:56:53.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:53.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856557+0000", 2020-11-16T20:56:53.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.069756316999999998 2020-11-16T20:56:53.817 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.817 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:53.817 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.817 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:618 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'243, mlcod=57'241)", 2020-11-16T20:56:53.818 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:56:53.818 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 33.873235528000002, 2020-11-16T20:56:53.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048895281999999998, 2020-11-16T20:56:53.818 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:53.818 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:53.818 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:53.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:53.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:56:53.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:53.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:53.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:56:53.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017163861999999998 2020-11-16T20:56:53.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:53.820 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816784+0000", 2020-11-16T20:56:53.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7071e-05 2020-11-16T20:56:53.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:53.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816801+0000", 2020-11-16T20:56:53.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6405e-05 2020-11-16T20:56:53.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:53.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816818+0000", 2020-11-16T20:56:53.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3030999999999999e-05 2020-11-16T20:56:53.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816831+0000", 2020-11-16T20:56:53.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4610000000000007e-05 2020-11-16T20:56:53.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816895+0000", 2020-11-16T20:56:53.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4202999999999998e-05 2020-11-16T20:56:53.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:53.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816929+0000", 2020-11-16T20:56:53.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.031527016999999997 2020-11-16T20:56:53.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:53.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.848456+0000", 2020-11-16T20:56:53.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9083000000000003e-05 2020-11-16T20:56:53.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:53.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.848515+0000", 2020-11-16T20:56:53.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048895281999999998 2020-11-16T20:56:53.825 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.825 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:53.825 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.826 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:618 3.3 3:d775beee:::smithi16641208-10:head [copy-from ver 12] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:56:53.826 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:56:53.826 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 33.864053458999997, 2020-11-16T20:56:53.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047870862, 2020-11-16T20:56:53.826 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:53.826 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:53.826 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:53.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:53.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:56:53.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:53.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:53.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:56:53.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0958999999999999e-05 2020-11-16T20:56:53.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:53.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808843+0000", 2020-11-16T20:56:53.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1294000000000001e-05 2020-11-16T20:56:53.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:53.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808854+0000", 2020-11-16T20:56:53.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8553999999999997e-05 2020-11-16T20:56:53.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:53.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808893+0000", 2020-11-16T20:56:53.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1985e-05 2020-11-16T20:56:53.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808905+0000", 2020-11-16T20:56:53.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7309000000000001e-05 2020-11-16T20:56:53.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808982+0000", 2020-11-16T20:56:53.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016374099999999999 2020-11-16T20:56:53.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:53.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809146+0000", 2020-11-16T20:56:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015955815000000002 2020-11-16T20:56:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:56:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.825102+0000", 2020-11-16T20:56:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048434799999999998 2020-11-16T20:56:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829945+0000", 2020-11-16T20:56:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021349677000000001 2020-11-16T20:56:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851295+0000", 2020-11-16T20:56:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052994100000000001 2020-11-16T20:56:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856594+0000", 2020-11-16T20:56:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3349000000000001e-05 2020-11-16T20:56:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856638+0000", 2020-11-16T20:56:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5289e-05 2020-11-16T20:56:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856673+0000", 2020-11-16T20:56:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047870862 2020-11-16T20:56:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:619 3.3 3:d79d68cf:::smithi16641208-37:head [copy-from ver 27] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:56:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:56:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 33.863494869, 2020-11-16T20:56:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047415915000000003, 2020-11-16T20:56:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:56:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:56:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3012000000000002e-05 2020-11-16T20:56:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:53.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809394+0000", 2020-11-16T20:56:53.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1699999999999996e-06 2020-11-16T20:56:53.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:53.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809399+0000", 2020-11-16T20:56:53.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2390000000000008e-06 2020-11-16T20:56:53.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:53.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809408+0000", 2020-11-16T20:56:53.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0259999999999998e-06 2020-11-16T20:56:53.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809413+0000", 2020-11-16T20:56:53.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0359999999999996e-05 2020-11-16T20:56:53.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809494+0000", 2020-11-16T20:56:53.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019616600000000001 2020-11-16T20:56:53.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:53.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809690+0000", 2020-11-16T20:56:53.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017673003999999999 2020-11-16T20:56:53.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:56:53.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.827363+0000", 2020-11-16T20:56:53.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006463033 2020-11-16T20:56:53.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.833826+0000", 2020-11-16T20:56:53.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017479913999999999 2020-11-16T20:56:53.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:53.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851306+0000", 2020-11-16T20:56:53.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054026500000000002 2020-11-16T20:56:53.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856708+0000", 2020-11-16T20:56:53.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8121999999999999e-05 2020-11-16T20:56:53.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:53.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856747+0000", 2020-11-16T20:56:53.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0219e-05 2020-11-16T20:56:53.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:53.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856777+0000", 2020-11-16T20:56:53.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047415915000000003 2020-11-16T20:56:53.846 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.847 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:53.847 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.847 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2990 4.1 4:b964d1b5:::smithi16641208-359:head [rollback 25] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:56:53.847 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:48.838164+0000", 2020-11-16T20:56:53.847 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.8346919719999999, 2020-11-16T20:56:53.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041467088999999999, 2020-11-16T20:56:53.848 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:53.848 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:53.848 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:53.848 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:53.848 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:53.848 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2990 2020-11-16T20:56:53.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.849 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:53.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:53.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838164+0000", 2020-11-16T20:56:53.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:53.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:53.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838164+0000", 2020-11-16T20:56:53.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5457000000000001e-05 2020-11-16T20:56:53.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:53.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838179+0000", 2020-11-16T20:56:53.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2140000000000001e-06 2020-11-16T20:56:53.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:53.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838182+0000", 2020-11-16T20:56:53.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4210000000000003e-06 2020-11-16T20:56:53.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:53.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838188+0000", 2020-11-16T20:56:53.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6560000000000001e-06 2020-11-16T20:56:53.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838190+0000", 2020-11-16T20:56:53.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000113182 2020-11-16T20:56:53.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838304+0000", 2020-11-16T20:56:53.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3859999999999996e-06 2020-11-16T20:56:53.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:53.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838313+0000", 2020-11-16T20:56:53.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0032817229999999998 2020-11-16T20:56:53.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.841595+0000", 2020-11-16T20:56:53.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5017e-05 2020-11-16T20:56:53.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.841630+0000", 2020-11-16T20:56:53.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019647588000000001 2020-11-16T20:56:53.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.861277+0000", 2020-11-16T20:56:53.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012631900000000001 2020-11-16T20:56:53.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:53.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.861404+0000", 2020-11-16T20:56:53.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023259800000000001 2020-11-16T20:56:53.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.861636+0000", 2020-11-16T20:56:53.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2471e-05 2020-11-16T20:56:53.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.861679+0000", 2020-11-16T20:56:53.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0077306099999999997 2020-11-16T20:56:53.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.869409+0000", 2020-11-16T20:56:53.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000107871 2020-11-16T20:56:53.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:53.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.869517+0000", 2020-11-16T20:56:53.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000186925 2020-11-16T20:56:53.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:56:53.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.869704+0000", 2020-11-16T20:56:53.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0078131980000000004 2020-11-16T20:56:53.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.877517+0000", 2020-11-16T20:56:53.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3420000000000002e-05 2020-11-16T20:56:53.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.877551+0000", 2020-11-16T20:56:53.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7361000000000005e-05 2020-11-16T20:56:53.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for ondisk", 2020-11-16T20:56:53.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.877648+0000", 2020-11-16T20:56:53.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0010716079999999999 2020-11-16T20:56:53.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.878720+0000", 2020-11-16T20:56:53.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00080916500000000004 2020-11-16T20:56:53.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:53.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879529+0000", 2020-11-16T20:56:53.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3050000000000002e-05 2020-11-16T20:56:53.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:53.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879582+0000", 2020-11-16T20:56:53.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8848999999999999e-05 2020-11-16T20:56:53.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:53.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879631+0000", 2020-11-16T20:56:53.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041467088999999999 2020-11-16T20:56:53.865 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.865 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:53.865 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.865 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2991 4.1 4:b964d1b5:::smithi16641208-359:head [append 0~0] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:56:53.866 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:48.838212+0000", 2020-11-16T20:56:53.866 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.8346435659999996, 2020-11-16T20:56:53.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041594183999999999, 2020-11-16T20:56:53.866 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:53.866 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:53.866 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:53.866 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:53.866 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:53.867 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2991 2020-11-16T20:56:53.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.867 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:53.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:53.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838212+0000", 2020-11-16T20:56:53.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:53.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:53.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838212+0000", 2020-11-16T20:56:53.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5463000000000001e-05 2020-11-16T20:56:53.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:53.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838228+0000", 2020-11-16T20:56:53.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.931e-06 2020-11-16T20:56:53.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:53.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838231+0000", 2020-11-16T20:56:53.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1950000000000002e-06 2020-11-16T20:56:53.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:53.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838236+0000", 2020-11-16T20:56:53.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.452e-06 2020-11-16T20:56:53.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838238+0000", 2020-11-16T20:56:53.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011414 2020-11-16T20:56:53.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838352+0000", 2020-11-16T20:56:53.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3620000000000006e-06 2020-11-16T20:56:53.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:53.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838361+0000", 2020-11-16T20:56:53.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00330554 2020-11-16T20:56:53.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.841666+0000", 2020-11-16T20:56:53.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3979999999999994e-05 2020-11-16T20:56:53.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.841730+0000", 2020-11-16T20:56:53.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020004936000000001 2020-11-16T20:56:53.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.861735+0000", 2020-11-16T20:56:53.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5636999999999998e-05 2020-11-16T20:56:53.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.861771+0000", 2020-11-16T20:56:53.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015910761999999998 2020-11-16T20:56:53.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.877682+0000", 2020-11-16T20:56:53.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023008600000000001 2020-11-16T20:56:53.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:53.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.877912+0000", 2020-11-16T20:56:53.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000228681 2020-11-16T20:56:53.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:56:53.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.878140+0000", 2020-11-16T20:56:53.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0013827620000000001 2020-11-16T20:56:53.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879523+0000", 2020-11-16T20:56:53.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000115841 2020-11-16T20:56:53.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:53.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879639+0000", 2020-11-16T20:56:53.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4579999999999997e-05 2020-11-16T20:56:53.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879683+0000", 2020-11-16T20:56:53.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1173000000000005e-05 2020-11-16T20:56:53.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:53.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879745+0000", 2020-11-16T20:56:53.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1662999999999996e-05 2020-11-16T20:56:53.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:53.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879806+0000", 2020-11-16T20:56:53.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041594183999999999 2020-11-16T20:56:53.880 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.880 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:53.881 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.881 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2994 4.1 4:81514658:::smithi16641208-76:head [rollback 25] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:56:53.881 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:48.838310+0000", 2020-11-16T20:56:53.881 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.8345456760000003, 2020-11-16T20:56:53.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.058717898999999997, 2020-11-16T20:56:53.882 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:53.882 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:53.882 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:53.882 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:53.882 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:53.882 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2994 2020-11-16T20:56:53.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.882 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:53.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:53.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838310+0000", 2020-11-16T20:56:53.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:53.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:53.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838310+0000", 2020-11-16T20:56:53.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6189e-05 2020-11-16T20:56:53.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.884 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:53.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838326+0000", 2020-11-16T20:56:53.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7750000000000001e-06 2020-11-16T20:56:53.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.885 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:53.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838329+0000", 2020-11-16T20:56:53.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1170000000000003e-06 2020-11-16T20:56:53.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.885 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:53.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838334+0000", 2020-11-16T20:56:53.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5509999999999998e-06 2020-11-16T20:56:53.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838337+0000", 2020-11-16T20:56:53.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4969999999999995e-05 2020-11-16T20:56:53.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838422+0000", 2020-11-16T20:56:53.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6809999999999998e-06 2020-11-16T20:56:53.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:53.888 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838429+0000", 2020-11-16T20:56:53.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0036974120000000002 2020-11-16T20:56:53.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.888 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.888 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.842127+0000", 2020-11-16T20:56:53.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7267000000000005e-05 2020-11-16T20:56:53.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.889 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.842194+0000", 2020-11-16T20:56:53.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036580992999999999 2020-11-16T20:56:53.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.890 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.878775+0000", 2020-11-16T20:56:53.890 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015282199999999999 2020-11-16T20:56:53.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.890 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:53.890 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.878928+0000", 2020-11-16T20:56:53.890 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025942000000000001 2020-11-16T20:56:53.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.891 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.891 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879187+0000", 2020-11-16T20:56:53.891 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6735000000000003e-05 2020-11-16T20:56:53.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.892 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.892 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879264+0000", 2020-11-16T20:56:53.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0079699739999999995 2020-11-16T20:56:53.892 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.892 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.892 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.892 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.887234+0000", 2020-11-16T20:56:53.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011584899999999999 2020-11-16T20:56:53.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:53.893 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.887350+0000", 2020-11-16T20:56:53.893 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019960799999999999 2020-11-16T20:56:53.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.893 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:56:53.894 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.887549+0000", 2020-11-16T20:56:53.894 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059496410000000003 2020-11-16T20:56:53.894 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.894 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.894 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.894 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893499+0000", 2020-11-16T20:56:53.894 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8387999999999997e-05 2020-11-16T20:56:53.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.895 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.895 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for ondisk", 2020-11-16T20:56:53.895 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893557+0000", 2020-11-16T20:56:53.895 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1730000000000005e-05 2020-11-16T20:56:53.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.895 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.896 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.896 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893639+0000", 2020-11-16T20:56:53.896 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0030284309999999998 2020-11-16T20:56:53.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.896 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:53.896 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.896668+0000", 2020-11-16T20:56:53.896 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024878999999999998 2020-11-16T20:56:53.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.897 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.897 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.897 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.896916+0000", 2020-11-16T20:56:53.897 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6546999999999998e-05 2020-11-16T20:56:53.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.897 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.897 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:53.898 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.896983+0000", 2020-11-16T20:56:53.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5009000000000002e-05 2020-11-16T20:56:53.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.898 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:53.898 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.897028+0000", 2020-11-16T20:56:53.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.058717898999999997 2020-11-16T20:56:53.899 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.899 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:53.899 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.899 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.899 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2995 4.1 4:81514658:::smithi16641208-76:head [append 0~0] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:56:53.899 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:48.838353+0000", 2020-11-16T20:56:53.900 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.8345024160000003, 2020-11-16T20:56:53.900 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.061235559000000002, 2020-11-16T20:56:53.900 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:53.900 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:53.900 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:53.900 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:53.900 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:53.900 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2995 2020-11-16T20:56:53.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.901 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:53.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:53.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838353+0000", 2020-11-16T20:56:53.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:53.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.902 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:53.902 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838353+0000", 2020-11-16T20:56:53.902 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5333e-05 2020-11-16T20:56:53.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.902 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:53.902 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838369+0000", 2020-11-16T20:56:53.903 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6699999999999998e-06 2020-11-16T20:56:53.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.903 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:53.903 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838371+0000", 2020-11-16T20:56:53.903 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9450000000000001e-06 2020-11-16T20:56:53.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:53.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838376+0000", 2020-11-16T20:56:53.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3810000000000002e-06 2020-11-16T20:56:53.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:53.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838379+0000", 2020-11-16T20:56:53.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6501000000000006e-05 2020-11-16T20:56:53.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.905 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.905 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838445+0000", 2020-11-16T20:56:53.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7589999999999999e-06 2020-11-16T20:56:53.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.906 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:53.906 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838449+0000", 2020-11-16T20:56:53.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003788249 2020-11-16T20:56:53.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.906 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.906 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.842237+0000", 2020-11-16T20:56:53.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4104999999999997e-05 2020-11-16T20:56:53.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.907 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.907 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.907 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.842301+0000", 2020-11-16T20:56:53.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.037139272000000001 2020-11-16T20:56:53.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.908 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.908 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879440+0000", 2020-11-16T20:56:53.908 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3401e-05 2020-11-16T20:56:53.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.908 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:53.908 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879484+0000", 2020-11-16T20:56:53.909 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014179615 2020-11-16T20:56:53.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.909 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:53.909 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893664+0000", 2020-11-16T20:56:53.909 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6710000000000002e-05 2020-11-16T20:56:53.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:53.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893750+0000", 2020-11-16T20:56:53.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015452900000000001 2020-11-16T20:56:53.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:56:53.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893905+0000", 2020-11-16T20:56:53.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0013753280000000001 2020-11-16T20:56:53.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.911 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.911 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.895280+0000", 2020-11-16T20:56:53.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014309889999999999 2020-11-16T20:56:53.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.912 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:53.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.896711+0000", 2020-11-16T20:56:53.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0027635649999999999 2020-11-16T20:56:53.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.912 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:53.912 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.899475+0000", 2020-11-16T20:56:53.913 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3380999999999997e-05 2020-11-16T20:56:53.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.913 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:53.913 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.899518+0000", 2020-11-16T20:56:53.913 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0826000000000003e-05 2020-11-16T20:56:53.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:53.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:53.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:53.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.899589+0000", 2020-11-16T20:56:53.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.061235559000000002 2020-11-16T20:56:53.914 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.914 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:53.914 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.914 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:53.915 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:53.915 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:53.917 INFO:tasks.rados.rados.0.smithi166.stdout:856: done (5 left) 2020-11-16T20:56:53.917 INFO:tasks.rados.rados.0.smithi166.stdout:857: read oid 398 snap -1 2020-11-16T20:56:53.917 INFO:tasks.rados.rados.0.smithi166.stdout:857: expect (ObjNum 397 snap 0 seq_num 397) 2020-11-16T20:56:53.917 INFO:tasks.rados.rados.0.smithi166.stdout:858: write oid 61 current snap is 27 2020-11-16T20:56:53.917 INFO:tasks.rados.rados.0.smithi166.stdout:858: seq_num 589 ranges {699323=480842,1850247=429872,2858378=532392} 2020-11-16T20:56:53.917 INFO:tasks.rados.rados.0.smithi166.stdout:858: writing smithi16641208-61 from 699323 to 1180165 tid 1 2020-11-16T20:56:53.918 INFO:tasks.rados.rados.0.smithi166.stdout:858: writing smithi16641208-61 from 1850247 to 2280119 tid 2 2020-11-16T20:56:53.918 INFO:tasks.rados.rados.0.smithi166.stdout:858: writing smithi16641208-61 from 2858378 to 3390770 tid 3 2020-11-16T20:56:53.918 INFO:tasks.rados.rados.0.smithi166.stdout:859: write (excl) oid 201 current snap is 27 2020-11-16T20:56:53.918 INFO:tasks.rados.rados.0.smithi166.stdout:859: seq_num 590 ranges {716130=556091,1792376=573530,2769448=460017,3821956=94174} 2020-11-16T20:56:53.918 INFO:tasks.rados.rados.0.smithi166.stdout:859: writing smithi16641208-201 from 716130 to 1272221 tid 1 2020-11-16T20:56:53.918 INFO:tasks.rados.rados.0.smithi166.stdout:859: writing smithi16641208-201 from 1792376 to 2365906 tid 2 2020-11-16T20:56:53.918 INFO:tasks.rados.rados.0.smithi166.stdout:859: writing smithi16641208-201 from 2769448 to 3229465 tid 3 2020-11-16T20:56:53.918 INFO:tasks.rados.rados.0.smithi166.stdout:859: writing smithi16641208-201 from 3821956 to 3916130 tid 4 2020-11-16T20:56:53.919 INFO:tasks.rados.rados.0.smithi166.stdout:860: cache_flush oid 250 snap -1 2020-11-16T20:56:53.919 INFO:tasks.rados.rados.0.smithi166.stdout:857: expect (ObjNum 397 snap 0 seq_num 397) 2020-11-16T20:56:53.919 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:53.844+0000 7ff3c9a43700 -1 osd.0 pg_epoch: 91 pg[3.1( v 91'707 (0'0,91'707] local-lis/les=19/20 n=137 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [0,4,3] r=0 lpr=19 crt=91'707 lcod 91'705 mlcod 91'705 active+clean+snaptrim trimq=[25~1] ps=[f~1,21~1,26~2,2b~1,2d~1,30~1,33~1,35~1]] removing snap head 2020-11-16T20:56:53.919 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:53.845+0000 7f868ad23700 -1 osd.1 pg_epoch: 91 pg[3.0( v 91'576 (0'0,91'576] local-lis/les=66/67 n=116 ec=19/19 lis/c=66/66 les/c/f=67/67/0 sis=66) [1,2,0] r=0 lpr=66 crt=91'576 lcod 91'574 mlcod 91'574 active+clean+snaptrim trimq=[25~1] ps=[f~1,21~1,26~2,2b~1,2d~1,30~1,33~1,35~1]] removing snap head 2020-11-16T20:56:53.919 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:53.921+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:53.920 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:53.852+0000 7f183b791700 -1 osd.4 pg_epoch: 91 pg[3.3( v 91'676 (0'0,91'676] local-lis/les=19/20 n=126 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [4,0,6] r=0 lpr=19 luod=91'674 crt=91'676 lcod 91'672 mlcod 91'672 active+clean+snaptrim trimq=[25~1] ps=[f~1,21~1,26~2,2b~1,2d~1,30~1,33~1,35~1]] removing snap head 2020-11-16T20:56:53.920 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:56:53.961 INFO:tasks.rados.rados.0.smithi166.stdout:859: finishing write tid 1 to smithi16641208-201 2020-11-16T20:56:53.961 INFO:tasks.rados.rados.0.smithi166.stdout:860: got (2) No such file or directory 2020-11-16T20:56:53.961 INFO:tasks.rados.rados.0.smithi166.stdout:859: finishing write tid 2 to smithi16641208-201 2020-11-16T20:56:53.961 INFO:tasks.rados.rados.0.smithi166.stdout:859: finishing write tid 3 to smithi16641208-201 2020-11-16T20:56:53.962 INFO:tasks.rados.rados.0.smithi166.stdout:859: finishing write tid 4 to smithi16641208-201 2020-11-16T20:56:53.962 INFO:tasks.rados.rados.0.smithi166.stdout:857: done (8 left) 2020-11-16T20:56:53.962 INFO:tasks.rados.rados.0.smithi166.stdout:860: done (7 left) 2020-11-16T20:56:53.962 INFO:tasks.rados.rados.0.smithi166.stdout:861: read oid 73 snap -1 2020-11-16T20:56:53.962 INFO:tasks.rados.rados.0.smithi166.stdout:861: expect (ObjNum 72 snap 0 seq_num 72) 2020-11-16T20:56:53.962 INFO:tasks.rados.rados.0.smithi166.stdout:862: read oid 150 snap -1 2020-11-16T20:56:53.962 INFO:tasks.rados.rados.0.smithi166.stdout:862: expect (ObjNum 149 snap 0 seq_num 149) 2020-11-16T20:56:53.963 INFO:tasks.rados.rados.0.smithi166.stdout:863: write oid 232 current snap is 27 2020-11-16T20:56:53.963 INFO:tasks.rados.rados.0.smithi166.stdout:859: finishing write tid 5 to smithi16641208-201 2020-11-16T20:56:53.963 INFO:tasks.rados.rados.0.smithi166.stdout:863: seq_num 591 ranges {732937=631340,1850858=433541,2796871=671289,3888195=44742} 2020-11-16T20:56:53.968 INFO:tasks.rados.rados.0.smithi166.stdout:863: writing smithi16641208-232 from 732937 to 1364277 tid 1 2020-11-16T20:56:53.973 INFO:tasks.rados.rados.0.smithi166.stdout:863: writing smithi16641208-232 from 1850858 to 2284399 tid 2 2020-11-16T20:56:53.980 INFO:tasks.rados.rados.0.smithi166.stdout:863: writing smithi16641208-232 from 2796871 to 3468160 tid 3 2020-11-16T20:56:53.983 INFO:tasks.rados.rados.0.smithi166.stdout:863: writing smithi16641208-232 from 3888195 to 3932937 tid 4 2020-11-16T20:56:53.983 INFO:tasks.rados.rados.0.smithi166.stdout:864: cache_flush oid 314 snap -1 2020-11-16T20:56:53.984 INFO:tasks.rados.rados.0.smithi166.stdout:859: finishing write tid 6 to smithi16641208-201 2020-11-16T20:56:53.984 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 201 v 718 (ObjNum 590 snap 27 seq_num 590) dirty exists 2020-11-16T20:56:53.984 INFO:tasks.rados.rados.0.smithi166.stdout:859: left oid 201 (ObjNum 590 snap 27 seq_num 590) 2020-11-16T20:56:53.984 INFO:tasks.rados.rados.0.smithi166.stdout:859: done (10 left) 2020-11-16T20:56:53.984 INFO:tasks.rados.rados.0.smithi166.stdout:865: cache_try_flush oid 156 snap -1 2020-11-16T20:56:53.984 INFO:tasks.rados.rados.0.smithi166.stdout:863: finishing write tid 1 to smithi16641208-232 2020-11-16T20:56:53.984 INFO:tasks.rados.rados.0.smithi166.stdout:866: snap_create 2020-11-16T20:56:53.985 INFO:tasks.rados.rados.0.smithi166.stdout:865: got (2) No such file or directory 2020-11-16T20:56:53.997 INFO:tasks.rados.rados.0.smithi166.stdout:863: finishing write tid 2 to smithi16641208-232 2020-11-16T20:56:53.997 INFO:tasks.rados.rados.0.smithi166.stdout:863: finishing write tid 3 to smithi16641208-232 2020-11-16T20:56:53.998 INFO:tasks.rados.rados.0.smithi166.stdout:863: finishing write tid 4 to smithi16641208-232 2020-11-16T20:56:53.998 INFO:tasks.rados.rados.0.smithi166.stdout:864: got (0) Success 2020-11-16T20:56:53.999 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 314 v 0 (ObjNum 313 snap 0 seq_num 313) dirty exists 2020-11-16T20:56:53.999 INFO:tasks.rados.rados.0.smithi166.stdout:863: finishing write tid 5 to smithi16641208-232 2020-11-16T20:56:53.999 INFO:tasks.rados.rados.0.smithi166.stdout:863: finishing write tid 6 to smithi16641208-232 2020-11-16T20:56:53.999 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 232 v 722 (ObjNum 591 snap 27 seq_num 591) dirty exists 2020-11-16T20:56:54.000 INFO:tasks.rados.rados.0.smithi166.stdout:863: left oid 232 (ObjNum 591 snap 27 seq_num 591) 2020-11-16T20:56:54.017 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:54.022+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:54.098 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:54.098 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:54.099 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:56:54.099 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:54.108 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:56:54.118 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:54.123+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:54.177 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:56:54.177 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:56:54.178 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2020-11-16T20:56:54.218 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:54.223+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:54.242 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:54.242 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:54.242 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:56:54.242 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:56:54.242 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:54.251 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:56:54.334 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:54.339+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:54.420 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:54.425+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:54.429 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:54.429 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:56:54.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:56:54.430 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:56:54.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.430 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:37 4.1 e33/22 4:b6545a47:::smithi16641208-46:head v 33'28, mlcod=33'26)", 2020-11-16T20:56:54.430 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.515282+0000", 2020-11-16T20:56:54.430 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.918021682999999, 2020-11-16T20:56:54.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016792344000000001, 2020-11-16T20:56:54.431 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:54.431 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:54.431 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:54.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:54.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.515282+0000", 2020-11-16T20:56:54.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:54.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:54.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.515282+0000", 2020-11-16T20:56:54.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0010571840000000001 2020-11-16T20:56:54.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.433 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:54.433 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516339+0000", 2020-11-16T20:56:54.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3354e-05 2020-11-16T20:56:54.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.433 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:54.433 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516352+0000", 2020-11-16T20:56:54.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7071999999999998e-05 2020-11-16T20:56:54.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:54.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516369+0000", 2020-11-16T20:56:54.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1358e-05 2020-11-16T20:56:54.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:54.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516381+0000", 2020-11-16T20:56:54.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5952999999999998e-05 2020-11-16T20:56:54.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:54.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516437+0000", 2020-11-16T20:56:54.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5420999999999998e-05 2020-11-16T20:56:54.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.436 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:54.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516472+0000", 2020-11-16T20:56:54.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015544192 2020-11-16T20:56:54.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:54.437 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532016+0000", 2020-11-16T20:56:54.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7809999999999997e-05 2020-11-16T20:56:54.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:54.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532074+0000", 2020-11-16T20:56:54.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016792344000000001 2020-11-16T20:56:54.438 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.438 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:54.438 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.438 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:39 4.1 e33/22 4:81558809:::smithi16641208-47:head v 33'30, mlcod=33'26)", 2020-11-16T20:56:54.439 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.519956+0000", 2020-11-16T20:56:54.439 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.913347536000003, 2020-11-16T20:56:54.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017898104000000001, 2020-11-16T20:56:54.439 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:54.439 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:54.439 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:54.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:54.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519956+0000", 2020-11-16T20:56:54.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:54.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:54.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519956+0000", 2020-11-16T20:56:54.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00038710900000000001 2020-11-16T20:56:54.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:54.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520343+0000", 2020-11-16T20:56:54.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0797e-05 2020-11-16T20:56:54.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:54.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520354+0000", 2020-11-16T20:56:54.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5874000000000001e-05 2020-11-16T20:56:54.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:54.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520370+0000", 2020-11-16T20:56:54.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3580000000000003e-06 2020-11-16T20:56:54.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:54.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520378+0000", 2020-11-16T20:56:54.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5744000000000001e-05 2020-11-16T20:56:54.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:54.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520424+0000", 2020-11-16T20:56:54.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4641e-05 2020-11-16T20:56:54.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:54.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520449+0000", 2020-11-16T20:56:54.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01735014 2020-11-16T20:56:54.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:54.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.537799+0000", 2020-11-16T20:56:54.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5441e-05 2020-11-16T20:56:54.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:54.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.537854+0000", 2020-11-16T20:56:54.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017898104000000001 2020-11-16T20:56:54.447 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.447 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:54.447 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.448 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:202 3.2 e35/19 3:5723fd94:::smithi16641208-211:head v 35'124, mlcod=35'121)", 2020-11-16T20:56:54.448 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.980847+0000", 2020-11-16T20:56:54.448 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 59.452456777000002, 2020-11-16T20:56:54.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015747763000000001, 2020-11-16T20:56:54.448 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:54.448 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:54.448 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:54.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:54.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.980847+0000", 2020-11-16T20:56:54.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:54.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:54.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.980847+0000", 2020-11-16T20:56:54.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072722660000000003 2020-11-16T20:56:54.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:54.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988119+0000", 2020-11-16T20:56:54.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2539e-05 2020-11-16T20:56:54.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.451 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:54.451 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988132+0000", 2020-11-16T20:56:54.451 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3723000000000001e-05 2020-11-16T20:56:54.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:54.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988145+0000", 2020-11-16T20:56:54.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8379999999999998e-06 2020-11-16T20:56:54.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:54.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988151+0000", 2020-11-16T20:56:54.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2691000000000002e-05 2020-11-16T20:56:54.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:54.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988194+0000", 2020-11-16T20:56:54.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8366e-05 2020-11-16T20:56:54.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:54.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988212+0000", 2020-11-16T20:56:54.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0083214259999999998 2020-11-16T20:56:54.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:54.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.996534+0000", 2020-11-16T20:56:54.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0914e-05 2020-11-16T20:56:54.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:54.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.996595+0000", 2020-11-16T20:56:54.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015747763000000001 2020-11-16T20:56:54.456 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.456 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:54.456 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.456 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:538 4.3 e41/22 4:c9160c9c:::smithi16641208-411:head v 41'95, mlcod=37'93)", 2020-11-16T20:56:54.456 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:56:54.457 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 50.307657726999999, 2020-11-16T20:56:54.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021023377999999999, 2020-11-16T20:56:54.457 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:54.457 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:54.457 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:54.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:54.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:56:54.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:54.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:54.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:56:54.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052206140000000002 2020-11-16T20:56:54.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.459 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:54.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130866+0000", 2020-11-16T20:56:54.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0824e-05 2020-11-16T20:56:54.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:54.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130877+0000", 2020-11-16T20:56:54.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5384e-05 2020-11-16T20:56:54.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:54.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130893+0000", 2020-11-16T20:56:54.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0064999999999999e-05 2020-11-16T20:56:54.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:54.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130903+0000", 2020-11-16T20:56:54.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3051000000000003e-05 2020-11-16T20:56:54.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:54.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130966+0000", 2020-11-16T20:56:54.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9724e-05 2020-11-16T20:56:54.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:54.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130985+0000", 2020-11-16T20:56:54.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015638332000000001 2020-11-16T20:56:54.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.463 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:54.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.146624+0000", 2020-11-16T20:56:54.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5383999999999998e-05 2020-11-16T20:56:54.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:54.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.146669+0000", 2020-11-16T20:56:54.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021023377999999999 2020-11-16T20:56:54.464 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.464 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:54.465 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.465 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:547 3.2 e42/19 3:5f250a2b:::smithi16641208-75:head v 42'381, mlcod=42'379)", 2020-11-16T20:56:54.465 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.026221+0000", 2020-11-16T20:56:54.465 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 49.407082191999997, 2020-11-16T20:56:54.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014398213, 2020-11-16T20:56:54.466 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:54.466 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:54.466 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:54.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:54.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.026221+0000", 2020-11-16T20:56:54.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:54.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:54.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.026221+0000", 2020-11-16T20:56:54.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052355140000000001 2020-11-16T20:56:54.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.468 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:54.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031457+0000", 2020-11-16T20:56:54.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3457e-05 2020-11-16T20:56:54.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.468 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:54.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031470+0000", 2020-11-16T20:56:54.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6532e-05 2020-11-16T20:56:54.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:54.469 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031487+0000", 2020-11-16T20:56:54.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6479999999999992e-06 2020-11-16T20:56:54.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:54.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031496+0000", 2020-11-16T20:56:54.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5820000000000003e-05 2020-11-16T20:56:54.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:54.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031561+0000", 2020-11-16T20:56:54.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6701999999999999e-05 2020-11-16T20:56:54.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:54.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031588+0000", 2020-11-16T20:56:54.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089396879999999995 2020-11-16T20:56:54.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.472 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.472 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:54.472 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.040528+0000", 2020-11-16T20:56:54.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1852000000000001e-05 2020-11-16T20:56:54.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.472 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.473 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:54.473 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.040620+0000", 2020-11-16T20:56:54.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014398213 2020-11-16T20:56:54.473 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.473 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:54.473 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.474 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2367 4.2 e42/22 4:581c1e5b:::smithi16641208-124:head v 42'136, mlcod=42'133)", 2020-11-16T20:56:54.474 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:56:54.474 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 49.379959349000003, 2020-11-16T20:56:54.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021196474999999999, 2020-11-16T20:56:54.474 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:54.475 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:54.475 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:54.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.475 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:54.475 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:56:54.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:54.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:54.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:56:54.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070663000000000002 2020-11-16T20:56:54.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:54.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060411+0000", 2020-11-16T20:56:54.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0189999999999995e-06 2020-11-16T20:56:54.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.477 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:54.477 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060420+0000", 2020-11-16T20:56:54.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0069e-05 2020-11-16T20:56:54.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.478 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:54.478 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060430+0000", 2020-11-16T20:56:54.478 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6879999999999999e-06 2020-11-16T20:56:54.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:54.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060437+0000", 2020-11-16T20:56:54.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3671999999999995e-05 2020-11-16T20:56:54.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:54.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060511+0000", 2020-11-16T20:56:54.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6801999999999998e-05 2020-11-16T20:56:54.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:54.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060548+0000", 2020-11-16T20:56:54.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013927701000000001 2020-11-16T20:56:54.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:54.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074475+0000", 2020-11-16T20:56:54.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5223999999999998e-05 2020-11-16T20:56:54.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:54.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074541+0000", 2020-11-16T20:56:54.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021196474999999999 2020-11-16T20:56:54.482 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.482 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:54.482 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.483 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:554 3.2 e42/19 3:769099fd:::smithi16641208-247:head v 42'386, mlcod=42'384)", 2020-11-16T20:56:54.483 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:56:54.483 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 49.363040376000001, 2020-11-16T20:56:54.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029531213000000001, 2020-11-16T20:56:54.483 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:54.483 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:54.483 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:54.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:54.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:56:54.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:54.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:54.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:56:54.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007828448 2020-11-16T20:56:54.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:54.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078092+0000", 2020-11-16T20:56:54.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2031000000000001e-05 2020-11-16T20:56:54.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:54.486 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078104+0000", 2020-11-16T20:56:54.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3950000000000001e-06 2020-11-16T20:56:54.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.487 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:54.487 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078112+0000", 2020-11-16T20:56:54.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.434e-06 2020-11-16T20:56:54.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.487 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:54.487 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078117+0000", 2020-11-16T20:56:54.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0217999999999999e-05 2020-11-16T20:56:54.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:54.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078168+0000", 2020-11-16T20:56:54.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6242e-05 2020-11-16T20:56:54.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:54.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078194+0000", 2020-11-16T20:56:54.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021550488 2020-11-16T20:56:54.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:54.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099744+0000", 2020-11-16T20:56:54.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9957000000000003e-05 2020-11-16T20:56:54.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:54.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099794+0000", 2020-11-16T20:56:54.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029531213000000001 2020-11-16T20:56:54.491 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.491 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:54.491 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.491 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2376 4.2 e42/22 4:540952ab:::smithi16641208-369:head v 42'142, mlcod=42'136)", 2020-11-16T20:56:54.491 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.077213+0000", 2020-11-16T20:56:54.492 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 49.356090279999997, 2020-11-16T20:56:54.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015666645, 2020-11-16T20:56:54.492 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:54.492 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:54.492 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:54.492 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.492 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:54.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077213+0000", 2020-11-16T20:56:54.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:54.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:54.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077213+0000", 2020-11-16T20:56:54.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9294e-05 2020-11-16T20:56:54.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:54.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077253+0000", 2020-11-16T20:56:54.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6004e-05 2020-11-16T20:56:54.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.495 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:54.495 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077279+0000", 2020-11-16T20:56:54.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.291e-05 2020-11-16T20:56:54.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.495 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:54.495 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077291+0000", 2020-11-16T20:56:54.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.225e-05 2020-11-16T20:56:54.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.496 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:54.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077304+0000", 2020-11-16T20:56:54.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9744e-05 2020-11-16T20:56:54.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:54.497 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077393+0000", 2020-11-16T20:56:54.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5826e-05 2020-11-16T20:56:54.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:54.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077419+0000", 2020-11-16T20:56:54.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015403659 2020-11-16T20:56:54.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:54.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.092823+0000", 2020-11-16T20:56:54.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6957999999999999e-05 2020-11-16T20:56:54.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:54.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.092880+0000", 2020-11-16T20:56:54.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015666645 2020-11-16T20:56:54.499 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.500 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:54.500 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.500 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:555 3.2 e42/19 3:590e6edd:::smithi16641208-203:head v 42'387, mlcod=42'384)", 2020-11-16T20:56:54.500 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:56:54.500 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 49.355159532000002, 2020-11-16T20:56:54.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021681786000000002, 2020-11-16T20:56:54.501 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:54.501 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:54.501 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:54.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:54.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:56:54.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:54.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:54.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:56:54.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6817999999999998e-05 2020-11-16T20:56:54.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:54.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078191+0000", 2020-11-16T20:56:54.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7800000000000003e-06 2020-11-16T20:56:54.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:54.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078198+0000", 2020-11-16T20:56:54.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0331e-05 2020-11-16T20:56:54.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:54.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078208+0000", 2020-11-16T20:56:54.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8429999999999998e-06 2020-11-16T20:56:54.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:54.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078214+0000", 2020-11-16T20:56:54.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0025044690000000001 2020-11-16T20:56:54.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:54.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080718+0000", 2020-11-16T20:56:54.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027441100000000001 2020-11-16T20:56:54.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:54.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080993+0000", 2020-11-16T20:56:54.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018806976999999999 2020-11-16T20:56:54.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:54.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099800+0000", 2020-11-16T20:56:54.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6157e-05 2020-11-16T20:56:54.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.508 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:54.508 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099826+0000", 2020-11-16T20:56:54.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021681786000000002 2020-11-16T20:56:54.508 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.508 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:54.508 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.509 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:485 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'94, mlcod=41'92)", 2020-11-16T20:56:54.509 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:56:54.509 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 49.354590565000002, 2020-11-16T20:56:54.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021768460999999999, 2020-11-16T20:56:54.509 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:54.509 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:54.510 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:54.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:54.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:56:54.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:54.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:54.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:56:54.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001603103 2020-11-16T20:56:54.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:54.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080316+0000", 2020-11-16T20:56:54.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4956e-05 2020-11-16T20:56:54.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.512 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:54.512 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080331+0000", 2020-11-16T20:56:54.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6291e-05 2020-11-16T20:56:54.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.513 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:54.513 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080347+0000", 2020-11-16T20:56:54.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3090000000000001e-06 2020-11-16T20:56:54.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.513 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:54.514 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080357+0000", 2020-11-16T20:56:54.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7073000000000001e-05 2020-11-16T20:56:54.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.514 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:54.514 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080414+0000", 2020-11-16T20:56:54.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5877e-05 2020-11-16T20:56:54.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:54.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080440+0000", 2020-11-16T20:56:54.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019927006000000001 2020-11-16T20:56:54.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:54.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100367+0000", 2020-11-16T20:56:54.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114846 2020-11-16T20:56:54.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:54.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100481+0000", 2020-11-16T20:56:54.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021768460999999999 2020-11-16T20:56:54.517 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.517 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:54.517 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.517 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.517 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:556 3.2 e42/19 3:590e6edd:::smithi16641208-203:head v 42'388, mlcod=42'384)", 2020-11-16T20:56:54.518 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.081175+0000", 2020-11-16T20:56:54.518 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 49.352128682999997, 2020-11-16T20:56:54.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020119680000000001, 2020-11-16T20:56:54.518 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:54.518 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:54.518 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:54.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:54.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081175+0000", 2020-11-16T20:56:54.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:54.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:54.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081175+0000", 2020-11-16T20:56:54.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084338599999999996 2020-11-16T20:56:54.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:54.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089609+0000", 2020-11-16T20:56:54.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1812e-05 2020-11-16T20:56:54.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:54.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089621+0000", 2020-11-16T20:56:54.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6175e-05 2020-11-16T20:56:54.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:54.522 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089637+0000", 2020-11-16T20:56:54.522 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2799999999999992e-06 2020-11-16T20:56:54.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.522 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:54.522 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089646+0000", 2020-11-16T20:56:54.522 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1341999999999998e-05 2020-11-16T20:56:54.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:54.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089687+0000", 2020-11-16T20:56:54.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3351999999999999e-05 2020-11-16T20:56:54.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.524 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:54.524 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089711+0000", 2020-11-16T20:56:54.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011527864000000001 2020-11-16T20:56:54.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.524 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.524 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:54.524 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101239+0000", 2020-11-16T20:56:54.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5995000000000002e-05 2020-11-16T20:56:54.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.525 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:54.525 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101295+0000", 2020-11-16T20:56:54.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020119680000000001 2020-11-16T20:56:54.525 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.526 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:54.526 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.526 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2370 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'95, mlcod=41'92)", 2020-11-16T20:56:54.526 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.083328+0000", 2020-11-16T20:56:54.526 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 49.349975981999997, 2020-11-16T20:56:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01719561, 2020-11-16T20:56:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083328+0000", 2020-11-16T20:56:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083328+0000", 2020-11-16T20:56:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00037936799999999999 2020-11-16T20:56:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083707+0000", 2020-11-16T20:56:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7088999999999999e-05 2020-11-16T20:56:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083724+0000", 2020-11-16T20:56:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6737999999999999e-05 2020-11-16T20:56:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083771+0000", 2020-11-16T20:56:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7869000000000001e-05 2020-11-16T20:56:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083789+0000", 2020-11-16T20:56:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0046429339999999996 2020-11-16T20:56:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.088432+0000", 2020-11-16T20:56:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7565999999999998e-05 2020-11-16T20:56:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.088479+0000", 2020-11-16T20:56:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012005706 2020-11-16T20:56:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100485+0000", 2020-11-16T20:56:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8340000000000002e-05 2020-11-16T20:56:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100523+0000", 2020-11-16T20:56:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01719561 2020-11-16T20:56:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2371 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'96, mlcod=41'92)", 2020-11-16T20:56:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.084682+0000", 2020-11-16T20:56:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 49.348621836, 2020-11-16T20:56:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015864851999999999, 2020-11-16T20:56:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084682+0000", 2020-11-16T20:56:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084682+0000", 2020-11-16T20:56:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1321e-05 2020-11-16T20:56:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084723+0000", 2020-11-16T20:56:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9310000000000008e-06 2020-11-16T20:56:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084731+0000", 2020-11-16T20:56:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1453e-05 2020-11-16T20:56:54.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.539 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:54.539 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084742+0000", 2020-11-16T20:56:54.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9670000000000004e-06 2020-11-16T20:56:54.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:54.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084749+0000", 2020-11-16T20:56:54.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048588700000000004 2020-11-16T20:56:54.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:54.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089608+0000", 2020-11-16T20:56:54.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3699999999999998e-05 2020-11-16T20:56:54.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:54.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089652+0000", 2020-11-16T20:56:54.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010873481000000001 2020-11-16T20:56:54.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:54.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100525+0000", 2020-11-16T20:56:54.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1129e-05 2020-11-16T20:56:54.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:54.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100547+0000", 2020-11-16T20:56:54.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015864851999999999 2020-11-16T20:56:54.543 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.543 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:54.543 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.544 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:663 4.3 e57/22 4:f65e82cb:::smithi16641208-219:head v 57'179, mlcod=57'176)", 2020-11-16T20:56:54.544 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:56:54.544 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 34.636475494999999, 2020-11-16T20:56:54.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022540092000000001, 2020-11-16T20:56:54.544 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:54.544 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:54.544 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:54.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.545 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:54.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:56:54.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:54.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.545 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:54.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:56:54.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013414394 2020-11-16T20:56:54.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:54.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810242+0000", 2020-11-16T20:56:54.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1864e-05 2020-11-16T20:56:54.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:54.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810254+0000", 2020-11-16T20:56:54.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3716e-05 2020-11-16T20:56:54.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.548 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:54.548 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810268+0000", 2020-11-16T20:56:54.548 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.064e-06 2020-11-16T20:56:54.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.548 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:54.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810277+0000", 2020-11-16T20:56:54.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0560999999999998e-05 2020-11-16T20:56:54.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.549 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:54.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810338+0000", 2020-11-16T20:56:54.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7523999999999999e-05 2020-11-16T20:56:54.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:54.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810365+0000", 2020-11-16T20:56:54.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089020890000000002 2020-11-16T20:56:54.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:54.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819267+0000", 2020-11-16T20:56:54.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010088 2020-11-16T20:56:54.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:54.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819368+0000", 2020-11-16T20:56:54.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022540092000000001 2020-11-16T20:56:54.552 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.552 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:54.552 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.552 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:618 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'243, mlcod=57'241)", 2020-11-16T20:56:54.553 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:56:54.553 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 34.632969420000002, 2020-11-16T20:56:54.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049183098000000001, 2020-11-16T20:56:54.553 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:54.553 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:54.553 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:54.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:54.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:56:54.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:54.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:54.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:56:54.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019114651 2020-11-16T20:56:54.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:54.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819449+0000", 2020-11-16T20:56:54.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.398e-05 2020-11-16T20:56:54.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.556 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:54.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819463+0000", 2020-11-16T20:56:54.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1139e-05 2020-11-16T20:56:54.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.556 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:54.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819474+0000", 2020-11-16T20:56:54.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1860000000000003e-06 2020-11-16T20:56:54.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:54.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819481+0000", 2020-11-16T20:56:54.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015472700000000001 2020-11-16T20:56:54.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:54.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819636+0000", 2020-11-16T20:56:54.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9632e-05 2020-11-16T20:56:54.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:54.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819665+0000", 2020-11-16T20:56:54.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029788289999999999 2020-11-16T20:56:54.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:54.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849454+0000", 2020-11-16T20:56:54.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3492999999999997e-05 2020-11-16T20:56:54.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.560 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:54.560 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849517+0000", 2020-11-16T20:56:54.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049183098000000001 2020-11-16T20:56:54.560 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.561 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:54.561 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.561 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:609 3.2 e57/19 3:5eead97c:::smithi16641208-34:head v 57'498, mlcod=57'495)", 2020-11-16T20:56:54.561 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:56:54.562 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 34.622689921000003, 2020-11-16T20:56:54.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039221579999999999, 2020-11-16T20:56:54.562 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:54.562 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:54.562 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:54.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:54.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:56:54.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:54.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:54.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:56:54.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008889859 2020-11-16T20:56:54.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:54.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819503+0000", 2020-11-16T20:56:54.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0149000000000001e-05 2020-11-16T20:56:54.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:54.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819514+0000", 2020-11-16T20:56:54.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1049999999999999e-05 2020-11-16T20:56:54.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:54.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819525+0000", 2020-11-16T20:56:54.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4829999999999999e-06 2020-11-16T20:56:54.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:54.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819533+0000", 2020-11-16T20:56:54.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031805760000000001 2020-11-16T20:56:54.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:54.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822714+0000", 2020-11-16T20:56:54.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0954000000000002e-05 2020-11-16T20:56:54.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:54.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822745+0000", 2020-11-16T20:56:54.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027044038999999999 2020-11-16T20:56:54.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:54.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849789+0000", 2020-11-16T20:56:54.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6470000000000001e-05 2020-11-16T20:56:54.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:54.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849835+0000", 2020-11-16T20:56:54.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039221579999999999 2020-11-16T20:56:54.569 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.569 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:54.570 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.570 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2583 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'244, mlcod=57'241)", 2020-11-16T20:56:54.570 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:56:54.570 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 34.613772386000001, 2020-11-16T20:56:54.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030101836999999999, 2020-11-16T20:56:54.571 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:54.571 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:54.571 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:54.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.571 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:54.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:56:54.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:54.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:54.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:56:54.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3781e-05 2020-11-16T20:56:54.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:54.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819575+0000", 2020-11-16T20:56:54.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3355e-05 2020-11-16T20:56:54.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:54.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819588+0000", 2020-11-16T20:56:54.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8198e-05 2020-11-16T20:56:54.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:54.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819657+0000", 2020-11-16T20:56:54.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5849999999999999e-05 2020-11-16T20:56:54.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:54.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819672+0000", 2020-11-16T20:56:54.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003042473 2020-11-16T20:56:54.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:54.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822715+0000", 2020-11-16T20:56:54.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9779999999999999e-05 2020-11-16T20:56:54.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:54.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822745+0000", 2020-11-16T20:56:54.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026828521000000001 2020-11-16T20:56:54.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:54.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849573+0000", 2020-11-16T20:56:54.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9879e-05 2020-11-16T20:56:54.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:54.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849633+0000", 2020-11-16T20:56:54.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030101836999999999 2020-11-16T20:56:54.578 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.578 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:54.578 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.579 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:728 4.3 e69/22 4:ccdf634d:::smithi16641208-284:head v 69'228, mlcod=61'226)", 2020-11-16T20:56:54.579 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:31.767600+0000", 2020-11-16T20:56:54.579 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 22.665703320999999, 2020-11-16T20:56:54.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014161465, 2020-11-16T20:56:54.579 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:54.580 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:54.580 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:54.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:54.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.767600+0000", 2020-11-16T20:56:54.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:54.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:54.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.767600+0000", 2020-11-16T20:56:54.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053383129999999999 2020-11-16T20:56:54.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:54.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.772939+0000", 2020-11-16T20:56:54.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0958000000000001e-05 2020-11-16T20:56:54.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:54.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.772950+0000", 2020-11-16T20:56:54.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0628999999999999e-05 2020-11-16T20:56:54.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:54.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.772960+0000", 2020-11-16T20:56:54.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9689999999999999e-06 2020-11-16T20:56:54.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:54.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.772966+0000", 2020-11-16T20:56:54.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3246999999999999e-05 2020-11-16T20:56:54.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:54.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.773029+0000", 2020-11-16T20:56:54.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2042000000000003e-05 2020-11-16T20:56:54.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:54.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.773061+0000", 2020-11-16T20:56:54.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0086372619999999997 2020-11-16T20:56:54.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:54.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.781699+0000", 2020-11-16T20:56:54.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3045000000000004e-05 2020-11-16T20:56:54.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:54.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.781762+0000", 2020-11-16T20:56:54.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014161465 2020-11-16T20:56:54.587 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.587 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:54.587 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.588 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:779 4.3 e72/22 4:d9c18080:::smithi16641208-173:head v 72'266, mlcod=71'264)", 2020-11-16T20:56:54.588 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:34.786324+0000", 2020-11-16T20:56:54.588 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.646979902000002, 2020-11-16T20:56:54.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017952486, 2020-11-16T20:56:54.588 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:54.588 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:54.588 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:54.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:54.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.786324+0000", 2020-11-16T20:56:54.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:54.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:54.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.786324+0000", 2020-11-16T20:56:54.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012598417000000001 2020-11-16T20:56:54.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:54.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.798922+0000", 2020-11-16T20:56:54.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1700000000000003e-06 2020-11-16T20:56:54.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:54.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.798931+0000", 2020-11-16T20:56:54.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2648e-05 2020-11-16T20:56:54.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:54.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.798944+0000", 2020-11-16T20:56:54.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0150000000000003e-06 2020-11-16T20:56:54.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:54.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.798952+0000", 2020-11-16T20:56:54.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4095999999999998e-05 2020-11-16T20:56:54.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:54.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.799006+0000", 2020-11-16T20:56:54.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2419e-05 2020-11-16T20:56:54.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:54.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.799028+0000", 2020-11-16T20:56:54.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051805050000000002 2020-11-16T20:56:54.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:54.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.804209+0000", 2020-11-16T20:56:54.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7216000000000002e-05 2020-11-16T20:56:54.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:54.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.804276+0000", 2020-11-16T20:56:54.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017952486 2020-11-16T20:56:54.596 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.596 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:54.596 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.596 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:3004 3.2 e87/19 3:4fbd4ff5:::smithi16641208-419:head v 87'579, mlcod=82'575)", 2020-11-16T20:56:54.596 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:49.842392+0000", 2020-11-16T20:56:54.597 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.5909114779999998, 2020-11-16T20:56:54.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014789337, 2020-11-16T20:56:54.597 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:54.597 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:54.597 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:54.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:54.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:49.842392+0000", 2020-11-16T20:56:54.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:54.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:54.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:49.842392+0000", 2020-11-16T20:56:54.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006146398 2020-11-16T20:56:54.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:54.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:49.848538+0000", 2020-11-16T20:56:54.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1034e-05 2020-11-16T20:56:54.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:54.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:49.848550+0000", 2020-11-16T20:56:54.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3869999999999999e-05 2020-11-16T20:56:54.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:54.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:49.848563+0000", 2020-11-16T20:56:54.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0150000000000003e-06 2020-11-16T20:56:54.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:54.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:49.848571+0000", 2020-11-16T20:56:54.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5760000000000003e-05 2020-11-16T20:56:54.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:54.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:49.848607+0000", 2020-11-16T20:56:54.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8309e-05 2020-11-16T20:56:54.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:54.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:49.848625+0000", 2020-11-16T20:56:54.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085111500000000003 2020-11-16T20:56:54.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:54.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:49.857137+0000", 2020-11-16T20:56:54.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4801e-05 2020-11-16T20:56:54.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:54.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:54.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:54.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:49.857181+0000", 2020-11-16T20:56:54.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014789337 2020-11-16T20:56:54.604 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.604 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:54.605 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.605 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:54.605 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:54.605 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:54.605 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:56:54.607 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:56:54.608 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:54.608 INFO:teuthology.orchestra.run.smithi166.stdout: "epoch": 91, 2020-11-16T20:56:54.608 INFO:teuthology.orchestra.run.smithi166.stdout: "fsid": "a14fd848-4cfe-4cd9-9140-5b3c4b4e904d", 2020-11-16T20:56:54.608 INFO:teuthology.orchestra.run.smithi166.stdout: "created": "2020-11-16T20:54:44.938121+0000", 2020-11-16T20:56:54.608 INFO:teuthology.orchestra.run.smithi166.stdout: "modified": "2020-11-16T20:56:53.819778+0000", 2020-11-16T20:56:54.609 INFO:teuthology.orchestra.run.smithi166.stdout: "last_up_change": "2020-11-16T20:54:52.080163+0000", 2020-11-16T20:56:54.609 INFO:teuthology.orchestra.run.smithi166.stdout: "last_in_change": "2020-11-16T20:54:52.080163+0000", 2020-11-16T20:56:54.609 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-11-16T20:56:54.609 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_num": 5804032, 2020-11-16T20:56:54.609 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_set": [ 2020-11-16T20:56:54.609 INFO:teuthology.orchestra.run.smithi166.stdout: "nodeep-scrub", 2020-11-16T20:56:54.609 INFO:teuthology.orchestra.run.smithi166.stdout: "pglog_hardlimit", 2020-11-16T20:56:54.610 INFO:teuthology.orchestra.run.smithi166.stdout: "purged_snapdirs", 2020-11-16T20:56:54.610 INFO:teuthology.orchestra.run.smithi166.stdout: "recovery_deletes", 2020-11-16T20:56:54.610 INFO:teuthology.orchestra.run.smithi166.stdout: "sortbitwise" 2020-11-16T20:56:54.610 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:54.610 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_version": 6, 2020-11-16T20:56:54.610 INFO:teuthology.orchestra.run.smithi166.stdout: "full_ratio": 0.94999998807907104, 2020-11-16T20:56:54.610 INFO:teuthology.orchestra.run.smithi166.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-11-16T20:56:54.611 INFO:teuthology.orchestra.run.smithi166.stdout: "nearfull_ratio": 0.85000002384185791, 2020-11-16T20:56:54.611 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_snapshot": "", 2020-11-16T20:56:54.611 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_max": 4, 2020-11-16T20:56:54.611 INFO:teuthology.orchestra.run.smithi166.stdout: "max_osd": 8, 2020-11-16T20:56:54.611 INFO:teuthology.orchestra.run.smithi166.stdout: "require_min_compat_client": "luminous", 2020-11-16T20:56:54.611 INFO:teuthology.orchestra.run.smithi166.stdout: "min_compat_client": "luminous", 2020-11-16T20:56:54.612 INFO:teuthology.orchestra.run.smithi166.stdout: "require_osd_release": "pacific", 2020-11-16T20:56:54.612 INFO:teuthology.orchestra.run.smithi166.stdout: "pools": [ 2020-11-16T20:56:54.612 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.612 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 1, 2020-11-16T20:56:54.612 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "device_health_metrics", 2020-11-16T20:56:54.612 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:54:49.109999+0000", 2020-11-16T20:56:54.612 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 1, 2020-11-16T20:56:54.613 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool", 2020-11-16T20:56:54.613 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:56:54.613 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:56:54.613 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:56:54.613 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:56:54.613 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:56:54.613 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:56:54.614 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:56:54.614 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:56:54.614 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:56:54.614 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:56:54.614 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 1, 2020-11-16T20:56:54.614 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 1, 2020-11-16T20:56:54.614 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 1, 2020-11-16T20:56:54.615 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 1, 2020-11-16T20:56:54.615 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 1, 2020-11-16T20:56:54.615 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:56:54.615 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:56:54.615 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:56:54.615 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:56:54.615 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:56:54.616 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:56:54.616 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:56:54.616 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.616 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "15", 2020-11-16T20:56:54.616 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "0", 2020-11-16T20:56:54.616 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-16T20:56:54.616 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "0", 2020-11-16T20:56:54.617 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:56:54.617 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:56:54.617 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 0, 2020-11-16T20:56:54.617 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 0, 2020-11-16T20:56:54.617 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:56:54.617 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:56:54.617 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:56:54.618 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:56:54.618 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:56:54.618 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:56:54.618 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:56:54.618 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:56:54.618 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:56:54.619 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:56:54.619 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:56:54.619 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:56:54.619 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:56:54.619 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:56:54.619 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:56:54.619 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:56:54.620 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:56:54.620 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:56:54.620 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:56:54.620 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.620 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:56:54.620 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:56:54.620 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:56:54.621 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:56:54.621 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:56:54.621 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:56:54.621 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:56:54.621 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:56:54.621 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:56:54.621 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:56:54.622 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:56:54.622 INFO:teuthology.orchestra.run.smithi166.stdout: "options": { 2020-11-16T20:56:54.622 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_min": 1 2020-11-16T20:56:54.622 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.622 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:56:54.622 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_devicehealth": {} 2020-11-16T20:56:54.622 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.623 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.623 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.623 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 2, 2020-11-16T20:56:54.623 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "rbd", 2020-11-16T20:56:54.623 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:54:53.253680+0000", 2020-11-16T20:56:54.623 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 1, 2020-11-16T20:56:54.623 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool", 2020-11-16T20:56:54.624 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:56:54.624 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:56:54.624 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:56:54.624 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:56:54.624 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:56:54.624 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:56:54.624 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:56:54.625 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:56:54.625 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:56:54.625 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:56:54.625 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 18, 2020-11-16T20:56:54.625 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 18, 2020-11-16T20:56:54.625 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 18, 2020-11-16T20:56:54.625 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 18, 2020-11-16T20:56:54.626 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 18, 2020-11-16T20:56:54.626 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:56:54.626 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:56:54.626 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:56:54.626 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:56:54.626 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:56:54.626 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:56:54.627 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:56:54.627 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.627 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "34", 2020-11-16T20:56:54.627 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "0", 2020-11-16T20:56:54.627 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-16T20:56:54.627 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "32", 2020-11-16T20:56:54.627 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:56:54.628 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:56:54.628 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 0, 2020-11-16T20:56:54.628 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 0, 2020-11-16T20:56:54.628 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:56:54.628 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:56:54.628 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:56:54.628 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:56:54.629 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:56:54.629 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:56:54.629 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:56:54.629 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:56:54.629 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:56:54.629 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:56:54.629 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:56:54.630 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:56:54.630 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:56:54.630 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:56:54.630 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:56:54.630 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:56:54.630 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:56:54.630 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:56:54.631 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:56:54.631 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.631 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:56:54.631 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:56:54.631 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:56:54.631 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:56:54.631 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:56:54.632 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:56:54.632 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:56:54.632 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:56:54.632 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:56:54.632 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:56:54.632 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:56:54.632 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:56:54.633 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:56:54.633 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd": {} 2020-11-16T20:56:54.633 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.633 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.633 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.633 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 3, 2020-11-16T20:56:54.633 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "base", 2020-11-16T20:56:54.634 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:55:23.597952+0000", 2020-11-16T20:56:54.634 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 8193, 2020-11-16T20:56:54.634 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2020-11-16T20:56:54.634 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:56:54.634 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:56:54.634 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:56:54.634 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:56:54.635 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:56:54.635 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:56:54.635 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:56:54.635 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:56:54.635 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:56:54.635 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:56:54.635 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 4, 2020-11-16T20:56:54.636 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 4, 2020-11-16T20:56:54.636 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 4, 2020-11-16T20:56:54.636 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 4, 2020-11-16T20:56:54.636 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 4, 2020-11-16T20:56:54.636 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:56:54.636 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:56:54.636 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:56:54.637 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:56:54.637 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:56:54.637 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:56:54.637 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:56:54.637 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.637 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "91", 2020-11-16T20:56:54.637 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "27", 2020-11-16T20:56:54.638 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "27", 2020-11-16T20:56:54.638 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "27", 2020-11-16T20:56:54.638 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:56:54.638 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:56:54.638 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 55, 2020-11-16T20:56:54.638 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 91, 2020-11-16T20:56:54.638 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:56:54.639 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:56:54.639 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:56:54.639 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:56:54.639 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [ 2020-11-16T20:56:54.639 INFO:teuthology.orchestra.run.smithi166.stdout: 4 2020-11-16T20:56:54.639 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:54.639 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:56:54.640 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": 4, 2020-11-16T20:56:54.640 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": 4, 2020-11-16T20:56:54.640 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:56:54.640 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:56:54.640 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:56:54.640 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:56:54.640 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:56:54.641 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:56:54.641 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:56:54.641 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:56:54.641 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:56:54.641 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:56:54.641 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:56:54.641 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.642 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:56:54.642 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:56:54.642 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:56:54.642 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:56:54.642 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:56:54.642 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:56:54.643 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:56:54.643 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:56:54.643 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:56:54.643 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:56:54.643 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:56:54.643 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:56:54.643 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:56:54.644 INFO:teuthology.orchestra.run.smithi166.stdout: "rados": {} 2020-11-16T20:56:54.644 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.644 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.644 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.644 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 4, 2020-11-16T20:56:54.644 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "cache", 2020-11-16T20:56:54.644 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:55:28.901773+0000", 2020-11-16T20:56:54.645 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 8201, 2020-11-16T20:56:54.645 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool,incomplete_clones,selfmanaged_snaps", 2020-11-16T20:56:54.645 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:56:54.645 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:56:54.645 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:56:54.645 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:56:54.645 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:56:54.645 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:56:54.646 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:56:54.646 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:56:54.646 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:56:54.646 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:56:54.646 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 4, 2020-11-16T20:56:54.646 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 4, 2020-11-16T20:56:54.647 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 4, 2020-11-16T20:56:54.647 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 4, 2020-11-16T20:56:54.647 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 4, 2020-11-16T20:56:54.647 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:56:54.647 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:56:54.647 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:56:54.647 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:56:54.647 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:56:54.648 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:56:54.648 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:56:54.648 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.648 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "91", 2020-11-16T20:56:54.648 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "27", 2020-11-16T20:56:54.648 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "27", 2020-11-16T20:56:54.648 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "27", 2020-11-16T20:56:54.649 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:56:54.649 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:56:54.649 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 55, 2020-11-16T20:56:54.649 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 91, 2020-11-16T20:56:54.649 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:56:54.649 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:56:54.649 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:56:54.650 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:56:54.650 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:56:54.650 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": 3, 2020-11-16T20:56:54.650 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:56:54.650 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:56:54.650 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "writeback", 2020-11-16T20:56:54.651 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:56:54.651 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 250, 2020-11-16T20:56:54.651 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:56:54.651 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:56:54.651 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:56:54.651 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:56:54.651 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:56:54.652 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:56:54.652 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:56:54.652 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "bloom", 2020-11-16T20:56:54.652 INFO:teuthology.orchestra.run.smithi166.stdout: "false_positive_probability": 0.050000000000000003, 2020-11-16T20:56:54.652 INFO:teuthology.orchestra.run.smithi166.stdout: "target_size": 0, 2020-11-16T20:56:54.652 INFO:teuthology.orchestra.run.smithi166.stdout: "seed": 0 2020-11-16T20:56:54.652 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.653 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 3600, 2020-11-16T20:56:54.653 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 8, 2020-11-16T20:56:54.653 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:56:54.653 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 2, 2020-11-16T20:56:54.653 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:56:54.653 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:56:54.653 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:56:54.654 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [ 2020-11-16T20:56:54.654 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:54.654 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:54.654 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:54.654 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:54.654 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:54.654 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:54.655 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:56:54.655 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000 2020-11-16T20:56:54.655 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:54.655 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:56:54.655 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:56:54.655 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:56:54.655 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:56:54.656 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": {} 2020-11-16T20:56:54.656 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.656 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:54.656 INFO:teuthology.orchestra.run.smithi166.stdout: "osds": [ 2020-11-16T20:56:54.656 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.656 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 0, 2020-11-16T20:56:54.656 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "35950122-efbd-420e-b07a-f5730f26df17", 2020-11-16T20:56:54.657 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:54.657 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:54.657 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:54.657 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:54.657 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:54.657 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:54.657 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:54.658 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 83, 2020-11-16T20:56:54.658 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:54.658 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:54.658 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:54.658 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.658 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.658 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.659 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6800", 2020-11-16T20:56:54.659 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:56:54.659 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.659 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.659 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.659 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:54.659 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.660 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.660 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.660 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6802", 2020-11-16T20:56:54.660 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:56:54.660 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.660 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.660 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.661 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:54.661 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.661 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.661 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.661 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6806", 2020-11-16T20:56:54.661 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:56:54.661 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.662 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.662 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.662 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:54.662 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.662 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.662 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.662 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6804", 2020-11-16T20:56:54.663 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:56:54.663 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.663 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.663 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.663 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6800/35293", 2020-11-16T20:56:54.663 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6802/35293", 2020-11-16T20:56:54.663 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6806/35293", 2020-11-16T20:56:54.664 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6804/35293", 2020-11-16T20:56:54.664 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:54.664 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:54.664 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:54.664 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.664 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.664 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.665 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 1, 2020-11-16T20:56:54.665 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "f768a1ff-3e8a-4131-a6ed-10f93b3ca900", 2020-11-16T20:56:54.665 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:54.665 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:54.665 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:54.665 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:54.665 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:54.666 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:54.666 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:54.666 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 66, 2020-11-16T20:56:54.666 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:54.666 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:54.666 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:54.666 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.667 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.667 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.667 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6808", 2020-11-16T20:56:54.667 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:56:54.667 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.667 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.667 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.668 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:54.668 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.668 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.668 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.668 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6809", 2020-11-16T20:56:54.668 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:56:54.668 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.669 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.669 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.669 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:54.669 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.669 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.670 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.670 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6811", 2020-11-16T20:56:54.670 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:56:54.670 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.670 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.670 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.671 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:54.671 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.671 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.671 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.671 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6810", 2020-11-16T20:56:54.671 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:56:54.671 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.672 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.672 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.672 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6808/35323", 2020-11-16T20:56:54.672 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6809/35323", 2020-11-16T20:56:54.672 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6811/35323", 2020-11-16T20:56:54.672 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6810/35323", 2020-11-16T20:56:54.672 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:54.672 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:54.673 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:54.673 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.673 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.673 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.673 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 2, 2020-11-16T20:56:54.673 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "88734179-84a6-4a9b-8af0-692805815875", 2020-11-16T20:56:54.673 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:54.674 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:54.674 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:54.674 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:54.674 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:54.674 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:54.674 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:54.674 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 84, 2020-11-16T20:56:54.675 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:54.675 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:54.675 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:54.675 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.675 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.675 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.675 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6801", 2020-11-16T20:56:54.675 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:56:54.676 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.676 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.676 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.676 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:54.676 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.676 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.676 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.677 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6803", 2020-11-16T20:56:54.677 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:56:54.677 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.677 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.677 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.677 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:54.677 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.677 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.678 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.678 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6807", 2020-11-16T20:56:54.678 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:56:54.678 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.678 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.678 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.678 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:54.679 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.679 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.679 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.679 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6805", 2020-11-16T20:56:54.679 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:56:54.679 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.679 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.680 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.680 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6801/35294", 2020-11-16T20:56:54.680 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6803/35294", 2020-11-16T20:56:54.680 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6807/35294", 2020-11-16T20:56:54.680 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6805/35294", 2020-11-16T20:56:54.680 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:54.680 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:54.681 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:54.681 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.681 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.681 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.681 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 3, 2020-11-16T20:56:54.681 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "319e54e8-3f03-4388-8de6-678d148e25d4", 2020-11-16T20:56:54.681 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:54.682 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:54.682 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:54.682 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:54.682 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:54.682 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:54.682 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:54.682 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 22, 2020-11-16T20:56:54.682 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:54.683 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:54.683 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:54.683 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.683 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.683 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.683 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6812", 2020-11-16T20:56:54.683 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:56:54.684 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.684 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.684 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.684 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:54.684 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.684 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.684 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.684 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6813", 2020-11-16T20:56:54.685 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:56:54.685 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.685 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.685 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.685 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:54.685 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.685 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.686 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.686 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6815", 2020-11-16T20:56:54.686 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:56:54.686 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.686 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.686 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.686 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:54.687 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.687 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.687 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.687 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6814", 2020-11-16T20:56:54.687 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:56:54.687 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.687 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.687 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.688 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6812/35324", 2020-11-16T20:56:54.688 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6813/35324", 2020-11-16T20:56:54.688 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6815/35324", 2020-11-16T20:56:54.688 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6814/35324", 2020-11-16T20:56:54.688 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:54.688 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:54.688 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:54.689 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.689 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.689 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.689 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 4, 2020-11-16T20:56:54.689 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "3edbb68e-e030-4379-891e-2412f1235ffb", 2020-11-16T20:56:54.689 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:54.689 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:54.689 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:54.690 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:54.690 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:54.690 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:54.690 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:54.690 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 63, 2020-11-16T20:56:54.690 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:54.690 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:54.691 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:54.691 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.691 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.691 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.691 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6804", 2020-11-16T20:56:54.691 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:56:54.691 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.691 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.692 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.692 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:54.692 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.692 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.692 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.692 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6805", 2020-11-16T20:56:54.692 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:56:54.693 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.693 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.693 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.693 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:54.693 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.693 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.693 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.693 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6807", 2020-11-16T20:56:54.694 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:56:54.694 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.694 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.694 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.694 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:54.694 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.694 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.695 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.695 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6806", 2020-11-16T20:56:54.695 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:56:54.695 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.695 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.695 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.695 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6804/31586", 2020-11-16T20:56:54.696 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6805/31586", 2020-11-16T20:56:54.696 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6807/31586", 2020-11-16T20:56:54.696 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6806/31586", 2020-11-16T20:56:54.696 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:54.696 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:54.696 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:54.696 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.696 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.697 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.697 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 5, 2020-11-16T20:56:54.697 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "44fbf5ac-4484-48a8-a846-1f5c01a6ec2c", 2020-11-16T20:56:54.697 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:54.697 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:54.697 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:54.697 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:54.698 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:54.698 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:54.698 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:54.698 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 63, 2020-11-16T20:56:54.698 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:54.698 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:54.698 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:54.698 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.699 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.699 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.699 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6808", 2020-11-16T20:56:54.699 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:56:54.699 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.699 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.699 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.700 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:54.700 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.700 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.700 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.700 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6810", 2020-11-16T20:56:54.700 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:56:54.700 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.700 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.701 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.701 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:54.701 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.701 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.701 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.701 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6813", 2020-11-16T20:56:54.701 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:56:54.702 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.702 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.702 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.702 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:54.702 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.702 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.702 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.702 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6812", 2020-11-16T20:56:54.703 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:56:54.703 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.703 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.703 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.703 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6808/31610", 2020-11-16T20:56:54.703 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6810/31610", 2020-11-16T20:56:54.703 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6813/31610", 2020-11-16T20:56:54.703 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6812/31610", 2020-11-16T20:56:54.704 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:54.704 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:54.704 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:54.704 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.704 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.704 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.704 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 6, 2020-11-16T20:56:54.705 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "f93b82df-f537-4601-8247-388bf100b5b5", 2020-11-16T20:56:54.705 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:54.705 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:54.705 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 0.5654754638671875, 2020-11-16T20:56:54.705 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:54.705 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:54.705 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:54.705 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:54.706 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 34, 2020-11-16T20:56:54.706 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:54.706 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:54.706 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:54.706 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.706 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.706 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.707 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6800", 2020-11-16T20:56:54.707 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:56:54.707 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.707 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.707 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.707 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:54.707 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.708 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.708 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.708 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6801", 2020-11-16T20:56:54.708 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:56:54.708 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.708 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.708 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.709 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:54.709 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.709 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.709 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.709 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6803", 2020-11-16T20:56:54.709 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:56:54.709 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.709 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.710 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.710 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:54.710 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.710 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.710 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.710 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6802", 2020-11-16T20:56:54.710 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:56:54.711 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.711 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.711 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.711 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6800/31587", 2020-11-16T20:56:54.711 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6801/31587", 2020-11-16T20:56:54.711 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6803/31587", 2020-11-16T20:56:54.711 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6802/31587", 2020-11-16T20:56:54.712 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:54.712 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:54.712 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:54.712 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.712 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.712 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.712 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 7, 2020-11-16T20:56:54.713 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "e5485c88-d267-4a6a-b9b6-15d869d28f28", 2020-11-16T20:56:54.713 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:56:54.713 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:56:54.713 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:56:54.713 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:56:54.713 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:56:54.713 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:56:54.713 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:56:54.714 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 34, 2020-11-16T20:56:54.714 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:56:54.714 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:56:54.714 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:56:54.714 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.714 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.714 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.715 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6809", 2020-11-16T20:56:54.715 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:56:54.715 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.715 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.715 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.715 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:56:54.715 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.716 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.716 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.716 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6811", 2020-11-16T20:56:54.716 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:56:54.716 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.716 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.716 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.716 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:56:54.717 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.717 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.717 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.717 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6815", 2020-11-16T20:56:54.717 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:56:54.717 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.717 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.718 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.718 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:56:54.718 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:56:54.718 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.718 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:56:54.718 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6814", 2020-11-16T20:56:54.718 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:56:54.718 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.719 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.719 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.719 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6809/31617", 2020-11-16T20:56:54.719 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6811/31617", 2020-11-16T20:56:54.719 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6815/31617", 2020-11-16T20:56:54.719 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6814/31617", 2020-11-16T20:56:54.719 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:56:54.720 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:56:54.720 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:56:54.720 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.720 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.720 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:54.720 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_xinfo": [ 2020-11-16T20:56:54.720 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.720 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 0, 2020-11-16T20:56:54.721 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:54.721 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:54.721 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:54.721 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:54.721 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:54.721 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:50.907461+0000", 2020-11-16T20:56:54.721 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:54.722 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.722 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.722 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 1, 2020-11-16T20:56:54.722 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:54.722 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:54.722 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:54.722 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:54.723 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:54.723 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:50.563693+0000", 2020-11-16T20:56:54.723 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:54.723 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.723 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.723 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 2, 2020-11-16T20:56:54.723 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:54.723 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:54.724 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:54.724 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:54.724 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:54.724 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:50.630147+0000", 2020-11-16T20:56:54.724 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:54.724 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.724 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.725 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 3, 2020-11-16T20:56:54.725 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:54.725 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:54.725 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:54.725 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:54.725 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:54.725 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:51.401993+0000", 2020-11-16T20:56:54.725 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:54.726 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.726 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.726 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 4, 2020-11-16T20:56:54.726 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:54.726 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:54.726 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:54.726 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:54.727 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:54.727 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:50.833464+0000", 2020-11-16T20:56:54.727 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:54.727 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.727 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.727 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 5, 2020-11-16T20:56:54.727 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:54.728 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:54.728 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:54.728 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:54.728 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:54.728 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:52.120480+0000", 2020-11-16T20:56:54.728 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:54.728 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.728 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.729 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 6, 2020-11-16T20:56:54.729 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:54.729 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:54.729 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:54.729 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:54.729 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:54.729 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:51.579262+0000", 2020-11-16T20:56:54.730 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:54.730 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.730 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.730 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 7, 2020-11-16T20:56:54.730 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:56:54.730 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:56:54.730 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:56:54.730 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:56:54.731 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:56:54.731 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:50.854798+0000", 2020-11-16T20:56:54.731 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:56:54.731 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.731 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:54.731 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_upmap": [ 2020-11-16T20:56:54.731 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.732 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "2.e", 2020-11-16T20:56:54.732 INFO:teuthology.orchestra.run.smithi166.stdout: "osds": [ 2020-11-16T20:56:54.732 INFO:teuthology.orchestra.run.smithi166.stdout: 1, 2020-11-16T20:56:54.732 INFO:teuthology.orchestra.run.smithi166.stdout: 7, 2020-11-16T20:56:54.732 INFO:teuthology.orchestra.run.smithi166.stdout: 0 2020-11-16T20:56:54.732 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.732 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.732 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.733 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "4.0", 2020-11-16T20:56:54.733 INFO:teuthology.orchestra.run.smithi166.stdout: "osds": [ 2020-11-16T20:56:54.733 INFO:teuthology.orchestra.run.smithi166.stdout: 2, 2020-11-16T20:56:54.733 INFO:teuthology.orchestra.run.smithi166.stdout: 1, 2020-11-16T20:56:54.733 INFO:teuthology.orchestra.run.smithi166.stdout: 0 2020-11-16T20:56:54.733 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.733 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.734 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:54.734 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_upmap_items": [ 2020-11-16T20:56:54.734 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.734 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "2.4", 2020-11-16T20:56:54.734 INFO:teuthology.orchestra.run.smithi166.stdout: "mappings": [ 2020-11-16T20:56:54.734 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.734 INFO:teuthology.orchestra.run.smithi166.stdout: "from": 7, 2020-11-16T20:56:54.735 INFO:teuthology.orchestra.run.smithi166.stdout: "to": 1 2020-11-16T20:56:54.735 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.735 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.735 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.735 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.735 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "4.1", 2020-11-16T20:56:54.735 INFO:teuthology.orchestra.run.smithi166.stdout: "mappings": [ 2020-11-16T20:56:54.735 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.736 INFO:teuthology.orchestra.run.smithi166.stdout: "from": 5, 2020-11-16T20:56:54.736 INFO:teuthology.orchestra.run.smithi166.stdout: "to": 3 2020-11-16T20:56:54.736 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.736 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.736 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.736 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:54.736 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_temp": [], 2020-11-16T20:56:54.736 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_temp": [], 2020-11-16T20:56:54.737 INFO:teuthology.orchestra.run.smithi166.stdout: "blocklist": {}, 2020-11-16T20:56:54.737 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profiles": { 2020-11-16T20:56:54.737 INFO:teuthology.orchestra.run.smithi166.stdout: "default": { 2020-11-16T20:56:54.737 INFO:teuthology.orchestra.run.smithi166.stdout: "crush-failure-domain": "osd", 2020-11-16T20:56:54.737 INFO:teuthology.orchestra.run.smithi166.stdout: "k": "2", 2020-11-16T20:56:54.737 INFO:teuthology.orchestra.run.smithi166.stdout: "m": "1", 2020-11-16T20:56:54.737 INFO:teuthology.orchestra.run.smithi166.stdout: "plugin": "jerasure", 2020-11-16T20:56:54.738 INFO:teuthology.orchestra.run.smithi166.stdout: "ruleset-failure-domain": "osd", 2020-11-16T20:56:54.738 INFO:teuthology.orchestra.run.smithi166.stdout: "technique": "reed_sol_van" 2020-11-16T20:56:54.738 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.738 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.738 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps_queue": [ 2020-11-16T20:56:54.738 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.738 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 3, 2020-11-16T20:56:54.739 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:56:54.739 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.739 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 15, 2020-11-16T20:56:54.739 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:54.739 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.739 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.739 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 33, 2020-11-16T20:56:54.740 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:54.740 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.740 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.740 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 37, 2020-11-16T20:56:54.740 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 3 2020-11-16T20:56:54.740 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.740 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.740 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 43, 2020-11-16T20:56:54.741 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:54.741 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.741 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.741 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 45, 2020-11-16T20:56:54.741 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:54.741 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.741 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.742 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 48, 2020-11-16T20:56:54.742 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:54.742 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.742 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.742 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 51, 2020-11-16T20:56:54.742 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:54.742 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.743 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.743 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 53, 2020-11-16T20:56:54.743 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:54.743 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.743 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.743 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.743 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.743 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 4, 2020-11-16T20:56:54.744 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:56:54.744 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.744 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 15, 2020-11-16T20:56:54.744 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:54.744 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.744 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.744 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 33, 2020-11-16T20:56:54.745 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:54.745 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.745 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.745 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 37, 2020-11-16T20:56:54.745 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 3 2020-11-16T20:56:54.745 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.745 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.745 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 43, 2020-11-16T20:56:54.746 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:54.746 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.746 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.746 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 45, 2020-11-16T20:56:54.746 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:54.746 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.746 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.747 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 48, 2020-11-16T20:56:54.747 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:54.747 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.747 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.747 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 51, 2020-11-16T20:56:54.747 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:54.747 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.748 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.748 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 53, 2020-11-16T20:56:54.748 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:54.748 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.748 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.748 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.748 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:54.748 INFO:teuthology.orchestra.run.smithi166.stdout: "new_removed_snaps": [ 2020-11-16T20:56:54.749 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.749 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 3, 2020-11-16T20:56:54.749 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:56:54.749 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.749 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 37, 2020-11-16T20:56:54.749 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:54.749 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.750 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.750 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:54.750 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.750 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 4, 2020-11-16T20:56:54.750 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:56:54.750 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:54.750 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 37, 2020-11-16T20:56:54.751 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:56:54.751 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.751 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:54.751 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.751 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:56:54.751 INFO:teuthology.orchestra.run.smithi166.stdout: "new_purged_snaps": [], 2020-11-16T20:56:54.751 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_node_flags": {}, 2020-11-16T20:56:54.752 INFO:teuthology.orchestra.run.smithi166.stdout: "device_class_flags": {}, 2020-11-16T20:56:54.752 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode": { 2020-11-16T20:56:54.752 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode_enabled": false, 2020-11-16T20:56:54.752 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_bucket_count": 0, 2020-11-16T20:56:54.752 INFO:teuthology.orchestra.run.smithi166.stdout: "degraded_stretch_mode": 0, 2020-11-16T20:56:54.752 INFO:teuthology.orchestra.run.smithi166.stdout: "recovering_stretch_mode": 0, 2020-11-16T20:56:54.752 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode_bucket": 0 2020-11-16T20:56:54.752 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:54.753 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:54.753 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:54.612+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:54.754 INFO:tasks.thrashosds.thrasher:j is {'epoch': 91, 'fsid': 'a14fd848-4cfe-4cd9-9140-5b3c4b4e904d', 'created': '2020-11-16T20:54:44.938121+0000', 'modified': '2020-11-16T20:56:53.819778+0000', 'last_up_change': '2020-11-16T20:54:52.080163+0000', 'last_in_change': '2020-11-16T20:54:52.080163+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-16T20:54:49.109999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-16T20:54:53.253680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 18, 'pg_placement_num': 18, 'pg_placement_num_target': 18, 'pg_num_target': 18, 'pg_num_pending': 18, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '32', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'base', 'create_time': '2020-11-16T20:55:23.597952+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 4, 'pg_placement_num': 4, 'pg_placement_num_target': 4, 'pg_num_target': 4, 'pg_num_pending': 4, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '27', 'last_force_op_resend_prenautilus': '27', 'last_force_op_resend_preluminous': '27', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 55, 'snap_epoch': 91, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [4], 'tier_of': -1, 'read_tier': 4, 'write_tier': 4, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 4, 'pool_name': 'cache', 'create_time': '2020-11-16T20:55:28.901773+0000', 'flags': 8201, 'flags_names': 'hashpspool,incomplete_clones,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 4, 'pg_placement_num': 4, 'pg_placement_num_target': 4, 'pg_num_target': 4, 'pg_num_pending': 4, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '27', 'last_force_op_resend_prenautilus': '27', 'last_force_op_resend_preluminous': '27', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 55, 'snap_epoch': 91, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': 3, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'writeback', 'target_max_bytes': 0, 'target_max_objects': 250, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'bloom', 'false_positive_probability': 0.05, 'target_size': 0, 'seed': 0}, 'hit_set_period': 3600, 'hit_set_count': 8, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 2, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [1000000, 1000000, 1000000, 1000000, 1000000, 1000000, 1000000, 1000000], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}}], 'osds': [{'osd': 0, 'uuid': '35950122-efbd-420e-b07a-f5730f26df17', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 83, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6800', 'nonce': 35293}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6802', 'nonce': 35293}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6806', 'nonce': 35293}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6804', 'nonce': 35293}]}, 'public_addr': '172.21.15.166:6800/35293', 'cluster_addr': '172.21.15.166:6802/35293', 'heartbeat_back_addr': '172.21.15.166:6806/35293', 'heartbeat_front_addr': '172.21.15.166:6804/35293', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f768a1ff-3e8a-4131-a6ed-10f93b3ca900', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 66, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6808', 'nonce': 35323}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6809', 'nonce': 35323}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6811', 'nonce': 35323}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6810', 'nonce': 35323}]}, 'public_addr': '172.21.15.166:6808/35323', 'cluster_addr': '172.21.15.166:6809/35323', 'heartbeat_back_addr': '172.21.15.166:6811/35323', 'heartbeat_front_addr': '172.21.15.166:6810/35323', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '88734179-84a6-4a9b-8af0-692805815875', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 84, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6801', 'nonce': 35294}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6803', 'nonce': 35294}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6807', 'nonce': 35294}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6805', 'nonce': 35294}]}, 'public_addr': '172.21.15.166:6801/35294', 'cluster_addr': '172.21.15.166:6803/35294', 'heartbeat_back_addr': '172.21.15.166:6807/35294', 'heartbeat_front_addr': '172.21.15.166:6805/35294', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '319e54e8-3f03-4388-8de6-678d148e25d4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6812', 'nonce': 35324}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6813', 'nonce': 35324}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6815', 'nonce': 35324}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6814', 'nonce': 35324}]}, 'public_addr': '172.21.15.166:6812/35324', 'cluster_addr': '172.21.15.166:6813/35324', 'heartbeat_back_addr': '172.21.15.166:6815/35324', 'heartbeat_front_addr': '172.21.15.166:6814/35324', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '3edbb68e-e030-4379-891e-2412f1235ffb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 63, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6804', 'nonce': 31586}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6805', 'nonce': 31586}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6807', 'nonce': 31586}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6806', 'nonce': 31586}]}, 'public_addr': '172.21.15.59:6804/31586', 'cluster_addr': '172.21.15.59:6805/31586', 'heartbeat_back_addr': '172.21.15.59:6807/31586', 'heartbeat_front_addr': '172.21.15.59:6806/31586', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '44fbf5ac-4484-48a8-a846-1f5c01a6ec2c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 63, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6808', 'nonce': 31610}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6810', 'nonce': 31610}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6813', 'nonce': 31610}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6812', 'nonce': 31610}]}, 'public_addr': '172.21.15.59:6808/31610', 'cluster_addr': '172.21.15.59:6810/31610', 'heartbeat_back_addr': '172.21.15.59:6813/31610', 'heartbeat_front_addr': '172.21.15.59:6812/31610', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'f93b82df-f537-4601-8247-388bf100b5b5', 'up': 1, 'in': 1, 'weight': 0.5654754638671875, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6800', 'nonce': 31587}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6801', 'nonce': 31587}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6803', 'nonce': 31587}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6802', 'nonce': 31587}]}, 'public_addr': '172.21.15.59:6800/31587', 'cluster_addr': '172.21.15.59:6801/31587', 'heartbeat_back_addr': '172.21.15.59:6803/31587', 'heartbeat_front_addr': '172.21.15.59:6802/31587', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'e5485c88-d267-4a6a-b9b6-15d869d28f28', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6809', 'nonce': 31617}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6811', 'nonce': 31617}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6815', 'nonce': 31617}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6814', 'nonce': 31617}]}, 'public_addr': '172.21.15.59:6809/31617', 'cluster_addr': '172.21.15.59:6811/31617', 'heartbeat_back_addr': '172.21.15.59:6815/31617', 'heartbeat_front_addr': '172.21.15.59:6814/31617', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:50.907461+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:50.563693+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:50.630147+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:51.401993+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:50.833464+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:52.120480+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:51.579262+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:50.854798+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.e', 'osds': [1, 7, 0]}, {'pgid': '4.0', 'osds': [2, 1, 0]}], 'pg_upmap_items': [{'pgid': '2.4', 'mappings': [{'from': 7, 'to': 1}]}, {'pgid': '4.1', 'mappings': [{'from': 5, 'to': 3}]}], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 15, 'length': 1}, {'begin': 33, 'length': 1}, {'begin': 37, 'length': 3}, {'begin': 43, 'length': 1}, {'begin': 45, 'length': 1}, {'begin': 48, 'length': 1}, {'begin': 51, 'length': 1}, {'begin': 53, 'length': 1}]}, {'pool': 4, 'snaps': [{'begin': 15, 'length': 1}, {'begin': 33, 'length': 1}, {'begin': 37, 'length': 3}, {'begin': 43, 'length': 1}, {'begin': 45, 'length': 1}, {'begin': 48, 'length': 1}, {'begin': 51, 'length': 1}, {'begin': 53, 'length': 1}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 37, 'length': 1}]}, {'pool': 4, 'snaps': [{'begin': 37, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2020-11-16T20:56:54.755 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-16T20:56:54.755 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:56:54.757 INFO:tasks.rados.rados.0.smithi166.stdout:863: done (11 left) 2020-11-16T20:56:54.757 INFO:tasks.rados.rados.0.smithi166.stdout:864: done (10 left) 2020-11-16T20:56:54.757 INFO:tasks.rados.rados.0.smithi166.stdout:865: done (9 left) 2020-11-16T20:56:54.757 INFO:tasks.rados.rados.0.smithi166.stdout:866: done (8 left) 2020-11-16T20:56:54.758 INFO:tasks.rados.rados.0.smithi166.stdout:867: cache_try_flush oid 69 snap -1 2020-11-16T20:56:54.758 INFO:tasks.rados.rados.0.smithi166.stdout:868: write oid 240 current snap is 28 2020-11-16T20:56:54.758 INFO:tasks.rados.rados.0.smithi166.stdout:868: seq_num 592 ranges {749744=706589,1909340=577199,3224294=482561} 2020-11-16T20:56:54.758 INFO:tasks.rados.rados.0.smithi166.stdout:868: writing smithi16641208-240 from 749744 to 1456333 tid 1 2020-11-16T20:56:54.758 INFO:tasks.rados.rados.0.smithi166.stdout:868: writing smithi16641208-240 from 1909340 to 2486539 tid 2 2020-11-16T20:56:54.758 INFO:tasks.rados.rados.0.smithi166.stdout:868: writing smithi16641208-240 from 3224294 to 3706855 tid 3 2020-11-16T20:56:54.759 INFO:tasks.rados.rados.0.smithi166.stdout:869: copy_from oid 459 from oid 390 current snap is 28 2020-11-16T20:56:54.759 INFO:tasks.rados.rados.0.smithi166.stdout:868: finishing write tid 1 to smithi16641208-240 2020-11-16T20:56:54.759 INFO:tasks.rados.rados.0.smithi166.stdout:870: write oid 32 current snap is 28 2020-11-16T20:56:54.759 INFO:tasks.rados.rados.0.smithi166.stdout:870: seq_num 593 ranges {766551=498191,1684175=720857,2851717=693833} 2020-11-16T20:56:54.759 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:54.762+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:54.760 INFO:tasks.rados.rados.0.smithi166.stdout:870: writing smithi16641208-32 from 766551 to 1264742 tid 1 2020-11-16T20:56:54.767 INFO:tasks.rados.rados.0.smithi166.stdout:870: writing smithi16641208-32 from 1684175 to 2405032 tid 2 2020-11-16T20:56:54.774 INFO:tasks.rados.rados.0.smithi166.stdout:870: writing smithi16641208-32 from 2851717 to 3545550 tid 3 2020-11-16T20:56:54.775 INFO:tasks.rados.rados.0.smithi166.stdout:871: read oid 428 snap 27 2020-11-16T20:56:54.775 INFO:tasks.rados.rados.0.smithi166.stdout:871: expect (ObjNum 427 snap 0 seq_num 427) 2020-11-16T20:56:54.775 INFO:tasks.rados.rados.0.smithi166.stdout:872: cache_try_flush oid 481 snap 27 2020-11-16T20:56:54.775 INFO:tasks.rados.rados.0.smithi166.stdout:868: finishing write tid 2 to smithi16641208-240 2020-11-16T20:56:54.775 INFO:tasks.rados.rados.0.smithi166.stdout:868: finishing write tid 3 to smithi16641208-240 2020-11-16T20:56:54.775 INFO:tasks.rados.rados.0.smithi166.stdout:868: finishing write tid 4 to smithi16641208-240 2020-11-16T20:56:54.776 INFO:tasks.rados.rados.0.smithi166.stdout:873: read oid 361 snap -1 2020-11-16T20:56:54.776 INFO:tasks.rados.rados.0.smithi166.stdout:873: expect (ObjNum 545 snap 12 seq_num 545) 2020-11-16T20:56:54.776 INFO:tasks.rados.rados.0.smithi166.stdout:874: cache_try_flush oid 9 snap -1 2020-11-16T20:56:54.776 INFO:tasks.rados.rados.0.smithi166.stdout:868: finishing write tid 5 to smithi16641208-240 2020-11-16T20:56:54.776 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 240 v 725 (ObjNum 592 snap 28 seq_num 592) dirty exists 2020-11-16T20:56:54.776 INFO:tasks.rados.rados.0.smithi166.stdout:868: left oid 240 (ObjNum 592 snap 28 seq_num 592) 2020-11-16T20:56:54.776 INFO:tasks.rados.rados.0.smithi166.stdout:870: finishing write tid 1 to smithi16641208-32 2020-11-16T20:56:54.777 INFO:tasks.rados.rados.0.smithi166.stdout:870: finishing write tid 2 to smithi16641208-32 2020-11-16T20:56:54.777 INFO:tasks.rados.rados.0.smithi166.stdout:868: done (15 left) 2020-11-16T20:56:54.777 INFO:tasks.rados.rados.0.smithi166.stdout:875: cache_flush oid 5 snap -1 2020-11-16T20:56:54.777 INFO:tasks.rados.rados.0.smithi166.stdout: waiting on 16 2020-11-16T20:56:54.780 INFO:tasks.rados.rados.0.smithi166.stdout:873: expect (ObjNum 545 snap 12 seq_num 545) 2020-11-16T20:56:54.831 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2020-11-16T20:56:54.875 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:54.880+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:54.909 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:54.909 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:54.909 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:56:54.909 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:54.920 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:56:54.925 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:56:54.929 INFO:tasks.rados.rados.0.smithi166.stdout:870: finishing write tid 3 to smithi16641208-32 2020-11-16T20:56:54.929 INFO:tasks.rados.rados.0.smithi166.stdout:870: finishing write tid 4 to smithi16641208-32 2020-11-16T20:56:54.929 INFO:tasks.rados.rados.0.smithi166.stdout:870: finishing write tid 5 to smithi16641208-32 2020-11-16T20:56:54.929 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 32 v 729 (ObjNum 593 snap 28 seq_num 593) dirty exists 2020-11-16T20:56:54.929 INFO:tasks.rados.rados.0.smithi166.stdout:870: left oid 32 (ObjNum 593 snap 28 seq_num 593) 2020-11-16T20:56:54.930 INFO:tasks.rados.rados.0.smithi166.stdout:871: expect (ObjNum 427 snap 0 seq_num 427) 2020-11-16T20:56:54.945 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:56:54.964 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:54.969+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:54.966 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:56:54.985 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:56:55.007 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:56:55.027 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:56:55.038 INFO:tasks.rados.rados.0.smithi166.stdout:875: got (0) Success 2020-11-16T20:56:55.039 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 5 v 0 (ObjNum 4 snap 0 seq_num 4) dirty exists 2020-11-16T20:56:55.039 INFO:tasks.rados.rados.0.smithi166.stdout:874: got (0) Success 2020-11-16T20:56:55.039 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 9 v 0 (ObjNum 566 snap 19 seq_num 566) dirty exists 2020-11-16T20:56:55.039 INFO:tasks.rados.rados.0.smithi166.stdout:870: done (15 left) 2020-11-16T20:56:55.039 INFO:tasks.rados.rados.0.smithi166.stdout:871: done (14 left) 2020-11-16T20:56:55.039 INFO:tasks.rados.rados.0.smithi166.stdout:873: done (13 left) 2020-11-16T20:56:55.040 INFO:tasks.rados.rados.0.smithi166.stdout:874: done (12 left) 2020-11-16T20:56:55.040 INFO:tasks.rados.rados.0.smithi166.stdout:875: done (11 left) 2020-11-16T20:56:55.040 INFO:tasks.rados.rados.0.smithi166.stdout:876: read oid 439 snap -1 2020-11-16T20:56:55.040 INFO:tasks.rados.rados.0.smithi166.stdout:876: expect (ObjNum 438 snap 0 seq_num 438) 2020-11-16T20:56:55.040 INFO:tasks.rados.rados.0.smithi166.stdout:877: cache_try_flush oid 120 snap -1 2020-11-16T20:56:55.040 INFO:tasks.rados.rados.0.smithi166.stdout:878: delete oid 226 current snap is 28 2020-11-16T20:56:55.049 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:56:55.058 INFO:tasks.rados.rados.0.smithi166.stdout:876: expect (ObjNum 438 snap 0 seq_num 438) 2020-11-16T20:56:55.060 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:56:55.065+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:56:55.062 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:55.062 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:55.072 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:56:55.072 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:56:55.073 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:56:55.074 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:56:55.074 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:56:55.074 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:56:55.074 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:56:55.074 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:56:55.074 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:56:55.075 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:56:55.120 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:56:55.122 INFO:teuthology.orchestra.run.smithi166.stderr:dumped all 2020-11-16T20:56:55.132 INFO:teuthology.orchestra.run.smithi166.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2020-11-16T20:56:55.095821+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1894468333,"num_objects":691,"num_object_clones":38,"num_object_copies":2073,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":597,"num_whiteouts":12,"num_read":1771,"num_read_kb":594609,"num_write":2833,"num_write_kb":1134819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":396327449,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":106,"num_flush_kb":300267,"num_evict":43,"num_evict_kb":121184,"num_promote":222,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3826,"ondisk_log_size":3826,"up":81,"acting":81,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3859408,"kb_used_data":3746064,"kb_used_omap":0,"kb_used_meta":113280,"kb_avail":751115312,"statfs":{"total":773094113280,"available":769142079488,"internally_reserved":0,"allocated":3835969536,"data_stored":3916998273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":115998720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,0,0,0,0,0,0,0,0,11],"upper_bound":4096},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7882242,"num_objects":8,"num_object_clones":9,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":2,"num_read":42,"num_read_kb":37303,"num_write":39,"num_write_kb":23550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":115551027,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":4,"num_flush_kb":12493,"num_evict":8,"num_evict_kb":23278,"num_promote":8,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000871"},"pg_stats":[{"pgid":"2.11","version":"0'0","reported_seq":"40","reported_epoch":"87","state":"active+clean","last_fresh":"2020-11-16T20:56:49.810105+0000","last_change":"2020-11-16T20:56:30.376104+0000","last_active":"2020-11-16T20:56:49.810105+0000","last_peered":"2020-11-16T20:56:49.810105+0000","last_clean":"2020-11-16T20:56:49.810105+0000","last_became_active":"2020-11-16T20:56:26.743063+0000","last_became_peered":"2020-11-16T20:56:26.743063+0000","last_unstale":"2020-11-16T20:56:49.810105+0000","last_undegraded":"2020-11-16T20:56:49.810105+0000","last_fullsized":"2020-11-16T20:56:49.810105+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:30.376014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:30.376014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"67","reported_epoch":"88","state":"active+clean","last_fresh":"2020-11-16T20:56:50.931003+0000","last_change":"2020-11-16T20:55:59.416734+0000","last_active":"2020-11-16T20:56:50.931003+0000","last_peered":"2020-11-16T20:56:50.931003+0000","last_clean":"2020-11-16T20:56:50.931003+0000","last_became_active":"2020-11-16T20:55:52.921860+0000","last_became_peered":"2020-11-16T20:55:52.921860+0000","last_unstale":"2020-11-16T20:56:50.931003+0000","last_undegraded":"2020-11-16T20:56:50.931003+0000","last_fullsized":"2020-11-16T20:56:50.931003+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.416654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.416654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":"66","reported_epoch":"87","state":"active+clean","last_fresh":"2020-11-16T20:56:49.810382+0000","last_change":"2020-11-16T20:55:56.438524+0000","last_active":"2020-11-16T20:56:49.810382+0000","last_peered":"2020-11-16T20:56:49.810382+0000","last_clean":"2020-11-16T20:56:49.810382+0000","last_became_active":"2020-11-16T20:55:52.922023+0000","last_became_peered":"2020-11-16T20:55:52.922023+0000","last_unstale":"2020-11-16T20:56:49.810382+0000","last_undegraded":"2020-11-16T20:56:49.810382+0000","last_fullsized":"2020-11-16T20:56:49.810382+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:56.438428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:56.438428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":"40","reported_epoch":"87","state":"active+clean","last_fresh":"2020-11-16T20:56:49.813669+0000","last_change":"2020-11-16T20:56:20.755004+0000","last_active":"2020-11-16T20:56:49.813669+0000","last_peered":"2020-11-16T20:56:49.813669+0000","last_clean":"2020-11-16T20:56:49.813669+0000","last_became_active":"2020-11-16T20:56:20.754520+0000","last_became_peered":"2020-11-16T20:56:20.754520+0000","last_unstale":"2020-11-16T20:56:49.813669+0000","last_undegraded":"2020-11-16T20:56:49.813669+0000","last_fullsized":"2020-11-16T20:56:49.813669+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:04.388506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:04.388506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"66","reported_epoch":"87","state":"active+clean","last_fresh":"2020-11-16T20:56:49.813488+0000","last_change":"2020-11-16T20:56:11.940489+0000","last_active":"2020-11-16T20:56:49.813488+0000","last_peered":"2020-11-16T20:56:49.813488+0000","last_clean":"2020-11-16T20:56:49.813488+0000","last_became_active":"2020-11-16T20:55:52.922134+0000","last_became_peered":"2020-11-16T20:55:52.922134+0000","last_unstale":"2020-11-16T20:56:49.813488+0000","last_undegraded":"2020-11-16T20:56:49.813488+0000","last_fullsized":"2020-11-16T20:56:49.813488+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:11.940423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:11.940423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"67","reported_epoch":"88","state":"active+clean","last_fresh":"2020-11-16T20:56:50.930065+0000","last_change":"2020-11-16T20:56:02.387946+0000","last_active":"2020-11-16T20:56:50.930065+0000","last_peered":"2020-11-16T20:56:50.930065+0000","last_clean":"2020-11-16T20:56:50.930065+0000","last_became_active":"2020-11-16T20:55:52.920496+0000","last_became_peered":"2020-11-16T20:55:52.920496+0000","last_unstale":"2020-11-16T20:56:50.930065+0000","last_undegraded":"2020-11-16T20:56:50.930065+0000","last_fullsized":"2020-11-16T20:56:50.930065+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:02.387861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:02.387861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"93","reported_epoch":"88","state":"active+clean","last_fresh":"2020-11-16T20:56:50.811547+0000","last_change":"2020-11-16T20:56:02.565668+0000","last_active":"2020-11-16T20:56:50.811547+0000","last_peered":"2020-11-16T20:56:50.811547+0000","last_clean":"2020-11-16T20:56:50.811547+0000","last_became_active":"2020-11-16T20:55:52.917496+0000","last_became_peered":"2020-11-16T20:55:52.917496+0000","last_unstale":"2020-11-16T20:56:50.811547+0000","last_undegraded":"2020-11-16T20:56:50.811547+0000","last_fullsized":"2020-11-16T20:56:50.811547+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:02.565607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:56:02.565607+0000","last_clean_scrub_stamp":"2020-11-16T20:56:02.565607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"92","reported_epoch":"87","state":"active+clean","last_fresh":"2020-11-16T20:56:49.813603+0000","last_change":"2020-11-16T20:56:01.955760+0000","last_active":"2020-11-16T20:56:49.813603+0000","last_peered":"2020-11-16T20:56:49.813603+0000","last_clean":"2020-11-16T20:56:49.813603+0000","last_became_active":"2020-11-16T20:55:52.922447+0000","last_became_peered":"2020-11-16T20:55:52.922447+0000","last_unstale":"2020-11-16T20:56:49.813603+0000","last_undegraded":"2020-11-16T20:56:49.813603+0000","last_fullsized":"2020-11-16T20:56:49.813603+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:01.955691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:01.955691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"75","reported_epoch":"87","state":"active+clean","last_fresh":"2020-11-16T20:56:49.813512+0000","last_change":"2020-11-16T20:56:18.755476+0000","last_active":"2020-11-16T20:56:49.813512+0000","last_peered":"2020-11-16T20:56:49.813512+0000","last_clean":"2020-11-16T20:56:49.813512+0000","last_became_active":"2020-11-16T20:56:18.754989+0000","last_became_peered":"2020-11-16T20:56:18.754989+0000","last_unstale":"2020-11-16T20:56:49.813512+0000","last_undegraded":"2020-11-16T20:56:49.813512+0000","last_fullsized":"2020-11-16T20:56:49.813512+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:00.967553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:00.967553+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"102","reported_epoch":"88","state":"active+clean","last_fresh":"2020-11-16T20:56:50.811531+0000","last_change":"2020-11-16T20:56:01.528273+0000","last_active":"2020-11-16T20:56:50.811531+0000","last_peered":"2020-11-16T20:56:50.811531+0000","last_clean":"2020-11-16T20:56:50.811531+0000","last_became_active":"2020-11-16T20:55:52.922303+0000","last_became_peered":"2020-11-16T20:55:52.922303+0000","last_unstale":"2020-11-16T20:56:50.811531+0000","last_undegraded":"2020-11-16T20:56:50.811531+0000","last_fullsized":"2020-11-16T20:56:50.811531+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:01.528217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:01.528217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"92","reported_epoch":"87","state":"active+clean","last_fresh":"2020-11-16T20:56:49.813602+0000","last_change":"2020-11-16T20:55:57.905062+0000","last_active":"2020-11-16T20:56:49.813602+0000","last_peered":"2020-11-16T20:56:49.813602+0000","last_clean":"2020-11-16T20:56:49.813602+0000","last_became_active":"2020-11-16T20:55:50.904146+0000","last_became_peered":"2020-11-16T20:55:50.904146+0000","last_unstale":"2020-11-16T20:56:49.813602+0000","last_undegraded":"2020-11-16T20:56:49.813602+0000","last_fullsized":"2020-11-16T20:56:49.813602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:57.905004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:57.905004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"87'340","reported_seq":"579","reported_epoch":"88","state":"active+clean","last_fresh":"2020-11-16T20:56:50.931603+0000","last_change":"2020-11-16T20:56:50.932390+0000","last_active":"2020-11-16T20:56:50.931603+0000","last_peered":"2020-11-16T20:56:50.931603+0000","last_clean":"2020-11-16T20:56:50.931603+0000","last_became_active":"2020-11-16T20:55:30.828637+0000","last_became_peered":"2020-11-16T20:55:30.828637+0000","last_unstale":"2020-11-16T20:56:50.931603+0000","last_undegraded":"2020-11-16T20:56:50.931603+0000","last_fullsized":"2020-11-16T20:56:50.931603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":340,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115465377,"num_objects":43,"num_object_clones":2,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":4,"num_read":80,"num_read_kb":34184,"num_write":174,"num_write_kb":29189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":30,"num_flush_kb":80914,"num_evict":6,"num_evict_kb":13724,"num_promote":55,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"f","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"2"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"30","length":"1"},{"start":"33","length":"1"}]},{"pgid":"2.2","version":"0'0","reported_seq":"103","reported_epoch":"89","state":"active+clean","last_fresh":"2020-11-16T20:56:52.795352+0000","last_change":"2020-11-16T20:56:26.743666+0000","last_active":"2020-11-16T20:56:52.795352+0000","last_peered":"2020-11-16T20:56:52.795352+0000","last_clean":"2020-11-16T20:56:52.795352+0000","last_became_active":"2020-11-16T20:56:26.743184+0000","last_became_peered":"2020-11-16T20:56:26.743184+0000","last_unstale":"2020-11-16T20:56:52.795352+0000","last_undegraded":"2020-11-16T20:56:52.795352+0000","last_fullsized":"2020-11-16T20:56:52.795352+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:57.606500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:57.606500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"88'670","reported_seq":"1022","reported_epoch":"88","state":"active+clean","last_fresh":"2020-11-16T20:56:51.058383+0000","last_change":"2020-11-16T20:56:50.818388+0000","last_active":"2020-11-16T20:56:51.058383+0000","last_peered":"2020-11-16T20:56:51.058383+0000","last_clean":"2020-11-16T20:56:51.058383+0000","last_became_active":"2020-11-16T20:55:25.103851+0000","last_became_peered":"2020-11-16T20:55:25.103851+0000","last_unstale":"2020-11-16T20:56:51.058383+0000","last_undegraded":"2020-11-16T20:56:51.058383+0000","last_fullsized":"2020-11-16T20:56:51.058383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":670,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":351266093,"num_objects":129,"num_object_clones":8,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":1,"num_read":355,"num_read_kb":77745,"num_write":546,"num_write_kb":261625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"f","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"2"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"30","length":"1"},{"start":"33","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":"93","reported_epoch":"88","state":"active+clean","last_fresh":"2020-11-16T20:56:50.929885+0000","last_change":"2020-11-16T20:55:58.465447+0000","last_active":"2020-11-16T20:56:50.929885+0000","last_peered":"2020-11-16T20:56:50.929885+0000","last_clean":"2020-11-16T20:56:50.929885+0000","last_became_active":"2020-11-16T20:55:50.905925+0000","last_became_peered":"2020-11-16T20:55:50.905925+0000","last_unstale":"2020-11-16T20:56:50.929885+0000","last_undegraded":"2020-11-16T20:56:50.929885+0000","last_fullsized":"2020-11-16T20:56:50.929885+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:58.465384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:58.465384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"82'572","reported_seq":"1176","reported_epoch":"88","state":"active+clean","last_fresh":"2020-11-16T20:56:50.930747+0000","last_change":"2020-11-16T20:56:50.931369+0000","last_active":"2020-11-16T20:56:50.930747+0000","last_peered":"2020-11-16T20:56:50.930747+0000","last_clean":"2020-11-16T20:56:50.930747+0000","last_became_active":"2020-11-16T20:56:29.739968+0000","last_became_peered":"2020-11-16T20:56:29.739968+0000","last_unstale":"2020-11-16T20:56:50.930747+0000","last_undegraded":"2020-11-16T20:56:50.930747+0000","last_fullsized":"2020-11-16T20:56:50.930747+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":572,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":329669823,"num_objects":118,"num_object_clones":4,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":1,"num_read":269,"num_read_kb":23351,"num_write":506,"num_write_kb":226690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":181673084,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"f","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"2"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"30","length":"1"},{"start":"33","length":"1"}]},{"pgid":"2.3","version":"0'0","reported_seq":"94","reported_epoch":"89","state":"active+clean","last_fresh":"2020-11-16T20:56:52.795493+0000","last_change":"2020-11-16T20:55:59.611811+0000","last_active":"2020-11-16T20:56:52.795493+0000","last_peered":"2020-11-16T20:56:52.795493+0000","last_clean":"2020-11-16T20:56:52.795493+0000","last_became_active":"2020-11-16T20:55:50.903578+0000","last_became_peered":"2020-11-16T20:55:50.903578+0000","last_unstale":"2020-11-16T20:56:52.795493+0000","last_undegraded":"2020-11-16T20:56:52.795493+0000","last_fullsized":"2020-11-16T20:56:52.795493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.611727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.611727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"89","reported_epoch":"88","state":"active+clean","last_fresh":"2020-11-16T20:56:50.811643+0000","last_change":"2020-11-16T20:56:03.542304+0000","last_active":"2020-11-16T20:56:50.811643+0000","last_peered":"2020-11-16T20:56:50.811643+0000","last_clean":"2020-11-16T20:56:50.811643+0000","last_became_active":"2020-11-16T20:54:53.112038+0000","last_became_peered":"2020-11-16T20:54:53.112038+0000","last_unstale":"2020-11-16T20:56:50.811643+0000","last_undegraded":"2020-11-16T20:56:50.811643+0000","last_fullsized":"2020-11-16T20:56:50.811643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'2","last_scrub_stamp":"2020-11-16T20:56:03.542235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:50.068882+0000","last_clean_scrub_stamp":"2020-11-16T20:56:03.542235+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"88'583","reported_seq":"929","reported_epoch":"88","state":"active+clean","last_fresh":"2020-11-16T20:56:50.937177+0000","last_change":"2020-11-16T20:56:50.826702+0000","last_active":"2020-11-16T20:56:50.937177+0000","last_peered":"2020-11-16T20:56:50.937177+0000","last_clean":"2020-11-16T20:56:50.937177+0000","last_became_active":"2020-11-16T20:55:25.106302+0000","last_became_peered":"2020-11-16T20:55:25.106302+0000","last_unstale":"2020-11-16T20:56:50.937177+0000","last_undegraded":"2020-11-16T20:56:50.937177+0000","last_fullsized":"2020-11-16T20:56:50.937177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'549","last_scrub_stamp":"2020-11-16T20:56:39.880955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:56:39.880955+0000","log_size":583,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":327078387,"num_objects":119,"num_object_clones":3,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":119,"num_whiteouts":0,"num_read":331,"num_read_kb":97294,"num_write":499,"num_write_kb":242804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"f","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"2"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"30","length":"1"},{"start":"33","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":"94","reported_epoch":"88","state":"active+clean","last_fresh":"2020-11-16T20:56:50.811743+0000","last_change":"2020-11-16T20:55:56.657297+0000","last_active":"2020-11-16T20:56:50.811743+0000","last_peered":"2020-11-16T20:56:50.811743+0000","last_clean":"2020-11-16T20:56:50.811743+0000","last_became_active":"2020-11-16T20:55:50.908710+0000","last_became_peered":"2020-11-16T20:55:50.908710+0000","last_unstale":"2020-11-16T20:56:50.811743+0000","last_undegraded":"2020-11-16T20:56:50.811743+0000","last_fullsized":"2020-11-16T20:56:50.811743+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:56.657242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:56.657242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'703","reported_seq":"1093","reported_epoch":"90","state":"active+clean","last_fresh":"2020-11-16T20:56:52.822127+0000","last_change":"2020-11-16T20:56:52.822617+0000","last_active":"2020-11-16T20:56:52.822127+0000","last_peered":"2020-11-16T20:56:52.822127+0000","last_clean":"2020-11-16T20:56:52.822127+0000","last_became_active":"2020-11-16T20:55:24.802649+0000","last_became_peered":"2020-11-16T20:55:24.802649+0000","last_unstale":"2020-11-16T20:56:52.822127+0000","last_undegraded":"2020-11-16T20:56:52.822127+0000","last_fullsized":"2020-11-16T20:56:52.822127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'650","last_scrub_stamp":"2020-11-16T20:56:37.941529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:56:37.941529+0000","log_size":703,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":393479300,"num_objects":139,"num_object_clones":5,"num_object_copies":417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":428,"num_read_kb":157177,"num_write":609,"num_write_kb":272756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"f","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"2"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"30","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"}]},{"pgid":"4.3","version":"88'343","reported_seq":"613","reported_epoch":"90","state":"active+clean","last_fresh":"2020-11-16T20:56:52.822756+0000","last_change":"2020-11-16T20:56:52.823062+0000","last_active":"2020-11-16T20:56:52.822756+0000","last_peered":"2020-11-16T20:56:52.822756+0000","last_clean":"2020-11-16T20:56:52.822756+0000","last_became_active":"2020-11-16T20:55:30.829833+0000","last_became_peered":"2020-11-16T20:55:30.829833+0000","last_unstale":"2020-11-16T20:56:52.822756+0000","last_undegraded":"2020-11-16T20:56:52.822756+0000","last_fullsized":"2020-11-16T20:56:52.822756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":343,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":137390486,"num_objects":48,"num_object_clones":4,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":106,"num_read_kb":62359,"num_write":196,"num_write_kb":35676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":28,"num_flush_kb":80718,"num_evict":16,"num_evict_kb":42731,"num_promote":62,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"f","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"2"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"30","length":"1"},{"start":"33","length":"1"},{"start":"35","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":"94","reported_epoch":"88","state":"active+clean","last_fresh":"2020-11-16T20:56:50.811960+0000","last_change":"2020-11-16T20:55:59.571968+0000","last_active":"2020-11-16T20:56:50.811960+0000","last_peered":"2020-11-16T20:56:50.811960+0000","last_clean":"2020-11-16T20:56:50.811960+0000","last_became_active":"2020-11-16T20:55:50.901014+0000","last_became_peered":"2020-11-16T20:55:50.901014+0000","last_unstale":"2020-11-16T20:56:50.811960+0000","last_undegraded":"2020-11-16T20:56:50.811960+0000","last_fullsized":"2020-11-16T20:56:50.811960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.571892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.571892+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"92","reported_epoch":"87","state":"active+clean","last_fresh":"2020-11-16T20:56:49.813726+0000","last_change":"2020-11-16T20:55:59.950321+0000","last_active":"2020-11-16T20:56:49.813726+0000","last_peered":"2020-11-16T20:56:49.813726+0000","last_clean":"2020-11-16T20:56:49.813726+0000","last_became_active":"2020-11-16T20:55:50.905408+0000","last_became_peered":"2020-11-16T20:55:50.905408+0000","last_unstale":"2020-11-16T20:56:49.813726+0000","last_undegraded":"2020-11-16T20:56:49.813726+0000","last_fullsized":"2020-11-16T20:56:49.813726+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.950219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.950219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"85'306","reported_seq":"563","reported_epoch":"88","state":"active+clean+wait","last_fresh":"2020-11-16T20:56:50.931758+0000","last_change":"2020-11-16T20:56:50.931758+0000","last_active":"2020-11-16T20:56:50.931758+0000","last_peered":"2020-11-16T20:56:50.931758+0000","last_clean":"2020-11-16T20:56:50.931758+0000","last_became_active":"2020-11-16T20:56:47.798651+0000","last_became_peered":"2020-11-16T20:56:47.798651+0000","last_unstale":"2020-11-16T20:56:50.931758+0000","last_undegraded":"2020-11-16T20:56:50.931758+0000","last_fullsized":"2020-11-16T20:56:50.931758+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":306,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114817540,"num_objects":44,"num_object_clones":7,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":2,"num_read":106,"num_read_kb":81904,"num_write":137,"num_write_kb":32051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":63,"num_bytes_recovered":122901039,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":21,"num_flush_kb":58014,"num_evict":12,"num_evict_kb":36936,"num_promote":48,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"f","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"2"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"30","length":"1"},{"start":"33","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":"92","reported_epoch":"87","state":"active+clean","last_fresh":"2020-11-16T20:56:49.812684+0000","last_change":"2020-11-16T20:55:59.645073+0000","last_active":"2020-11-16T20:56:49.812684+0000","last_peered":"2020-11-16T20:56:49.812684+0000","last_clean":"2020-11-16T20:56:49.812684+0000","last_became_active":"2020-11-16T20:55:50.905649+0000","last_became_peered":"2020-11-16T20:55:50.905649+0000","last_unstale":"2020-11-16T20:56:49.812684+0000","last_undegraded":"2020-11-16T20:56:49.812684+0000","last_fullsized":"2020-11-16T20:56:49.812684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.644996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.644996+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"88'307","reported_seq":"666","reported_epoch":"88","state":"active+clean","last_fresh":"2020-11-16T20:56:50.985775+0000","last_change":"2020-11-16T20:56:50.816497+0000","last_active":"2020-11-16T20:56:50.985775+0000","last_peered":"2020-11-16T20:56:50.985775+0000","last_clean":"2020-11-16T20:56:50.985775+0000","last_became_active":"2020-11-16T20:56:16.750108+0000","last_became_peered":"2020-11-16T20:56:16.750108+0000","last_unstale":"2020-11-16T20:56:50.985775+0000","last_undegraded":"2020-11-16T20:56:50.985775+0000","last_fullsized":"2020-11-16T20:56:50.985775+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'266","last_scrub_stamp":"2020-11-16T20:56:42.351294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:56:42.351294+0000","log_size":307,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":125301327,"num_objects":49,"num_object_clones":5,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":3,"num_read":96,"num_read_kb":60595,"num_write":164,"num_write_kb":34018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":91753326,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":27,"num_flush_kb":80621,"num_evict":9,"num_evict_kb":27793,"num_promote":57,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"f","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"2"},{"start":"2b","length":"1"},{"start":"2d","length":"1"},{"start":"30","length":"1"},{"start":"33","length":"1"}]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":492974730,"num_objects":184,"num_object_clones":18,"num_object_copies":552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":9,"num_read":388,"num_read_kb":239042,"num_write":671,"num_write_kb":130934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":214654365,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":106,"num_flush_kb":300267,"num_evict":43,"num_evict_kb":121184,"num_promote":222,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1275142144,"data_stored":1339105413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1296,"ondisk_log_size":1296,"up":12,"acting":12,"num_store_stats":8},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":1401493603,"num_objects":505,"num_object_clones":20,"num_object_copies":1515,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":505,"num_whiteouts":3,"num_read":1383,"num_read_kb":355567,"num_write":2160,"num_write_kb":1003875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":181673084,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2552631296,"data_stored":2574044070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2528,"ondisk_log_size":2528,"up":12,"acting":12,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":18,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125036,"kb_used_data":117412,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94246804,"statfs":{"total":96636764160,"available":96508727296,"internally_reserved":0,"allocated":120229888,"data_stored":127138192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.89300000000000002}]},{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.139}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.0329999999999999}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.2649999999999999}]},{"osd":4,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.1000000000000001}]},{"osd":5,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":1.413},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":1.1839999999999999}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.538},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.589}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":535156,"kb_used_data":516588,"kb_used_omap":0,"kb_used_meta":18560,"kb_avail":93836684,"statfs":{"total":96636764160,"available":96088764416,"internally_reserved":0,"allocated":528986112,"data_stored":547059143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19005440},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.749},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.93999999999999995}]},{"osd":1,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.099},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.64900000000000002}]},{"osd":2,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":1.077}]},{"osd":3,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.054}]},{"osd":4,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.2250000000000001}]},{"osd":5,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.1539999999999999}]},{"osd":7,"last update":"Mon Nov 16 20:55:56 2020","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.526},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.1299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":402588,"kb_used_data":389972,"kb_used_omap":0,"kb_used_meta":12608,"kb_avail":93969252,"statfs":{"total":96636764160,"available":96224514048,"internally_reserved":0,"allocated":399331328,"data_stored":397415236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12910592},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.69799999999999995}]},{"osd":2,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.96599999999999997}]},{"osd":3,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.677,"5min":2.677,"15min":2.677},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.94199999999999995}]},{"osd":4,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.135}]},{"osd":5,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":1.343},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.109}]},{"osd":6,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.498},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.446}]},{"osd":7,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"max":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.806}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":867004,"kb_used_data":846580,"kb_used_omap":0,"kb_used_meta":20416,"kb_avail":93504836,"statfs":{"total":96636764160,"available":95748952064,"internally_reserved":0,"allocated":866897920,"data_stored":886199032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20905984},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.67100000000000004}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.50900000000000001}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.75600000000000001}]},{"osd":4,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.222},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.2609999999999999}]},{"osd":5,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.3819999999999999}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.175},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":1.2809999999999999}]},{"osd":7,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"max":{"1min":1.954,"5min":1.954,"15min":1.954},"last":1.397},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.2}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305700,"kb_used_data":294108,"kb_used_omap":0,"kb_used_meta":11584,"kb_avail":94066140,"statfs":{"total":96636764160,"available":96323727360,"internally_reserved":0,"allocated":301166592,"data_stored":299462597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11862016},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,11],"upper_bound":4096},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.71099999999999997}]},{"osd":1,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.79600000000000004}]},{"osd":3,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.68799999999999994}]},{"osd":4,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.0349999999999999}]},{"osd":5,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.94599999999999995}]},{"osd":6,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.288}]},{"osd":7,"last update":"Mon Nov 16 20:55:52 2020","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.4470000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":542856,"kb_used_data":528384,"kb_used_omap":0,"kb_used_meta":14464,"kb_avail":93828984,"statfs":{"total":96636764160,"available":96080879616,"internally_reserved":0,"allocated":541065216,"data_stored":555414944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14811136},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.5},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.52600000000000002}]},{"osd":1,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.69199999999999995}]},{"osd":2,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.79100000000000004}]},{"osd":4,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.923,"5min":2.923,"15min":2.923},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.968,"5min":2.968,"15min":2.968},"last":0.89300000000000002}]},{"osd":5,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.8479999999999999,"5min":2.8479999999999999,"15min":2.8479999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.92700000000000005}]},{"osd":6,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.859,"5min":2.859,"15min":2.859},"last":1.054},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":3.5390000000000001,"5min":3.5390000000000001,"15min":3.5390000000000001},"last":1.0069999999999999}]},{"osd":7,"last update":"Mon Nov 16 20:55:53 2020","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.036},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.9780000000000002,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":0.99099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":657016,"kb_used_data":642416,"kb_used_omap":0,"kb_used_meta":14592,"kb_avail":93714824,"statfs":{"total":96636764160,"available":95963979776,"internally_reserved":0,"allocated":657833984,"data_stored":675694448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14942208},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.879},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.355}]},{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":1.0369999999999999}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.70499999999999996}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.78700000000000003}]},{"osd":5,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.2589999999999999}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":0.93899999999999995}]},{"osd":7,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":2.4369999999999998,"5min":2.4369999999999998,"15min":2.4369999999999998},"last":1.641},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.2869999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424052,"kb_used_data":410604,"kb_used_omap":0,"kb_used_meta":13440,"kb_avail":93947788,"statfs":{"total":96636764160,"available":96202534912,"internally_reserved":0,"allocated":420458496,"data_stored":428614681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13762560},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.0760000000000001}]},{"osd":1,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.877},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.95799999999999996}]},{"osd":2,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.0389999999999999}]},{"osd":3,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.569},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":1.2649999999999999}]},{"osd":4,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.423},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.1910000000000001}]},{"osd":6,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.847},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.6659999999999999}]},{"osd":7,"last update":"Mon Nov 16 20:55:54 2020","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.7110000000000001},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":1.107,"5min":1.107,"15min":1.107},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.347}]}]}]}} 2020-11-16T20:56:55.135 INFO:tasks.thrashosds.thrasher:Setting 4.3 to [2, 3, 5, 7, 0, 1] 2020-11-16T20:56:55.136 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.3', '2', '3', '5', '7', '0', '1'] 2020-11-16T20:56:55.136 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.3 2 3 5 7 0 1 2020-11-16T20:56:55.161 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:55.166+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:55.168 INFO:tasks.rados.rados.0.smithi166.stdout:876: done (13 left) 2020-11-16T20:56:55.168 INFO:tasks.rados.rados.0.smithi166.stdout:878: done (12 left) 2020-11-16T20:56:55.168 INFO:tasks.rados.rados.0.smithi166.stdout:879: delete oid 424 current snap is 28 2020-11-16T20:56:55.246 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:55.247 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:55.256 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:56:55.262 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:55.268+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:55.363 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:55.369+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:55.431 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:55.431 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:55.440 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:56:55.464 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:55.469+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:55.565 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:55.569+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:55.574 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:55.575 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:55.584 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:56:55.666 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:55.671+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:55.759 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:55.760 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:55.766 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:55.771+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:55.769 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:56:55.824 INFO:teuthology.orchestra.run.smithi166.stderr:nodeep-scrub is unset 2020-11-16T20:56:55.829 INFO:teuthology.orchestra.run.smithi166.stderr:set 4.3 pg_upmap_items mapping to [2->3,5->7,0->1] 2020-11-16T20:56:55.882 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:55.887+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:55.903 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:55.903 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:55.913 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:56:55.997 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:56.002+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:56.069 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:56.074+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:56.078 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:56.078 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:56.088 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:56:56.171 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:56.176+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:56.255 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:56.256 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:56.265 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:56:56.306 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:56.311+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:56.372 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:56.378+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:56.433 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:56.451 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:56.453 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:56:56.496 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:56.501+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:56.575 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:56.580+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:56.620 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:56.621 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:56.630 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:56:56.676 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:56.681+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:56.777 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:56.782+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:56.796 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:56.796 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:56.805 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:56:56.877 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:56.882+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:56.973 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:56.973 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:56.978 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:56:56.983+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:56:56.982 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:56:57.080 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:57.084+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:57.085 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:56:57.110 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:56:57.110 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:56:57.121 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:56:57.203 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:57.209+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:57.231 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:56:57.251 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:56:57.270 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:56:57.280 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:57.286+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:57.291 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:56:57.295 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:57.295 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:56:57.295 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:56:57.295 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:56:57.296 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.296 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:901 3.0 e35/19 3:29e07ad2:::smithi16641208-204:head v 35'134, mlcod=35'132)", 2020-11-16T20:56:57.296 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.128152+0000", 2020-11-16T20:56:57.296 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 63.171202796000003, 2020-11-16T20:56:57.296 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042710120000000002, 2020-11-16T20:56:57.296 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:57.296 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:57.297 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:57.297 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.297 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:57.297 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128152+0000", 2020-11-16T20:56:57.297 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:57.297 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.298 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.299 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:57.299 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128152+0000", 2020-11-16T20:56:57.299 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019783600000000001 2020-11-16T20:56:57.299 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.299 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.299 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:57.299 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128350+0000", 2020-11-16T20:56:57.300 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6030000000000005e-06 2020-11-16T20:56:57.300 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.300 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.300 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:57.300 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128358+0000", 2020-11-16T20:56:57.300 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2595999999999999e-05 2020-11-16T20:56:57.300 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.301 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.301 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:57.301 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128371+0000", 2020-11-16T20:56:57.301 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3209999999999999e-06 2020-11-16T20:56:57.301 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.301 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.301 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:57.301 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128378+0000", 2020-11-16T20:56:57.302 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4047e-05 2020-11-16T20:56:57.302 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.302 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.302 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:57.302 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128422+0000", 2020-11-16T20:56:57.302 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9796000000000001e-05 2020-11-16T20:56:57.302 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.303 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.303 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:57.303 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.128452+0000", 2020-11-16T20:56:57.303 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039150929999999997 2020-11-16T20:56:57.303 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.303 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.303 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:57.304 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.132367+0000", 2020-11-16T20:56:57.304 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5720000000000002e-05 2020-11-16T20:56:57.304 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.304 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.304 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:57.304 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.132423+0000", 2020-11-16T20:56:57.304 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042710120000000002 2020-11-16T20:56:57.304 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.305 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:57.305 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.305 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.305 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.305 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1028 3.0 e35/19 3:2e3eb594:::smithi16641208-229:head v 35'159, mlcod=35'157)", 2020-11-16T20:56:57.305 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.635550+0000", 2020-11-16T20:56:57.305 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 62.663804354, 2020-11-16T20:56:57.306 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042338380000000002, 2020-11-16T20:56:57.306 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:57.306 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:57.306 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:57.306 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.306 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:57.306 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635550+0000", 2020-11-16T20:56:57.307 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:57.307 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.307 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.307 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:57.307 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635550+0000", 2020-11-16T20:56:57.307 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018653699999999999 2020-11-16T20:56:57.307 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.307 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.308 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:57.308 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635737+0000", 2020-11-16T20:56:57.308 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.037e-06 2020-11-16T20:56:57.308 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.308 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.308 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:57.308 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635746+0000", 2020-11-16T20:56:57.309 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3001e-05 2020-11-16T20:56:57.309 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.309 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.309 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:57.309 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635759+0000", 2020-11-16T20:56:57.309 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7740000000000004e-06 2020-11-16T20:56:57.309 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.310 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.310 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:57.310 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635767+0000", 2020-11-16T20:56:57.310 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1385999999999999e-05 2020-11-16T20:56:57.310 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.310 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.310 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:57.310 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635818+0000", 2020-11-16T20:56:57.311 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6427e-05 2020-11-16T20:56:57.311 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.311 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.311 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:57.311 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.635845+0000", 2020-11-16T20:56:57.311 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003885164 2020-11-16T20:56:57.311 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.312 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.312 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:57.312 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.639730+0000", 2020-11-16T20:56:57.312 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4512000000000003e-05 2020-11-16T20:56:57.312 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.312 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.312 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:57.313 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.639784+0000", 2020-11-16T20:56:57.313 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042338380000000002 2020-11-16T20:56:57.313 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.313 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:57.313 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.313 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.313 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1102 3.0 e35/19 3:1c1ecb34:::smithi16641208-245:head v 35'172, mlcod=35'170)", 2020-11-16T20:56:57.314 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.920148+0000", 2020-11-16T20:56:57.314 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 62.379206469000003, 2020-11-16T20:56:57.314 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053854699999999998, 2020-11-16T20:56:57.314 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:57.314 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:57.314 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:57.314 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.315 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:57.315 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920148+0000", 2020-11-16T20:56:57.315 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:57.315 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.315 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.315 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:57.315 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920148+0000", 2020-11-16T20:56:57.315 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019421400000000001 2020-11-16T20:56:57.316 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.316 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.316 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:57.316 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920342+0000", 2020-11-16T20:56:57.316 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6169999999999996e-06 2020-11-16T20:56:57.316 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.316 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.317 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:57.317 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920352+0000", 2020-11-16T20:56:57.317 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3684e-05 2020-11-16T20:56:57.317 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.317 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.317 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:57.317 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920366+0000", 2020-11-16T20:56:57.317 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7789999999999996e-06 2020-11-16T20:56:57.318 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.318 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.318 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:57.318 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920374+0000", 2020-11-16T20:56:57.318 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8783999999999995e-05 2020-11-16T20:56:57.318 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.318 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.319 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:57.319 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920472+0000", 2020-11-16T20:56:57.319 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6865000000000001e-05 2020-11-16T20:56:57.319 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.319 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.319 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:57.319 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.920499+0000", 2020-11-16T20:56:57.320 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004975246 2020-11-16T20:56:57.320 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.320 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.320 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:57.320 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.925474+0000", 2020-11-16T20:56:57.320 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9280999999999997e-05 2020-11-16T20:56:57.320 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.320 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.321 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:57.321 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.925534+0000", 2020-11-16T20:56:57.321 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053854699999999998 2020-11-16T20:56:57.321 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.321 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:57.321 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.321 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.322 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.322 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1235 3.0 e35/19 3:2294fced:::smithi16641208-278:head v 35'188, mlcod=35'185)", 2020-11-16T20:56:57.322 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.354799+0000", 2020-11-16T20:56:57.322 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 61.944555356000002, 2020-11-16T20:56:57.322 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050791389999999999, 2020-11-16T20:56:57.322 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:57.322 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:57.323 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:57.323 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.323 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:57.323 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354799+0000", 2020-11-16T20:56:57.323 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:57.323 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.323 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.323 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:57.324 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354799+0000", 2020-11-16T20:56:57.324 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2141000000000002e-05 2020-11-16T20:56:57.324 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.324 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.324 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:57.324 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354842+0000", 2020-11-16T20:56:57.324 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.601e-06 2020-11-16T20:56:57.325 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.325 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.325 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:57.325 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354848+0000", 2020-11-16T20:56:57.325 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.028e-05 2020-11-16T20:56:57.325 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.325 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.326 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:57.326 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354858+0000", 2020-11-16T20:56:57.326 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2959999999999998e-06 2020-11-16T20:56:57.326 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.326 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.326 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:57.326 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354864+0000", 2020-11-16T20:56:57.326 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3279999999999999e-05 2020-11-16T20:56:57.327 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.327 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.327 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:57.327 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354907+0000", 2020-11-16T20:56:57.327 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3655e-05 2020-11-16T20:56:57.327 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.327 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.328 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:57.328 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.354931+0000", 2020-11-16T20:56:57.328 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004888875 2020-11-16T20:56:57.328 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.328 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.328 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:57.328 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.359820+0000", 2020-11-16T20:56:57.328 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9011000000000001e-05 2020-11-16T20:56:57.329 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.329 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.329 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:57.329 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.359879+0000", 2020-11-16T20:56:57.329 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050791389999999999 2020-11-16T20:56:57.329 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.329 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:57.330 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.330 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.330 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.330 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1237 3.0 e35/19 3:0b7cd9c0:::smithi16641208-279:head v 35'189, mlcod=35'187)", 2020-11-16T20:56:57.330 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:55.361967+0000", 2020-11-16T20:56:57.330 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 61.937388114000001, 2020-11-16T20:56:57.330 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041733320000000001, 2020-11-16T20:56:57.331 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:57.331 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:57.331 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:57.331 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.331 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:57.331 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.361967+0000", 2020-11-16T20:56:57.331 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:57.331 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.332 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.332 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:57.332 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.361967+0000", 2020-11-16T20:56:57.332 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045453300000000002 2020-11-16T20:56:57.332 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.332 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.332 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:57.333 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362421+0000", 2020-11-16T20:56:57.333 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1178999999999999e-05 2020-11-16T20:56:57.333 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.333 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.333 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:57.333 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362432+0000", 2020-11-16T20:56:57.333 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5865000000000001e-05 2020-11-16T20:56:57.333 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.334 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.334 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:57.334 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362448+0000", 2020-11-16T20:56:57.334 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9809999999999992e-06 2020-11-16T20:56:57.334 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.334 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.334 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:57.335 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362457+0000", 2020-11-16T20:56:57.335 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9304e-05 2020-11-16T20:56:57.335 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:57.335 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362516+0000", 2020-11-16T20:56:57.335 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2886000000000003e-05 2020-11-16T20:56:57.335 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.336 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.336 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:57.336 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.362549+0000", 2020-11-16T20:56:57.336 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035249809999999999 2020-11-16T20:56:57.336 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.336 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.336 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:57.337 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.366074+0000", 2020-11-16T20:56:57.337 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5603000000000002e-05 2020-11-16T20:56:57.337 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.337 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.337 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:57.337 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:55.366140+0000", 2020-11-16T20:56:57.337 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041733320000000001 2020-11-16T20:56:57.338 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.338 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:57.338 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.338 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.338 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.338 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1468 3.0 e36/19 3:1852173c:::smithi16641208-329:head v 36'238, mlcod=36'236)", 2020-11-16T20:56:57.338 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.208167+0000", 2020-11-16T20:56:57.338 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 61.091187949999998, 2020-11-16T20:56:57.339 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052481979999999999, 2020-11-16T20:56:57.339 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:57.339 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:57.339 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:57.339 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.339 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:57.339 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208167+0000", 2020-11-16T20:56:57.340 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:57.340 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.340 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.340 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:57.340 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208167+0000", 2020-11-16T20:56:57.340 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013521900000000001 2020-11-16T20:56:57.340 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.340 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.341 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:57.341 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208302+0000", 2020-11-16T20:56:57.341 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1307e-05 2020-11-16T20:56:57.341 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.341 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.341 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:57.341 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208313+0000", 2020-11-16T20:56:57.342 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2828e-05 2020-11-16T20:56:57.342 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.342 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.342 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:57.342 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208326+0000", 2020-11-16T20:56:57.342 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8889999999999996e-06 2020-11-16T20:56:57.342 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.343 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.343 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:57.343 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208333+0000", 2020-11-16T20:56:57.343 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2843999999999999e-05 2020-11-16T20:56:57.343 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.343 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.343 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:57.343 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208366+0000", 2020-11-16T20:56:57.344 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4986e-05 2020-11-16T20:56:57.344 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.344 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.344 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:57.344 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.208381+0000", 2020-11-16T20:56:57.344 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0049810990000000001 2020-11-16T20:56:57.344 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.345 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.345 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:57.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.213362+0000", 2020-11-16T20:56:57.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3025999999999997e-05 2020-11-16T20:56:57.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.345 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.345 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:57.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.213415+0000", 2020-11-16T20:56:57.346 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052481979999999999 2020-11-16T20:56:57.346 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.346 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:57.346 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.346 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.346 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.346 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:1490 3.0 e36/19 3:10845e0e:::smithi16641208-333:head v 36'252, mlcod=36'250)", 2020-11-16T20:56:57.347 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:56.301912+0000", 2020-11-16T20:56:57.347 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 60.997442948, 2020-11-16T20:56:57.347 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044835179999999997, 2020-11-16T20:56:57.347 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:57.347 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:57.347 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:57.347 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.348 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:57.348 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.301912+0000", 2020-11-16T20:56:57.348 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:57.348 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.348 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.348 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:57.348 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.301912+0000", 2020-11-16T20:56:57.348 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114265 2020-11-16T20:56:57.349 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.349 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.349 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:57.349 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302026+0000", 2020-11-16T20:56:57.349 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7940000000000008e-06 2020-11-16T20:56:57.349 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.350 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:57.350 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302035+0000", 2020-11-16T20:56:57.350 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5187e-05 2020-11-16T20:56:57.350 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.350 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:57.350 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302050+0000", 2020-11-16T20:56:57.351 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.653e-06 2020-11-16T20:56:57.351 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.351 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.351 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:57.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302059+0000", 2020-11-16T20:56:57.351 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8010000000000003e-05 2020-11-16T20:56:57.351 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.352 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:57.352 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302107+0000", 2020-11-16T20:56:57.352 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5335000000000001e-05 2020-11-16T20:56:57.352 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.352 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:57.352 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.302132+0000", 2020-11-16T20:56:57.353 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042049239999999996 2020-11-16T20:56:57.353 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.353 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.353 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:57.353 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.306337+0000", 2020-11-16T20:56:57.353 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8350000000000002e-05 2020-11-16T20:56:57.353 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.354 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.354 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:57.354 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:56.306395+0000", 2020-11-16T20:56:57.354 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044835179999999997 2020-11-16T20:56:57.354 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.354 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:57.354 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.355 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.355 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.355 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:534 3.0 e46/19 3:10845e0e:::smithi16641208-333:5 v 46'391, mlcod=45'385)", 2020-11-16T20:56:57.355 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.013124+0000", 2020-11-16T20:56:57.355 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 48.286230375999999, 2020-11-16T20:56:57.355 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050053900000000002, 2020-11-16T20:56:57.355 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:57.355 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:57.356 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:57.356 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.356 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:57.356 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013124+0000", 2020-11-16T20:56:57.356 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:57.356 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.356 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.357 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:57.357 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013124+0000", 2020-11-16T20:56:57.357 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9255999999999997e-05 2020-11-16T20:56:57.357 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.357 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.357 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:57.357 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013174+0000", 2020-11-16T20:56:57.357 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5140000000000004e-06 2020-11-16T20:56:57.358 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.358 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.358 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:57.358 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013181+0000", 2020-11-16T20:56:57.358 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1279e-05 2020-11-16T20:56:57.358 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.358 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.359 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:57.359 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013192+0000", 2020-11-16T20:56:57.359 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0970000000000002e-06 2020-11-16T20:56:57.359 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.359 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.359 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:57.359 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013199+0000", 2020-11-16T20:56:57.360 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5442e-05 2020-11-16T20:56:57.360 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.360 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.360 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:57.360 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013284+0000", 2020-11-16T20:56:57.360 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8368e-05 2020-11-16T20:56:57.360 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.360 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.361 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:57.361 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.013312+0000", 2020-11-16T20:56:57.361 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0047640549999999997 2020-11-16T20:56:57.361 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.361 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.361 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:57.361 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.018076+0000", 2020-11-16T20:56:57.362 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3378999999999998e-05 2020-11-16T20:56:57.362 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.362 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.362 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:57.362 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.018130+0000", 2020-11-16T20:56:57.362 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050053900000000002 2020-11-16T20:56:57.362 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.363 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:57.363 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.363 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.363 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.363 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:553 3.0 e51/19 3:0980614a:::smithi16641208-158:d v 51'399, mlcod=48'395)", 2020-11-16T20:56:57.363 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.036559+0000", 2020-11-16T20:56:57.363 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 43.262795314999998, 2020-11-16T20:56:57.363 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0057593829999999999, 2020-11-16T20:56:57.364 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:57.364 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:57.364 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:57.364 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.364 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:57.364 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036559+0000", 2020-11-16T20:56:57.364 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:57.365 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.365 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.365 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:57.365 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036559+0000", 2020-11-16T20:56:57.365 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3611000000000001e-05 2020-11-16T20:56:57.365 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.365 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.366 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:57.366 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036593+0000", 2020-11-16T20:56:57.366 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6789999999999996e-06 2020-11-16T20:56:57.366 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.366 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.366 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:57.366 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036598+0000", 2020-11-16T20:56:57.366 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1350000000000003e-06 2020-11-16T20:56:57.367 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.367 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.367 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:57.367 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036605+0000", 2020-11-16T20:56:57.367 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5200000000000003e-06 2020-11-16T20:56:57.367 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.367 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.368 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:57.368 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036611+0000", 2020-11-16T20:56:57.368 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1322000000000001e-05 2020-11-16T20:56:57.368 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.368 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.368 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:57.368 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036663+0000", 2020-11-16T20:56:57.368 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8333000000000001e-05 2020-11-16T20:56:57.369 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.369 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.369 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:57.369 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.036691+0000", 2020-11-16T20:56:57.369 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0055720800000000001 2020-11-16T20:56:57.369 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.369 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.370 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:57.370 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.042263+0000", 2020-11-16T20:56:57.370 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5702999999999998e-05 2020-11-16T20:56:57.370 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.370 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.370 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:57.370 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.042319+0000", 2020-11-16T20:56:57.371 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0057593829999999999 2020-11-16T20:56:57.371 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.371 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:57.371 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.371 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.371 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.371 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:556 3.0 e51/19 3:03c93966:::smithi16641208-422:e v 51'401, mlcod=48'395)", 2020-11-16T20:56:57.371 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.037559+0000", 2020-11-16T20:56:57.372 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 43.261795610999997, 2020-11-16T20:56:57.372 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052553039999999997, 2020-11-16T20:56:57.372 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:57.372 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:57.372 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:57.372 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.372 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:57.373 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037559+0000", 2020-11-16T20:56:57.373 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:57.373 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.373 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.373 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:57.373 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037559+0000", 2020-11-16T20:56:57.373 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2685999999999998e-05 2020-11-16T20:56:57.373 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.374 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.374 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:57.374 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037592+0000", 2020-11-16T20:56:57.374 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1830000000000002e-06 2020-11-16T20:56:57.374 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.374 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.374 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:57.375 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037597+0000", 2020-11-16T20:56:57.375 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0809999999999996e-06 2020-11-16T20:56:57.375 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.375 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.375 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:57.375 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037604+0000", 2020-11-16T20:56:57.375 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.361e-06 2020-11-16T20:56:57.376 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.376 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.376 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:57.376 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.037609+0000", 2020-11-16T20:56:57.376 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00041286099999999999 2020-11-16T20:56:57.376 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.376 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.376 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:57.377 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.038022+0000", 2020-11-16T20:56:57.377 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4833000000000001e-05 2020-11-16T20:56:57.377 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.377 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.377 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:57.377 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.038047+0000", 2020-11-16T20:56:57.377 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0047145110000000002 2020-11-16T20:56:57.378 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.378 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.378 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:57.378 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.042762+0000", 2020-11-16T20:56:57.378 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2787999999999997e-05 2020-11-16T20:56:57.378 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.378 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.379 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:57.379 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.042814+0000", 2020-11-16T20:56:57.379 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052553039999999997 2020-11-16T20:56:57.379 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.379 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:57.379 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.379 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.379 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.380 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:559 3.0 e52/19 3:0980614a:::smithi16641208-158:d v 52'405, mlcod=51'401)", 2020-11-16T20:56:57.380 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:15.014239+0000", 2020-11-16T20:56:57.380 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 42.285115738000002, 2020-11-16T20:56:57.380 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0060540699999999999, 2020-11-16T20:56:57.380 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:57.380 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:57.380 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:57.381 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.381 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:57.381 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014239+0000", 2020-11-16T20:56:57.381 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:57.381 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.381 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.381 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:57.381 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014239+0000", 2020-11-16T20:56:57.382 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1819000000000001e-05 2020-11-16T20:56:57.382 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.382 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:57.382 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014281+0000", 2020-11-16T20:56:57.382 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6719999999999998e-06 2020-11-16T20:56:57.382 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.383 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.383 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:57.383 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014288+0000", 2020-11-16T20:56:57.383 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0564000000000001e-05 2020-11-16T20:56:57.383 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.383 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.383 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:57.384 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014298+0000", 2020-11-16T20:56:57.384 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1902000000000001e-05 2020-11-16T20:56:57.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.384 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:57.384 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014310+0000", 2020-11-16T20:56:57.384 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4212999999999997e-05 2020-11-16T20:56:57.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.385 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.385 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:57.385 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014364+0000", 2020-11-16T20:56:57.385 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9425e-05 2020-11-16T20:56:57.385 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.385 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.385 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:57.386 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.014394+0000", 2020-11-16T20:56:57.386 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0058527630000000004 2020-11-16T20:56:57.386 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.386 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.386 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:57.386 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.020246+0000", 2020-11-16T20:56:57.386 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6712000000000003e-05 2020-11-16T20:56:57.386 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.387 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.387 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:57.387 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.020293+0000", 2020-11-16T20:56:57.387 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0060540699999999999 2020-11-16T20:56:57.387 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.387 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:57.387 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.388 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.388 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:561 3.0 e52/19 3:03c93966:::smithi16641208-422:e v 52'407, mlcod=51'401)", 2020-11-16T20:56:57.388 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:15.015143+0000", 2020-11-16T20:56:57.388 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 42.284211517000003, 2020-11-16T20:56:57.388 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0073835719999999997, 2020-11-16T20:56:57.388 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:57.389 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:57.389 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:57.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.389 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:57.389 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015143+0000", 2020-11-16T20:56:57.389 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:57.389 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.390 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:57.390 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015143+0000", 2020-11-16T20:56:57.390 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4036999999999999e-05 2020-11-16T20:56:57.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.390 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.390 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:57.390 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015187+0000", 2020-11-16T20:56:57.391 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8350000000000004e-06 2020-11-16T20:56:57.391 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.391 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:57.391 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015195+0000", 2020-11-16T20:56:57.391 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1216999999999999e-05 2020-11-16T20:56:57.391 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.392 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:57.392 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015206+0000", 2020-11-16T20:56:57.392 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9390000000000002e-06 2020-11-16T20:56:57.392 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.392 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.392 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:57.392 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015212+0000", 2020-11-16T20:56:57.393 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.066e-05 2020-11-16T20:56:57.393 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.393 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.393 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:57.393 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015253+0000", 2020-11-16T20:56:57.393 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1534000000000001e-05 2020-11-16T20:56:57.393 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.393 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.394 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:57.394 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.015274+0000", 2020-11-16T20:56:57.394 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0072086629999999997 2020-11-16T20:56:57.394 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.394 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.394 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:57.394 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.022483+0000", 2020-11-16T20:56:57.395 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3686999999999997e-05 2020-11-16T20:56:57.395 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.395 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.395 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:57.395 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:15.022527+0000", 2020-11-16T20:56:57.395 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0073835719999999997 2020-11-16T20:56:57.395 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.396 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:57.396 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.396 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.396 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.396 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2604 3.0 e57/19 3:2294fced:::smithi16641208-278:head v 57'440, mlcod=57'436)", 2020-11-16T20:56:57.396 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.930849+0000", 2020-11-16T20:56:57.396 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 37.368505751999997, 2020-11-16T20:56:57.396 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054406599999999999, 2020-11-16T20:56:57.397 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:57.397 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:57.397 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:57.397 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.397 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:57.397 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.930849+0000", 2020-11-16T20:56:57.397 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:57.398 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.398 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.398 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:57.398 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.930849+0000", 2020-11-16T20:56:57.398 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000849838 2020-11-16T20:56:57.398 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.398 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.398 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:57.399 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.931699+0000", 2020-11-16T20:56:57.399 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2410000000000001e-06 2020-11-16T20:56:57.399 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.399 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.399 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:57.399 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.931708+0000", 2020-11-16T20:56:57.399 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.764e-06 2020-11-16T20:56:57.400 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.400 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.400 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:57.400 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.931718+0000", 2020-11-16T20:56:57.400 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2930000000000003e-06 2020-11-16T20:56:57.400 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.400 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.401 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:57.401 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.931725+0000", 2020-11-16T20:56:57.401 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0489999999999999e-05 2020-11-16T20:56:57.401 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.401 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.401 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:57.401 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.931786+0000", 2020-11-16T20:56:57.401 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8841000000000001e-05 2020-11-16T20:56:57.402 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.402 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.402 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:57.402 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.931814+0000", 2020-11-16T20:56:57.402 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044240770000000002 2020-11-16T20:56:57.402 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.402 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.403 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:57.403 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.936239+0000", 2020-11-16T20:56:57.403 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1116000000000003e-05 2020-11-16T20:56:57.403 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.403 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.403 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:57.403 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.936290+0000", 2020-11-16T20:56:57.404 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054406599999999999 2020-11-16T20:56:57.404 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.404 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:57.404 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.404 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.404 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.404 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:730 3.0 e82/66 3:2294fced:::smithi16641208-278:14 v 82'546, mlcod=82'542)", 2020-11-16T20:56:57.404 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.758635+0000", 2020-11-16T20:56:57.405 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 12.540719251000001, 2020-11-16T20:56:57.405 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061572399999999996, 2020-11-16T20:56:57.405 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:57.405 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:57.405 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:57.405 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.405 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:57.406 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.758635+0000", 2020-11-16T20:56:57.406 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:57.406 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.406 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.406 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:57.406 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.758635+0000", 2020-11-16T20:56:57.406 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4821999999999999e-05 2020-11-16T20:56:57.406 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.407 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.407 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:57.407 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.758680+0000", 2020-11-16T20:56:57.407 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.5219999999999996e-06 2020-11-16T20:56:57.407 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.407 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.407 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:57.408 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.758690+0000", 2020-11-16T20:56:57.408 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6467e-05 2020-11-16T20:56:57.408 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.408 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.408 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:57.408 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.758706+0000", 2020-11-16T20:56:57.408 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8881999999999999e-05 2020-11-16T20:56:57.408 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.409 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.409 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:57.409 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.758735+0000", 2020-11-16T20:56:57.409 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3925999999999997e-05 2020-11-16T20:56:57.409 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.409 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.409 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:57.410 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.758799+0000", 2020-11-16T20:56:57.410 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9947e-05 2020-11-16T20:56:57.410 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.410 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.410 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:57.410 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.758829+0000", 2020-11-16T20:56:57.410 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0058938139999999998 2020-11-16T20:56:57.411 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.411 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.411 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:57.411 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.764723+0000", 2020-11-16T20:56:57.411 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9859999999999999e-05 2020-11-16T20:56:57.411 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.411 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.411 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:57.412 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.764793+0000", 2020-11-16T20:56:57.412 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061572399999999996 2020-11-16T20:56:57.412 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.412 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:57.412 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.412 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.412 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.413 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:731 3.0 e82/66 3:26512967:::smithi16641208-466:23 v 82'548, mlcod=82'542)", 2020-11-16T20:56:57.413 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.759542+0000", 2020-11-16T20:56:57.413 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 12.539812916000001, 2020-11-16T20:56:57.413 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0055834719999999999, 2020-11-16T20:56:57.413 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:57.413 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:57.413 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:57.413 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.414 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:57.414 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759542+0000", 2020-11-16T20:56:57.414 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:57.414 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.414 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.414 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:57.414 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759542+0000", 2020-11-16T20:56:57.415 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6737000000000002e-05 2020-11-16T20:56:57.415 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.415 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.415 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:57.415 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759569+0000", 2020-11-16T20:56:57.415 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0726e-05 2020-11-16T20:56:57.415 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.416 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.416 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:57.416 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759579+0000", 2020-11-16T20:56:57.416 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.117e-05 2020-11-16T20:56:57.416 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.416 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.416 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:57.416 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759590+0000", 2020-11-16T20:56:57.417 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8179999999999998e-06 2020-11-16T20:56:57.417 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.417 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.417 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:57.417 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759597+0000", 2020-11-16T20:56:57.417 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019832300000000001 2020-11-16T20:56:57.417 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.418 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.418 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:57.418 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759796+0000", 2020-11-16T20:56:57.418 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4968e-05 2020-11-16T20:56:57.418 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.418 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.418 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:57.418 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759841+0000", 2020-11-16T20:56:57.419 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052313209999999997 2020-11-16T20:56:57.419 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.419 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.419 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:57.419 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.765072+0000", 2020-11-16T20:56:57.419 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3409000000000003e-05 2020-11-16T20:56:57.419 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.420 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.420 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:57.420 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.765125+0000", 2020-11-16T20:56:57.420 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0055834719999999999 2020-11-16T20:56:57.420 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.420 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:57.420 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.420 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.421 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.421 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:740 3.0 e82/66 3:10c8e08d:::smithi16641208-23:1d v 82'554, mlcod=82'550)", 2020-11-16T20:56:57.421 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.790318+0000", 2020-11-16T20:56:57.421 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 12.509037123000001, 2020-11-16T20:56:57.421 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0048854110000000001, 2020-11-16T20:56:57.421 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:57.421 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:57.422 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:57.422 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.422 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:57.422 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790318+0000", 2020-11-16T20:56:57.422 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:57.422 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.422 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.423 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:57.423 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790318+0000", 2020-11-16T20:56:57.423 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7818000000000002e-05 2020-11-16T20:56:57.423 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.423 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.423 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:57.423 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790365+0000", 2020-11-16T20:56:57.423 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3859999999999996e-06 2020-11-16T20:56:57.424 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.424 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.424 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:57.424 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790375+0000", 2020-11-16T20:56:57.424 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3345e-05 2020-11-16T20:56:57.424 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.424 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.425 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:57.425 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790388+0000", 2020-11-16T20:56:57.425 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8689999999999993e-06 2020-11-16T20:56:57.425 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.425 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.425 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:57.425 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790397+0000", 2020-11-16T20:56:57.425 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0379e-05 2020-11-16T20:56:57.426 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.426 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.426 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:57.426 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790447+0000", 2020-11-16T20:56:57.426 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3439000000000003e-05 2020-11-16T20:56:57.426 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.426 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.427 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:57.427 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790481+0000", 2020-11-16T20:56:57.427 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0046606199999999999 2020-11-16T20:56:57.427 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.427 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.427 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:57.427 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.795141+0000", 2020-11-16T20:56:57.427 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1555000000000003e-05 2020-11-16T20:56:57.428 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.428 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.428 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:57.428 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.795203+0000", 2020-11-16T20:56:57.428 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0048854110000000001 2020-11-16T20:56:57.428 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.428 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:57.429 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.429 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.429 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.429 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4201.0:4 2.1 2.3e6a8311 (undecoded) ondisk+read+known_if_redirected e31)", 2020-11-16T20:56:57.429 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.118498+0000", 2020-11-16T20:56:57.429 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.1808570199999995, 2020-11-16T20:56:57.429 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0047454460000000004, 2020-11-16T20:56:57.430 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:57.430 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:56:57.430 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:57.430 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4201", 2020-11-16T20:56:57.430 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.59:0/1179787522", 2020-11-16T20:56:57.430 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4 2020-11-16T20:56:57.430 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.430 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:57.431 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.431 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:57.431 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.118498+0000", 2020-11-16T20:56:57.431 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:57.431 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.431 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.431 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:57.432 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.118498+0000", 2020-11-16T20:56:57.432 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5562999999999999e-05 2020-11-16T20:56:57.432 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.432 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.432 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:57.432 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.118523+0000", 2020-11-16T20:56:57.432 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8754e-05 2020-11-16T20:56:57.432 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.433 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.433 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:57.433 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.118542+0000", 2020-11-16T20:56:57.433 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5423000000000001e-05 2020-11-16T20:56:57.433 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.433 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.433 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:57.434 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.118557+0000", 2020-11-16T20:56:57.434 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.084e-05 2020-11-16T20:56:57.434 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.434 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.434 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:57.434 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.118568+0000", 2020-11-16T20:56:57.434 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0046516040000000002 2020-11-16T20:56:57.435 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.435 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.435 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:57.435 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.123220+0000", 2020-11-16T20:56:57.435 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3261999999999999e-05 2020-11-16T20:56:57.435 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.435 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.435 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:57.436 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.123243+0000", 2020-11-16T20:56:57.436 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0047454460000000004 2020-11-16T20:56:57.436 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.436 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:57.436 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.436 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.436 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.437 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:755 3.0 e91/66 3:055e14cb:::smithi16641208-187:25 v 91'574, mlcod=82'570)", 2020-11-16T20:56:57.437 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.832261+0000", 2020-11-16T20:56:57.437 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.4670935759999999, 2020-11-16T20:56:57.437 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054882400000000001, 2020-11-16T20:56:57.437 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:57.437 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:57.437 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:57.437 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.438 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:57.438 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.832261+0000", 2020-11-16T20:56:57.438 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:57.438 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.438 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.438 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:57.438 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.832261+0000", 2020-11-16T20:56:57.439 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1686000000000005e-05 2020-11-16T20:56:57.439 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.439 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.439 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:57.439 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.832323+0000", 2020-11-16T20:56:57.439 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9750000000000007e-06 2020-11-16T20:56:57.439 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.440 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.440 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:57.440 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.832331+0000", 2020-11-16T20:56:57.440 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2317000000000001e-05 2020-11-16T20:56:57.440 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.440 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.440 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:57.440 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.832343+0000", 2020-11-16T20:56:57.441 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6670000000000002e-06 2020-11-16T20:56:57.441 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.441 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.441 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:57.441 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.832352+0000", 2020-11-16T20:56:57.441 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019020800000000001 2020-11-16T20:56:57.441 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.442 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.442 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:57.442 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.832542+0000", 2020-11-16T20:56:57.442 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3923000000000001e-05 2020-11-16T20:56:57.442 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.442 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.442 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:57.442 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.832566+0000", 2020-11-16T20:56:57.443 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0051334600000000003 2020-11-16T20:56:57.443 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.443 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.443 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:57.443 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.837699+0000", 2020-11-16T20:56:57.443 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0003999999999998e-05 2020-11-16T20:56:57.443 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.444 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.444 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:57.444 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.837749+0000", 2020-11-16T20:56:57.444 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054882400000000001 2020-11-16T20:56:57.444 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.444 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:57.444 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.444 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.445 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.445 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:757 3.0 e91/66 3:1f4e8cfe:::smithi16641208-390:27 v 91'576, mlcod=82'570)", 2020-11-16T20:56:57.445 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.834343+0000", 2020-11-16T20:56:57.445 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.4650119639999999, 2020-11-16T20:56:57.445 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0047081600000000003, 2020-11-16T20:56:57.445 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:57.445 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:57.446 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:57.446 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.446 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:57.446 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.834343+0000", 2020-11-16T20:56:57.446 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:57.446 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.446 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.447 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:57.447 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.834343+0000", 2020-11-16T20:56:57.447 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7386999999999999e-05 2020-11-16T20:56:57.447 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.447 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.447 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:57.447 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.834390+0000", 2020-11-16T20:56:57.447 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0280000000000006e-06 2020-11-16T20:56:57.448 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.448 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.448 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:57.448 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.834399+0000", 2020-11-16T20:56:57.448 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1005000000000001e-05 2020-11-16T20:56:57.448 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.448 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.449 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:57.449 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.834410+0000", 2020-11-16T20:56:57.449 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.878e-06 2020-11-16T20:56:57.449 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.449 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.449 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:57.449 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.834417+0000", 2020-11-16T20:56:57.449 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00061185000000000005 2020-11-16T20:56:57.450 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.450 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.450 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:57.450 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.835029+0000", 2020-11-16T20:56:57.450 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8438000000000001e-05 2020-11-16T20:56:57.450 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.450 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.451 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:57.451 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.835057+0000", 2020-11-16T20:56:57.451 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039053569999999999 2020-11-16T20:56:57.451 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.451 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.451 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:57.451 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.838963+0000", 2020-11-16T20:56:57.451 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8216999999999999e-05 2020-11-16T20:56:57.452 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.452 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.452 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:57.452 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.839051+0000", 2020-11-16T20:56:57.452 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0047081600000000003 2020-11-16T20:56:57.452 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.452 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:57.453 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.453 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.453 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.453 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.1.0:760 3.0 e91/66 3:3297596a:::smithi16641208-146:2b v 91'580, mlcod=91'574)", 2020-11-16T20:56:57.453 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.847764+0000", 2020-11-16T20:56:57.453 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.451590886, 2020-11-16T20:56:57.453 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0055739769999999999, 2020-11-16T20:56:57.453 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:57.454 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:57.454 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:57.454 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.454 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:57.454 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.847764+0000", 2020-11-16T20:56:57.454 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:57.454 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.455 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.455 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:57.455 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.847764+0000", 2020-11-16T20:56:57.455 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4780000000000002e-05 2020-11-16T20:56:57.455 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.455 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.455 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:57.456 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.847809+0000", 2020-11-16T20:56:57.456 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4230000000000005e-06 2020-11-16T20:56:57.456 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.456 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.456 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:57.456 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.847817+0000", 2020-11-16T20:56:57.456 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1426e-05 2020-11-16T20:56:57.456 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.457 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.457 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:57.457 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.847828+0000", 2020-11-16T20:56:57.457 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3729999999999998e-06 2020-11-16T20:56:57.457 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.457 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.457 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:57.458 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.847835+0000", 2020-11-16T20:56:57.458 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00164748 2020-11-16T20:56:57.458 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.458 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.458 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:57.458 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849482+0000", 2020-11-16T20:56:57.458 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8257000000000001e-05 2020-11-16T20:56:57.458 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.459 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.459 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:57.459 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849511+0000", 2020-11-16T20:56:57.459 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037660430000000002 2020-11-16T20:56:57.459 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.459 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.459 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:57.460 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.853277+0000", 2020-11-16T20:56:57.460 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1194999999999999e-05 2020-11-16T20:56:57.460 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:57.460 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:57.460 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:57.460 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.853338+0000", 2020-11-16T20:56:57.460 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0055739769999999999 2020-11-16T20:56:57.460 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.461 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:57.461 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.461 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:57.461 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:57.461 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:57.463 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:56:57.464 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:56:57.464 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:56:57.464 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:56:57.464 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:56:57.464 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:56:57.464 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:56:57.465 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:56:57.465 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:56:57.465 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:56:57.465 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:56:57.465 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:56:57.465 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:56:57.466 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:57.467+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:57.563 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:57.568+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:57.629 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:57.629 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:57.629 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:56:57.629 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:57.639 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:56:57.664 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:57.669+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:57.765 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:57.770+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:57.804 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:57.805 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:56:57.805 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:56:57.805 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:56:57.805 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:57.814 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:56:57.839 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2020-11-16T20:56:57.898 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:57.903+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:57.967 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:56:57.972+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:56:58.013 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:56:58.014 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:56:58.014 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:56:58.014 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:56:58.014 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.014 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:202 3.2 3:5723fd94:::smithi16641208-211:head [copy-from ver 110] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e35)", 2020-11-16T20:56:58.015 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:56:58.015 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 63.047683124999999, 2020-11-16T20:56:58.015 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027790216999999999, 2020-11-16T20:56:58.015 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:58.015 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.015 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:58.015 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.016 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:58.016 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:56:58.016 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:58.016 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.016 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:58.017 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:56:58.017 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1907999999999998e-05 2020-11-16T20:56:58.017 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.017 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.017 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:58.018 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969232+0000", 2020-11-16T20:56:58.018 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5270000000000004e-06 2020-11-16T20:56:58.018 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.018 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.018 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:58.019 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969239+0000", 2020-11-16T20:56:58.019 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3062e-05 2020-11-16T20:56:58.019 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.019 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.019 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:58.020 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969252+0000", 2020-11-16T20:56:58.020 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8919999999999997e-06 2020-11-16T20:56:58.020 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.020 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.020 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.020 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969258+0000", 2020-11-16T20:56:58.021 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00040859799999999998 2020-11-16T20:56:58.021 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.021 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.021 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.021 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969666+0000", 2020-11-16T20:56:58.021 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0932000000000003e-05 2020-11-16T20:56:58.021 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.022 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.022 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:58.022 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969757+0000", 2020-11-16T20:56:58.022 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010999395 2020-11-16T20:56:58.022 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.022 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.023 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:58.023 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.980757+0000", 2020-11-16T20:56:58.023 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006260659 2020-11-16T20:56:58.023 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.023 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.023 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:58.023 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987017+0000", 2020-11-16T20:56:58.024 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0080836880000000003 2020-11-16T20:56:58.024 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.024 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.024 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.024 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995101+0000", 2020-11-16T20:56:58.024 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001796829 2020-11-16T20:56:58.024 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.025 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.025 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.025 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996898+0000", 2020-11-16T20:56:58.025 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2086000000000003e-05 2020-11-16T20:56:58.025 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.025 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.025 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:58.025 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996940+0000", 2020-11-16T20:56:58.026 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0641e-05 2020-11-16T20:56:58.026 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.026 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.026 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:58.026 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996971+0000", 2020-11-16T20:56:58.026 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027790216999999999 2020-11-16T20:56:58.026 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.027 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:58.027 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.027 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.027 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.027 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:547 3.2 3:5f250a2b:::smithi16641208-75:head [copy-from ver 38] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:58.027 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:56:58.027 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 52.999295822000001, 2020-11-16T20:56:58.028 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027400430999999999, 2020-11-16T20:56:58.028 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:58.028 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.028 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:58.028 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.028 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:58.028 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:56:58.028 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:58.029 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.029 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.029 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:58.029 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:56:58.029 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5093999999999999e-05 2020-11-16T20:56:58.029 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.029 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.030 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:58.030 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017613+0000", 2020-11-16T20:56:58.030 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6150000000000003e-06 2020-11-16T20:56:58.030 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.030 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.030 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:58.030 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017623+0000", 2020-11-16T20:56:58.031 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6934000000000001e-05 2020-11-16T20:56:58.031 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.031 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.031 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:58.031 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017639+0000", 2020-11-16T20:56:58.031 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1892000000000001e-05 2020-11-16T20:56:58.031 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.031 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.032 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.032 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017651+0000", 2020-11-16T20:56:58.032 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2955999999999998e-05 2020-11-16T20:56:58.032 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.032 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.032 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.032 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017714+0000", 2020-11-16T20:56:58.033 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019352400000000001 2020-11-16T20:56:58.033 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.033 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.033 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:58.033 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017908+0000", 2020-11-16T20:56:58.033 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0073901349999999999 2020-11-16T20:56:58.033 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.034 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.034 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:58.034 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025298+0000", 2020-11-16T20:56:58.034 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0082133799999999993 2020-11-16T20:56:58.034 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.034 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.034 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:58.034 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033511+0000", 2020-11-16T20:56:58.035 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0074347629999999996 2020-11-16T20:56:58.035 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.035 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.035 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.035 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.040946+0000", 2020-11-16T20:56:58.035 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039404669999999996 2020-11-16T20:56:58.035 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.036 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.036 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.036 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044887+0000", 2020-11-16T20:56:58.036 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7098000000000002e-05 2020-11-16T20:56:58.036 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.036 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.036 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:58.036 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044934+0000", 2020-11-16T20:56:58.037 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4573000000000003e-05 2020-11-16T20:56:58.037 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.037 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.037 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:58.037 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044968+0000", 2020-11-16T20:56:58.037 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027400430999999999 2020-11-16T20:56:58.037 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.038 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:58.038 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.038 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.038 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.038 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:548 3.2 3:6173e90a:::smithi16641208-2:head [copy-from ver 3] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:58.038 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:56:58.038 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 52.999164489000002, 2020-11-16T20:56:58.039 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029556911000000002, 2020-11-16T20:56:58.039 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:58.039 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.039 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:58.039 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.039 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:58.039 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:56:58.039 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:58.040 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.040 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.040 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:58.040 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:56:58.040 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2478000000000002e-05 2020-11-16T20:56:58.040 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.040 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.041 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:58.041 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017742+0000", 2020-11-16T20:56:58.041 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3060000000000003e-06 2020-11-16T20:56:58.041 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.041 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.041 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:58.041 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017748+0000", 2020-11-16T20:56:58.042 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1102e-05 2020-11-16T20:56:58.042 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.042 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.042 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:58.042 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017759+0000", 2020-11-16T20:56:58.042 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.118e-06 2020-11-16T20:56:58.042 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.043 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.043 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.043 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017764+0000", 2020-11-16T20:56:58.043 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032233700000000001 2020-11-16T20:56:58.043 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.043 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.043 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.043 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.018086+0000", 2020-11-16T20:56:58.044 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000128374 2020-11-16T20:56:58.044 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.044 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.044 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:58.044 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.018215+0000", 2020-11-16T20:56:58.044 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012971355 2020-11-16T20:56:58.044 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.045 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.045 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:58.045 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.031186+0000", 2020-11-16T20:56:58.045 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044142890000000001 2020-11-16T20:56:58.045 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.045 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.045 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:58.045 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.035600+0000", 2020-11-16T20:56:58.046 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092372719999999995 2020-11-16T20:56:58.046 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.046 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.046 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.046 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044838+0000", 2020-11-16T20:56:58.046 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0023022049999999999 2020-11-16T20:56:58.046 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.047 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.047 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.047 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047140+0000", 2020-11-16T20:56:58.047 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0380999999999997e-05 2020-11-16T20:56:58.047 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.047 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.047 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:58.048 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047200+0000", 2020-11-16T20:56:58.048 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5693999999999999e-05 2020-11-16T20:56:58.048 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.048 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.048 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:58.048 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047256+0000", 2020-11-16T20:56:58.048 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029556911000000002 2020-11-16T20:56:58.048 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.049 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:58.049 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.049 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.049 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.049 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:554 3.2 3:769099fd:::smithi16641208-247:head [copy-from ver 123] snapc 1=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:56:58.049 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:56:58.049 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 52.966761171000002, 2020-11-16T20:56:58.050 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998, 2020-11-16T20:56:58.050 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:58.050 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.050 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:58.050 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.050 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:58.050 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:56:58.050 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:58.051 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.051 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.051 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:58.051 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:56:58.051 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6705999999999997e-05 2020-11-16T20:56:58.051 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.051 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.052 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:58.052 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050139+0000", 2020-11-16T20:56:58.052 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6199999999999998e-06 2020-11-16T20:56:58.052 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.052 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.052 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:58.052 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050144+0000", 2020-11-16T20:56:58.053 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.944e-06 2020-11-16T20:56:58.053 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.053 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.053 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:58.053 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050154+0000", 2020-11-16T20:56:58.053 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4043999999999999e-05 2020-11-16T20:56:58.053 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.053 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.054 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.054 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050178+0000", 2020-11-16T20:56:58.054 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078971409999999999 2020-11-16T20:56:58.054 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.054 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.054 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.054 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058075+0000", 2020-11-16T20:56:58.055 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012776500000000001 2020-11-16T20:56:58.055 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.055 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.055 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:58.055 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058203+0000", 2020-11-16T20:56:58.055 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011807013 2020-11-16T20:56:58.055 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.056 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.056 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:58.056 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070010+0000", 2020-11-16T20:56:58.056 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029522160000000001 2020-11-16T20:56:58.056 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.056 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.056 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:58.056 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.072962+0000", 2020-11-16T20:56:58.057 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017845006 2020-11-16T20:56:58.057 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.057 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.057 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.057 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.090807+0000", 2020-11-16T20:56:58.057 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.009301808 2020-11-16T20:56:58.057 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.058 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.058 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.058 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100109+0000", 2020-11-16T20:56:58.058 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7076999999999995e-05 2020-11-16T20:56:58.058 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.058 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.058 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:58.059 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100176+0000", 2020-11-16T20:56:58.059 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9790999999999999e-05 2020-11-16T20:56:58.059 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.059 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.059 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:58.059 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100216+0000", 2020-11-16T20:56:58.059 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998 2020-11-16T20:56:58.059 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.060 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:58.060 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.060 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.060 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.060 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2429 4.0 4:3b92f709:::smithi16641208-69:head [rollback 7] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:56:58.060 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:56:58.060 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 48.000842908999999, 2020-11-16T20:56:58.061 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003, 2020-11-16T20:56:58.061 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:58.061 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.061 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:58.061 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:58.061 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:58.061 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2429 2020-11-16T20:56:58.061 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.062 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:58.062 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.062 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:58.062 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:56:58.062 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:58.062 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.062 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.063 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:58.063 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:56:58.063 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3710000000000002e-05 2020-11-16T20:56:58.063 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.063 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.063 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:58.063 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016044+0000", 2020-11-16T20:56:58.064 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7090000000000001e-06 2020-11-16T20:56:58.064 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.064 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.064 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:58.064 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016049+0000", 2020-11-16T20:56:58.064 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8820000000000003e-06 2020-11-16T20:56:58.064 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.064 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:58.065 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016056+0000", 2020-11-16T20:56:58.065 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.27e-06 2020-11-16T20:56:58.065 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.065 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016059+0000", 2020-11-16T20:56:58.066 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.537e-05 2020-11-16T20:56:58.066 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.066 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.066 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016115+0000", 2020-11-16T20:56:58.066 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8690000000000003e-06 2020-11-16T20:56:58.066 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.066 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.067 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:58.067 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016120+0000", 2020-11-16T20:56:58.067 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021405730000000002 2020-11-16T20:56:58.067 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.067 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.067 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.067 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018260+0000", 2020-11-16T20:56:58.068 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0137999999999999e-05 2020-11-16T20:56:58.068 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.068 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.068 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.068 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018320+0000", 2020-11-16T20:56:58.068 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011799352000000001 2020-11-16T20:56:58.068 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.069 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.069 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.069 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030120+0000", 2020-11-16T20:56:58.069 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000163139 2020-11-16T20:56:58.069 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.069 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.069 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:58.070 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030283+0000", 2020-11-16T20:56:58.070 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029657000000000002 2020-11-16T20:56:58.070 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.070 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.070 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.070 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030579+0000", 2020-11-16T20:56:58.070 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3058000000000001e-05 2020-11-16T20:56:58.070 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.071 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.071 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.071 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030612+0000", 2020-11-16T20:56:58.071 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0075168259999999999 2020-11-16T20:56:58.071 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.071 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.071 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.072 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038129+0000", 2020-11-16T20:56:58.072 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012914299999999999 2020-11-16T20:56:58.072 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.072 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.072 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:58.072 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038258+0000", 2020-11-16T20:56:58.072 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034292799999999999 2020-11-16T20:56:58.072 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.073 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.073 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:56:58.073 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038601+0000", 2020-11-16T20:56:58.073 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0025181159999999999 2020-11-16T20:56:58.073 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.073 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.073 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.074 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041119+0000", 2020-11-16T20:56:58.074 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2331999999999997e-05 2020-11-16T20:56:58.074 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.074 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.074 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for ondisk", 2020-11-16T20:56:58.074 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041202+0000", 2020-11-16T20:56:58.074 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028481750000000001 2020-11-16T20:56:58.075 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.075 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.075 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:58.075 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044050+0000", 2020-11-16T20:56:58.075 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001269921 2020-11-16T20:56:58.075 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.075 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.075 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.076 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045320+0000", 2020-11-16T20:56:58.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054215490000000003 2020-11-16T20:56:58.076 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.076 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.076 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.076 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050741+0000", 2020-11-16T20:56:58.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6981000000000001e-05 2020-11-16T20:56:58.077 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.077 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.077 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:58.077 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050808+0000", 2020-11-16T20:56:58.077 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8841e-05 2020-11-16T20:56:58.077 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.077 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.077 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:58.078 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050877+0000", 2020-11-16T20:56:58.078 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003 2020-11-16T20:56:58.078 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.078 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:58.078 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.078 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.078 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.079 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2430 4.0 4:3b92f709:::smithi16641208-69:head [append 0~0] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:56:58.079 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:56:58.079 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 48.000786585999997, 2020-11-16T20:56:58.079 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001, 2020-11-16T20:56:58.079 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:58.079 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.079 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:58.080 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:58.080 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:58.080 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2430 2020-11-16T20:56:58.080 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.080 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:58.080 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.080 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:58.080 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:56:58.081 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:58.081 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.081 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.081 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:58.081 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:56:58.081 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0857e-05 2020-11-16T20:56:58.081 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.082 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.082 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:58.082 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016098+0000", 2020-11-16T20:56:58.082 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9179999999999999e-06 2020-11-16T20:56:58.082 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.082 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.082 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:58.083 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016104+0000", 2020-11-16T20:56:58.083 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8230000000000006e-06 2020-11-16T20:56:58.083 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.083 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.083 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:58.083 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016114+0000", 2020-11-16T20:56:58.083 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2180000000000001e-06 2020-11-16T20:56:58.083 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.084 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.084 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.084 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016118+0000", 2020-11-16T20:56:58.084 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3547999999999995e-05 2020-11-16T20:56:58.084 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.084 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.084 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.085 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016181+0000", 2020-11-16T20:56:58.085 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8730000000000007e-06 2020-11-16T20:56:58.085 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.085 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.085 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:58.085 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016189+0000", 2020-11-16T20:56:58.085 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021577200000000001 2020-11-16T20:56:58.086 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.086 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.086 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.086 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018347+0000", 2020-11-16T20:56:58.086 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6832000000000001e-05 2020-11-16T20:56:58.086 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.086 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.086 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.087 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018404+0000", 2020-11-16T20:56:58.087 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012272913999999999 2020-11-16T20:56:58.087 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.087 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.087 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.087 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030677+0000", 2020-11-16T20:56:58.087 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2555000000000002e-05 2020-11-16T20:56:58.088 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.088 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.088 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.088 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030719+0000", 2020-11-16T20:56:58.088 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010518684 2020-11-16T20:56:58.088 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.088 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.088 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.089 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041238+0000", 2020-11-16T20:56:58.089 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000144723 2020-11-16T20:56:58.089 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.089 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.089 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:58.089 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041383+0000", 2020-11-16T20:56:58.089 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000214575 2020-11-16T20:56:58.090 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.090 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.090 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:56:58.090 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041597+0000", 2020-11-16T20:56:58.090 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002463196 2020-11-16T20:56:58.090 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.090 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.091 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:58.091 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044060+0000", 2020-11-16T20:56:58.091 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001654066 2020-11-16T20:56:58.091 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.091 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.091 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.091 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045715+0000", 2020-11-16T20:56:58.091 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053780599999999996 2020-11-16T20:56:58.092 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.092 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.092 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.092 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051093+0000", 2020-11-16T20:56:58.092 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8189999999999996e-05 2020-11-16T20:56:58.092 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.092 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.093 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:58.093 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051161+0000", 2020-11-16T20:56:58.093 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4910000000000001e-05 2020-11-16T20:56:58.093 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.093 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.093 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:58.093 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051216+0000", 2020-11-16T20:56:58.093 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001 2020-11-16T20:56:58.094 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.094 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:58.094 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.094 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.094 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.094 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "MOSDPGPush(4.1 52/51 [PushOp(4:9ab04c4a:::smithi16641208-1:head, version: 33'3, data_included: [0~892056,1542129~156520], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:9ab04c4a:::smithi16641208-1:head@33'3, size: 2016807, copy_subset: [0~2016807], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1698649, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:a1eef07d:::smithi16641208-13:head, version: 33'9, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:a1eef07d:::smithi16641208-13:head@33'9, size: 2201684, copy_subset: [0~2201684], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:929564f0:::smithi16641208-24:head, version: 33'18, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:929564f0:::smithi16641208-24:head@33'18, size: 2386561, copy_subset: [0~2386561], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b565f7d2:::smithi16641208-35:head, version: 33'27, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b565f7d2:::smithi16641208-35:head@33'27, size: 2571438, copy_subset: [0~2571438], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b6545a47:::smithi16641208-46:head, version: 33'29, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b6545a47:::smithi16641208-46:head@33'29, size: 2756315, copy_subset: [0~2756315], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:9bd9f31d:::smithi16641208-48:head, version: 33'35, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:9bd9f31d:::smithi16641208-48:head@33'35, size: 2789929, copy_subset: [0~2789929], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:83205103:::smithi16641208-103:head, version: 34'38, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:83205103:::smithi16641208-103:head@34'38, size: 3714314, copy_subset: [0~3714314], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:86a0a5b7:::smithi16641208-108:head, version: 34'42, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:86a0a5b7:::smithi16641208-108:head@34'42, size: 3798349, copy_subset: [0~3798349], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-16T20:56:58.094 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:56:58.095 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 43.246189979999997, 2020-11-16T20:56:58.095 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032552672999999997, 2020-11-16T20:56:58.095 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:58.095 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:58.095 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:58.095 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.095 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:58.096 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:56:58.096 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:58.096 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.096 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.096 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:58.096 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:56:58.096 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017498692999999999 2020-11-16T20:56:58.097 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.097 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.097 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:58.097 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788172+0000", 2020-11-16T20:56:58.097 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4147999999999999e-05 2020-11-16T20:56:58.097 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.097 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.097 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:58.098 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788206+0000", 2020-11-16T20:56:58.098 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0016000000000002e-05 2020-11-16T20:56:58.098 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.098 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.098 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:58.098 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788276+0000", 2020-11-16T20:56:58.098 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2172000000000002e-05 2020-11-16T20:56:58.099 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.099 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.099 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.099 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788319+0000", 2020-11-16T20:56:58.099 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000154337 2020-11-16T20:56:58.099 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.099 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.099 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.100 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788473+0000", 2020-11-16T20:56:58.100 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7690000000000002e-06 2020-11-16T20:56:58.100 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.100 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.100 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:58.100 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788482+0000", 2020-11-16T20:56:58.100 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014744538 2020-11-16T20:56:58.101 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.101 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.101 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:58.101 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803226+0000", 2020-11-16T20:56:58.101 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032552672999999997 2020-11-16T20:56:58.101 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.101 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:58.102 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.102 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.102 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.102 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.0:552 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'128, mlcod=0'0)", 2020-11-16T20:56:58.102 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:56:58.102 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 43.226224561999999, 2020-11-16T20:56:58.102 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038033168999999999, 2020-11-16T20:56:58.102 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:58.103 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.103 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:58.103 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.103 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:58.103 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:56:58.103 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:58.103 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.104 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.104 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:58.104 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:56:58.104 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0031023880000000002 2020-11-16T20:56:58.104 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.104 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.104 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:58.104 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793741+0000", 2020-11-16T20:56:58.105 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1496e-05 2020-11-16T20:56:58.105 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.105 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.105 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:58.105 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793753+0000", 2020-11-16T20:56:58.105 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9009999999999999e-05 2020-11-16T20:56:58.105 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.106 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.106 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:58.106 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793772+0000", 2020-11-16T20:56:58.106 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3318e-05 2020-11-16T20:56:58.106 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.106 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.106 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.107 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793785+0000", 2020-11-16T20:56:58.107 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012534775 2020-11-16T20:56:58.107 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.107 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.107 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.107 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806320+0000", 2020-11-16T20:56:58.107 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8144999999999999e-05 2020-11-16T20:56:58.107 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.108 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.108 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:58.108 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806348+0000", 2020-11-16T20:56:58.108 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022285688000000001 2020-11-16T20:56:58.108 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.108 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.108 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:58.109 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828634+0000", 2020-11-16T20:56:58.109 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8349000000000002e-05 2020-11-16T20:56:58.109 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.109 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.109 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:58.109 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828672+0000", 2020-11-16T20:56:58.109 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038033168999999999 2020-11-16T20:56:58.110 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.110 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:58.110 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.110 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.110 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.110 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2503 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'129, mlcod=0'0)", 2020-11-16T20:56:58.110 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:56:58.111 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 43.223036381999997, 2020-11-16T20:56:58.111 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034870998, 2020-11-16T20:56:58.111 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:58.111 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.111 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:58.111 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.111 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:58.111 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:56:58.112 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:58.112 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.112 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.112 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:58.112 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:56:58.112 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00093048899999999995 2020-11-16T20:56:58.112 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.113 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:58.113 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794758+0000", 2020-11-16T20:56:58.113 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.169e-05 2020-11-16T20:56:58.113 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.113 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:58.113 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794769+0000", 2020-11-16T20:56:58.114 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3998999999999999e-05 2020-11-16T20:56:58.114 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.114 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.114 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:58.114 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794783+0000", 2020-11-16T20:56:58.114 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.481e-06 2020-11-16T20:56:58.114 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.115 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.115 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.115 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794791+0000", 2020-11-16T20:56:58.115 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.02524036 2020-11-16T20:56:58.115 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.115 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.115 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.116 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820031+0000", 2020-11-16T20:56:58.116 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.811e-05 2020-11-16T20:56:58.116 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.116 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.116 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:58.116 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820059+0000", 2020-11-16T20:56:58.116 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.008614577 2020-11-16T20:56:58.117 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.117 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.117 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:58.117 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828674+0000", 2020-11-16T20:56:58.117 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4292000000000001e-05 2020-11-16T20:56:58.117 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.117 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.117 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:58.118 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828698+0000", 2020-11-16T20:56:58.118 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034870998 2020-11-16T20:56:58.118 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.118 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:58.118 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.118 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.118 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.119 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2504 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'130, mlcod=0'0)", 2020-11-16T20:56:58.119 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:56:58.119 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 43.222030699999998, 2020-11-16T20:56:58.119 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033888776000000002, 2020-11-16T20:56:58.119 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:58.119 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.119 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:58.119 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.120 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:58.120 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:56:58.120 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:58.120 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.120 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.120 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:58.120 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:56:58.121 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3896999999999997e-05 2020-11-16T20:56:58.121 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.121 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.121 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:58.121 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794877+0000", 2020-11-16T20:56:58.121 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7019999999999998e-06 2020-11-16T20:56:58.121 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.121 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.122 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:58.122 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794883+0000", 2020-11-16T20:56:58.122 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.789e-06 2020-11-16T20:56:58.122 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.122 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.122 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:58.122 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794888+0000", 2020-11-16T20:56:58.123 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.852e-06 2020-11-16T20:56:58.123 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.123 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.123 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.123 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794891+0000", 2020-11-16T20:56:58.123 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026152822999999999 2020-11-16T20:56:58.123 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.123 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.124 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.124 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.821044+0000", 2020-11-16T20:56:58.124 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6900999999999999e-05 2020-11-16T20:56:58.124 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.124 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.124 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:58.124 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.821071+0000", 2020-11-16T20:56:58.125 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0076283210000000004 2020-11-16T20:56:58.125 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.125 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.125 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:58.125 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828699+0000", 2020-11-16T20:56:58.125 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2490999999999999e-05 2020-11-16T20:56:58.125 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.126 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.126 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:58.126 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828722+0000", 2020-11-16T20:56:58.126 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033888776000000002 2020-11-16T20:56:58.126 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.126 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:58.126 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.126 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.127 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.127 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.13:681 3.1 e52/19 3:afc69464:::smithi16641208-110:head v 52'546, mlcod=52'544)", 2020-11-16T20:56:58.127 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:56:58.127 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 43.21937063, 2020-11-16T20:56:58.127 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.03113606, 2020-11-16T20:56:58.127 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:58.127 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.128 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:58.128 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.128 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:58.128 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:56:58.128 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:58.128 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.128 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.129 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:58.129 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:56:58.129 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0026681809999999999 2020-11-16T20:56:58.129 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.129 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.129 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:58.129 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800161+0000", 2020-11-16T20:56:58.129 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3499000000000001e-05 2020-11-16T20:56:58.130 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.130 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.130 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:58.130 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800175+0000", 2020-11-16T20:56:58.130 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8301999999999999e-05 2020-11-16T20:56:58.130 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.130 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.131 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:58.131 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800193+0000", 2020-11-16T20:56:58.131 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0465999999999999e-05 2020-11-16T20:56:58.131 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.131 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.131 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.131 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800203+0000", 2020-11-16T20:56:58.132 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061432479999999996 2020-11-16T20:56:58.132 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.132 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.132 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.132 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806347+0000", 2020-11-16T20:56:58.132 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.641e-05 2020-11-16T20:56:58.132 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.132 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.133 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:58.133 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806373+0000", 2020-11-16T20:56:58.133 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022190887999999999 2020-11-16T20:56:58.133 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.133 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.133 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:58.133 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828564+0000", 2020-11-16T20:56:58.134 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5066000000000003e-05 2020-11-16T20:56:58.134 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.134 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.134 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:58.134 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828629+0000", 2020-11-16T20:56:58.134 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.03113606 2020-11-16T20:56:58.134 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.134 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:58.135 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.135 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.135 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.135 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.13:682 3.1 e52/19 3:b3ae2c4d:::smithi16641208-463:head v 52'547, mlcod=52'544)", 2020-11-16T20:56:58.135 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.802222+0000", 2020-11-16T20:56:58.135 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 43.214641726000004, 2020-11-16T20:56:58.135 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026721733000000001, 2020-11-16T20:56:58.136 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:58.136 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.136 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:58.136 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.136 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:58.136 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.802222+0000", 2020-11-16T20:56:58.136 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:58.136 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.137 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.137 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:58.137 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.802222+0000", 2020-11-16T20:56:58.137 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001333442 2020-11-16T20:56:58.137 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.137 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.137 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:58.138 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803555+0000", 2020-11-16T20:56:58.138 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0971999999999999e-05 2020-11-16T20:56:58.138 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.138 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.138 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:58.138 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803566+0000", 2020-11-16T20:56:58.138 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5973000000000001e-05 2020-11-16T20:56:58.139 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.139 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.139 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:58.139 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803582+0000", 2020-11-16T20:56:58.139 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2969999999999998e-06 2020-11-16T20:56:58.139 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.139 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.139 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.140 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803590+0000", 2020-11-16T20:56:58.140 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016424259 2020-11-16T20:56:58.140 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.140 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.140 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.140 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820014+0000", 2020-11-16T20:56:58.140 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9485999999999999e-05 2020-11-16T20:56:58.141 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.141 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.141 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:58.141 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820033+0000", 2020-11-16T20:56:58.141 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0088553179999999992 2020-11-16T20:56:58.141 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.141 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.141 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:58.142 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828889+0000", 2020-11-16T20:56:58.142 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4985999999999998e-05 2020-11-16T20:56:58.142 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.142 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.142 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:58.142 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828944+0000", 2020-11-16T20:56:58.142 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026721733000000001 2020-11-16T20:56:58.143 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.143 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:58.143 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.143 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.143 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.143 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:603 3.2 3:5a2e7c26:::smithi16641208-130:head [copy-from ver 67] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:56:58.143 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:56:58.143 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.265622636000003, 2020-11-16T20:56:58.144 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036631116999999998, 2020-11-16T20:56:58.144 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:58.144 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.144 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:58.144 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.144 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:58.144 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:56:58.145 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:58.145 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.145 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.145 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:58.145 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:56:58.145 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9854000000000002e-05 2020-11-16T20:56:58.145 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.145 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.146 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:58.146 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751281+0000", 2020-11-16T20:56:58.146 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1840000000000004e-06 2020-11-16T20:56:58.146 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.146 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.146 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:58.146 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751287+0000", 2020-11-16T20:56:58.147 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0231000000000001e-05 2020-11-16T20:56:58.147 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.147 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.147 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:58.147 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751297+0000", 2020-11-16T20:56:58.147 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.639e-06 2020-11-16T20:56:58.147 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.148 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.148 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.148 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751302+0000", 2020-11-16T20:56:58.148 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030012000000000002 2020-11-16T20:56:58.148 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.148 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.148 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.148 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751602+0000", 2020-11-16T20:56:58.149 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013830200000000001 2020-11-16T20:56:58.149 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.149 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.149 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:58.149 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751740+0000", 2020-11-16T20:56:58.149 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019538969999999999 2020-11-16T20:56:58.149 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.150 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.150 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:58.150 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771279+0000", 2020-11-16T20:56:58.150 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007630403 2020-11-16T20:56:58.150 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.150 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.150 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:58.150 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.778910+0000", 2020-11-16T20:56:58.151 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0065002009999999997 2020-11-16T20:56:58.151 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.151 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.151 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.151 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.785410+0000", 2020-11-16T20:56:58.151 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0023914140000000001 2020-11-16T20:56:58.151 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.152 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.152 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.152 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787801+0000", 2020-11-16T20:56:58.152 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9629999999999998e-05 2020-11-16T20:56:58.152 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.152 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.152 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:58.152 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787841+0000", 2020-11-16T20:56:58.153 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1168999999999999e-05 2020-11-16T20:56:58.153 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.153 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.153 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:58.153 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787872+0000", 2020-11-16T20:56:58.153 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036631116999999998 2020-11-16T20:56:58.153 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.154 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:58.154 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.154 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.154 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.154 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:609 3.2 3:5eead97c:::smithi16641208-34:head [copy-from ver 27] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:56:58.154 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:56:58.154 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.227825506999999, 2020-11-16T20:56:58.155 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.062626424, 2020-11-16T20:56:58.155 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:58.155 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.155 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:58.155 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.155 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:58.155 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:56:58.155 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:58.156 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.156 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.156 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:58.156 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:56:58.156 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3596000000000001e-05 2020-11-16T20:56:58.156 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.156 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.157 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:58.157 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789082+0000", 2020-11-16T20:56:58.157 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3209999999999999e-06 2020-11-16T20:56:58.157 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.157 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.157 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:58.157 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789089+0000", 2020-11-16T20:56:58.158 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3498e-05 2020-11-16T20:56:58.158 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.158 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.158 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:58.158 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789103+0000", 2020-11-16T20:56:58.158 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3679999999999998e-06 2020-11-16T20:56:58.158 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.158 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.159 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.159 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789109+0000", 2020-11-16T20:56:58.159 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007399638 2020-11-16T20:56:58.159 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.159 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.159 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.159 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.796509+0000", 2020-11-16T20:56:58.160 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000181168 2020-11-16T20:56:58.160 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.160 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.160 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:58.160 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.796690+0000", 2020-11-16T20:56:58.160 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01336562 2020-11-16T20:56:58.160 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.161 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.161 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:58.161 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.810055+0000", 2020-11-16T20:56:58.161 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044828350000000001 2020-11-16T20:56:58.161 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.161 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.161 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:58.161 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.814538+0000", 2020-11-16T20:56:58.162 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035609628999999997 2020-11-16T20:56:58.162 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.162 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.162 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.162 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850148+0000", 2020-11-16T20:56:58.162 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0013754730000000001 2020-11-16T20:56:58.162 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.163 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.163 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.163 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851523+0000", 2020-11-16T20:56:58.163 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9935e-05 2020-11-16T20:56:58.163 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.163 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.163 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:58.164 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851603+0000", 2020-11-16T20:56:58.164 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1342999999999999e-05 2020-11-16T20:56:58.164 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.164 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.164 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:58.164 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851665+0000", 2020-11-16T20:56:58.164 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.062626424 2020-11-16T20:56:58.164 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.165 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:58.165 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.165 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.165 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.165 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2605 4.0 4:2294fced:::smithi16641208-278:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:56:58.165 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:56:58.165 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.099990390999999, 2020-11-16T20:56:58.166 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032301128999999998, 2020-11-16T20:56:58.166 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:58.166 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:58.166 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:58.166 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:58.166 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:58.166 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2605 2020-11-16T20:56:58.166 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.167 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:58.167 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.167 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:58.167 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:56:58.167 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:58.167 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.167 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.168 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:58.168 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:56:58.168 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.811e-05 2020-11-16T20:56:58.168 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.168 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.168 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:58.168 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916901+0000", 2020-11-16T20:56:58.168 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2939999999999996e-06 2020-11-16T20:56:58.169 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.169 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.169 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:58.169 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916907+0000", 2020-11-16T20:56:58.169 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0589e-05 2020-11-16T20:56:58.169 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.169 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.170 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:58.170 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916917+0000", 2020-11-16T20:56:58.170 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2549999999999999e-06 2020-11-16T20:56:58.170 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.170 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.170 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.170 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916921+0000", 2020-11-16T20:56:58.170 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033789099999999999 2020-11-16T20:56:58.171 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.171 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.171 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.171 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.917259+0000", 2020-11-16T20:56:58.171 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.25e-05 2020-11-16T20:56:58.171 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.171 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.172 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.172 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.917332+0000", 2020-11-16T20:56:58.172 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.028336376999999999 2020-11-16T20:56:58.172 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.172 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.172 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.172 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.945668+0000", 2020-11-16T20:56:58.172 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0983000000000006e-05 2020-11-16T20:56:58.173 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.173 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.173 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:58.173 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.945759+0000", 2020-11-16T20:56:58.173 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00324756 2020-11-16T20:56:58.173 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.173 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.174 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.174 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949007+0000", 2020-11-16T20:56:58.174 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0583999999999999e-05 2020-11-16T20:56:58.174 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.174 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.174 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:58.174 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949097+0000", 2020-11-16T20:56:58.175 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6985999999999998e-05 2020-11-16T20:56:58.175 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.175 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.175 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:58.175 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949174+0000", 2020-11-16T20:56:58.175 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032301128999999998 2020-11-16T20:56:58.175 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.175 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:58.176 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.176 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.176 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.176 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2874 4.0 4:055e14cb:::smithi16641208-187:head [copy-from ver 402] snapc 25=[25,23,21,f] ondisk+write+known_if_redirected e72)", 2020-11-16T20:56:58.176 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:56:58.176 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 23.271466720999999, 2020-11-16T20:56:58.176 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031663616999999998, 2020-11-16T20:56:58.177 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:58.177 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.177 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:58.177 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:58.177 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:58.177 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2874 2020-11-16T20:56:58.177 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.177 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:58.178 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.178 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:58.178 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:56:58.178 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:58.178 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.178 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.178 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:58.179 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:56:58.179 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6754000000000001e-05 2020-11-16T20:56:58.179 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.179 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.179 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:58.179 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745434+0000", 2020-11-16T20:56:58.179 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5049999999999998e-06 2020-11-16T20:56:58.180 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.180 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.180 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:58.180 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745439+0000", 2020-11-16T20:56:58.180 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0803e-05 2020-11-16T20:56:58.180 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.180 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.180 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:58.181 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745450+0000", 2020-11-16T20:56:58.181 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8810000000000004e-06 2020-11-16T20:56:58.181 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.181 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.181 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.181 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745455+0000", 2020-11-16T20:56:58.181 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022866499999999999 2020-11-16T20:56:58.182 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.182 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.182 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.182 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745684+0000", 2020-11-16T20:56:58.182 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000132714 2020-11-16T20:56:58.182 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.182 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.182 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:58.183 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745816+0000", 2020-11-16T20:56:58.183 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050117850000000004 2020-11-16T20:56:58.183 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.183 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.183 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:56:58.183 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.750828+0000", 2020-11-16T20:56:58.183 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010413489 2020-11-16T20:56:58.184 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.184 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.184 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:58.184 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.761241+0000", 2020-11-16T20:56:58.184 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028274289999999998 2020-11-16T20:56:58.184 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.184 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.185 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.185 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.764069+0000", 2020-11-16T20:56:58.185 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012880057 2020-11-16T20:56:58.185 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.185 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.185 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.185 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.776949+0000", 2020-11-16T20:56:58.185 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2536e-05 2020-11-16T20:56:58.186 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.186 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.186 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:58.186 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777002+0000", 2020-11-16T20:56:58.186 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8999000000000002e-05 2020-11-16T20:56:58.186 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.186 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.187 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:58.187 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777061+0000", 2020-11-16T20:56:58.187 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031663616999999998 2020-11-16T20:56:58.187 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.187 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:58.187 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.187 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.187 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.188 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2875 4.0 4:055e14cb:::smithi16641208-187:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-11-16T20:56:58.188 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:56:58.188 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 23.271377494999999, 2020-11-16T20:56:58.188 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031888061000000002, 2020-11-16T20:56:58.188 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:58.188 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:58.188 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:56:58.189 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:56:58.189 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:58.189 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2875 2020-11-16T20:56:58.189 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.189 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:58.189 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.189 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:58.190 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:56:58.190 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:58.190 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.190 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.190 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:58.190 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:56:58.190 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0239000000000001e-05 2020-11-16T20:56:58.190 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.191 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.191 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:58.191 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745506+0000", 2020-11-16T20:56:58.191 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.252e-06 2020-11-16T20:56:58.191 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.191 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.191 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:58.192 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745510+0000", 2020-11-16T20:56:58.192 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3670000000000002e-06 2020-11-16T20:56:58.192 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.192 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.192 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:58.192 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745516+0000", 2020-11-16T20:56:58.192 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1089999999999998e-06 2020-11-16T20:56:58.192 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.193 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.193 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.193 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745519+0000", 2020-11-16T20:56:58.193 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045188999999999998 2020-11-16T20:56:58.193 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.193 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.193 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.194 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745971+0000", 2020-11-16T20:56:58.194 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7822999999999998e-05 2020-11-16T20:56:58.194 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.194 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.194 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.194 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.746029+0000", 2020-11-16T20:56:58.194 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013333563999999999 2020-11-16T20:56:58.194 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.195 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.195 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.195 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.759362+0000", 2020-11-16T20:56:58.195 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000170896 2020-11-16T20:56:58.195 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.195 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.195 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:58.196 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.759533+0000", 2020-11-16T20:56:58.196 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017572878 2020-11-16T20:56:58.196 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.196 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.196 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.196 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777106+0000", 2020-11-16T20:56:58.196 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014436399999999999 2020-11-16T20:56:58.196 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.197 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.197 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:58.197 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777251+0000", 2020-11-16T20:56:58.197 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012367899999999999 2020-11-16T20:56:58.197 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.197 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.197 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:58.198 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777374+0000", 2020-11-16T20:56:58.198 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031888061000000002 2020-11-16T20:56:58.198 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.198 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:58.198 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.198 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.198 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.199 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3004 3.2 3:4fbd4ff5:::smithi16641208-419:head [copy-from ver 366] snapc 33=[33,25] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e87)", 2020-11-16T20:56:58.199 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.815968+0000", 2020-11-16T20:56:58.199 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.2008958819999993, 2020-11-16T20:56:58.199 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042048220999999997, 2020-11-16T20:56:58.199 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:58.199 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.199 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:58.199 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.200 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:58.200 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.815968+0000", 2020-11-16T20:56:58.200 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:58.200 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.200 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.200 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:58.200 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.815968+0000", 2020-11-16T20:56:58.201 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3235000000000002e-05 2020-11-16T20:56:58.201 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.201 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.201 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:58.201 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816011+0000", 2020-11-16T20:56:58.201 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.303e-06 2020-11-16T20:56:58.201 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.201 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.202 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:58.202 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816019+0000", 2020-11-16T20:56:58.202 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9714999999999999e-05 2020-11-16T20:56:58.202 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.202 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.202 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:58.202 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816049+0000", 2020-11-16T20:56:58.203 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2960000000000001e-06 2020-11-16T20:56:58.203 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.203 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.203 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.203 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816056+0000", 2020-11-16T20:56:58.203 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000241606 2020-11-16T20:56:58.203 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.203 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.204 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.204 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816298+0000", 2020-11-16T20:56:58.204 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016421599999999999 2020-11-16T20:56:58.204 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.204 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.204 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:58.204 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816462+0000", 2020-11-16T20:56:58.205 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025803994 2020-11-16T20:56:58.205 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.205 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.205 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:58.205 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.842266+0000", 2020-11-16T20:56:58.205 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0072860549999999996 2020-11-16T20:56:58.205 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.205 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.206 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:56:58.206 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.849552+0000", 2020-11-16T20:56:58.206 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0077911389999999999 2020-11-16T20:56:58.206 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.206 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.206 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.206 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.857343+0000", 2020-11-16T20:56:58.207 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00049728000000000001 2020-11-16T20:56:58.207 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.207 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.207 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.207 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.857841+0000", 2020-11-16T20:56:58.207 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.1997999999999997e-05 2020-11-16T20:56:58.207 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.207 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.208 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:56:58.208 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.857923+0000", 2020-11-16T20:56:58.208 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3383999999999999e-05 2020-11-16T20:56:58.208 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.208 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.208 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:58.208 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858016+0000", 2020-11-16T20:56:58.209 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042048220999999997 2020-11-16T20:56:58.209 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.209 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:58.209 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.209 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.209 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.209 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:650 3.2 3:4fbd4ff5:::smithi16641208-419:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e87)", 2020-11-16T20:56:58.209 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.816105+0000", 2020-11-16T20:56:58.210 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.200758252, 2020-11-16T20:56:58.210 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042242304000000001, 2020-11-16T20:56:58.210 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:58.210 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:58.210 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:58.210 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.210 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:58.211 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816105+0000", 2020-11-16T20:56:58.211 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:58.211 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.211 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.211 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:58.211 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816105+0000", 2020-11-16T20:56:58.211 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6486999999999999e-05 2020-11-16T20:56:58.212 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.212 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.212 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:58.212 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816132+0000", 2020-11-16T20:56:58.212 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5230000000000003e-06 2020-11-16T20:56:58.212 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.212 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.212 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:58.213 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816137+0000", 2020-11-16T20:56:58.213 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1498000000000001e-05 2020-11-16T20:56:58.213 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.213 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.213 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:58.213 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816149+0000", 2020-11-16T20:56:58.213 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5789999999999997e-06 2020-11-16T20:56:58.214 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.214 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.214 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.214 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816153+0000", 2020-11-16T20:56:58.214 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00044901199999999999 2020-11-16T20:56:58.214 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.214 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.214 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.215 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816602+0000", 2020-11-16T20:56:58.215 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6134000000000002e-05 2020-11-16T20:56:58.215 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.215 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.215 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.215 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816649+0000", 2020-11-16T20:56:58.215 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032065206999999998 2020-11-16T20:56:58.216 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.216 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.216 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.216 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848714+0000", 2020-11-16T20:56:58.216 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000103695 2020-11-16T20:56:58.216 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.216 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.216 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:58.217 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848818+0000", 2020-11-16T20:56:58.217 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092315220000000007 2020-11-16T20:56:58.217 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.217 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.217 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.217 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858049+0000", 2020-11-16T20:56:58.217 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000104415 2020-11-16T20:56:58.218 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.218 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.218 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:58.218 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858153+0000", 2020-11-16T20:56:58.218 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019423199999999999 2020-11-16T20:56:58.218 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.218 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.219 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:58.219 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858348+0000", 2020-11-16T20:56:58.219 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042242304000000001 2020-11-16T20:56:58.219 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.219 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:58.219 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.219 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.219 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.220 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:651 3.2 3:4fbd4ff5:::smithi16641208-419:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e87)", 2020-11-16T20:56:58.220 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.816182+0000", 2020-11-16T20:56:58.220 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.2006817569999999, 2020-11-16T20:56:58.220 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047784220000000002, 2020-11-16T20:56:58.220 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:56:58.220 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:56:58.220 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:56:58.221 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.221 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:56:58.221 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816182+0000", 2020-11-16T20:56:58.221 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:56:58.221 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.221 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.221 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:56:58.221 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816182+0000", 2020-11-16T20:56:58.222 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6310999999999998e-05 2020-11-16T20:56:58.222 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.222 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.222 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:56:58.222 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816218+0000", 2020-11-16T20:56:58.222 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6110000000000001e-06 2020-11-16T20:56:58.222 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.223 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.223 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:56:58.223 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816224+0000", 2020-11-16T20:56:58.223 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9189999999999994e-06 2020-11-16T20:56:58.223 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.223 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.223 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:56:58.224 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816234+0000", 2020-11-16T20:56:58.224 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3220000000000003e-06 2020-11-16T20:56:58.224 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.224 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.224 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.224 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816238+0000", 2020-11-16T20:56:58.224 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00043294900000000002 2020-11-16T20:56:58.224 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.225 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.225 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.225 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816671+0000", 2020-11-16T20:56:58.225 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3359999999999998e-05 2020-11-16T20:56:58.225 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.225 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.225 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.226 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816714+0000", 2020-11-16T20:56:58.226 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032137410999999998 2020-11-16T20:56:58.226 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.226 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.226 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.226 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848852+0000", 2020-11-16T20:56:58.226 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000103235 2020-11-16T20:56:58.226 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.227 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.227 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:58.227 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848955+0000", 2020-11-16T20:56:58.227 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094266409999999995 2020-11-16T20:56:58.227 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.227 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.227 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:56:58.228 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858382+0000", 2020-11-16T20:56:58.228 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7973999999999995e-05 2020-11-16T20:56:58.228 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.228 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.228 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:56:58.228 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858470+0000", 2020-11-16T20:56:58.228 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054964870000000004 2020-11-16T20:56:58.228 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:56:58.229 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:56:58.229 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:56:58.229 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.863966+0000", 2020-11-16T20:56:58.229 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047784220000000002 2020-11-16T20:56:58.229 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.229 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:58.229 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.230 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:56:58.230 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:56:58.230 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:56:58.231 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:56:58.232 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:58.236+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:58.332 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:58.337+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:58.380 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:58.380 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:58.381 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:56:58.381 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:58.391 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:56:58.435 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:56:58.440+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:56:58.526 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:58.526 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:58.526 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:56:58.526 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:56:58.526 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:58.534 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:56:58.539+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:56:58.535 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:56:58.635 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:58.640+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:58.712 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:58.713 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:56:58.713 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:56:58.713 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:56:58.713 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.713 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2370 4.1 4:82bb0fe7:::smithi16641208-101:head [write 2346424~426830] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:58.713 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:56:58.714 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 53.661334230000001, 2020-11-16T20:56:58.714 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04706581, 2020-11-16T20:56:58.714 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:58.714 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.714 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:58.714 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:58.715 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:58.715 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2370 2020-11-16T20:56:58.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.715 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:58.715 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.715 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:58.716 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:56:58.716 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:58.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.716 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.716 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:58.716 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:56:58.717 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011081520000000001 2020-11-16T20:56:58.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.717 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.717 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:58.717 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055391+0000", 2020-11-16T20:56:58.717 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8289999999999996e-06 2020-11-16T20:56:58.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.718 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.718 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:58.718 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055397+0000", 2020-11-16T20:56:58.718 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7599999999999997e-06 2020-11-16T20:56:58.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.718 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.718 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:58.719 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055407+0000", 2020-11-16T20:56:58.719 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4180000000000002e-06 2020-11-16T20:56:58.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.719 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.719 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.719 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055413+0000", 2020-11-16T20:56:58.719 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1767000000000001e-05 2020-11-16T20:56:58.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.720 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.720 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055465+0000", 2020-11-16T20:56:58.720 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1916999999999998e-05 2020-11-16T20:56:58.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.721 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.721 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055517+0000", 2020-11-16T20:56:58.721 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027302192999999999 2020-11-16T20:56:58.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.721 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.721 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.721 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.082819+0000", 2020-11-16T20:56:58.722 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013272199999999999 2020-11-16T20:56:58.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.722 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.722 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:58.722 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.082952+0000", 2020-11-16T20:56:58.722 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000218574 2020-11-16T20:56:58.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.723 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.723 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:58.723 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083171+0000", 2020-11-16T20:56:58.723 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016037374 2020-11-16T20:56:58.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.723 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.723 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:58.724 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099208+0000", 2020-11-16T20:56:58.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001621248 2020-11-16T20:56:58.724 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.724 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.724 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.724 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100829+0000", 2020-11-16T20:56:58.725 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039884700000000003 2020-11-16T20:56:58.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.725 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.725 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.725 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101228+0000", 2020-11-16T20:56:58.725 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1977000000000006e-05 2020-11-16T20:56:58.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.726 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:58.726 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101300+0000", 2020-11-16T20:56:58.726 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9032000000000001e-05 2020-11-16T20:56:58.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.726 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:58.727 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101349+0000", 2020-11-16T20:56:58.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04706581 2020-11-16T20:56:58.727 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.727 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:58.727 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.727 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2371 4.1 4:82bb0fe7:::smithi16641208-101:head [setxattr _header (57) in=7b,truncate 2773254] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:56:58.728 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.055441+0000", 2020-11-16T20:56:58.728 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 53.660176313000001, 2020-11-16T20:56:58.728 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046178253000000002, 2020-11-16T20:56:58.728 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:58.728 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.728 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:58.729 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:58.729 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:58.729 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2371 2020-11-16T20:56:58.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.729 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:58.729 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.729 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:58.729 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055441+0000", 2020-11-16T20:56:58.730 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:58.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.730 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.730 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:58.730 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055441+0000", 2020-11-16T20:56:58.730 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4688999999999999e-05 2020-11-16T20:56:58.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.731 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:58.731 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055476+0000", 2020-11-16T20:56:58.731 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8220000000000003e-06 2020-11-16T20:56:58.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.731 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:58.732 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055482+0000", 2020-11-16T20:56:58.732 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0340000000000002e-06 2020-11-16T20:56:58.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.732 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:58.732 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055488+0000", 2020-11-16T20:56:58.732 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.49e-06 2020-11-16T20:56:58.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.733 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.733 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.733 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055491+0000", 2020-11-16T20:56:58.733 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6255999999999998e-05 2020-11-16T20:56:58.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.733 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.733 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.734 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055547+0000", 2020-11-16T20:56:58.734 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6068000000000005e-05 2020-11-16T20:56:58.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.734 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.734 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.734 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055614+0000", 2020-11-16T20:56:58.734 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.028667674000000001 2020-11-16T20:56:58.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.735 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.735 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.735 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084281+0000", 2020-11-16T20:56:58.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000104868 2020-11-16T20:56:58.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.735 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.735 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:58.736 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084386+0000", 2020-11-16T20:56:58.736 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015165799999999999 2020-11-16T20:56:58.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.736 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.736 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:56:58.736 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084538+0000", 2020-11-16T20:56:58.736 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014678207 2020-11-16T20:56:58.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.737 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.737 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:58.737 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099216+0000", 2020-11-16T20:56:58.737 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0016622550000000001 2020-11-16T20:56:58.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.737 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.737 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.738 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100878+0000", 2020-11-16T20:56:58.738 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00061087000000000001 2020-11-16T20:56:58.738 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.738 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.738 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.738 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101489+0000", 2020-11-16T20:56:58.738 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0320000000000004e-05 2020-11-16T20:56:58.739 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.739 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:58.739 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101559+0000", 2020-11-16T20:56:58.739 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0041999999999999e-05 2020-11-16T20:56:58.739 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.740 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:58.740 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101619+0000", 2020-11-16T20:56:58.740 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046178253000000002 2020-11-16T20:56:58.740 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.740 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:58.740 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.741 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.741 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2372 4.1 4:82bb0fe7:::smithi16641208-101:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e42)", 2020-11-16T20:56:58.741 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:56:58.741 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 53.660105283999997, 2020-11-16T20:56:58.741 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046557016999999999, 2020-11-16T20:56:58.741 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:58.741 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:58.742 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:58.742 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:58.742 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:58.742 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2372 2020-11-16T20:56:58.742 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.742 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:58.742 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.742 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:58.743 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:56:58.743 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:58.743 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.743 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.743 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:58.743 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:56:58.743 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9907000000000001e-05 2020-11-16T20:56:58.744 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.744 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.744 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:58.744 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055532+0000", 2020-11-16T20:56:58.744 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0599999999999999e-06 2020-11-16T20:56:58.744 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.744 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.744 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:58.745 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055535+0000", 2020-11-16T20:56:58.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1430000000000003e-06 2020-11-16T20:56:58.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.745 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.745 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:58.745 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055541+0000", 2020-11-16T20:56:58.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6819999999999999e-06 2020-11-16T20:56:58.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.746 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.746 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055544+0000", 2020-11-16T20:56:58.746 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000102643 2020-11-16T20:56:58.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.747 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.747 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055647+0000", 2020-11-16T20:56:58.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7197000000000003e-05 2020-11-16T20:56:58.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.747 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.747 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.747 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055684+0000", 2020-11-16T20:56:58.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029347807 2020-11-16T20:56:58.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.085032+0000", 2020-11-16T20:56:58.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6130000000000005e-05 2020-11-16T20:56:58.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.749 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:58.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.085108+0000", 2020-11-16T20:56:58.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016542980999999998 2020-11-16T20:56:58.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.749 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101651+0000", 2020-11-16T20:56:58.750 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000118733 2020-11-16T20:56:58.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.750 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.750 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:58.750 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101769+0000", 2020-11-16T20:56:58.750 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029973400000000001 2020-11-16T20:56:58.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.750 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.751 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:58.751 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.102069+0000", 2020-11-16T20:56:58.751 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046557016999999999 2020-11-16T20:56:58.751 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.751 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:58.751 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.751 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.752 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.752 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2423 3.3 3:c5716d1e:::smithi16641208-111:head [copy-from ver 265] snapc 7=[7,5] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e46)", 2020-11-16T20:56:58.752 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:09.027460+0000", 2020-11-16T20:56:58.752 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 49.688157132000001, 2020-11-16T20:56:58.752 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.038337614999999998, 2020-11-16T20:56:58.752 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:58.752 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.753 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:58.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:58.753 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027460+0000", 2020-11-16T20:56:58.753 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:58.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:58.754 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027460+0000", 2020-11-16T20:56:58.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4963999999999998e-05 2020-11-16T20:56:58.754 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.754 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.754 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:58.754 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027505+0000", 2020-11-16T20:56:58.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.925e-05 2020-11-16T20:56:58.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.755 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:58.755 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027525+0000", 2020-11-16T20:56:58.755 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3959e-05 2020-11-16T20:56:58.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.756 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:58.756 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027539+0000", 2020-11-16T20:56:58.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8059999999999997e-06 2020-11-16T20:56:58.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.756 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.756 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.756 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027545+0000", 2020-11-16T20:56:58.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0037794289999999999 2020-11-16T20:56:58.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031325+0000", 2020-11-16T20:56:58.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000127613 2020-11-16T20:56:58.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:58.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031452+0000", 2020-11-16T20:56:58.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021049117999999999 2020-11-16T20:56:58.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:56:58.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.052502+0000", 2020-11-16T20:56:58.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012965061 2020-11-16T20:56:58.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.759 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065467+0000", 2020-11-16T20:56:58.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9788000000000003e-05 2020-11-16T20:56:58.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065536+0000", 2020-11-16T20:56:58.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013262699999999999 2020-11-16T20:56:58.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:58.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065669+0000", 2020-11-16T20:56:58.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4404999999999999e-05 2020-11-16T20:56:58.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.761 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:58.761 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065713+0000", 2020-11-16T20:56:58.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4594999999999999e-05 2020-11-16T20:56:58.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:58.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065798+0000", 2020-11-16T20:56:58.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.038337614999999998 2020-11-16T20:56:58.762 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.762 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:58.762 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.763 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:577 3.3 3:c5716d1e:::smithi16641208-111:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e46)", 2020-11-16T20:56:58.763 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:09.027581+0000", 2020-11-16T20:56:58.763 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 49.688036689, 2020-11-16T20:56:58.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.038487691999999997, 2020-11-16T20:56:58.763 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:58.763 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:58.764 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:58.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:58.764 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027581+0000", 2020-11-16T20:56:58.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:58.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:58.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027581+0000", 2020-11-16T20:56:58.765 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3422e-05 2020-11-16T20:56:58.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.765 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:58.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027614+0000", 2020-11-16T20:56:58.765 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1710000000000002e-06 2020-11-16T20:56:58.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:58.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027622+0000", 2020-11-16T20:56:58.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2265e-05 2020-11-16T20:56:58.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.767 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:58.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027635+0000", 2020-11-16T20:56:58.767 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4700000000000001e-06 2020-11-16T20:56:58.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.767 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027640+0000", 2020-11-16T20:56:58.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0040006759999999999 2020-11-16T20:56:58.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.768 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.768 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031641+0000", 2020-11-16T20:56:58.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4350000000000006e-05 2020-11-16T20:56:58.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031705+0000", 2020-11-16T20:56:58.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029225991999999999 2020-11-16T20:56:58.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.060931+0000", 2020-11-16T20:56:58.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013316099999999999 2020-11-16T20:56:58.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.770 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:58.770 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.061064+0000", 2020-11-16T20:56:58.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047860919999999996 2020-11-16T20:56:58.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.771 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.771 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065850+0000", 2020-11-16T20:56:58.771 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1691e-05 2020-11-16T20:56:58.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.771 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:58.771 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065942+0000", 2020-11-16T20:56:58.772 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012640199999999999 2020-11-16T20:56:58.772 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.772 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.772 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:58.772 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.066068+0000", 2020-11-16T20:56:58.772 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.038487691999999997 2020-11-16T20:56:58.772 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.772 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:58.773 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.773 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:578 3.3 3:c5716d1e:::smithi16641208-111:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e46)", 2020-11-16T20:56:58.773 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:09.027672+0000", 2020-11-16T20:56:58.773 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 49.687945575000001, 2020-11-16T20:56:58.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.043041498999999997, 2020-11-16T20:56:58.774 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:58.774 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:58.774 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:58.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:58.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027672+0000", 2020-11-16T20:56:58.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:58.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:58.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027672+0000", 2020-11-16T20:56:58.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2234000000000003e-05 2020-11-16T20:56:58.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:58.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027714+0000", 2020-11-16T20:56:58.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5910000000000001e-06 2020-11-16T20:56:58.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:58.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027721+0000", 2020-11-16T20:56:58.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1319e-05 2020-11-16T20:56:58.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:58.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027732+0000", 2020-11-16T20:56:58.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7919999999999998e-06 2020-11-16T20:56:58.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027738+0000", 2020-11-16T20:56:58.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0040456559999999999 2020-11-16T20:56:58.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031784+0000", 2020-11-16T20:56:58.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9271999999999999e-05 2020-11-16T20:56:58.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031833+0000", 2020-11-16T20:56:58.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029282580999999999 2020-11-16T20:56:58.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.061115+0000", 2020-11-16T20:56:58.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6058999999999998e-05 2020-11-16T20:56:58.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:58.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.061191+0000", 2020-11-16T20:56:58.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049009099999999996 2020-11-16T20:56:58.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.066092+0000", 2020-11-16T20:56:58.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7039999999999995e-05 2020-11-16T20:56:58.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:58.782 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.066159+0000", 2020-11-16T20:56:58.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045540449999999996 2020-11-16T20:56:58.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.782 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:58.782 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.070713+0000", 2020-11-16T20:56:58.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.043041498999999997 2020-11-16T20:56:58.783 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.783 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:58.783 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.783 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.783 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2427 4.1 4:a1b421f3:::smithi16641208-471:head [cache-flush] snapc 0=[] ondisk+read+ignore_cache+known_if_redirected e47)", 2020-11-16T20:56:58.783 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:10.015762+0000", 2020-11-16T20:56:58.784 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 48.699855135999996, 2020-11-16T20:56:58.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036562619999999997, 2020-11-16T20:56:58.784 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:58.784 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:58.784 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:58.784 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:58.784 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:58.784 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2427 2020-11-16T20:56:58.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.785 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:58.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:58.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015762+0000", 2020-11-16T20:56:58.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:58.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.786 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:58.786 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015762+0000", 2020-11-16T20:56:58.786 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8266999999999999e-05 2020-11-16T20:56:58.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.786 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:58.787 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015791+0000", 2020-11-16T20:56:58.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3263e-05 2020-11-16T20:56:58.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.787 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:58.787 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015804+0000", 2020-11-16T20:56:58.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1194e-05 2020-11-16T20:56:58.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:58.788 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015815+0000", 2020-11-16T20:56:58.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9799999999999998e-06 2020-11-16T20:56:58.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015823+0000", 2020-11-16T20:56:58.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0092000000000006e-05 2020-11-16T20:56:58.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015893+0000", 2020-11-16T20:56:58.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4109999999999996e-06 2020-11-16T20:56:58.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.790 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2020-11-16T20:56:58.790 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015902+0000", 2020-11-16T20:56:58.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0024786610000000001 2020-11-16T20:56:58.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.791 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.791 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.018380+0000", 2020-11-16T20:56:58.791 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016238599999999999 2020-11-16T20:56:58.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.791 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:58.791 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.018543+0000", 2020-11-16T20:56:58.791 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.033540168000000002 2020-11-16T20:56:58.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.052083+0000", 2020-11-16T20:56:58.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014603000000000001 2020-11-16T20:56:58.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:58.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.052229+0000", 2020-11-16T20:56:58.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6168000000000005e-05 2020-11-16T20:56:58.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:58.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.052325+0000", 2020-11-16T20:56:58.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036562619999999997 2020-11-16T20:56:58.794 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.794 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:58.794 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.794 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2503 4.1 4:b0538c7c:::smithi16641208-136:head [write 1790337~563515] snapc f=[f,e,d,5] ondisk+write+known_if_redirected e52)", 2020-11-16T20:56:58.794 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:56:58.795 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.968909781000001, 2020-11-16T20:56:58.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089724989000000005, 2020-11-16T20:56:58.795 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:58.795 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.795 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:58.795 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:58.795 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:58.796 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2503 2020-11-16T20:56:58.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.796 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:58.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:58.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:56:58.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:58.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:58.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:56:58.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00060419599999999999 2020-11-16T20:56:58.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:58.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747312+0000", 2020-11-16T20:56:58.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.319e-06 2020-11-16T20:56:58.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:58.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747318+0000", 2020-11-16T20:56:58.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5100000000000004e-06 2020-11-16T20:56:58.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:58.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747328+0000", 2020-11-16T20:56:58.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6369999999999999e-06 2020-11-16T20:56:58.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747335+0000", 2020-11-16T20:56:58.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001800479 2020-11-16T20:56:58.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.800 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749136+0000", 2020-11-16T20:56:58.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7970000000000002e-05 2020-11-16T20:56:58.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749194+0000", 2020-11-16T20:56:58.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030847998000000001 2020-11-16T20:56:58.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780042+0000", 2020-11-16T20:56:58.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013142199999999999 2020-11-16T20:56:58.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:58.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780173+0000", 2020-11-16T20:56:58.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022398200000000001 2020-11-16T20:56:58.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:56:58.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780397+0000", 2020-11-16T20:56:58.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061389269999999998 2020-11-16T20:56:58.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786536+0000", 2020-11-16T20:56:58.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3673999999999998e-05 2020-11-16T20:56:58.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:58.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786630+0000", 2020-11-16T20:56:58.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049513384000000001 2020-11-16T20:56:58.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836143+0000", 2020-11-16T20:56:58.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4713000000000001e-05 2020-11-16T20:56:58.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:58.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836218+0000", 2020-11-16T20:56:58.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000214778 2020-11-16T20:56:58.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:58.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836433+0000", 2020-11-16T20:56:58.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089724989000000005 2020-11-16T20:56:58.807 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.807 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:58.807 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.807 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2504 4.1 4:b0538c7c:::smithi16641208-136:head [setxattr _header (58) in=7b,truncate 2991745] snapc f=[f,e,d,5] ondisk+write+known_if_redirected e52)", 2020-11-16T20:56:58.807 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:56:58.808 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.968235411000002, 2020-11-16T20:56:58.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089341162000000002, 2020-11-16T20:56:58.808 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:58.808 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.808 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:58.808 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:58.808 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:58.808 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2504 2020-11-16T20:56:58.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.809 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:58.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:58.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:56:58.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:58.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:58.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:56:58.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5520999999999999e-05 2020-11-16T20:56:58.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:58.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747438+0000", 2020-11-16T20:56:58.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2020-11-16T20:56:58.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:58.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747444+0000", 2020-11-16T20:56:58.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.661e-06 2020-11-16T20:56:58.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:58.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747451+0000", 2020-11-16T20:56:58.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6920000000000001e-06 2020-11-16T20:56:58.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747456+0000", 2020-11-16T20:56:58.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0017949769999999999 2020-11-16T20:56:58.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749251+0000", 2020-11-16T20:56:58.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114708 2020-11-16T20:56:58.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749366+0000", 2020-11-16T20:56:58.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032215049000000003 2020-11-16T20:56:58.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.781581+0000", 2020-11-16T20:56:58.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000181452 2020-11-16T20:56:58.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:58.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.781762+0000", 2020-11-16T20:56:58.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024118300000000001 2020-11-16T20:56:58.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:56:58.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782003+0000", 2020-11-16T20:56:58.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045997939999999999 2020-11-16T20:56:58.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786603+0000", 2020-11-16T20:56:58.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8782000000000002e-05 2020-11-16T20:56:58.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:58.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786642+0000", 2020-11-16T20:56:58.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049869098000000001 2020-11-16T20:56:58.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836511+0000", 2020-11-16T20:56:58.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4498000000000005e-05 2020-11-16T20:56:58.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:58.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836576+0000", 2020-11-16T20:56:58.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000147615 2020-11-16T20:56:58.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:58.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836723+0000", 2020-11-16T20:56:58.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089341162000000002 2020-11-16T20:56:58.820 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.820 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:58.820 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.820 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2505 4.1 4:b0538c7c:::smithi16641208-136:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e52)", 2020-11-16T20:56:58.820 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:56:58.821 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.968126282999997, 2020-11-16T20:56:58.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089929617000000003, 2020-11-16T20:56:58.821 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:58.821 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:58.821 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:58.821 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:58.821 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:58.822 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2505 2020-11-16T20:56:58.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.822 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:58.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:58.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:56:58.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:58.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:58.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:56:58.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1894999999999999e-05 2020-11-16T20:56:58.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:58.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747523+0000", 2020-11-16T20:56:58.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3900000000000003e-06 2020-11-16T20:56:58.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:58.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747527+0000", 2020-11-16T20:56:58.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8169999999999999e-06 2020-11-16T20:56:58.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:58.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747535+0000", 2020-11-16T20:56:58.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6449999999999998e-06 2020-11-16T20:56:58.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747539+0000", 2020-11-16T20:56:58.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0018868209999999999 2020-11-16T20:56:58.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749426+0000", 2020-11-16T20:56:58.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4963000000000002e-05 2020-11-16T20:56:58.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749481+0000", 2020-11-16T20:56:58.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032915959000000002 2020-11-16T20:56:58.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782397+0000", 2020-11-16T20:56:58.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018449499999999999 2020-11-16T20:56:58.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:58.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782581+0000", 2020-11-16T20:56:58.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054195457000000002 2020-11-16T20:56:58.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836777+0000", 2020-11-16T20:56:58.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000214584 2020-11-16T20:56:58.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:58.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836991+0000", 2020-11-16T20:56:58.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000429591 2020-11-16T20:56:58.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:58.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.837421+0000", 2020-11-16T20:56:58.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089929617000000003 2020-11-16T20:56:58.831 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.831 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:58.831 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.831 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2593 3.3 3:f5f8fa2a:::smithi16641208-144:head [copy-from ver 64] snapc 14=[12,f,5] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e57)", 2020-11-16T20:56:58.831 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:56:58.832 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 38.928977422000003, 2020-11-16T20:56:58.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064638111999999998, 2020-11-16T20:56:58.832 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:58.832 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.832 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:58.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:58.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:56:58.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:58.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:58.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:56:58.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3655999999999998e-05 2020-11-16T20:56:58.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:58.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786664+0000", 2020-11-16T20:56:58.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1850000000000003e-06 2020-11-16T20:56:58.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:58.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786669+0000", 2020-11-16T20:56:58.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0861e-05 2020-11-16T20:56:58.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:58.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786680+0000", 2020-11-16T20:56:58.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6749999999999996e-06 2020-11-16T20:56:58.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786686+0000", 2020-11-16T20:56:58.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2327000000000003e-05 2020-11-16T20:56:58.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786729+0000", 2020-11-16T20:56:58.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000156143 2020-11-16T20:56:58.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:58.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786885+0000", 2020-11-16T20:56:58.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024103846000000002 2020-11-16T20:56:58.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:56:58.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810989+0000", 2020-11-16T20:56:58.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018870436000000001 2020-11-16T20:56:58.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829859+0000", 2020-11-16T20:56:58.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021210896 2020-11-16T20:56:58.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851070+0000", 2020-11-16T20:56:58.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3708e-05 2020-11-16T20:56:58.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:58.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851084+0000", 2020-11-16T20:56:58.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7329e-05 2020-11-16T20:56:58.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:58.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851131+0000", 2020-11-16T20:56:58.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014705 2020-11-16T20:56:58.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:58.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851278+0000", 2020-11-16T20:56:58.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064638111999999998 2020-11-16T20:56:58.841 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.842 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:58.842 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.842 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:616 3.3 3:f5f8fa2a:::smithi16641208-144:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e57)", 2020-11-16T20:56:58.842 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:56:58.842 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 38.928886767999998, 2020-11-16T20:56:58.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064784234999999996, 2020-11-16T20:56:58.843 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:58.843 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:58.843 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:58.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:58.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:56:58.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:58.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:58.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:56:58.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8559999999999998e-05 2020-11-16T20:56:58.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:58.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786749+0000", 2020-11-16T20:56:58.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4549999999999997e-06 2020-11-16T20:56:58.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:58.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786754+0000", 2020-11-16T20:56:58.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4980000000000006e-06 2020-11-16T20:56:58.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:58.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786762+0000", 2020-11-16T20:56:58.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9790000000000004e-06 2020-11-16T20:56:58.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786766+0000", 2020-11-16T20:56:58.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029976900000000002 2020-11-16T20:56:58.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787066+0000", 2020-11-16T20:56:58.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3581999999999998e-05 2020-11-16T20:56:58.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787100+0000", 2020-11-16T20:56:58.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.037252078000000001 2020-11-16T20:56:58.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824352+0000", 2020-11-16T20:56:58.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000124189 2020-11-16T20:56:58.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:58.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824476+0000", 2020-11-16T20:56:58.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026883987000000002 2020-11-16T20:56:58.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851360+0000", 2020-11-16T20:56:58.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6365999999999994e-05 2020-11-16T20:56:58.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:58.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851426+0000", 2020-11-16T20:56:58.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8771999999999996e-05 2020-11-16T20:56:58.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:58.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851515+0000", 2020-11-16T20:56:58.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064784234999999996 2020-11-16T20:56:58.852 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.852 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:58.852 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.852 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:617 3.3 3:f5f8fa2a:::smithi16641208-144:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e57)", 2020-11-16T20:56:58.853 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:56:58.853 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 38.928816453000003, 2020-11-16T20:56:58.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.069756316999999998, 2020-11-16T20:56:58.853 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:58.853 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:56:58.853 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:58.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:58.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:56:58.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:58.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:58.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:56:58.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3865000000000002e-05 2020-11-16T20:56:58.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:58.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786835+0000", 2020-11-16T20:56:58.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6949999999999999e-06 2020-11-16T20:56:58.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:58.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786840+0000", 2020-11-16T20:56:58.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3559999999999999e-06 2020-11-16T20:56:58.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:58.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786849+0000", 2020-11-16T20:56:58.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.045e-06 2020-11-16T20:56:58.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786854+0000", 2020-11-16T20:56:58.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026743999999999997 2020-11-16T20:56:58.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787121+0000", 2020-11-16T20:56:58.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8912000000000001e-05 2020-11-16T20:56:58.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787180+0000", 2020-11-16T20:56:58.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.042545010000000001 2020-11-16T20:56:58.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829725+0000", 2020-11-16T20:56:58.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3979000000000003e-05 2020-11-16T20:56:58.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:56:58.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829819+0000", 2020-11-16T20:56:58.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021745652000000001 2020-11-16T20:56:58.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851565+0000", 2020-11-16T20:56:58.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000102064 2020-11-16T20:56:58.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:58.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851667+0000", 2020-11-16T20:56:58.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048902989999999999 2020-11-16T20:56:58.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:58.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856557+0000", 2020-11-16T20:56:58.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.069756316999999998 2020-11-16T20:56:58.862 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.862 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:58.862 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.863 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:618 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'243, mlcod=57'241)", 2020-11-16T20:56:58.863 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:56:58.863 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 38.915997329, 2020-11-16T20:56:58.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048895281999999998, 2020-11-16T20:56:58.863 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:58.863 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.863 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:58.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:58.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:56:58.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:58.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:58.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:56:58.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017163861999999998 2020-11-16T20:56:58.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:58.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816784+0000", 2020-11-16T20:56:58.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7071e-05 2020-11-16T20:56:58.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:58.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816801+0000", 2020-11-16T20:56:58.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6405e-05 2020-11-16T20:56:58.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:58.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816818+0000", 2020-11-16T20:56:58.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3030999999999999e-05 2020-11-16T20:56:58.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816831+0000", 2020-11-16T20:56:58.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4610000000000007e-05 2020-11-16T20:56:58.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816895+0000", 2020-11-16T20:56:58.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4202999999999998e-05 2020-11-16T20:56:58.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:58.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816929+0000", 2020-11-16T20:56:58.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.031527016999999997 2020-11-16T20:56:58.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:58.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.848456+0000", 2020-11-16T20:56:58.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9083000000000003e-05 2020-11-16T20:56:58.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:58.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.848515+0000", 2020-11-16T20:56:58.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048895281999999998 2020-11-16T20:56:58.870 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.870 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:58.870 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.871 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:618 3.3 3:d775beee:::smithi16641208-10:head [copy-from ver 12] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:56:58.871 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:56:58.871 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 38.906815260000002, 2020-11-16T20:56:58.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047870862, 2020-11-16T20:56:58.871 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:58.871 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.872 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:58.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.872 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:58.872 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:56:58.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:58.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:58.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:56:58.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0958999999999999e-05 2020-11-16T20:56:58.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:58.873 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808843+0000", 2020-11-16T20:56:58.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1294000000000001e-05 2020-11-16T20:56:58.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:58.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808854+0000", 2020-11-16T20:56:58.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8553999999999997e-05 2020-11-16T20:56:58.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:58.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808893+0000", 2020-11-16T20:56:58.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1985e-05 2020-11-16T20:56:58.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808905+0000", 2020-11-16T20:56:58.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7309000000000001e-05 2020-11-16T20:56:58.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808982+0000", 2020-11-16T20:56:58.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016374099999999999 2020-11-16T20:56:58.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:58.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809146+0000", 2020-11-16T20:56:58.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015955815000000002 2020-11-16T20:56:58.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:56:58.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.825102+0000", 2020-11-16T20:56:58.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048434799999999998 2020-11-16T20:56:58.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829945+0000", 2020-11-16T20:56:58.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021349677000000001 2020-11-16T20:56:58.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:58.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851295+0000", 2020-11-16T20:56:58.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052994100000000001 2020-11-16T20:56:58.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856594+0000", 2020-11-16T20:56:58.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3349000000000001e-05 2020-11-16T20:56:58.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:58.881 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856638+0000", 2020-11-16T20:56:58.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5289e-05 2020-11-16T20:56:58.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.881 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.881 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:58.881 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856673+0000", 2020-11-16T20:56:58.881 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047870862 2020-11-16T20:56:58.882 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.882 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:58.882 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.882 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.882 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:619 3.3 3:d79d68cf:::smithi16641208-37:head [copy-from ver 27] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:56:58.882 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:56:58.882 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 38.906256669999998, 2020-11-16T20:56:58.883 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047415915000000003, 2020-11-16T20:56:58.883 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:58.883 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.883 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:58.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.883 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:58.883 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:56:58.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:58.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.884 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.884 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:58.884 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:56:58.884 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3012000000000002e-05 2020-11-16T20:56:58.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.885 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:58.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809394+0000", 2020-11-16T20:56:58.885 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1699999999999996e-06 2020-11-16T20:56:58.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.885 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.885 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:58.885 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809399+0000", 2020-11-16T20:56:58.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2390000000000008e-06 2020-11-16T20:56:58.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.886 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.886 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:58.886 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809408+0000", 2020-11-16T20:56:58.886 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0259999999999998e-06 2020-11-16T20:56:58.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.887 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809413+0000", 2020-11-16T20:56:58.887 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0359999999999996e-05 2020-11-16T20:56:58.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.887 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.887 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.888 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809494+0000", 2020-11-16T20:56:58.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019616600000000001 2020-11-16T20:56:58.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.888 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.888 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:58.888 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809690+0000", 2020-11-16T20:56:58.888 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017673003999999999 2020-11-16T20:56:58.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:56:58.889 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.827363+0000", 2020-11-16T20:56:58.889 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006463033 2020-11-16T20:56:58.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.889 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.890 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.833826+0000", 2020-11-16T20:56:58.890 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017479913999999999 2020-11-16T20:56:58.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.890 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.890 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:58.890 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851306+0000", 2020-11-16T20:56:58.890 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054026500000000002 2020-11-16T20:56:58.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.891 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.891 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856708+0000", 2020-11-16T20:56:58.891 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8121999999999999e-05 2020-11-16T20:56:58.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.891 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.891 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:58.892 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856747+0000", 2020-11-16T20:56:58.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0219e-05 2020-11-16T20:56:58.892 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.892 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.892 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:58.892 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856777+0000", 2020-11-16T20:56:58.892 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047415915000000003 2020-11-16T20:56:58.893 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.893 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:58.893 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.893 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.893 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2990 4.1 4:b964d1b5:::smithi16641208-359:head [rollback 25] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:56:58.893 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:48.838164+0000", 2020-11-16T20:56:58.893 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.8774537729999992, 2020-11-16T20:56:58.894 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041467088999999999, 2020-11-16T20:56:58.894 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:58.894 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.894 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:58.894 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:58.894 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:58.895 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2990 2020-11-16T20:56:58.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.895 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:58.895 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.895 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:58.895 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838164+0000", 2020-11-16T20:56:58.895 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:58.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.896 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:58.896 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838164+0000", 2020-11-16T20:56:58.896 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5457000000000001e-05 2020-11-16T20:56:58.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.896 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.896 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:58.897 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838179+0000", 2020-11-16T20:56:58.897 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2140000000000001e-06 2020-11-16T20:56:58.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.897 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.897 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:58.897 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838182+0000", 2020-11-16T20:56:58.897 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4210000000000003e-06 2020-11-16T20:56:58.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.898 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:58.898 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838188+0000", 2020-11-16T20:56:58.898 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6560000000000001e-06 2020-11-16T20:56:58.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.898 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.899 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838190+0000", 2020-11-16T20:56:58.899 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000113182 2020-11-16T20:56:58.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.899 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.899 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.899 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838304+0000", 2020-11-16T20:56:58.899 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3859999999999996e-06 2020-11-16T20:56:58.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.900 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.900 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:58.900 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838313+0000", 2020-11-16T20:56:58.900 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0032817229999999998 2020-11-16T20:56:58.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.900 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.841595+0000", 2020-11-16T20:56:58.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5017e-05 2020-11-16T20:56:58.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.901 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.901 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.901 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.841630+0000", 2020-11-16T20:56:58.901 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019647588000000001 2020-11-16T20:56:58.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.902 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.902 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.861277+0000", 2020-11-16T20:56:58.902 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012631900000000001 2020-11-16T20:56:58.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.902 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.903 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:58.903 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.861404+0000", 2020-11-16T20:56:58.903 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023259800000000001 2020-11-16T20:56:58.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.903 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.903 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.861636+0000", 2020-11-16T20:56:58.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2471e-05 2020-11-16T20:56:58.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.904 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.904 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.861679+0000", 2020-11-16T20:56:58.904 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0077306099999999997 2020-11-16T20:56:58.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.904 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.905 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.905 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.869409+0000", 2020-11-16T20:56:58.905 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000107871 2020-11-16T20:56:58.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.905 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.905 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:58.905 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.869517+0000", 2020-11-16T20:56:58.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000186925 2020-11-16T20:56:58.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.906 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:56:58.906 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.869704+0000", 2020-11-16T20:56:58.906 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0078131980000000004 2020-11-16T20:56:58.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.906 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.907 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.907 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.877517+0000", 2020-11-16T20:56:58.907 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3420000000000002e-05 2020-11-16T20:56:58.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.907 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.907 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.907 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.877551+0000", 2020-11-16T20:56:58.908 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7361000000000005e-05 2020-11-16T20:56:58.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.908 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for ondisk", 2020-11-16T20:56:58.908 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.877648+0000", 2020-11-16T20:56:58.908 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0010716079999999999 2020-11-16T20:56:58.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.909 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.909 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.878720+0000", 2020-11-16T20:56:58.909 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00080916500000000004 2020-11-16T20:56:58.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.909 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.909 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:58.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879529+0000", 2020-11-16T20:56:58.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3050000000000002e-05 2020-11-16T20:56:58.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.910 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.910 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:58.910 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879582+0000", 2020-11-16T20:56:58.910 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8848999999999999e-05 2020-11-16T20:56:58.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.911 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.911 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:58.911 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879631+0000", 2020-11-16T20:56:58.911 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041467088999999999 2020-11-16T20:56:58.911 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.911 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:58.911 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.912 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2991 4.1 4:b964d1b5:::smithi16641208-359:head [append 0~0] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:56:58.912 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:48.838212+0000", 2020-11-16T20:56:58.912 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.8774053669999997, 2020-11-16T20:56:58.912 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041594183999999999, 2020-11-16T20:56:58.912 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:58.913 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.913 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:58.913 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:58.913 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:58.913 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2991 2020-11-16T20:56:58.913 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.913 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:58.913 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:58.914 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838212+0000", 2020-11-16T20:56:58.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:58.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.914 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:58.915 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838212+0000", 2020-11-16T20:56:58.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5463000000000001e-05 2020-11-16T20:56:58.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.915 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:58.915 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838228+0000", 2020-11-16T20:56:58.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.931e-06 2020-11-16T20:56:58.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:58.916 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838231+0000", 2020-11-16T20:56:58.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1950000000000002e-06 2020-11-16T20:56:58.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:58.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838236+0000", 2020-11-16T20:56:58.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.452e-06 2020-11-16T20:56:58.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.917 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838238+0000", 2020-11-16T20:56:58.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011414 2020-11-16T20:56:58.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.918 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838352+0000", 2020-11-16T20:56:58.918 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3620000000000006e-06 2020-11-16T20:56:58.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.919 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:58.919 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838361+0000", 2020-11-16T20:56:58.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00330554 2020-11-16T20:56:58.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.920 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.920 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.841666+0000", 2020-11-16T20:56:58.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3979999999999994e-05 2020-11-16T20:56:58.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.920 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.920 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.841730+0000", 2020-11-16T20:56:58.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020004936000000001 2020-11-16T20:56:58.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.921 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.861735+0000", 2020-11-16T20:56:58.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5636999999999998e-05 2020-11-16T20:56:58.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.922 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.861771+0000", 2020-11-16T20:56:58.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015910761999999998 2020-11-16T20:56:58.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.922 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.877682+0000", 2020-11-16T20:56:58.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023008600000000001 2020-11-16T20:56:58.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:58.923 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.877912+0000", 2020-11-16T20:56:58.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000228681 2020-11-16T20:56:58.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:56:58.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.878140+0000", 2020-11-16T20:56:58.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0013827620000000001 2020-11-16T20:56:58.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879523+0000", 2020-11-16T20:56:58.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000115841 2020-11-16T20:56:58.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.925 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:58.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879639+0000", 2020-11-16T20:56:58.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4579999999999997e-05 2020-11-16T20:56:58.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.926 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879683+0000", 2020-11-16T20:56:58.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1173000000000005e-05 2020-11-16T20:56:58.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:58.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879745+0000", 2020-11-16T20:56:58.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1662999999999996e-05 2020-11-16T20:56:58.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:58.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879806+0000", 2020-11-16T20:56:58.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041594183999999999 2020-11-16T20:56:58.927 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.928 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:58.928 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.928 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2994 4.1 4:81514658:::smithi16641208-76:head [rollback 25] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:56:58.928 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:48.838310+0000", 2020-11-16T20:56:58.928 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.8773074770000004, 2020-11-16T20:56:58.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.058717898999999997, 2020-11-16T20:56:58.929 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:58.929 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.929 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:58.929 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:58.929 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:58.929 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2994 2020-11-16T20:56:58.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.930 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:58.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:58.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838310+0000", 2020-11-16T20:56:58.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:58.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.931 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:58.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838310+0000", 2020-11-16T20:56:58.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6189e-05 2020-11-16T20:56:58.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.931 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:58.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838326+0000", 2020-11-16T20:56:58.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7750000000000001e-06 2020-11-16T20:56:58.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:58.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838329+0000", 2020-11-16T20:56:58.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1170000000000003e-06 2020-11-16T20:56:58.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.933 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:58.933 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838334+0000", 2020-11-16T20:56:58.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5509999999999998e-06 2020-11-16T20:56:58.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.933 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.933 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838337+0000", 2020-11-16T20:56:58.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4969999999999995e-05 2020-11-16T20:56:58.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838422+0000", 2020-11-16T20:56:58.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6809999999999998e-06 2020-11-16T20:56:58.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:58.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838429+0000", 2020-11-16T20:56:58.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0036974120000000002 2020-11-16T20:56:58.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.842127+0000", 2020-11-16T20:56:58.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7267000000000005e-05 2020-11-16T20:56:58.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.842194+0000", 2020-11-16T20:56:58.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036580992999999999 2020-11-16T20:56:58.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.878775+0000", 2020-11-16T20:56:58.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015282199999999999 2020-11-16T20:56:58.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:58.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.878928+0000", 2020-11-16T20:56:58.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025942000000000001 2020-11-16T20:56:58.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879187+0000", 2020-11-16T20:56:58.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6735000000000003e-05 2020-11-16T20:56:58.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879264+0000", 2020-11-16T20:56:58.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0079699739999999995 2020-11-16T20:56:58.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.887234+0000", 2020-11-16T20:56:58.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011584899999999999 2020-11-16T20:56:58.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:58.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.887350+0000", 2020-11-16T20:56:58.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019960799999999999 2020-11-16T20:56:58.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:56:58.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.887549+0000", 2020-11-16T20:56:58.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059496410000000003 2020-11-16T20:56:58.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.942 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893499+0000", 2020-11-16T20:56:58.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8387999999999997e-05 2020-11-16T20:56:58.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.942 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for ondisk", 2020-11-16T20:56:58.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893557+0000", 2020-11-16T20:56:58.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1730000000000005e-05 2020-11-16T20:56:58.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893639+0000", 2020-11-16T20:56:58.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0030284309999999998 2020-11-16T20:56:58.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.944 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:58.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.896668+0000", 2020-11-16T20:56:58.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024878999999999998 2020-11-16T20:56:58.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.944 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.896916+0000", 2020-11-16T20:56:58.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6546999999999998e-05 2020-11-16T20:56:58.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:58.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.896983+0000", 2020-11-16T20:56:58.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5009000000000002e-05 2020-11-16T20:56:58.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:58.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.897028+0000", 2020-11-16T20:56:58.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.058717898999999997 2020-11-16T20:56:58.946 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.946 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:58.946 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.947 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2995 4.1 4:81514658:::smithi16641208-76:head [append 0~0] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:56:58.947 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:48.838353+0000", 2020-11-16T20:56:58.947 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.8772642170000005, 2020-11-16T20:56:58.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.061235559000000002, 2020-11-16T20:56:58.947 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:56:58.947 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:56:58.948 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:56:58.948 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:56:58.948 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:56:58.948 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2995 2020-11-16T20:56:58.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.948 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:56:58.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:56:58.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838353+0000", 2020-11-16T20:56:58.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:56:58.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:56:58.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838353+0000", 2020-11-16T20:56:58.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5333e-05 2020-11-16T20:56:58.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:56:58.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838369+0000", 2020-11-16T20:56:58.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6699999999999998e-06 2020-11-16T20:56:58.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:56:58.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838371+0000", 2020-11-16T20:56:58.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9450000000000001e-06 2020-11-16T20:56:58.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:56:58.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838376+0000", 2020-11-16T20:56:58.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3810000000000002e-06 2020-11-16T20:56:58.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.952 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:56:58.952 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838379+0000", 2020-11-16T20:56:58.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6501000000000006e-05 2020-11-16T20:56:58.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.953 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838445+0000", 2020-11-16T20:56:58.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7589999999999999e-06 2020-11-16T20:56:58.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.953 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.953 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:56:58.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838449+0000", 2020-11-16T20:56:58.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003788249 2020-11-16T20:56:58.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.842237+0000", 2020-11-16T20:56:58.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4104999999999997e-05 2020-11-16T20:56:58.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.842301+0000", 2020-11-16T20:56:58.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.037139272000000001 2020-11-16T20:56:58.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879440+0000", 2020-11-16T20:56:58.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3401e-05 2020-11-16T20:56:58.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:56:58.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879484+0000", 2020-11-16T20:56:58.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014179615 2020-11-16T20:56:58.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:56:58.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893664+0000", 2020-11-16T20:56:58.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6710000000000002e-05 2020-11-16T20:56:58.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:56:58.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893750+0000", 2020-11-16T20:56:58.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015452900000000001 2020-11-16T20:56:58.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:56:58.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893905+0000", 2020-11-16T20:56:58.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0013753280000000001 2020-11-16T20:56:58.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.895280+0000", 2020-11-16T20:56:58.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014309889999999999 2020-11-16T20:56:58.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:56:58.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.896711+0000", 2020-11-16T20:56:58.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0027635649999999999 2020-11-16T20:56:58.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:56:58.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.899475+0000", 2020-11-16T20:56:58.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3380999999999997e-05 2020-11-16T20:56:58.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:56:58.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.899518+0000", 2020-11-16T20:56:58.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0826000000000003e-05 2020-11-16T20:56:58.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:56:58.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:56:58.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:56:58.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.899589+0000", 2020-11-16T20:56:58.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.061235559000000002 2020-11-16T20:56:58.962 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.962 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:58.962 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.963 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:56:58.963 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:56:58.963 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:58.964 INFO:teuthology.orchestra.run.smithi166.stderr:noscrub is set 2020-11-16T20:56:58.965 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:58.969+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:58.965 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:56:59.065 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:56:59.069+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:56:59.101 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:59.101 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:59.101 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:56:59.101 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:59.110 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:56:59.166 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:56:59.171+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:56:59.268 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:59.273+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:59.294 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:59.294 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:56:59.294 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:56:59.294 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:56:59.294 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:56:59.303 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:56:59.369 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:56:59.374+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:56:59.440 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:56:59.440 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:56:59.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:57:03.714 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:57:03.714 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.715 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:37 4.1 e33/22 4:b6545a47:::smithi16641208-46:head v 33'28, mlcod=33'26)", 2020-11-16T20:57:03.715 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.515282+0000", 2020-11-16T20:57:03.715 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.928917087000002, 2020-11-16T20:57:03.715 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016792344000000001, 2020-11-16T20:57:03.715 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:03.715 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:03.715 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:03.716 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.716 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:03.716 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.515282+0000", 2020-11-16T20:57:03.716 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:03.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.716 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.716 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:03.717 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.515282+0000", 2020-11-16T20:57:03.717 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0010571840000000001 2020-11-16T20:57:03.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.717 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.717 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:03.717 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516339+0000", 2020-11-16T20:57:03.717 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3354e-05 2020-11-16T20:57:03.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.718 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.718 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:03.718 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516352+0000", 2020-11-16T20:57:03.718 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7071999999999998e-05 2020-11-16T20:57:03.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.718 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.719 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:03.719 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516369+0000", 2020-11-16T20:57:03.719 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1358e-05 2020-11-16T20:57:03.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.719 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.719 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:03.719 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516381+0000", 2020-11-16T20:57:03.720 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5952999999999998e-05 2020-11-16T20:57:03.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.720 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:03.720 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516437+0000", 2020-11-16T20:57:03.720 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5420999999999998e-05 2020-11-16T20:57:03.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.721 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:03.721 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.516472+0000", 2020-11-16T20:57:03.721 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015544192 2020-11-16T20:57:03.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.721 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.721 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:03.721 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532016+0000", 2020-11-16T20:57:03.722 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7809999999999997e-05 2020-11-16T20:57:03.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.722 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.722 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:03.722 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.532074+0000", 2020-11-16T20:57:03.722 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016792344000000001 2020-11-16T20:57:03.722 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.723 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:03.723 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.723 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.723 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:39 4.1 e33/22 4:81558809:::smithi16641208-47:head v 33'30, mlcod=33'26)", 2020-11-16T20:57:03.723 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:51.519956+0000", 2020-11-16T20:57:03.723 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.924242939999999, 2020-11-16T20:57:03.723 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017898104000000001, 2020-11-16T20:57:03.724 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:03.724 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:03.724 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:03.724 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.724 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:03.724 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519956+0000", 2020-11-16T20:57:03.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:03.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.725 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.725 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:03.725 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.519956+0000", 2020-11-16T20:57:03.725 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00038710900000000001 2020-11-16T20:57:03.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.725 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:03.726 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520343+0000", 2020-11-16T20:57:03.726 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0797e-05 2020-11-16T20:57:03.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.726 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.726 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:03.726 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520354+0000", 2020-11-16T20:57:03.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5874000000000001e-05 2020-11-16T20:57:03.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.727 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:03.727 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520370+0000", 2020-11-16T20:57:03.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3580000000000003e-06 2020-11-16T20:57:03.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.728 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:03.728 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520378+0000", 2020-11-16T20:57:03.728 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5744000000000001e-05 2020-11-16T20:57:03.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.728 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.728 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:03.728 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520424+0000", 2020-11-16T20:57:03.729 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4641e-05 2020-11-16T20:57:03.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.729 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.729 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:03.729 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.520449+0000", 2020-11-16T20:57:03.729 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01735014 2020-11-16T20:57:03.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.730 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.730 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:03.730 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.537799+0000", 2020-11-16T20:57:03.730 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5441e-05 2020-11-16T20:57:03.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.730 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.730 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:03.730 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:51.537854+0000", 2020-11-16T20:57:03.731 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017898104000000001 2020-11-16T20:57:03.731 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.731 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:03.731 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.731 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:202 3.2 e35/19 3:5723fd94:::smithi16641208-211:head v 35'124, mlcod=35'121)", 2020-11-16T20:57:03.732 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:55:54.980847+0000", 2020-11-16T20:57:03.732 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 64.463352181000005, 2020-11-16T20:57:03.732 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015747763000000001, 2020-11-16T20:57:03.732 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:03.732 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:03.732 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:03.732 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.733 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:03.733 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.980847+0000", 2020-11-16T20:57:03.733 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:03.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.733 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.733 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:03.733 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.980847+0000", 2020-11-16T20:57:03.733 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072722660000000003 2020-11-16T20:57:03.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.734 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.734 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:03.734 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988119+0000", 2020-11-16T20:57:03.734 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2539e-05 2020-11-16T20:57:03.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.734 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.735 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:03.735 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988132+0000", 2020-11-16T20:57:03.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3723000000000001e-05 2020-11-16T20:57:03.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.735 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.735 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:03.735 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988145+0000", 2020-11-16T20:57:03.736 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8379999999999998e-06 2020-11-16T20:57:03.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.736 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.736 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:03.736 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988151+0000", 2020-11-16T20:57:03.736 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2691000000000002e-05 2020-11-16T20:57:03.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.736 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.737 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:03.737 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988194+0000", 2020-11-16T20:57:03.737 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8366e-05 2020-11-16T20:57:03.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.737 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.737 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:03.737 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.988212+0000", 2020-11-16T20:57:03.738 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0083214259999999998 2020-11-16T20:57:03.738 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.738 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.738 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:03.738 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.996534+0000", 2020-11-16T20:57:03.738 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0914e-05 2020-11-16T20:57:03.738 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.739 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:03.739 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:55:54.996595+0000", 2020-11-16T20:57:03.739 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015747763000000001 2020-11-16T20:57:03.739 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.739 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:03.739 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.739 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.740 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.740 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:538 4.3 e41/22 4:c9160c9c:::smithi16641208-411:head v 41'95, mlcod=37'93)", 2020-11-16T20:57:03.740 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:57:03.740 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 55.318553131000002, 2020-11-16T20:57:03.740 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021023377999999999, 2020-11-16T20:57:03.740 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:03.740 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:03.741 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:03.741 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.741 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:03.741 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:57:03.741 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:03.741 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.741 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.742 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:03.742 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:57:03.742 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052206140000000002 2020-11-16T20:57:03.742 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.742 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.742 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:03.742 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130866+0000", 2020-11-16T20:57:03.743 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0824e-05 2020-11-16T20:57:03.743 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.743 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.743 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:03.743 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130877+0000", 2020-11-16T20:57:03.743 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5384e-05 2020-11-16T20:57:03.743 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.744 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.744 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:03.744 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130893+0000", 2020-11-16T20:57:03.744 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0064999999999999e-05 2020-11-16T20:57:03.744 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.744 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.744 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:03.744 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130903+0000", 2020-11-16T20:57:03.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3051000000000003e-05 2020-11-16T20:57:03.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.745 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.745 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:03.745 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130966+0000", 2020-11-16T20:57:03.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9724e-05 2020-11-16T20:57:03.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.746 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:03.746 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130985+0000", 2020-11-16T20:57:03.746 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015638332000000001 2020-11-16T20:57:03.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.746 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:03.747 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.146624+0000", 2020-11-16T20:57:03.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5383999999999998e-05 2020-11-16T20:57:03.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.747 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.747 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:03.747 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.146669+0000", 2020-11-16T20:57:03.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021023377999999999 2020-11-16T20:57:03.747 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.748 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:03.748 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.748 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:547 3.2 e42/19 3:5f250a2b:::smithi16641208-75:head v 42'381, mlcod=42'379)", 2020-11-16T20:57:03.748 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.026221+0000", 2020-11-16T20:57:03.748 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 54.417977596, 2020-11-16T20:57:03.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014398213, 2020-11-16T20:57:03.749 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:03.749 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:03.749 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:03.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.749 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:03.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.026221+0000", 2020-11-16T20:57:03.750 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:03.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.750 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.750 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:03.750 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.026221+0000", 2020-11-16T20:57:03.750 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052355140000000001 2020-11-16T20:57:03.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.751 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.751 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:03.751 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031457+0000", 2020-11-16T20:57:03.751 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3457e-05 2020-11-16T20:57:03.751 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.751 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.751 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:03.751 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031470+0000", 2020-11-16T20:57:03.752 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6532e-05 2020-11-16T20:57:03.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.752 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.752 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:03.752 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031487+0000", 2020-11-16T20:57:03.752 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6479999999999992e-06 2020-11-16T20:57:03.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:03.753 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031496+0000", 2020-11-16T20:57:03.753 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5820000000000003e-05 2020-11-16T20:57:03.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:03.753 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031561+0000", 2020-11-16T20:57:03.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6701999999999999e-05 2020-11-16T20:57:03.754 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.754 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.754 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:03.754 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.031588+0000", 2020-11-16T20:57:03.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089396879999999995 2020-11-16T20:57:03.754 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.755 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:03.755 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.040528+0000", 2020-11-16T20:57:03.755 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1852000000000001e-05 2020-11-16T20:57:03.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.755 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:03.756 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.040620+0000", 2020-11-16T20:57:03.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014398213 2020-11-16T20:57:03.756 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.756 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:03.756 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.756 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.756 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2367 4.2 e42/22 4:581c1e5b:::smithi16641208-124:head v 42'136, mlcod=42'133)", 2020-11-16T20:57:03.757 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:57:03.757 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 54.390854752999999, 2020-11-16T20:57:03.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021196474999999999, 2020-11-16T20:57:03.757 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:03.757 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:03.757 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:03.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:03.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:57:03.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:03.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:03.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:57:03.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070663000000000002 2020-11-16T20:57:03.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:03.759 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060411+0000", 2020-11-16T20:57:03.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0189999999999995e-06 2020-11-16T20:57:03.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:03.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060420+0000", 2020-11-16T20:57:03.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0069e-05 2020-11-16T20:57:03.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:03.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060430+0000", 2020-11-16T20:57:03.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6879999999999999e-06 2020-11-16T20:57:03.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.761 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:03.761 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060437+0000", 2020-11-16T20:57:03.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3671999999999995e-05 2020-11-16T20:57:03.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:03.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060511+0000", 2020-11-16T20:57:03.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6801999999999998e-05 2020-11-16T20:57:03.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:03.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060548+0000", 2020-11-16T20:57:03.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013927701000000001 2020-11-16T20:57:03.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:03.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074475+0000", 2020-11-16T20:57:03.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5223999999999998e-05 2020-11-16T20:57:03.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:03.764 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074541+0000", 2020-11-16T20:57:03.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021196474999999999 2020-11-16T20:57:03.764 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.764 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:03.764 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.765 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:554 3.2 e42/19 3:769099fd:::smithi16641208-247:head v 42'386, mlcod=42'384)", 2020-11-16T20:57:03.765 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:57:03.765 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 54.373935779999996, 2020-11-16T20:57:03.765 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029531213000000001, 2020-11-16T20:57:03.765 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:03.765 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:03.766 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:03.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:03.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:57:03.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:03.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.767 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:03.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:57:03.767 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007828448 2020-11-16T20:57:03.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.767 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:03.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078092+0000", 2020-11-16T20:57:03.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2031000000000001e-05 2020-11-16T20:57:03.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.768 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:03.768 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078104+0000", 2020-11-16T20:57:03.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3950000000000001e-06 2020-11-16T20:57:03.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:03.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078112+0000", 2020-11-16T20:57:03.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.434e-06 2020-11-16T20:57:03.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:03.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078117+0000", 2020-11-16T20:57:03.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0217999999999999e-05 2020-11-16T20:57:03.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.770 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:03.770 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078168+0000", 2020-11-16T20:57:03.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6242e-05 2020-11-16T20:57:03.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.771 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:03.771 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078194+0000", 2020-11-16T20:57:03.771 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021550488 2020-11-16T20:57:03.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.771 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:03.772 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099744+0000", 2020-11-16T20:57:03.772 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9957000000000003e-05 2020-11-16T20:57:03.772 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.772 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.772 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:03.772 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099794+0000", 2020-11-16T20:57:03.772 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029531213000000001 2020-11-16T20:57:03.772 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.773 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:03.773 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.773 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2376 4.2 e42/22 4:540952ab:::smithi16641208-369:head v 42'142, mlcod=42'136)", 2020-11-16T20:57:03.773 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.077213+0000", 2020-11-16T20:57:03.773 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 54.366985683999999, 2020-11-16T20:57:03.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015666645, 2020-11-16T20:57:03.774 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:03.774 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:03.774 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:03.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:03.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077213+0000", 2020-11-16T20:57:03.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:03.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:03.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077213+0000", 2020-11-16T20:57:03.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9294e-05 2020-11-16T20:57:03.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:03.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077253+0000", 2020-11-16T20:57:03.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6004e-05 2020-11-16T20:57:03.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:03.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077279+0000", 2020-11-16T20:57:03.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.291e-05 2020-11-16T20:57:03.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:03.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077291+0000", 2020-11-16T20:57:03.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.225e-05 2020-11-16T20:57:03.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:03.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077304+0000", 2020-11-16T20:57:03.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9744e-05 2020-11-16T20:57:03.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:03.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077393+0000", 2020-11-16T20:57:03.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5826e-05 2020-11-16T20:57:03.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:03.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.077419+0000", 2020-11-16T20:57:03.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015403659 2020-11-16T20:57:03.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:03.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.092823+0000", 2020-11-16T20:57:03.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6957999999999999e-05 2020-11-16T20:57:03.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:03.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.092880+0000", 2020-11-16T20:57:03.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015666645 2020-11-16T20:57:03.781 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.781 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:03.781 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.781 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:555 3.2 e42/19 3:590e6edd:::smithi16641208-203:head v 42'387, mlcod=42'384)", 2020-11-16T20:57:03.782 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:57:03.782 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 54.366054935999998, 2020-11-16T20:57:03.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021681786000000002, 2020-11-16T20:57:03.782 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:03.782 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:03.782 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:03.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.783 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:03.783 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:57:03.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:03.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.783 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.783 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:03.783 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:57:03.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6817999999999998e-05 2020-11-16T20:57:03.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:03.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078191+0000", 2020-11-16T20:57:03.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7800000000000003e-06 2020-11-16T20:57:03.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:03.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078198+0000", 2020-11-16T20:57:03.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0331e-05 2020-11-16T20:57:03.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:03.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078208+0000", 2020-11-16T20:57:03.786 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8429999999999998e-06 2020-11-16T20:57:03.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.786 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:03.786 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078214+0000", 2020-11-16T20:57:03.786 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0025044690000000001 2020-11-16T20:57:03.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.787 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:03.787 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080718+0000", 2020-11-16T20:57:03.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027441100000000001 2020-11-16T20:57:03.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.787 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:03.787 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080993+0000", 2020-11-16T20:57:03.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018806976999999999 2020-11-16T20:57:03.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:03.788 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099800+0000", 2020-11-16T20:57:03.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6157e-05 2020-11-16T20:57:03.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:03.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099826+0000", 2020-11-16T20:57:03.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021681786000000002 2020-11-16T20:57:03.789 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.789 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:03.789 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.790 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:485 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'94, mlcod=41'92)", 2020-11-16T20:57:03.790 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:57:03.790 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 54.365485968999998, 2020-11-16T20:57:03.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021768460999999999, 2020-11-16T20:57:03.790 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:03.790 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:03.791 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:03.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.791 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:03.791 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:57:03.791 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:03.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:03.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:57:03.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001603103 2020-11-16T20:57:03.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:03.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080316+0000", 2020-11-16T20:57:03.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4956e-05 2020-11-16T20:57:03.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:03.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080331+0000", 2020-11-16T20:57:03.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6291e-05 2020-11-16T20:57:03.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:03.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080347+0000", 2020-11-16T20:57:03.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3090000000000001e-06 2020-11-16T20:57:03.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:03.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080357+0000", 2020-11-16T20:57:03.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7073000000000001e-05 2020-11-16T20:57:03.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.795 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:03.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080414+0000", 2020-11-16T20:57:03.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5877e-05 2020-11-16T20:57:03.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:03.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080440+0000", 2020-11-16T20:57:03.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019927006000000001 2020-11-16T20:57:03.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:03.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100367+0000", 2020-11-16T20:57:03.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114846 2020-11-16T20:57:03.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:03.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100481+0000", 2020-11-16T20:57:03.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021768460999999999 2020-11-16T20:57:03.797 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.798 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:03.798 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.798 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:556 3.2 e42/19 3:590e6edd:::smithi16641208-203:head v 42'388, mlcod=42'384)", 2020-11-16T20:57:03.798 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.081175+0000", 2020-11-16T20:57:03.798 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 54.363024086999999, 2020-11-16T20:57:03.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020119680000000001, 2020-11-16T20:57:03.799 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:03.799 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:03.799 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:03.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:03.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081175+0000", 2020-11-16T20:57:03.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:03.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.800 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:03.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.081175+0000", 2020-11-16T20:57:03.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084338599999999996 2020-11-16T20:57:03.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:03.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089609+0000", 2020-11-16T20:57:03.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1812e-05 2020-11-16T20:57:03.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:03.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089621+0000", 2020-11-16T20:57:03.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6175e-05 2020-11-16T20:57:03.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:03.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089637+0000", 2020-11-16T20:57:03.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2799999999999992e-06 2020-11-16T20:57:03.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:03.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089646+0000", 2020-11-16T20:57:03.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1341999999999998e-05 2020-11-16T20:57:03.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:03.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089687+0000", 2020-11-16T20:57:03.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3351999999999999e-05 2020-11-16T20:57:03.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:03.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089711+0000", 2020-11-16T20:57:03.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011527864000000001 2020-11-16T20:57:03.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:03.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101239+0000", 2020-11-16T20:57:03.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5995000000000002e-05 2020-11-16T20:57:03.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:03.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101295+0000", 2020-11-16T20:57:03.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020119680000000001 2020-11-16T20:57:03.806 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.806 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:03.806 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.806 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2370 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'95, mlcod=41'92)", 2020-11-16T20:57:03.807 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.083328+0000", 2020-11-16T20:57:03.807 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 54.360871385999999, 2020-11-16T20:57:03.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01719561, 2020-11-16T20:57:03.807 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:03.807 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:03.807 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:03.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:03.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083328+0000", 2020-11-16T20:57:03.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:03.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:03.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083328+0000", 2020-11-16T20:57:03.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00037936799999999999 2020-11-16T20:57:03.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:03.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083707+0000", 2020-11-16T20:57:03.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7088999999999999e-05 2020-11-16T20:57:03.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:03.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083724+0000", 2020-11-16T20:57:03.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6737999999999999e-05 2020-11-16T20:57:03.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:03.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083771+0000", 2020-11-16T20:57:03.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7869000000000001e-05 2020-11-16T20:57:03.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:03.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083789+0000", 2020-11-16T20:57:03.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0046429339999999996 2020-11-16T20:57:03.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:03.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.088432+0000", 2020-11-16T20:57:03.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7565999999999998e-05 2020-11-16T20:57:03.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:03.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.088479+0000", 2020-11-16T20:57:03.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012005706 2020-11-16T20:57:03.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:03.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100485+0000", 2020-11-16T20:57:03.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8340000000000002e-05 2020-11-16T20:57:03.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:03.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100523+0000", 2020-11-16T20:57:03.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01719561 2020-11-16T20:57:03.814 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.814 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:03.814 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.815 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2371 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'96, mlcod=41'92)", 2020-11-16T20:57:03.815 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.084682+0000", 2020-11-16T20:57:03.815 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 54.359517240000002, 2020-11-16T20:57:03.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015864851999999999, 2020-11-16T20:57:03.815 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:03.815 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:03.815 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:03.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:03.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084682+0000", 2020-11-16T20:57:03.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:03.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:03.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084682+0000", 2020-11-16T20:57:03.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1321e-05 2020-11-16T20:57:03.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:03.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084723+0000", 2020-11-16T20:57:03.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9310000000000008e-06 2020-11-16T20:57:03.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:03.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084731+0000", 2020-11-16T20:57:03.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1453e-05 2020-11-16T20:57:03.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:03.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084742+0000", 2020-11-16T20:57:03.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9670000000000004e-06 2020-11-16T20:57:03.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:03.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084749+0000", 2020-11-16T20:57:03.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048588700000000004 2020-11-16T20:57:03.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:03.820 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089608+0000", 2020-11-16T20:57:03.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3699999999999998e-05 2020-11-16T20:57:03.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:03.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.089652+0000", 2020-11-16T20:57:03.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010873481000000001 2020-11-16T20:57:03.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:03.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100525+0000", 2020-11-16T20:57:03.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1129e-05 2020-11-16T20:57:03.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:03.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100547+0000", 2020-11-16T20:57:03.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015864851999999999 2020-11-16T20:57:03.822 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.822 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:03.823 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.823 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:663 4.3 e57/22 4:f65e82cb:::smithi16641208-219:head v 57'179, mlcod=57'176)", 2020-11-16T20:57:03.823 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:57:03.823 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.647370899000002, 2020-11-16T20:57:03.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022540092000000001, 2020-11-16T20:57:03.823 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:03.824 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:03.824 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:03.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:03.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:57:03.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:03.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:03.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:57:03.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013414394 2020-11-16T20:57:03.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:03.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810242+0000", 2020-11-16T20:57:03.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1864e-05 2020-11-16T20:57:03.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:03.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810254+0000", 2020-11-16T20:57:03.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3716e-05 2020-11-16T20:57:03.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:03.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810268+0000", 2020-11-16T20:57:03.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.064e-06 2020-11-16T20:57:03.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:03.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810277+0000", 2020-11-16T20:57:03.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0560999999999998e-05 2020-11-16T20:57:03.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:03.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810338+0000", 2020-11-16T20:57:03.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7523999999999999e-05 2020-11-16T20:57:03.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:03.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810365+0000", 2020-11-16T20:57:03.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089020890000000002 2020-11-16T20:57:03.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:03.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819267+0000", 2020-11-16T20:57:03.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010088 2020-11-16T20:57:03.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:03.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819368+0000", 2020-11-16T20:57:03.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022540092000000001 2020-11-16T20:57:03.831 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.831 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:03.831 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.831 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:618 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'243, mlcod=57'241)", 2020-11-16T20:57:03.831 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:57:03.831 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.643864823999998, 2020-11-16T20:57:03.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049183098000000001, 2020-11-16T20:57:03.832 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:03.832 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:03.832 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:03.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:03.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:57:03.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:03.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:03.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:57:03.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019114651 2020-11-16T20:57:03.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:03.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819449+0000", 2020-11-16T20:57:03.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.398e-05 2020-11-16T20:57:03.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:03.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819463+0000", 2020-11-16T20:57:03.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1139e-05 2020-11-16T20:57:03.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:03.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819474+0000", 2020-11-16T20:57:03.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1860000000000003e-06 2020-11-16T20:57:03.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:03.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819481+0000", 2020-11-16T20:57:03.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015472700000000001 2020-11-16T20:57:03.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:03.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819636+0000", 2020-11-16T20:57:03.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9632e-05 2020-11-16T20:57:03.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:03.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819665+0000", 2020-11-16T20:57:03.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029788289999999999 2020-11-16T20:57:03.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:03.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849454+0000", 2020-11-16T20:57:03.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3492999999999997e-05 2020-11-16T20:57:03.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:03.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849517+0000", 2020-11-16T20:57:03.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049183098000000001 2020-11-16T20:57:03.839 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.839 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:03.839 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.839 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:609 3.2 e57/19 3:5eead97c:::smithi16641208-34:head v 57'498, mlcod=57'495)", 2020-11-16T20:57:03.840 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:57:03.840 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.633585324999999, 2020-11-16T20:57:03.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039221579999999999, 2020-11-16T20:57:03.840 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:03.840 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:03.840 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:03.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:03.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:57:03.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:03.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:03.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:57:03.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008889859 2020-11-16T20:57:03.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:03.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819503+0000", 2020-11-16T20:57:03.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0149000000000001e-05 2020-11-16T20:57:03.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:03.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819514+0000", 2020-11-16T20:57:03.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1049999999999999e-05 2020-11-16T20:57:03.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:03.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819525+0000", 2020-11-16T20:57:03.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4829999999999999e-06 2020-11-16T20:57:03.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:03.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819533+0000", 2020-11-16T20:57:03.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031805760000000001 2020-11-16T20:57:03.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:03.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822714+0000", 2020-11-16T20:57:03.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0954000000000002e-05 2020-11-16T20:57:03.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:03.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822745+0000", 2020-11-16T20:57:03.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027044038999999999 2020-11-16T20:57:03.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:03.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849789+0000", 2020-11-16T20:57:03.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6470000000000001e-05 2020-11-16T20:57:03.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:03.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849835+0000", 2020-11-16T20:57:03.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039221579999999999 2020-11-16T20:57:03.847 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.847 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:03.847 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.848 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2583 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'244, mlcod=57'241)", 2020-11-16T20:57:03.848 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:57:03.848 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 39.624667789999997, 2020-11-16T20:57:03.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030101836999999999, 2020-11-16T20:57:03.848 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:03.848 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:03.849 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:03.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:03.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:57:03.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:03.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:03.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:57:03.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3781e-05 2020-11-16T20:57:03.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:03.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819575+0000", 2020-11-16T20:57:03.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3355e-05 2020-11-16T20:57:03.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:03.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819588+0000", 2020-11-16T20:57:03.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8198e-05 2020-11-16T20:57:03.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:03.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819657+0000", 2020-11-16T20:57:03.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5849999999999999e-05 2020-11-16T20:57:03.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:03.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819672+0000", 2020-11-16T20:57:03.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003042473 2020-11-16T20:57:03.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:03.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822715+0000", 2020-11-16T20:57:03.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9779999999999999e-05 2020-11-16T20:57:03.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:03.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822745+0000", 2020-11-16T20:57:03.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026828521000000001 2020-11-16T20:57:03.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:03.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849573+0000", 2020-11-16T20:57:03.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9879e-05 2020-11-16T20:57:03.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:03.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849633+0000", 2020-11-16T20:57:03.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030101836999999999 2020-11-16T20:57:03.855 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.855 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:03.856 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.856 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:728 4.3 e69/22 4:ccdf634d:::smithi16641208-284:head v 69'228, mlcod=61'226)", 2020-11-16T20:57:03.856 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:31.767600+0000", 2020-11-16T20:57:03.856 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.676598725000002, 2020-11-16T20:57:03.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014161465, 2020-11-16T20:57:03.857 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:03.857 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:03.857 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:03.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:03.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.767600+0000", 2020-11-16T20:57:03.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:03.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:03.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.767600+0000", 2020-11-16T20:57:03.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053383129999999999 2020-11-16T20:57:03.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:03.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.772939+0000", 2020-11-16T20:57:03.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0958000000000001e-05 2020-11-16T20:57:03.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:03.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.772950+0000", 2020-11-16T20:57:03.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0628999999999999e-05 2020-11-16T20:57:03.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:03.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.772960+0000", 2020-11-16T20:57:03.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9689999999999999e-06 2020-11-16T20:57:03.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:03.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.772966+0000", 2020-11-16T20:57:03.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3246999999999999e-05 2020-11-16T20:57:03.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:03.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.773029+0000", 2020-11-16T20:57:03.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2042000000000003e-05 2020-11-16T20:57:03.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:03.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.773061+0000", 2020-11-16T20:57:03.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0086372619999999997 2020-11-16T20:57:03.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:03.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.781699+0000", 2020-11-16T20:57:03.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3045000000000004e-05 2020-11-16T20:57:03.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:03.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:31.781762+0000", 2020-11-16T20:57:03.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014161465 2020-11-16T20:57:03.864 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.864 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:03.864 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.864 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:779 4.3 e72/22 4:d9c18080:::smithi16641208-173:head v 72'266, mlcod=71'264)", 2020-11-16T20:57:03.864 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:34.786324+0000", 2020-11-16T20:57:03.864 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 24.657875306000001, 2020-11-16T20:57:03.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017952486, 2020-11-16T20:57:03.865 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:03.865 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:03.865 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:03.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:03.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.786324+0000", 2020-11-16T20:57:03.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:03.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:03.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.786324+0000", 2020-11-16T20:57:03.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012598417000000001 2020-11-16T20:57:03.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:03.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.798922+0000", 2020-11-16T20:57:03.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1700000000000003e-06 2020-11-16T20:57:03.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:03.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.798931+0000", 2020-11-16T20:57:03.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2648e-05 2020-11-16T20:57:03.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:03.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.798944+0000", 2020-11-16T20:57:03.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0150000000000003e-06 2020-11-16T20:57:03.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:03.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.798952+0000", 2020-11-16T20:57:03.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4095999999999998e-05 2020-11-16T20:57:03.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:03.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.799006+0000", 2020-11-16T20:57:03.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2419e-05 2020-11-16T20:57:03.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:03.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.799028+0000", 2020-11-16T20:57:03.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0051805050000000002 2020-11-16T20:57:03.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:03.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.804209+0000", 2020-11-16T20:57:03.871 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7216000000000002e-05 2020-11-16T20:57:03.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.871 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:03.871 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:34.804276+0000", 2020-11-16T20:57:03.872 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017952486 2020-11-16T20:57:03.872 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.872 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:03.872 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.872 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:3004 3.2 e87/19 3:4fbd4ff5:::smithi16641208-419:head v 87'579, mlcod=82'575)", 2020-11-16T20:57:03.873 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:49.842392+0000", 2020-11-16T20:57:03.873 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.601806882, 2020-11-16T20:57:03.873 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014789337, 2020-11-16T20:57:03.873 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:03.873 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:03.873 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:03.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.873 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:03.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:49.842392+0000", 2020-11-16T20:57:03.874 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:03.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.874 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.874 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:03.874 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:49.842392+0000", 2020-11-16T20:57:03.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006146398 2020-11-16T20:57:03.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.875 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:03.875 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:49.848538+0000", 2020-11-16T20:57:03.875 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1034e-05 2020-11-16T20:57:03.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.875 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:03.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:49.848550+0000", 2020-11-16T20:57:03.876 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3869999999999999e-05 2020-11-16T20:57:03.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.876 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:03.876 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:49.848563+0000", 2020-11-16T20:57:03.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0150000000000003e-06 2020-11-16T20:57:03.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.877 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:03.877 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:49.848571+0000", 2020-11-16T20:57:03.877 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5760000000000003e-05 2020-11-16T20:57:03.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:03.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:49.848607+0000", 2020-11-16T20:57:03.878 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8309e-05 2020-11-16T20:57:03.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.878 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.878 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:03.878 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:49.848625+0000", 2020-11-16T20:57:03.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085111500000000003 2020-11-16T20:57:03.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.879 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.879 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:03.879 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:49.857137+0000", 2020-11-16T20:57:03.879 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4801e-05 2020-11-16T20:57:03.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:03.880 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:03.880 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:03.880 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:49.857181+0000", 2020-11-16T20:57:03.880 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014789337 2020-11-16T20:57:03.880 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.880 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:03.880 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.880 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:03.881 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:03.881 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:03.881 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:57:03.882 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:57:03.882 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:57:03.883 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2020-11-16T20:57:03.883 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2020-11-16T20:57:03.888 INFO:tasks.rados.rados.0.smithi166.stdout:829: got (2) No such file or directory 2020-11-16T20:57:03.888 INFO:tasks.rados.rados.0.smithi166.stdout:846: got (2) No such file or directory 2020-11-16T20:57:03.889 INFO:tasks.rados.rados.0.smithi166.stdout:847: got (2) No such file or directory 2020-11-16T20:57:03.889 INFO:tasks.rados.rados.0.smithi166.stdout:826: finishing write tid 1 to smithi16641208-329 2020-11-16T20:57:03.889 INFO:tasks.rados.rados.0.smithi166.stdout:858: finishing write tid 1 to smithi16641208-61 2020-11-16T20:57:03.889 INFO:tasks.rados.rados.0.smithi166.stdout:872: got (2) No such file or directory 2020-11-16T20:57:03.889 INFO:tasks.rados.rados.0.smithi166.stdout:827: finishing write tid 1 to smithi16641208-386 2020-11-16T20:57:03.889 INFO:tasks.rados.rados.0.smithi166.stdout:858: finishing write tid 2 to smithi16641208-61 2020-11-16T20:57:03.889 INFO:tasks.rados.rados.0.smithi166.stdout:858: finishing write tid 3 to smithi16641208-61 2020-11-16T20:57:03.890 INFO:tasks.rados.rados.0.smithi166.stdout:858: finishing write tid 4 to smithi16641208-61 2020-11-16T20:57:03.890 INFO:tasks.rados.rados.0.smithi166.stdout:861: expect (ObjNum 72 snap 0 seq_num 72) 2020-11-16T20:57:03.890 INFO:tasks.rados.rados.0.smithi166.stdout:829: done (12 left) 2020-11-16T20:57:03.890 INFO:tasks.rados.rados.0.smithi166.stdout:846: done (11 left) 2020-11-16T20:57:03.890 INFO:tasks.rados.rados.0.smithi166.stdout:847: done (10 left) 2020-11-16T20:57:03.890 INFO:tasks.rados.rados.0.smithi166.stdout:861: done (9 left) 2020-11-16T20:57:03.890 INFO:tasks.rados.rados.0.smithi166.stdout:872: done (8 left) 2020-11-16T20:57:03.891 INFO:tasks.rados.rados.0.smithi166.stdout:879: done (7 left) 2020-11-16T20:57:03.891 INFO:tasks.rados.rados.0.smithi166.stdout:880: cache_flush oid 63 snap -1 2020-11-16T20:57:03.891 INFO:tasks.rados.rados.0.smithi166.stdout:858: finishing write tid 5 to smithi16641208-61 2020-11-16T20:57:03.891 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 61 v 522 (ObjNum 589 snap 27 seq_num 589) dirty exists 2020-11-16T20:57:03.891 INFO:tasks.rados.rados.0.smithi166.stdout:858: left oid 61 (ObjNum 589 snap 27 seq_num 589) 2020-11-16T20:57:03.891 INFO:tasks.rados.rados.0.smithi166.stdout:826: finishing write tid 2 to smithi16641208-329 2020-11-16T20:57:03.891 INFO:tasks.rados.rados.0.smithi166.stdout:826: finishing write tid 3 to smithi16641208-329 2020-11-16T20:57:03.892 INFO:tasks.rados.rados.0.smithi166.stdout:862: expect (ObjNum 149 snap 0 seq_num 149) 2020-11-16T20:57:03.892 INFO:tasks.rados.rados.0.smithi166.stdout:827: finishing write tid 2 to smithi16641208-386 2020-11-16T20:57:03.892 INFO:tasks.rados.rados.0.smithi166.stdout:827: finishing write tid 3 to smithi16641208-386 2020-11-16T20:57:03.892 INFO:tasks.rados.rados.0.smithi166.stdout:827: finishing write tid 4 to smithi16641208-386 2020-11-16T20:57:03.892 INFO:tasks.rados.rados.0.smithi166.stdout:827: finishing write tid 5 to smithi16641208-386 2020-11-16T20:57:03.892 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 386 v 586 (ObjNum 583 snap 25 seq_num 583) dirty exists 2020-11-16T20:57:03.892 INFO:tasks.rados.rados.0.smithi166.stdout:827: left oid 386 (ObjNum 583 snap 25 seq_num 583) 2020-11-16T20:57:03.893 INFO:tasks.rados.rados.0.smithi166.stdout:826: finishing write tid 4 to smithi16641208-329 2020-11-16T20:57:03.893 INFO:tasks.rados.rados.0.smithi166.stdout:826: finishing write tid 5 to smithi16641208-329 2020-11-16T20:57:03.893 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 329 v 587 (ObjNum 582 snap 25 seq_num 582) dirty exists 2020-11-16T20:57:03.893 INFO:tasks.rados.rados.0.smithi166.stdout:826: left oid 329 (ObjNum 582 snap 25 seq_num 582) 2020-11-16T20:57:03.893 INFO:tasks.rados.rados.0.smithi166.stdout:826: done (7 left) 2020-11-16T20:57:03.893 INFO:tasks.rados.rados.0.smithi166.stdout:827: done (6 left) 2020-11-16T20:57:03.893 INFO:tasks.rados.rados.0.smithi166.stdout:858: done (5 left) 2020-11-16T20:57:03.893 INFO:tasks.rados.rados.0.smithi166.stdout:862: done (4 left) 2020-11-16T20:57:03.894 INFO:tasks.rados.rados.0.smithi166.stdout:881: cache_evict oid 326 snap -1 2020-11-16T20:57:03.894 INFO:tasks.rados.rados.0.smithi166.stdout:867: got (0) Success 2020-11-16T20:57:03.894 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 69 v 0 (ObjNum 577 snap 23 seq_num 577) dirty exists 2020-11-16T20:57:03.894 INFO:tasks.rados.rados.0.smithi166.stdout:869: finishing copy_from to smithi16641208-459 2020-11-16T20:57:03.894 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 459 v 165 (ObjNum 234 snap 0 seq_num 234) dirty exists 2020-11-16T20:57:03.894 INFO:tasks.rados.rados.0.smithi166.stdout:877: got (0) Success 2020-11-16T20:57:03.894 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 120 v 0 (ObjNum 532 snap 9 seq_num 532) dirty exists 2020-11-16T20:57:03.895 INFO:tasks.rados.rados.0.smithi166.stdout:869: finishing copy_from racing read to smithi16641208-459 2020-11-16T20:57:03.895 INFO:tasks.rados.rados.0.smithi166.stdout:880: got (2) No such file or directory 2020-11-16T20:57:03.895 INFO:tasks.rados.rados.0.smithi166.stdout:867: done (4 left) 2020-11-16T20:57:03.895 INFO:tasks.rados.rados.0.smithi166.stdout:869: done (3 left) 2020-11-16T20:57:03.895 INFO:tasks.rados.rados.0.smithi166.stdout:877: done (2 left) 2020-11-16T20:57:03.895 INFO:tasks.rados.rados.0.smithi166.stdout:880: done (1 left) 2020-11-16T20:57:03.895 INFO:tasks.rados.rados.0.smithi166.stdout:882: rollback oid 146 current snap is 28 2020-11-16T20:57:03.896 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 146 to 27 2020-11-16T20:57:03.896 INFO:tasks.rados.rados.0.smithi166.stdout:883: delete oid 276 current snap is 28 2020-11-16T20:57:03.896 INFO:tasks.rados.rados.0.smithi166.stdout:881: got (2) No such file or directory 2020-11-16T20:57:03.896 INFO:tasks.rados.rados.0.smithi166.stdout:882: finishing rollback tid 0 to smithi16641208-146 2020-11-16T20:57:03.896 INFO:tasks.rados.rados.0.smithi166.stdout:881: done (2 left) 2020-11-16T20:57:03.896 INFO:tasks.rados.rados.0.smithi166.stdout:883: done (1 left) 2020-11-16T20:57:03.896 INFO:tasks.rados.rados.0.smithi166.stdout:884: read oid 84 snap -1 2020-11-16T20:57:03.896 INFO:tasks.rados.rados.0.smithi166.stdout:884: expect (ObjNum 83 snap 0 seq_num 83) 2020-11-16T20:57:03.897 INFO:tasks.rados.rados.0.smithi166.stdout:885: write oid 352 current snap is 28 2020-11-16T20:57:03.897 INFO:tasks.rados.rados.0.smithi166.stdout:885: seq_num 597 ranges {433779=799187,1801750=232029} 2020-11-16T20:57:03.897 INFO:tasks.rados.rados.0.smithi166.stdout:885: writing smithi16641208-352 from 433779 to 1232966 tid 1 2020-11-16T20:57:03.897 INFO:tasks.rados.rados.0.smithi166.stdout:885: writing smithi16641208-352 from 1801750 to 2033779 tid 2 2020-11-16T20:57:03.897 INFO:tasks.rados.rados.0.smithi166.stdout:886: cache_evict oid 134 snap -1 2020-11-16T20:57:03.897 INFO:tasks.rados.rados.0.smithi166.stdout:887: read oid 12 snap -1 2020-11-16T20:57:03.897 INFO:tasks.rados.rados.0.smithi166.stdout:887: expect (ObjNum 563 snap 19 seq_num 563) 2020-11-16T20:57:03.898 INFO:tasks.rados.rados.0.smithi166.stdout:888: cache_try_flush oid 419 snap -1 2020-11-16T20:57:03.898 INFO:tasks.rados.rados.0.smithi166.stdout:889: delete oid 121 current snap is 28 2020-11-16T20:57:03.898 INFO:tasks.rados.rados.0.smithi166.stdout:884: expect (ObjNum 83 snap 0 seq_num 83) 2020-11-16T20:57:03.898 INFO:tasks.rados.rados.0.smithi166.stdout:886: got (2) No such file or directory 2020-11-16T20:57:03.898 INFO:tasks.rados.rados.0.smithi166.stdout:888: got (0) Success 2020-11-16T20:57:03.898 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 419 v 0 (ObjNum 428 snap 0 seq_num 428) dirty exists 2020-11-16T20:57:03.898 INFO:tasks.rados.rados.0.smithi166.stdout:887: expect (ObjNum 563 snap 19 seq_num 563) 2020-11-16T20:57:03.899 INFO:tasks.rados.rados.0.smithi166.stdout:885: finishing write tid 1 to smithi16641208-352 2020-11-16T20:57:03.899 INFO:tasks.rados.rados.0.smithi166.stdout:882: finishing rollback tid 1 to smithi16641208-146 2020-11-16T20:57:03.899 INFO:tasks.rados.rados.0.smithi166.stdout:882: finishing rollback tid 2 to smithi16641208-146 2020-11-16T20:57:03.899 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 146 v 594 (ObjNum 458 snap 0 seq_num 458) dirty exists 2020-11-16T20:57:03.899 INFO:tasks.rados.rados.0.smithi166.stdout:885: finishing write tid 2 to smithi16641208-352 2020-11-16T20:57:03.899 INFO:tasks.rados.rados.0.smithi166.stdout:885: finishing write tid 3 to smithi16641208-352 2020-11-16T20:57:03.899 INFO:tasks.rados.rados.0.smithi166.stdout:885: finishing write tid 4 to smithi16641208-352 2020-11-16T20:57:03.899 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 352 v 690 (ObjNum 597 snap 28 seq_num 597) dirty exists 2020-11-16T20:57:03.900 INFO:tasks.rados.rados.0.smithi166.stdout:885: left oid 352 (ObjNum 597 snap 28 seq_num 597) 2020-11-16T20:57:03.900 INFO:tasks.rados.rados.0.smithi166.stdout:882: done (6 left) 2020-11-16T20:57:03.900 INFO:tasks.rados.rados.0.smithi166.stdout:884: done (5 left) 2020-11-16T20:57:03.900 INFO:tasks.rados.rados.0.smithi166.stdout:885: done (4 left) 2020-11-16T20:57:03.900 INFO:tasks.rados.rados.0.smithi166.stdout:886: done (3 left) 2020-11-16T20:57:03.900 INFO:tasks.rados.rados.0.smithi166.stdout:887: done (2 left) 2020-11-16T20:57:03.900 INFO:tasks.rados.rados.0.smithi166.stdout:888: done (1 left) 2020-11-16T20:57:03.901 INFO:tasks.rados.rados.0.smithi166.stdout:889: done (0 left) 2020-11-16T20:57:03.901 INFO:tasks.rados.rados.0.smithi166.stdout:890: snap_create 2020-11-16T20:57:03.901 INFO:tasks.rados.rados.0.smithi166.stdout:890: done (0 left) 2020-11-16T20:57:03.901 INFO:tasks.rados.rados.0.smithi166.stdout:891: read oid 488 snap 27 2020-11-16T20:57:03.901 INFO:tasks.rados.rados.0.smithi166.stdout:891: expect (ObjNum 487 snap 0 seq_num 487) 2020-11-16T20:57:03.901 INFO:tasks.rados.rados.0.smithi166.stdout:892: write (excl) oid 229 current snap is 29 2020-11-16T20:57:03.901 INFO:tasks.rados.rados.0.smithi166.stdout:892: seq_num 599 ranges {467393=549685,1802361=265032} 2020-11-16T20:57:03.901 INFO:tasks.rados.rados.0.smithi166.stdout:892: writing smithi16641208-229 from 467393 to 1017078 tid 1 2020-11-16T20:57:03.902 INFO:tasks.rados.rados.0.smithi166.stdout:892: writing smithi16641208-229 from 1802361 to 2067393 tid 2 2020-11-16T20:57:03.902 INFO:tasks.rados.rados.0.smithi166.stdout:893: snap_create 2020-11-16T20:57:03.902 INFO:tasks.rados.rados.0.smithi166.stdout:892: finishing write tid 1 to smithi16641208-229 2020-11-16T20:57:03.902 INFO:tasks.rados.rados.0.smithi166.stdout:891: expect (ObjNum 487 snap 0 seq_num 487) 2020-11-16T20:57:03.902 INFO:tasks.rados.rados.0.smithi166.stdout:892: finishing write tid 2 to smithi16641208-229 2020-11-16T20:57:03.902 INFO:tasks.rados.rados.0.smithi166.stdout:892: finishing write tid 3 to smithi16641208-229 2020-11-16T20:57:03.902 INFO:tasks.rados.rados.0.smithi166.stdout:892: finishing write tid 4 to smithi16641208-229 2020-11-16T20:57:03.903 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 229 v 597 (ObjNum 599 snap 29 seq_num 599) dirty exists 2020-11-16T20:57:03.903 INFO:tasks.rados.rados.0.smithi166.stdout:892: left oid 229 (ObjNum 599 snap 29 seq_num 599) 2020-11-16T20:57:03.903 INFO:tasks.rados.rados.0.smithi166.stdout:891: done (2 left) 2020-11-16T20:57:03.903 INFO:tasks.rados.rados.0.smithi166.stdout:892: done (1 left) 2020-11-16T20:57:03.903 INFO:tasks.rados.rados.0.smithi166.stdout:893: done (0 left) 2020-11-16T20:57:03.903 INFO:tasks.rados.rados.0.smithi166.stdout:894: delete oid 143 current snap is 30 2020-11-16T20:57:03.903 INFO:tasks.rados.rados.0.smithi166.stdout:894: done (0 left) 2020-11-16T20:57:03.903 INFO:tasks.rados.rados.0.smithi166.stdout:895: cache_flush oid 5 snap 28 2020-11-16T20:57:03.904 INFO:tasks.rados.rados.0.smithi166.stdout:896: cache_flush oid 169 snap 29 2020-11-16T20:57:03.904 INFO:tasks.rados.rados.0.smithi166.stdout:897: delete oid 393 current snap is 30 2020-11-16T20:57:03.904 INFO:tasks.rados.rados.0.smithi166.stdout:895: got (0) Success 2020-11-16T20:57:03.904 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 5 v 0 (ObjNum 4 snap 0 seq_num 4) dirty exists 2020-11-16T20:57:03.904 INFO:tasks.rados.rados.0.smithi166.stdout:896: got (2) No such file or directory 2020-11-16T20:57:03.904 INFO:tasks.rados.rados.0.smithi166.stdout:895: done (2 left) 2020-11-16T20:57:03.904 INFO:tasks.rados.rados.0.smithi166.stdout:896: done (1 left) 2020-11-16T20:57:03.905 INFO:tasks.rados.rados.0.smithi166.stdout:897: done (0 left) 2020-11-16T20:57:03.905 INFO:tasks.rados.rados.0.smithi166.stdout:898: rollback oid 1 current snap is 30 2020-11-16T20:57:03.905 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 1 to 28 2020-11-16T20:57:03.905 INFO:tasks.rados.rados.0.smithi166.stdout:899: cache_flush oid 310 snap 27 2020-11-16T20:57:03.905 INFO:tasks.rados.rados.0.smithi166.stdout:900: delete oid 369 current snap is 30 2020-11-16T20:57:03.905 INFO:tasks.rados.rados.0.smithi166.stdout:899: got (2) No such file or directory 2020-11-16T20:57:03.905 INFO:tasks.rados.rados.0.smithi166.stdout:898: finishing rollback tid 0 to smithi16641208-1 2020-11-16T20:57:03.905 INFO:tasks.rados.rados.0.smithi166.stdout:899: done (2 left) 2020-11-16T20:57:03.906 INFO:tasks.rados.rados.0.smithi166.stdout:900: done (1 left) 2020-11-16T20:57:03.906 INFO:tasks.rados.rados.0.smithi166.stdout:901: cache_try_flush oid 56 snap -1 2020-11-16T20:57:03.906 INFO:tasks.rados.rados.0.smithi166.stdout:902: snap_remove snap 27 2020-11-16T20:57:03.907 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:57:03.907 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:03.886+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:03.984 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:03.989+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:04.074 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:04.075 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:57:04.075 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:57:04.075 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:04.080 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:57:04.084 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:04.088+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:04.085 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:57:04.119 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:57:04.139 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:57:04.158 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:57:04.178 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:57:04.185 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:04.189+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:04.198 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:57:04.219 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:57:04.239 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:57:04.240 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:57:04.240 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:57:04.241 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:57:04.241 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:57:04.241 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:57:04.241 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:57:04.241 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:57:04.241 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:57:04.259 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:57:04.260 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:04.260 INFO:teuthology.orchestra.run.smithi166.stdout: "epoch": 99, 2020-11-16T20:57:04.260 INFO:teuthology.orchestra.run.smithi166.stdout: "fsid": "a14fd848-4cfe-4cd9-9140-5b3c4b4e904d", 2020-11-16T20:57:04.260 INFO:teuthology.orchestra.run.smithi166.stdout: "created": "2020-11-16T20:54:44.938121+0000", 2020-11-16T20:57:04.260 INFO:teuthology.orchestra.run.smithi166.stdout: "modified": "2020-11-16T20:57:03.860905+0000", 2020-11-16T20:57:04.260 INFO:teuthology.orchestra.run.smithi166.stdout: "last_up_change": "2020-11-16T20:54:52.080163+0000", 2020-11-16T20:57:04.260 INFO:teuthology.orchestra.run.smithi166.stdout: "last_in_change": "2020-11-16T20:54:52.080163+0000", 2020-11-16T20:57:04.261 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-11-16T20:57:04.261 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_num": 5801984, 2020-11-16T20:57:04.261 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_set": [ 2020-11-16T20:57:04.261 INFO:teuthology.orchestra.run.smithi166.stdout: "noscrub", 2020-11-16T20:57:04.261 INFO:teuthology.orchestra.run.smithi166.stdout: "pglog_hardlimit", 2020-11-16T20:57:04.261 INFO:teuthology.orchestra.run.smithi166.stdout: "purged_snapdirs", 2020-11-16T20:57:04.261 INFO:teuthology.orchestra.run.smithi166.stdout: "recovery_deletes", 2020-11-16T20:57:04.262 INFO:teuthology.orchestra.run.smithi166.stdout: "sortbitwise" 2020-11-16T20:57:04.262 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:04.262 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_version": 6, 2020-11-16T20:57:04.262 INFO:teuthology.orchestra.run.smithi166.stdout: "full_ratio": 0.94999998807907104, 2020-11-16T20:57:04.262 INFO:teuthology.orchestra.run.smithi166.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-11-16T20:57:04.262 INFO:teuthology.orchestra.run.smithi166.stdout: "nearfull_ratio": 0.85000002384185791, 2020-11-16T20:57:04.262 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_snapshot": "", 2020-11-16T20:57:04.263 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_max": 4, 2020-11-16T20:57:04.263 INFO:teuthology.orchestra.run.smithi166.stdout: "max_osd": 8, 2020-11-16T20:57:04.263 INFO:teuthology.orchestra.run.smithi166.stdout: "require_min_compat_client": "luminous", 2020-11-16T20:57:04.263 INFO:teuthology.orchestra.run.smithi166.stdout: "min_compat_client": "luminous", 2020-11-16T20:57:04.263 INFO:teuthology.orchestra.run.smithi166.stdout: "require_osd_release": "pacific", 2020-11-16T20:57:04.263 INFO:teuthology.orchestra.run.smithi166.stdout: "pools": [ 2020-11-16T20:57:04.263 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.264 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 1, 2020-11-16T20:57:04.264 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "device_health_metrics", 2020-11-16T20:57:04.264 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:54:49.109999+0000", 2020-11-16T20:57:04.264 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 1, 2020-11-16T20:57:04.264 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool", 2020-11-16T20:57:04.264 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:57:04.264 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:57:04.265 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:57:04.265 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:57:04.265 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:57:04.265 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:57:04.265 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:57:04.265 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:57:04.265 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:57:04.266 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:57:04.266 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 1, 2020-11-16T20:57:04.266 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 1, 2020-11-16T20:57:04.266 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 1, 2020-11-16T20:57:04.266 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 1, 2020-11-16T20:57:04.266 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 1, 2020-11-16T20:57:04.266 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:57:04.267 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:57:04.267 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:57:04.267 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:57:04.267 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:57:04.267 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:57:04.267 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:57:04.267 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.268 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "15", 2020-11-16T20:57:04.268 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "0", 2020-11-16T20:57:04.268 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-16T20:57:04.268 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "0", 2020-11-16T20:57:04.268 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:57:04.268 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:57:04.268 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 0, 2020-11-16T20:57:04.268 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 0, 2020-11-16T20:57:04.269 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:57:04.269 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:57:04.269 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:57:04.269 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:57:04.269 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:57:04.269 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:57:04.269 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:57:04.270 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:57:04.270 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:57:04.270 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:57:04.270 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:57:04.270 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:57:04.270 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:57:04.270 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:57:04.271 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:57:04.271 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:57:04.271 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:57:04.271 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:57:04.271 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:57:04.271 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.271 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:57:04.272 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:57:04.272 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:57:04.272 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:57:04.272 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:57:04.272 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:57:04.272 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:57:04.272 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:57:04.272 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:57:04.273 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:57:04.273 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:57:04.273 INFO:teuthology.orchestra.run.smithi166.stdout: "options": { 2020-11-16T20:57:04.273 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_min": 1 2020-11-16T20:57:04.273 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.273 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:57:04.273 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_devicehealth": {} 2020-11-16T20:57:04.274 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.274 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.274 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.274 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 2, 2020-11-16T20:57:04.274 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "rbd", 2020-11-16T20:57:04.274 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:54:53.253680+0000", 2020-11-16T20:57:04.274 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 1, 2020-11-16T20:57:04.275 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool", 2020-11-16T20:57:04.275 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:57:04.275 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:57:04.275 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:57:04.275 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:57:04.275 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:57:04.275 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:57:04.275 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:57:04.276 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:57:04.276 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:57:04.276 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:57:04.276 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 18, 2020-11-16T20:57:04.276 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 18, 2020-11-16T20:57:04.276 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 18, 2020-11-16T20:57:04.276 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 18, 2020-11-16T20:57:04.277 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 18, 2020-11-16T20:57:04.277 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:57:04.277 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:57:04.277 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:57:04.277 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:57:04.277 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:57:04.277 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:57:04.277 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:57:04.278 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.278 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "34", 2020-11-16T20:57:04.278 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "0", 2020-11-16T20:57:04.278 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-16T20:57:04.278 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "32", 2020-11-16T20:57:04.278 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:57:04.278 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:57:04.279 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 0, 2020-11-16T20:57:04.279 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 0, 2020-11-16T20:57:04.279 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:57:04.279 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:57:04.279 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:57:04.279 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:57:04.279 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:57:04.280 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:57:04.280 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:57:04.280 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:57:04.280 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:57:04.280 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:57:04.280 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:57:04.280 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:57:04.280 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:57:04.281 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:57:04.281 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:57:04.281 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:57:04.281 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:57:04.281 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:57:04.281 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:57:04.281 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.282 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:57:04.282 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:57:04.282 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:57:04.282 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:57:04.282 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:57:04.282 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:57:04.282 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:57:04.283 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:57:04.283 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:57:04.283 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:57:04.283 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:57:04.283 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:57:04.283 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:57:04.283 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd": {} 2020-11-16T20:57:04.284 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.284 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.284 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.284 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 3, 2020-11-16T20:57:04.284 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "base", 2020-11-16T20:57:04.284 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:55:23.597952+0000", 2020-11-16T20:57:04.284 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 8193, 2020-11-16T20:57:04.284 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2020-11-16T20:57:04.285 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:57:04.285 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:57:04.285 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:57:04.285 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:57:04.285 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:57:04.285 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:57:04.285 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:57:04.286 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:57:04.286 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:57:04.286 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:57:04.286 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 4, 2020-11-16T20:57:04.286 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 4, 2020-11-16T20:57:04.286 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 4, 2020-11-16T20:57:04.286 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 4, 2020-11-16T20:57:04.287 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 4, 2020-11-16T20:57:04.287 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:57:04.287 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:57:04.287 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:57:04.287 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:57:04.287 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:57:04.287 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:57:04.287 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:57:04.288 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.288 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "99", 2020-11-16T20:57:04.288 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "27", 2020-11-16T20:57:04.288 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "27", 2020-11-16T20:57:04.288 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "27", 2020-11-16T20:57:04.288 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:57:04.288 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:57:04.289 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 58, 2020-11-16T20:57:04.289 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 99, 2020-11-16T20:57:04.289 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:57:04.289 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:57:04.289 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:57:04.289 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:57:04.289 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [ 2020-11-16T20:57:04.289 INFO:teuthology.orchestra.run.smithi166.stdout: 4 2020-11-16T20:57:04.290 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:04.290 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:57:04.290 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": 4, 2020-11-16T20:57:04.290 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": 4, 2020-11-16T20:57:04.290 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:57:04.290 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:57:04.290 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:57:04.291 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:57:04.291 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:57:04.291 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:57:04.291 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:57:04.291 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:57:04.291 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:57:04.291 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:57:04.291 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:57:04.292 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.292 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:57:04.292 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:57:04.292 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:57:04.292 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:57:04.292 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:57:04.292 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:57:04.293 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:57:04.293 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:57:04.293 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:57:04.293 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:57:04.293 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:57:04.293 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:57:04.293 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:57:04.294 INFO:teuthology.orchestra.run.smithi166.stdout: "rados": {} 2020-11-16T20:57:04.294 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.294 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.294 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.294 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 4, 2020-11-16T20:57:04.294 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "cache", 2020-11-16T20:57:04.294 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:55:28.901773+0000", 2020-11-16T20:57:04.294 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 8201, 2020-11-16T20:57:04.295 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool,incomplete_clones,selfmanaged_snaps", 2020-11-16T20:57:04.295 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:57:04.295 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:57:04.295 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:57:04.295 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:57:04.295 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:57:04.295 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:57:04.296 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:57:04.296 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:57:04.296 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:57:04.296 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:57:04.296 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 4, 2020-11-16T20:57:04.296 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 4, 2020-11-16T20:57:04.296 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 4, 2020-11-16T20:57:04.296 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 4, 2020-11-16T20:57:04.297 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 4, 2020-11-16T20:57:04.297 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:57:04.297 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:57:04.297 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:57:04.297 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:57:04.297 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:57:04.297 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:57:04.298 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:57:04.298 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.298 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "99", 2020-11-16T20:57:04.298 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "27", 2020-11-16T20:57:04.298 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "27", 2020-11-16T20:57:04.298 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "27", 2020-11-16T20:57:04.298 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:57:04.299 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:57:04.299 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 58, 2020-11-16T20:57:04.299 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 99, 2020-11-16T20:57:04.299 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:57:04.299 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:57:04.299 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:57:04.299 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:57:04.299 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:57:04.300 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": 3, 2020-11-16T20:57:04.300 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:57:04.300 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:57:04.300 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "writeback", 2020-11-16T20:57:04.300 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:57:04.300 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 250, 2020-11-16T20:57:04.300 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:57:04.300 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:57:04.301 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:57:04.301 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:57:04.301 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:57:04.301 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:57:04.301 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:57:04.301 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "bloom", 2020-11-16T20:57:04.301 INFO:teuthology.orchestra.run.smithi166.stdout: "false_positive_probability": 0.050000000000000003, 2020-11-16T20:57:04.302 INFO:teuthology.orchestra.run.smithi166.stdout: "target_size": 0, 2020-11-16T20:57:04.302 INFO:teuthology.orchestra.run.smithi166.stdout: "seed": 0 2020-11-16T20:57:04.302 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.302 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 3600, 2020-11-16T20:57:04.302 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 8, 2020-11-16T20:57:04.302 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:57:04.302 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 2, 2020-11-16T20:57:04.303 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:57:04.303 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:57:04.303 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:57:04.303 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [ 2020-11-16T20:57:04.303 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:57:04.303 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:57:04.303 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:57:04.303 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:57:04.304 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:57:04.304 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:57:04.304 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:57:04.304 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000 2020-11-16T20:57:04.304 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:04.304 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:57:04.304 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:57:04.305 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:57:04.305 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:57:04.305 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": {} 2020-11-16T20:57:04.305 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.305 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:04.305 INFO:teuthology.orchestra.run.smithi166.stdout: "osds": [ 2020-11-16T20:57:04.305 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.305 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 0, 2020-11-16T20:57:04.306 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "35950122-efbd-420e-b07a-f5730f26df17", 2020-11-16T20:57:04.306 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:57:04.306 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:57:04.306 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:57:04.306 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:57:04.306 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:57:04.306 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:57:04.307 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:57:04.307 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 95, 2020-11-16T20:57:04.307 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:57:04.307 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:57:04.307 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:57:04.307 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.307 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.308 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.308 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6800", 2020-11-16T20:57:04.308 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:57:04.308 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.308 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.308 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.308 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:57:04.308 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.309 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.309 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.309 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6802", 2020-11-16T20:57:04.309 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:57:04.309 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.309 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.309 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.310 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:57:04.310 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.310 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.310 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.310 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6806", 2020-11-16T20:57:04.310 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:57:04.310 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.311 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.311 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.311 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:57:04.311 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.311 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.311 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.311 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6804", 2020-11-16T20:57:04.311 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:57:04.312 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.312 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.312 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.312 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6800/35293", 2020-11-16T20:57:04.312 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6802/35293", 2020-11-16T20:57:04.312 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6806/35293", 2020-11-16T20:57:04.312 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6804/35293", 2020-11-16T20:57:04.313 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:57:04.313 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:57:04.313 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:57:04.313 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.313 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.313 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 1, 2020-11-16T20:57:04.314 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "f768a1ff-3e8a-4131-a6ed-10f93b3ca900", 2020-11-16T20:57:04.314 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:57:04.314 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:57:04.314 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:57:04.314 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:57:04.314 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:57:04.314 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:57:04.315 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:57:04.315 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 96, 2020-11-16T20:57:04.315 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:57:04.315 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:57:04.315 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:57:04.315 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.315 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.315 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.316 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6808", 2020-11-16T20:57:04.316 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:57:04.316 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.316 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.316 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.316 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:57:04.316 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.317 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.317 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.317 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6809", 2020-11-16T20:57:04.317 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:57:04.317 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.317 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.317 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.317 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:57:04.318 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.318 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.318 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.318 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6811", 2020-11-16T20:57:04.318 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:57:04.318 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.318 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.319 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.319 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:57:04.319 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.319 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.319 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.319 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6810", 2020-11-16T20:57:04.319 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:57:04.320 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.320 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.320 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.320 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6808/35323", 2020-11-16T20:57:04.320 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6809/35323", 2020-11-16T20:57:04.320 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6811/35323", 2020-11-16T20:57:04.320 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6810/35323", 2020-11-16T20:57:04.320 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:57:04.321 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:57:04.321 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:57:04.321 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.321 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.321 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.321 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 2, 2020-11-16T20:57:04.321 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "88734179-84a6-4a9b-8af0-692805815875", 2020-11-16T20:57:04.322 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:57:04.322 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:57:04.322 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:57:04.322 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:57:04.322 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:57:04.322 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:57:04.322 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:57:04.322 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 84, 2020-11-16T20:57:04.323 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:57:04.323 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:57:04.323 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:57:04.323 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.323 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.323 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.323 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6801", 2020-11-16T20:57:04.324 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:57:04.324 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.324 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.324 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.324 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:57:04.324 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.324 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.324 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.325 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6803", 2020-11-16T20:57:04.325 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:57:04.325 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.325 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.325 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.325 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:57:04.325 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.326 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.326 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.326 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6807", 2020-11-16T20:57:04.326 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:57:04.326 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.326 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.326 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.327 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:57:04.327 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.327 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.327 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.327 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6805", 2020-11-16T20:57:04.327 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:57:04.327 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.327 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.328 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.328 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6801/35294", 2020-11-16T20:57:04.328 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6803/35294", 2020-11-16T20:57:04.328 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6807/35294", 2020-11-16T20:57:04.328 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6805/35294", 2020-11-16T20:57:04.328 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:57:04.328 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:57:04.329 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:57:04.329 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.329 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.329 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.329 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 3, 2020-11-16T20:57:04.329 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "319e54e8-3f03-4388-8de6-678d148e25d4", 2020-11-16T20:57:04.329 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:57:04.330 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:57:04.330 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:57:04.330 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:57:04.330 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:57:04.330 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:57:04.330 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:57:04.330 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 22, 2020-11-16T20:57:04.331 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:57:04.331 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:57:04.331 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:57:04.331 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.331 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.331 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.331 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6812", 2020-11-16T20:57:04.331 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:57:04.332 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.332 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.332 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.332 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:57:04.332 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.332 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.332 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.332 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6813", 2020-11-16T20:57:04.333 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:57:04.333 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.333 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.333 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.333 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:57:04.333 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.333 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.334 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.334 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6815", 2020-11-16T20:57:04.334 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:57:04.334 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.334 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.334 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.334 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:57:04.335 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.335 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.335 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6814", 2020-11-16T20:57:04.335 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:57:04.335 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.335 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.335 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.336 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6812/35324", 2020-11-16T20:57:04.336 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6813/35324", 2020-11-16T20:57:04.336 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6815/35324", 2020-11-16T20:57:04.336 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6814/35324", 2020-11-16T20:57:04.336 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:57:04.336 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:57:04.336 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:57:04.337 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.337 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.337 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.337 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 4, 2020-11-16T20:57:04.337 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "3edbb68e-e030-4379-891e-2412f1235ffb", 2020-11-16T20:57:04.337 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:57:04.337 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:57:04.337 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:57:04.338 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:57:04.338 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:57:04.338 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:57:04.338 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:57:04.338 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 63, 2020-11-16T20:57:04.338 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:57:04.338 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:57:04.339 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:57:04.339 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.339 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.339 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.339 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6804", 2020-11-16T20:57:04.339 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:57:04.339 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.340 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.340 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.340 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:57:04.340 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.340 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.340 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.340 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6805", 2020-11-16T20:57:04.340 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:57:04.341 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.341 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.341 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.341 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:57:04.341 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.341 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.341 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.342 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6807", 2020-11-16T20:57:04.342 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:57:04.342 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.342 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.342 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.342 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:57:04.342 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.343 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.343 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.343 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6806", 2020-11-16T20:57:04.343 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:57:04.343 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.343 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.343 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.343 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6804/31586", 2020-11-16T20:57:04.344 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6805/31586", 2020-11-16T20:57:04.344 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6807/31586", 2020-11-16T20:57:04.344 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6806/31586", 2020-11-16T20:57:04.344 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:57:04.344 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:57:04.344 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:57:04.344 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.345 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.345 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 5, 2020-11-16T20:57:04.345 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "44fbf5ac-4484-48a8-a846-1f5c01a6ec2c", 2020-11-16T20:57:04.345 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:57:04.345 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:57:04.345 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:57:04.346 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:57:04.346 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:57:04.346 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:57:04.346 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:57:04.346 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 63, 2020-11-16T20:57:04.346 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:57:04.346 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:57:04.346 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:57:04.347 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.347 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.347 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.347 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6808", 2020-11-16T20:57:04.347 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:57:04.347 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.347 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.348 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.348 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:57:04.348 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.348 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.348 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.348 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6810", 2020-11-16T20:57:04.348 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:57:04.348 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.349 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.349 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.349 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:57:04.349 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.349 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.349 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.349 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6813", 2020-11-16T20:57:04.350 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:57:04.350 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.350 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.350 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.350 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:57:04.350 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.350 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.351 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6812", 2020-11-16T20:57:04.351 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:57:04.351 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.351 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.351 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.351 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6808/31610", 2020-11-16T20:57:04.351 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6810/31610", 2020-11-16T20:57:04.352 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6813/31610", 2020-11-16T20:57:04.352 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6812/31610", 2020-11-16T20:57:04.352 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:57:04.352 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:57:04.352 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:57:04.352 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.352 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.353 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 6, 2020-11-16T20:57:04.353 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "f93b82df-f537-4601-8247-388bf100b5b5", 2020-11-16T20:57:04.353 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:57:04.353 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:57:04.353 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 0.5654754638671875, 2020-11-16T20:57:04.353 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:57:04.353 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:57:04.354 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:57:04.354 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:57:04.354 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 34, 2020-11-16T20:57:04.354 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:57:04.354 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:57:04.354 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:57:04.354 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.355 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.355 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.355 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6800", 2020-11-16T20:57:04.355 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:57:04.355 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.355 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.355 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.356 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:57:04.356 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.356 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.356 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.356 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6801", 2020-11-16T20:57:04.356 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:57:04.356 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.356 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.357 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.357 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:57:04.357 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.357 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.357 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.357 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6803", 2020-11-16T20:57:04.357 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:57:04.358 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.358 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.358 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.358 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:57:04.358 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.358 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.358 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.358 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6802", 2020-11-16T20:57:04.359 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:57:04.359 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.359 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.359 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.359 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6800/31587", 2020-11-16T20:57:04.359 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6801/31587", 2020-11-16T20:57:04.359 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6803/31587", 2020-11-16T20:57:04.360 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6802/31587", 2020-11-16T20:57:04.360 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:57:04.360 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:57:04.360 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:57:04.360 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.360 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.360 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.360 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 7, 2020-11-16T20:57:04.361 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "e5485c88-d267-4a6a-b9b6-15d869d28f28", 2020-11-16T20:57:04.361 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:57:04.361 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:57:04.361 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:57:04.361 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:57:04.361 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:57:04.361 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:57:04.362 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:57:04.362 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 34, 2020-11-16T20:57:04.362 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:57:04.362 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:57:04.362 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:57:04.362 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.362 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.363 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.363 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6809", 2020-11-16T20:57:04.363 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:57:04.363 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.363 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.363 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.363 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:57:04.363 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.364 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.364 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.364 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6811", 2020-11-16T20:57:04.364 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:57:04.364 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.364 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.364 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.365 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:57:04.365 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.365 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.365 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.365 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6815", 2020-11-16T20:57:04.365 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:57:04.365 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.365 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.366 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.366 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:57:04.366 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:04.366 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.366 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:04.366 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6814", 2020-11-16T20:57:04.366 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:57:04.367 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.367 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.367 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.367 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6809/31617", 2020-11-16T20:57:04.367 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6811/31617", 2020-11-16T20:57:04.367 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6815/31617", 2020-11-16T20:57:04.367 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6814/31617", 2020-11-16T20:57:04.368 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:57:04.368 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:57:04.368 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:57:04.368 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.368 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.368 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:04.368 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_xinfo": [ 2020-11-16T20:57:04.368 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.369 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 0, 2020-11-16T20:57:04.369 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:57:04.369 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:57:04.369 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:57:04.369 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:57:04.369 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:57:04.369 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:50.907461+0000", 2020-11-16T20:57:04.370 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:57:04.370 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.370 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.370 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 1, 2020-11-16T20:57:04.370 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:57:04.370 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:57:04.370 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:57:04.370 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:57:04.371 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:57:04.371 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:50.563693+0000", 2020-11-16T20:57:04.371 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:57:04.371 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.371 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.371 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 2, 2020-11-16T20:57:04.371 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:57:04.372 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:57:04.372 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:57:04.372 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:57:04.372 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:57:04.372 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:50.630147+0000", 2020-11-16T20:57:04.372 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:57:04.372 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.373 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.373 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 3, 2020-11-16T20:57:04.373 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:57:04.373 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:57:04.373 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:57:04.373 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:57:04.373 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:57:04.373 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:51.401993+0000", 2020-11-16T20:57:04.374 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:57:04.374 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.374 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.374 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 4, 2020-11-16T20:57:04.374 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:57:04.374 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:57:04.374 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:57:04.375 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:57:04.375 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:57:04.375 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:50.833464+0000", 2020-11-16T20:57:04.375 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:57:04.375 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.375 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.375 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 5, 2020-11-16T20:57:04.375 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:57:04.376 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:57:04.376 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:57:04.376 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:57:04.376 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:57:04.376 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:52.120480+0000", 2020-11-16T20:57:04.376 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:57:04.376 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.377 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.377 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 6, 2020-11-16T20:57:04.377 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:57:04.377 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:57:04.377 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:57:04.377 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:57:04.377 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:57:04.377 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:51.579262+0000", 2020-11-16T20:57:04.378 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:57:04.378 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.378 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.378 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 7, 2020-11-16T20:57:04.378 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:57:04.378 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:57:04.378 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:57:04.379 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:57:04.379 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:57:04.379 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:50.854798+0000", 2020-11-16T20:57:04.379 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:57:04.379 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.379 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:04.379 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_upmap": [ 2020-11-16T20:57:04.380 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.380 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "2.e", 2020-11-16T20:57:04.380 INFO:teuthology.orchestra.run.smithi166.stdout: "osds": [ 2020-11-16T20:57:04.380 INFO:teuthology.orchestra.run.smithi166.stdout: 1, 2020-11-16T20:57:04.380 INFO:teuthology.orchestra.run.smithi166.stdout: 7, 2020-11-16T20:57:04.380 INFO:teuthology.orchestra.run.smithi166.stdout: 0 2020-11-16T20:57:04.380 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.381 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.381 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.381 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "4.0", 2020-11-16T20:57:04.381 INFO:teuthology.orchestra.run.smithi166.stdout: "osds": [ 2020-11-16T20:57:04.381 INFO:teuthology.orchestra.run.smithi166.stdout: 2, 2020-11-16T20:57:04.381 INFO:teuthology.orchestra.run.smithi166.stdout: 1, 2020-11-16T20:57:04.381 INFO:teuthology.orchestra.run.smithi166.stdout: 0 2020-11-16T20:57:04.381 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.382 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.382 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:04.382 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_upmap_items": [ 2020-11-16T20:57:04.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.382 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "2.4", 2020-11-16T20:57:04.382 INFO:teuthology.orchestra.run.smithi166.stdout: "mappings": [ 2020-11-16T20:57:04.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.383 INFO:teuthology.orchestra.run.smithi166.stdout: "from": 7, 2020-11-16T20:57:04.383 INFO:teuthology.orchestra.run.smithi166.stdout: "to": 1 2020-11-16T20:57:04.383 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.383 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.383 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.383 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.383 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "4.1", 2020-11-16T20:57:04.384 INFO:teuthology.orchestra.run.smithi166.stdout: "mappings": [ 2020-11-16T20:57:04.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.384 INFO:teuthology.orchestra.run.smithi166.stdout: "from": 5, 2020-11-16T20:57:04.384 INFO:teuthology.orchestra.run.smithi166.stdout: "to": 3 2020-11-16T20:57:04.384 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.384 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.385 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "4.3", 2020-11-16T20:57:04.385 INFO:teuthology.orchestra.run.smithi166.stdout: "mappings": [ 2020-11-16T20:57:04.385 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.385 INFO:teuthology.orchestra.run.smithi166.stdout: "from": 5, 2020-11-16T20:57:04.385 INFO:teuthology.orchestra.run.smithi166.stdout: "to": 7 2020-11-16T20:57:04.385 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.385 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.386 INFO:teuthology.orchestra.run.smithi166.stdout: "from": 0, 2020-11-16T20:57:04.386 INFO:teuthology.orchestra.run.smithi166.stdout: "to": 1 2020-11-16T20:57:04.386 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.386 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.386 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.386 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:04.386 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_temp": [], 2020-11-16T20:57:04.386 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_temp": [], 2020-11-16T20:57:04.387 INFO:teuthology.orchestra.run.smithi166.stdout: "blocklist": {}, 2020-11-16T20:57:04.387 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profiles": { 2020-11-16T20:57:04.387 INFO:teuthology.orchestra.run.smithi166.stdout: "default": { 2020-11-16T20:57:04.387 INFO:teuthology.orchestra.run.smithi166.stdout: "crush-failure-domain": "osd", 2020-11-16T20:57:04.387 INFO:teuthology.orchestra.run.smithi166.stdout: "k": "2", 2020-11-16T20:57:04.387 INFO:teuthology.orchestra.run.smithi166.stdout: "m": "1", 2020-11-16T20:57:04.387 INFO:teuthology.orchestra.run.smithi166.stdout: "plugin": "jerasure", 2020-11-16T20:57:04.388 INFO:teuthology.orchestra.run.smithi166.stdout: "ruleset-failure-domain": "osd", 2020-11-16T20:57:04.388 INFO:teuthology.orchestra.run.smithi166.stdout: "technique": "reed_sol_van" 2020-11-16T20:57:04.388 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.388 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps_queue": [ 2020-11-16T20:57:04.388 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.388 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 3, 2020-11-16T20:57:04.388 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:57:04.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.389 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 37, 2020-11-16T20:57:04.389 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:57:04.389 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.389 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 48, 2020-11-16T20:57:04.389 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:57:04.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.390 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.390 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 51, 2020-11-16T20:57:04.390 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:57:04.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.390 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.390 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 53, 2020-11-16T20:57:04.390 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:57:04.391 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.391 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.391 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.391 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 4, 2020-11-16T20:57:04.391 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:57:04.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.392 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 37, 2020-11-16T20:57:04.392 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:57:04.392 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.392 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.392 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 48, 2020-11-16T20:57:04.392 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:57:04.392 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.393 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.393 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 51, 2020-11-16T20:57:04.393 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:57:04.393 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:04.393 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:04.393 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 53, 2020-11-16T20:57:04.393 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:57:04.393 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.394 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:04.394 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.394 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:04.394 INFO:teuthology.orchestra.run.smithi166.stdout: "new_removed_snaps": [], 2020-11-16T20:57:04.394 INFO:teuthology.orchestra.run.smithi166.stdout: "new_purged_snaps": [], 2020-11-16T20:57:04.394 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_node_flags": {}, 2020-11-16T20:57:04.394 INFO:teuthology.orchestra.run.smithi166.stdout: "device_class_flags": {}, 2020-11-16T20:57:04.395 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode": { 2020-11-16T20:57:04.395 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode_enabled": false, 2020-11-16T20:57:04.395 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_bucket_count": 0, 2020-11-16T20:57:04.395 INFO:teuthology.orchestra.run.smithi166.stdout: "degraded_stretch_mode": 0, 2020-11-16T20:57:04.395 INFO:teuthology.orchestra.run.smithi166.stdout: "recovering_stretch_mode": 0, 2020-11-16T20:57:04.395 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode_bucket": 0 2020-11-16T20:57:04.395 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:04.395 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:04.397 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:04.397 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:04.398 INFO:tasks.thrashosds.thrasher:j is {'epoch': 99, 'fsid': 'a14fd848-4cfe-4cd9-9140-5b3c4b4e904d', 'created': '2020-11-16T20:54:44.938121+0000', 'modified': '2020-11-16T20:57:03.860905+0000', 'last_up_change': '2020-11-16T20:54:52.080163+0000', 'last_in_change': '2020-11-16T20:54:52.080163+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-16T20:54:49.109999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-16T20:54:53.253680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 18, 'pg_placement_num': 18, 'pg_placement_num_target': 18, 'pg_num_target': 18, 'pg_num_pending': 18, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '32', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'base', 'create_time': '2020-11-16T20:55:23.597952+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 4, 'pg_placement_num': 4, 'pg_placement_num_target': 4, 'pg_num_target': 4, 'pg_num_pending': 4, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '27', 'last_force_op_resend_prenautilus': '27', 'last_force_op_resend_preluminous': '27', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 58, 'snap_epoch': 99, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [4], 'tier_of': -1, 'read_tier': 4, 'write_tier': 4, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 4, 'pool_name': 'cache', 'create_time': '2020-11-16T20:55:28.901773+0000', 'flags': 8201, 'flags_names': 'hashpspool,incomplete_clones,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 4, 'pg_placement_num': 4, 'pg_placement_num_target': 4, 'pg_num_target': 4, 'pg_num_pending': 4, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '27', 'last_force_op_resend_prenautilus': '27', 'last_force_op_resend_preluminous': '27', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 58, 'snap_epoch': 99, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': 3, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'writeback', 'target_max_bytes': 0, 'target_max_objects': 250, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'bloom', 'false_positive_probability': 0.05, 'target_size': 0, 'seed': 0}, 'hit_set_period': 3600, 'hit_set_count': 8, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 2, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [1000000, 1000000, 1000000, 1000000, 1000000, 1000000, 1000000, 1000000], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}}], 'osds': [{'osd': 0, 'uuid': '35950122-efbd-420e-b07a-f5730f26df17', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 95, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6800', 'nonce': 35293}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6802', 'nonce': 35293}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6806', 'nonce': 35293}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6804', 'nonce': 35293}]}, 'public_addr': '172.21.15.166:6800/35293', 'cluster_addr': '172.21.15.166:6802/35293', 'heartbeat_back_addr': '172.21.15.166:6806/35293', 'heartbeat_front_addr': '172.21.15.166:6804/35293', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f768a1ff-3e8a-4131-a6ed-10f93b3ca900', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 96, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6808', 'nonce': 35323}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6809', 'nonce': 35323}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6811', 'nonce': 35323}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6810', 'nonce': 35323}]}, 'public_addr': '172.21.15.166:6808/35323', 'cluster_addr': '172.21.15.166:6809/35323', 'heartbeat_back_addr': '172.21.15.166:6811/35323', 'heartbeat_front_addr': '172.21.15.166:6810/35323', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '88734179-84a6-4a9b-8af0-692805815875', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 84, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6801', 'nonce': 35294}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6803', 'nonce': 35294}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6807', 'nonce': 35294}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6805', 'nonce': 35294}]}, 'public_addr': '172.21.15.166:6801/35294', 'cluster_addr': '172.21.15.166:6803/35294', 'heartbeat_back_addr': '172.21.15.166:6807/35294', 'heartbeat_front_addr': '172.21.15.166:6805/35294', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '319e54e8-3f03-4388-8de6-678d148e25d4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6812', 'nonce': 35324}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6813', 'nonce': 35324}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6815', 'nonce': 35324}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6814', 'nonce': 35324}]}, 'public_addr': '172.21.15.166:6812/35324', 'cluster_addr': '172.21.15.166:6813/35324', 'heartbeat_back_addr': '172.21.15.166:6815/35324', 'heartbeat_front_addr': '172.21.15.166:6814/35324', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '3edbb68e-e030-4379-891e-2412f1235ffb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 63, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6804', 'nonce': 31586}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6805', 'nonce': 31586}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6807', 'nonce': 31586}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6806', 'nonce': 31586}]}, 'public_addr': '172.21.15.59:6804/31586', 'cluster_addr': '172.21.15.59:6805/31586', 'heartbeat_back_addr': '172.21.15.59:6807/31586', 'heartbeat_front_addr': '172.21.15.59:6806/31586', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '44fbf5ac-4484-48a8-a846-1f5c01a6ec2c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 63, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6808', 'nonce': 31610}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6810', 'nonce': 31610}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6813', 'nonce': 31610}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6812', 'nonce': 31610}]}, 'public_addr': '172.21.15.59:6808/31610', 'cluster_addr': '172.21.15.59:6810/31610', 'heartbeat_back_addr': '172.21.15.59:6813/31610', 'heartbeat_front_addr': '172.21.15.59:6812/31610', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'f93b82df-f537-4601-8247-388bf100b5b5', 'up': 1, 'in': 1, 'weight': 0.5654754638671875, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6800', 'nonce': 31587}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6801', 'nonce': 31587}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6803', 'nonce': 31587}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6802', 'nonce': 31587}]}, 'public_addr': '172.21.15.59:6800/31587', 'cluster_addr': '172.21.15.59:6801/31587', 'heartbeat_back_addr': '172.21.15.59:6803/31587', 'heartbeat_front_addr': '172.21.15.59:6802/31587', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'e5485c88-d267-4a6a-b9b6-15d869d28f28', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6809', 'nonce': 31617}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6811', 'nonce': 31617}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6815', 'nonce': 31617}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6814', 'nonce': 31617}]}, 'public_addr': '172.21.15.59:6809/31617', 'cluster_addr': '172.21.15.59:6811/31617', 'heartbeat_back_addr': '172.21.15.59:6815/31617', 'heartbeat_front_addr': '172.21.15.59:6814/31617', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:50.907461+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:50.563693+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:50.630147+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:51.401993+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:50.833464+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:52.120480+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:51.579262+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:50.854798+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.e', 'osds': [1, 7, 0]}, {'pgid': '4.0', 'osds': [2, 1, 0]}], 'pg_upmap_items': [{'pgid': '2.4', 'mappings': [{'from': 7, 'to': 1}]}, {'pgid': '4.1', 'mappings': [{'from': 5, 'to': 3}]}, {'pgid': '4.3', 'mappings': [{'from': 5, 'to': 7}, {'from': 0, 'to': 1}]}], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 37, 'length': 1}, {'begin': 48, 'length': 1}, {'begin': 51, 'length': 1}, {'begin': 53, 'length': 1}]}, {'pool': 4, 'snaps': [{'begin': 37, 'length': 1}, {'begin': 48, 'length': 1}, {'begin': 51, 'length': 1}, {'begin': 53, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2020-11-16T20:57:04.398 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 2.e 2020-11-16T20:57:04.399 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 2.e 2020-11-16T20:57:04.399 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:04.402+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:04.400 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:57:04.497 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:04.501+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:04.573 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:04.574 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:04.583 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:57:04.624 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:04.628+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:04.699 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:04.702+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:04.736 INFO:tasks.rados.rados.0.smithi166.stdout:902: done (2 left) 2020-11-16T20:57:04.737 INFO:tasks.rados.rados.0.smithi166.stdout:903: cache_flush oid 236 snap -1 2020-11-16T20:57:04.737 INFO:tasks.rados.rados.0.smithi166.stdout:898: finishing rollback tid 1 to smithi16641208-1 2020-11-16T20:57:04.737 INFO:tasks.rados.rados.0.smithi166.stdout:898: finishing rollback tid 2 to smithi16641208-1 2020-11-16T20:57:04.737 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 1 v 732 (ObjNum 0 snap 0 seq_num 0) dirty exists 2020-11-16T20:57:04.737 INFO:tasks.rados.rados.0.smithi166.stdout:901: got (2) No such file or directory 2020-11-16T20:57:04.743 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:04.745+0000 7ff3c9a43700 -1 osd.0 pg_epoch: 100 pg[3.1( v 100'725 (0'0,100'725] local-lis/les=19/20 n=136 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [0,4,3] r=0 lpr=19 luod=99'723 crt=100'725 lcod 92'721 mlcod 92'721 active+clean+snaptrim trimq=[38~1]] removing snap head 2020-11-16T20:57:04.743 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:04.746+0000 7f1d7e7f5700 -1 osd.3 pg_epoch: 100 pg[3.2( v 97'591 (0'0,97'591] local-lis/les=19/20 n=117 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [3,5,6] r=0 lpr=19 crt=97'591 lcod 91'589 mlcod 91'589 active+clean+snaptrim trimq=[38~1]] removing snap head 2020-11-16T20:57:04.743 INFO:tasks.rados.rados.0.smithi166.stdout:898: done (2 left) 2020-11-16T20:57:04.743 INFO:tasks.rados.rados.0.smithi166.stdout:901: done (1 left) 2020-11-16T20:57:04.744 INFO:tasks.rados.rados.0.smithi166.stdout:904: write (excl) oid 122 current snap is 30 2020-11-16T20:57:04.744 INFO:tasks.rados.rados.0.smithi166.stdout:904: seq_num 603 ranges {534621=567034,1636289=498332} 2020-11-16T20:57:04.745 INFO:tasks.rados.rados.0.smithi166.stdout:904: writing smithi16641208-122 from 534621 to 1101655 tid 1 2020-11-16T20:57:04.752 INFO:tasks.rados.rados.0.smithi166.stdout:904: writing smithi16641208-122 from 1636289 to 2134621 tid 2 2020-11-16T20:57:04.752 INFO:tasks.rados.rados.0.smithi166.stdout:905: read oid 221 snap -1 2020-11-16T20:57:04.752 INFO:tasks.rados.rados.0.smithi166.stdout:905: expect (ObjNum 220 snap 0 seq_num 220) 2020-11-16T20:57:04.753 INFO:tasks.rados.rados.0.smithi166.stdout:906: cache_flush oid 25 snap -1 2020-11-16T20:57:04.753 INFO:tasks.rados.rados.0.smithi166.stdout:907: write (excl) oid 136 current snap is 30 2020-11-16T20:57:04.753 INFO:tasks.rados.rados.0.smithi166.stdout:907: seq_num 604 ranges {551428=642283,1694771=456657} 2020-11-16T20:57:04.753 INFO:teuthology.orchestra.run.smithi166.stderr:nodeep-scrub is set 2020-11-16T20:57:04.759 INFO:tasks.rados.rados.0.smithi166.stdout:907: writing smithi16641208-136 from 551428 to 1193711 tid 1 2020-11-16T20:57:04.766 INFO:tasks.rados.rados.0.smithi166.stdout:907: writing smithi16641208-136 from 1694771 to 2151428 tid 2 2020-11-16T20:57:04.766 INFO:tasks.rados.rados.0.smithi166.stdout:908: copy_from oid 74 from oid 114 current snap is 30 2020-11-16T20:57:04.766 INFO:tasks.rados.rados.0.smithi166.stdout:909: rollback oid 3 current snap is 30 2020-11-16T20:57:04.766 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 3 to 28 2020-11-16T20:57:04.766 INFO:tasks.rados.rados.0.smithi166.stdout:903: got (0) Success 2020-11-16T20:57:04.767 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 236 v 0 (ObjNum 235 snap 0 seq_num 235) dirty exists 2020-11-16T20:57:04.767 INFO:tasks.rados.rados.0.smithi166.stdout:903: done (6 left) 2020-11-16T20:57:04.767 INFO:tasks.rados.rados.0.smithi166.stdout:910: write (excl) oid 357 current snap is 30 2020-11-16T20:57:04.767 INFO:tasks.rados.rados.0.smithi166.stdout:910: seq_num 605 ranges {568235=717532,1753253=414982} 2020-11-16T20:57:04.769 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:04.769 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:04.771 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:04.775+0000 7f868ad23700 -1 osd.1 pg_epoch: 100 pg[3.0( v 100'598 (0'0,100'598] local-lis/les=66/67 n=117 ec=19/19 lis/c=66/66 les/c/f=67/67/0 sis=66) [1,2,0] r=0 lpr=66 crt=100'598 lcod 100'596 mlcod 100'596 active+clean+snaptrim trimq=[38~1]] removing snap head 2020-11-16T20:57:04.777 INFO:tasks.rados.rados.0.smithi166.stdout:910: writing smithi16641208-357 from 568235 to 1285767 tid 1 2020-11-16T20:57:04.782 INFO:tasks.rados.rados.0.smithi166.stdout:910: writing smithi16641208-357 from 1753253 to 2168235 tid 2 2020-11-16T20:57:04.783 INFO:tasks.rados.rados.0.smithi166.stdout:911: cache_try_flush oid 284 snap -1 2020-11-16T20:57:04.786 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:57:04.788 INFO:tasks.rados.rados.0.smithi166.stdout:907: finishing write tid 1 to smithi16641208-136 2020-11-16T20:57:04.788 INFO:tasks.rados.rados.0.smithi166.stdout:909: finishing rollback tid 1 to smithi16641208-3 2020-11-16T20:57:04.789 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 3 v 307 (ObjNum 1953066355 snap 909207912 seq_num 842085430) dirty dne 2020-11-16T20:57:04.789 INFO:tasks.rados.rados.0.smithi166.stdout:905: expect (ObjNum 220 snap 0 seq_num 220) 2020-11-16T20:57:04.826 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:04.830+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:04.901 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:04.904+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:04.916 INFO:tasks.rados.rados.0.smithi166.stdout:904: finishing write tid 1 to smithi16641208-122 2020-11-16T20:57:04.916 INFO:tasks.rados.rados.0.smithi166.stdout:907: finishing write tid 2 to smithi16641208-136 2020-11-16T20:57:04.916 INFO:tasks.rados.rados.0.smithi166.stdout:907: finishing write tid 3 to smithi16641208-136 2020-11-16T20:57:04.916 INFO:tasks.rados.rados.0.smithi166.stdout:907: finishing write tid 4 to smithi16641208-136 2020-11-16T20:57:04.916 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 136 v 735 (ObjNum 604 snap 30 seq_num 604) dirty exists 2020-11-16T20:57:04.916 INFO:tasks.rados.rados.0.smithi166.stdout:907: left oid 136 (ObjNum 604 snap 30 seq_num 604) 2020-11-16T20:57:04.917 INFO:tasks.rados.rados.0.smithi166.stdout:905: done (7 left) 2020-11-16T20:57:04.917 INFO:tasks.rados.rados.0.smithi166.stdout:907: done (6 left) 2020-11-16T20:57:04.917 INFO:tasks.rados.rados.0.smithi166.stdout:909: done (5 left) 2020-11-16T20:57:04.917 INFO:tasks.rados.rados.0.smithi166.stdout:912: read oid 131 snap -1 2020-11-16T20:57:04.917 INFO:tasks.rados.rados.0.smithi166.stdout:912: expect (ObjNum 130 snap 0 seq_num 130) 2020-11-16T20:57:04.917 INFO:tasks.rados.rados.0.smithi166.stdout:913: cache_try_flush oid 499 snap -1 2020-11-16T20:57:04.918 INFO:tasks.rados.rados.0.smithi166.stdout:911: got (0) Success 2020-11-16T20:57:04.918 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 284 v 0 (ObjNum 560 snap 18 seq_num 560) dirty exists 2020-11-16T20:57:04.918 INFO:tasks.rados.rados.0.smithi166.stdout:910: finishing write tid 1 to smithi16641208-357 2020-11-16T20:57:04.918 INFO:tasks.rados.rados.0.smithi166.stdout:906: got (0) Success 2020-11-16T20:57:04.918 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 25 v 0 (ObjNum 24 snap 0 seq_num 24) dirty exists 2020-11-16T20:57:04.918 INFO:tasks.rados.rados.0.smithi166.stdout:904: finishing write tid 2 to smithi16641208-122 2020-11-16T20:57:04.918 INFO:tasks.rados.rados.0.smithi166.stdout:904: finishing write tid 3 to smithi16641208-122 2020-11-16T20:57:04.919 INFO:tasks.rados.rados.0.smithi166.stdout:904: finishing write tid 4 to smithi16641208-122 2020-11-16T20:57:04.919 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 122 v 737 (ObjNum 603 snap 30 seq_num 603) dirty exists 2020-11-16T20:57:04.919 INFO:tasks.rados.rados.0.smithi166.stdout:904: left oid 122 (ObjNum 603 snap 30 seq_num 603) 2020-11-16T20:57:04.919 INFO:tasks.rados.rados.0.smithi166.stdout:910: finishing write tid 2 to smithi16641208-357 2020-11-16T20:57:04.919 INFO:tasks.rados.rados.0.smithi166.stdout:908: finishing copy_from to smithi16641208-74 2020-11-16T20:57:04.919 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 74 v 56 (ObjNum 113 snap 0 seq_num 113) dirty exists 2020-11-16T20:57:04.919 INFO:tasks.rados.rados.0.smithi166.stdout:910: finishing write tid 3 to smithi16641208-357 2020-11-16T20:57:04.919 INFO:tasks.rados.rados.0.smithi166.stdout:910: finishing write tid 4 to smithi16641208-357 2020-11-16T20:57:04.920 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 357 v 597 (ObjNum 605 snap 30 seq_num 605) dirty exists 2020-11-16T20:57:04.920 INFO:tasks.rados.rados.0.smithi166.stdout:910: left oid 357 (ObjNum 605 snap 30 seq_num 605) 2020-11-16T20:57:04.920 INFO:tasks.rados.rados.0.smithi166.stdout:904: done (6 left) 2020-11-16T20:57:04.920 INFO:tasks.rados.rados.0.smithi166.stdout:906: done (5 left) 2020-11-16T20:57:04.920 INFO:tasks.rados.rados.0.smithi166.stdout:910: done (4 left) 2020-11-16T20:57:04.920 INFO:tasks.rados.rados.0.smithi166.stdout:911: done (3 left) 2020-11-16T20:57:04.920 INFO:tasks.rados.rados.0.smithi166.stdout:914: read oid 292 snap -1 2020-11-16T20:57:04.921 INFO:tasks.rados.rados.0.smithi166.stdout:914: expect (ObjNum 291 snap 0 seq_num 291) 2020-11-16T20:57:04.921 INFO:tasks.rados.rados.0.smithi166.stdout:915: write (excl) oid 327 current snap is 30 2020-11-16T20:57:04.921 INFO:tasks.rados.rados.0.smithi166.stdout:908: finishing copy_from racing read to smithi16641208-74 2020-11-16T20:57:04.921 INFO:tasks.rados.rados.0.smithi166.stdout:915: seq_num 606 ranges {585042=792781,2095382=89660} 2020-11-16T20:57:04.923 INFO:tasks.rados.rados.0.smithi166.stdout:915: writing smithi16641208-327 from 585042 to 1377823 tid 1 2020-11-16T20:57:04.928 INFO:tasks.rados.rados.0.smithi166.stdout:915: writing smithi16641208-327 from 2095382 to 2185042 tid 2 2020-11-16T20:57:04.929 INFO:tasks.rados.rados.0.smithi166.stdout:908: done (4 left) 2020-11-16T20:57:04.929 INFO:tasks.rados.rados.0.smithi166.stdout:916: read oid 256 snap -1 2020-11-16T20:57:04.929 INFO:tasks.rados.rados.0.smithi166.stdout:916: expect (ObjNum 255 snap 0 seq_num 255) 2020-11-16T20:57:04.929 INFO:tasks.rados.rados.0.smithi166.stdout:917: delete oid 260 current snap is 30 2020-11-16T20:57:04.929 INFO:tasks.rados.rados.0.smithi166.stdout:913: got (0) Success 2020-11-16T20:57:04.929 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 499 v 0 (ObjNum 548 snap 13 seq_num 548) dirty exists 2020-11-16T20:57:04.929 INFO:tasks.rados.rados.0.smithi166.stdout:914: expect (ObjNum 291 snap 0 seq_num 291) 2020-11-16T20:57:04.965 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:04.966 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:04.975 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:57:05.001 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:05.006+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:05.027 INFO:tasks.rados.rados.0.smithi166.stdout:912: expect (ObjNum 130 snap 0 seq_num 130) 2020-11-16T20:57:05.096 INFO:tasks.rados.rados.0.smithi166.stdout:916: expect (ObjNum 255 snap 0 seq_num 255) 2020-11-16T20:57:05.102 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:05.106+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:05.150 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:05.151 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:05.160 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:57:05.166 INFO:tasks.rados.rados.0.smithi166.stdout:915: finishing write tid 1 to smithi16641208-327 2020-11-16T20:57:05.167 INFO:tasks.rados.rados.0.smithi166.stdout:915: finishing write tid 2 to smithi16641208-327 2020-11-16T20:57:05.167 INFO:tasks.rados.rados.0.smithi166.stdout:915: finishing write tid 3 to smithi16641208-327 2020-11-16T20:57:05.167 INFO:tasks.rados.rados.0.smithi166.stdout:915: finishing write tid 4 to smithi16641208-327 2020-11-16T20:57:05.167 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 327 v 607 (ObjNum 606 snap 30 seq_num 606) dirty exists 2020-11-16T20:57:05.167 INFO:tasks.rados.rados.0.smithi166.stdout:915: left oid 327 (ObjNum 606 snap 30 seq_num 606) 2020-11-16T20:57:05.167 INFO:tasks.rados.rados.0.smithi166.stdout:912: done (5 left) 2020-11-16T20:57:05.167 INFO:tasks.rados.rados.0.smithi166.stdout:913: done (4 left) 2020-11-16T20:57:05.168 INFO:tasks.rados.rados.0.smithi166.stdout:914: done (3 left) 2020-11-16T20:57:05.168 INFO:tasks.rados.rados.0.smithi166.stdout:915: done (2 left) 2020-11-16T20:57:05.168 INFO:tasks.rados.rados.0.smithi166.stdout:916: done (1 left) 2020-11-16T20:57:05.168 INFO:tasks.rados.rados.0.smithi166.stdout:917: done (0 left) 2020-11-16T20:57:05.168 INFO:tasks.rados.rados.0.smithi166.stdout:918: cache_flush oid 301 snap 28 2020-11-16T20:57:05.168 INFO:tasks.rados.rados.0.smithi166.stdout:919: snap_remove snap 29 2020-11-16T20:57:05.203 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:05.209+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:05.286 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:05.286 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:05.295 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:57:05.336 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:05.341+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:05.405 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:57:05.410+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:57:05.460 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:05.460 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:05.469 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:57:05.513 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:05.518+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:05.595 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:05.596 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:05.605 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:57:05.646 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:05.651+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:05.708 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:05.712+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:05.747 INFO:tasks.rados.rados.0.smithi166.stdout:919: done (1 left) 2020-11-16T20:57:05.747 INFO:tasks.rados.rados.0.smithi166.stdout:920: read oid 90 snap 28 2020-11-16T20:57:05.747 INFO:tasks.rados.rados.0.smithi166.stdout:920: expect (ObjNum 89 snap 0 seq_num 89) 2020-11-16T20:57:05.747 INFO:tasks.rados.rados.0.smithi166.stdout:921: read oid 296 snap -1 2020-11-16T20:57:05.748 INFO:tasks.rados.rados.0.smithi166.stdout:921: expect (ObjNum 295 snap 0 seq_num 295) 2020-11-16T20:57:05.748 INFO:tasks.rados.rados.0.smithi166.stdout:922: rollback oid 330 current snap is 30 2020-11-16T20:57:05.748 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 330 to 28 2020-11-16T20:57:05.748 INFO:tasks.rados.rados.0.smithi166.stdout:923: read oid 113 snap 28 2020-11-16T20:57:05.748 INFO:tasks.rados.rados.0.smithi166.stdout:923: expect deleted 2020-11-16T20:57:05.748 INFO:tasks.rados.rados.0.smithi166.stdout:924: cache_flush oid 176 snap -1 2020-11-16T20:57:05.748 INFO:tasks.rados.rados.0.smithi166.stdout:925: write oid 234 current snap is 30 2020-11-16T20:57:05.749 INFO:tasks.rados.rados.0.smithi166.stdout:925: seq_num 608 ranges {618656=543279,1812346=406310} 2020-11-16T20:57:05.754 INFO:tasks.rados.rados.0.smithi166.stdout:925: writing smithi16641208-234 from 618656 to 1161935 tid 1 2020-11-16T20:57:05.754 INFO:teuthology.orchestra.run.smithi166.stderr:clear 2.e pg_upmap mapping 2020-11-16T20:57:05.761 INFO:tasks.rados.rados.0.smithi166.stdout:925: writing smithi16641208-234 from 1812346 to 2218656 tid 2 2020-11-16T20:57:05.761 INFO:tasks.rados.rados.0.smithi166.stdout:926: delete oid 468 current snap is 30 2020-11-16T20:57:05.761 INFO:tasks.rados.rados.0.smithi166.stdout:918: got (2) No such file or directory 2020-11-16T20:57:05.762 INFO:tasks.rados.rados.0.smithi166.stdout:924: got (2) No such file or directory 2020-11-16T20:57:05.774 INFO:tasks.rados.rados.0.smithi166.stdout:921: expect (ObjNum 295 snap 0 seq_num 295) 2020-11-16T20:57:05.796 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:05.796 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:05.807 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:57:05.848 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:05.853+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:05.872 INFO:tasks.rados.rados.0.smithi166.stdout:918: done (7 left) 2020-11-16T20:57:05.872 INFO:tasks.rados.rados.0.smithi166.stdout:921: done (6 left) 2020-11-16T20:57:05.872 INFO:tasks.rados.rados.0.smithi166.stdout:923: done (5 left) 2020-11-16T20:57:05.872 INFO:tasks.rados.rados.0.smithi166.stdout:924: done (4 left) 2020-11-16T20:57:05.873 INFO:tasks.rados.rados.0.smithi166.stdout:926: done (3 left) 2020-11-16T20:57:05.873 INFO:tasks.rados.rados.0.smithi166.stdout:927: cache_try_flush oid 216 snap 28 2020-11-16T20:57:05.873 INFO:tasks.rados.rados.0.smithi166.stdout:922: finishing rollback tid 0 to smithi16641208-330 2020-11-16T20:57:05.873 INFO:tasks.rados.rados.0.smithi166.stdout:922: finishing rollback tid 1 to smithi16641208-330 2020-11-16T20:57:10.074 INFO:tasks.rados.rados.0.smithi166.stdout:920: expect (ObjNum 89 snap 0 seq_num 89) 2020-11-16T20:57:10.075 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:57:10.076 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2020-11-16T20:57:10.083 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:07.763+0000 7f1837789700 -1 osd.4 pg_epoch: 103 pg[3.3( v 103'698 (0'0,103'698] local-lis/les=19/20 n=122 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [4,0,6] r=0 lpr=19 luod=101'696 crt=103'698 lcod 101'694 mlcod 101'694 active+clean+snaptrim trimq=[39~1] ps=[38~1,3a~1]] removing snap head 2020-11-16T20:57:10.083 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:10.083 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:10.083 INFO:tasks.rados.rados.0.smithi166.stdout:925: finishing write tid 1 to smithi16641208-234 2020-11-16T20:57:10.084 INFO:tasks.rados.rados.0.smithi166.stdout:922: finishing rollback tid 2 to smithi16641208-330 2020-11-16T20:57:10.084 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 330 v 611 (ObjNum 329 snap 0 seq_num 329) dirty exists 2020-11-16T20:57:10.084 INFO:tasks.rados.rados.0.smithi166.stdout:925: finishing write tid 2 to smithi16641208-234 2020-11-16T20:57:10.084 INFO:tasks.rados.rados.0.smithi166.stdout:925: finishing write tid 3 to smithi16641208-234 2020-11-16T20:57:10.084 INFO:tasks.rados.rados.0.smithi166.stdout:920: done (3 left) 2020-11-16T20:57:10.084 INFO:tasks.rados.rados.0.smithi166.stdout:922: done (2 left) 2020-11-16T20:57:10.085 INFO:tasks.rados.rados.0.smithi166.stdout:928: delete oid 30 current snap is 30 2020-11-16T20:57:10.085 INFO:tasks.rados.rados.0.smithi166.stdout:925: finishing write tid 4 to smithi16641208-234 2020-11-16T20:57:10.085 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 234 v 698 (ObjNum 608 snap 30 seq_num 608) dirty exists 2020-11-16T20:57:10.085 INFO:tasks.rados.rados.0.smithi166.stdout:925: left oid 234 (ObjNum 608 snap 30 seq_num 608) 2020-11-16T20:57:10.085 INFO:tasks.rados.rados.0.smithi166.stdout:927: got (2) No such file or directory 2020-11-16T20:57:10.085 INFO:tasks.rados.rados.0.smithi166.stdout:925: done (2 left) 2020-11-16T20:57:10.085 INFO:tasks.rados.rados.0.smithi166.stdout:927: done (1 left) 2020-11-16T20:57:10.085 INFO:tasks.rados.rados.0.smithi166.stdout:928: done (0 left) 2020-11-16T20:57:10.086 INFO:tasks.rados.rados.0.smithi166.stdout:929: snap_create 2020-11-16T20:57:10.086 INFO:tasks.rados.rados.0.smithi166.stdout:929: done (0 left) 2020-11-16T20:57:10.086 INFO:tasks.rados.rados.0.smithi166.stdout:930: read oid 283 snap 30 2020-11-16T20:57:10.086 INFO:tasks.rados.rados.0.smithi166.stdout:930: expect (ObjNum 520 snap 6 seq_num 520) 2020-11-16T20:57:10.086 INFO:tasks.rados.rados.0.smithi166.stdout:931: snap_remove snap 28 2020-11-16T20:57:10.086 INFO:tasks.rados.rados.0.smithi166.stdout:931: done (1 left) 2020-11-16T20:57:10.087 INFO:tasks.rados.rados.0.smithi166.stdout:932: delete oid 2 current snap is 31 2020-11-16T20:57:10.087 INFO:tasks.rados.rados.0.smithi166.stdout:930: expect (ObjNum 520 snap 6 seq_num 520) 2020-11-16T20:57:10.087 INFO:tasks.rados.rados.0.smithi166.stdout:930: done (1 left) 2020-11-16T20:57:10.087 INFO:tasks.rados.rados.0.smithi166.stdout:932: done (0 left) 2020-11-16T20:57:10.087 INFO:tasks.rados.rados.0.smithi166.stdout:933: write (excl) oid 7 current snap is 31 2020-11-16T20:57:10.087 INFO:tasks.rados.rados.0.smithi166.stdout:933: seq_num 612 ranges {685884=560628,2046274=239610} 2020-11-16T20:57:10.087 INFO:tasks.rados.rados.0.smithi166.stdout:933: writing smithi16641208-7 from 685884 to 1246512 tid 1 2020-11-16T20:57:10.088 INFO:tasks.rados.rados.0.smithi166.stdout:933: writing smithi16641208-7 from 2046274 to 2285884 tid 2 2020-11-16T20:57:10.088 INFO:tasks.rados.rados.0.smithi166.stdout:934: rollback oid 296 current snap is 31 2020-11-16T20:57:10.088 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 296 to 30 2020-11-16T20:57:10.088 INFO:tasks.rados.rados.0.smithi166.stdout:933: finishing write tid 1 to smithi16641208-7 2020-11-16T20:57:10.088 INFO:tasks.rados.rados.0.smithi166.stdout:935: cache_evict oid 394 snap 30 2020-11-16T20:57:10.088 INFO:tasks.rados.rados.0.smithi166.stdout:936: copy_from oid 10 from oid 444 current snap is 31 2020-11-16T20:57:10.088 INFO:tasks.rados.rados.0.smithi166.stdout:937: write oid 52 current snap is 31 2020-11-16T20:57:10.088 INFO:tasks.rados.rados.0.smithi166.stdout:937: seq_num 613 ranges {702691=635877,2104756=197935} 2020-11-16T20:57:10.089 INFO:tasks.rados.rados.0.smithi166.stdout:937: writing smithi16641208-52 from 702691 to 1338568 tid 1 2020-11-16T20:57:10.089 INFO:tasks.rados.rados.0.smithi166.stdout:937: writing smithi16641208-52 from 2104756 to 2302691 tid 2 2020-11-16T20:57:10.089 INFO:tasks.rados.rados.0.smithi166.stdout:938: cache_flush oid 475 snap -1 2020-11-16T20:57:10.089 INFO:tasks.rados.rados.0.smithi166.stdout:935: got (2) No such file or directory 2020-11-16T20:57:10.089 INFO:tasks.rados.rados.0.smithi166.stdout:935: done (5 left) 2020-11-16T20:57:10.089 INFO:tasks.rados.rados.0.smithi166.stdout:939: cache_try_flush oid 193 snap -1 2020-11-16T20:57:10.089 INFO:tasks.rados.rados.0.smithi166.stdout:933: finishing write tid 2 to smithi16641208-7 2020-11-16T20:57:10.090 INFO:tasks.rados.rados.0.smithi166.stdout:934: finishing rollback tid 0 to smithi16641208-296 2020-11-16T20:57:10.090 INFO:tasks.rados.rados.0.smithi166.stdout:933: finishing write tid 3 to smithi16641208-7 2020-11-16T20:57:10.090 INFO:tasks.rados.rados.0.smithi166.stdout:933: finishing write tid 4 to smithi16641208-7 2020-11-16T20:57:10.090 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 7 v 702 (ObjNum 612 snap 31 seq_num 612) dirty exists 2020-11-16T20:57:10.090 INFO:tasks.rados.rados.0.smithi166.stdout:933: left oid 7 (ObjNum 612 snap 31 seq_num 612) 2020-11-16T20:57:10.090 INFO:tasks.rados.rados.0.smithi166.stdout:933: done (5 left) 2020-11-16T20:57:10.090 INFO:tasks.rados.rados.0.smithi166.stdout:940: write (excl) oid 280 current snap is 31 2020-11-16T20:57:10.091 INFO:tasks.rados.rados.0.smithi166.stdout:940: seq_num 614 ranges {719498=711126,2046885=272613} 2020-11-16T20:57:10.091 INFO:tasks.rados.rados.0.smithi166.stdout:940: writing smithi16641208-280 from 719498 to 1430624 tid 1 2020-11-16T20:57:10.091 INFO:tasks.rados.rados.0.smithi166.stdout:940: writing smithi16641208-280 from 2046885 to 2319498 tid 2 2020-11-16T20:57:10.091 INFO:tasks.rados.rados.0.smithi166.stdout:941: snap_create 2020-11-16T20:57:10.091 INFO:tasks.rados.rados.0.smithi166.stdout:938: got (2) No such file or directory 2020-11-16T20:57:10.091 INFO:tasks.rados.rados.0.smithi166.stdout:937: finishing write tid 1 to smithi16641208-52 2020-11-16T20:57:10.091 INFO:tasks.rados.rados.0.smithi166.stdout:934: finishing rollback tid 1 to smithi16641208-296 2020-11-16T20:57:10.091 INFO:tasks.rados.rados.0.smithi166.stdout:934: finishing rollback tid 2 to smithi16641208-296 2020-11-16T20:57:10.092 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 296 v 626 (ObjNum 295 snap 0 seq_num 295) dirty exists 2020-11-16T20:57:10.092 INFO:tasks.rados.rados.0.smithi166.stdout:936: finishing copy_from to smithi16641208-10 2020-11-16T20:57:10.092 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 10 v 390 (ObjNum 443 snap 0 seq_num 443) dirty exists 2020-11-16T20:57:10.092 INFO:tasks.rados.rados.0.smithi166.stdout:940: finishing write tid 1 to smithi16641208-280 2020-11-16T20:57:10.092 INFO:tasks.rados.rados.0.smithi166.stdout:939: got (0) Success 2020-11-16T20:57:10.092 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 193 v 0 (ObjNum 575 snap 23 seq_num 575) dirty exists 2020-11-16T20:57:10.092 INFO:tasks.rados.rados.0.smithi166.stdout:937: finishing write tid 2 to smithi16641208-52 2020-11-16T20:57:10.093 INFO:tasks.rados.rados.0.smithi166.stdout:937: finishing write tid 3 to smithi16641208-52 2020-11-16T20:57:10.093 INFO:tasks.rados.rados.0.smithi166.stdout:937: finishing write tid 4 to smithi16641208-52 2020-11-16T20:57:10.093 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 52 v 759 (ObjNum 613 snap 31 seq_num 613) dirty exists 2020-11-16T20:57:10.093 INFO:tasks.rados.rados.0.smithi166.stdout:937: left oid 52 (ObjNum 613 snap 31 seq_num 613) 2020-11-16T20:57:10.093 INFO:tasks.rados.rados.0.smithi166.stdout:940: finishing write tid 2 to smithi16641208-280 2020-11-16T20:57:10.093 INFO:tasks.rados.rados.0.smithi166.stdout:940: finishing write tid 3 to smithi16641208-280 2020-11-16T20:57:10.093 INFO:tasks.rados.rados.0.smithi166.stdout:936: finishing copy_from racing read to smithi16641208-10 2020-11-16T20:57:10.094 INFO:tasks.rados.rados.0.smithi166.stdout:940: finishing write tid 4 to smithi16641208-280 2020-11-16T20:57:10.094 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 280 v 628 (ObjNum 614 snap 31 seq_num 614) dirty exists 2020-11-16T20:57:10.094 INFO:tasks.rados.rados.0.smithi166.stdout:940: left oid 280 (ObjNum 614 snap 31 seq_num 614) 2020-11-16T20:57:10.094 INFO:tasks.rados.rados.0.smithi166.stdout:934: done (6 left) 2020-11-16T20:57:10.094 INFO:tasks.rados.rados.0.smithi166.stdout:936: done (5 left) 2020-11-16T20:57:10.094 INFO:tasks.rados.rados.0.smithi166.stdout:937: done (4 left) 2020-11-16T20:57:10.094 INFO:tasks.rados.rados.0.smithi166.stdout:938: done (3 left) 2020-11-16T20:57:10.094 INFO:tasks.rados.rados.0.smithi166.stdout:939: done (2 left) 2020-11-16T20:57:10.095 INFO:tasks.rados.rados.0.smithi166.stdout:940: done (1 left) 2020-11-16T20:57:10.095 INFO:tasks.rados.rados.0.smithi166.stdout:941: done (0 left) 2020-11-16T20:57:10.095 INFO:tasks.rados.rados.0.smithi166.stdout:942: read oid 366 snap -1 2020-11-16T20:57:10.095 INFO:tasks.rados.rados.0.smithi166.stdout:942: expect (ObjNum 534 snap 9 seq_num 534) 2020-11-16T20:57:10.095 INFO:tasks.rados.rados.0.smithi166.stdout:943: copy_from oid 277 from oid 28 current snap is 32 2020-11-16T20:57:10.095 INFO:tasks.rados.rados.0.smithi166.stdout:944: cache_flush oid 303 snap -1 2020-11-16T20:57:10.095 INFO:tasks.rados.rados.0.smithi166.stdout:945: cache_try_flush oid 384 snap -1 2020-11-16T20:57:10.096 INFO:tasks.rados.rados.0.smithi166.stdout:946: cache_flush oid 360 snap 31 2020-11-16T20:57:10.096 INFO:tasks.rados.rados.0.smithi166.stdout:947: read oid 477 snap -1 2020-11-16T20:57:10.096 INFO:tasks.rados.rados.0.smithi166.stdout:947: expect (ObjNum 476 snap 0 seq_num 476) 2020-11-16T20:57:10.096 INFO:tasks.rados.rados.0.smithi166.stdout:948: copy_from oid 46 from oid 378 current snap is 32 2020-11-16T20:57:10.096 INFO:tasks.rados.rados.0.smithi166.stdout:949: write oid 133 current snap is 32 2020-11-16T20:57:10.096 INFO:tasks.rados.rados.0.smithi166.stdout:949: seq_num 615 ranges {736305=786375,2105367=230938} 2020-11-16T20:57:10.096 INFO:tasks.rados.rados.0.smithi166.stdout:949: writing smithi16641208-133 from 736305 to 1522680 tid 1 2020-11-16T20:57:10.096 INFO:tasks.rados.rados.0.smithi166.stdout:949: writing smithi16641208-133 from 2105367 to 2336305 tid 2 2020-11-16T20:57:10.097 INFO:tasks.rados.rados.0.smithi166.stdout:950: write (excl) oid 29 current snap is 32 2020-11-16T20:57:10.097 INFO:tasks.rados.rados.0.smithi166.stdout:945: got (2) No such file or directory 2020-11-16T20:57:10.097 INFO:tasks.rados.rados.0.smithi166.stdout:950: seq_num 616 ranges {753112=577977,1880202=472910} 2020-11-16T20:57:10.097 INFO:tasks.rados.rados.0.smithi166.stdout:950: writing smithi16641208-29 from 753112 to 1331089 tid 1 2020-11-16T20:57:10.097 INFO:tasks.rados.rados.0.smithi166.stdout:950: writing smithi16641208-29 from 1880202 to 2353112 tid 2 2020-11-16T20:57:10.097 INFO:tasks.rados.rados.0.smithi166.stdout:945: done (8 left) 2020-11-16T20:57:10.097 INFO:tasks.rados.rados.0.smithi166.stdout:951: read oid 278 snap -1 2020-11-16T20:57:10.098 INFO:tasks.rados.rados.0.smithi166.stdout:951: expect (ObjNum 359 snap 0 seq_num 359) 2020-11-16T20:57:10.098 INFO:tasks.rados.rados.0.smithi166.stdout:952: write (excl) oid 451 current snap is 32 2020-11-16T20:57:10.098 INFO:tasks.rados.rados.0.smithi166.stdout:952: seq_num 617 ranges {769919=653226,1938684=431235} 2020-11-16T20:57:10.098 INFO:tasks.rados.rados.0.smithi166.stdout:952: writing smithi16641208-451 from 769919 to 1423145 tid 1 2020-11-16T20:57:10.098 INFO:tasks.rados.rados.0.smithi166.stdout:952: writing smithi16641208-451 from 1938684 to 2369919 tid 2 2020-11-16T20:57:10.098 INFO:tasks.rados.rados.0.smithi166.stdout:953: read oid 33 snap -1 2020-11-16T20:57:10.098 INFO:tasks.rados.rados.0.smithi166.stdout:953: expect (ObjNum 12 snap 0 seq_num 12) 2020-11-16T20:57:10.099 INFO:tasks.rados.rados.0.smithi166.stdout:954: read oid 458 snap -1 2020-11-16T20:57:10.099 INFO:tasks.rados.rados.0.smithi166.stdout:954: expect (ObjNum 457 snap 0 seq_num 457) 2020-11-16T20:57:10.099 INFO:tasks.rados.rados.0.smithi166.stdout:955: write (excl) oid 265 current snap is 32 2020-11-16T20:57:10.099 INFO:tasks.rados.rados.0.smithi166.stdout:946: got (2) No such file or directory 2020-11-16T20:57:10.099 INFO:tasks.rados.rados.0.smithi166.stdout:955: seq_num 618 ranges {786726=728475,2280813=105913} 2020-11-16T20:57:10.099 INFO:tasks.rados.rados.0.smithi166.stdout:955: writing smithi16641208-265 from 786726 to 1515201 tid 1 2020-11-16T20:57:10.099 INFO:tasks.rados.rados.0.smithi166.stdout:955: writing smithi16641208-265 from 2280813 to 2386726 tid 2 2020-11-16T20:57:10.099 INFO:tasks.rados.rados.0.smithi166.stdout:946: done (12 left) 2020-11-16T20:57:10.100 INFO:tasks.rados.rados.0.smithi166.stdout:956: snap_remove snap 31 2020-11-16T20:57:10.100 INFO:tasks.rados.rados.0.smithi166.stdout:956: done (12 left) 2020-11-16T20:57:10.100 INFO:tasks.rados.rados.0.smithi166.stdout:957: copy_from oid 319 from oid 207 current snap is 32 2020-11-16T20:57:10.100 INFO:tasks.rados.rados.0.smithi166.stdout:942: expect (ObjNum 534 snap 9 seq_num 534) 2020-11-16T20:57:10.100 INFO:tasks.rados.rados.0.smithi166.stdout:947: expect (ObjNum 476 snap 0 seq_num 476) 2020-11-16T20:57:10.100 INFO:tasks.rados.rados.0.smithi166.stdout:949: finishing write tid 1 to smithi16641208-133 2020-11-16T20:57:10.100 INFO:tasks.rados.rados.0.smithi166.stdout:951: expect (ObjNum 359 snap 0 seq_num 359) 2020-11-16T20:57:10.101 INFO:tasks.rados.rados.0.smithi166.stdout:950: finishing write tid 1 to smithi16641208-29 2020-11-16T20:57:10.101 INFO:tasks.rados.rados.0.smithi166.stdout:944: got (0) Success 2020-11-16T20:57:10.101 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 303 v 0 (ObjNum 302 snap 0 seq_num 302) dirty exists 2020-11-16T20:57:10.101 INFO:tasks.rados.rados.0.smithi166.stdout:943: finishing copy_from to smithi16641208-277 2020-11-16T20:57:10.101 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 277 v 21 (ObjNum 27 snap 0 seq_num 27) dirty exists 2020-11-16T20:57:10.101 INFO:tasks.rados.rados.0.smithi166.stdout:942: done (12 left) 2020-11-16T20:57:10.101 INFO:tasks.rados.rados.0.smithi166.stdout:944: done (11 left) 2020-11-16T20:57:10.101 INFO:tasks.rados.rados.0.smithi166.stdout:947: done (10 left) 2020-11-16T20:57:10.102 INFO:tasks.rados.rados.0.smithi166.stdout:951: done (9 left) 2020-11-16T20:57:10.102 INFO:tasks.rados.rados.0.smithi166.stdout:958: write oid 218 current snap is 32 2020-11-16T20:57:10.102 INFO:tasks.rados.rados.0.smithi166.stdout:958: seq_num 619 ranges {403533=403724,1539295=652201} 2020-11-16T20:57:10.102 INFO:tasks.rados.rados.0.smithi166.stdout:958: writing smithi16641208-218 from 403533 to 807257 tid 1 2020-11-16T20:57:10.102 INFO:tasks.rados.rados.0.smithi166.stdout:958: writing smithi16641208-218 from 1539295 to 2191496 tid 2 2020-11-16T20:57:10.102 INFO:tasks.rados.rados.0.smithi166.stdout:959: delete oid 347 current snap is 32 2020-11-16T20:57:10.102 INFO:tasks.rados.rados.0.smithi166.stdout:952: finishing write tid 1 to smithi16641208-451 2020-11-16T20:57:10.103 INFO:tasks.rados.rados.0.smithi166.stdout:953: expect (ObjNum 12 snap 0 seq_num 12) 2020-11-16T20:57:10.103 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:07.768+0000 7f8686d1b700 -1 osd.1 pg_epoch: 103 pg[3.0( v 103'616 (0'0,103'616] local-lis/les=66/67 n=116 ec=19/19 lis/c=66/66 les/c/f=67/67/0 sis=66) [1,2,0] r=0 lpr=66 luod=101'614 crt=103'616 lcod 101'612 mlcod 101'612 active+clean+snaptrim trimq=[39~1] ps=[38~1,3a~1]] removing snap head 2020-11-16T20:57:10.103 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:07.771+0000 7ff3cda4b700 -1 osd.0 pg_epoch: 103 pg[3.1( v 103'751 (0'0,103'751] local-lis/les=19/20 n=135 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [0,4,3] r=0 lpr=19 crt=103'751 lcod 103'749 mlcod 103'749 active+clean+snaptrim trimq=[39~1] ps=[38~1,3a~1]] removing snap head 2020-11-16T20:57:10.103 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:10.080+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:10.103 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:07.771+0000 7f1d7a7ed700 -1 osd.3 pg_epoch: 103 pg[3.2( v 103'601 (0'0,103'601] local-lis/les=19/20 n=116 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [3,5,6] r=0 lpr=19 luod=101'599 crt=103'601 lcod 101'597 mlcod 101'597 active+clean+snaptrim trimq=[39~1] ps=[38~1,3a~1]] removing snap head 2020-11-16T20:57:10.104 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:57:10.104 INFO:tasks.rados.rados.0.smithi166.stdout:954: expect (ObjNum 457 snap 0 seq_num 457) 2020-11-16T20:57:10.177 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:10.181+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:10.228 INFO:tasks.rados.rados.0.smithi166.stdout:949: finishing write tid 2 to smithi16641208-133 2020-11-16T20:57:10.228 INFO:tasks.rados.rados.0.smithi166.stdout:949: finishing write tid 3 to smithi16641208-133 2020-11-16T20:57:10.228 INFO:tasks.rados.rados.0.smithi166.stdout:949: finishing write tid 4 to smithi16641208-133 2020-11-16T20:57:10.228 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 133 v 706 (ObjNum 615 snap 32 seq_num 615) dirty exists 2020-11-16T20:57:10.228 INFO:tasks.rados.rados.0.smithi166.stdout:949: left oid 133 (ObjNum 615 snap 32 seq_num 615) 2020-11-16T20:57:10.229 INFO:tasks.rados.rados.0.smithi166.stdout:950: finishing write tid 2 to smithi16641208-29 2020-11-16T20:57:10.229 INFO:tasks.rados.rados.0.smithi166.stdout:950: finishing write tid 3 to smithi16641208-29 2020-11-16T20:57:10.229 INFO:tasks.rados.rados.0.smithi166.stdout:950: finishing write tid 4 to smithi16641208-29 2020-11-16T20:57:10.229 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 29 v 708 (ObjNum 616 snap 32 seq_num 616) dirty exists 2020-11-16T20:57:10.229 INFO:tasks.rados.rados.0.smithi166.stdout:950: left oid 29 (ObjNum 616 snap 32 seq_num 616) 2020-11-16T20:57:10.229 INFO:tasks.rados.rados.0.smithi166.stdout:952: finishing write tid 2 to smithi16641208-451 2020-11-16T20:57:10.229 INFO:tasks.rados.rados.0.smithi166.stdout:943: finishing copy_from racing read to smithi16641208-277 2020-11-16T20:57:10.230 INFO:tasks.rados.rados.0.smithi166.stdout:952: finishing write tid 3 to smithi16641208-451 2020-11-16T20:57:10.230 INFO:tasks.rados.rados.0.smithi166.stdout:952: finishing write tid 4 to smithi16641208-451 2020-11-16T20:57:10.230 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 451 v 600 (ObjNum 617 snap 32 seq_num 617) dirty exists 2020-11-16T20:57:10.230 INFO:tasks.rados.rados.0.smithi166.stdout:952: left oid 451 (ObjNum 617 snap 32 seq_num 617) 2020-11-16T20:57:10.230 INFO:tasks.rados.rados.0.smithi166.stdout:955: finishing write tid 1 to smithi16641208-265 2020-11-16T20:57:10.230 INFO:tasks.rados.rados.0.smithi166.stdout:955: finishing write tid 2 to smithi16641208-265 2020-11-16T20:57:10.230 INFO:tasks.rados.rados.0.smithi166.stdout:955: finishing write tid 3 to smithi16641208-265 2020-11-16T20:57:10.231 INFO:tasks.rados.rados.0.smithi166.stdout:955: finishing write tid 4 to smithi16641208-265 2020-11-16T20:57:10.231 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 265 v 635 (ObjNum 618 snap 32 seq_num 618) dirty exists 2020-11-16T20:57:10.231 INFO:tasks.rados.rados.0.smithi166.stdout:955: left oid 265 (ObjNum 618 snap 32 seq_num 618) 2020-11-16T20:57:10.231 INFO:tasks.rados.rados.0.smithi166.stdout:948: finishing copy_from to smithi16641208-46 2020-11-16T20:57:10.231 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 46 v 277 (ObjNum 377 snap 0 seq_num 377) dirty exists 2020-11-16T20:57:10.231 INFO:tasks.rados.rados.0.smithi166.stdout:948: finishing copy_from racing read to smithi16641208-46 2020-11-16T20:57:10.231 INFO:tasks.rados.rados.0.smithi166.stdout:957: finishing copy_from to smithi16641208-319 2020-11-16T20:57:10.231 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 319 v 445 (ObjNum 206 snap 0 seq_num 206) dirty exists 2020-11-16T20:57:10.232 INFO:tasks.rados.rados.0.smithi166.stdout:957: finishing copy_from racing read to smithi16641208-319 2020-11-16T20:57:10.232 INFO:tasks.rados.rados.0.smithi166.stdout:943: done (10 left) 2020-11-16T20:57:10.232 INFO:tasks.rados.rados.0.smithi166.stdout:948: done (9 left) 2020-11-16T20:57:10.232 INFO:tasks.rados.rados.0.smithi166.stdout:949: done (8 left) 2020-11-16T20:57:10.232 INFO:tasks.rados.rados.0.smithi166.stdout:950: done (7 left) 2020-11-16T20:57:10.232 INFO:tasks.rados.rados.0.smithi166.stdout:952: done (6 left) 2020-11-16T20:57:10.232 INFO:tasks.rados.rados.0.smithi166.stdout:953: done (5 left) 2020-11-16T20:57:10.233 INFO:tasks.rados.rados.0.smithi166.stdout:954: done (4 left) 2020-11-16T20:57:10.233 INFO:tasks.rados.rados.0.smithi166.stdout:955: done (3 left) 2020-11-16T20:57:10.233 INFO:tasks.rados.rados.0.smithi166.stdout:957: done (2 left) 2020-11-16T20:57:10.233 INFO:tasks.rados.rados.0.smithi166.stdout:959: done (1 left) 2020-11-16T20:57:10.233 INFO:tasks.rados.rados.0.smithi166.stdout:960: snap_create 2020-11-16T20:57:10.233 INFO:tasks.rados.rados.0.smithi166.stdout:958: finishing write tid 1 to smithi16641208-218 2020-11-16T20:57:10.233 INFO:tasks.rados.rados.0.smithi166.stdout:958: finishing write tid 2 to smithi16641208-218 2020-11-16T20:57:10.233 INFO:tasks.rados.rados.0.smithi166.stdout:958: finishing write tid 3 to smithi16641208-218 2020-11-16T20:57:10.234 INFO:tasks.rados.rados.0.smithi166.stdout:958: finishing write tid 4 to smithi16641208-218 2020-11-16T20:57:10.234 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 218 v 639 (ObjNum 619 snap 32 seq_num 619) dirty exists 2020-11-16T20:57:10.234 INFO:tasks.rados.rados.0.smithi166.stdout:958: left oid 218 (ObjNum 619 snap 32 seq_num 619) 2020-11-16T20:57:10.242 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:10.242 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:10.252 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:57:10.277 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:10.281+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:10.378 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:10.382+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:10.380 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:10.380 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:10.390 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:57:10.458 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:57:10.478 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:57:10.478 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:10.482+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:10.497 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:57:10.517 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:57:10.538 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:57:10.559 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:57:10.560 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:10.561 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:57:10.561 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:57:10.561 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:57:10.561 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:10.571 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:57:10.580 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:57:10.580 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:10.584+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:10.600 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:57:10.602 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:57:10.602 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:57:10.602 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:57:10.603 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:57:10.603 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:57:10.603 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:57:10.603 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:57:10.604 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:57:10.680 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:10.684+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:10.708 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:10.709 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:57:10.709 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:57:10.709 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:57:10.709 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.709 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2979 4.0 4:1852173c:::smithi16641208-329:head [write 581674~637746,stat] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:10.709 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:57:10.710 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.908098473999999, 2020-11-16T20:57:10.710 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.009457398, 2020-11-16T20:57:10.710 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:10.710 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:10.710 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:10.710 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:10.711 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:10.711 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2979 2020-11-16T20:57:10.711 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.711 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:10.711 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.711 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:10.711 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:57:10.712 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:10.712 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.712 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.712 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:10.712 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:57:10.712 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030732300000000003 2020-11-16T20:57:10.712 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.713 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.713 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:10.713 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803965+0000", 2020-11-16T20:57:10.713 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0319999999999992e-06 2020-11-16T20:57:10.713 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.713 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.714 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:10.714 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803974+0000", 2020-11-16T20:57:10.714 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5930000000000002e-05 2020-11-16T20:57:10.714 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.714 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.714 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:10.714 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803990+0000", 2020-11-16T20:57:10.715 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1910000000000006e-06 2020-11-16T20:57:10.715 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.715 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.715 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:10.715 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803999+0000", 2020-11-16T20:57:10.715 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5637000000000003e-05 2020-11-16T20:57:10.715 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.716 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.716 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.716 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.804055+0000", 2020-11-16T20:57:10.716 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3769000000000001e-05 2020-11-16T20:57:10.716 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.716 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.716 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:10.717 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.804088+0000", 2020-11-16T20:57:10.717 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.995239140000001 2020-11-16T20:57:10.717 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.717 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.717 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.717 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799328+0000", 2020-11-16T20:57:10.717 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0137818 2020-11-16T20:57:10.718 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.718 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.718 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:10.718 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813109+0000", 2020-11-16T20:57:10.718 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5759999999999996e-06 2020-11-16T20:57:10.718 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.719 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.719 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:10.719 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813115+0000", 2020-11-16T20:57:10.719 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.009457398 2020-11-16T20:57:10.719 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.719 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:10.719 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.720 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.720 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.720 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2980 4.0 4:1852173c:::smithi16641208-329:head [write 1840873~558854] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:10.720 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:57:10.720 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.901832742, 2020-11-16T20:57:10.720 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.039347508000001, 2020-11-16T20:57:10.720 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:10.721 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:10.721 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:10.721 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:10.721 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:10.721 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2980 2020-11-16T20:57:10.721 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.721 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:10.722 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.722 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:10.722 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:57:10.722 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:10.722 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.722 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.722 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:10.723 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:57:10.723 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024810899999999999 2020-11-16T20:57:10.723 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.723 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.723 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:10.723 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810171+0000", 2020-11-16T20:57:10.723 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5610000000000001e-06 2020-11-16T20:57:10.724 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.724 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.724 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:10.724 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810179+0000", 2020-11-16T20:57:10.724 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7418000000000002e-05 2020-11-16T20:57:10.724 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.725 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.725 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:10.725 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810196+0000", 2020-11-16T20:57:10.725 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0079999999999996e-06 2020-11-16T20:57:10.725 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.725 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.725 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:10.726 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810203+0000", 2020-11-16T20:57:10.726 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3705000000000002e-05 2020-11-16T20:57:10.726 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.726 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.726 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.726 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810257+0000", 2020-11-16T20:57:10.726 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3656999999999998e-05 2020-11-16T20:57:10.727 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.727 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.727 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:10.727 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810311+0000", 2020-11-16T20:57:10.727 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.989427508 2020-11-16T20:57:10.727 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.727 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.728 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.728 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799738+0000", 2020-11-16T20:57:10.728 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2526000000000003e-05 2020-11-16T20:57:10.728 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.728 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.728 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:10.729 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799811+0000", 2020-11-16T20:57:10.729 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027934184000000001 2020-11-16T20:57:10.729 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.729 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.729 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.729 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827745+0000", 2020-11-16T20:57:10.729 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015776700000000001 2020-11-16T20:57:10.730 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.730 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.730 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:10.730 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827903+0000", 2020-11-16T20:57:10.730 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000185539 2020-11-16T20:57:10.730 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.731 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.731 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:10.731 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.828088+0000", 2020-11-16T20:57:10.731 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018143857999999999 2020-11-16T20:57:10.731 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.731 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.731 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:10.732 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846232+0000", 2020-11-16T20:57:10.732 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00074682199999999996 2020-11-16T20:57:10.732 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.732 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.732 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:10.732 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846979+0000", 2020-11-16T20:57:10.732 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021617530000000002 2020-11-16T20:57:10.733 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.733 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.733 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:10.733 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849141+0000", 2020-11-16T20:57:10.733 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4513999999999998e-05 2020-11-16T20:57:10.733 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.733 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.734 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:10.734 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849215+0000", 2020-11-16T20:57:10.734 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5578999999999998e-05 2020-11-16T20:57:10.734 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.734 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.734 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:10.734 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849271+0000", 2020-11-16T20:57:10.735 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.039347508000001 2020-11-16T20:57:10.735 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.735 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:10.735 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.735 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.735 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.736 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2981 4.0 4:1852173c:::smithi16641208-329:head [write 3066417~537135] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:10.736 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:57:10.736 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.894916445, 2020-11-16T20:57:10.736 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.032910677, 2020-11-16T20:57:10.736 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:10.736 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:10.736 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:10.737 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:10.737 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:10.737 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2981 2020-11-16T20:57:10.737 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.737 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:10.737 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.738 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:10.738 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:57:10.738 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:10.738 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.738 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.738 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:10.739 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:57:10.739 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024974099999999999 2020-11-16T20:57:10.739 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.739 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.739 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:10.739 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817089+0000", 2020-11-16T20:57:10.739 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3829999999999992e-06 2020-11-16T20:57:10.740 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.740 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.740 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:10.740 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817098+0000", 2020-11-16T20:57:10.740 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2118e-05 2020-11-16T20:57:10.740 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.740 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.741 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:10.741 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817110+0000", 2020-11-16T20:57:10.741 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6050000000000004e-06 2020-11-16T20:57:10.741 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.741 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.741 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:10.742 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817119+0000", 2020-11-16T20:57:10.742 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7204000000000003e-05 2020-11-16T20:57:10.742 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.742 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.742 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.742 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817177+0000", 2020-11-16T20:57:10.742 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9932999999999998e-05 2020-11-16T20:57:10.743 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.743 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.743 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:10.743 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817227+0000", 2020-11-16T20:57:10.743 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.98265286 2020-11-16T20:57:10.743 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.743 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.744 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.744 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799879+0000", 2020-11-16T20:57:10.744 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.737e-05 2020-11-16T20:57:10.744 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.744 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.744 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:10.744 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799947+0000", 2020-11-16T20:57:10.745 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029940584999999999 2020-11-16T20:57:10.745 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.745 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.745 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.745 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.829887+0000", 2020-11-16T20:57:10.745 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000217505 2020-11-16T20:57:10.746 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.746 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.746 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:10.746 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.830105+0000", 2020-11-16T20:57:10.746 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029022100000000001 2020-11-16T20:57:10.746 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.747 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.747 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:10.747 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.830395+0000", 2020-11-16T20:57:10.747 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015847953000000001 2020-11-16T20:57:10.747 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.747 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.747 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:10.748 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846243+0000", 2020-11-16T20:57:10.748 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0011558250000000001 2020-11-16T20:57:10.748 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.748 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.748 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:10.748 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847399+0000", 2020-11-16T20:57:10.748 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021524500000000002 2020-11-16T20:57:10.749 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.749 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.749 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:10.749 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849551+0000", 2020-11-16T20:57:10.749 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000138787 2020-11-16T20:57:10.749 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.749 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.750 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:10.750 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849690+0000", 2020-11-16T20:57:10.750 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0136999999999997e-05 2020-11-16T20:57:10.750 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.750 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.751 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:10.751 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849750+0000", 2020-11-16T20:57:10.751 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.032910677 2020-11-16T20:57:10.751 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.751 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:10.751 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.751 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.752 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.752 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2982 4.0 4:1852173c:::smithi16641208-329:head [setxattr _header (58) in=7b,truncate 3781674] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:10.752 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:57:10.752 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.894598129999999, 2020-11-16T20:57:10.752 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.035208633, 2020-11-16T20:57:10.752 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:10.752 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:10.753 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:10.753 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:10.753 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:10.753 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2982 2020-11-16T20:57:10.753 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.753 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:10.754 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.754 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:10.754 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:57:10.754 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:10.754 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.754 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.754 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:10.755 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:57:10.755 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8856000000000002e-05 2020-11-16T20:57:10.755 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.755 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.755 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:10.755 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817197+0000", 2020-11-16T20:57:10.755 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.93e-06 2020-11-16T20:57:10.756 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.756 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.756 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:10.756 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817203+0000", 2020-11-16T20:57:10.756 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0932e-05 2020-11-16T20:57:10.756 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.756 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.757 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:10.757 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817214+0000", 2020-11-16T20:57:10.757 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3470000000000001e-06 2020-11-16T20:57:10.757 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.757 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.757 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:10.758 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817218+0000", 2020-11-16T20:57:10.758 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4603e-05 2020-11-16T20:57:10.758 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.758 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.758 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.758 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817263+0000", 2020-11-16T20:57:10.758 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6387000000000002e-05 2020-11-16T20:57:10.759 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.759 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.759 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:10.759 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817309+0000", 2020-11-16T20:57:10.759 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.982698653 2020-11-16T20:57:10.759 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.759 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.760 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.760 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800008+0000", 2020-11-16T20:57:10.760 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5400000000000004e-05 2020-11-16T20:57:10.760 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.760 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.760 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:10.760 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800073+0000", 2020-11-16T20:57:10.761 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.044932818999999999 2020-11-16T20:57:10.761 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.761 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.761 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.761 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845006+0000", 2020-11-16T20:57:10.761 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017285099999999999 2020-11-16T20:57:10.761 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.762 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.762 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:10.762 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845179+0000", 2020-11-16T20:57:10.762 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023420900000000001 2020-11-16T20:57:10.762 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.762 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.763 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:10.763 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845413+0000", 2020-11-16T20:57:10.763 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0020276000000000001 2020-11-16T20:57:10.763 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.763 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.763 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:10.763 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847441+0000", 2020-11-16T20:57:10.764 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00050358800000000002 2020-11-16T20:57:10.764 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.764 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.764 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:10.764 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847944+0000", 2020-11-16T20:57:10.764 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042758900000000001 2020-11-16T20:57:10.764 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.765 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.765 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:10.765 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852220+0000", 2020-11-16T20:57:10.765 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9648999999999997e-05 2020-11-16T20:57:10.765 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.765 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.765 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:10.766 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852290+0000", 2020-11-16T20:57:10.766 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6919e-05 2020-11-16T20:57:10.766 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.766 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.766 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:10.766 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852367+0000", 2020-11-16T20:57:10.767 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.035208633 2020-11-16T20:57:10.767 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.767 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:10.767 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.767 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.767 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.767 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2983 4.0 4:1852173c:::smithi16641208-329:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e86)", 2020-11-16T20:57:10.768 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:57:10.768 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.894507662999999, 2020-11-16T20:57:10.768 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.037016812999999, 2020-11-16T20:57:10.768 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:10.768 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:10.768 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:10.769 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:10.769 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:10.769 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2983 2020-11-16T20:57:10.769 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.769 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:10.769 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.769 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:10.770 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:57:10.770 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:10.770 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.770 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.770 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:10.770 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:57:10.770 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7317999999999999e-05 2020-11-16T20:57:10.771 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.771 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.771 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:10.771 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817266+0000", 2020-11-16T20:57:10.771 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3519999999999998e-06 2020-11-16T20:57:10.771 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.771 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.772 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:10.772 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817269+0000", 2020-11-16T20:57:10.772 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7859999999999999e-06 2020-11-16T20:57:10.772 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.772 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.772 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:10.772 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817276+0000", 2020-11-16T20:57:10.773 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5620000000000002e-06 2020-11-16T20:57:10.773 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.773 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.773 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:10.773 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817278+0000", 2020-11-16T20:57:10.773 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3251999999999996e-05 2020-11-16T20:57:10.773 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.774 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.774 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.774 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817352+0000", 2020-11-16T20:57:10.774 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7966000000000001e-05 2020-11-16T20:57:10.774 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.774 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.775 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:10.775 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817400+0000", 2020-11-16T20:57:10.775 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.982734203 2020-11-16T20:57:10.775 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.775 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.775 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.775 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800134+0000", 2020-11-16T20:57:10.776 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9765999999999997e-05 2020-11-16T20:57:10.776 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.776 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.776 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:10.776 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800194+0000", 2020-11-16T20:57:10.776 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.046087276000000003 2020-11-16T20:57:10.776 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.777 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.777 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.777 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846281+0000", 2020-11-16T20:57:10.777 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000115396 2020-11-16T20:57:10.777 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.777 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.778 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:10.778 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846396+0000", 2020-11-16T20:57:10.778 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006004573 2020-11-16T20:57:10.778 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.778 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.778 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.779 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852401+0000", 2020-11-16T20:57:10.779 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013211599999999999 2020-11-16T20:57:10.779 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.779 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.779 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:10.779 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852533+0000", 2020-11-16T20:57:10.780 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0017322469999999999 2020-11-16T20:57:10.780 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.780 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.780 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:10.780 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.854265+0000", 2020-11-16T20:57:10.780 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.037016812999999 2020-11-16T20:57:10.780 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.781 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:10.781 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.781 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.781 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.781 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2984 4.0 4:033219d6:::smithi16641208-386:head [write 598481~712995,stat] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:10.781 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:57:10.781 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.887447820999999, 2020-11-16T20:57:10.782 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.003104742, 2020-11-16T20:57:10.782 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:10.782 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:10.782 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:10.782 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:10.782 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:10.783 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2984 2020-11-16T20:57:10.783 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.783 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:10.783 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.783 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:10.783 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:57:10.784 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:10.784 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.784 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.784 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:10.784 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:57:10.784 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00037173000000000002 2020-11-16T20:57:10.784 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.785 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.785 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:10.785 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824680+0000", 2020-11-16T20:57:10.785 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.146e-05 2020-11-16T20:57:10.785 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.785 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.785 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:10.786 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824691+0000", 2020-11-16T20:57:10.786 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6951000000000001e-05 2020-11-16T20:57:10.786 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.786 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.786 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:10.786 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824708+0000", 2020-11-16T20:57:10.787 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2082000000000001e-05 2020-11-16T20:57:10.787 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.787 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.787 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:10.787 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824720+0000", 2020-11-16T20:57:10.787 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0284000000000002e-05 2020-11-16T20:57:10.787 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.788 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.788 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.788 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824771+0000", 2020-11-16T20:57:10.788 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1241000000000001e-05 2020-11-16T20:57:10.788 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.788 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.788 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:10.789 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824802+0000", 2020-11-16T20:57:10.789 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.975455838 2020-11-16T20:57:10.789 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.789 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.789 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.789 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800258+0000", 2020-11-16T20:57:10.789 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027151194999999999 2020-11-16T20:57:10.790 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.790 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.790 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:10.790 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827409+0000", 2020-11-16T20:57:10.790 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9609999999999999e-06 2020-11-16T20:57:10.790 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.791 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.791 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:10.791 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827413+0000", 2020-11-16T20:57:10.791 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.003104742 2020-11-16T20:57:10.791 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.791 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:10.791 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.792 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.792 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.792 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2985 4.0 4:033219d6:::smithi16641208-386:head [write 1899355~418865] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:10.792 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:57:10.792 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.881836538999998, 2020-11-16T20:57:10.792 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.021091737000001, 2020-11-16T20:57:10.792 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:10.793 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:10.793 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:10.793 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:10.793 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:10.793 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2985 2020-11-16T20:57:10.793 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.793 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:10.794 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.794 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:10.794 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:57:10.794 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:10.794 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.794 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.795 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:10.795 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:57:10.795 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023221799999999999 2020-11-16T20:57:10.795 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.795 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.795 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:10.795 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830152+0000", 2020-11-16T20:57:10.796 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9769999999999995e-06 2020-11-16T20:57:10.796 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.796 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.796 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:10.796 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830162+0000", 2020-11-16T20:57:10.796 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5545000000000001e-05 2020-11-16T20:57:10.796 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.797 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.797 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:10.797 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830177+0000", 2020-11-16T20:57:10.797 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0334e-05 2020-11-16T20:57:10.797 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.797 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:10.798 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830188+0000", 2020-11-16T20:57:10.798 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3430999999999996e-05 2020-11-16T20:57:10.798 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.798 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.798 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830251+0000", 2020-11-16T20:57:10.799 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2651999999999997e-05 2020-11-16T20:57:10.799 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.799 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.799 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:10.799 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830304+0000", 2020-11-16T20:57:10.799 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.970289857999999 2020-11-16T20:57:10.799 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.800 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.800 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.800 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800594+0000", 2020-11-16T20:57:10.800 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8948999999999993e-05 2020-11-16T20:57:10.800 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.800 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.800 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:10.801 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800663+0000", 2020-11-16T20:57:10.801 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036018513000000002 2020-11-16T20:57:10.801 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.801 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.801 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.801 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836681+0000", 2020-11-16T20:57:10.802 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013201099999999999 2020-11-16T20:57:10.802 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.802 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.802 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:10.802 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836813+0000", 2020-11-16T20:57:10.802 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000126635 2020-11-16T20:57:10.803 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.803 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.803 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:10.803 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836940+0000", 2020-11-16T20:57:10.803 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010477907 2020-11-16T20:57:10.803 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.804 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.804 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:10.804 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847418+0000", 2020-11-16T20:57:10.804 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000158796 2020-11-16T20:57:10.805 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.805 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.805 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:10.805 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847576+0000", 2020-11-16T20:57:10.805 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033023729999999999 2020-11-16T20:57:10.806 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.806 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.806 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:10.806 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850879+0000", 2020-11-16T20:57:10.806 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6360999999999996e-05 2020-11-16T20:57:10.806 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.806 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.807 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:10.807 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850955+0000", 2020-11-16T20:57:10.807 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6177000000000001e-05 2020-11-16T20:57:10.807 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.807 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.807 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:10.808 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851011+0000", 2020-11-16T20:57:10.808 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.021091737000001 2020-11-16T20:57:10.808 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.808 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:10.808 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.808 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.808 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.809 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2986 4.0 4:033219d6:::smithi16641208-386:head [write 3093840~704641] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:10.809 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:57:10.809 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.873610837000001, 2020-11-16T20:57:10.809 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013155362999999, 2020-11-16T20:57:10.809 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:10.809 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:10.809 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:10.810 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:10.810 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:10.810 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2986 2020-11-16T20:57:10.810 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.811 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:10.811 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.811 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:10.811 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:57:10.812 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:10.812 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.812 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.812 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:10.812 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:57:10.813 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00038247200000000002 2020-11-16T20:57:10.813 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.813 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.813 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:10.813 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838528+0000", 2020-11-16T20:57:10.813 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3299999999999999e-06 2020-11-16T20:57:10.814 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.814 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.814 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:10.814 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838536+0000", 2020-11-16T20:57:10.814 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3438000000000001e-05 2020-11-16T20:57:10.814 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.814 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.815 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:10.815 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838549+0000", 2020-11-16T20:57:10.815 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0213e-05 2020-11-16T20:57:10.815 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.815 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.815 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:10.816 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838560+0000", 2020-11-16T20:57:10.816 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1894999999999997e-05 2020-11-16T20:57:10.816 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.816 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.816 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.816 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838612+0000", 2020-11-16T20:57:10.816 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8209e-05 2020-11-16T20:57:10.817 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.817 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.817 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:10.817 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838650+0000", 2020-11-16T20:57:10.817 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962061715000001 2020-11-16T20:57:10.817 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.818 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.818 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.818 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800712+0000", 2020-11-16T20:57:10.818 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6964e-05 2020-11-16T20:57:10.818 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.819 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.819 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:10.819 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800748+0000", 2020-11-16T20:57:10.820 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037209265999999998 2020-11-16T20:57:10.820 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.820 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.820 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.821 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.837958+0000", 2020-11-16T20:57:10.821 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000160304 2020-11-16T20:57:10.821 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.821 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.822 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:10.822 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.838118+0000", 2020-11-16T20:57:10.822 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022362799999999999 2020-11-16T20:57:10.823 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.823 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.823 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:10.823 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.838342+0000", 2020-11-16T20:57:10.823 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0090844710000000002 2020-11-16T20:57:10.824 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.824 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.824 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:10.824 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847426+0000", 2020-11-16T20:57:10.825 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000219199 2020-11-16T20:57:10.825 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.825 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.825 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:10.826 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847645+0000", 2020-11-16T20:57:10.826 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003411603 2020-11-16T20:57:10.826 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.826 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.826 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:10.827 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851057+0000", 2020-11-16T20:57:10.827 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014736799999999999 2020-11-16T20:57:10.827 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.827 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.827 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:10.827 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851204+0000", 2020-11-16T20:57:10.828 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6287999999999997e-05 2020-11-16T20:57:10.828 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.828 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.828 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:10.828 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851301+0000", 2020-11-16T20:57:10.828 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013155362999999 2020-11-16T20:57:10.829 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.829 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:10.829 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.829 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.829 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.829 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2987 4.0 4:033219d6:::smithi16641208-386:head [setxattr _header (58) in=7b,truncate 3798481] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:10.830 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:57:10.830 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.873152198, 2020-11-16T20:57:10.830 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.012971041, 2020-11-16T20:57:10.830 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:10.830 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:10.830 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:10.830 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:10.831 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:10.831 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2987 2020-11-16T20:57:10.831 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.831 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:10.831 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.831 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:10.832 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:57:10.832 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:10.832 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.832 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.832 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:10.832 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:57:10.832 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4530000000000002e-05 2020-11-16T20:57:10.833 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.833 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.833 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:10.833 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838648+0000", 2020-11-16T20:57:10.833 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8390000000000001e-06 2020-11-16T20:57:10.833 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.833 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.834 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:10.834 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838655+0000", 2020-11-16T20:57:10.834 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0341e-05 2020-11-16T20:57:10.834 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.834 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.834 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:10.835 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838666+0000", 2020-11-16T20:57:10.835 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0929999999999999e-06 2020-11-16T20:57:10.835 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.835 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.835 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:10.835 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838672+0000", 2020-11-16T20:57:10.835 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8074999999999997e-05 2020-11-16T20:57:10.836 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.836 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.836 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.836 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838710+0000", 2020-11-16T20:57:10.836 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1121000000000002e-05 2020-11-16T20:57:10.836 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.836 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.837 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:10.837 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838751+0000", 2020-11-16T20:57:10.837 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962044797000001 2020-11-16T20:57:10.837 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.837 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.837 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.837 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800796+0000", 2020-11-16T20:57:10.838 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6808999999999998e-05 2020-11-16T20:57:10.838 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.838 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.838 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:10.838 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800852+0000", 2020-11-16T20:57:10.838 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042964599999999999 2020-11-16T20:57:10.839 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.839 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.839 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.839 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843817+0000", 2020-11-16T20:57:10.839 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017807899999999999 2020-11-16T20:57:10.839 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.840 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.840 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:10.840 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843995+0000", 2020-11-16T20:57:10.840 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023680500000000001 2020-11-16T20:57:10.840 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.840 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.840 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:10.841 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844232+0000", 2020-11-16T20:57:10.841 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00320163 2020-11-16T20:57:10.841 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.841 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.841 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:10.841 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847434+0000", 2020-11-16T20:57:10.841 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00042527899999999998 2020-11-16T20:57:10.842 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.842 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.842 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:10.842 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847859+0000", 2020-11-16T20:57:10.842 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0034987920000000001 2020-11-16T20:57:10.842 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.842 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.843 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:10.843 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851358+0000", 2020-11-16T20:57:10.843 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014067300000000001 2020-11-16T20:57:10.843 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.843 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.843 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:10.844 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851498+0000", 2020-11-16T20:57:10.844 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6577999999999998e-05 2020-11-16T20:57:10.844 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.844 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.844 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:10.844 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851575+0000", 2020-11-16T20:57:10.844 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.012971041 2020-11-16T20:57:10.845 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.845 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:10.845 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.845 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.845 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.845 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2988 4.0 4:033219d6:::smithi16641208-386:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e86)", 2020-11-16T20:57:10.846 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:57:10.846 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.873049698999999, 2020-11-16T20:57:10.846 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013229791000001, 2020-11-16T20:57:10.846 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:10.846 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:10.846 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:10.847 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:10.847 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:10.847 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2988 2020-11-16T20:57:10.847 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.847 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:10.847 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.847 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:10.848 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:57:10.848 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:10.848 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.848 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.848 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:10.848 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:57:10.848 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9252999999999999e-05 2020-11-16T20:57:10.849 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.849 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.849 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:10.849 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838736+0000", 2020-11-16T20:57:10.849 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3980000000000004e-06 2020-11-16T20:57:10.849 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.850 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.850 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:10.850 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838742+0000", 2020-11-16T20:57:10.850 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1144999999999999e-05 2020-11-16T20:57:10.850 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.850 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.851 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:10.851 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838753+0000", 2020-11-16T20:57:10.851 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6229999999999996e-06 2020-11-16T20:57:10.851 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.851 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.852 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:10.852 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838758+0000", 2020-11-16T20:57:10.852 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5130000000000003e-05 2020-11-16T20:57:10.852 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.852 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.852 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.852 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838803+0000", 2020-11-16T20:57:10.853 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0132000000000001e-05 2020-11-16T20:57:10.853 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.853 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.853 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:10.853 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838843+0000", 2020-11-16T20:57:10.853 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962066786999999 2020-11-16T20:57:10.853 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.854 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.854 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.854 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800910+0000", 2020-11-16T20:57:10.854 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6925999999999997e-05 2020-11-16T20:57:10.854 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.854 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.855 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:10.855 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800967+0000", 2020-11-16T20:57:10.855 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.043837752000000001 2020-11-16T20:57:10.855 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.855 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.855 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.855 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844805+0000", 2020-11-16T20:57:10.856 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012337000000000001 2020-11-16T20:57:10.856 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.856 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.856 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:10.856 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844928+0000", 2020-11-16T20:57:10.856 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0066885149999999999 2020-11-16T20:57:10.856 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.857 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.857 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.857 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851616+0000", 2020-11-16T20:57:10.857 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5716000000000005e-05 2020-11-16T20:57:10.857 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.857 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.858 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:10.858 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851692+0000", 2020-11-16T20:57:10.858 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024404400000000001 2020-11-16T20:57:10.858 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.858 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.858 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:10.858 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851936+0000", 2020-11-16T20:57:10.859 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013229791000001 2020-11-16T20:57:10.859 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.859 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:10.859 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.859 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.859 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.859 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2992 4.0 4:0f4a2e46:::smithi16641208-399:head [cache-evict] snapc 0=[] ondisk+read+ignore_cache+known_if_redirected e86)", 2020-11-16T20:57:10.860 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:57:10.860 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.872963362, 2020-11-16T20:57:10.860 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962433468, 2020-11-16T20:57:10.860 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:10.860 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:10.860 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:10.861 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:10.861 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:10.861 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2992 2020-11-16T20:57:10.861 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.861 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:10.861 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.861 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:10.862 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:57:10.862 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:10.862 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.862 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.862 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:10.862 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:57:10.863 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7780000000000002e-05 2020-11-16T20:57:10.863 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.863 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.863 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:10.863 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838820+0000", 2020-11-16T20:57:10.863 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1200000000000001e-06 2020-11-16T20:57:10.863 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.864 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.864 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:10.864 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838826+0000", 2020-11-16T20:57:10.864 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0008e-05 2020-11-16T20:57:10.864 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.864 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.864 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:10.865 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838836+0000", 2020-11-16T20:57:10.865 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3749999999999996e-06 2020-11-16T20:57:10.865 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.865 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.865 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:10.865 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838840+0000", 2020-11-16T20:57:10.865 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0889000000000002e-05 2020-11-16T20:57:10.866 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.866 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.866 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.866 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838871+0000", 2020-11-16T20:57:10.866 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6891000000000003e-05 2020-11-16T20:57:10.866 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.867 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.867 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:10.867 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838908+0000", 2020-11-16T20:57:10.867 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962115045999999 2020-11-16T20:57:10.867 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.867 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.867 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.868 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801023+0000", 2020-11-16T20:57:10.868 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020335899999999999 2020-11-16T20:57:10.868 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.868 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.868 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:10.868 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801226+0000", 2020-11-16T20:57:10.868 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962433468 2020-11-16T20:57:10.869 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.869 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:10.869 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.869 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.869 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.869 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3051 4.0 4:2ceac9f9:::smithi16641208-61:head [write 699323~480842] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:57:10.869 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:57:10.870 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 16.870843055000002, 2020-11-16T20:57:10.870 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9728349610000002, 2020-11-16T20:57:10.870 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:10.870 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:10.870 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:10.870 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:10.870 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:10.871 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3051 2020-11-16T20:57:10.871 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.871 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:10.871 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.871 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:10.871 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:57:10.871 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:10.872 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.872 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.872 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:10.872 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:57:10.872 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032526199999999999 2020-11-16T20:57:10.872 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.873 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.873 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:10.873 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841238+0000", 2020-11-16T20:57:10.873 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9822000000000001e-05 2020-11-16T20:57:10.873 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.873 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.873 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:10.874 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841258+0000", 2020-11-16T20:57:10.874 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.507e-05 2020-11-16T20:57:10.874 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.874 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.874 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:10.874 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841273+0000", 2020-11-16T20:57:10.874 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8900000000000007e-06 2020-11-16T20:57:10.875 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.875 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.875 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:10.875 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841281+0000", 2020-11-16T20:57:10.875 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4356000000000003e-05 2020-11-16T20:57:10.875 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.876 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.876 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.876 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841365+0000", 2020-11-16T20:57:10.876 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0232000000000002e-05 2020-11-16T20:57:10.876 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.876 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.876 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:10.877 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841426+0000", 2020-11-16T20:57:10.877 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9604309439999996 2020-11-16T20:57:10.877 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.877 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.877 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.877 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801857+0000", 2020-11-16T20:57:10.877 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000164897 2020-11-16T20:57:10.878 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.878 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.878 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:10.878 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.802021+0000", 2020-11-16T20:57:10.878 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020576500000000001 2020-11-16T20:57:10.878 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.879 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.879 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:10.879 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.802227+0000", 2020-11-16T20:57:10.879 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0066237170000000003 2020-11-16T20:57:10.879 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.879 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.880 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:10.880 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808851+0000", 2020-11-16T20:57:10.880 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037712430000000001 2020-11-16T20:57:10.880 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.880 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.880 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:10.880 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812622+0000", 2020-11-16T20:57:10.881 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00099110800000000009 2020-11-16T20:57:10.881 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.881 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.881 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:10.881 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813613+0000", 2020-11-16T20:57:10.881 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1646e-05 2020-11-16T20:57:10.881 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.882 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.882 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:10.882 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813665+0000", 2020-11-16T20:57:10.882 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3009000000000004e-05 2020-11-16T20:57:10.882 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.882 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.883 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:10.883 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813748+0000", 2020-11-16T20:57:10.883 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9728349610000002 2020-11-16T20:57:10.883 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.883 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:10.883 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.884 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.884 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.884 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3052 4.0 4:2ceac9f9:::smithi16641208-61:head [write 1850247~429872] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:57:10.884 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:57:10.884 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 16.862652015999998, 2020-11-16T20:57:10.884 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9911138360000002, 2020-11-16T20:57:10.884 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:10.885 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:10.885 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:10.885 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:10.885 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:10.885 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3052 2020-11-16T20:57:10.885 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.885 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:10.886 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.886 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:10.886 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:57:10.886 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:10.886 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.886 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.887 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:10.887 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:57:10.887 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000296166 2020-11-16T20:57:10.887 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.887 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.887 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:10.888 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849400+0000", 2020-11-16T20:57:10.888 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0699999999999996e-06 2020-11-16T20:57:10.888 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.888 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.888 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:10.888 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849409+0000", 2020-11-16T20:57:10.888 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3725e-05 2020-11-16T20:57:10.889 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.889 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.889 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:10.889 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849423+0000", 2020-11-16T20:57:10.889 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9929999999999998e-06 2020-11-16T20:57:10.889 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.889 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.890 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:10.890 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849430+0000", 2020-11-16T20:57:10.890 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9708000000000002e-05 2020-11-16T20:57:10.890 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.890 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.890 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.890 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849520+0000", 2020-11-16T20:57:10.891 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2088000000000002e-05 2020-11-16T20:57:10.891 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.891 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.891 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:10.891 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849552+0000", 2020-11-16T20:57:10.891 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.954526692 2020-11-16T20:57:10.891 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.892 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.892 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.892 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804079+0000", 2020-11-16T20:57:10.892 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015456899999999999 2020-11-16T20:57:10.892 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.892 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.892 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:10.893 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804233+0000", 2020-11-16T20:57:10.893 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019627800000000001 2020-11-16T20:57:10.893 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.893 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.893 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:10.893 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804429+0000", 2020-11-16T20:57:10.893 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006762316 2020-11-16T20:57:10.894 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.894 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.894 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:10.894 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811192+0000", 2020-11-16T20:57:10.894 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002630467 2020-11-16T20:57:10.894 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.894 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.895 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:10.895 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813822+0000", 2020-11-16T20:57:10.895 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026302065999999999 2020-11-16T20:57:10.895 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.895 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.895 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:10.896 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840124+0000", 2020-11-16T20:57:10.896 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.274e-05 2020-11-16T20:57:10.896 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.896 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.896 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:10.896 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840177+0000", 2020-11-16T20:57:10.896 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0958000000000003e-05 2020-11-16T20:57:10.897 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.897 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.897 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:10.897 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840218+0000", 2020-11-16T20:57:10.897 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9911138360000002 2020-11-16T20:57:10.897 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.897 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:10.898 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.898 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.898 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.898 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3053 4.0 4:2ceac9f9:::smithi16641208-61:head [write 2858378~532392] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:57:10.898 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:57:10.898 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 16.854194685, 2020-11-16T20:57:10.899 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9828430529999999, 2020-11-16T20:57:10.899 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:10.899 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:10.899 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:10.899 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:10.899 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:10.899 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3053 2020-11-16T20:57:10.900 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.900 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:10.900 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.900 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:10.900 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:57:10.900 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:10.900 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.901 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.901 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:10.901 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:57:10.901 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000647082 2020-11-16T20:57:10.901 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.901 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.901 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:10.902 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858208+0000", 2020-11-16T20:57:10.902 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.269e-05 2020-11-16T20:57:10.902 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.902 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.902 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:10.902 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858221+0000", 2020-11-16T20:57:10.903 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0361e-05 2020-11-16T20:57:10.903 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.903 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.903 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:10.903 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858242+0000", 2020-11-16T20:57:10.903 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1184e-05 2020-11-16T20:57:10.903 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.904 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.904 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:10.904 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858253+0000", 2020-11-16T20:57:10.904 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7032000000000004e-05 2020-11-16T20:57:10.904 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.904 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.904 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.905 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858330+0000", 2020-11-16T20:57:10.905 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4135999999999998e-05 2020-11-16T20:57:10.905 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.905 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.905 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:10.905 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858384+0000", 2020-11-16T20:57:10.905 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9487614310000003 2020-11-16T20:57:10.906 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.906 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.906 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.906 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807145+0000", 2020-11-16T20:57:10.906 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9426000000000007e-05 2020-11-16T20:57:10.906 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.906 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.907 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:10.907 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807245+0000", 2020-11-16T20:57:10.907 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018410799999999999 2020-11-16T20:57:10.907 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.907 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.907 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:10.907 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807429+0000", 2020-11-16T20:57:10.908 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0064067339999999999 2020-11-16T20:57:10.908 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.908 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.908 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:10.908 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813836+0000", 2020-11-16T20:57:10.908 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001513267 2020-11-16T20:57:10.908 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.909 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.909 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:10.909 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815349+0000", 2020-11-16T20:57:10.909 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024962895999999998 2020-11-16T20:57:10.909 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.909 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.909 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:10.910 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840312+0000", 2020-11-16T20:57:10.910 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7781999999999997e-05 2020-11-16T20:57:10.910 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.910 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.910 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:10.910 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840370+0000", 2020-11-16T20:57:10.910 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4924e-05 2020-11-16T20:57:10.911 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.911 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.911 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:10.911 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840404+0000", 2020-11-16T20:57:10.911 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9828430529999999 2020-11-16T20:57:10.911 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.911 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:10.912 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.912 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.912 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.912 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3054 4.0 4:2ceac9f9:::smithi16641208-61:head [setxattr _header (57) in=7b,truncate 3899323] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:57:10.912 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:57:10.912 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 16.853442178000002, 2020-11-16T20:57:10.912 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9822430049999999, 2020-11-16T20:57:10.913 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:10.913 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:10.913 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:10.913 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:10.913 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:10.913 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3054 2020-11-16T20:57:10.913 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.914 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:10.914 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.914 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:10.914 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:57:10.914 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:10.914 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.915 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.915 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:10.915 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:57:10.915 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8208999999999999e-05 2020-11-16T20:57:10.915 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.915 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.915 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:10.916 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858362+0000", 2020-11-16T20:57:10.916 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5539999999999998e-06 2020-11-16T20:57:10.916 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.916 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.916 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:10.916 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858371+0000", 2020-11-16T20:57:10.916 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.005e-05 2020-11-16T20:57:10.917 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.917 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.917 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:10.917 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858381+0000", 2020-11-16T20:57:10.917 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8099999999999997e-06 2020-11-16T20:57:10.918 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.918 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.918 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:10.918 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858386+0000", 2020-11-16T20:57:10.918 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6168000000000005e-05 2020-11-16T20:57:10.918 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.919 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.919 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.919 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858482+0000", 2020-11-16T20:57:10.919 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7954999999999999e-05 2020-11-16T20:57:10.919 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.919 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.919 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:10.920 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858510+0000", 2020-11-16T20:57:10.920 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9498925639999998 2020-11-16T20:57:10.920 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.920 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.920 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.920 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808402+0000", 2020-11-16T20:57:10.920 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3084000000000005e-05 2020-11-16T20:57:10.921 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.921 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.921 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:10.921 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808495+0000", 2020-11-16T20:57:10.921 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114826 2020-11-16T20:57:10.921 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.921 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.922 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:10.922 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808610+0000", 2020-11-16T20:57:10.922 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052363219999999999 2020-11-16T20:57:10.922 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.922 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.922 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:10.922 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813846+0000", 2020-11-16T20:57:10.923 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0015700709999999999 2020-11-16T20:57:10.923 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.923 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.923 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:10.923 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815417+0000", 2020-11-16T20:57:10.923 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025048682999999999 2020-11-16T20:57:10.923 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.924 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.924 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:10.924 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840465+0000", 2020-11-16T20:57:10.924 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5473000000000003e-05 2020-11-16T20:57:10.924 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.924 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.925 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:10.925 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840511+0000", 2020-11-16T20:57:10.925 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6236000000000003e-05 2020-11-16T20:57:10.925 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.925 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.925 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:10.925 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840557+0000", 2020-11-16T20:57:10.926 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9822430049999999 2020-11-16T20:57:10.926 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.926 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:10.926 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.926 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.926 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.926 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3055 4.0 4:2ceac9f9:::smithi16641208-61:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e91)", 2020-11-16T20:57:10.927 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:57:10.927 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 16.853266982000001, 2020-11-16T20:57:10.927 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9852841799999998, 2020-11-16T20:57:10.927 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:10.927 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:10.927 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:10.927 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:10.928 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:10.928 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3055 2020-11-16T20:57:10.928 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.928 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:10.928 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.928 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:10.928 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:57:10.929 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:10.929 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.929 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.929 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:10.929 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:57:10.929 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4403000000000002e-05 2020-11-16T20:57:10.929 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.930 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.930 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:10.930 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858523+0000", 2020-11-16T20:57:10.930 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4670000000000001e-06 2020-11-16T20:57:10.930 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.930 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.931 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:10.931 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858530+0000", 2020-11-16T20:57:10.931 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2469999999999999e-05 2020-11-16T20:57:10.931 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.931 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.931 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:10.931 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858542+0000", 2020-11-16T20:57:10.932 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2449999999999998e-06 2020-11-16T20:57:10.932 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.932 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.932 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:10.932 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858548+0000", 2020-11-16T20:57:10.932 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9604000000000002e-05 2020-11-16T20:57:10.932 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.933 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.933 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.933 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858587+0000", 2020-11-16T20:57:10.933 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4863000000000001e-05 2020-11-16T20:57:10.933 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.933 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.933 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:10.934 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858632+0000", 2020-11-16T20:57:10.934 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9521692039999996 2020-11-16T20:57:10.934 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.934 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.934 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.934 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.810801+0000", 2020-11-16T20:57:10.934 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014886700000000001 2020-11-16T20:57:10.935 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.935 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.935 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:10.935 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.810950+0000", 2020-11-16T20:57:10.935 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029669781999999999 2020-11-16T20:57:10.935 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.935 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.936 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.936 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840620+0000", 2020-11-16T20:57:10.936 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010005699999999999 2020-11-16T20:57:10.936 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.936 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.936 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:10.936 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840720+0000", 2020-11-16T20:57:10.937 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030532179999999999 2020-11-16T20:57:10.937 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.937 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.937 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:10.937 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843773+0000", 2020-11-16T20:57:10.937 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9852841799999998 2020-11-16T20:57:10.938 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.938 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:10.938 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.938 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.938 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.938 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3065 4.0 4:2f657946:::smithi16641208-73:head [read 0~3210104,checksum] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:57:10.938 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:57:10.939 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 16.744991959, 2020-11-16T20:57:10.939 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8738324339999997, 2020-11-16T20:57:10.939 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:10.939 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:10.939 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:10.939 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:10.939 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:10.940 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3065 2020-11-16T20:57:10.940 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.940 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:10.940 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.940 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:10.940 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:57:10.940 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:10.941 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.941 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.941 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:10.941 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:57:10.941 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3065999999999999e-05 2020-11-16T20:57:10.941 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.941 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.942 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:10.942 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966787+0000", 2020-11-16T20:57:10.942 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8329999999999998e-06 2020-11-16T20:57:10.942 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.942 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.942 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:10.942 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966790+0000", 2020-11-16T20:57:10.943 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1780000000000002e-06 2020-11-16T20:57:10.943 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.943 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.943 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:10.943 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966795+0000", 2020-11-16T20:57:10.943 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3460000000000001e-06 2020-11-16T20:57:10.943 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.944 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.944 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:10.944 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966798+0000", 2020-11-16T20:57:10.944 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6675000000000003e-05 2020-11-16T20:57:10.944 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.944 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.945 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.945 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966844+0000", 2020-11-16T20:57:10.945 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5497999999999999e-05 2020-11-16T20:57:10.945 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.945 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.945 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:10.945 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966870+0000", 2020-11-16T20:57:10.946 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8445859479999998 2020-11-16T20:57:10.946 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.946 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.946 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.946 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811456+0000", 2020-11-16T20:57:10.946 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029140889999999999 2020-11-16T20:57:10.947 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.947 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.947 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:10.947 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840597+0000", 2020-11-16T20:57:10.947 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8738324339999997 2020-11-16T20:57:10.947 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.948 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:10.948 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.948 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.948 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.948 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3066 4.0 4:356864c0:::smithi16641208-150:head [read 0~2504243,checksum,omap-get-vals-by-keys,omap-get-keys,omap-get-vals,omap-get-header,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:57:10.948 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:57:10.948 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 16.744940734, 2020-11-16T20:57:10.949 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8778990499999999, 2020-11-16T20:57:10.949 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:10.949 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:10.949 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:10.949 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:10.949 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:10.949 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3066 2020-11-16T20:57:10.950 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.950 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:10.950 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.950 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:10.950 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:57:10.950 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:10.951 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.951 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.951 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:10.951 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:57:10.951 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1704000000000001e-05 2020-11-16T20:57:10.951 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.952 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.952 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:10.952 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966837+0000", 2020-11-16T20:57:10.952 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6850000000000001e-06 2020-11-16T20:57:10.952 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.953 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.953 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:10.953 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966840+0000", 2020-11-16T20:57:10.953 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7479999999999999e-06 2020-11-16T20:57:10.953 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.953 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.953 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:10.954 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966845+0000", 2020-11-16T20:57:10.954 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5059999999999998e-06 2020-11-16T20:57:10.954 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.954 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.954 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:10.954 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966848+0000", 2020-11-16T20:57:10.954 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4314000000000002e-05 2020-11-16T20:57:10.955 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.955 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.955 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.955 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966902+0000", 2020-11-16T20:57:10.955 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.561e-05 2020-11-16T20:57:10.955 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.955 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.956 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:10.956 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:57:10.956 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8448102110000004 2020-11-16T20:57:10.956 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.956 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.956 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.956 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811738+0000", 2020-11-16T20:57:10.957 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032976272000000001 2020-11-16T20:57:10.957 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.957 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.957 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:10.957 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844714+0000", 2020-11-16T20:57:10.957 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8778990499999999 2020-11-16T20:57:10.958 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.958 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:10.958 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.958 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.958 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.958 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3067 4.0 4:356864c0:::smithi16641208-150:head [sparse-read 0~2504243] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:57:10.958 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:57:10.959 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 16.744889276999999, 2020-11-16T20:57:10.959 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8780898150000001, 2020-11-16T20:57:10.959 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:10.959 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:10.959 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:10.959 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:10.959 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:10.960 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3067 2020-11-16T20:57:10.960 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.960 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:10.960 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.960 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:10.960 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:57:10.960 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:10.961 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.961 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.961 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:10.961 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:57:10.961 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2826e-05 2020-11-16T20:57:10.961 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.962 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.962 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:10.962 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966900+0000", 2020-11-16T20:57:10.962 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.694e-06 2020-11-16T20:57:10.962 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.962 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.962 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:10.963 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966902+0000", 2020-11-16T20:57:10.963 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0889999999999999e-06 2020-11-16T20:57:10.963 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.963 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.963 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:10.963 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966907+0000", 2020-11-16T20:57:10.963 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3910000000000001e-06 2020-11-16T20:57:10.964 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.964 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.964 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:10.964 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966910+0000", 2020-11-16T20:57:10.964 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2771000000000002e-05 2020-11-16T20:57:10.964 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.964 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.965 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.965 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966943+0000", 2020-11-16T20:57:10.965 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5301000000000001e-05 2020-11-16T20:57:10.965 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.965 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.965 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:10.965 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966968+0000", 2020-11-16T20:57:10.966 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.845055017 2020-11-16T20:57:10.966 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.966 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.966 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.966 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812023+0000", 2020-11-16T20:57:10.966 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032933726000000003 2020-11-16T20:57:10.966 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.967 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.967 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:10.967 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844957+0000", 2020-11-16T20:57:10.967 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8780898150000001 2020-11-16T20:57:10.967 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.967 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:10.967 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.968 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.968 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.968 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3068 4.0 4:356864c0:::smithi16641208-150:head [read 0~2504243,checksum] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:57:10.968 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:57:10.968 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 16.744827939, 2020-11-16T20:57:10.968 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8828719500000002, 2020-11-16T20:57:10.968 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:10.969 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:10.969 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:10.969 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:10.969 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:10.969 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3068 2020-11-16T20:57:10.969 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.969 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:10.970 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.970 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:10.970 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:57:10.970 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:10.970 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.970 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.971 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:10.971 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:57:10.971 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0942999999999999e-05 2020-11-16T20:57:10.971 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.971 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.971 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:10.971 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966949+0000", 2020-11-16T20:57:10.972 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.712e-06 2020-11-16T20:57:10.972 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.972 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.972 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:10.972 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966952+0000", 2020-11-16T20:57:10.972 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8479999999999997e-06 2020-11-16T20:57:10.972 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.973 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.973 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:10.973 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966958+0000", 2020-11-16T20:57:10.973 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9170000000000002e-06 2020-11-16T20:57:10.973 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.973 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.974 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:10.974 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966961+0000", 2020-11-16T20:57:10.974 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4105999999999999e-05 2020-11-16T20:57:10.974 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.974 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.974 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.974 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966985+0000", 2020-11-16T20:57:10.975 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2056e-05 2020-11-16T20:57:10.975 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.975 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.975 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:10.975 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.967007+0000", 2020-11-16T20:57:10.975 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8456606430000004 2020-11-16T20:57:10.975 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.976 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.976 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:10.976 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812667+0000", 2020-11-16T20:57:10.976 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037132724999999998 2020-11-16T20:57:10.976 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:10.976 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:10.976 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:10.977 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849800+0000", 2020-11-16T20:57:10.977 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8828719500000002 2020-11-16T20:57:10.977 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.977 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:10.977 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.977 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:10.978 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:10.978 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:10.978 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:57:10.978 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:57:10.979 INFO:tasks.thrashosds.thrasher:inject_pause on 5 2020-11-16T20:57:10.979 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2020-11-16T20:57:10.979 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2020-11-16T20:57:10.980 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2020-11-16T20:57:10.982 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:57:10.982 INFO:tasks.rados.rados.0.smithi166.stdout:958: done (1 left) 2020-11-16T20:57:10.983 INFO:tasks.rados.rados.0.smithi166.stdout:960: done (0 left) 2020-11-16T20:57:10.983 INFO:tasks.rados.rados.0.smithi166.stdout:961: cache_try_flush oid 136 snap -1 2020-11-16T20:57:10.983 INFO:tasks.rados.rados.0.smithi166.stdout:962: cache_evict oid 492 snap 32 2020-11-16T20:57:10.983 INFO:tasks.rados.rados.0.smithi166.stdout:963: snap_create 2020-11-16T20:57:10.983 INFO:tasks.rados.rados.0.smithi166.stdout:962: got (2) No such file or directory 2020-11-16T20:57:10.983 INFO:tasks.rados.rados.0.smithi166.stdout:961: got (0) Success 2020-11-16T20:57:10.983 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 136 v 0 (ObjNum 604 snap 30 seq_num 604) dirty exists 2020-11-16T20:57:10.984 INFO:teuthology.orchestra.run.smithi166.stderr:noscrub is unset 2020-11-16T20:57:10.984 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:10.983+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:11.080 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:11.084+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:11.133 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:11.133 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "" 2020-11-16T20:57:11.133 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:11.147 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:11.148 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:57:11.148 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:57:11.148 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:11.157 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:57:11.201 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:11.205+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:11.281 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:57:11.285+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:57:11.282 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:11.282 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:57:11.282 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:57:11.283 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:57:11.283 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:11.291 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:57:11.382 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:11.386+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:11.462 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:11.462 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:57:11.462 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:57:11.462 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:57:11.462 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.463 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:202 3.2 3:5723fd94:::smithi16641208-211:head [copy-from ver 110] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e35)", 2020-11-16T20:57:11.463 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:57:11.463 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.496187520999996, 2020-11-16T20:57:11.463 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027790216999999999, 2020-11-16T20:57:11.463 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:11.463 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:11.464 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:11.464 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.464 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:11.464 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:57:11.464 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:11.464 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.464 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.465 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:11.465 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969180+0000", 2020-11-16T20:57:11.465 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1907999999999998e-05 2020-11-16T20:57:11.465 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.465 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.465 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:11.466 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969232+0000", 2020-11-16T20:57:11.466 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5270000000000004e-06 2020-11-16T20:57:11.466 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.466 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.466 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:11.466 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969239+0000", 2020-11-16T20:57:11.466 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3062e-05 2020-11-16T20:57:11.467 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.467 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.467 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:11.467 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969252+0000", 2020-11-16T20:57:11.467 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8919999999999997e-06 2020-11-16T20:57:11.467 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.467 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.468 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:11.468 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969258+0000", 2020-11-16T20:57:11.468 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00040859799999999998 2020-11-16T20:57:11.468 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.468 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.468 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.468 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969666+0000", 2020-11-16T20:57:11.469 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0932000000000003e-05 2020-11-16T20:57:11.469 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.469 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.469 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:11.469 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.969757+0000", 2020-11-16T20:57:11.469 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010999395 2020-11-16T20:57:11.470 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.470 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.470 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:11.470 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.980757+0000", 2020-11-16T20:57:11.470 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006260659 2020-11-16T20:57:11.470 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.470 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.471 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:11.471 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.987017+0000", 2020-11-16T20:57:11.471 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0080836880000000003 2020-11-16T20:57:11.471 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.471 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.471 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:11.472 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.995101+0000", 2020-11-16T20:57:11.472 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001796829 2020-11-16T20:57:11.472 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.472 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.472 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:11.472 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996898+0000", 2020-11-16T20:57:11.473 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2086000000000003e-05 2020-11-16T20:57:11.473 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.473 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.473 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:11.473 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996940+0000", 2020-11-16T20:57:11.473 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0641e-05 2020-11-16T20:57:11.473 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.474 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.474 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:11.474 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:55:54.996971+0000", 2020-11-16T20:57:11.474 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027790216999999999 2020-11-16T20:57:11.474 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.474 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:11.474 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.475 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.475 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.475 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:547 3.2 3:5f250a2b:::smithi16641208-75:head [copy-from ver 38] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:57:11.475 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:57:11.475 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 66.447800217999998, 2020-11-16T20:57:11.475 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027400430999999999, 2020-11-16T20:57:11.475 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:11.476 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:11.476 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:11.476 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.476 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:11.476 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:57:11.476 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:11.476 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.477 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.477 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:11.477 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017568+0000", 2020-11-16T20:57:11.477 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5093999999999999e-05 2020-11-16T20:57:11.477 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.477 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.477 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:11.478 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017613+0000", 2020-11-16T20:57:11.478 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6150000000000003e-06 2020-11-16T20:57:11.478 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.478 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.478 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:11.478 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017623+0000", 2020-11-16T20:57:11.479 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6934000000000001e-05 2020-11-16T20:57:11.479 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.479 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.479 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:11.479 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017639+0000", 2020-11-16T20:57:11.479 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1892000000000001e-05 2020-11-16T20:57:11.479 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.480 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.480 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:11.480 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017651+0000", 2020-11-16T20:57:11.480 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2955999999999998e-05 2020-11-16T20:57:11.480 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.480 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.480 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.481 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017714+0000", 2020-11-16T20:57:11.481 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019352400000000001 2020-11-16T20:57:11.481 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.481 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.481 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:11.481 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017908+0000", 2020-11-16T20:57:11.481 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0073901349999999999 2020-11-16T20:57:11.482 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.482 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.482 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:11.482 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.025298+0000", 2020-11-16T20:57:11.482 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0082133799999999993 2020-11-16T20:57:11.482 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.482 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.483 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:11.483 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.033511+0000", 2020-11-16T20:57:11.483 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0074347629999999996 2020-11-16T20:57:11.483 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.483 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.483 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:11.483 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.040946+0000", 2020-11-16T20:57:11.484 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039404669999999996 2020-11-16T20:57:11.484 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.484 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.484 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:11.484 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044887+0000", 2020-11-16T20:57:11.484 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7098000000000002e-05 2020-11-16T20:57:11.484 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.485 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.485 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:11.485 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044934+0000", 2020-11-16T20:57:11.485 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4573000000000003e-05 2020-11-16T20:57:11.485 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.485 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.485 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:11.486 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044968+0000", 2020-11-16T20:57:11.486 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027400430999999999 2020-11-16T20:57:11.486 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.486 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:11.486 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.486 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.487 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.487 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:548 3.2 3:6173e90a:::smithi16641208-2:head [copy-from ver 3] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:57:11.487 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:57:11.487 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 66.447668884999999, 2020-11-16T20:57:11.487 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029556911000000002, 2020-11-16T20:57:11.487 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:11.487 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:11.488 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:11.488 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.488 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:11.488 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:57:11.488 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:11.488 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.489 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.489 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:11.489 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017699+0000", 2020-11-16T20:57:11.489 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2478000000000002e-05 2020-11-16T20:57:11.489 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.489 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.490 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:11.490 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017742+0000", 2020-11-16T20:57:11.490 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3060000000000003e-06 2020-11-16T20:57:11.490 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.490 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.491 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:11.491 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017748+0000", 2020-11-16T20:57:11.491 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1102e-05 2020-11-16T20:57:11.491 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.491 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.491 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:11.492 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017759+0000", 2020-11-16T20:57:11.492 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.118e-06 2020-11-16T20:57:11.492 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.492 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.492 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:11.492 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.017764+0000", 2020-11-16T20:57:11.493 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032233700000000001 2020-11-16T20:57:11.493 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.493 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.493 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.494 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.018086+0000", 2020-11-16T20:57:11.494 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000128374 2020-11-16T20:57:11.494 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.494 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.494 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:11.494 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.018215+0000", 2020-11-16T20:57:11.495 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012971355 2020-11-16T20:57:11.495 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.495 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.495 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:11.496 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.031186+0000", 2020-11-16T20:57:11.496 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044142890000000001 2020-11-16T20:57:11.496 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.496 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.496 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:11.496 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.035600+0000", 2020-11-16T20:57:11.497 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092372719999999995 2020-11-16T20:57:11.497 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.497 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.497 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:11.498 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.044838+0000", 2020-11-16T20:57:11.498 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0023022049999999999 2020-11-16T20:57:11.498 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.498 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.498 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:11.498 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047140+0000", 2020-11-16T20:57:11.498 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0380999999999997e-05 2020-11-16T20:57:11.499 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.499 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.499 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:11.499 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047200+0000", 2020-11-16T20:57:11.499 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5693999999999999e-05 2020-11-16T20:57:11.499 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.499 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.500 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:11.500 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.047256+0000", 2020-11-16T20:57:11.500 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029556911000000002 2020-11-16T20:57:11.500 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.500 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:11.500 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.500 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.501 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.501 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:554 3.2 3:769099fd:::smithi16641208-247:head [copy-from ver 123] snapc 1=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:57:11.501 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:57:11.501 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 66.415265567000006, 2020-11-16T20:57:11.501 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998, 2020-11-16T20:57:11.501 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:11.502 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:11.502 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:11.502 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.502 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:11.502 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:57:11.502 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:11.502 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.503 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.503 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:11.503 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:57:11.503 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6705999999999997e-05 2020-11-16T20:57:11.503 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.503 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.503 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:11.504 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050139+0000", 2020-11-16T20:57:11.504 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6199999999999998e-06 2020-11-16T20:57:11.504 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.504 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.504 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:11.504 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050144+0000", 2020-11-16T20:57:11.504 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.944e-06 2020-11-16T20:57:11.505 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.505 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.505 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:11.505 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050154+0000", 2020-11-16T20:57:11.505 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4043999999999999e-05 2020-11-16T20:57:11.505 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.505 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.506 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:11.506 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050178+0000", 2020-11-16T20:57:11.506 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078971409999999999 2020-11-16T20:57:11.506 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.506 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.506 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.506 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058075+0000", 2020-11-16T20:57:11.507 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012776500000000001 2020-11-16T20:57:11.507 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.507 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.507 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:11.507 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058203+0000", 2020-11-16T20:57:11.507 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011807013 2020-11-16T20:57:11.507 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.508 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.508 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:11.508 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070010+0000", 2020-11-16T20:57:11.508 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029522160000000001 2020-11-16T20:57:11.508 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.508 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.508 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:11.509 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.072962+0000", 2020-11-16T20:57:11.509 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017845006 2020-11-16T20:57:11.509 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.509 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.509 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:11.509 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.090807+0000", 2020-11-16T20:57:11.509 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.009301808 2020-11-16T20:57:11.510 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.510 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.510 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:11.510 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100109+0000", 2020-11-16T20:57:11.510 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7076999999999995e-05 2020-11-16T20:57:11.510 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.510 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.511 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:11.511 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100176+0000", 2020-11-16T20:57:11.511 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9790999999999999e-05 2020-11-16T20:57:11.511 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.511 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.511 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:11.511 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100216+0000", 2020-11-16T20:57:11.512 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998 2020-11-16T20:57:11.512 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.512 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:11.512 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.512 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.512 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.512 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2429 4.0 4:3b92f709:::smithi16641208-69:head [rollback 7] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:57:11.513 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:57:11.513 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 61.449347305000003, 2020-11-16T20:57:11.513 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003, 2020-11-16T20:57:11.513 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:11.513 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:11.513 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:11.513 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:11.514 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:11.514 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2429 2020-11-16T20:57:11.514 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.514 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:11.514 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.514 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:11.514 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:57:11.515 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:11.515 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.515 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.515 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:11.515 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:57:11.515 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3710000000000002e-05 2020-11-16T20:57:11.515 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.516 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.516 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:11.516 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016044+0000", 2020-11-16T20:57:11.516 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7090000000000001e-06 2020-11-16T20:57:11.516 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.516 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.516 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:11.517 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016049+0000", 2020-11-16T20:57:11.517 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8820000000000003e-06 2020-11-16T20:57:11.517 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.517 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.517 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:11.517 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016056+0000", 2020-11-16T20:57:11.518 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.27e-06 2020-11-16T20:57:11.518 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.518 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.518 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:11.518 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016059+0000", 2020-11-16T20:57:11.518 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.537e-05 2020-11-16T20:57:11.518 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.519 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.519 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.519 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016115+0000", 2020-11-16T20:57:11.519 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8690000000000003e-06 2020-11-16T20:57:11.519 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.519 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.519 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:11.520 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016120+0000", 2020-11-16T20:57:11.520 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021405730000000002 2020-11-16T20:57:11.520 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.520 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.520 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.520 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018260+0000", 2020-11-16T20:57:11.520 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0137999999999999e-05 2020-11-16T20:57:11.521 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.521 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.521 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:11.521 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018320+0000", 2020-11-16T20:57:11.521 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011799352000000001 2020-11-16T20:57:11.521 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.521 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.522 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.522 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030120+0000", 2020-11-16T20:57:11.522 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000163139 2020-11-16T20:57:11.522 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.522 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.522 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:11.522 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030283+0000", 2020-11-16T20:57:11.523 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029657000000000002 2020-11-16T20:57:11.523 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.523 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.523 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:11.523 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030579+0000", 2020-11-16T20:57:11.523 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3058000000000001e-05 2020-11-16T20:57:11.523 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.524 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.524 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:11.524 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030612+0000", 2020-11-16T20:57:11.524 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0075168259999999999 2020-11-16T20:57:11.524 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.524 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.524 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.525 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038129+0000", 2020-11-16T20:57:11.525 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012914299999999999 2020-11-16T20:57:11.525 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.525 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.525 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:11.525 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038258+0000", 2020-11-16T20:57:11.525 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034292799999999999 2020-11-16T20:57:11.526 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.526 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.526 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:57:11.526 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038601+0000", 2020-11-16T20:57:11.526 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0025181159999999999 2020-11-16T20:57:11.526 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.526 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.527 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.527 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041119+0000", 2020-11-16T20:57:11.527 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2331999999999997e-05 2020-11-16T20:57:11.527 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.527 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.527 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for ondisk", 2020-11-16T20:57:11.527 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041202+0000", 2020-11-16T20:57:11.528 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028481750000000001 2020-11-16T20:57:11.528 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.528 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.528 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:11.528 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044050+0000", 2020-11-16T20:57:11.528 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001269921 2020-11-16T20:57:11.529 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.529 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.529 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:11.529 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045320+0000", 2020-11-16T20:57:11.529 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054215490000000003 2020-11-16T20:57:11.529 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.530 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.530 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:11.530 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050741+0000", 2020-11-16T20:57:11.530 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6981000000000001e-05 2020-11-16T20:57:11.530 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.530 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.530 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:11.531 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050808+0000", 2020-11-16T20:57:11.531 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8841e-05 2020-11-16T20:57:11.531 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.531 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.532 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:11.532 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050877+0000", 2020-11-16T20:57:11.532 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003 2020-11-16T20:57:11.532 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.532 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:11.532 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.533 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.533 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.533 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2430 4.0 4:3b92f709:::smithi16641208-69:head [append 0~0] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:57:11.533 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:57:11.533 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 61.449290982000001, 2020-11-16T20:57:11.533 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001, 2020-11-16T20:57:11.533 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:11.534 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:11.534 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:11.534 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:11.534 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:11.534 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2430 2020-11-16T20:57:11.534 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.535 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:11.535 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.535 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:11.535 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:57:11.535 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:11.535 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.535 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.536 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:11.536 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:57:11.536 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0857e-05 2020-11-16T20:57:11.536 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.536 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.536 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:11.536 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016098+0000", 2020-11-16T20:57:11.537 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9179999999999999e-06 2020-11-16T20:57:11.537 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.537 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.537 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:11.537 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016104+0000", 2020-11-16T20:57:11.537 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8230000000000006e-06 2020-11-16T20:57:11.537 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.538 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.538 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:11.538 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016114+0000", 2020-11-16T20:57:11.538 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2180000000000001e-06 2020-11-16T20:57:11.538 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.538 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.538 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:11.539 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016118+0000", 2020-11-16T20:57:11.539 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3547999999999995e-05 2020-11-16T20:57:11.539 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.539 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.539 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.539 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016181+0000", 2020-11-16T20:57:11.539 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8730000000000007e-06 2020-11-16T20:57:11.540 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.540 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.540 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:11.540 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016189+0000", 2020-11-16T20:57:11.540 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021577200000000001 2020-11-16T20:57:11.540 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.540 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.541 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.541 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018347+0000", 2020-11-16T20:57:11.541 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6832000000000001e-05 2020-11-16T20:57:11.541 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.541 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.541 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:11.541 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018404+0000", 2020-11-16T20:57:11.542 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012272913999999999 2020-11-16T20:57:11.542 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.542 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.542 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.542 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030677+0000", 2020-11-16T20:57:11.542 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2555000000000002e-05 2020-11-16T20:57:11.542 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.543 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.543 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:11.543 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030719+0000", 2020-11-16T20:57:11.543 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010518684 2020-11-16T20:57:11.543 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.543 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.543 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.544 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041238+0000", 2020-11-16T20:57:11.544 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000144723 2020-11-16T20:57:11.544 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.544 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.544 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:11.544 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041383+0000", 2020-11-16T20:57:11.544 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000214575 2020-11-16T20:57:11.545 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.545 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.545 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:57:11.545 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041597+0000", 2020-11-16T20:57:11.545 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002463196 2020-11-16T20:57:11.545 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.545 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.546 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:11.546 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044060+0000", 2020-11-16T20:57:11.546 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001654066 2020-11-16T20:57:11.546 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.546 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.546 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:11.546 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045715+0000", 2020-11-16T20:57:11.547 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053780599999999996 2020-11-16T20:57:11.547 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.547 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.547 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:11.547 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051093+0000", 2020-11-16T20:57:11.547 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8189999999999996e-05 2020-11-16T20:57:11.547 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.548 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.548 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:11.548 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051161+0000", 2020-11-16T20:57:11.548 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4910000000000001e-05 2020-11-16T20:57:11.548 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.548 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.549 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:11.549 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051216+0000", 2020-11-16T20:57:11.549 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001 2020-11-16T20:57:11.549 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.549 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:11.549 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.549 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.550 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.550 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "MOSDPGPush(4.1 52/51 [PushOp(4:9ab04c4a:::smithi16641208-1:head, version: 33'3, data_included: [0~892056,1542129~156520], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:9ab04c4a:::smithi16641208-1:head@33'3, size: 2016807, copy_subset: [0~2016807], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1698649, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:a1eef07d:::smithi16641208-13:head, version: 33'9, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:a1eef07d:::smithi16641208-13:head@33'9, size: 2201684, copy_subset: [0~2201684], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:929564f0:::smithi16641208-24:head, version: 33'18, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:929564f0:::smithi16641208-24:head@33'18, size: 2386561, copy_subset: [0~2386561], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b565f7d2:::smithi16641208-35:head, version: 33'27, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b565f7d2:::smithi16641208-35:head@33'27, size: 2571438, copy_subset: [0~2571438], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b6545a47:::smithi16641208-46:head, version: 33'29, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b6545a47:::smithi16641208-46:head@33'29, size: 2756315, copy_subset: [0~2756315], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:9bd9f31d:::smithi16641208-48:head, version: 33'35, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:9bd9f31d:::smithi16641208-48:head@33'35, size: 2789929, copy_subset: [0~2789929], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:83205103:::smithi16641208-103:head, version: 34'38, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:83205103:::smithi16641208-103:head@34'38, size: 3714314, copy_subset: [0~3714314], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:86a0a5b7:::smithi16641208-108:head, version: 34'42, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:86a0a5b7:::smithi16641208-108:head@34'42, size: 3798349, copy_subset: [0~3798349], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-16T20:57:11.550 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:57:11.550 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 56.694694376000001, 2020-11-16T20:57:11.550 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032552672999999997, 2020-11-16T20:57:11.550 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:11.551 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:11.551 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:11.551 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.551 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:11.551 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:57:11.551 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:11.551 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.552 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.552 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:11.552 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:57:11.552 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017498692999999999 2020-11-16T20:57:11.552 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.552 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.552 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:11.553 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788172+0000", 2020-11-16T20:57:11.553 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4147999999999999e-05 2020-11-16T20:57:11.553 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.553 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.553 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:11.553 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788206+0000", 2020-11-16T20:57:11.553 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0016000000000002e-05 2020-11-16T20:57:11.554 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.554 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.554 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:11.554 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788276+0000", 2020-11-16T20:57:11.554 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2172000000000002e-05 2020-11-16T20:57:11.555 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.555 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.555 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:11.555 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788319+0000", 2020-11-16T20:57:11.555 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000154337 2020-11-16T20:57:11.555 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.555 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.556 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.556 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788473+0000", 2020-11-16T20:57:11.556 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7690000000000002e-06 2020-11-16T20:57:11.556 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.556 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.556 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:11.556 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788482+0000", 2020-11-16T20:57:11.557 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014744538 2020-11-16T20:57:11.557 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.557 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.557 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:11.557 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803226+0000", 2020-11-16T20:57:11.557 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032552672999999997 2020-11-16T20:57:11.557 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.558 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:11.558 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.558 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.558 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.558 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.0:552 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'128, mlcod=0'0)", 2020-11-16T20:57:11.558 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:57:11.558 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 56.674728958000003, 2020-11-16T20:57:11.559 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038033168999999999, 2020-11-16T20:57:11.559 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:11.559 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:11.559 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:11.559 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.559 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:11.559 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:57:11.560 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:11.560 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.560 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.560 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:11.560 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:57:11.560 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0031023880000000002 2020-11-16T20:57:11.561 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.561 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.561 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:11.561 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793741+0000", 2020-11-16T20:57:11.561 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1496e-05 2020-11-16T20:57:11.561 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.561 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.562 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:11.562 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793753+0000", 2020-11-16T20:57:11.562 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9009999999999999e-05 2020-11-16T20:57:11.562 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.562 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.562 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:11.562 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793772+0000", 2020-11-16T20:57:11.563 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3318e-05 2020-11-16T20:57:11.563 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.563 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.563 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:11.563 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793785+0000", 2020-11-16T20:57:11.563 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012534775 2020-11-16T20:57:11.563 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.564 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.564 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.564 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806320+0000", 2020-11-16T20:57:11.564 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8144999999999999e-05 2020-11-16T20:57:11.564 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.564 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.564 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:11.565 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806348+0000", 2020-11-16T20:57:11.565 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022285688000000001 2020-11-16T20:57:11.565 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.565 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.565 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:11.565 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828634+0000", 2020-11-16T20:57:11.565 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8349000000000002e-05 2020-11-16T20:57:11.566 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.566 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.566 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:11.566 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828672+0000", 2020-11-16T20:57:11.566 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038033168999999999 2020-11-16T20:57:11.566 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.566 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:11.567 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.567 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.567 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.567 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2503 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'129, mlcod=0'0)", 2020-11-16T20:57:11.567 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:57:11.567 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 56.671540778000001, 2020-11-16T20:57:11.567 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034870998, 2020-11-16T20:57:11.568 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:11.568 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:11.568 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:11.568 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.568 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:11.568 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:57:11.568 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:11.569 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.569 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.569 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:11.569 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:57:11.569 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00093048899999999995 2020-11-16T20:57:11.569 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.569 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.570 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:11.570 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794758+0000", 2020-11-16T20:57:11.570 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.169e-05 2020-11-16T20:57:11.570 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.570 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.570 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:11.571 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794769+0000", 2020-11-16T20:57:11.571 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3998999999999999e-05 2020-11-16T20:57:11.571 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.571 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.571 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:11.571 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794783+0000", 2020-11-16T20:57:11.571 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.481e-06 2020-11-16T20:57:11.572 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.572 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.572 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:11.572 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794791+0000", 2020-11-16T20:57:11.572 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.02524036 2020-11-16T20:57:11.572 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.573 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.573 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.573 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820031+0000", 2020-11-16T20:57:11.573 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.811e-05 2020-11-16T20:57:11.573 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.573 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.573 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:11.574 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820059+0000", 2020-11-16T20:57:11.574 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.008614577 2020-11-16T20:57:11.574 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.574 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.574 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:11.574 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828674+0000", 2020-11-16T20:57:11.575 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4292000000000001e-05 2020-11-16T20:57:11.575 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.575 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.575 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:11.575 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828698+0000", 2020-11-16T20:57:11.575 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034870998 2020-11-16T20:57:11.575 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.576 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:11.576 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.576 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.576 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.576 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2504 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'130, mlcod=0'0)", 2020-11-16T20:57:11.576 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:57:11.576 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 56.670535096000002, 2020-11-16T20:57:11.577 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033888776000000002, 2020-11-16T20:57:11.577 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:11.577 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:11.577 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:11.577 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.577 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:11.577 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:57:11.578 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:11.578 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.578 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.578 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:11.578 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:57:11.578 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3896999999999997e-05 2020-11-16T20:57:11.579 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.579 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.579 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:11.579 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794877+0000", 2020-11-16T20:57:11.579 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7019999999999998e-06 2020-11-16T20:57:11.579 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.579 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.580 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:11.580 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794883+0000", 2020-11-16T20:57:11.580 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.789e-06 2020-11-16T20:57:11.580 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.580 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.580 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:11.580 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794888+0000", 2020-11-16T20:57:11.581 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.852e-06 2020-11-16T20:57:11.581 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.581 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.581 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:11.581 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794891+0000", 2020-11-16T20:57:11.581 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026152822999999999 2020-11-16T20:57:11.581 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.582 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.582 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.582 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.821044+0000", 2020-11-16T20:57:11.582 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6900999999999999e-05 2020-11-16T20:57:11.582 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.582 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.582 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:11.583 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.821071+0000", 2020-11-16T20:57:11.583 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0076283210000000004 2020-11-16T20:57:11.583 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.583 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.583 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:11.583 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828699+0000", 2020-11-16T20:57:11.583 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2490999999999999e-05 2020-11-16T20:57:11.584 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.584 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.584 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:11.584 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828722+0000", 2020-11-16T20:57:11.584 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033888776000000002 2020-11-16T20:57:11.584 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.584 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:11.585 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.585 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.585 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.585 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.13:681 3.1 e52/19 3:afc69464:::smithi16641208-110:head v 52'546, mlcod=52'544)", 2020-11-16T20:57:11.585 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:57:11.585 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 56.667875025999997, 2020-11-16T20:57:11.585 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.03113606, 2020-11-16T20:57:11.586 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:11.586 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:11.586 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:11.586 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.586 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:11.586 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:57:11.586 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:11.587 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.587 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.587 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:11.587 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:57:11.587 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0026681809999999999 2020-11-16T20:57:11.587 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.587 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.588 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:11.588 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800161+0000", 2020-11-16T20:57:11.588 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3499000000000001e-05 2020-11-16T20:57:11.588 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.588 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.588 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:11.589 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800175+0000", 2020-11-16T20:57:11.589 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8301999999999999e-05 2020-11-16T20:57:11.589 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.589 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.589 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:11.589 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800193+0000", 2020-11-16T20:57:11.590 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0465999999999999e-05 2020-11-16T20:57:11.590 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.590 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.590 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:11.590 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800203+0000", 2020-11-16T20:57:11.590 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061432479999999996 2020-11-16T20:57:11.591 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.591 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.591 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.591 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806347+0000", 2020-11-16T20:57:11.591 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.641e-05 2020-11-16T20:57:11.591 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.592 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.592 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:11.592 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806373+0000", 2020-11-16T20:57:11.592 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022190887999999999 2020-11-16T20:57:11.592 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.592 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.593 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:11.593 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828564+0000", 2020-11-16T20:57:11.593 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5066000000000003e-05 2020-11-16T20:57:11.593 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.593 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.593 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:11.594 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828629+0000", 2020-11-16T20:57:11.594 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.03113606 2020-11-16T20:57:11.594 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.594 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:11.595 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.595 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.595 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.595 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.13:682 3.1 e52/19 3:b3ae2c4d:::smithi16641208-463:head v 52'547, mlcod=52'544)", 2020-11-16T20:57:11.595 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.802222+0000", 2020-11-16T20:57:11.595 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 56.663146122000001, 2020-11-16T20:57:11.595 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026721733000000001, 2020-11-16T20:57:11.596 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:11.596 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:11.596 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:11.597 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.597 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:11.597 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.802222+0000", 2020-11-16T20:57:11.597 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:11.598 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.598 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.598 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:11.599 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.802222+0000", 2020-11-16T20:57:11.599 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001333442 2020-11-16T20:57:11.599 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.599 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.600 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:11.600 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803555+0000", 2020-11-16T20:57:11.600 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0971999999999999e-05 2020-11-16T20:57:11.601 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.601 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.601 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:11.601 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803566+0000", 2020-11-16T20:57:11.601 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5973000000000001e-05 2020-11-16T20:57:11.601 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.602 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.602 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:11.602 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803582+0000", 2020-11-16T20:57:11.602 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2969999999999998e-06 2020-11-16T20:57:11.602 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.602 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.603 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:11.603 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803590+0000", 2020-11-16T20:57:11.603 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016424259 2020-11-16T20:57:11.603 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.603 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.603 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.603 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820014+0000", 2020-11-16T20:57:11.604 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9485999999999999e-05 2020-11-16T20:57:11.604 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.604 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.604 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:11.604 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820033+0000", 2020-11-16T20:57:11.604 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0088553179999999992 2020-11-16T20:57:11.604 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.605 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.605 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:11.605 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828889+0000", 2020-11-16T20:57:11.605 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4985999999999998e-05 2020-11-16T20:57:11.605 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.605 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.605 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:11.606 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828944+0000", 2020-11-16T20:57:11.606 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026721733000000001 2020-11-16T20:57:11.606 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.606 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:11.606 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.606 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.607 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.607 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:603 3.2 3:5a2e7c26:::smithi16641208-130:head [copy-from ver 67] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:57:11.607 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:57:11.607 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 51.714127032, 2020-11-16T20:57:11.607 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036631116999999998, 2020-11-16T20:57:11.607 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:11.607 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:11.608 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:11.608 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.608 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:11.608 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:57:11.608 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:11.608 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.608 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.609 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:11.609 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:57:11.609 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9854000000000002e-05 2020-11-16T20:57:11.609 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.609 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.609 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:11.609 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751281+0000", 2020-11-16T20:57:11.610 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1840000000000004e-06 2020-11-16T20:57:11.610 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.610 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.610 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:11.610 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751287+0000", 2020-11-16T20:57:11.610 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0231000000000001e-05 2020-11-16T20:57:11.610 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.611 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.611 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:11.611 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751297+0000", 2020-11-16T20:57:11.611 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.639e-06 2020-11-16T20:57:11.611 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.611 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.612 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:11.612 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751302+0000", 2020-11-16T20:57:11.612 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030012000000000002 2020-11-16T20:57:11.612 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.612 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.612 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.612 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751602+0000", 2020-11-16T20:57:11.613 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013830200000000001 2020-11-16T20:57:11.613 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.613 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.613 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:11.613 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751740+0000", 2020-11-16T20:57:11.613 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019538969999999999 2020-11-16T20:57:11.613 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.614 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.614 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:11.614 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771279+0000", 2020-11-16T20:57:11.614 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007630403 2020-11-16T20:57:11.614 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.614 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.614 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:11.615 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.778910+0000", 2020-11-16T20:57:11.615 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0065002009999999997 2020-11-16T20:57:11.615 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.615 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.615 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:11.615 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.785410+0000", 2020-11-16T20:57:11.615 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0023914140000000001 2020-11-16T20:57:11.616 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.616 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.616 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:11.616 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787801+0000", 2020-11-16T20:57:11.616 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9629999999999998e-05 2020-11-16T20:57:11.616 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.616 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.617 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:11.617 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787841+0000", 2020-11-16T20:57:11.617 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1168999999999999e-05 2020-11-16T20:57:11.617 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.617 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.617 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:11.617 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787872+0000", 2020-11-16T20:57:11.618 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036631116999999998 2020-11-16T20:57:11.618 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.618 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:11.618 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.618 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.618 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.619 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:609 3.2 3:5eead97c:::smithi16641208-34:head [copy-from ver 27] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:57:11.619 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:57:11.619 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 51.676329903000003, 2020-11-16T20:57:11.619 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.062626424, 2020-11-16T20:57:11.619 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:11.620 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:11.620 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:11.620 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.620 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:11.620 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:57:11.620 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:11.621 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.621 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.621 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:11.621 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:57:11.621 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3596000000000001e-05 2020-11-16T20:57:11.621 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.621 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.622 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:11.622 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789082+0000", 2020-11-16T20:57:11.622 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3209999999999999e-06 2020-11-16T20:57:11.622 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.622 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.622 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:11.622 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789089+0000", 2020-11-16T20:57:11.623 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3498e-05 2020-11-16T20:57:11.623 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.623 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.623 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:11.623 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789103+0000", 2020-11-16T20:57:11.623 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3679999999999998e-06 2020-11-16T20:57:11.623 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.624 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.624 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:11.624 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789109+0000", 2020-11-16T20:57:11.624 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007399638 2020-11-16T20:57:11.624 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.624 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.624 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.625 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.796509+0000", 2020-11-16T20:57:11.625 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000181168 2020-11-16T20:57:11.625 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.625 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.625 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:11.625 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.796690+0000", 2020-11-16T20:57:11.625 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01336562 2020-11-16T20:57:11.625 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.626 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.626 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:11.626 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.810055+0000", 2020-11-16T20:57:11.626 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044828350000000001 2020-11-16T20:57:11.626 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.626 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.626 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:11.627 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.814538+0000", 2020-11-16T20:57:11.627 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035609628999999997 2020-11-16T20:57:11.627 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.627 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.627 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:11.627 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850148+0000", 2020-11-16T20:57:11.627 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0013754730000000001 2020-11-16T20:57:11.628 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.628 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.628 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:11.628 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851523+0000", 2020-11-16T20:57:11.628 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9935e-05 2020-11-16T20:57:11.628 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.628 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.629 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:11.629 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851603+0000", 2020-11-16T20:57:11.629 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1342999999999999e-05 2020-11-16T20:57:11.629 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.629 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.629 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:11.629 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851665+0000", 2020-11-16T20:57:11.629 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.062626424 2020-11-16T20:57:11.630 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.630 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:11.630 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.630 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.630 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.630 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2605 4.0 4:2294fced:::smithi16641208-278:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:57:11.630 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:57:11.631 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 51.548494787000003, 2020-11-16T20:57:11.631 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032301128999999998, 2020-11-16T20:57:11.631 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:11.631 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:11.631 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:11.631 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:11.631 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:11.632 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2605 2020-11-16T20:57:11.632 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.632 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:11.632 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.632 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:11.632 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:57:11.632 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:11.632 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.633 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.633 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:11.633 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:57:11.633 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.811e-05 2020-11-16T20:57:11.633 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.633 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.633 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:11.634 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916901+0000", 2020-11-16T20:57:11.634 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2939999999999996e-06 2020-11-16T20:57:11.634 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.634 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.634 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:11.634 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916907+0000", 2020-11-16T20:57:11.634 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0589e-05 2020-11-16T20:57:11.635 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.635 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.635 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:11.635 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916917+0000", 2020-11-16T20:57:11.635 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2549999999999999e-06 2020-11-16T20:57:11.635 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.635 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.635 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:11.636 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916921+0000", 2020-11-16T20:57:11.636 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033789099999999999 2020-11-16T20:57:11.636 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.636 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.636 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.636 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.917259+0000", 2020-11-16T20:57:11.636 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.25e-05 2020-11-16T20:57:11.637 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.637 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.637 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:11.637 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.917332+0000", 2020-11-16T20:57:11.637 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.028336376999999999 2020-11-16T20:57:11.637 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.637 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.638 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.638 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.945668+0000", 2020-11-16T20:57:11.638 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0983000000000006e-05 2020-11-16T20:57:11.638 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.638 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.638 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:11.638 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.945759+0000", 2020-11-16T20:57:11.639 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00324756 2020-11-16T20:57:11.639 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.639 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.639 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.639 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949007+0000", 2020-11-16T20:57:11.639 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0583999999999999e-05 2020-11-16T20:57:11.639 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.639 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.640 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:11.640 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949097+0000", 2020-11-16T20:57:11.640 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6985999999999998e-05 2020-11-16T20:57:11.640 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.640 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.640 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:11.640 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949174+0000", 2020-11-16T20:57:11.641 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032301128999999998 2020-11-16T20:57:11.641 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.641 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:11.641 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.641 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.641 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.641 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2874 4.0 4:055e14cb:::smithi16641208-187:head [copy-from ver 402] snapc 25=[25,23,21,f] ondisk+write+known_if_redirected e72)", 2020-11-16T20:57:11.641 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:57:11.642 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 36.719971117, 2020-11-16T20:57:11.642 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031663616999999998, 2020-11-16T20:57:11.642 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:11.642 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:11.642 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:11.642 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:11.642 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:11.643 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2874 2020-11-16T20:57:11.643 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.643 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:11.643 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.643 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:11.643 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:57:11.643 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:11.644 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.644 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.644 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:11.644 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:57:11.644 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6754000000000001e-05 2020-11-16T20:57:11.644 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.644 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.644 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:11.645 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745434+0000", 2020-11-16T20:57:11.645 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5049999999999998e-06 2020-11-16T20:57:11.645 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.645 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.645 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:11.645 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745439+0000", 2020-11-16T20:57:11.645 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0803e-05 2020-11-16T20:57:11.646 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.646 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.646 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:11.646 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745450+0000", 2020-11-16T20:57:11.646 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8810000000000004e-06 2020-11-16T20:57:11.646 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.646 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.647 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:11.647 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745455+0000", 2020-11-16T20:57:11.647 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022866499999999999 2020-11-16T20:57:11.647 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.647 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.647 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.647 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745684+0000", 2020-11-16T20:57:11.647 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000132714 2020-11-16T20:57:11.648 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.648 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.648 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:11.648 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745816+0000", 2020-11-16T20:57:11.648 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050117850000000004 2020-11-16T20:57:11.648 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.648 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.649 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:57:11.649 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.750828+0000", 2020-11-16T20:57:11.649 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010413489 2020-11-16T20:57:11.649 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.649 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.649 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:11.649 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.761241+0000", 2020-11-16T20:57:11.650 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028274289999999998 2020-11-16T20:57:11.650 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.650 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.650 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:11.650 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.764069+0000", 2020-11-16T20:57:11.650 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012880057 2020-11-16T20:57:11.650 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.650 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.651 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:11.651 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.776949+0000", 2020-11-16T20:57:11.651 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2536e-05 2020-11-16T20:57:11.651 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.651 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.651 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:11.651 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777002+0000", 2020-11-16T20:57:11.652 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8999000000000002e-05 2020-11-16T20:57:11.652 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.652 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.652 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:11.652 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777061+0000", 2020-11-16T20:57:11.652 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031663616999999998 2020-11-16T20:57:11.652 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.652 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:11.653 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.653 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.653 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.653 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2875 4.0 4:055e14cb:::smithi16641208-187:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-11-16T20:57:11.653 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:57:11.653 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 36.719881891, 2020-11-16T20:57:11.653 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031888061000000002, 2020-11-16T20:57:11.654 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:11.654 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:11.654 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:11.654 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:11.654 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:11.654 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2875 2020-11-16T20:57:11.654 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.655 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:11.655 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.655 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:11.655 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:57:11.655 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:11.655 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.655 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.656 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:11.656 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:57:11.656 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0239000000000001e-05 2020-11-16T20:57:11.656 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.656 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.656 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:11.656 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745506+0000", 2020-11-16T20:57:11.657 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.252e-06 2020-11-16T20:57:11.657 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.657 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.657 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:11.657 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745510+0000", 2020-11-16T20:57:11.657 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3670000000000002e-06 2020-11-16T20:57:11.658 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.658 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.658 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:11.658 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745516+0000", 2020-11-16T20:57:11.658 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1089999999999998e-06 2020-11-16T20:57:11.658 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.658 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.659 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:11.659 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745519+0000", 2020-11-16T20:57:11.659 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045188999999999998 2020-11-16T20:57:11.659 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.659 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.659 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.659 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745971+0000", 2020-11-16T20:57:11.659 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7822999999999998e-05 2020-11-16T20:57:11.660 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.660 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.660 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:11.660 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.746029+0000", 2020-11-16T20:57:11.660 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013333563999999999 2020-11-16T20:57:11.660 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.660 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.661 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.661 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.759362+0000", 2020-11-16T20:57:11.661 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000170896 2020-11-16T20:57:11.661 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.661 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.661 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:11.661 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.759533+0000", 2020-11-16T20:57:11.661 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017572878 2020-11-16T20:57:11.662 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.662 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.662 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.662 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777106+0000", 2020-11-16T20:57:11.662 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014436399999999999 2020-11-16T20:57:11.662 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.662 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.663 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:11.663 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777251+0000", 2020-11-16T20:57:11.663 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012367899999999999 2020-11-16T20:57:11.663 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.663 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.663 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:11.663 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777374+0000", 2020-11-16T20:57:11.664 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031888061000000002 2020-11-16T20:57:11.664 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.664 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:11.664 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.664 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.664 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.664 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3004 3.2 3:4fbd4ff5:::smithi16641208-419:head [copy-from ver 366] snapc 33=[33,25] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e87)", 2020-11-16T20:57:11.664 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.815968+0000", 2020-11-16T20:57:11.665 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.649400278000002, 2020-11-16T20:57:11.665 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042048220999999997, 2020-11-16T20:57:11.665 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:11.665 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:11.665 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:11.665 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.665 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:11.666 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.815968+0000", 2020-11-16T20:57:11.666 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:11.666 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.666 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.666 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:11.666 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.815968+0000", 2020-11-16T20:57:11.666 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3235000000000002e-05 2020-11-16T20:57:11.667 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.667 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.667 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:11.667 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816011+0000", 2020-11-16T20:57:11.667 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.303e-06 2020-11-16T20:57:11.667 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.667 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.667 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:11.668 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816019+0000", 2020-11-16T20:57:11.668 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9714999999999999e-05 2020-11-16T20:57:11.668 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.668 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.668 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:11.668 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816049+0000", 2020-11-16T20:57:11.668 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2960000000000001e-06 2020-11-16T20:57:11.669 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.669 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.669 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:11.669 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816056+0000", 2020-11-16T20:57:11.669 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000241606 2020-11-16T20:57:11.669 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.669 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.669 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.670 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816298+0000", 2020-11-16T20:57:11.670 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016421599999999999 2020-11-16T20:57:11.670 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.670 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.670 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:11.670 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816462+0000", 2020-11-16T20:57:11.670 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025803994 2020-11-16T20:57:11.671 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.671 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.671 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:11.671 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.842266+0000", 2020-11-16T20:57:11.671 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0072860549999999996 2020-11-16T20:57:11.671 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.671 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.671 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:11.672 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.849552+0000", 2020-11-16T20:57:11.672 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0077911389999999999 2020-11-16T20:57:11.672 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.672 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.672 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:11.672 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.857343+0000", 2020-11-16T20:57:11.672 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00049728000000000001 2020-11-16T20:57:11.673 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.673 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.673 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:11.673 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.857841+0000", 2020-11-16T20:57:11.673 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.1997999999999997e-05 2020-11-16T20:57:11.673 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.673 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.674 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:11.674 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.857923+0000", 2020-11-16T20:57:11.674 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3383999999999999e-05 2020-11-16T20:57:11.674 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.674 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.674 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:11.674 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858016+0000", 2020-11-16T20:57:11.674 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042048220999999997 2020-11-16T20:57:11.675 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.675 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:11.675 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.675 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.675 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.675 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:650 3.2 3:4fbd4ff5:::smithi16641208-419:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e87)", 2020-11-16T20:57:11.675 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.816105+0000", 2020-11-16T20:57:11.676 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.649262648000001, 2020-11-16T20:57:11.676 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042242304000000001, 2020-11-16T20:57:11.676 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:11.676 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:11.676 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:11.676 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.676 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:11.677 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816105+0000", 2020-11-16T20:57:11.677 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:11.677 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.677 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.677 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:11.677 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816105+0000", 2020-11-16T20:57:11.677 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6486999999999999e-05 2020-11-16T20:57:11.677 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.678 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.678 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:11.678 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816132+0000", 2020-11-16T20:57:11.678 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5230000000000003e-06 2020-11-16T20:57:11.678 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.678 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.678 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:11.679 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816137+0000", 2020-11-16T20:57:11.679 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1498000000000001e-05 2020-11-16T20:57:11.679 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.679 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.679 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:11.679 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816149+0000", 2020-11-16T20:57:11.679 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5789999999999997e-06 2020-11-16T20:57:11.679 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.680 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.680 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:11.680 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816153+0000", 2020-11-16T20:57:11.680 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00044901199999999999 2020-11-16T20:57:11.680 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.680 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.680 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.681 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816602+0000", 2020-11-16T20:57:11.681 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6134000000000002e-05 2020-11-16T20:57:11.681 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.681 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.681 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:11.681 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816649+0000", 2020-11-16T20:57:11.681 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032065206999999998 2020-11-16T20:57:11.681 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.682 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.682 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.682 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848714+0000", 2020-11-16T20:57:11.682 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000103695 2020-11-16T20:57:11.682 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.682 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.682 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:11.683 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848818+0000", 2020-11-16T20:57:11.683 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092315220000000007 2020-11-16T20:57:11.683 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.683 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.683 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.683 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858049+0000", 2020-11-16T20:57:11.683 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000104415 2020-11-16T20:57:11.683 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.684 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.684 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:11.684 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858153+0000", 2020-11-16T20:57:11.684 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019423199999999999 2020-11-16T20:57:11.684 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.684 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.684 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:11.685 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858348+0000", 2020-11-16T20:57:11.685 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042242304000000001 2020-11-16T20:57:11.685 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.685 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:11.685 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.685 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.685 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.685 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:651 3.2 3:4fbd4ff5:::smithi16641208-419:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e87)", 2020-11-16T20:57:11.686 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.816182+0000", 2020-11-16T20:57:11.686 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.649186152999999, 2020-11-16T20:57:11.686 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047784220000000002, 2020-11-16T20:57:11.686 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:11.686 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:11.686 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:11.686 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.687 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:11.687 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816182+0000", 2020-11-16T20:57:11.687 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:11.687 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.687 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.687 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:11.687 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816182+0000", 2020-11-16T20:57:11.688 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6310999999999998e-05 2020-11-16T20:57:11.688 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.688 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.688 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:11.688 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816218+0000", 2020-11-16T20:57:11.688 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6110000000000001e-06 2020-11-16T20:57:11.688 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.688 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.689 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:11.689 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816224+0000", 2020-11-16T20:57:11.689 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9189999999999994e-06 2020-11-16T20:57:11.689 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.689 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.689 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:11.689 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816234+0000", 2020-11-16T20:57:11.690 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3220000000000003e-06 2020-11-16T20:57:11.690 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.690 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.690 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:11.690 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816238+0000", 2020-11-16T20:57:11.690 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00043294900000000002 2020-11-16T20:57:11.690 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.691 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.691 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.691 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816671+0000", 2020-11-16T20:57:11.691 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3359999999999998e-05 2020-11-16T20:57:11.691 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.691 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.691 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:11.691 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816714+0000", 2020-11-16T20:57:11.692 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032137410999999998 2020-11-16T20:57:11.692 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.692 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.692 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.692 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848852+0000", 2020-11-16T20:57:11.692 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000103235 2020-11-16T20:57:11.692 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.693 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.693 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:11.693 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848955+0000", 2020-11-16T20:57:11.693 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094266409999999995 2020-11-16T20:57:11.693 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.693 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.693 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:11.693 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858382+0000", 2020-11-16T20:57:11.694 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7973999999999995e-05 2020-11-16T20:57:11.694 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.694 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.694 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:11.694 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858470+0000", 2020-11-16T20:57:11.694 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054964870000000004 2020-11-16T20:57:11.694 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:11.695 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:11.695 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:11.695 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.863966+0000", 2020-11-16T20:57:11.695 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047784220000000002 2020-11-16T20:57:11.695 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.695 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:11.695 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.695 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:11.696 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:11.696 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:11.697 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:57:11.698 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:11.701+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:11.783 INFO:tasks.rados.rados.0.smithi166.stdout:961: done (2 left) 2020-11-16T20:57:11.783 INFO:tasks.rados.rados.0.smithi166.stdout:962: done (1 left) 2020-11-16T20:57:11.783 INFO:tasks.rados.rados.0.smithi166.stdout:963: done (0 left) 2020-11-16T20:57:11.784 INFO:tasks.rados.rados.0.smithi166.stdout:964: write oid 50 current snap is 34 2020-11-16T20:57:11.784 INFO:tasks.rados.rados.0.smithi166.stdout:964: seq_num 621 ranges {437147=554222,1656259=655870} 2020-11-16T20:57:11.788 INFO:tasks.rados.rados.0.smithi166.stdout:964: writing smithi16641208-50 from 437147 to 991369 tid 1 2020-11-16T20:57:11.796 INFO:tasks.rados.rados.0.smithi166.stdout:964: writing smithi16641208-50 from 1656259 to 2312129 tid 2 2020-11-16T20:57:11.796 INFO:tasks.rados.rados.0.smithi166.stdout:965: snap_remove snap 30 2020-11-16T20:57:11.799 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:11.802+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:11.852 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:11.853 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:57:11.853 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:57:11.853 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:11.862 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:57:11.899 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:11.903+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:12.000 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:12.004+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:12.038 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:12.038 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:57:12.039 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:57:12.039 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:57:12.039 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:12.048 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:57:12.101 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:12.105+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:12.186 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:12.186 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:57:12.187 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:57:12.187 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:57:12.187 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.187 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2370 4.1 4:82bb0fe7:::smithi16641208-101:head [write 2346424~426830] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:57:12.187 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:57:12.187 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.135054241000006, 2020-11-16T20:57:12.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04706581, 2020-11-16T20:57:12.188 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:12.188 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:12.188 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:12.188 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:12.188 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:12.188 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2370 2020-11-16T20:57:12.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.189 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:12.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:12.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:57:12.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:12.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.190 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:12.190 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:57:12.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011081520000000001 2020-11-16T20:57:12.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.190 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:12.190 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055391+0000", 2020-11-16T20:57:12.191 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8289999999999996e-06 2020-11-16T20:57:12.191 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.191 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.191 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:12.191 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055397+0000", 2020-11-16T20:57:12.191 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7599999999999997e-06 2020-11-16T20:57:12.191 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.192 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:12.192 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055407+0000", 2020-11-16T20:57:12.192 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4180000000000002e-06 2020-11-16T20:57:12.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.192 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:12.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055413+0000", 2020-11-16T20:57:12.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1767000000000001e-05 2020-11-16T20:57:12.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055465+0000", 2020-11-16T20:57:12.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1916999999999998e-05 2020-11-16T20:57:12.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.194 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:12.194 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055517+0000", 2020-11-16T20:57:12.194 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027302192999999999 2020-11-16T20:57:12.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.194 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.195 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.082819+0000", 2020-11-16T20:57:12.195 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013272199999999999 2020-11-16T20:57:12.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.195 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.195 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:12.195 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.082952+0000", 2020-11-16T20:57:12.195 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000218574 2020-11-16T20:57:12.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.196 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.196 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:12.196 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083171+0000", 2020-11-16T20:57:12.196 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016037374 2020-11-16T20:57:12.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.196 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.196 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:12.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099208+0000", 2020-11-16T20:57:12.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001621248 2020-11-16T20:57:12.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:12.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100829+0000", 2020-11-16T20:57:12.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039884700000000003 2020-11-16T20:57:12.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:12.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101228+0000", 2020-11-16T20:57:12.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1977000000000006e-05 2020-11-16T20:57:12.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:12.199 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101300+0000", 2020-11-16T20:57:12.199 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9032000000000001e-05 2020-11-16T20:57:12.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.199 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:12.199 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101349+0000", 2020-11-16T20:57:12.199 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04706581 2020-11-16T20:57:12.200 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.200 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:12.200 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.200 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.200 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2371 4.1 4:82bb0fe7:::smithi16641208-101:head [setxattr _header (57) in=7b,truncate 2773254] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:57:12.200 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.055441+0000", 2020-11-16T20:57:12.200 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.133896324000006, 2020-11-16T20:57:12.201 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046178253000000002, 2020-11-16T20:57:12.201 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:12.201 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:12.201 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:12.201 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:12.201 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:12.201 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2371 2020-11-16T20:57:12.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.202 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:12.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:12.202 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055441+0000", 2020-11-16T20:57:12.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:12.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.203 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.203 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:12.203 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055441+0000", 2020-11-16T20:57:12.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4688999999999999e-05 2020-11-16T20:57:12.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.203 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.203 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:12.203 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055476+0000", 2020-11-16T20:57:12.204 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8220000000000003e-06 2020-11-16T20:57:12.204 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.204 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.204 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:12.204 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055482+0000", 2020-11-16T20:57:12.204 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0340000000000002e-06 2020-11-16T20:57:12.204 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.205 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:12.205 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055488+0000", 2020-11-16T20:57:12.205 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.49e-06 2020-11-16T20:57:12.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.205 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:12.206 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055491+0000", 2020-11-16T20:57:12.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6255999999999998e-05 2020-11-16T20:57:12.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.206 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.206 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.206 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055547+0000", 2020-11-16T20:57:12.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6068000000000005e-05 2020-11-16T20:57:12.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:12.207 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055614+0000", 2020-11-16T20:57:12.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.028667674000000001 2020-11-16T20:57:12.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084281+0000", 2020-11-16T20:57:12.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000104868 2020-11-16T20:57:12.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:12.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084386+0000", 2020-11-16T20:57:12.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015165799999999999 2020-11-16T20:57:12.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:12.209 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.084538+0000", 2020-11-16T20:57:12.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014678207 2020-11-16T20:57:12.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:12.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099216+0000", 2020-11-16T20:57:12.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0016622550000000001 2020-11-16T20:57:12.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:12.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100878+0000", 2020-11-16T20:57:12.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00061087000000000001 2020-11-16T20:57:12.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.211 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:12.211 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101489+0000", 2020-11-16T20:57:12.211 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0320000000000004e-05 2020-11-16T20:57:12.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.211 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:12.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101559+0000", 2020-11-16T20:57:12.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0041999999999999e-05 2020-11-16T20:57:12.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.212 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:12.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101619+0000", 2020-11-16T20:57:12.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046178253000000002 2020-11-16T20:57:12.213 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.213 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:12.213 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.213 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2372 4.1 4:82bb0fe7:::smithi16641208-101:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e42)", 2020-11-16T20:57:12.213 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:57:12.214 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 67.133825294999994, 2020-11-16T20:57:12.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046557016999999999, 2020-11-16T20:57:12.214 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:12.214 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:12.214 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:12.214 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:12.214 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:12.214 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2372 2020-11-16T20:57:12.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.215 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:12.215 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.215 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:12.215 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:57:12.215 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:12.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:12.216 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:57:12.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9907000000000001e-05 2020-11-16T20:57:12.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:12.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055532+0000", 2020-11-16T20:57:12.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0599999999999999e-06 2020-11-16T20:57:12.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.217 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:12.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055535+0000", 2020-11-16T20:57:12.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1430000000000003e-06 2020-11-16T20:57:12.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:12.218 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055541+0000", 2020-11-16T20:57:12.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6819999999999999e-06 2020-11-16T20:57:12.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:12.219 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055544+0000", 2020-11-16T20:57:12.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000102643 2020-11-16T20:57:12.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.219 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.219 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055647+0000", 2020-11-16T20:57:12.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7197000000000003e-05 2020-11-16T20:57:12.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:12.220 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055684+0000", 2020-11-16T20:57:12.220 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029347807 2020-11-16T20:57:12.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.085032+0000", 2020-11-16T20:57:12.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6130000000000005e-05 2020-11-16T20:57:12.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:12.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.085108+0000", 2020-11-16T20:57:12.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016542980999999998 2020-11-16T20:57:12.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101651+0000", 2020-11-16T20:57:12.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000118733 2020-11-16T20:57:12.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:12.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101769+0000", 2020-11-16T20:57:12.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029973400000000001 2020-11-16T20:57:12.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:12.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.102069+0000", 2020-11-16T20:57:12.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046557016999999999 2020-11-16T20:57:12.224 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.224 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:12.224 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.224 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2423 3.3 3:c5716d1e:::smithi16641208-111:head [copy-from ver 265] snapc 7=[7,5] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e46)", 2020-11-16T20:57:12.224 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:09.027460+0000", 2020-11-16T20:57:12.224 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 63.161877142999998, 2020-11-16T20:57:12.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.038337614999999998, 2020-11-16T20:57:12.225 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:12.225 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:12.225 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:12.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:12.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027460+0000", 2020-11-16T20:57:12.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:12.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.226 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:12.226 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027460+0000", 2020-11-16T20:57:12.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4963999999999998e-05 2020-11-16T20:57:12.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:12.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027505+0000", 2020-11-16T20:57:12.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.925e-05 2020-11-16T20:57:12.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.227 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:12.227 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027525+0000", 2020-11-16T20:57:12.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3959e-05 2020-11-16T20:57:12.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.228 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:12.228 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027539+0000", 2020-11-16T20:57:12.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8059999999999997e-06 2020-11-16T20:57:12.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:12.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027545+0000", 2020-11-16T20:57:12.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0037794289999999999 2020-11-16T20:57:12.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031325+0000", 2020-11-16T20:57:12.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000127613 2020-11-16T20:57:12.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.230 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:12.230 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031452+0000", 2020-11-16T20:57:12.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021049117999999999 2020-11-16T20:57:12.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.231 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:57:12.231 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.052502+0000", 2020-11-16T20:57:12.231 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012965061 2020-11-16T20:57:12.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.231 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:12.231 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065467+0000", 2020-11-16T20:57:12.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9788000000000003e-05 2020-11-16T20:57:12.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.232 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:12.232 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065536+0000", 2020-11-16T20:57:12.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013262699999999999 2020-11-16T20:57:12.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:12.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065669+0000", 2020-11-16T20:57:12.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4404999999999999e-05 2020-11-16T20:57:12.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:12.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065713+0000", 2020-11-16T20:57:12.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4594999999999999e-05 2020-11-16T20:57:12.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.234 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:12.234 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065798+0000", 2020-11-16T20:57:12.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.038337614999999998 2020-11-16T20:57:12.234 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.235 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:12.235 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.235 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:577 3.3 3:c5716d1e:::smithi16641208-111:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e46)", 2020-11-16T20:57:12.235 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:09.027581+0000", 2020-11-16T20:57:12.235 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 63.161756699999998, 2020-11-16T20:57:12.235 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.038487691999999997, 2020-11-16T20:57:12.236 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:12.236 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:12.236 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:12.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.236 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:12.236 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027581+0000", 2020-11-16T20:57:12.236 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:12.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:12.237 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027581+0000", 2020-11-16T20:57:12.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3422e-05 2020-11-16T20:57:12.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:12.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027614+0000", 2020-11-16T20:57:12.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1710000000000002e-06 2020-11-16T20:57:12.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:12.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027622+0000", 2020-11-16T20:57:12.239 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2265e-05 2020-11-16T20:57:12.239 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.239 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:12.239 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027635+0000", 2020-11-16T20:57:12.239 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4700000000000001e-06 2020-11-16T20:57:12.239 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.240 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:12.240 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027640+0000", 2020-11-16T20:57:12.240 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0040006759999999999 2020-11-16T20:57:12.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.240 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.240 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.240 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031641+0000", 2020-11-16T20:57:12.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4350000000000006e-05 2020-11-16T20:57:12.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.241 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:12.241 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031705+0000", 2020-11-16T20:57:12.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029225991999999999 2020-11-16T20:57:12.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.060931+0000", 2020-11-16T20:57:12.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013316099999999999 2020-11-16T20:57:12.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:12.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.061064+0000", 2020-11-16T20:57:12.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047860919999999996 2020-11-16T20:57:12.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.243 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065850+0000", 2020-11-16T20:57:12.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1691e-05 2020-11-16T20:57:12.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.244 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:12.244 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.065942+0000", 2020-11-16T20:57:12.244 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012640199999999999 2020-11-16T20:57:12.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.244 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:12.244 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.066068+0000", 2020-11-16T20:57:12.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.038487691999999997 2020-11-16T20:57:12.245 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.245 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:12.245 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.245 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.245 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:578 3.3 3:c5716d1e:::smithi16641208-111:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e46)", 2020-11-16T20:57:12.245 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:09.027672+0000", 2020-11-16T20:57:12.246 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 63.161665585999998, 2020-11-16T20:57:12.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.043041498999999997, 2020-11-16T20:57:12.246 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:12.246 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:12.246 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:12.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:12.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027672+0000", 2020-11-16T20:57:12.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:12.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:12.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027672+0000", 2020-11-16T20:57:12.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2234000000000003e-05 2020-11-16T20:57:12.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.248 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:12.248 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027714+0000", 2020-11-16T20:57:12.248 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5910000000000001e-06 2020-11-16T20:57:12.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.248 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:12.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027721+0000", 2020-11-16T20:57:12.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1319e-05 2020-11-16T20:57:12.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.249 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:12.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027732+0000", 2020-11-16T20:57:12.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7919999999999998e-06 2020-11-16T20:57:12.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:12.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.027738+0000", 2020-11-16T20:57:12.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0040456559999999999 2020-11-16T20:57:12.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031784+0000", 2020-11-16T20:57:12.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9271999999999999e-05 2020-11-16T20:57:12.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:12.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.031833+0000", 2020-11-16T20:57:12.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029282580999999999 2020-11-16T20:57:12.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.252 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.252 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.252 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.061115+0000", 2020-11-16T20:57:12.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6058999999999998e-05 2020-11-16T20:57:12.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.252 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.252 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:12.253 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.061191+0000", 2020-11-16T20:57:12.253 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049009099999999996 2020-11-16T20:57:12.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.253 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.253 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.066092+0000", 2020-11-16T20:57:12.253 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7039999999999995e-05 2020-11-16T20:57:12.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:12.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.066159+0000", 2020-11-16T20:57:12.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045540449999999996 2020-11-16T20:57:12.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:12.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:09.070713+0000", 2020-11-16T20:57:12.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.043041498999999997 2020-11-16T20:57:12.255 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.255 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:12.255 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.256 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2427 4.1 4:a1b421f3:::smithi16641208-471:head [cache-flush] snapc 0=[] ondisk+read+ignore_cache+known_if_redirected e47)", 2020-11-16T20:57:12.256 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:10.015762+0000", 2020-11-16T20:57:12.256 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 62.173575147000001, 2020-11-16T20:57:12.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036562619999999997, 2020-11-16T20:57:12.256 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:12.256 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:12.256 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:12.256 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:12.257 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:12.257 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2427 2020-11-16T20:57:12.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.257 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:12.257 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.257 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:12.257 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015762+0000", 2020-11-16T20:57:12.258 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:12.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.258 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:12.258 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015762+0000", 2020-11-16T20:57:12.258 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8266999999999999e-05 2020-11-16T20:57:12.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.259 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:12.259 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015791+0000", 2020-11-16T20:57:12.259 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3263e-05 2020-11-16T20:57:12.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.259 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:12.259 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015804+0000", 2020-11-16T20:57:12.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1194e-05 2020-11-16T20:57:12.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:12.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015815+0000", 2020-11-16T20:57:12.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9799999999999998e-06 2020-11-16T20:57:12.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:12.261 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015823+0000", 2020-11-16T20:57:12.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0092000000000006e-05 2020-11-16T20:57:12.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.262 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015893+0000", 2020-11-16T20:57:12.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4109999999999996e-06 2020-11-16T20:57:12.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.262 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2020-11-16T20:57:12.262 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.015902+0000", 2020-11-16T20:57:12.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0024786610000000001 2020-11-16T20:57:12.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.263 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.263 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.018380+0000", 2020-11-16T20:57:12.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016238599999999999 2020-11-16T20:57:12.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.263 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:12.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.018543+0000", 2020-11-16T20:57:12.264 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.033540168000000002 2020-11-16T20:57:12.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.052083+0000", 2020-11-16T20:57:12.264 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014603000000000001 2020-11-16T20:57:12.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.265 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:12.265 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.052229+0000", 2020-11-16T20:57:12.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6168000000000005e-05 2020-11-16T20:57:12.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.266 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:12.266 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:10.052325+0000", 2020-11-16T20:57:12.266 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036562619999999997 2020-11-16T20:57:12.266 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.266 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:12.266 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.266 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.267 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2503 4.1 4:b0538c7c:::smithi16641208-136:head [write 1790337~563515] snapc f=[f,e,d,5] ondisk+write+known_if_redirected e52)", 2020-11-16T20:57:12.267 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:57:12.267 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 57.442629791999998, 2020-11-16T20:57:12.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089724989000000005, 2020-11-16T20:57:12.267 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:12.267 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:12.267 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:12.268 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:12.268 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:12.268 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2503 2020-11-16T20:57:12.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.268 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:12.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.268 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:12.269 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:57:12.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:12.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.269 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:12.269 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:57:12.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00060419599999999999 2020-11-16T20:57:12.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.270 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:12.270 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747312+0000", 2020-11-16T20:57:12.270 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.319e-06 2020-11-16T20:57:12.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.270 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:12.271 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747318+0000", 2020-11-16T20:57:12.271 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5100000000000004e-06 2020-11-16T20:57:12.271 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.271 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.271 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:12.271 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747328+0000", 2020-11-16T20:57:12.271 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6369999999999999e-06 2020-11-16T20:57:12.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.272 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.272 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:12.272 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747335+0000", 2020-11-16T20:57:12.272 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001800479 2020-11-16T20:57:12.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.272 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.272 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.273 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749136+0000", 2020-11-16T20:57:12.273 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7970000000000002e-05 2020-11-16T20:57:12.273 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.273 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.273 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:12.273 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749194+0000", 2020-11-16T20:57:12.273 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030847998000000001 2020-11-16T20:57:12.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.274 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.274 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.274 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780042+0000", 2020-11-16T20:57:12.274 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013142199999999999 2020-11-16T20:57:12.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.274 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.274 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:12.275 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780173+0000", 2020-11-16T20:57:12.275 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022398200000000001 2020-11-16T20:57:12.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.275 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.275 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:57:12.275 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780397+0000", 2020-11-16T20:57:12.275 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061389269999999998 2020-11-16T20:57:12.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.276 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:12.276 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786536+0000", 2020-11-16T20:57:12.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3673999999999998e-05 2020-11-16T20:57:12.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.276 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:12.277 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786630+0000", 2020-11-16T20:57:12.277 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049513384000000001 2020-11-16T20:57:12.277 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.277 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.277 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:12.277 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836143+0000", 2020-11-16T20:57:12.277 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4713000000000001e-05 2020-11-16T20:57:12.278 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.278 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.278 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:12.278 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836218+0000", 2020-11-16T20:57:12.278 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000214778 2020-11-16T20:57:12.278 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.278 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.279 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:12.279 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836433+0000", 2020-11-16T20:57:12.279 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089724989000000005 2020-11-16T20:57:12.279 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.279 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:12.279 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.279 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.279 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.280 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2504 4.1 4:b0538c7c:::smithi16641208-136:head [setxattr _header (58) in=7b,truncate 2991745] snapc f=[f,e,d,5] ondisk+write+known_if_redirected e52)", 2020-11-16T20:57:12.280 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:57:12.280 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 57.441955421999999, 2020-11-16T20:57:12.280 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089341162000000002, 2020-11-16T20:57:12.280 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:12.280 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:12.280 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:12.281 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:12.281 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:12.281 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2504 2020-11-16T20:57:12.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.281 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:12.281 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.281 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:12.281 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:57:12.282 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:12.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.282 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.282 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:12.282 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:57:12.282 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5520999999999999e-05 2020-11-16T20:57:12.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.283 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.283 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:12.283 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747438+0000", 2020-11-16T20:57:12.283 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2020-11-16T20:57:12.283 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.283 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.283 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:12.284 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747444+0000", 2020-11-16T20:57:12.284 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.661e-06 2020-11-16T20:57:12.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.284 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.284 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:12.284 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747451+0000", 2020-11-16T20:57:12.284 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6920000000000001e-06 2020-11-16T20:57:12.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.285 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:12.285 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747456+0000", 2020-11-16T20:57:12.285 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0017949769999999999 2020-11-16T20:57:12.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.285 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749251+0000", 2020-11-16T20:57:12.286 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114708 2020-11-16T20:57:12.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.286 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:12.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749366+0000", 2020-11-16T20:57:12.286 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032215049000000003 2020-11-16T20:57:12.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.287 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.287 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.287 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.781581+0000", 2020-11-16T20:57:12.287 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000181452 2020-11-16T20:57:12.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.287 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.287 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:12.288 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.781762+0000", 2020-11-16T20:57:12.288 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024118300000000001 2020-11-16T20:57:12.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.288 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.288 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:57:12.288 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782003+0000", 2020-11-16T20:57:12.288 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045997939999999999 2020-11-16T20:57:12.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:12.289 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786603+0000", 2020-11-16T20:57:12.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8782000000000002e-05 2020-11-16T20:57:12.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:12.290 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786642+0000", 2020-11-16T20:57:12.290 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049869098000000001 2020-11-16T20:57:12.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.290 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:12.290 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836511+0000", 2020-11-16T20:57:12.290 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4498000000000005e-05 2020-11-16T20:57:12.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.291 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.291 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:12.291 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836576+0000", 2020-11-16T20:57:12.291 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000147615 2020-11-16T20:57:12.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.291 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.291 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:12.292 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836723+0000", 2020-11-16T20:57:12.292 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089341162000000002 2020-11-16T20:57:12.292 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.292 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:12.292 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.292 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.293 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2505 4.1 4:b0538c7c:::smithi16641208-136:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e52)", 2020-11-16T20:57:12.293 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:57:12.293 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 57.441846294000001, 2020-11-16T20:57:12.293 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089929617000000003, 2020-11-16T20:57:12.293 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:12.293 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:12.293 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:12.294 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:12.294 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:12.294 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2505 2020-11-16T20:57:12.294 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.294 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:12.294 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.294 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:12.294 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:57:12.295 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:12.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.295 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.295 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:12.295 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:57:12.295 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1894999999999999e-05 2020-11-16T20:57:12.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.296 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.296 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:12.296 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747523+0000", 2020-11-16T20:57:12.296 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3900000000000003e-06 2020-11-16T20:57:12.296 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.296 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.296 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:12.296 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747527+0000", 2020-11-16T20:57:12.297 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8169999999999999e-06 2020-11-16T20:57:12.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.297 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.297 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:12.297 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747535+0000", 2020-11-16T20:57:12.297 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6449999999999998e-06 2020-11-16T20:57:12.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.298 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.298 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:12.298 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747539+0000", 2020-11-16T20:57:12.298 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0018868209999999999 2020-11-16T20:57:12.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.298 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.298 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.299 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749426+0000", 2020-11-16T20:57:12.299 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4963000000000002e-05 2020-11-16T20:57:12.299 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.299 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.299 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:12.299 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749481+0000", 2020-11-16T20:57:12.299 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032915959000000002 2020-11-16T20:57:12.299 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.300 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.300 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.300 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782397+0000", 2020-11-16T20:57:12.300 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018449499999999999 2020-11-16T20:57:12.300 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.300 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.300 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:12.301 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782581+0000", 2020-11-16T20:57:12.301 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054195457000000002 2020-11-16T20:57:12.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.301 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.301 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.301 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836777+0000", 2020-11-16T20:57:12.301 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000214584 2020-11-16T20:57:12.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.302 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.302 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:12.302 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836991+0000", 2020-11-16T20:57:12.302 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000429591 2020-11-16T20:57:12.302 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.302 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.302 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:12.303 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.837421+0000", 2020-11-16T20:57:12.303 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089929617000000003 2020-11-16T20:57:12.303 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.303 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:12.303 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.303 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.303 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2593 3.3 3:f5f8fa2a:::smithi16641208-144:head [copy-from ver 64] snapc 14=[12,f,5] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e57)", 2020-11-16T20:57:12.304 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:57:12.304 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.402697433, 2020-11-16T20:57:12.304 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064638111999999998, 2020-11-16T20:57:12.304 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:12.304 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:12.304 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:12.304 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.305 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:12.305 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:57:12.305 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:12.305 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.305 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.305 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:12.305 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:57:12.306 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3655999999999998e-05 2020-11-16T20:57:12.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.306 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.306 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:12.306 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786664+0000", 2020-11-16T20:57:12.306 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1850000000000003e-06 2020-11-16T20:57:12.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.306 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.307 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:12.307 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786669+0000", 2020-11-16T20:57:12.307 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0861e-05 2020-11-16T20:57:12.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.307 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:12.307 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786680+0000", 2020-11-16T20:57:12.308 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6749999999999996e-06 2020-11-16T20:57:12.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.308 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:12.308 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786686+0000", 2020-11-16T20:57:12.308 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2327000000000003e-05 2020-11-16T20:57:12.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.309 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.309 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786729+0000", 2020-11-16T20:57:12.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000156143 2020-11-16T20:57:12.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.309 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.309 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:12.309 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786885+0000", 2020-11-16T20:57:12.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024103846000000002 2020-11-16T20:57:12.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:57:12.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810989+0000", 2020-11-16T20:57:12.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018870436000000001 2020-11-16T20:57:12.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:12.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829859+0000", 2020-11-16T20:57:12.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021210896 2020-11-16T20:57:12.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:12.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851070+0000", 2020-11-16T20:57:12.312 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3708e-05 2020-11-16T20:57:12.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.312 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:12.312 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851084+0000", 2020-11-16T20:57:12.312 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7329e-05 2020-11-16T20:57:12.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.313 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:12.313 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851131+0000", 2020-11-16T20:57:12.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014705 2020-11-16T20:57:12.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.313 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:12.313 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851278+0000", 2020-11-16T20:57:12.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064638111999999998 2020-11-16T20:57:12.314 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.314 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:12.314 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.314 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:616 3.3 3:f5f8fa2a:::smithi16641208-144:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e57)", 2020-11-16T20:57:12.315 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:57:12.315 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.402606779000003, 2020-11-16T20:57:12.315 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064784234999999996, 2020-11-16T20:57:12.315 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:12.315 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:12.315 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:12.315 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.316 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:12.316 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:57:12.316 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:12.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.316 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:12.316 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:57:12.316 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8559999999999998e-05 2020-11-16T20:57:12.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:12.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786749+0000", 2020-11-16T20:57:12.317 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4549999999999997e-06 2020-11-16T20:57:12.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.318 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:12.318 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786754+0000", 2020-11-16T20:57:12.318 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4980000000000006e-06 2020-11-16T20:57:12.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.318 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:12.318 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786762+0000", 2020-11-16T20:57:12.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9790000000000004e-06 2020-11-16T20:57:12.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.319 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:12.319 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786766+0000", 2020-11-16T20:57:12.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029976900000000002 2020-11-16T20:57:12.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.320 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.320 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787066+0000", 2020-11-16T20:57:12.320 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3581999999999998e-05 2020-11-16T20:57:12.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.320 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.320 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:12.320 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787100+0000", 2020-11-16T20:57:12.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.037252078000000001 2020-11-16T20:57:12.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.321 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.321 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824352+0000", 2020-11-16T20:57:12.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000124189 2020-11-16T20:57:12.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:12.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824476+0000", 2020-11-16T20:57:12.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026883987000000002 2020-11-16T20:57:12.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851360+0000", 2020-11-16T20:57:12.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6365999999999994e-05 2020-11-16T20:57:12.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:12.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851426+0000", 2020-11-16T20:57:12.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8771999999999996e-05 2020-11-16T20:57:12.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.324 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:12.324 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851515+0000", 2020-11-16T20:57:12.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064784234999999996 2020-11-16T20:57:12.324 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.324 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:12.324 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.325 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:617 3.3 3:f5f8fa2a:::smithi16641208-144:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e57)", 2020-11-16T20:57:12.325 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:57:12.325 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.402536464000001, 2020-11-16T20:57:12.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.069756316999999998, 2020-11-16T20:57:12.325 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:12.325 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:12.325 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:12.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.326 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:12.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:57:12.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:12.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.326 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:12.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:57:12.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3865000000000002e-05 2020-11-16T20:57:12.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:12.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786835+0000", 2020-11-16T20:57:12.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6949999999999999e-06 2020-11-16T20:57:12.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:12.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786840+0000", 2020-11-16T20:57:12.328 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3559999999999999e-06 2020-11-16T20:57:12.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:12.329 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786849+0000", 2020-11-16T20:57:12.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.045e-06 2020-11-16T20:57:12.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.329 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:12.329 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786854+0000", 2020-11-16T20:57:12.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026743999999999997 2020-11-16T20:57:12.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.330 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.330 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787121+0000", 2020-11-16T20:57:12.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8912000000000001e-05 2020-11-16T20:57:12.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.330 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:12.331 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787180+0000", 2020-11-16T20:57:12.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.042545010000000001 2020-11-16T20:57:12.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.331 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.331 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829725+0000", 2020-11-16T20:57:12.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3979000000000003e-05 2020-11-16T20:57:12.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.332 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:12.332 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829819+0000", 2020-11-16T20:57:12.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021745652000000001 2020-11-16T20:57:12.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.332 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.333 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851565+0000", 2020-11-16T20:57:12.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000102064 2020-11-16T20:57:12.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.333 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:12.333 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851667+0000", 2020-11-16T20:57:12.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048902989999999999 2020-11-16T20:57:12.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.334 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:12.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856557+0000", 2020-11-16T20:57:12.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.069756316999999998 2020-11-16T20:57:12.334 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.334 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:12.334 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.335 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.335 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:618 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'243, mlcod=57'241)", 2020-11-16T20:57:12.335 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:57:12.335 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.389717339999997, 2020-11-16T20:57:12.335 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048895281999999998, 2020-11-16T20:57:12.335 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:12.335 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:12.336 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:12.336 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.336 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:12.336 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:57:12.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:12.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.336 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:12.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:57:12.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017163861999999998 2020-11-16T20:57:12.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:12.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816784+0000", 2020-11-16T20:57:12.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7071e-05 2020-11-16T20:57:12.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:12.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816801+0000", 2020-11-16T20:57:12.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6405e-05 2020-11-16T20:57:12.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.339 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:12.339 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816818+0000", 2020-11-16T20:57:12.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3030999999999999e-05 2020-11-16T20:57:12.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.339 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.339 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:12.339 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816831+0000", 2020-11-16T20:57:12.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4610000000000007e-05 2020-11-16T20:57:12.340 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.340 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.340 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.340 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816895+0000", 2020-11-16T20:57:12.340 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4202999999999998e-05 2020-11-16T20:57:12.340 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.340 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.341 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:12.341 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816929+0000", 2020-11-16T20:57:12.341 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.031527016999999997 2020-11-16T20:57:12.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.341 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:12.341 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.848456+0000", 2020-11-16T20:57:12.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9083000000000003e-05 2020-11-16T20:57:12.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:12.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.848515+0000", 2020-11-16T20:57:12.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048895281999999998 2020-11-16T20:57:12.342 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.342 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:12.343 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.343 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:618 3.3 3:d775beee:::smithi16641208-10:head [copy-from ver 12] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:57:12.343 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:57:12.343 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.380535270999999, 2020-11-16T20:57:12.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047870862, 2020-11-16T20:57:12.344 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:12.344 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:12.344 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:12.344 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.344 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:12.344 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:57:12.344 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:12.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.345 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:12.345 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:57:12.345 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0958999999999999e-05 2020-11-16T20:57:12.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.345 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:12.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808843+0000", 2020-11-16T20:57:12.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1294000000000001e-05 2020-11-16T20:57:12.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.346 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:12.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808854+0000", 2020-11-16T20:57:12.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8553999999999997e-05 2020-11-16T20:57:12.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.347 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:12.347 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808893+0000", 2020-11-16T20:57:12.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1985e-05 2020-11-16T20:57:12.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.347 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:12.348 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808905+0000", 2020-11-16T20:57:12.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7309000000000001e-05 2020-11-16T20:57:12.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.348 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.348 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808982+0000", 2020-11-16T20:57:12.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016374099999999999 2020-11-16T20:57:12.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.349 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:12.349 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809146+0000", 2020-11-16T20:57:12.349 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015955815000000002 2020-11-16T20:57:12.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.349 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:57:12.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.825102+0000", 2020-11-16T20:57:12.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048434799999999998 2020-11-16T20:57:12.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:12.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829945+0000", 2020-11-16T20:57:12.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021349677000000001 2020-11-16T20:57:12.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.351 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:12.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851295+0000", 2020-11-16T20:57:12.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052994100000000001 2020-11-16T20:57:12.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.351 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:12.352 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856594+0000", 2020-11-16T20:57:12.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3349000000000001e-05 2020-11-16T20:57:12.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:12.352 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856638+0000", 2020-11-16T20:57:12.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5289e-05 2020-11-16T20:57:12.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:12.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856673+0000", 2020-11-16T20:57:12.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047870862 2020-11-16T20:57:12.353 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.353 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:12.353 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.354 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.354 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:619 3.3 3:d79d68cf:::smithi16641208-37:head [copy-from ver 27] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:57:12.354 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:57:12.354 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 52.379976681000002, 2020-11-16T20:57:12.354 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047415915000000003, 2020-11-16T20:57:12.354 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:12.354 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:12.355 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:12.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.355 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:12.355 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:57:12.355 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:12.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.356 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:12.356 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:57:12.356 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3012000000000002e-05 2020-11-16T20:57:12.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.356 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.356 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:12.356 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809394+0000", 2020-11-16T20:57:12.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1699999999999996e-06 2020-11-16T20:57:12.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:12.357 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809399+0000", 2020-11-16T20:57:12.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2390000000000008e-06 2020-11-16T20:57:12.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.358 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:12.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809408+0000", 2020-11-16T20:57:12.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0259999999999998e-06 2020-11-16T20:57:12.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.358 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:12.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809413+0000", 2020-11-16T20:57:12.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0359999999999996e-05 2020-11-16T20:57:12.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809494+0000", 2020-11-16T20:57:12.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019616600000000001 2020-11-16T20:57:12.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.360 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:12.360 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809690+0000", 2020-11-16T20:57:12.360 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017673003999999999 2020-11-16T20:57:12.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.360 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.360 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:57:12.360 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.827363+0000", 2020-11-16T20:57:12.361 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006463033 2020-11-16T20:57:12.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.361 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.361 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:12.361 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.833826+0000", 2020-11-16T20:57:12.361 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017479913999999999 2020-11-16T20:57:12.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.362 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:12.362 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851306+0000", 2020-11-16T20:57:12.362 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054026500000000002 2020-11-16T20:57:12.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.362 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:12.362 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856708+0000", 2020-11-16T20:57:12.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8121999999999999e-05 2020-11-16T20:57:12.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.363 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:12.363 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856747+0000", 2020-11-16T20:57:12.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0219e-05 2020-11-16T20:57:12.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:12.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856777+0000", 2020-11-16T20:57:12.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047415915000000003 2020-11-16T20:57:12.364 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.364 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:12.364 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.365 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2990 4.1 4:b964d1b5:::smithi16641208-359:head [rollback 25] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:12.365 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:48.838164+0000", 2020-11-16T20:57:12.365 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.351173784, 2020-11-16T20:57:12.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041467088999999999, 2020-11-16T20:57:12.365 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:12.365 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:12.366 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:12.366 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:12.366 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:12.366 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2990 2020-11-16T20:57:12.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.366 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:12.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:12.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838164+0000", 2020-11-16T20:57:12.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:12.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:12.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838164+0000", 2020-11-16T20:57:12.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5457000000000001e-05 2020-11-16T20:57:12.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:12.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838179+0000", 2020-11-16T20:57:12.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2140000000000001e-06 2020-11-16T20:57:12.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:12.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838182+0000", 2020-11-16T20:57:12.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4210000000000003e-06 2020-11-16T20:57:12.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:12.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838188+0000", 2020-11-16T20:57:12.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6560000000000001e-06 2020-11-16T20:57:12.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:12.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838190+0000", 2020-11-16T20:57:12.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000113182 2020-11-16T20:57:12.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838304+0000", 2020-11-16T20:57:12.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3859999999999996e-06 2020-11-16T20:57:12.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:12.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838313+0000", 2020-11-16T20:57:12.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0032817229999999998 2020-11-16T20:57:12.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.372 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.841595+0000", 2020-11-16T20:57:12.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5017e-05 2020-11-16T20:57:12.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:12.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.841630+0000", 2020-11-16T20:57:12.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019647588000000001 2020-11-16T20:57:12.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.861277+0000", 2020-11-16T20:57:12.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012631900000000001 2020-11-16T20:57:12.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:12.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.861404+0000", 2020-11-16T20:57:12.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023259800000000001 2020-11-16T20:57:12.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:12.375 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.861636+0000", 2020-11-16T20:57:12.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2471e-05 2020-11-16T20:57:12.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:12.375 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.861679+0000", 2020-11-16T20:57:12.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0077306099999999997 2020-11-16T20:57:12.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.869409+0000", 2020-11-16T20:57:12.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000107871 2020-11-16T20:57:12.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:12.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.869517+0000", 2020-11-16T20:57:12.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000186925 2020-11-16T20:57:12.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:57:12.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.869704+0000", 2020-11-16T20:57:12.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0078131980000000004 2020-11-16T20:57:12.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:12.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.877517+0000", 2020-11-16T20:57:12.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3420000000000002e-05 2020-11-16T20:57:12.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.877551+0000", 2020-11-16T20:57:12.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7361000000000005e-05 2020-11-16T20:57:12.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for ondisk", 2020-11-16T20:57:12.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.877648+0000", 2020-11-16T20:57:12.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0010716079999999999 2020-11-16T20:57:12.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.380 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:12.380 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.878720+0000", 2020-11-16T20:57:12.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00080916500000000004 2020-11-16T20:57:12.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:12.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879529+0000", 2020-11-16T20:57:12.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3050000000000002e-05 2020-11-16T20:57:12.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:12.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879582+0000", 2020-11-16T20:57:12.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8848999999999999e-05 2020-11-16T20:57:12.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.382 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:12.382 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879631+0000", 2020-11-16T20:57:12.382 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041467088999999999 2020-11-16T20:57:12.382 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.382 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:12.383 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.383 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2991 4.1 4:b964d1b5:::smithi16641208-359:head [append 0~0] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:12.383 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:48.838212+0000", 2020-11-16T20:57:12.383 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.351125377999999, 2020-11-16T20:57:12.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041594183999999999, 2020-11-16T20:57:12.383 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:12.384 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:12.384 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:12.384 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:12.384 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:12.384 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2991 2020-11-16T20:57:12.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.384 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:12.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:12.385 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838212+0000", 2020-11-16T20:57:12.385 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:12.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:12.385 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838212+0000", 2020-11-16T20:57:12.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5463000000000001e-05 2020-11-16T20:57:12.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.386 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.386 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:12.386 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838228+0000", 2020-11-16T20:57:12.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.931e-06 2020-11-16T20:57:12.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.387 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:12.387 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838231+0000", 2020-11-16T20:57:12.387 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1950000000000002e-06 2020-11-16T20:57:12.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.387 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:12.387 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838236+0000", 2020-11-16T20:57:12.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.452e-06 2020-11-16T20:57:12.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.388 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:12.388 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838238+0000", 2020-11-16T20:57:12.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011414 2020-11-16T20:57:12.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.389 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.389 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838352+0000", 2020-11-16T20:57:12.389 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3620000000000006e-06 2020-11-16T20:57:12.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.389 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:12.389 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838361+0000", 2020-11-16T20:57:12.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00330554 2020-11-16T20:57:12.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.390 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.841666+0000", 2020-11-16T20:57:12.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3979999999999994e-05 2020-11-16T20:57:12.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.391 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.391 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:12.391 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.841730+0000", 2020-11-16T20:57:12.391 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020004936000000001 2020-11-16T20:57:12.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.391 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.391 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.391 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.861735+0000", 2020-11-16T20:57:12.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5636999999999998e-05 2020-11-16T20:57:12.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.392 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.392 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:12.392 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.861771+0000", 2020-11-16T20:57:12.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015910761999999998 2020-11-16T20:57:12.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.877682+0000", 2020-11-16T20:57:12.393 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023008600000000001 2020-11-16T20:57:12.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:12.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.877912+0000", 2020-11-16T20:57:12.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000228681 2020-11-16T20:57:12.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:57:12.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.878140+0000", 2020-11-16T20:57:12.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0013827620000000001 2020-11-16T20:57:12.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.395 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:12.395 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879523+0000", 2020-11-16T20:57:12.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000115841 2020-11-16T20:57:12.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.395 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:12.395 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879639+0000", 2020-11-16T20:57:12.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4579999999999997e-05 2020-11-16T20:57:12.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.396 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:12.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879683+0000", 2020-11-16T20:57:12.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1173000000000005e-05 2020-11-16T20:57:12.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:12.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879745+0000", 2020-11-16T20:57:12.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1662999999999996e-05 2020-11-16T20:57:12.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:12.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879806+0000", 2020-11-16T20:57:12.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.041594183999999999 2020-11-16T20:57:12.398 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.398 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:12.398 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.398 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2994 4.1 4:81514658:::smithi16641208-76:head [rollback 25] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:12.399 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:48.838310+0000", 2020-11-16T20:57:12.399 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.351027488, 2020-11-16T20:57:12.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.058717898999999997, 2020-11-16T20:57:12.399 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:12.399 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:12.399 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:12.399 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:12.400 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:12.400 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2994 2020-11-16T20:57:12.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.400 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:12.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.400 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:12.400 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838310+0000", 2020-11-16T20:57:12.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:12.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:12.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838310+0000", 2020-11-16T20:57:12.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6189e-05 2020-11-16T20:57:12.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:12.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838326+0000", 2020-11-16T20:57:12.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7750000000000001e-06 2020-11-16T20:57:12.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:12.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838329+0000", 2020-11-16T20:57:12.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1170000000000003e-06 2020-11-16T20:57:12.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.403 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:12.403 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838334+0000", 2020-11-16T20:57:12.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5509999999999998e-06 2020-11-16T20:57:12.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.404 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:12.404 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838337+0000", 2020-11-16T20:57:12.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4969999999999995e-05 2020-11-16T20:57:12.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.404 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.404 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838422+0000", 2020-11-16T20:57:12.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6809999999999998e-06 2020-11-16T20:57:12.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.405 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:12.405 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838429+0000", 2020-11-16T20:57:12.405 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0036974120000000002 2020-11-16T20:57:12.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.406 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.842127+0000", 2020-11-16T20:57:12.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7267000000000005e-05 2020-11-16T20:57:12.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.406 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:12.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.842194+0000", 2020-11-16T20:57:12.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036580992999999999 2020-11-16T20:57:12.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.407 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.878775+0000", 2020-11-16T20:57:12.407 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015282199999999999 2020-11-16T20:57:12.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:12.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.878928+0000", 2020-11-16T20:57:12.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025942000000000001 2020-11-16T20:57:12.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:12.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879187+0000", 2020-11-16T20:57:12.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6735000000000003e-05 2020-11-16T20:57:12.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.409 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.409 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:12.409 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879264+0000", 2020-11-16T20:57:12.409 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0079699739999999995 2020-11-16T20:57:12.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.409 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.410 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.410 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.887234+0000", 2020-11-16T20:57:12.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011584899999999999 2020-11-16T20:57:12.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.410 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:12.410 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.887350+0000", 2020-11-16T20:57:12.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019960799999999999 2020-11-16T20:57:12.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:57:12.411 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.887549+0000", 2020-11-16T20:57:12.411 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059496410000000003 2020-11-16T20:57:12.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893499+0000", 2020-11-16T20:57:12.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8387999999999997e-05 2020-11-16T20:57:12.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for ondisk", 2020-11-16T20:57:12.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893557+0000", 2020-11-16T20:57:12.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1730000000000005e-05 2020-11-16T20:57:12.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:12.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893639+0000", 2020-11-16T20:57:12.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0030284309999999998 2020-11-16T20:57:12.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:12.414 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.896668+0000", 2020-11-16T20:57:12.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024878999999999998 2020-11-16T20:57:12.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.414 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:12.414 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.896916+0000", 2020-11-16T20:57:12.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6546999999999998e-05 2020-11-16T20:57:12.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.415 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:12.415 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.896983+0000", 2020-11-16T20:57:12.415 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5009000000000002e-05 2020-11-16T20:57:12.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.415 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:12.416 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.897028+0000", 2020-11-16T20:57:12.416 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.058717898999999997 2020-11-16T20:57:12.416 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.416 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:12.416 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.417 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2995 4.1 4:81514658:::smithi16641208-76:head [append 0~0] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:12.417 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:48.838353+0000", 2020-11-16T20:57:12.417 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.350984228000002, 2020-11-16T20:57:12.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.061235559000000002, 2020-11-16T20:57:12.417 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:12.417 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:12.417 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:12.418 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:12.418 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:12.418 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2995 2020-11-16T20:57:12.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.418 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:12.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:12.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838353+0000", 2020-11-16T20:57:12.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:12.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.419 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:12.419 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838353+0000", 2020-11-16T20:57:12.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5333e-05 2020-11-16T20:57:12.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.420 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:12.420 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838369+0000", 2020-11-16T20:57:12.420 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6699999999999998e-06 2020-11-16T20:57:12.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.420 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:12.420 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838371+0000", 2020-11-16T20:57:12.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9450000000000001e-06 2020-11-16T20:57:12.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.421 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:12.421 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838376+0000", 2020-11-16T20:57:12.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3810000000000002e-06 2020-11-16T20:57:12.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.422 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:12.422 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838379+0000", 2020-11-16T20:57:12.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6501000000000006e-05 2020-11-16T20:57:12.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.422 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.422 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838445+0000", 2020-11-16T20:57:12.423 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7589999999999999e-06 2020-11-16T20:57:12.423 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.423 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:12.423 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838449+0000", 2020-11-16T20:57:12.423 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003788249 2020-11-16T20:57:12.423 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.424 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.842237+0000", 2020-11-16T20:57:12.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4104999999999997e-05 2020-11-16T20:57:12.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:12.424 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.842301+0000", 2020-11-16T20:57:12.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.037139272000000001 2020-11-16T20:57:12.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.425 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879440+0000", 2020-11-16T20:57:12.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3401e-05 2020-11-16T20:57:12.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:12.426 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879484+0000", 2020-11-16T20:57:12.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014179615 2020-11-16T20:57:12.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:12.426 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893664+0000", 2020-11-16T20:57:12.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6710000000000002e-05 2020-11-16T20:57:12.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.427 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:12.427 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893750+0000", 2020-11-16T20:57:12.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015452900000000001 2020-11-16T20:57:12.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.428 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:57:12.428 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893905+0000", 2020-11-16T20:57:12.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0013753280000000001 2020-11-16T20:57:12.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.428 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:12.428 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.895280+0000", 2020-11-16T20:57:12.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014309889999999999 2020-11-16T20:57:12.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:12.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.896711+0000", 2020-11-16T20:57:12.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0027635649999999999 2020-11-16T20:57:12.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:12.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.899475+0000", 2020-11-16T20:57:12.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3380999999999997e-05 2020-11-16T20:57:12.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:12.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.899518+0000", 2020-11-16T20:57:12.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0826000000000003e-05 2020-11-16T20:57:12.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:12.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:12.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:12.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.899589+0000", 2020-11-16T20:57:12.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.061235559000000002 2020-11-16T20:57:12.431 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.432 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:12.432 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.432 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:12.432 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:12.432 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:12.433 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:12.438+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:12.434 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:57:12.534 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:12.538+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:12.613 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:12.613 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:57:12.613 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:57:12.614 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:12.615 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:57:12.622 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:57:12.663 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:12.667+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:12.736 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:12.740+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:12.765 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:57:12.786 INFO:tasks.rados.rados.0.smithi166.stdout:965: done (1 left) 2020-11-16T20:57:12.787 INFO:tasks.rados.rados.0.smithi166.stdout:966: snap_create 2020-11-16T20:57:12.787 INFO:tasks.rados.rados.0.smithi166.stdout:964: finishing write tid 1 to smithi16641208-50 2020-11-16T20:57:12.787 INFO:tasks.rados.rados.0.smithi166.stdout:964: finishing write tid 2 to smithi16641208-50 2020-11-16T20:57:12.787 INFO:tasks.rados.rados.0.smithi166.stdout:964: finishing write tid 3 to smithi16641208-50 2020-11-16T20:57:12.787 INFO:tasks.rados.rados.0.smithi166.stdout:964: finishing write tid 4 to smithi16641208-50 2020-11-16T20:57:12.787 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 50 v 613 (ObjNum 621 snap 34 seq_num 621) dirty exists 2020-11-16T20:57:12.788 INFO:tasks.rados.rados.0.smithi166.stdout:964: left oid 50 (ObjNum 621 snap 34 seq_num 621) 2020-11-16T20:57:12.788 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:12.791+0000 7f1d7a7ed700 -1 osd.3 pg_epoch: 108 pg[3.2( v 107'612 (0'0,107'612] local-lis/les=19/20 n=117 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [3,5,6] r=0 lpr=19 crt=107'612 lcod 107'611 mlcod 107'611 active+clean+snaptrim trimq=[3d~1] ps=[38~3,3f~1]] removing snap head 2020-11-16T20:57:12.788 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:57:12.788 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:12.792+0000 7f1d7a7ed700 -1 osd.3 pg_epoch: 108 pg[3.2( v 108'614 (0'0,108'614] local-lis/les=19/20 n=115 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [3,5,6] r=0 lpr=19 luod=107'612 crt=108'614 lcod 107'611 mlcod 107'611 active+clean+snaptrim trimq=[3d~1] ps=[38~3,3f~1]] removing snap head 2020-11-16T20:57:12.806 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:12.806 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:57:12.806 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:57:12.806 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:57:12.807 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:12.809 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:57:12.816 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:57:12.827 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:57:12.847 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:57:12.857 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:12.861+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:12.866 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:57:12.886 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:57:12.906 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:57:12.907 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:57:12.907 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:57:12.907 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:57:12.907 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:57:12.907 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:57:12.908 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:57:12.908 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:57:12.908 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:57:12.938 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:12.942+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:12.985 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2020-11-16T20:57:12.993 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:12.993 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:13.003 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:57:13.046 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:13.050+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:13.139 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:13.140 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:13.140 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:13.144+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:13.149 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:57:13.241 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:13.244+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:13.327 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:13.328 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:13.337 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:57:13.341 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:13.346+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:13.442 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:57:13.446+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:57:13.513 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:13.514 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:13.523 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:57:13.564 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:13.568+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:13.644 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:13.649+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:13.699 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:13.699 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:13.709 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:57:13.752 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:57:13.756+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:57:13.792 INFO:tasks.rados.rados.0.smithi166.stdout:964: done (1 left) 2020-11-16T20:57:13.792 INFO:tasks.rados.rados.0.smithi166.stdout:966: done (0 left) 2020-11-16T20:57:13.792 INFO:tasks.rados.rados.0.smithi166.stdout:967: delete oid 395 current snap is 35 2020-11-16T20:57:13.795 INFO:teuthology.orchestra.run.smithi166.stderr:nodeep-scrub is unset 2020-11-16T20:57:13.798 INFO:tasks.rados.rados.0.smithi166.stdout:967: done (0 left) 2020-11-16T20:57:13.798 INFO:tasks.rados.rados.0.smithi166.stdout:968: cache_evict oid 285 snap 32 2020-11-16T20:57:13.799 INFO:tasks.rados.rados.0.smithi166.stdout:969: snap_create 2020-11-16T20:57:13.801 INFO:tasks.rados.rados.0.smithi166.stdout:968: got (2) No such file or directory 2020-11-16T20:57:13.846 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:13.850+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:13.850 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:13.850 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:13.859 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:57:13.947 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:57:13.950+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:57:14.035 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:14.035 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:14.045 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:57:14.047 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:14.052+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:14.148 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:14.153+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:14.183 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:14.183 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:14.192 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:57:14.248 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:14.253+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:14.319 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:14.319 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:14.328 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:57:14.349 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:14.353+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:14.450 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:14.454+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:14.494 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:14.494 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:14.503 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:57:14.551 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:14.555+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:14.628 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:14.628 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:14.637 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:57:14.651 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:14.656+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:14.738 INFO:tasks.rados.rados.0.smithi166.stdout:968: done (1 left) 2020-11-16T20:57:14.738 INFO:tasks.rados.rados.0.smithi166.stdout:969: done (0 left) 2020-11-16T20:57:14.738 INFO:tasks.rados.rados.0.smithi166.stdout:970: snap_remove snap 33 2020-11-16T20:57:14.753 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:14.757+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:14.767 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:14.767 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:14.777 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:57:14.853 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:14.858+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:14.904 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:14.905 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:14.914 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:57:14.917 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:57:14.954 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:14.958+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:15.045 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:15.046 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:15.056 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:57:15.056 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:15.060+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:15.104 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:57:15.123 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:57:15.144 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:57:15.156 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:57:15.161+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:57:15.163 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:57:15.184 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:57:15.189 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:15.189 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:57:15.189 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:57:15.189 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:57:15.190 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:15.199 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:57:15.205 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:57:15.229 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:57:15.249 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:57:15.251 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:57:15.251 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:57:15.251 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:57:15.251 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:57:15.251 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:57:15.252 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:57:15.252 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:57:15.252 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:57:15.257 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:15.261+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:15.331 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:15.331 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:57:15.332 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:57:15.332 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:57:15.332 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.332 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2979 4.0 4:1852173c:::smithi16641208-329:head [write 581674~637746,stat] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:15.332 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:57:15.332 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 26.530870872000001, 2020-11-16T20:57:15.332 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.009457398, 2020-11-16T20:57:15.333 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:15.333 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:15.333 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:15.333 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:15.333 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:15.333 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2979 2020-11-16T20:57:15.333 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.334 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:15.334 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.334 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:15.334 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:57:15.334 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:15.334 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.334 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:15.335 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:57:15.335 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030732300000000003 2020-11-16T20:57:15.335 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:15.335 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803965+0000", 2020-11-16T20:57:15.336 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0319999999999992e-06 2020-11-16T20:57:15.336 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.336 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.336 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:15.336 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803974+0000", 2020-11-16T20:57:15.336 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5930000000000002e-05 2020-11-16T20:57:15.336 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.336 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.337 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:15.337 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803990+0000", 2020-11-16T20:57:15.337 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1910000000000006e-06 2020-11-16T20:57:15.337 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.337 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.337 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:15.337 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803999+0000", 2020-11-16T20:57:15.338 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5637000000000003e-05 2020-11-16T20:57:15.338 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.338 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.338 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.338 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.804055+0000", 2020-11-16T20:57:15.338 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3769000000000001e-05 2020-11-16T20:57:15.338 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.339 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.339 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:15.339 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.804088+0000", 2020-11-16T20:57:15.339 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.995239140000001 2020-11-16T20:57:15.339 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.339 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.339 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.339 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799328+0000", 2020-11-16T20:57:15.340 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0137818 2020-11-16T20:57:15.340 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.340 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.340 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:15.340 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813109+0000", 2020-11-16T20:57:15.340 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5759999999999996e-06 2020-11-16T20:57:15.340 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.341 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.341 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:15.341 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813115+0000", 2020-11-16T20:57:15.341 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.009457398 2020-11-16T20:57:15.341 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.341 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:15.341 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.342 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.342 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.342 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2980 4.0 4:1852173c:::smithi16641208-329:head [write 1840873~558854] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:15.342 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:57:15.342 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 26.524605139999998, 2020-11-16T20:57:15.342 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.039347508000001, 2020-11-16T20:57:15.342 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:15.342 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:15.343 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:15.343 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:15.343 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:15.343 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2980 2020-11-16T20:57:15.343 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.343 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:15.343 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.344 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:15.344 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:57:15.344 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:15.344 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.344 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.344 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:15.344 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:57:15.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024810899999999999 2020-11-16T20:57:15.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.345 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.345 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:15.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810171+0000", 2020-11-16T20:57:15.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5610000000000001e-06 2020-11-16T20:57:15.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.346 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.346 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:15.346 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810179+0000", 2020-11-16T20:57:15.346 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7418000000000002e-05 2020-11-16T20:57:15.346 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.346 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.346 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:15.347 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810196+0000", 2020-11-16T20:57:15.347 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0079999999999996e-06 2020-11-16T20:57:15.347 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.347 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.347 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:15.347 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810203+0000", 2020-11-16T20:57:15.347 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3705000000000002e-05 2020-11-16T20:57:15.347 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.348 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.348 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.348 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810257+0000", 2020-11-16T20:57:15.348 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3656999999999998e-05 2020-11-16T20:57:15.348 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.348 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.348 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:15.349 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810311+0000", 2020-11-16T20:57:15.349 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.989427508 2020-11-16T20:57:15.349 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.349 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.349 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.349 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799738+0000", 2020-11-16T20:57:15.349 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2526000000000003e-05 2020-11-16T20:57:15.350 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.350 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:15.350 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799811+0000", 2020-11-16T20:57:15.350 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027934184000000001 2020-11-16T20:57:15.350 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.350 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827745+0000", 2020-11-16T20:57:15.351 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015776700000000001 2020-11-16T20:57:15.351 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.351 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.351 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:15.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827903+0000", 2020-11-16T20:57:15.351 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000185539 2020-11-16T20:57:15.352 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.352 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:15.352 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.828088+0000", 2020-11-16T20:57:15.352 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018143857999999999 2020-11-16T20:57:15.352 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.353 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:15.353 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846232+0000", 2020-11-16T20:57:15.353 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00074682199999999996 2020-11-16T20:57:15.353 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.353 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.353 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:15.353 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846979+0000", 2020-11-16T20:57:15.353 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021617530000000002 2020-11-16T20:57:15.354 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.354 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.354 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:15.354 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849141+0000", 2020-11-16T20:57:15.354 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4513999999999998e-05 2020-11-16T20:57:15.354 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.354 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.355 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:15.355 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849215+0000", 2020-11-16T20:57:15.355 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5578999999999998e-05 2020-11-16T20:57:15.355 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.355 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.355 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:15.355 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849271+0000", 2020-11-16T20:57:15.355 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.039347508000001 2020-11-16T20:57:15.356 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.356 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:15.356 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.356 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.356 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.356 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2981 4.0 4:1852173c:::smithi16641208-329:head [write 3066417~537135] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:15.356 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:57:15.357 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 26.517688842999998, 2020-11-16T20:57:15.357 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.032910677, 2020-11-16T20:57:15.357 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:15.357 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:15.357 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:15.357 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:15.357 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:15.358 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2981 2020-11-16T20:57:15.358 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.358 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:15.358 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.358 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:15.358 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:57:15.358 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:15.359 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.359 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.359 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:15.359 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:57:15.359 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024974099999999999 2020-11-16T20:57:15.359 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.359 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.360 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:15.360 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817089+0000", 2020-11-16T20:57:15.360 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3829999999999992e-06 2020-11-16T20:57:15.360 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.360 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.360 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:15.360 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817098+0000", 2020-11-16T20:57:15.360 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2118e-05 2020-11-16T20:57:15.361 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.361 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.361 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:15.361 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817110+0000", 2020-11-16T20:57:15.361 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6050000000000004e-06 2020-11-16T20:57:15.361 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.361 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.362 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:15.362 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817119+0000", 2020-11-16T20:57:15.362 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7204000000000003e-05 2020-11-16T20:57:15.362 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.362 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.362 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.362 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817177+0000", 2020-11-16T20:57:15.362 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9932999999999998e-05 2020-11-16T20:57:15.363 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.363 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.363 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:15.363 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817227+0000", 2020-11-16T20:57:15.363 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.98265286 2020-11-16T20:57:15.363 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.363 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.364 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.364 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799879+0000", 2020-11-16T20:57:15.364 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.737e-05 2020-11-16T20:57:15.364 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.364 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.364 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:15.364 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799947+0000", 2020-11-16T20:57:15.365 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029940584999999999 2020-11-16T20:57:15.365 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.365 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.365 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.365 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.829887+0000", 2020-11-16T20:57:15.365 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000217505 2020-11-16T20:57:15.365 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.365 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.366 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:15.366 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.830105+0000", 2020-11-16T20:57:15.366 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029022100000000001 2020-11-16T20:57:15.366 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.366 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.366 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:15.366 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.830395+0000", 2020-11-16T20:57:15.367 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015847953000000001 2020-11-16T20:57:15.367 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.367 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.367 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:15.367 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846243+0000", 2020-11-16T20:57:15.367 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0011558250000000001 2020-11-16T20:57:15.367 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.367 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.368 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:15.368 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847399+0000", 2020-11-16T20:57:15.368 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021524500000000002 2020-11-16T20:57:15.368 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.368 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.368 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:15.368 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849551+0000", 2020-11-16T20:57:15.369 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000138787 2020-11-16T20:57:15.369 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.369 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.369 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:15.369 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849690+0000", 2020-11-16T20:57:15.369 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0136999999999997e-05 2020-11-16T20:57:15.369 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.370 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.370 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:15.370 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849750+0000", 2020-11-16T20:57:15.370 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.032910677 2020-11-16T20:57:15.370 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.370 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:15.370 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.370 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.371 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.371 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2982 4.0 4:1852173c:::smithi16641208-329:head [setxattr _header (58) in=7b,truncate 3781674] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:15.371 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:57:15.371 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 26.517370528000001, 2020-11-16T20:57:15.371 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.035208633, 2020-11-16T20:57:15.371 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:15.371 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:15.372 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:15.372 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:15.372 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:15.372 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2982 2020-11-16T20:57:15.372 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.372 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:15.372 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.373 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:15.373 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:57:15.373 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:15.373 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.373 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.373 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:15.373 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:57:15.373 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8856000000000002e-05 2020-11-16T20:57:15.374 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.374 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.374 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:15.374 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817197+0000", 2020-11-16T20:57:15.374 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.93e-06 2020-11-16T20:57:15.374 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.374 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.375 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:15.375 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817203+0000", 2020-11-16T20:57:15.375 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0932e-05 2020-11-16T20:57:15.375 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.375 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.375 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:15.375 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817214+0000", 2020-11-16T20:57:15.376 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3470000000000001e-06 2020-11-16T20:57:15.376 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.376 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.376 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:15.376 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817218+0000", 2020-11-16T20:57:15.376 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4603e-05 2020-11-16T20:57:15.376 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.376 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.377 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.377 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817263+0000", 2020-11-16T20:57:15.377 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6387000000000002e-05 2020-11-16T20:57:15.377 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.377 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.377 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:15.377 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817309+0000", 2020-11-16T20:57:15.378 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.982698653 2020-11-16T20:57:15.378 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.378 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.378 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.378 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800008+0000", 2020-11-16T20:57:15.378 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5400000000000004e-05 2020-11-16T20:57:15.378 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.379 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.379 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:15.379 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800073+0000", 2020-11-16T20:57:15.379 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.044932818999999999 2020-11-16T20:57:15.379 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.379 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.379 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.380 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845006+0000", 2020-11-16T20:57:15.380 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017285099999999999 2020-11-16T20:57:15.380 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.380 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.380 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:15.380 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845179+0000", 2020-11-16T20:57:15.380 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023420900000000001 2020-11-16T20:57:15.380 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.381 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.381 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:15.381 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845413+0000", 2020-11-16T20:57:15.381 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0020276000000000001 2020-11-16T20:57:15.381 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.381 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.381 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:15.382 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847441+0000", 2020-11-16T20:57:15.382 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00050358800000000002 2020-11-16T20:57:15.382 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.382 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:15.382 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847944+0000", 2020-11-16T20:57:15.382 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042758900000000001 2020-11-16T20:57:15.382 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.383 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.383 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:15.383 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852220+0000", 2020-11-16T20:57:15.383 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9648999999999997e-05 2020-11-16T20:57:15.383 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.383 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.383 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:15.384 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852290+0000", 2020-11-16T20:57:15.384 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6919e-05 2020-11-16T20:57:15.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.384 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:15.384 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852367+0000", 2020-11-16T20:57:15.384 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.035208633 2020-11-16T20:57:15.385 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.385 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:15.385 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.385 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.385 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.385 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2983 4.0 4:1852173c:::smithi16641208-329:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e86)", 2020-11-16T20:57:15.385 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:57:15.385 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 26.517280061000001, 2020-11-16T20:57:15.386 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.037016812999999, 2020-11-16T20:57:15.386 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:15.386 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:15.386 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:15.386 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:15.386 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:15.386 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2983 2020-11-16T20:57:15.387 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.387 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:15.387 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.387 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:15.387 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:57:15.387 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:15.387 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.388 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.388 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:15.388 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:57:15.388 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7317999999999999e-05 2020-11-16T20:57:15.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.388 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.388 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:15.388 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817266+0000", 2020-11-16T20:57:15.389 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3519999999999998e-06 2020-11-16T20:57:15.389 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.389 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:15.389 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817269+0000", 2020-11-16T20:57:15.389 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7859999999999999e-06 2020-11-16T20:57:15.389 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.390 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.390 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:15.390 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817276+0000", 2020-11-16T20:57:15.390 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5620000000000002e-06 2020-11-16T20:57:15.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.390 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.390 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:15.391 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817278+0000", 2020-11-16T20:57:15.391 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3251999999999996e-05 2020-11-16T20:57:15.391 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.391 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.391 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817352+0000", 2020-11-16T20:57:15.391 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7966000000000001e-05 2020-11-16T20:57:15.391 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.392 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.392 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:15.395 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817400+0000", 2020-11-16T20:57:15.395 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.982734203 2020-11-16T20:57:15.395 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.395 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.395 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.396 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800134+0000", 2020-11-16T20:57:15.396 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9765999999999997e-05 2020-11-16T20:57:15.396 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.396 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.396 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:15.396 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800194+0000", 2020-11-16T20:57:15.396 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.046087276000000003 2020-11-16T20:57:15.397 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.397 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.397 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.397 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846281+0000", 2020-11-16T20:57:15.397 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000115396 2020-11-16T20:57:15.397 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.397 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.397 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:15.398 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846396+0000", 2020-11-16T20:57:15.398 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006004573 2020-11-16T20:57:15.398 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.398 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.398 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.398 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852401+0000", 2020-11-16T20:57:15.398 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013211599999999999 2020-11-16T20:57:15.399 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.399 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.399 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:15.399 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852533+0000", 2020-11-16T20:57:15.399 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0017322469999999999 2020-11-16T20:57:15.399 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.399 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.399 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:15.400 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.854265+0000", 2020-11-16T20:57:15.400 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.037016812999999 2020-11-16T20:57:15.400 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.400 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:15.400 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.400 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.400 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.401 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2984 4.0 4:033219d6:::smithi16641208-386:head [write 598481~712995,stat] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:15.401 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:57:15.401 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 26.510220219000001, 2020-11-16T20:57:15.401 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.003104742, 2020-11-16T20:57:15.401 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:15.401 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:15.401 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:15.402 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:15.402 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:15.402 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2984 2020-11-16T20:57:15.402 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.402 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:15.402 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.402 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:15.403 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:57:15.403 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:15.403 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.403 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.403 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:15.403 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:57:15.403 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00037173000000000002 2020-11-16T20:57:15.403 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.404 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.404 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:15.404 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824680+0000", 2020-11-16T20:57:15.404 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.146e-05 2020-11-16T20:57:15.404 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.404 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.404 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:15.405 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824691+0000", 2020-11-16T20:57:15.405 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6951000000000001e-05 2020-11-16T20:57:15.405 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.405 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.405 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:15.405 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824708+0000", 2020-11-16T20:57:15.405 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2082000000000001e-05 2020-11-16T20:57:15.406 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.406 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.406 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:15.406 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824720+0000", 2020-11-16T20:57:15.406 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0284000000000002e-05 2020-11-16T20:57:15.406 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.406 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.406 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.407 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824771+0000", 2020-11-16T20:57:15.407 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1241000000000001e-05 2020-11-16T20:57:15.407 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.407 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.407 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:15.407 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824802+0000", 2020-11-16T20:57:15.407 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.975455838 2020-11-16T20:57:15.408 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.408 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.408 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.408 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800258+0000", 2020-11-16T20:57:15.408 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027151194999999999 2020-11-16T20:57:15.408 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.408 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.408 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:15.409 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827409+0000", 2020-11-16T20:57:15.409 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9609999999999999e-06 2020-11-16T20:57:15.409 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.409 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.409 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:15.409 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827413+0000", 2020-11-16T20:57:15.409 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.003104742 2020-11-16T20:57:15.410 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.410 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:15.410 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.410 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.410 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.410 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2985 4.0 4:033219d6:::smithi16641208-386:head [write 1899355~418865] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:15.410 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:57:15.411 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 26.504608937, 2020-11-16T20:57:15.411 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.021091737000001, 2020-11-16T20:57:15.411 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:15.411 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:15.411 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:15.411 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:15.411 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:15.411 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2985 2020-11-16T20:57:15.412 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.412 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:15.412 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.412 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:15.412 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:57:15.412 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:15.412 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.413 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.413 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:15.413 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:57:15.413 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023221799999999999 2020-11-16T20:57:15.413 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.413 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.413 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:15.414 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830152+0000", 2020-11-16T20:57:15.414 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9769999999999995e-06 2020-11-16T20:57:15.414 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.414 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.414 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:15.414 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830162+0000", 2020-11-16T20:57:15.414 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5545000000000001e-05 2020-11-16T20:57:15.414 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.415 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.415 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:15.415 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830177+0000", 2020-11-16T20:57:15.415 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0334e-05 2020-11-16T20:57:15.415 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.415 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.415 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:15.416 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830188+0000", 2020-11-16T20:57:15.416 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3430999999999996e-05 2020-11-16T20:57:15.416 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.416 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.416 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.416 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830251+0000", 2020-11-16T20:57:15.416 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2651999999999997e-05 2020-11-16T20:57:15.417 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.417 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.417 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:15.417 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830304+0000", 2020-11-16T20:57:15.417 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.970289857999999 2020-11-16T20:57:15.417 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.417 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.417 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.418 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800594+0000", 2020-11-16T20:57:15.418 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8948999999999993e-05 2020-11-16T20:57:15.418 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.418 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.418 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:15.418 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800663+0000", 2020-11-16T20:57:15.418 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036018513000000002 2020-11-16T20:57:15.419 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.419 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.419 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.419 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836681+0000", 2020-11-16T20:57:15.419 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013201099999999999 2020-11-16T20:57:15.419 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.419 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.420 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:15.420 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836813+0000", 2020-11-16T20:57:15.420 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000126635 2020-11-16T20:57:15.420 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.420 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.420 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:15.420 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836940+0000", 2020-11-16T20:57:15.420 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010477907 2020-11-16T20:57:15.421 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.421 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.421 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:15.421 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847418+0000", 2020-11-16T20:57:15.421 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000158796 2020-11-16T20:57:15.421 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.421 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.422 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:15.422 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847576+0000", 2020-11-16T20:57:15.422 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033023729999999999 2020-11-16T20:57:15.422 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.422 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.422 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:15.422 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850879+0000", 2020-11-16T20:57:15.422 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6360999999999996e-05 2020-11-16T20:57:15.423 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.423 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.423 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:15.423 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850955+0000", 2020-11-16T20:57:15.423 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6177000000000001e-05 2020-11-16T20:57:15.423 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.423 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.424 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:15.424 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851011+0000", 2020-11-16T20:57:15.424 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.021091737000001 2020-11-16T20:57:15.424 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.424 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:15.424 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.424 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.425 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.425 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2986 4.0 4:033219d6:::smithi16641208-386:head [write 3093840~704641] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:15.425 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:57:15.425 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 26.496383235, 2020-11-16T20:57:15.425 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013155362999999, 2020-11-16T20:57:15.425 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:15.425 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:15.425 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:15.426 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:15.426 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:15.426 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2986 2020-11-16T20:57:15.426 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.426 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:15.426 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.426 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:15.427 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:57:15.427 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:15.427 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.427 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.427 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:15.427 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:57:15.427 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00038247200000000002 2020-11-16T20:57:15.427 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.428 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.428 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:15.428 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838528+0000", 2020-11-16T20:57:15.428 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3299999999999999e-06 2020-11-16T20:57:15.428 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.428 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.428 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:15.429 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838536+0000", 2020-11-16T20:57:15.429 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3438000000000001e-05 2020-11-16T20:57:15.429 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.429 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.429 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:15.429 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838549+0000", 2020-11-16T20:57:15.429 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0213e-05 2020-11-16T20:57:15.429 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.430 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.430 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:15.430 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838560+0000", 2020-11-16T20:57:15.430 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1894999999999997e-05 2020-11-16T20:57:15.430 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.430 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.430 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.431 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838612+0000", 2020-11-16T20:57:15.431 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8209e-05 2020-11-16T20:57:15.431 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.431 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.431 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:15.431 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838650+0000", 2020-11-16T20:57:15.431 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962061715000001 2020-11-16T20:57:15.432 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.432 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.432 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.432 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800712+0000", 2020-11-16T20:57:15.432 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6964e-05 2020-11-16T20:57:15.432 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.432 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.432 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:15.433 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800748+0000", 2020-11-16T20:57:15.433 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037209265999999998 2020-11-16T20:57:15.433 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.433 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.433 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.433 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.837958+0000", 2020-11-16T20:57:15.433 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000160304 2020-11-16T20:57:15.434 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.434 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.434 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:15.434 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.838118+0000", 2020-11-16T20:57:15.434 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022362799999999999 2020-11-16T20:57:15.434 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.434 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.434 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:15.435 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.838342+0000", 2020-11-16T20:57:15.435 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0090844710000000002 2020-11-16T20:57:15.435 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.435 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.435 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:15.435 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847426+0000", 2020-11-16T20:57:15.435 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000219199 2020-11-16T20:57:15.436 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.436 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.436 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:15.436 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847645+0000", 2020-11-16T20:57:15.436 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003411603 2020-11-16T20:57:15.436 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.436 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.436 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:15.437 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851057+0000", 2020-11-16T20:57:15.437 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014736799999999999 2020-11-16T20:57:15.437 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.437 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.437 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:15.437 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851204+0000", 2020-11-16T20:57:15.437 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6287999999999997e-05 2020-11-16T20:57:15.438 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.438 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.438 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:15.438 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851301+0000", 2020-11-16T20:57:15.438 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013155362999999 2020-11-16T20:57:15.438 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.438 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:15.439 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.439 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.439 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.439 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2987 4.0 4:033219d6:::smithi16641208-386:head [setxattr _header (58) in=7b,truncate 3798481] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:15.439 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:57:15.439 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 26.495924595999998, 2020-11-16T20:57:15.439 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.012971041, 2020-11-16T20:57:15.440 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:15.440 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:15.440 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:15.440 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:15.440 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:15.440 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2987 2020-11-16T20:57:15.440 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.440 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:15.441 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.441 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:15.441 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:57:15.441 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:15.441 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.441 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.441 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:15.442 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:57:15.442 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4530000000000002e-05 2020-11-16T20:57:15.442 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.442 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.442 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:15.442 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838648+0000", 2020-11-16T20:57:15.442 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8390000000000001e-06 2020-11-16T20:57:15.442 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.443 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.443 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:15.443 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838655+0000", 2020-11-16T20:57:15.443 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0341e-05 2020-11-16T20:57:15.443 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.443 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.443 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:15.444 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838666+0000", 2020-11-16T20:57:15.444 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0929999999999999e-06 2020-11-16T20:57:15.444 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.444 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.444 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:15.444 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838672+0000", 2020-11-16T20:57:15.444 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8074999999999997e-05 2020-11-16T20:57:15.444 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.445 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.445 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.445 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838710+0000", 2020-11-16T20:57:15.445 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1121000000000002e-05 2020-11-16T20:57:15.445 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.445 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.445 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:15.446 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838751+0000", 2020-11-16T20:57:15.446 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962044797000001 2020-11-16T20:57:15.446 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.446 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.446 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.446 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800796+0000", 2020-11-16T20:57:15.446 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6808999999999998e-05 2020-11-16T20:57:15.447 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.447 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.447 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:15.447 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800852+0000", 2020-11-16T20:57:15.447 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042964599999999999 2020-11-16T20:57:15.447 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.447 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.447 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.448 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843817+0000", 2020-11-16T20:57:15.448 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017807899999999999 2020-11-16T20:57:15.448 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.448 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.448 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:15.448 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843995+0000", 2020-11-16T20:57:15.448 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023680500000000001 2020-11-16T20:57:15.449 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.449 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.449 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:15.449 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844232+0000", 2020-11-16T20:57:15.449 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00320163 2020-11-16T20:57:15.449 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.449 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.449 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:15.450 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847434+0000", 2020-11-16T20:57:15.450 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00042527899999999998 2020-11-16T20:57:15.450 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.450 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.450 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:15.450 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847859+0000", 2020-11-16T20:57:15.450 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0034987920000000001 2020-11-16T20:57:15.451 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.451 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.451 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:15.451 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851358+0000", 2020-11-16T20:57:15.451 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014067300000000001 2020-11-16T20:57:15.451 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.451 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.451 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:15.452 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851498+0000", 2020-11-16T20:57:15.452 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6577999999999998e-05 2020-11-16T20:57:15.452 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.452 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.452 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:15.452 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851575+0000", 2020-11-16T20:57:15.452 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.012971041 2020-11-16T20:57:15.453 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.453 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:15.453 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.453 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.453 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.453 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2988 4.0 4:033219d6:::smithi16641208-386:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e86)", 2020-11-16T20:57:15.453 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:57:15.454 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 26.495822097000001, 2020-11-16T20:57:15.454 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013229791000001, 2020-11-16T20:57:15.454 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:15.454 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:15.454 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:15.454 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:15.454 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:15.454 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2988 2020-11-16T20:57:15.455 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.455 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:15.455 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.455 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:15.455 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:57:15.455 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:15.455 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.456 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.456 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:15.456 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:57:15.456 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9252999999999999e-05 2020-11-16T20:57:15.456 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.456 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.456 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:15.456 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838736+0000", 2020-11-16T20:57:15.457 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3980000000000004e-06 2020-11-16T20:57:15.457 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.457 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.457 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:15.457 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838742+0000", 2020-11-16T20:57:15.457 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1144999999999999e-05 2020-11-16T20:57:15.457 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.458 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.458 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:15.458 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838753+0000", 2020-11-16T20:57:15.458 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6229999999999996e-06 2020-11-16T20:57:15.458 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.458 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.458 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:15.459 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838758+0000", 2020-11-16T20:57:15.459 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5130000000000003e-05 2020-11-16T20:57:15.459 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.459 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.459 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.459 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838803+0000", 2020-11-16T20:57:15.459 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0132000000000001e-05 2020-11-16T20:57:15.459 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.460 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.460 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:15.460 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838843+0000", 2020-11-16T20:57:15.460 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962066786999999 2020-11-16T20:57:15.460 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.460 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.460 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.461 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800910+0000", 2020-11-16T20:57:15.461 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6925999999999997e-05 2020-11-16T20:57:15.461 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.461 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.461 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:15.461 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800967+0000", 2020-11-16T20:57:15.461 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.043837752000000001 2020-11-16T20:57:15.461 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.462 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.462 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.462 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844805+0000", 2020-11-16T20:57:15.462 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012337000000000001 2020-11-16T20:57:15.462 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.462 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.462 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:15.463 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844928+0000", 2020-11-16T20:57:15.463 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0066885149999999999 2020-11-16T20:57:15.463 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.463 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.463 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.463 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851616+0000", 2020-11-16T20:57:15.463 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5716000000000005e-05 2020-11-16T20:57:15.464 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.464 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.464 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:15.464 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851692+0000", 2020-11-16T20:57:15.464 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024404400000000001 2020-11-16T20:57:15.464 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.464 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.464 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:15.465 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851936+0000", 2020-11-16T20:57:15.465 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013229791000001 2020-11-16T20:57:15.465 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.465 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:15.465 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.465 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.465 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.466 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2992 4.0 4:0f4a2e46:::smithi16641208-399:head [cache-evict] snapc 0=[] ondisk+read+ignore_cache+known_if_redirected e86)", 2020-11-16T20:57:15.466 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:57:15.466 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 26.495735759999999, 2020-11-16T20:57:15.466 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962433468, 2020-11-16T20:57:15.466 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:15.466 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:15.466 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:15.467 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:15.467 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:15.467 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2992 2020-11-16T20:57:15.467 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.467 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:15.467 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.467 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:15.467 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:57:15.468 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:15.468 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.468 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.468 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:15.468 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:57:15.468 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7780000000000002e-05 2020-11-16T20:57:15.468 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.469 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.469 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:15.469 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838820+0000", 2020-11-16T20:57:15.469 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1200000000000001e-06 2020-11-16T20:57:15.469 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.469 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.469 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:15.469 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838826+0000", 2020-11-16T20:57:15.470 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0008e-05 2020-11-16T20:57:15.470 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.470 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.470 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:15.470 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838836+0000", 2020-11-16T20:57:15.470 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3749999999999996e-06 2020-11-16T20:57:15.470 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.471 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.471 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:15.471 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838840+0000", 2020-11-16T20:57:15.471 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0889000000000002e-05 2020-11-16T20:57:15.471 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.471 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.471 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.472 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838871+0000", 2020-11-16T20:57:15.472 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6891000000000003e-05 2020-11-16T20:57:15.472 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.472 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.472 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:15.472 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838908+0000", 2020-11-16T20:57:15.472 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962115045999999 2020-11-16T20:57:15.472 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.473 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.473 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.473 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801023+0000", 2020-11-16T20:57:15.473 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020335899999999999 2020-11-16T20:57:15.473 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.473 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.473 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:15.474 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801226+0000", 2020-11-16T20:57:15.474 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962433468 2020-11-16T20:57:15.474 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.474 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:15.474 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.474 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.474 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.474 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3051 4.0 4:2ceac9f9:::smithi16641208-61:head [write 699323~480842] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:57:15.475 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:57:15.475 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.493615453, 2020-11-16T20:57:15.475 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9728349610000002, 2020-11-16T20:57:15.475 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:15.475 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:15.475 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:15.475 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:15.476 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:15.476 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3051 2020-11-16T20:57:15.476 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.476 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:15.476 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.476 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:15.476 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:57:15.476 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:15.477 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.477 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.477 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:15.477 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:57:15.477 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032526199999999999 2020-11-16T20:57:15.477 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.477 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.478 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:15.478 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841238+0000", 2020-11-16T20:57:15.478 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9822000000000001e-05 2020-11-16T20:57:15.478 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.478 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.478 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:15.478 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841258+0000", 2020-11-16T20:57:15.479 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.507e-05 2020-11-16T20:57:15.479 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.479 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.479 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:15.479 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841273+0000", 2020-11-16T20:57:15.479 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8900000000000007e-06 2020-11-16T20:57:15.479 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.479 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.480 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:15.480 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841281+0000", 2020-11-16T20:57:15.480 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4356000000000003e-05 2020-11-16T20:57:15.480 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.480 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.480 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.480 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841365+0000", 2020-11-16T20:57:15.481 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0232000000000002e-05 2020-11-16T20:57:15.481 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.481 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.481 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:15.481 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841426+0000", 2020-11-16T20:57:15.481 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9604309439999996 2020-11-16T20:57:15.481 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.481 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.482 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.482 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801857+0000", 2020-11-16T20:57:15.482 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000164897 2020-11-16T20:57:15.482 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.482 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.482 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:15.482 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.802021+0000", 2020-11-16T20:57:15.483 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020576500000000001 2020-11-16T20:57:15.483 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.483 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.483 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:15.483 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.802227+0000", 2020-11-16T20:57:15.483 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0066237170000000003 2020-11-16T20:57:15.483 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.484 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.484 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:15.484 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808851+0000", 2020-11-16T20:57:15.484 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037712430000000001 2020-11-16T20:57:15.484 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.484 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.484 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:15.484 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812622+0000", 2020-11-16T20:57:15.485 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00099110800000000009 2020-11-16T20:57:15.485 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.485 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.485 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:15.485 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813613+0000", 2020-11-16T20:57:15.485 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1646e-05 2020-11-16T20:57:15.485 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.486 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.486 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:15.486 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813665+0000", 2020-11-16T20:57:15.486 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3009000000000004e-05 2020-11-16T20:57:15.486 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.486 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.486 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:15.486 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813748+0000", 2020-11-16T20:57:15.487 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9728349610000002 2020-11-16T20:57:15.487 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.487 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:15.487 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.487 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.487 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.487 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3052 4.0 4:2ceac9f9:::smithi16641208-61:head [write 1850247~429872] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:57:15.488 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:57:15.488 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.485424414000001, 2020-11-16T20:57:15.488 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9911138360000002, 2020-11-16T20:57:15.488 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:15.488 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:15.488 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:15.488 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:15.489 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:15.489 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3052 2020-11-16T20:57:15.489 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.489 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:15.489 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.489 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:15.489 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:57:15.489 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:15.490 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.490 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.490 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:15.490 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:57:15.490 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000296166 2020-11-16T20:57:15.490 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.490 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.491 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:15.491 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849400+0000", 2020-11-16T20:57:15.491 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0699999999999996e-06 2020-11-16T20:57:15.491 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.491 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.491 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:15.491 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849409+0000", 2020-11-16T20:57:15.492 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3725e-05 2020-11-16T20:57:15.492 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.492 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.492 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:15.492 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849423+0000", 2020-11-16T20:57:15.492 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9929999999999998e-06 2020-11-16T20:57:15.492 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.492 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.493 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:15.493 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849430+0000", 2020-11-16T20:57:15.493 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9708000000000002e-05 2020-11-16T20:57:15.493 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.493 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.493 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.493 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849520+0000", 2020-11-16T20:57:15.494 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2088000000000002e-05 2020-11-16T20:57:15.494 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.494 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.494 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:15.494 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849552+0000", 2020-11-16T20:57:15.494 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.954526692 2020-11-16T20:57:15.494 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.495 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.495 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.495 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804079+0000", 2020-11-16T20:57:15.495 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015456899999999999 2020-11-16T20:57:15.495 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.495 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.495 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:15.495 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804233+0000", 2020-11-16T20:57:15.496 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019627800000000001 2020-11-16T20:57:15.496 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.496 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.496 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:15.496 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804429+0000", 2020-11-16T20:57:15.496 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006762316 2020-11-16T20:57:15.496 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.497 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.497 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:15.497 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811192+0000", 2020-11-16T20:57:15.497 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002630467 2020-11-16T20:57:15.497 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.497 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.497 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:15.497 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813822+0000", 2020-11-16T20:57:15.498 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026302065999999999 2020-11-16T20:57:15.498 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.498 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.498 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:15.498 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840124+0000", 2020-11-16T20:57:15.498 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.274e-05 2020-11-16T20:57:15.498 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.499 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.499 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:15.499 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840177+0000", 2020-11-16T20:57:15.499 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0958000000000003e-05 2020-11-16T20:57:15.499 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.499 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.499 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:15.500 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840218+0000", 2020-11-16T20:57:15.500 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9911138360000002 2020-11-16T20:57:15.500 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.500 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:15.500 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.500 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.500 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.501 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3053 4.0 4:2ceac9f9:::smithi16641208-61:head [write 2858378~532392] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:57:15.501 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:57:15.501 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.476967083000002, 2020-11-16T20:57:15.501 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9828430529999999, 2020-11-16T20:57:15.501 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:15.501 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:15.502 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:15.502 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:15.502 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:15.502 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3053 2020-11-16T20:57:15.502 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.502 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:15.503 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.503 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:15.503 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:57:15.503 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:15.503 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.503 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.504 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:15.504 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:57:15.504 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000647082 2020-11-16T20:57:15.504 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.504 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.505 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:15.505 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858208+0000", 2020-11-16T20:57:15.505 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.269e-05 2020-11-16T20:57:15.505 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.505 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.505 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:15.506 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858221+0000", 2020-11-16T20:57:15.506 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0361e-05 2020-11-16T20:57:15.506 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.506 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.506 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:15.506 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858242+0000", 2020-11-16T20:57:15.506 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1184e-05 2020-11-16T20:57:15.507 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.507 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.507 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:15.507 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858253+0000", 2020-11-16T20:57:15.507 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7032000000000004e-05 2020-11-16T20:57:15.507 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.507 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.508 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.508 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858330+0000", 2020-11-16T20:57:15.508 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4135999999999998e-05 2020-11-16T20:57:15.508 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.508 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.508 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:15.508 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858384+0000", 2020-11-16T20:57:15.509 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9487614310000003 2020-11-16T20:57:15.509 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.509 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.509 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.509 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807145+0000", 2020-11-16T20:57:15.509 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9426000000000007e-05 2020-11-16T20:57:15.509 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.510 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.510 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:15.510 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807245+0000", 2020-11-16T20:57:15.510 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018410799999999999 2020-11-16T20:57:15.510 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.510 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.510 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:15.510 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807429+0000", 2020-11-16T20:57:15.511 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0064067339999999999 2020-11-16T20:57:15.511 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.511 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.511 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:15.511 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813836+0000", 2020-11-16T20:57:15.511 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001513267 2020-11-16T20:57:15.511 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.512 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.512 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:15.512 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815349+0000", 2020-11-16T20:57:15.512 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024962895999999998 2020-11-16T20:57:15.512 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.512 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.512 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:15.513 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840312+0000", 2020-11-16T20:57:15.513 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7781999999999997e-05 2020-11-16T20:57:15.513 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.513 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.513 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:15.513 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840370+0000", 2020-11-16T20:57:15.513 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4924e-05 2020-11-16T20:57:15.513 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.514 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.514 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:15.514 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840404+0000", 2020-11-16T20:57:15.514 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9828430529999999 2020-11-16T20:57:15.514 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.514 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:15.514 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.515 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.515 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.515 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3054 4.0 4:2ceac9f9:::smithi16641208-61:head [setxattr _header (57) in=7b,truncate 3899323] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:57:15.515 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:57:15.515 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.476214576, 2020-11-16T20:57:15.515 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9822430049999999, 2020-11-16T20:57:15.515 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:15.516 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:15.516 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:15.516 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:15.516 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:15.516 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3054 2020-11-16T20:57:15.516 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.516 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:15.516 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.517 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:15.517 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:57:15.517 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:15.517 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.517 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.517 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:15.517 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:57:15.518 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8208999999999999e-05 2020-11-16T20:57:15.518 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.518 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.518 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:15.518 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858362+0000", 2020-11-16T20:57:15.518 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5539999999999998e-06 2020-11-16T20:57:15.518 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.519 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.519 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:15.519 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858371+0000", 2020-11-16T20:57:15.519 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.005e-05 2020-11-16T20:57:15.519 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.519 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.519 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:15.519 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858381+0000", 2020-11-16T20:57:15.520 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8099999999999997e-06 2020-11-16T20:57:15.520 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.520 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.520 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:15.520 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858386+0000", 2020-11-16T20:57:15.520 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6168000000000005e-05 2020-11-16T20:57:15.520 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.521 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.521 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.521 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858482+0000", 2020-11-16T20:57:15.521 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7954999999999999e-05 2020-11-16T20:57:15.521 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.521 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.521 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:15.521 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858510+0000", 2020-11-16T20:57:15.522 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9498925639999998 2020-11-16T20:57:15.522 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.522 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.522 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.522 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808402+0000", 2020-11-16T20:57:15.522 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3084000000000005e-05 2020-11-16T20:57:15.522 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.523 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.523 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:15.523 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808495+0000", 2020-11-16T20:57:15.523 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114826 2020-11-16T20:57:15.523 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.523 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.523 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:15.524 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808610+0000", 2020-11-16T20:57:15.524 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052363219999999999 2020-11-16T20:57:15.524 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.524 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.524 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:15.524 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813846+0000", 2020-11-16T20:57:15.524 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0015700709999999999 2020-11-16T20:57:15.524 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.525 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.525 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:15.525 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815417+0000", 2020-11-16T20:57:15.525 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025048682999999999 2020-11-16T20:57:15.525 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.525 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.525 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:15.526 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840465+0000", 2020-11-16T20:57:15.526 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5473000000000003e-05 2020-11-16T20:57:15.526 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.526 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.526 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:15.526 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840511+0000", 2020-11-16T20:57:15.526 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6236000000000003e-05 2020-11-16T20:57:15.527 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.527 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.527 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:15.527 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840557+0000", 2020-11-16T20:57:15.527 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9822430049999999 2020-11-16T20:57:15.527 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.527 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:15.527 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.528 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.528 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.528 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3055 4.0 4:2ceac9f9:::smithi16641208-61:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e91)", 2020-11-16T20:57:15.528 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:57:15.528 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.47603938, 2020-11-16T20:57:15.528 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9852841799999998, 2020-11-16T20:57:15.528 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:15.529 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:15.529 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:15.529 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:15.529 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:15.529 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3055 2020-11-16T20:57:15.529 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.529 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:15.529 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.530 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:15.530 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:57:15.530 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:15.530 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.530 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.530 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:15.530 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:57:15.531 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4403000000000002e-05 2020-11-16T20:57:15.531 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.531 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.531 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:15.531 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858523+0000", 2020-11-16T20:57:15.531 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4670000000000001e-06 2020-11-16T20:57:15.531 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.532 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.532 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:15.532 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858530+0000", 2020-11-16T20:57:15.532 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2469999999999999e-05 2020-11-16T20:57:15.532 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.532 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.532 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:15.532 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858542+0000", 2020-11-16T20:57:15.533 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2449999999999998e-06 2020-11-16T20:57:15.533 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.533 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.533 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:15.533 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858548+0000", 2020-11-16T20:57:15.533 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9604000000000002e-05 2020-11-16T20:57:15.533 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.534 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.534 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.534 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858587+0000", 2020-11-16T20:57:15.534 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4863000000000001e-05 2020-11-16T20:57:15.534 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.534 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.534 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:15.534 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858632+0000", 2020-11-16T20:57:15.535 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9521692039999996 2020-11-16T20:57:15.535 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.535 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.535 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.535 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.810801+0000", 2020-11-16T20:57:15.535 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014886700000000001 2020-11-16T20:57:15.535 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.536 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.536 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:15.536 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.810950+0000", 2020-11-16T20:57:15.536 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029669781999999999 2020-11-16T20:57:15.536 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.536 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.536 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.536 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840620+0000", 2020-11-16T20:57:15.537 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010005699999999999 2020-11-16T20:57:15.537 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.537 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.537 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:15.537 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840720+0000", 2020-11-16T20:57:15.537 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030532179999999999 2020-11-16T20:57:15.537 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.538 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.538 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:15.538 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843773+0000", 2020-11-16T20:57:15.538 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9852841799999998 2020-11-16T20:57:15.538 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.538 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:15.538 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.539 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.539 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.539 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3065 4.0 4:2f657946:::smithi16641208-73:head [read 0~3210104,checksum] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:57:15.539 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:57:15.539 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.367764356999999, 2020-11-16T20:57:15.539 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8738324339999997, 2020-11-16T20:57:15.539 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:15.539 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:15.540 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:15.540 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:15.540 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:15.540 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3065 2020-11-16T20:57:15.540 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.540 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:15.540 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.541 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:15.541 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:57:15.541 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:15.541 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.541 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.541 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:15.541 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:57:15.541 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3065999999999999e-05 2020-11-16T20:57:15.542 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.542 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.542 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:15.542 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966787+0000", 2020-11-16T20:57:15.542 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8329999999999998e-06 2020-11-16T20:57:15.542 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.542 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.543 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:15.543 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966790+0000", 2020-11-16T20:57:15.543 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1780000000000002e-06 2020-11-16T20:57:15.543 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.543 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.543 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:15.543 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966795+0000", 2020-11-16T20:57:15.544 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3460000000000001e-06 2020-11-16T20:57:15.544 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.544 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.544 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:15.544 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966798+0000", 2020-11-16T20:57:15.544 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6675000000000003e-05 2020-11-16T20:57:15.544 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.545 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.545 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.545 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966844+0000", 2020-11-16T20:57:15.545 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5497999999999999e-05 2020-11-16T20:57:15.545 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.545 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.545 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:15.546 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966870+0000", 2020-11-16T20:57:15.546 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8445859479999998 2020-11-16T20:57:15.546 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.546 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.546 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.546 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811456+0000", 2020-11-16T20:57:15.546 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029140889999999999 2020-11-16T20:57:15.547 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.547 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.547 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:15.547 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840597+0000", 2020-11-16T20:57:15.547 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8738324339999997 2020-11-16T20:57:15.547 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.547 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:15.547 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.548 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.548 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.548 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3066 4.0 4:356864c0:::smithi16641208-150:head [read 0~2504243,checksum,omap-get-vals-by-keys,omap-get-keys,omap-get-vals,omap-get-header,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:57:15.548 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:57:15.548 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.367713131999999, 2020-11-16T20:57:15.548 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8778990499999999, 2020-11-16T20:57:15.548 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:15.549 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:15.549 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:15.549 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:15.549 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:15.549 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3066 2020-11-16T20:57:15.549 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.549 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:15.549 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.550 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:15.550 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:57:15.550 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:15.550 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.550 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.550 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:15.550 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:57:15.551 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1704000000000001e-05 2020-11-16T20:57:15.551 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.551 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.551 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:15.551 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966837+0000", 2020-11-16T20:57:15.551 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6850000000000001e-06 2020-11-16T20:57:15.551 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.552 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.552 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:15.552 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966840+0000", 2020-11-16T20:57:15.552 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7479999999999999e-06 2020-11-16T20:57:15.552 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.552 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.552 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:15.552 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966845+0000", 2020-11-16T20:57:15.553 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5059999999999998e-06 2020-11-16T20:57:15.553 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.553 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.553 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:15.553 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966848+0000", 2020-11-16T20:57:15.553 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4314000000000002e-05 2020-11-16T20:57:15.553 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.554 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.554 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.554 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966902+0000", 2020-11-16T20:57:15.554 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.561e-05 2020-11-16T20:57:15.554 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.554 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.554 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:15.555 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:57:15.555 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8448102110000004 2020-11-16T20:57:15.555 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.555 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.555 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.555 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811738+0000", 2020-11-16T20:57:15.555 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032976272000000001 2020-11-16T20:57:15.555 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.556 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.556 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:15.556 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844714+0000", 2020-11-16T20:57:15.556 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8778990499999999 2020-11-16T20:57:15.556 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.556 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:15.556 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.557 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.557 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.557 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3067 4.0 4:356864c0:::smithi16641208-150:head [sparse-read 0~2504243] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:57:15.557 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:57:15.557 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.367661675000001, 2020-11-16T20:57:15.557 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8780898150000001, 2020-11-16T20:57:15.557 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:15.557 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:15.558 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:15.558 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:15.558 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:15.558 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3067 2020-11-16T20:57:15.558 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.558 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:15.558 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.559 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:15.559 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:57:15.559 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:15.559 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.559 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.559 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:15.559 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:57:15.560 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2826e-05 2020-11-16T20:57:15.560 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.560 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.560 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:15.560 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966900+0000", 2020-11-16T20:57:15.560 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.694e-06 2020-11-16T20:57:15.560 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.560 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.561 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:15.561 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966902+0000", 2020-11-16T20:57:15.561 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0889999999999999e-06 2020-11-16T20:57:15.561 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.561 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.561 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:15.561 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966907+0000", 2020-11-16T20:57:15.562 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3910000000000001e-06 2020-11-16T20:57:15.562 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.562 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.562 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:15.562 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966910+0000", 2020-11-16T20:57:15.562 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2771000000000002e-05 2020-11-16T20:57:15.562 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.562 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.563 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.563 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966943+0000", 2020-11-16T20:57:15.563 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5301000000000001e-05 2020-11-16T20:57:15.563 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.563 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.563 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:15.563 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966968+0000", 2020-11-16T20:57:15.564 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.845055017 2020-11-16T20:57:15.564 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.564 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.564 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.564 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812023+0000", 2020-11-16T20:57:15.564 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032933726000000003 2020-11-16T20:57:15.564 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.564 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.565 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:15.565 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844957+0000", 2020-11-16T20:57:15.565 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8780898150000001 2020-11-16T20:57:15.565 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.565 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:15.565 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.565 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.566 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.566 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3068 4.0 4:356864c0:::smithi16641208-150:head [read 0~2504243,checksum] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:57:15.566 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:57:15.566 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.367600336999999, 2020-11-16T20:57:15.566 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8828719500000002, 2020-11-16T20:57:15.566 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:15.566 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:15.567 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:15.567 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:15.567 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:15.567 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3068 2020-11-16T20:57:15.567 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.567 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:15.567 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.567 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:15.568 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:57:15.568 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:15.568 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.568 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.568 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:15.568 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:57:15.568 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0942999999999999e-05 2020-11-16T20:57:15.569 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.569 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.569 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:15.569 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966949+0000", 2020-11-16T20:57:15.569 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.712e-06 2020-11-16T20:57:15.569 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.569 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.570 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:15.570 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966952+0000", 2020-11-16T20:57:15.570 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8479999999999997e-06 2020-11-16T20:57:15.570 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.570 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.570 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:15.570 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966958+0000", 2020-11-16T20:57:15.571 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9170000000000002e-06 2020-11-16T20:57:15.571 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.571 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.571 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:15.571 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966961+0000", 2020-11-16T20:57:15.571 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4105999999999999e-05 2020-11-16T20:57:15.571 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.571 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.572 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.572 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966985+0000", 2020-11-16T20:57:15.572 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2056e-05 2020-11-16T20:57:15.572 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.572 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.572 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:15.572 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.967007+0000", 2020-11-16T20:57:15.573 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8456606430000004 2020-11-16T20:57:15.573 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.573 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.573 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:15.573 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812667+0000", 2020-11-16T20:57:15.573 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037132724999999998 2020-11-16T20:57:15.573 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:15.573 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:15.574 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:15.574 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849800+0000", 2020-11-16T20:57:15.574 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8828719500000002 2020-11-16T20:57:15.574 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.574 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:15.574 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.574 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:15.575 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:15.575 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:15.576 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:57:15.577 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:15.580+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:15.677 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:15.682+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:15.743 INFO:tasks.rados.rados.0.smithi166.stdout:970: done (0 left) 2020-11-16T20:57:15.744 INFO:tasks.rados.rados.0.smithi166.stdout:971: read oid 191 snap -1 2020-11-16T20:57:15.744 INFO:tasks.rados.rados.0.smithi166.stdout:971: expect (ObjNum 190 snap 0 seq_num 190) 2020-11-16T20:57:15.744 INFO:tasks.rados.rados.0.smithi166.stdout:972: read oid 332 snap -1 2020-11-16T20:57:15.744 INFO:tasks.rados.rados.0.smithi166.stdout:972: expect (ObjNum 331 snap 0 seq_num 331) 2020-11-16T20:57:15.744 INFO:tasks.rados.rados.0.smithi166.stdout:973: cache_flush oid 323 snap -1 2020-11-16T20:57:15.745 INFO:tasks.rados.rados.0.smithi166.stdout:974: read oid 244 snap -1 2020-11-16T20:57:15.745 INFO:tasks.rados.rados.0.smithi166.stdout:974: expect (ObjNum 243 snap 0 seq_num 243) 2020-11-16T20:57:15.745 INFO:tasks.rados.rados.0.smithi166.stdout:975: rollback oid 407 current snap is 36 2020-11-16T20:57:19.942 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 407 to 34 2020-11-16T20:57:19.942 INFO:tasks.rados.rados.0.smithi166.stdout:976: snap_remove snap 35 2020-11-16T20:57:19.943 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2020-11-16T20:57:19.944 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:57:19.944 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:57:19.944 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2020-11-16T20:57:19.945 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:57:19.951 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:19.951 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:57:19.951 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:57:19.951 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:19.952 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:57:19.952 INFO:tasks.rados.rados.0.smithi166.stdout:976: done (5 left) 2020-11-16T20:57:19.952 INFO:tasks.rados.rados.0.smithi166.stdout:977: copy_from oid 439 from oid 491 current snap is 36 2020-11-16T20:57:19.952 INFO:tasks.rados.rados.0.smithi166.stdout:974: expect (ObjNum 243 snap 0 seq_num 243) 2020-11-16T20:57:19.952 INFO:tasks.rados.rados.0.smithi166.stdout:975: finishing rollback tid 0 to smithi16641208-407 2020-11-16T20:57:19.953 INFO:tasks.rados.rados.0.smithi166.stdout:975: finishing rollback tid 1 to smithi16641208-407 2020-11-16T20:57:19.953 INFO:tasks.rados.rados.0.smithi166.stdout:975: finishing rollback tid 2 to smithi16641208-407 2020-11-16T20:57:19.953 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 407 v 616 (ObjNum 521 snap 6 seq_num 521) dirty exists 2020-11-16T20:57:19.953 INFO:tasks.rados.rados.0.smithi166.stdout:972: expect (ObjNum 331 snap 0 seq_num 331) 2020-11-16T20:57:19.953 INFO:tasks.rados.rados.0.smithi166.stdout:971: expect (ObjNum 190 snap 0 seq_num 190) 2020-11-16T20:57:19.953 INFO:tasks.rados.rados.0.smithi166.stdout:973: got (2) No such file or directory 2020-11-16T20:57:19.954 INFO:tasks.rados.rados.0.smithi166.stdout:977: finishing copy_from to smithi16641208-439 2020-11-16T20:57:19.954 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 439 v 511 (ObjNum 490 snap 0 seq_num 490) dirty exists 2020-11-16T20:57:19.954 INFO:tasks.rados.rados.0.smithi166.stdout:977: finishing copy_from racing read to smithi16641208-439 2020-11-16T20:57:19.954 INFO:tasks.rados.rados.0.smithi166.stdout:971: done (5 left) 2020-11-16T20:57:19.954 INFO:tasks.rados.rados.0.smithi166.stdout:972: done (4 left) 2020-11-16T20:57:19.954 INFO:tasks.rados.rados.0.smithi166.stdout:973: done (3 left) 2020-11-16T20:57:19.954 INFO:tasks.rados.rados.0.smithi166.stdout:974: done (2 left) 2020-11-16T20:57:19.955 INFO:tasks.rados.rados.0.smithi166.stdout:975: done (1 left) 2020-11-16T20:57:19.955 INFO:tasks.rados.rados.0.smithi166.stdout:977: done (0 left) 2020-11-16T20:57:19.955 INFO:tasks.rados.rados.0.smithi166.stdout:978: delete oid 13 current snap is 36 2020-11-16T20:57:19.955 INFO:tasks.rados.rados.0.smithi166.stdout:978: done (0 left) 2020-11-16T20:57:19.955 INFO:tasks.rados.rados.0.smithi166.stdout:979: snap_create 2020-11-16T20:57:19.955 INFO:tasks.rados.rados.0.smithi166.stdout:979: done (0 left) 2020-11-16T20:57:19.955 INFO:tasks.rados.rados.0.smithi166.stdout:980: rollback oid 406 current snap is 37 2020-11-16T20:57:19.955 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 406 to 32 2020-11-16T20:57:19.956 INFO:tasks.rados.rados.0.smithi166.stdout:981: cache_flush oid 374 snap -1 2020-11-16T20:57:19.956 INFO:tasks.rados.rados.0.smithi166.stdout:982: cache_evict oid 480 snap -1 2020-11-16T20:57:19.956 INFO:tasks.rados.rados.0.smithi166.stdout:983: cache_try_flush oid 482 snap -1 2020-11-16T20:57:19.956 INFO:tasks.rados.rados.0.smithi166.stdout:984: write (excl) oid 448 current snap is 37 2020-11-16T20:57:19.956 INFO:tasks.rados.rados.0.smithi166.stdout:984: seq_num 624 ranges {487568=496322,1431705=519550} 2020-11-16T20:57:19.956 INFO:tasks.rados.rados.0.smithi166.stdout:984: writing smithi16641208-448 from 487568 to 983890 tid 1 2020-11-16T20:57:19.956 INFO:tasks.rados.rados.0.smithi166.stdout:984: writing smithi16641208-448 from 1431705 to 1951255 tid 2 2020-11-16T20:57:19.957 INFO:tasks.rados.rados.0.smithi166.stdout:985: snap_create 2020-11-16T20:57:19.957 INFO:tasks.rados.rados.0.smithi166.stdout:982: got (2) No such file or directory 2020-11-16T20:57:19.957 INFO:tasks.rados.rados.0.smithi166.stdout:981: got (2) No such file or directory 2020-11-16T20:57:19.957 INFO:tasks.rados.rados.0.smithi166.stdout:983: got (2) No such file or directory 2020-11-16T20:57:19.957 INFO:tasks.rados.rados.0.smithi166.stdout:984: finishing write tid 1 to smithi16641208-448 2020-11-16T20:57:19.957 INFO:tasks.rados.rados.0.smithi166.stdout:984: finishing write tid 2 to smithi16641208-448 2020-11-16T20:57:19.957 INFO:tasks.rados.rados.0.smithi166.stdout:984: finishing write tid 3 to smithi16641208-448 2020-11-16T20:57:19.958 INFO:tasks.rados.rados.0.smithi166.stdout:984: finishing write tid 4 to smithi16641208-448 2020-11-16T20:57:19.958 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 448 v 619 (ObjNum 624 snap 37 seq_num 624) dirty exists 2020-11-16T20:57:19.958 INFO:tasks.rados.rados.0.smithi166.stdout:984: left oid 448 (ObjNum 624 snap 37 seq_num 624) 2020-11-16T20:57:19.958 INFO:tasks.rados.rados.0.smithi166.stdout:981: done (5 left) 2020-11-16T20:57:19.958 INFO:tasks.rados.rados.0.smithi166.stdout:982: done (4 left) 2020-11-16T20:57:19.958 INFO:tasks.rados.rados.0.smithi166.stdout:983: done (3 left) 2020-11-16T20:57:19.958 INFO:tasks.rados.rados.0.smithi166.stdout:984: done (2 left) 2020-11-16T20:57:19.959 INFO:tasks.rados.rados.0.smithi166.stdout:985: done (1 left) 2020-11-16T20:57:19.959 INFO:tasks.rados.rados.0.smithi166.stdout:986: cache_flush oid 17 snap -1 2020-11-16T20:57:19.959 INFO:tasks.rados.rados.0.smithi166.stdout:987: write oid 122 current snap is 38 2020-11-16T20:57:19.959 INFO:tasks.rados.rados.0.smithi166.stdout:987: seq_num 625 ranges {504375=571571,1490187=663208} 2020-11-16T20:57:19.959 INFO:tasks.rados.rados.0.smithi166.stdout:987: writing smithi16641208-122 from 504375 to 1075946 tid 1 2020-11-16T20:57:19.959 INFO:tasks.rados.rados.0.smithi166.stdout:987: writing smithi16641208-122 from 1490187 to 2153395 tid 2 2020-11-16T20:57:19.959 INFO:tasks.rados.rados.0.smithi166.stdout:988: delete oid 301 current snap is 38 2020-11-16T20:57:19.959 INFO:tasks.rados.rados.0.smithi166.stdout:986: got (0) Success 2020-11-16T20:57:19.960 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 17 v 0 (ObjNum 16 snap 0 seq_num 16) dirty exists 2020-11-16T20:57:19.960 INFO:tasks.rados.rados.0.smithi166.stdout:986: done (3 left) 2020-11-16T20:57:19.960 INFO:tasks.rados.rados.0.smithi166.stdout:988: done (2 left) 2020-11-16T20:57:19.960 INFO:tasks.rados.rados.0.smithi166.stdout:989: cache_flush oid 203 snap -1 2020-11-16T20:57:19.960 INFO:tasks.rados.rados.0.smithi166.stdout:990: cache_try_flush oid 133 snap -1 2020-11-16T20:57:19.960 INFO:tasks.rados.rados.0.smithi166.stdout:991: write (excl) oid 44 current snap is 38 2020-11-16T20:57:19.960 INFO:tasks.rados.rados.0.smithi166.stdout:991: seq_num 627 ranges {537989=722069,1890798=647191} 2020-11-16T20:57:19.961 INFO:tasks.rados.rados.0.smithi166.stdout:991: writing smithi16641208-44 from 537989 to 1260058 tid 1 2020-11-16T20:57:19.961 INFO:tasks.rados.rados.0.smithi166.stdout:991: writing smithi16641208-44 from 1890798 to 2537989 tid 2 2020-11-16T20:57:19.961 INFO:tasks.rados.rados.0.smithi166.stdout:992: write (excl) oid 121 current snap is 38 2020-11-16T20:57:19.961 INFO:tasks.rados.rados.0.smithi166.stdout:987: finishing write tid 1 to smithi16641208-122 2020-11-16T20:57:19.961 INFO:tasks.rados.rados.0.smithi166.stdout:992: seq_num 628 ranges {554796=797318,1949280=526888} 2020-11-16T20:57:19.961 INFO:tasks.rados.rados.0.smithi166.stdout:992: writing smithi16641208-121 from 554796 to 1352114 tid 1 2020-11-16T20:57:19.961 INFO:tasks.rados.rados.0.smithi166.stdout:992: writing smithi16641208-121 from 1949280 to 2476168 tid 2 2020-11-16T20:57:19.962 INFO:tasks.rados.rados.0.smithi166.stdout:993: cache_flush oid 379 snap -1 2020-11-16T20:57:19.962 INFO:tasks.rados.rados.0.smithi166.stdout:987: finishing write tid 2 to smithi16641208-122 2020-11-16T20:57:19.962 INFO:tasks.rados.rados.0.smithi166.stdout:994: read oid 101 snap -1 2020-11-16T20:57:19.962 INFO:tasks.rados.rados.0.smithi166.stdout:994: expect (ObjNum 522 snap 6 seq_num 522) 2020-11-16T20:57:19.962 INFO:tasks.rados.rados.0.smithi166.stdout:995: write (excl) oid 70 current snap is 38 2020-11-16T20:57:19.962 INFO:tasks.rados.rados.0.smithi166.stdout:987: finishing write tid 3 to smithi16641208-122 2020-11-16T20:57:19.962 INFO:tasks.rados.rados.0.smithi166.stdout:987: finishing write tid 4 to smithi16641208-122 2020-11-16T20:57:19.962 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 122 v 763 (ObjNum 625 snap 38 seq_num 625) dirty exists 2020-11-16T20:57:19.963 INFO:tasks.rados.rados.0.smithi166.stdout:987: left oid 122 (ObjNum 625 snap 38 seq_num 625) 2020-11-16T20:57:19.963 INFO:tasks.rados.rados.0.smithi166.stdout:989: got (0) Success 2020-11-16T20:57:19.963 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 203 v 0 (ObjNum 1727591392 snap 22090 seq_num 1727591392) clean dne 2020-11-16T20:57:19.963 INFO:tasks.rados.rados.0.smithi166.stdout:995: seq_num 629 ranges {571603=472567,1607762=670546} 2020-11-16T20:57:19.963 INFO:tasks.rados.rados.0.smithi166.stdout:995: writing smithi16641208-70 from 571603 to 1044170 tid 1 2020-11-16T20:57:19.963 INFO:tasks.rados.rados.0.smithi166.stdout:995: writing smithi16641208-70 from 1607762 to 2278308 tid 2 2020-11-16T20:57:19.963 INFO:tasks.rados.rados.0.smithi166.stdout:987: done (8 left) 2020-11-16T20:57:19.964 INFO:tasks.rados.rados.0.smithi166.stdout:989: done (7 left) 2020-11-16T20:57:19.964 INFO:tasks.rados.rados.0.smithi166.stdout:996: cache_evict oid 408 snap -1 2020-11-16T20:57:19.964 INFO:tasks.rados.rados.0.smithi166.stdout:990: got (0) Success 2020-11-16T20:57:19.964 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 133 v 0 (ObjNum 615 snap 32 seq_num 615) dirty exists 2020-11-16T20:57:19.964 INFO:tasks.rados.rados.0.smithi166.stdout:992: finishing write tid 1 to smithi16641208-121 2020-11-16T20:57:19.964 INFO:tasks.rados.rados.0.smithi166.stdout:993: got (2) No such file or directory 2020-11-16T20:57:19.964 INFO:tasks.rados.rados.0.smithi166.stdout:992: finishing write tid 2 to smithi16641208-121 2020-11-16T20:57:19.965 INFO:tasks.rados.rados.0.smithi166.stdout:992: finishing write tid 3 to smithi16641208-121 2020-11-16T20:57:19.965 INFO:tasks.rados.rados.0.smithi166.stdout:990: done (7 left) 2020-11-16T20:57:19.965 INFO:tasks.rados.rados.0.smithi166.stdout:993: done (6 left) 2020-11-16T20:57:19.965 INFO:tasks.rados.rados.0.smithi166.stdout:997: cache_evict oid 385 snap -1 2020-11-16T20:57:19.965 INFO:tasks.rados.rados.0.smithi166.stdout:992: finishing write tid 4 to smithi16641208-121 2020-11-16T20:57:19.965 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 121 v 642 (ObjNum 628 snap 38 seq_num 628) dirty exists 2020-11-16T20:57:19.965 INFO:tasks.rados.rados.0.smithi166.stdout:992: left oid 121 (ObjNum 628 snap 38 seq_num 628) 2020-11-16T20:57:19.965 INFO:tasks.rados.rados.0.smithi166.stdout:992: done (6 left) 2020-11-16T20:57:19.966 INFO:tasks.rados.rados.0.smithi166.stdout:998: snap_create 2020-11-16T20:57:19.966 INFO:tasks.rados.rados.0.smithi166.stdout:996: got (2) No such file or directory 2020-11-16T20:57:19.966 INFO:tasks.rados.rados.0.smithi166.stdout:997: got (2) No such file or directory 2020-11-16T20:57:19.966 INFO:tasks.rados.rados.0.smithi166.stdout:994: expect (ObjNum 522 snap 6 seq_num 522) 2020-11-16T20:57:19.966 INFO:tasks.rados.rados.0.smithi166.stdout:995: finishing write tid 1 to smithi16641208-70 2020-11-16T20:57:19.966 INFO:tasks.rados.rados.0.smithi166.stdout:995: finishing write tid 2 to smithi16641208-70 2020-11-16T20:57:19.966 INFO:tasks.rados.rados.0.smithi166.stdout:995: finishing write tid 3 to smithi16641208-70 2020-11-16T20:57:19.967 INFO:tasks.rados.rados.0.smithi166.stdout:995: finishing write tid 4 to smithi16641208-70 2020-11-16T20:57:19.967 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 70 v 778 (ObjNum 629 snap 38 seq_num 629) dirty exists 2020-11-16T20:57:19.967 INFO:tasks.rados.rados.0.smithi166.stdout:995: left oid 70 (ObjNum 629 snap 38 seq_num 629) 2020-11-16T20:57:19.967 INFO:tasks.rados.rados.0.smithi166.stdout:994: done (6 left) 2020-11-16T20:57:19.967 INFO:tasks.rados.rados.0.smithi166.stdout:995: done (5 left) 2020-11-16T20:57:19.967 INFO:tasks.rados.rados.0.smithi166.stdout:996: done (4 left) 2020-11-16T20:57:19.967 INFO:tasks.rados.rados.0.smithi166.stdout:997: done (3 left) 2020-11-16T20:57:19.968 INFO:tasks.rados.rados.0.smithi166.stdout:998: done (2 left) 2020-11-16T20:57:19.968 INFO:tasks.rados.rados.0.smithi166.stdout:999: write (excl) oid 320 current snap is 39 2020-11-16T20:57:19.968 INFO:tasks.rados.rados.0.smithi166.stdout:999: seq_num 630 ranges {588410=547816,1666244=414204,2484603=103807} 2020-11-16T20:57:19.968 INFO:tasks.rados.rados.0.smithi166.stdout:999: writing smithi16641208-320 from 588410 to 1136226 tid 1 2020-11-16T20:57:19.968 INFO:tasks.rados.rados.0.smithi166.stdout:999: writing smithi16641208-320 from 1666244 to 2080448 tid 2 2020-11-16T20:57:19.968 INFO:tasks.rados.rados.0.smithi166.stdout:999: writing smithi16641208-320 from 2484603 to 2588410 tid 3 2020-11-16T20:57:19.968 INFO:tasks.rados.rados.0.smithi166.stdout:1000: write oid 24 current snap is 39 2020-11-16T20:57:19.968 INFO:tasks.rados.rados.0.smithi166.stdout:1000: seq_num 631 ranges {605217=739418,2124726=480491} 2020-11-16T20:57:19.969 INFO:tasks.rados.rados.0.smithi166.stdout:1000: writing smithi16641208-24 from 605217 to 1344635 tid 1 2020-11-16T20:57:19.969 INFO:tasks.rados.rados.0.smithi166.stdout:1000: writing smithi16641208-24 from 2124726 to 2605217 tid 2 2020-11-16T20:57:19.969 INFO:tasks.rados.rados.0.smithi166.stdout:1001: read oid 446 snap -1 2020-11-16T20:57:19.969 INFO:tasks.rados.rados.0.smithi166.stdout:1001: expect deleted 2020-11-16T20:57:19.969 INFO:tasks.rados.rados.0.smithi166.stdout:1002: copy_from oid 54 from oid 110 current snap is 39 2020-11-16T20:57:19.969 INFO:tasks.rados.rados.0.smithi166.stdout:1003: snap_remove snap 34 2020-11-16T20:57:19.970 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:57:19.948+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:57:20.045 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:20.049+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:20.145 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:20.149+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:20.168 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:57:20.194 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:20.194 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:57:20.194 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:57:20.194 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:57:20.194 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:20.197 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:57:20.207 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:57:20.221 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:57:20.246 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:20.250+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:20.246 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:57:20.270 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:57:20.295 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:57:20.322 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:57:20.347 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:20.351+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:20.361 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:57:20.363 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:57:20.363 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:57:20.364 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:57:20.364 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:57:20.364 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:57:20.364 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:57:20.364 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:57:20.364 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:57:20.391 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:20.391 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:20.401 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:57:20.447 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:20.452+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:20.479 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:57:20.479 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:20.480 INFO:teuthology.orchestra.run.smithi166.stdout: "epoch": 115, 2020-11-16T20:57:20.480 INFO:teuthology.orchestra.run.smithi166.stdout: "fsid": "a14fd848-4cfe-4cd9-9140-5b3c4b4e904d", 2020-11-16T20:57:20.480 INFO:teuthology.orchestra.run.smithi166.stdout: "created": "2020-11-16T20:54:44.938121+0000", 2020-11-16T20:57:20.480 INFO:teuthology.orchestra.run.smithi166.stdout: "modified": "2020-11-16T20:57:19.816955+0000", 2020-11-16T20:57:20.480 INFO:teuthology.orchestra.run.smithi166.stdout: "last_up_change": "2020-11-16T20:54:52.080163+0000", 2020-11-16T20:57:20.480 INFO:teuthology.orchestra.run.smithi166.stdout: "last_in_change": "2020-11-16T20:54:52.080163+0000", 2020-11-16T20:57:20.480 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-11-16T20:57:20.481 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_num": 5799936, 2020-11-16T20:57:20.481 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_set": [ 2020-11-16T20:57:20.481 INFO:teuthology.orchestra.run.smithi166.stdout: "pglog_hardlimit", 2020-11-16T20:57:20.481 INFO:teuthology.orchestra.run.smithi166.stdout: "purged_snapdirs", 2020-11-16T20:57:20.481 INFO:teuthology.orchestra.run.smithi166.stdout: "recovery_deletes", 2020-11-16T20:57:20.481 INFO:teuthology.orchestra.run.smithi166.stdout: "sortbitwise" 2020-11-16T20:57:20.481 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:20.482 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_version": 7, 2020-11-16T20:57:20.482 INFO:teuthology.orchestra.run.smithi166.stdout: "full_ratio": 0.94999998807907104, 2020-11-16T20:57:20.482 INFO:teuthology.orchestra.run.smithi166.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-11-16T20:57:20.482 INFO:teuthology.orchestra.run.smithi166.stdout: "nearfull_ratio": 0.85000002384185791, 2020-11-16T20:57:20.482 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_snapshot": "", 2020-11-16T20:57:20.482 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_max": 4, 2020-11-16T20:57:20.482 INFO:teuthology.orchestra.run.smithi166.stdout: "max_osd": 8, 2020-11-16T20:57:20.483 INFO:teuthology.orchestra.run.smithi166.stdout: "require_min_compat_client": "luminous", 2020-11-16T20:57:20.483 INFO:teuthology.orchestra.run.smithi166.stdout: "min_compat_client": "luminous", 2020-11-16T20:57:20.483 INFO:teuthology.orchestra.run.smithi166.stdout: "require_osd_release": "pacific", 2020-11-16T20:57:20.483 INFO:teuthology.orchestra.run.smithi166.stdout: "pools": [ 2020-11-16T20:57:20.483 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.483 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 1, 2020-11-16T20:57:20.483 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "device_health_metrics", 2020-11-16T20:57:20.483 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:54:49.109999+0000", 2020-11-16T20:57:20.484 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 1, 2020-11-16T20:57:20.484 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool", 2020-11-16T20:57:20.484 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:57:20.484 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:57:20.484 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:57:20.484 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:57:20.484 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:57:20.485 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:57:20.485 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:57:20.485 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:57:20.485 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:57:20.485 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:57:20.485 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 1, 2020-11-16T20:57:20.485 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 1, 2020-11-16T20:57:20.486 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 1, 2020-11-16T20:57:20.486 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 1, 2020-11-16T20:57:20.486 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 1, 2020-11-16T20:57:20.486 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:57:20.486 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:57:20.486 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:57:20.486 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:57:20.487 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:57:20.487 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:57:20.487 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:57:20.487 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.487 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "15", 2020-11-16T20:57:20.487 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "0", 2020-11-16T20:57:20.487 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-16T20:57:20.487 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "0", 2020-11-16T20:57:20.488 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:57:20.488 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:57:20.488 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 0, 2020-11-16T20:57:20.488 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 0, 2020-11-16T20:57:20.488 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:57:20.488 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:57:20.488 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:57:20.489 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:57:20.489 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:57:20.489 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:57:20.489 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:57:20.489 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:57:20.489 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:57:20.489 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:57:20.489 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:57:20.490 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:57:20.490 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:57:20.490 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:57:20.490 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:57:20.490 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:57:20.490 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:57:20.490 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:57:20.491 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:57:20.491 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.491 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:57:20.491 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:57:20.491 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:57:20.491 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:57:20.491 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:57:20.492 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:57:20.492 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:57:20.492 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:57:20.492 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:57:20.492 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:57:20.492 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:57:20.492 INFO:teuthology.orchestra.run.smithi166.stdout: "options": { 2020-11-16T20:57:20.492 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_min": 1 2020-11-16T20:57:20.493 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.493 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:57:20.493 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_devicehealth": {} 2020-11-16T20:57:20.493 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.493 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.493 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.493 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 2, 2020-11-16T20:57:20.494 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "rbd", 2020-11-16T20:57:20.494 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:54:53.253680+0000", 2020-11-16T20:57:20.494 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 1, 2020-11-16T20:57:20.494 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool", 2020-11-16T20:57:20.494 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:57:20.494 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:57:20.494 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:57:20.494 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:57:20.495 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:57:20.495 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:57:20.495 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:57:20.495 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:57:20.495 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:57:20.495 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:57:20.495 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 18, 2020-11-16T20:57:20.496 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 18, 2020-11-16T20:57:20.496 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 18, 2020-11-16T20:57:20.496 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 18, 2020-11-16T20:57:20.496 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 18, 2020-11-16T20:57:20.496 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:57:20.496 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:57:20.496 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:57:20.497 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:57:20.497 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:57:20.497 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:57:20.497 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:57:20.497 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.497 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "34", 2020-11-16T20:57:20.497 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "0", 2020-11-16T20:57:20.497 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-16T20:57:20.498 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "32", 2020-11-16T20:57:20.498 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:57:20.498 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:57:20.498 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 0, 2020-11-16T20:57:20.498 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 0, 2020-11-16T20:57:20.498 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:57:20.498 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:57:20.499 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:57:20.499 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:57:20.499 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:57:20.499 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:57:20.499 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:57:20.499 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:57:20.499 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:57:20.499 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:57:20.500 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:57:20.500 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:57:20.500 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:57:20.500 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:57:20.500 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:57:20.500 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:57:20.500 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:57:20.501 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:57:20.501 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:57:20.501 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.501 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:57:20.501 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:57:20.501 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:57:20.501 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:57:20.501 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:57:20.502 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:57:20.502 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:57:20.502 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:57:20.502 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:57:20.502 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:57:20.502 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:57:20.502 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:57:20.503 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:57:20.503 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd": {} 2020-11-16T20:57:20.503 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.503 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.503 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.503 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 3, 2020-11-16T20:57:20.503 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "base", 2020-11-16T20:57:20.504 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:55:23.597952+0000", 2020-11-16T20:57:20.504 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 8193, 2020-11-16T20:57:20.504 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2020-11-16T20:57:20.504 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:57:20.504 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:57:20.504 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:57:20.504 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:57:20.504 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:57:20.505 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:57:20.505 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:57:20.505 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:57:20.505 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:57:20.505 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:57:20.505 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 4, 2020-11-16T20:57:20.505 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 4, 2020-11-16T20:57:20.506 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 4, 2020-11-16T20:57:20.506 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 4, 2020-11-16T20:57:20.506 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 4, 2020-11-16T20:57:20.506 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:57:20.506 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:57:20.506 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:57:20.506 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:57:20.506 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:57:20.507 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:57:20.507 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:57:20.507 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.507 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "115", 2020-11-16T20:57:20.507 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "27", 2020-11-16T20:57:20.507 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "27", 2020-11-16T20:57:20.507 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "27", 2020-11-16T20:57:20.508 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:57:20.508 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:57:20.508 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 74, 2020-11-16T20:57:20.508 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 115, 2020-11-16T20:57:20.508 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:57:20.508 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:57:20.508 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:57:20.508 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:57:20.509 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [ 2020-11-16T20:57:20.509 INFO:teuthology.orchestra.run.smithi166.stdout: 4 2020-11-16T20:57:20.509 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:20.509 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:57:20.509 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": 4, 2020-11-16T20:57:20.509 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": 4, 2020-11-16T20:57:20.509 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:57:20.510 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:57:20.510 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:57:20.510 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:57:20.510 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:57:20.510 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:57:20.510 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:57:20.510 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:57:20.511 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:57:20.511 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:57:20.511 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:57:20.511 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.511 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:57:20.511 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:57:20.511 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:57:20.511 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:57:20.512 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:57:20.512 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:57:20.512 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:57:20.512 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:57:20.512 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:57:20.512 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:57:20.513 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:57:20.513 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:57:20.513 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:57:20.513 INFO:teuthology.orchestra.run.smithi166.stdout: "rados": {} 2020-11-16T20:57:20.513 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.513 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.513 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.513 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 4, 2020-11-16T20:57:20.514 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "cache", 2020-11-16T20:57:20.514 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:55:28.901773+0000", 2020-11-16T20:57:20.514 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 8201, 2020-11-16T20:57:20.514 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool,incomplete_clones,selfmanaged_snaps", 2020-11-16T20:57:20.514 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:57:20.514 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:57:20.514 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:57:20.515 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:57:20.515 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:57:20.515 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:57:20.515 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:57:20.515 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:57:20.515 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:57:20.515 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:57:20.515 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 4, 2020-11-16T20:57:20.516 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 4, 2020-11-16T20:57:20.516 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 4, 2020-11-16T20:57:20.516 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 4, 2020-11-16T20:57:20.516 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 4, 2020-11-16T20:57:20.516 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:57:20.516 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:57:20.516 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:57:20.517 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:57:20.517 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:57:20.517 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:57:20.517 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:57:20.517 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.517 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "115", 2020-11-16T20:57:20.517 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "27", 2020-11-16T20:57:20.517 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "27", 2020-11-16T20:57:20.518 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "27", 2020-11-16T20:57:20.518 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:57:20.518 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:57:20.518 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 74, 2020-11-16T20:57:20.518 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 115, 2020-11-16T20:57:20.518 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:57:20.518 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:57:20.519 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:57:20.519 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:57:20.519 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:57:20.519 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": 3, 2020-11-16T20:57:20.519 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:57:20.519 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:57:20.519 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "writeback", 2020-11-16T20:57:20.519 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:57:20.520 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 250, 2020-11-16T20:57:20.520 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:57:20.520 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:57:20.520 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:57:20.520 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:57:20.520 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:57:20.520 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:57:20.521 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:57:20.521 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "bloom", 2020-11-16T20:57:20.521 INFO:teuthology.orchestra.run.smithi166.stdout: "false_positive_probability": 0.050000000000000003, 2020-11-16T20:57:20.521 INFO:teuthology.orchestra.run.smithi166.stdout: "target_size": 0, 2020-11-16T20:57:20.521 INFO:teuthology.orchestra.run.smithi166.stdout: "seed": 0 2020-11-16T20:57:20.521 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.521 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 3600, 2020-11-16T20:57:20.522 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 8, 2020-11-16T20:57:20.522 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:57:20.522 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 2, 2020-11-16T20:57:20.522 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:57:20.522 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:57:20.522 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:57:20.522 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [ 2020-11-16T20:57:20.522 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:57:20.523 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:57:20.523 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:57:20.523 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:57:20.523 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:57:20.523 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:57:20.523 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:57:20.523 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000 2020-11-16T20:57:20.524 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:20.524 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:57:20.524 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:57:20.524 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:57:20.524 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:57:20.524 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": {} 2020-11-16T20:57:20.524 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.525 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:20.525 INFO:teuthology.orchestra.run.smithi166.stdout: "osds": [ 2020-11-16T20:57:20.525 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.525 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 0, 2020-11-16T20:57:20.525 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "35950122-efbd-420e-b07a-f5730f26df17", 2020-11-16T20:57:20.525 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:57:20.525 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:57:20.526 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:57:20.526 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:57:20.526 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:57:20.526 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:57:20.526 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:57:20.526 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 95, 2020-11-16T20:57:20.526 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:57:20.526 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:57:20.527 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:57:20.527 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.527 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.527 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.527 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6800", 2020-11-16T20:57:20.527 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:57:20.527 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.528 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.528 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.528 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:57:20.528 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.528 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.528 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.528 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6802", 2020-11-16T20:57:20.529 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:57:20.529 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.529 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.529 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.529 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:57:20.529 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.529 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.529 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.530 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6806", 2020-11-16T20:57:20.530 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:57:20.530 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.530 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.530 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.530 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:57:20.530 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.531 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.531 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.531 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6804", 2020-11-16T20:57:20.531 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:57:20.531 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.531 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.531 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.532 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6800/35293", 2020-11-16T20:57:20.532 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6802/35293", 2020-11-16T20:57:20.532 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6806/35293", 2020-11-16T20:57:20.532 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6804/35293", 2020-11-16T20:57:20.532 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:57:20.532 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:57:20.532 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:57:20.532 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.533 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.533 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.533 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 1, 2020-11-16T20:57:20.533 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "f768a1ff-3e8a-4131-a6ed-10f93b3ca900", 2020-11-16T20:57:20.533 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:57:20.533 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:57:20.533 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:57:20.533 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:57:20.534 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:57:20.534 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:57:20.534 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:57:20.534 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 114, 2020-11-16T20:57:20.534 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:57:20.534 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:57:20.534 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:57:20.535 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.535 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.535 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.535 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6808", 2020-11-16T20:57:20.535 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:57:20.535 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.535 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.536 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.536 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:57:20.536 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.536 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.536 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.536 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6809", 2020-11-16T20:57:20.536 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:57:20.536 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.537 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.537 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.537 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:57:20.537 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.537 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.537 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.537 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6811", 2020-11-16T20:57:20.537 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:57:20.538 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.538 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.538 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.538 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:57:20.538 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.538 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.538 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.539 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6810", 2020-11-16T20:57:20.539 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:57:20.539 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.539 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.539 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.539 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6808/35323", 2020-11-16T20:57:20.539 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6809/35323", 2020-11-16T20:57:20.540 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6811/35323", 2020-11-16T20:57:20.540 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6810/35323", 2020-11-16T20:57:20.540 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:57:20.540 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:57:20.540 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:57:20.540 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.540 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.540 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.541 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 2, 2020-11-16T20:57:20.541 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "88734179-84a6-4a9b-8af0-692805815875", 2020-11-16T20:57:20.541 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:57:20.541 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:57:20.541 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:57:20.541 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:57:20.541 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:57:20.542 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:57:20.542 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:57:20.542 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 113, 2020-11-16T20:57:20.542 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:57:20.542 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:57:20.542 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:57:20.542 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.542 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.543 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.543 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6801", 2020-11-16T20:57:20.543 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:57:20.543 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.543 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.543 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.543 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:57:20.544 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.544 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.544 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.544 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6803", 2020-11-16T20:57:20.544 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:57:20.544 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.544 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.544 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.545 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:57:20.545 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.545 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.545 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.545 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6807", 2020-11-16T20:57:20.545 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:57:20.545 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.546 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.546 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.546 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:57:20.546 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.546 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.546 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.546 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6805", 2020-11-16T20:57:20.547 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:57:20.547 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.547 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.547 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.547 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6801/35294", 2020-11-16T20:57:20.547 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6803/35294", 2020-11-16T20:57:20.547 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6807/35294", 2020-11-16T20:57:20.547 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6805/35294", 2020-11-16T20:57:20.548 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:57:20.548 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:57:20.548 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:57:20.548 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.548 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.548 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.548 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 3, 2020-11-16T20:57:20.549 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "319e54e8-3f03-4388-8de6-678d148e25d4", 2020-11-16T20:57:20.549 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:57:20.549 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:57:20.549 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:57:20.549 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:57:20.549 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:57:20.549 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:57:20.549 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:57:20.550 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 22, 2020-11-16T20:57:20.550 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:57:20.550 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:57:20.550 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:57:20.550 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.550 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.550 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.551 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6812", 2020-11-16T20:57:20.551 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:57:20.551 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.551 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.551 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.551 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:57:20.551 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.551 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.552 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.552 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6813", 2020-11-16T20:57:20.552 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:57:20.552 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.552 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.552 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.552 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:57:20.553 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.553 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.553 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.553 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6815", 2020-11-16T20:57:20.553 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:57:20.553 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.553 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.553 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.554 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:57:20.554 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.554 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.554 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.554 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6814", 2020-11-16T20:57:20.554 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:57:20.554 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.555 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.555 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.555 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6812/35324", 2020-11-16T20:57:20.555 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6813/35324", 2020-11-16T20:57:20.555 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6815/35324", 2020-11-16T20:57:20.555 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6814/35324", 2020-11-16T20:57:20.555 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:57:20.555 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:57:20.556 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:57:20.556 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.556 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.556 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.556 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 4, 2020-11-16T20:57:20.556 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "3edbb68e-e030-4379-891e-2412f1235ffb", 2020-11-16T20:57:20.556 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:57:20.557 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:57:20.557 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:57:20.557 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:57:20.557 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:57:20.557 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:57:20.557 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:57:20.557 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 63, 2020-11-16T20:57:20.557 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:57:20.558 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:57:20.558 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:57:20.558 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.558 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.558 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.558 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6804", 2020-11-16T20:57:20.558 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:57:20.559 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.559 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.559 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.559 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:57:20.559 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.559 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.559 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.560 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6805", 2020-11-16T20:57:20.560 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:57:20.560 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.560 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.560 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.560 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:57:20.560 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.560 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.561 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.561 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6807", 2020-11-16T20:57:20.561 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:57:20.561 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.561 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.561 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.561 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:57:20.562 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.562 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.562 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.562 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6806", 2020-11-16T20:57:20.562 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:57:20.562 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.562 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.562 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.563 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6804/31586", 2020-11-16T20:57:20.563 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6805/31586", 2020-11-16T20:57:20.563 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6807/31586", 2020-11-16T20:57:20.563 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6806/31586", 2020-11-16T20:57:20.563 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:57:20.563 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:57:20.563 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:57:20.564 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.564 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.564 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.564 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 5, 2020-11-16T20:57:20.564 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "44fbf5ac-4484-48a8-a846-1f5c01a6ec2c", 2020-11-16T20:57:20.564 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:57:20.564 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:57:20.564 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:57:20.565 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:57:20.565 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:57:20.565 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:57:20.565 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:57:20.565 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 63, 2020-11-16T20:57:20.565 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:57:20.565 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:57:20.566 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:57:20.566 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.566 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.566 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.566 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6808", 2020-11-16T20:57:20.566 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:57:20.566 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.566 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.567 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.567 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:57:20.567 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.567 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.567 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.567 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6810", 2020-11-16T20:57:20.567 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:57:20.568 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.568 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.568 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.568 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:57:20.568 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.568 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.568 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.568 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6813", 2020-11-16T20:57:20.569 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:57:20.569 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.569 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.569 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.569 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:57:20.569 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.569 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.569 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.570 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6812", 2020-11-16T20:57:20.570 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:57:20.570 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.570 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.570 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.570 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6808/31610", 2020-11-16T20:57:20.570 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6810/31610", 2020-11-16T20:57:20.571 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6813/31610", 2020-11-16T20:57:20.571 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6812/31610", 2020-11-16T20:57:20.571 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:57:20.571 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:57:20.571 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:57:20.571 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.571 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.572 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.572 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 6, 2020-11-16T20:57:20.572 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "f93b82df-f537-4601-8247-388bf100b5b5", 2020-11-16T20:57:20.572 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:57:20.572 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:57:20.572 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 0.592620849609375, 2020-11-16T20:57:20.572 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:57:20.572 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:57:20.573 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:57:20.573 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:57:20.573 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 34, 2020-11-16T20:57:20.573 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:57:20.573 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:57:20.573 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:57:20.573 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.574 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.574 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.574 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6800", 2020-11-16T20:57:20.574 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:57:20.574 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.574 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.574 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.574 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:57:20.575 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.575 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.575 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.575 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6801", 2020-11-16T20:57:20.575 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:57:20.575 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.575 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.576 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.576 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:57:20.576 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.576 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.576 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.576 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6803", 2020-11-16T20:57:20.576 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:57:20.576 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.577 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.577 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.577 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:57:20.577 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.577 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.577 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.577 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6802", 2020-11-16T20:57:20.578 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:57:20.578 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.578 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.578 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.578 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6800/31587", 2020-11-16T20:57:20.578 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6801/31587", 2020-11-16T20:57:20.578 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6803/31587", 2020-11-16T20:57:20.579 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6802/31587", 2020-11-16T20:57:20.579 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:57:20.579 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:57:20.579 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:57:20.579 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.579 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.579 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.579 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 7, 2020-11-16T20:57:20.580 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "e5485c88-d267-4a6a-b9b6-15d869d28f28", 2020-11-16T20:57:20.580 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:57:20.580 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:57:20.580 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:57:20.580 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:57:20.580 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:57:20.580 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:57:20.581 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:57:20.581 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 34, 2020-11-16T20:57:20.581 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:57:20.581 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:57:20.581 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:57:20.581 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.581 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.582 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.582 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6809", 2020-11-16T20:57:20.582 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:57:20.582 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.582 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.582 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.582 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:57:20.583 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.583 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.583 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.583 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6811", 2020-11-16T20:57:20.583 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:57:20.583 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.583 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.583 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.584 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:57:20.584 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.584 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.584 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.584 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6815", 2020-11-16T20:57:20.584 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:57:20.584 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.585 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.585 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.585 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:57:20.585 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:20.585 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.585 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:20.585 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6814", 2020-11-16T20:57:20.585 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:57:20.586 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.586 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.586 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.586 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6809/31617", 2020-11-16T20:57:20.586 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6811/31617", 2020-11-16T20:57:20.586 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6815/31617", 2020-11-16T20:57:20.586 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6814/31617", 2020-11-16T20:57:20.587 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:57:20.587 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:57:20.587 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:57:20.587 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.587 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.587 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:20.587 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_xinfo": [ 2020-11-16T20:57:20.587 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.588 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 0, 2020-11-16T20:57:20.588 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:57:20.588 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:57:20.588 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:57:20.588 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:57:20.588 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:57:20.588 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:50.907461+0000", 2020-11-16T20:57:20.589 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:57:20.589 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.589 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.589 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 1, 2020-11-16T20:57:20.589 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:57:20.589 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:57:20.589 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:57:20.589 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:57:20.590 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:57:20.590 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:50.563693+0000", 2020-11-16T20:57:20.590 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:57:20.590 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.590 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.590 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 2, 2020-11-16T20:57:20.590 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:57:20.591 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:57:20.591 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:57:20.591 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:57:20.591 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:57:20.591 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:50.630147+0000", 2020-11-16T20:57:20.591 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:57:20.591 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.592 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.592 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 3, 2020-11-16T20:57:20.592 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:57:20.592 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:57:20.592 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:57:20.592 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:57:20.592 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:57:20.592 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:51.401993+0000", 2020-11-16T20:57:20.593 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:57:20.593 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.593 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.593 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 4, 2020-11-16T20:57:20.593 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:57:20.593 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:57:20.593 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:57:20.594 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:57:20.594 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:57:20.594 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:50.833464+0000", 2020-11-16T20:57:20.594 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:57:20.594 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.594 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.594 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 5, 2020-11-16T20:57:20.594 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:57:20.595 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:57:20.595 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:57:20.595 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:57:20.595 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:57:20.595 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:52.120480+0000", 2020-11-16T20:57:20.595 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:57:20.595 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.596 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.596 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 6, 2020-11-16T20:57:20.596 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:57:20.596 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:57:20.596 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:57:20.596 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:57:20.596 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:57:20.597 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:51.579262+0000", 2020-11-16T20:57:20.597 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:57:20.597 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.597 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.597 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 7, 2020-11-16T20:57:20.597 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:57:20.597 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:57:20.597 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:57:20.598 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:57:20.598 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:57:20.598 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:50.854798+0000", 2020-11-16T20:57:20.598 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:57:20.598 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.598 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:20.598 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_upmap": [ 2020-11-16T20:57:20.599 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.599 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "4.0", 2020-11-16T20:57:20.599 INFO:teuthology.orchestra.run.smithi166.stdout: "osds": [ 2020-11-16T20:57:20.599 INFO:teuthology.orchestra.run.smithi166.stdout: 2, 2020-11-16T20:57:20.599 INFO:teuthology.orchestra.run.smithi166.stdout: 1, 2020-11-16T20:57:20.599 INFO:teuthology.orchestra.run.smithi166.stdout: 0 2020-11-16T20:57:20.599 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.599 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.600 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:20.600 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_upmap_items": [ 2020-11-16T20:57:20.600 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.600 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "2.4", 2020-11-16T20:57:20.600 INFO:teuthology.orchestra.run.smithi166.stdout: "mappings": [ 2020-11-16T20:57:20.600 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.600 INFO:teuthology.orchestra.run.smithi166.stdout: "from": 7, 2020-11-16T20:57:20.601 INFO:teuthology.orchestra.run.smithi166.stdout: "to": 1 2020-11-16T20:57:20.601 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.601 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.601 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.601 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.601 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "4.1", 2020-11-16T20:57:20.601 INFO:teuthology.orchestra.run.smithi166.stdout: "mappings": [ 2020-11-16T20:57:20.601 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.602 INFO:teuthology.orchestra.run.smithi166.stdout: "from": 5, 2020-11-16T20:57:20.602 INFO:teuthology.orchestra.run.smithi166.stdout: "to": 3 2020-11-16T20:57:20.602 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.602 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.602 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.602 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.602 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "4.3", 2020-11-16T20:57:20.602 INFO:teuthology.orchestra.run.smithi166.stdout: "mappings": [ 2020-11-16T20:57:20.603 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.603 INFO:teuthology.orchestra.run.smithi166.stdout: "from": 5, 2020-11-16T20:57:20.603 INFO:teuthology.orchestra.run.smithi166.stdout: "to": 7 2020-11-16T20:57:20.603 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.603 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.603 INFO:teuthology.orchestra.run.smithi166.stdout: "from": 0, 2020-11-16T20:57:20.603 INFO:teuthology.orchestra.run.smithi166.stdout: "to": 1 2020-11-16T20:57:20.604 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.604 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.604 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.604 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:20.604 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_temp": [ 2020-11-16T20:57:20.604 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.604 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "3.0", 2020-11-16T20:57:20.604 INFO:teuthology.orchestra.run.smithi166.stdout: "osds": [ 2020-11-16T20:57:20.605 INFO:teuthology.orchestra.run.smithi166.stdout: 1, 2020-11-16T20:57:20.605 INFO:teuthology.orchestra.run.smithi166.stdout: 2 2020-11-16T20:57:20.605 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.605 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.605 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:20.605 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_temp": [], 2020-11-16T20:57:20.605 INFO:teuthology.orchestra.run.smithi166.stdout: "blocklist": {}, 2020-11-16T20:57:20.606 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profiles": { 2020-11-16T20:57:20.606 INFO:teuthology.orchestra.run.smithi166.stdout: "default": { 2020-11-16T20:57:20.606 INFO:teuthology.orchestra.run.smithi166.stdout: "crush-failure-domain": "osd", 2020-11-16T20:57:20.606 INFO:teuthology.orchestra.run.smithi166.stdout: "k": "2", 2020-11-16T20:57:20.606 INFO:teuthology.orchestra.run.smithi166.stdout: "m": "1", 2020-11-16T20:57:20.606 INFO:teuthology.orchestra.run.smithi166.stdout: "plugin": "jerasure", 2020-11-16T20:57:20.606 INFO:teuthology.orchestra.run.smithi166.stdout: "ruleset-failure-domain": "osd", 2020-11-16T20:57:20.606 INFO:teuthology.orchestra.run.smithi166.stdout: "technique": "reed_sol_van" 2020-11-16T20:57:20.607 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.607 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.607 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps_queue": [ 2020-11-16T20:57:20.607 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.607 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 3, 2020-11-16T20:57:20.607 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:57:20.607 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.607 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 61, 2020-11-16T20:57:20.608 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:57:20.608 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.608 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.608 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 63, 2020-11-16T20:57:20.608 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:57:20.608 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.609 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.609 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 66, 2020-11-16T20:57:20.609 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:57:20.609 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.609 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.609 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 69, 2020-11-16T20:57:20.609 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:57:20.609 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.610 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.610 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.610 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.610 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 4, 2020-11-16T20:57:20.610 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:57:20.610 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.610 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 61, 2020-11-16T20:57:20.611 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:57:20.611 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.611 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.611 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 66, 2020-11-16T20:57:20.611 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:57:20.611 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:20.611 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:20.611 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 69, 2020-11-16T20:57:20.612 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:57:20.612 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.612 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:20.612 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.612 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:20.612 INFO:teuthology.orchestra.run.smithi166.stdout: "new_removed_snaps": [], 2020-11-16T20:57:20.612 INFO:teuthology.orchestra.run.smithi166.stdout: "new_purged_snaps": [], 2020-11-16T20:57:20.613 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_node_flags": {}, 2020-11-16T20:57:20.613 INFO:teuthology.orchestra.run.smithi166.stdout: "device_class_flags": {}, 2020-11-16T20:57:20.613 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode": { 2020-11-16T20:57:20.613 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode_enabled": false, 2020-11-16T20:57:20.613 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_bucket_count": 0, 2020-11-16T20:57:20.613 INFO:teuthology.orchestra.run.smithi166.stdout: "degraded_stretch_mode": 0, 2020-11-16T20:57:20.613 INFO:teuthology.orchestra.run.smithi166.stdout: "recovering_stretch_mode": 0, 2020-11-16T20:57:20.613 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode_bucket": 0 2020-11-16T20:57:20.614 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:20.614 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:20.615 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:20.615 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:20.616 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:57:20.617 INFO:tasks.thrashosds.thrasher:j is {'epoch': 115, 'fsid': 'a14fd848-4cfe-4cd9-9140-5b3c4b4e904d', 'created': '2020-11-16T20:54:44.938121+0000', 'modified': '2020-11-16T20:57:19.816955+0000', 'last_up_change': '2020-11-16T20:54:52.080163+0000', 'last_in_change': '2020-11-16T20:54:52.080163+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 7, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-16T20:54:49.109999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-16T20:54:53.253680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 18, 'pg_placement_num': 18, 'pg_placement_num_target': 18, 'pg_num_target': 18, 'pg_num_pending': 18, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '32', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'base', 'create_time': '2020-11-16T20:55:23.597952+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 4, 'pg_placement_num': 4, 'pg_placement_num_target': 4, 'pg_num_target': 4, 'pg_num_pending': 4, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '27', 'last_force_op_resend_prenautilus': '27', 'last_force_op_resend_preluminous': '27', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 74, 'snap_epoch': 115, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [4], 'tier_of': -1, 'read_tier': 4, 'write_tier': 4, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 4, 'pool_name': 'cache', 'create_time': '2020-11-16T20:55:28.901773+0000', 'flags': 8201, 'flags_names': 'hashpspool,incomplete_clones,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 4, 'pg_placement_num': 4, 'pg_placement_num_target': 4, 'pg_num_target': 4, 'pg_num_pending': 4, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '27', 'last_force_op_resend_prenautilus': '27', 'last_force_op_resend_preluminous': '27', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 74, 'snap_epoch': 115, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': 3, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'writeback', 'target_max_bytes': 0, 'target_max_objects': 250, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'bloom', 'false_positive_probability': 0.05, 'target_size': 0, 'seed': 0}, 'hit_set_period': 3600, 'hit_set_count': 8, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 2, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [1000000, 1000000, 1000000, 1000000, 1000000, 1000000, 1000000, 1000000], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}}], 'osds': [{'osd': 0, 'uuid': '35950122-efbd-420e-b07a-f5730f26df17', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 95, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6800', 'nonce': 35293}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6802', 'nonce': 35293}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6806', 'nonce': 35293}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6804', 'nonce': 35293}]}, 'public_addr': '172.21.15.166:6800/35293', 'cluster_addr': '172.21.15.166:6802/35293', 'heartbeat_back_addr': '172.21.15.166:6806/35293', 'heartbeat_front_addr': '172.21.15.166:6804/35293', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f768a1ff-3e8a-4131-a6ed-10f93b3ca900', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 114, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6808', 'nonce': 35323}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6809', 'nonce': 35323}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6811', 'nonce': 35323}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6810', 'nonce': 35323}]}, 'public_addr': '172.21.15.166:6808/35323', 'cluster_addr': '172.21.15.166:6809/35323', 'heartbeat_back_addr': '172.21.15.166:6811/35323', 'heartbeat_front_addr': '172.21.15.166:6810/35323', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '88734179-84a6-4a9b-8af0-692805815875', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 113, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6801', 'nonce': 35294}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6803', 'nonce': 35294}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6807', 'nonce': 35294}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6805', 'nonce': 35294}]}, 'public_addr': '172.21.15.166:6801/35294', 'cluster_addr': '172.21.15.166:6803/35294', 'heartbeat_back_addr': '172.21.15.166:6807/35294', 'heartbeat_front_addr': '172.21.15.166:6805/35294', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '319e54e8-3f03-4388-8de6-678d148e25d4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6812', 'nonce': 35324}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6813', 'nonce': 35324}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6815', 'nonce': 35324}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6814', 'nonce': 35324}]}, 'public_addr': '172.21.15.166:6812/35324', 'cluster_addr': '172.21.15.166:6813/35324', 'heartbeat_back_addr': '172.21.15.166:6815/35324', 'heartbeat_front_addr': '172.21.15.166:6814/35324', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '3edbb68e-e030-4379-891e-2412f1235ffb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 63, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6804', 'nonce': 31586}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6805', 'nonce': 31586}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6807', 'nonce': 31586}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6806', 'nonce': 31586}]}, 'public_addr': '172.21.15.59:6804/31586', 'cluster_addr': '172.21.15.59:6805/31586', 'heartbeat_back_addr': '172.21.15.59:6807/31586', 'heartbeat_front_addr': '172.21.15.59:6806/31586', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '44fbf5ac-4484-48a8-a846-1f5c01a6ec2c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 63, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6808', 'nonce': 31610}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6810', 'nonce': 31610}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6813', 'nonce': 31610}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6812', 'nonce': 31610}]}, 'public_addr': '172.21.15.59:6808/31610', 'cluster_addr': '172.21.15.59:6810/31610', 'heartbeat_back_addr': '172.21.15.59:6813/31610', 'heartbeat_front_addr': '172.21.15.59:6812/31610', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'f93b82df-f537-4601-8247-388bf100b5b5', 'up': 1, 'in': 1, 'weight': 0.592620849609375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6800', 'nonce': 31587}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6801', 'nonce': 31587}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6803', 'nonce': 31587}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6802', 'nonce': 31587}]}, 'public_addr': '172.21.15.59:6800/31587', 'cluster_addr': '172.21.15.59:6801/31587', 'heartbeat_back_addr': '172.21.15.59:6803/31587', 'heartbeat_front_addr': '172.21.15.59:6802/31587', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'e5485c88-d267-4a6a-b9b6-15d869d28f28', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6809', 'nonce': 31617}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6811', 'nonce': 31617}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6815', 'nonce': 31617}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6814', 'nonce': 31617}]}, 'public_addr': '172.21.15.59:6809/31617', 'cluster_addr': '172.21.15.59:6811/31617', 'heartbeat_back_addr': '172.21.15.59:6815/31617', 'heartbeat_front_addr': '172.21.15.59:6814/31617', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:50.907461+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:50.563693+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:50.630147+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:51.401993+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:50.833464+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:52.120480+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:51.579262+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:50.854798+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '4.0', 'osds': [2, 1, 0]}], 'pg_upmap_items': [{'pgid': '2.4', 'mappings': [{'from': 7, 'to': 1}]}, {'pgid': '4.1', 'mappings': [{'from': 5, 'to': 3}]}, {'pgid': '4.3', 'mappings': [{'from': 5, 'to': 7}, {'from': 0, 'to': 1}]}], 'pg_temp': [{'pgid': '3.0', 'osds': [1, 2]}], 'primary_temp': [], 'blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 61, 'length': 1}, {'begin': 63, 'length': 1}, {'begin': 66, 'length': 1}, {'begin': 69, 'length': 1}]}, {'pool': 4, 'snaps': [{'begin': 61, 'length': 1}, {'begin': 66, 'length': 1}, {'begin': 69, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2020-11-16T20:57:20.617 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-16T20:57:20.618 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:20.620+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:20.715 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:20.720+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:20.791 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:20.791 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:20.800 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:57:20.826 INFO:tasks.rados.rados.0.smithi166.stdout:1003: done (6 left) 2020-11-16T20:57:20.826 INFO:tasks.rados.rados.0.smithi166.stdout:1004: snap_remove snap 38 2020-11-16T20:57:20.835 INFO:teuthology.orchestra.run.smithi166.stderr:noscrub is set 2020-11-16T20:57:20.841 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:20.846+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:20.916 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:20.921+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:20.925 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:57:20.927 INFO:teuthology.orchestra.run.smithi166.stderr:dumped all 2020-11-16T20:57:20.937 INFO:teuthology.orchestra.run.smithi166.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2020-11-16T20:57:20.828262+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1881086297,"num_objects":674,"num_object_clones":6,"num_object_copies":2022,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":578,"num_whiteouts":20,"num_read":2056,"num_read_kb":855097,"num_write":2994,"num_write_kb":1229973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":314,"num_bytes_recovered":512848008,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":122,"num_flush_kb":346790,"num_evict":51,"num_evict_kb":145019,"num_promote":256,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4277,"ondisk_log_size":4277,"up":81,"acting":81,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3971416,"kb_used_data":3838616,"kb_used_omap":0,"kb_used_meta":132736,"kb_avail":751003304,"statfs":{"total":773094113280,"available":769027383296,"internally_reserved":0,"allocated":3930742784,"data_stored":3921669434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":135921664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13595692,"num_objects":-10,"num_object_clones":-10,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-12,"num_whiteouts":1,"num_read":27,"num_read_kb":25333,"num_write":8,"num_write_kb":9981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":3,"num_flush_kb":7797,"num_evict":0,"num_evict_kb":0,"num_promote":2,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.077614"},"pg_stats":[{"pgid":"2.11","version":"0'0","reported_seq":"62","reported_epoch":"111","state":"active+clean","last_fresh":"2020-11-16T20:57:15.751486+0000","last_change":"2020-11-16T20:56:30.376104+0000","last_active":"2020-11-16T20:57:15.751486+0000","last_peered":"2020-11-16T20:57:15.751486+0000","last_clean":"2020-11-16T20:57:15.751486+0000","last_became_active":"2020-11-16T20:56:26.743063+0000","last_became_peered":"2020-11-16T20:56:26.743063+0000","last_unstale":"2020-11-16T20:57:15.751486+0000","last_undegraded":"2020-11-16T20:57:15.751486+0000","last_fullsized":"2020-11-16T20:57:15.751486+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:30.376014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:30.376014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"89","reported_epoch":"111","state":"active+clean","last_fresh":"2020-11-16T20:57:15.747440+0000","last_change":"2020-11-16T20:55:59.416734+0000","last_active":"2020-11-16T20:57:15.747440+0000","last_peered":"2020-11-16T20:57:15.747440+0000","last_clean":"2020-11-16T20:57:15.747440+0000","last_became_active":"2020-11-16T20:55:52.921860+0000","last_became_peered":"2020-11-16T20:55:52.921860+0000","last_unstale":"2020-11-16T20:57:15.747440+0000","last_undegraded":"2020-11-16T20:57:15.747440+0000","last_fullsized":"2020-11-16T20:57:15.747440+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.416654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.416654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":"88","reported_epoch":"111","state":"active+clean","last_fresh":"2020-11-16T20:57:15.751434+0000","last_change":"2020-11-16T20:55:56.438524+0000","last_active":"2020-11-16T20:57:15.751434+0000","last_peered":"2020-11-16T20:57:15.751434+0000","last_clean":"2020-11-16T20:57:15.751434+0000","last_became_active":"2020-11-16T20:55:52.922023+0000","last_became_peered":"2020-11-16T20:55:52.922023+0000","last_unstale":"2020-11-16T20:57:15.751434+0000","last_undegraded":"2020-11-16T20:57:15.751434+0000","last_fullsized":"2020-11-16T20:57:15.751434+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:56.438428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:56.438428+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":"23","reported_epoch":"111","state":"active+clean","last_fresh":"2020-11-16T20:57:15.747653+0000","last_change":"2020-11-16T20:57:13.756286+0000","last_active":"2020-11-16T20:57:15.747653+0000","last_peered":"2020-11-16T20:57:15.747653+0000","last_clean":"2020-11-16T20:57:15.747653+0000","last_became_active":"2020-11-16T20:57:06.893046+0000","last_became_peered":"2020-11-16T20:57:06.893046+0000","last_unstale":"2020-11-16T20:57:15.747653+0000","last_undegraded":"2020-11-16T20:57:15.747653+0000","last_fullsized":"2020-11-16T20:57:15.747653+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:13.756223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:13.756223+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"90","reported_epoch":"111","state":"active+clean","last_fresh":"2020-11-16T20:57:15.752169+0000","last_change":"2020-11-16T20:56:11.940489+0000","last_active":"2020-11-16T20:57:15.752169+0000","last_peered":"2020-11-16T20:57:15.752169+0000","last_clean":"2020-11-16T20:57:15.752169+0000","last_became_active":"2020-11-16T20:55:52.922134+0000","last_became_peered":"2020-11-16T20:55:52.922134+0000","last_unstale":"2020-11-16T20:57:15.752169+0000","last_undegraded":"2020-11-16T20:57:15.752169+0000","last_fullsized":"2020-11-16T20:57:15.752169+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:11.940423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:11.940423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"89","reported_epoch":"111","state":"active+clean","last_fresh":"2020-11-16T20:57:15.747539+0000","last_change":"2020-11-16T20:56:02.387946+0000","last_active":"2020-11-16T20:57:15.747539+0000","last_peered":"2020-11-16T20:57:15.747539+0000","last_clean":"2020-11-16T20:57:15.747539+0000","last_became_active":"2020-11-16T20:55:52.920496+0000","last_became_peered":"2020-11-16T20:55:52.920496+0000","last_unstale":"2020-11-16T20:57:15.747539+0000","last_undegraded":"2020-11-16T20:57:15.747539+0000","last_fullsized":"2020-11-16T20:57:15.747539+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:02.387861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:02.387861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"116","reported_epoch":"111","state":"active+clean","last_fresh":"2020-11-16T20:57:15.791908+0000","last_change":"2020-11-16T20:56:02.565668+0000","last_active":"2020-11-16T20:57:15.791908+0000","last_peered":"2020-11-16T20:57:15.791908+0000","last_clean":"2020-11-16T20:57:15.791908+0000","last_became_active":"2020-11-16T20:55:52.917496+0000","last_became_peered":"2020-11-16T20:55:52.917496+0000","last_unstale":"2020-11-16T20:57:15.791908+0000","last_undegraded":"2020-11-16T20:57:15.791908+0000","last_fullsized":"2020-11-16T20:57:15.791908+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:02.565607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:56:02.565607+0000","last_clean_scrub_stamp":"2020-11-16T20:56:02.565607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"116","reported_epoch":"111","state":"active+clean","last_fresh":"2020-11-16T20:57:15.751536+0000","last_change":"2020-11-16T20:56:01.955760+0000","last_active":"2020-11-16T20:57:15.751536+0000","last_peered":"2020-11-16T20:57:15.751536+0000","last_clean":"2020-11-16T20:57:15.751536+0000","last_became_active":"2020-11-16T20:55:52.922447+0000","last_became_peered":"2020-11-16T20:55:52.922447+0000","last_unstale":"2020-11-16T20:57:15.751536+0000","last_undegraded":"2020-11-16T20:57:15.751536+0000","last_fullsized":"2020-11-16T20:57:15.751536+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:01.955691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:01.955691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"99","reported_epoch":"111","state":"active+clean","last_fresh":"2020-11-16T20:57:15.751540+0000","last_change":"2020-11-16T20:56:18.755476+0000","last_active":"2020-11-16T20:57:15.751540+0000","last_peered":"2020-11-16T20:57:15.751540+0000","last_clean":"2020-11-16T20:57:15.751540+0000","last_became_active":"2020-11-16T20:56:18.754989+0000","last_became_peered":"2020-11-16T20:56:18.754989+0000","last_unstale":"2020-11-16T20:57:15.751540+0000","last_undegraded":"2020-11-16T20:57:15.751540+0000","last_fullsized":"2020-11-16T20:57:15.751540+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:00.967553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:00.967553+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"128","reported_epoch":"111","state":"active+clean","last_fresh":"2020-11-16T20:57:15.791763+0000","last_change":"2020-11-16T20:57:11.459260+0000","last_active":"2020-11-16T20:57:15.791763+0000","last_peered":"2020-11-16T20:57:15.791763+0000","last_clean":"2020-11-16T20:57:15.791763+0000","last_became_active":"2020-11-16T20:55:52.922303+0000","last_became_peered":"2020-11-16T20:55:52.922303+0000","last_unstale":"2020-11-16T20:57:15.791763+0000","last_undegraded":"2020-11-16T20:57:15.791763+0000","last_fullsized":"2020-11-16T20:57:15.791763+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:11.459190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:11.459190+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"116","reported_epoch":"111","state":"active+clean","last_fresh":"2020-11-16T20:57:15.751557+0000","last_change":"2020-11-16T20:55:57.905062+0000","last_active":"2020-11-16T20:57:15.751557+0000","last_peered":"2020-11-16T20:57:15.751557+0000","last_clean":"2020-11-16T20:57:15.751557+0000","last_became_active":"2020-11-16T20:55:50.904146+0000","last_became_peered":"2020-11-16T20:55:50.904146+0000","last_unstale":"2020-11-16T20:57:15.751557+0000","last_undegraded":"2020-11-16T20:57:15.751557+0000","last_fullsized":"2020-11-16T20:57:15.751557+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:57.905004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:57.905004+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"112'378","reported_seq":"687","reported_epoch":"112","state":"active+clean","last_fresh":"2020-11-16T20:57:16.803827+0000","last_change":"2020-11-16T20:57:16.804053+0000","last_active":"2020-11-16T20:57:16.803827+0000","last_peered":"2020-11-16T20:57:16.803827+0000","last_clean":"2020-11-16T20:57:16.803827+0000","last_became_active":"2020-11-16T20:55:30.828637+0000","last_became_peered":"2020-11-16T20:55:30.828637+0000","last_unstale":"2020-11-16T20:57:16.803827+0000","last_undegraded":"2020-11-16T20:57:16.803827+0000","last_fullsized":"2020-11-16T20:57:16.803827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":378,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109583158,"num_objects":46,"num_object_clones":1,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":7,"num_read":85,"num_read_kb":34187,"num_write":186,"num_write_kb":30655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":34,"num_flush_kb":91715,"num_evict":6,"num_evict_kb":13724,"num_promote":59,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3d","length":"1"},{"start":"42","length":"1"},{"start":"45","length":"1"}]},{"pgid":"2.2","version":"0'0","reported_seq":"126","reported_epoch":"112","state":"active+clean","last_fresh":"2020-11-16T20:57:16.802841+0000","last_change":"2020-11-16T20:56:26.743666+0000","last_active":"2020-11-16T20:57:16.802841+0000","last_peered":"2020-11-16T20:57:16.802841+0000","last_clean":"2020-11-16T20:57:16.802841+0000","last_became_active":"2020-11-16T20:56:26.743184+0000","last_became_peered":"2020-11-16T20:56:26.743184+0000","last_unstale":"2020-11-16T20:57:16.802841+0000","last_undegraded":"2020-11-16T20:57:16.802841+0000","last_fullsized":"2020-11-16T20:57:16.802841+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:57.606500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:57.606500+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"111'720","reported_seq":"1144","reported_epoch":"112","state":"active+clean","last_fresh":"2020-11-16T20:57:16.756032+0000","last_change":"2020-11-16T20:57:16.756541+0000","last_active":"2020-11-16T20:57:16.756032+0000","last_peered":"2020-11-16T20:57:16.756032+0000","last_clean":"2020-11-16T20:57:16.756032+0000","last_became_active":"2020-11-16T20:55:25.103851+0000","last_became_peered":"2020-11-16T20:55:25.103851+0000","last_unstale":"2020-11-16T20:57:16.756032+0000","last_undegraded":"2020-11-16T20:57:16.756032+0000","last_fullsized":"2020-11-16T20:57:16.756032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'686","last_scrub_stamp":"2020-11-16T20:56:54.448375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:56:54.448375+0000","log_size":720,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":341412352,"num_objects":121,"num_object_clones":1,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":1,"num_read":388,"num_read_kb":108490,"num_write":554,"num_write_kb":271486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"42","length":"1"},{"start":"45","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":"115","reported_epoch":"111","state":"active+clean","last_fresh":"2020-11-16T20:57:15.747412+0000","last_change":"2020-11-16T20:55:58.465447+0000","last_active":"2020-11-16T20:57:15.747412+0000","last_peered":"2020-11-16T20:57:15.747412+0000","last_clean":"2020-11-16T20:57:15.747412+0000","last_became_active":"2020-11-16T20:55:50.905925+0000","last_became_peered":"2020-11-16T20:55:50.905925+0000","last_unstale":"2020-11-16T20:57:15.747412+0000","last_undegraded":"2020-11-16T20:57:15.747412+0000","last_fullsized":"2020-11-16T20:57:15.747412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:58.465384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:58.465384+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"108'645","reported_seq":"1332","reported_epoch":"112","state":"active+clean","last_fresh":"2020-11-16T20:57:16.799487+0000","last_change":"2020-11-16T20:57:16.799875+0000","last_active":"2020-11-16T20:57:16.799487+0000","last_peered":"2020-11-16T20:57:16.799487+0000","last_clean":"2020-11-16T20:57:16.799487+0000","last_became_active":"2020-11-16T20:56:29.739968+0000","last_became_peered":"2020-11-16T20:56:29.739968+0000","last_unstale":"2020-11-16T20:57:16.799487+0000","last_undegraded":"2020-11-16T20:57:16.799487+0000","last_fullsized":"2020-11-16T20:57:16.799487+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":645,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":325880340,"num_objects":113,"num_object_clones":1,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":333,"num_read_kb":88225,"num_write":527,"num_write_kb":254254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":181673084,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"42","length":"1"},{"start":"45","length":"1"}]},{"pgid":"2.3","version":"0'0","reported_seq":"120","reported_epoch":"112","state":"active+clean","last_fresh":"2020-11-16T20:57:16.802685+0000","last_change":"2020-11-16T20:57:12.498318+0000","last_active":"2020-11-16T20:57:16.802685+0000","last_peered":"2020-11-16T20:57:16.802685+0000","last_clean":"2020-11-16T20:57:16.802685+0000","last_became_active":"2020-11-16T20:55:50.903578+0000","last_became_peered":"2020-11-16T20:55:50.903578+0000","last_unstale":"2020-11-16T20:57:16.802685+0000","last_undegraded":"2020-11-16T20:57:16.802685+0000","last_fullsized":"2020-11-16T20:57:16.802685+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:12.498241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:12.498241+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"112","reported_epoch":"111","state":"active+clean","last_fresh":"2020-11-16T20:57:15.791737+0000","last_change":"2020-11-16T20:56:03.542304+0000","last_active":"2020-11-16T20:57:15.791737+0000","last_peered":"2020-11-16T20:57:15.791737+0000","last_clean":"2020-11-16T20:57:15.791737+0000","last_became_active":"2020-11-16T20:54:53.112038+0000","last_became_peered":"2020-11-16T20:54:53.112038+0000","last_unstale":"2020-11-16T20:57:15.791737+0000","last_undegraded":"2020-11-16T20:57:15.791737+0000","last_fullsized":"2020-11-16T20:57:15.791737+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'2","last_scrub_stamp":"2020-11-16T20:56:03.542235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:50.068882+0000","last_clean_scrub_stamp":"2020-11-16T20:56:03.542235+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"111'623","reported_seq":"1038","reported_epoch":"112","state":"active+clean","last_fresh":"2020-11-16T20:57:16.769140+0000","last_change":"2020-11-16T20:57:16.769643+0000","last_active":"2020-11-16T20:57:16.769140+0000","last_peered":"2020-11-16T20:57:16.769140+0000","last_clean":"2020-11-16T20:57:16.769140+0000","last_became_active":"2020-11-16T20:55:25.106302+0000","last_became_peered":"2020-11-16T20:55:25.106302+0000","last_unstale":"2020-11-16T20:57:16.769140+0000","last_undegraded":"2020-11-16T20:57:16.769140+0000","last_fullsized":"2020-11-16T20:57:16.769140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'549","last_scrub_stamp":"2020-11-16T20:56:39.880955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:56:39.880955+0000","log_size":623,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":314005929,"num_objects":113,"num_object_clones":1,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":361,"num_read_kb":122883,"num_write":511,"num_write_kb":255489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"42","length":"1"},{"start":"45","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":"117","reported_epoch":"111","state":"active+clean","last_fresh":"2020-11-16T20:57:15.791896+0000","last_change":"2020-11-16T20:55:56.657297+0000","last_active":"2020-11-16T20:57:15.791896+0000","last_peered":"2020-11-16T20:57:15.791896+0000","last_clean":"2020-11-16T20:57:15.791896+0000","last_became_active":"2020-11-16T20:55:50.908710+0000","last_became_peered":"2020-11-16T20:55:50.908710+0000","last_unstale":"2020-11-16T20:57:15.791896+0000","last_undegraded":"2020-11-16T20:57:15.791896+0000","last_fullsized":"2020-11-16T20:57:15.791896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:56.657242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:56.657242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"112'766","reported_seq":"1226","reported_epoch":"112","state":"active+clean","last_fresh":"2020-11-16T20:57:16.778955+0000","last_change":"2020-11-16T20:57:16.753545+0000","last_active":"2020-11-16T20:57:16.778955+0000","last_peered":"2020-11-16T20:57:16.778955+0000","last_clean":"2020-11-16T20:57:16.778955+0000","last_became_active":"2020-11-16T20:55:24.802649+0000","last_became_peered":"2020-11-16T20:55:24.802649+0000","last_unstale":"2020-11-16T20:57:16.778955+0000","last_undegraded":"2020-11-16T20:57:16.778955+0000","last_fullsized":"2020-11-16T20:57:16.778955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'650","last_scrub_stamp":"2020-11-16T20:56:37.941529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:56:37.941529+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":387972497,"num_objects":133,"num_object_clones":1,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133,"num_whiteouts":0,"num_read":466,"num_read_kb":184792,"num_write":626,"num_write_kb":299571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3d","length":"1"},{"start":"3f","length":"1"},{"start":"42","length":"1"},{"start":"45","length":"1"}]},{"pgid":"4.3","version":"109'386","reported_seq":"741","reported_epoch":"112","state":"active+clean","last_fresh":"2020-11-16T20:57:16.799565+0000","last_change":"2020-11-16T20:57:16.800235+0000","last_active":"2020-11-16T20:57:16.799565+0000","last_peered":"2020-11-16T20:57:16.799565+0000","last_clean":"2020-11-16T20:57:16.799565+0000","last_became_active":"2020-11-16T20:56:59.855884+0000","last_became_peered":"2020-11-16T20:56:59.855884+0000","last_unstale":"2020-11-16T20:57:16.799565+0000","last_undegraded":"2020-11-16T20:57:16.799565+0000","last_fullsized":"2020-11-16T20:57:16.799565+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:55:29.809179+0000","log_size":386,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131719264,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":2,"num_read":152,"num_read_kb":114096,"num_write":218,"num_write_kb":38335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":74,"num_bytes_recovered":116520559,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":29,"num_flush_kb":82737,"num_evict":20,"num_evict_kb":55322,"num_promote":68,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3d","length":"1"},{"start":"42","length":"1"},{"start":"45","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":"120","reported_epoch":"111","state":"active+clean","last_fresh":"2020-11-16T20:57:15.791902+0000","last_change":"2020-11-16T20:57:15.403335+0000","last_active":"2020-11-16T20:57:15.791902+0000","last_peered":"2020-11-16T20:57:15.791902+0000","last_clean":"2020-11-16T20:57:15.791902+0000","last_became_active":"2020-11-16T20:55:50.901014+0000","last_became_peered":"2020-11-16T20:55:50.901014+0000","last_unstale":"2020-11-16T20:57:15.791902+0000","last_undegraded":"2020-11-16T20:57:15.791902+0000","last_fullsized":"2020-11-16T20:57:15.791902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:15.403250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:15.403250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"116","reported_epoch":"111","state":"active+clean","last_fresh":"2020-11-16T20:57:15.751679+0000","last_change":"2020-11-16T20:55:59.950321+0000","last_active":"2020-11-16T20:57:15.751679+0000","last_peered":"2020-11-16T20:57:15.751679+0000","last_clean":"2020-11-16T20:57:15.751679+0000","last_became_active":"2020-11-16T20:55:50.905408+0000","last_became_peered":"2020-11-16T20:55:50.905408+0000","last_unstale":"2020-11-16T20:57:15.751679+0000","last_undegraded":"2020-11-16T20:57:15.751679+0000","last_fullsized":"2020-11-16T20:57:15.751679+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.950219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.950219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"108'373","reported_seq":"725","reported_epoch":"112","state":"active+clean","last_fresh":"2020-11-16T20:57:16.764355+0000","last_change":"2020-11-16T20:57:16.764674+0000","last_active":"2020-11-16T20:57:16.764355+0000","last_peered":"2020-11-16T20:57:16.764355+0000","last_clean":"2020-11-16T20:57:16.764355+0000","last_became_active":"2020-11-16T20:56:47.798651+0000","last_became_peered":"2020-11-16T20:56:47.798651+0000","last_unstale":"2020-11-16T20:57:16.764355+0000","last_undegraded":"2020-11-16T20:57:16.764355+0000","last_fullsized":"2020-11-16T20:57:16.764355+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'320","last_scrub_stamp":"2020-11-16T20:56:54.815437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:56:54.815437+0000","log_size":373,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":132407493,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":4,"num_read":155,"num_read_kb":129342,"num_write":169,"num_write_kb":36986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":63,"num_bytes_recovered":122901039,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":27,"num_flush_kb":77303,"num_evict":12,"num_evict_kb":36936,"num_promote":62,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3d","length":"1"},{"start":"42","length":"1"},{"start":"45","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":"116","reported_epoch":"111","state":"active+clean","last_fresh":"2020-11-16T20:57:15.747724+0000","last_change":"2020-11-16T20:55:59.645073+0000","last_active":"2020-11-16T20:57:15.747724+0000","last_peered":"2020-11-16T20:57:15.747724+0000","last_clean":"2020-11-16T20:57:15.747724+0000","last_became_active":"2020-11-16T20:55:50.905649+0000","last_became_peered":"2020-11-16T20:55:50.905649+0000","last_unstale":"2020-11-16T20:57:15.747724+0000","last_undegraded":"2020-11-16T20:57:15.747724+0000","last_fullsized":"2020-11-16T20:57:15.747724+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.644996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.644996+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"112'384","reported_seq":"817","reported_epoch":"112","state":"active+clean","last_fresh":"2020-11-16T20:57:16.788797+0000","last_change":"2020-11-16T20:57:16.757737+0000","last_active":"2020-11-16T20:57:16.788797+0000","last_peered":"2020-11-16T20:57:16.788797+0000","last_clean":"2020-11-16T20:57:16.788797+0000","last_became_active":"2020-11-16T20:56:16.750108+0000","last_became_peered":"2020-11-16T20:56:16.750108+0000","last_unstale":"2020-11-16T20:57:16.788797+0000","last_undegraded":"2020-11-16T20:57:16.788797+0000","last_fullsized":"2020-11-16T20:57:16.788797+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'266","last_scrub_stamp":"2020-11-16T20:56:42.351294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:56:42.351294+0000","log_size":384,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":138105264,"num_objects":51,"num_object_clones":1,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":6,"num_read":116,"num_read_kb":73082,"num_write":201,"num_write_kb":43187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":91753326,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":32,"num_flush_kb":95035,"num_evict":13,"num_evict_kb":39037,"num_promote":67,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3d","length":"1"},{"start":"42","length":"1"},{"start":"45","length":"1"}]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":511815179,"num_objects":192,"num_object_clones":2,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":19,"num_read":508,"num_read_kb":350707,"num_write":774,"num_write_kb":149163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":331174924,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":122,"num_flush_kb":346790,"num_evict":51,"num_evict_kb":145019,"num_promote":256,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1333223424,"data_stored":1340009500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1521,"ondisk_log_size":1521,"up":12,"acting":12,"num_store_stats":8},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":1369271118,"num_objects":480,"num_object_clones":4,"num_object_copies":1440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":480,"num_whiteouts":1,"num_read":1548,"num_read_kb":504390,"num_write":2218,"num_write_kb":1080800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":181673084,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2596388864,"data_stored":2586456816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2754,"ondisk_log_size":2754,"up":12,"acting":12,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":18,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127000,"kb_used_data":114896,"kb_used_omap":0,"kb_used_meta":12096,"kb_avail":94244840,"statfs":{"total":96636764160,"available":96506716160,"internally_reserved":0,"allocated":117653504,"data_stored":116800593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12386304},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.96699999999999997,"15min":0.96799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.90000000000000002,"15min":0.91600000000000004},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.252,"5min":1.48,"15min":1.48},"last":0.82499999999999996}]},{"osd":1,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.93999999999999995,"15min":0.94499999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.03,"5min":0.997,"15min":0.99099999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":0.64400000000000002}]},{"osd":2,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.97399999999999998,"15min":0.98899999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.175},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.97999999999999998,"15min":0.98299999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.93400000000000005}]},{"osd":3,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.1279999999999999,"15min":1.1359999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.0620000000000001,"15min":1.0549999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.91400000000000003}]},{"osd":4,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.98499999999999999,"15min":0.99299999999999999},"min":{"1min":0.63400000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.387,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.218},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.159,"15min":1.161},"min":{"1min":0.70999999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2,"5min":2,"15min":2},"last":0.79200000000000004}]},{"osd":5,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.103,"15min":1.107},"min":{"1min":0.71199999999999997,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.004},{"interface":"front","average":{"1min":1.081,"5min":1.181,"15min":1.1970000000000001},"min":{"1min":0.74299999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.4730000000000001,"5min":1.583,"15min":1.583},"last":1.034}]},{"osd":6,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.264,"15min":1.25},"min":{"1min":0.89300000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.359,"15min":1.375},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.2929999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":545540,"kb_used_data":526268,"kb_used_omap":0,"kb_used_meta":19264,"kb_avail":93826300,"statfs":{"total":96636764160,"available":96078131200,"internally_reserved":0,"allocated":538898432,"data_stored":536734069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19726336},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.94899999999999995,"15min":0.95299999999999996},"min":{"1min":0.55500000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.421,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.93300000000000005,"15min":0.93000000000000005},"min":{"1min":0.62,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.89700000000000002}]},{"osd":1,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.018,"15min":1.016},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.4650000000000001,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.038},{"interface":"front","average":{"1min":1.1000000000000001,"5min":0.96399999999999997,"15min":0.94099999999999995},"min":{"1min":0.64900000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.071}]},{"osd":2,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.86399999999999999,"15min":0.872},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.083,"5min":1.123,"15min":1.1299999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.6559999999999999,"5min":1.897,"15min":1.897},"last":1.216}]},{"osd":3,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.089,"15min":1.103},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.369,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1259999999999999,"15min":1.123},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.4730000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.1659999999999999}]},{"osd":4,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.129,"15min":1.1419999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.7390000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1759999999999999,"15min":1.1799999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.75}]},{"osd":5,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0920000000000001,"15min":1.1020000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":1.294},{"interface":"front","average":{"1min":1.327,"5min":1.4339999999999999,"15min":1.452},"min":{"1min":1.0860000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":1.901,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.3500000000000001}]},{"osd":7,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.131},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.3009999999999999,"15min":1.3100000000000001},"min":{"1min":0.96799999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.008}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":530272,"kb_used_data":515864,"kb_used_omap":0,"kb_used_meta":14400,"kb_avail":93841568,"statfs":{"total":96636764160,"available":96093765632,"internally_reserved":0,"allocated":528244736,"data_stored":528889483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14745600},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:56:54 2020","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.71399999999999997,"15min":0.72499999999999998},"min":{"1min":0.42499999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91800000000000004,"5min":1.407,"15min":1.407},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.2270000000000001,"5min":1.645,"15min":1.645},"last":0.53200000000000003}]},{"osd":2,"last update":"Mon Nov 16 20:56:54 2020","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.74199999999999999,"15min":0.75800000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92700000000000005,"5min":1.754,"15min":1.754},"last":0.878},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.88400000000000001,"15min":0.90900000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.96599999999999997,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.76300000000000001}]},{"osd":3,"last update":"Mon Nov 16 20:56:54 2020","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.95999999999999996,"15min":0.98399999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.399,"5min":2.677,"15min":2.677},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.91500000000000004,"15min":0.92600000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2470000000000001,"5min":1.486,"15min":1.486},"last":0.89700000000000002}]},{"osd":4,"last update":"Mon Nov 16 20:56:54 2020","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.1100000000000001,"15min":1.1160000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.6479999999999999,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.153,"15min":1.161},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.79700000000000004}]},{"osd":5,"last update":"Mon Nov 16 20:56:54 2020","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.2270000000000001,"15min":1.248},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4159999999999999,"5min":1.913,"15min":1.913},"last":1.046},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.2350000000000001,"15min":1.254},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.5289999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.292}]},{"osd":6,"last update":"Mon Nov 16 20:56:54 2020","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.224,"15min":1.2270000000000001},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.5309999999999999,"5min":1.883,"15min":1.883},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.25,"5min":1.278,"15min":1.2829999999999999},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.5580000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.22}]},{"osd":7,"last update":"Mon Nov 16 20:56:54 2020","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.29,"15min":1.3080000000000001},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.7390000000000001,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.288,"15min":1.302},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.806,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.089}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":783344,"kb_used_data":761768,"kb_used_omap":0,"kb_used_meta":21568,"kb_avail":93588496,"statfs":{"total":96636764160,"available":95834619904,"internally_reserved":0,"allocated":780050432,"data_stored":776321984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22085632},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 16 20:56:55 2020","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.71999999999999997,"15min":0.73099999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0249999999999999,"5min":1.05,"15min":1.05},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.877,"15min":0.873},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.7269999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":0.85399999999999998}]},{"osd":2,"last update":"Mon Nov 16 20:56:55 2020","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.75900000000000001,"15min":0.77600000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.86799999999999999,"15min":0.877},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.67100000000000004}]},{"osd":3,"last update":"Mon Nov 16 20:56:55 2020","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.92300000000000004,"15min":0.93700000000000006},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.93700000000000006,"15min":0.95499999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.79100000000000004}]},{"osd":4,"last update":"Mon Nov 16 20:56:55 2020","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.145,"15min":1.137},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":3.3100000000000001,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.075,"5min":1.216,"15min":1.24},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.175}]},{"osd":5,"last update":"Mon Nov 16 20:56:55 2020","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2929999999999999,"15min":1.3049999999999999},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.381},{"interface":"front","average":{"1min":1.133,"5min":1.1799999999999999,"15min":1.1879999999999999},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.2190000000000001}]},{"osd":6,"last update":"Mon Nov 16 20:56:55 2020","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.236,"15min":1.2549999999999999},"min":{"1min":0.79100000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.137},{"interface":"front","average":{"1min":1.252,"5min":1.3240000000000001,"15min":1.3360000000000001},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.5670000000000002,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":1.2789999999999999}]},{"osd":7,"last update":"Mon Nov 16 20:56:55 2020","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.3799999999999999,"15min":1.3999999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":1.2},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.365,"15min":1.3919999999999999},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.2309999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.3149999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":323200,"kb_used_data":310840,"kb_used_omap":0,"kb_used_meta":12352,"kb_avail":94048640,"statfs":{"total":96636764160,"available":96305807360,"internally_reserved":0,"allocated":318300160,"data_stored":316605791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12648448},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:56:52 2020","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.72199999999999998,"15min":0.69999999999999996},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.78000000000000003,"15min":0.75800000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.758,"5min":2.758,"15min":2.758},"last":0.57999999999999996}]},{"osd":1,"last update":"Mon Nov 16 20:56:52 2020","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.84799999999999998,"15min":0.83399999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":3.3090000000000002,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.052,"5min":0.90600000000000003,"15min":0.88200000000000001},"min":{"1min":0.61799999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.3580000000000001,"5min":3.3580000000000001,"15min":3.3580000000000001},"last":0.71399999999999997}]},{"osd":3,"last update":"Mon Nov 16 20:56:53 2020","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.751,"15min":0.73699999999999999},"min":{"1min":0.53600000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.623},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.90500000000000003,"15min":0.89100000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.77600000000000002}]},{"osd":4,"last update":"Mon Nov 16 20:56:52 2020","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1259999999999999,"15min":1.1279999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4379999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.165,"15min":1.143},"min":{"1min":0.82299999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.143}]},{"osd":5,"last update":"Mon Nov 16 20:56:52 2020","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.157,"15min":1.145},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.173,"15min":1.1699999999999999},"min":{"1min":0.77100000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.83499999999999996}]},{"osd":6,"last update":"Mon Nov 16 20:56:52 2020","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.113,"15min":1.1000000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.26,"5min":1.208,"15min":1.2},"min":{"1min":0.93300000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.96599999999999997}]},{"osd":7,"last update":"Mon Nov 16 20:56:52 2020","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2490000000000001,"15min":1.2529999999999999},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.2809999999999999,"15min":1.2789999999999999},"min":{"1min":0.91600000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.79,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.081}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":570172,"kb_used_data":550772,"kb_used_omap":0,"kb_used_meta":19392,"kb_avail":93801668,"statfs":{"total":96636764160,"available":96052908032,"internally_reserved":0,"allocated":563990528,"data_stored":561713338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":19857408},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:56:53 2020","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.65200000000000002,"15min":0.65400000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.67500000000000004,"15min":0.67900000000000005},"min":{"1min":0.52600000000000002,"5min":0.495,"15min":0.495},"max":{"1min":0.93200000000000005,"5min":0.996,"15min":0.996},"last":0.86699999999999999}]},{"osd":1,"last update":"Mon Nov 16 20:56:53 2020","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.79100000000000004,"15min":0.81000000000000005},"min":{"1min":0.47699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1850000000000001,"5min":2.105,"15min":2.105},"last":0.497},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.93500000000000005,"15min":0.95699999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2450000000000001,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.66800000000000004}]},{"osd":2,"last update":"Mon Nov 16 20:56:53 2020","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.93200000000000005,"15min":0.95399999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3160000000000001,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.056},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0129999999999999,"15min":1.0209999999999999},"min":{"1min":0.73299999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4379999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.88700000000000001}]},{"osd":4,"last update":"Mon Nov 16 20:56:53 2020","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.117,"15min":1.1359999999999999},"min":{"1min":0.73499999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.6779999999999999,"5min":2.923,"15min":2.923},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.165,"15min":1.173},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.016,"5min":2.968,"15min":2.968},"last":0.74199999999999999}]},{"osd":5,"last update":"Mon Nov 16 20:56:53 2020","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.2450000000000001,"15min":1.2729999999999999},"min":{"1min":0.76200000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.1789999999999998,"5min":2.8479999999999999,"15min":2.8479999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.121,"15min":1.111},"min":{"1min":0.89200000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.79900000000000004}]},{"osd":6,"last update":"Mon Nov 16 20:56:53 2020","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.218,"15min":1.2450000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.4430000000000001,"5min":2.859,"15min":2.859},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.3899999999999999,"15min":1.4239999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.2890000000000001,"5min":3.5390000000000001,"15min":3.5390000000000001},"last":0.84699999999999998}]},{"osd":7,"last update":"Mon Nov 16 20:56:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.296,"15min":1.3129999999999999},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.512,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.254},{"interface":"front","average":{"1min":1.127,"5min":1.2849999999999999,"15min":1.3109999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.538,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":1.1599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":674880,"kb_used_data":655288,"kb_used_omap":0,"kb_used_meta":19584,"kb_avail":93696960,"statfs":{"total":96636764160,"available":95945687040,"internally_reserved":0,"allocated":671014912,"data_stored":670723505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20054016},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.077,"15min":1.075},"min":{"1min":0.70099999999999996,"5min":0.629,"15min":0.629},"max":{"1min":1.5229999999999999,"5min":1.571,"15min":1.571},"last":1.429}]},{"osd":1,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.873,"15min":0.877},"min":{"1min":0.52700000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1879999999999999,"5min":1.196,"15min":1.196},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.871,"15min":0.86899999999999999},"min":{"1min":0.58799999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3200000000000001,"5min":1.331,"15min":1.331},"last":0.69899999999999995}]},{"osd":2,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.022,"15min":1.0269999999999999},"min":{"1min":0.70999999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2889999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.0429999999999999,"15min":1.0609999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.306,"5min":1.609,"15min":1.609},"last":1.1719999999999999}]},{"osd":3,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0209999999999999,"15min":1.024},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.262},{"interface":"front","average":{"1min":0.90600000000000003,"5min":1.135,"15min":1.173},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1619999999999999,"5min":1.528,"15min":1.528},"last":1.228}]},{"osd":5,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.0680000000000001,"15min":1.091},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.419,"5min":1.643,"15min":1.643},"last":0.999},{"interface":"front","average":{"1min":1.163,"5min":1.1990000000000001,"15min":1.2050000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.6519999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.5509999999999999}]},{"osd":6,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.1419999999999999,"15min":1.163},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.331},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.2889999999999999,"15min":1.304},"min":{"1min":0.93899999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.6379999999999999,"5min":1.79,"15min":1.79},"last":1.304}]},{"osd":7,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.4059999999999999,"15min":1.421},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":1.827,"5min":2.4369999999999998,"15min":2.4369999999999998},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.383,"15min":1.4139999999999999},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.5509999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.413}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":417008,"kb_used_data":402920,"kb_used_omap":0,"kb_used_meta":14080,"kb_avail":93954832,"statfs":{"total":96636764160,"available":96209747968,"internally_reserved":0,"allocated":412590080,"data_stored":413880671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14417920},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.89500000000000002,"15min":0.89100000000000001},"min":{"1min":0.58899999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.879,"5min":0.90400000000000003,"15min":0.90800000000000003},"min":{"1min":0.505,"5min":0.497,"15min":0.497},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.63800000000000001}]},{"osd":1,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.93999999999999995,"15min":0.94999999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.95599999999999996,"15min":0.95699999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.97099999999999997}]},{"osd":2,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0149999999999999,"15min":1.0189999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.78900000000000003}]},{"osd":3,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.052,"15min":1.0569999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.087},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.153,"15min":1.1519999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.228}]},{"osd":4,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0389999999999999,"15min":1.0269999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1679999999999999,"15min":1.1819999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.0229999999999999}]},{"osd":6,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.2010000000000001,"15min":1.21},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.593},{"interface":"front","average":{"1min":1.272,"5min":1.333,"15min":1.343},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.5289999999999999}]},{"osd":7,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.4239999999999999,"15min":1.4430000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7949999999999999,"5min":1.909,"15min":1.909},"last":1.1870000000000001}]}]}]}} 2020-11-16T20:57:20.941 INFO:tasks.thrashosds.thrasher:Setting 2.c to [4, 5, 6] 2020-11-16T20:57:20.941 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '2.c', '4', '5', '6'] 2020-11-16T20:57:20.941 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 2.c 4 5 6 2020-11-16T20:57:20.975 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:20.975 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:20.985 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:57:21.028 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:21.033+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:21.118 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:21.122+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:21.120 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:21.120 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:21.130 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:57:21.218 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:21.223+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:21.305 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:21.305 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:21.314 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:57:21.319 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:21.324+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:21.420 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:21.424+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:21.449 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:21.449 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:21.458 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:57:21.520 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:21.525+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:21.621 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:21.626+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:21.634 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:21.634 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:21.643 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:57:21.722 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:21.726+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:21.818 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:21.818 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:21.823 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:21.827+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:21.828 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:57:21.834 INFO:tasks.rados.rados.0.smithi166.stdout:1004: done (6 left) 2020-11-16T20:57:21.835 INFO:tasks.rados.rados.0.smithi166.stdout:1005: rollback oid 337 current snap is 39 2020-11-16T20:57:21.835 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 337 to 32 2020-11-16T20:57:21.835 INFO:tasks.rados.rados.0.smithi166.stdout:1000: finishing write tid 1 to smithi16641208-24 2020-11-16T20:57:21.835 INFO:tasks.rados.rados.0.smithi166.stdout:1000: finishing write tid 2 to smithi16641208-24 2020-11-16T20:57:21.835 INFO:tasks.rados.rados.0.smithi166.stdout:1000: finishing write tid 3 to smithi16641208-24 2020-11-16T20:57:21.835 INFO:tasks.rados.rados.0.smithi166.stdout:1000: finishing write tid 4 to smithi16641208-24 2020-11-16T20:57:21.835 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 24 v 781 (ObjNum 631 snap 39 seq_num 631) dirty exists 2020-11-16T20:57:21.836 INFO:tasks.rados.rados.0.smithi166.stdout:1000: left oid 24 (ObjNum 631 snap 39 seq_num 631) 2020-11-16T20:57:21.836 INFO:tasks.rados.rados.0.smithi166.stdout:980: finishing rollback tid 0 to smithi16641208-406 2020-11-16T20:57:21.836 INFO:tasks.rados.rados.0.smithi166.stdout:1002: finishing copy_from to smithi16641208-54 2020-11-16T20:57:21.836 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 54 v 549 (ObjNum 536 snap 11 seq_num 536) dirty exists 2020-11-16T20:57:21.836 INFO:tasks.rados.rados.0.smithi166.stdout:991: finishing write tid 1 to smithi16641208-44 2020-11-16T20:57:21.836 INFO:tasks.rados.rados.0.smithi166.stdout:1002: finishing copy_from racing read to smithi16641208-54 2020-11-16T20:57:21.836 INFO:tasks.rados.rados.0.smithi166.stdout:999: finishing write tid 1 to smithi16641208-320 2020-11-16T20:57:21.837 INFO:tasks.rados.rados.0.smithi166.stdout:991: finishing write tid 2 to smithi16641208-44 2020-11-16T20:57:21.837 INFO:tasks.rados.rados.0.smithi166.stdout:991: finishing write tid 3 to smithi16641208-44 2020-11-16T20:57:21.837 INFO:tasks.rados.rados.0.smithi166.stdout:1000: done (6 left) 2020-11-16T20:57:21.837 INFO:tasks.rados.rados.0.smithi166.stdout:1001: done (5 left) 2020-11-16T20:57:21.837 INFO:tasks.rados.rados.0.smithi166.stdout:1002: done (4 left) 2020-11-16T20:57:21.837 INFO:tasks.rados.rados.0.smithi166.stdout:1006: cache_try_flush oid 395 snap -1 2020-11-16T20:57:21.837 INFO:tasks.rados.rados.0.smithi166.stdout:991: finishing write tid 4 to smithi16641208-44 2020-11-16T20:57:21.837 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 44 v 651 (ObjNum 627 snap 38 seq_num 627) dirty exists 2020-11-16T20:57:21.838 INFO:tasks.rados.rados.0.smithi166.stdout:991: left oid 44 (ObjNum 627 snap 38 seq_num 627) 2020-11-16T20:57:21.838 INFO:tasks.rados.rados.0.smithi166.stdout:980: finishing rollback tid 1 to smithi16641208-406 2020-11-16T20:57:21.838 INFO:tasks.rados.rados.0.smithi166.stdout:980: finishing rollback tid 2 to smithi16641208-406 2020-11-16T20:57:21.838 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 406 v 653 (ObjNum 405 snap 0 seq_num 405) dirty exists 2020-11-16T20:57:21.838 INFO:tasks.rados.rados.0.smithi166.stdout:999: finishing write tid 2 to smithi16641208-320 2020-11-16T20:57:21.838 INFO:tasks.rados.rados.0.smithi166.stdout:999: finishing write tid 3 to smithi16641208-320 2020-11-16T20:57:21.838 INFO:tasks.rados.rados.0.smithi166.stdout:999: finishing write tid 4 to smithi16641208-320 2020-11-16T20:57:21.839 INFO:tasks.rados.rados.0.smithi166.stdout:999: finishing write tid 5 to smithi16641208-320 2020-11-16T20:57:21.839 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 320 v 656 (ObjNum 630 snap 39 seq_num 630) dirty exists 2020-11-16T20:57:21.839 INFO:tasks.rados.rados.0.smithi166.stdout:999: left oid 320 (ObjNum 630 snap 39 seq_num 630) 2020-11-16T20:57:21.839 INFO:tasks.rados.rados.0.smithi166.stdout:980: done (4 left) 2020-11-16T20:57:21.839 INFO:tasks.rados.rados.0.smithi166.stdout:991: done (3 left) 2020-11-16T20:57:21.840 INFO:tasks.rados.rados.0.smithi166.stdout:999: done (2 left) 2020-11-16T20:57:21.840 INFO:tasks.rados.rados.0.smithi166.stdout:1007: cache_flush oid 11 snap -1 2020-11-16T20:57:21.840 INFO:tasks.rados.rados.0.smithi166.stdout:1008: write (excl) oid 443 current snap is 39 2020-11-16T20:57:21.840 INFO:tasks.rados.rados.0.smithi166.stdout:1008: seq_num 632 ranges {622024=414667,1783208=417873} 2020-11-16T20:57:21.841 INFO:tasks.rados.rados.0.smithi166.stdout:1008: writing smithi16641208-443 from 622024 to 1036691 tid 1 2020-11-16T20:57:21.845 INFO:teuthology.orchestra.run.smithi166.stderr:set 2.c pg_upmap mapping to [4,5,6] 2020-11-16T20:57:21.849 INFO:tasks.rados.rados.0.smithi166.stdout:1008: writing smithi16641208-443 from 1783208 to 2201081 tid 2 2020-11-16T20:57:21.849 INFO:tasks.rados.rados.0.smithi166.stdout:1009: write (excl) oid 131 current snap is 39 2020-11-16T20:57:21.849 INFO:tasks.rados.rados.0.smithi166.stdout:1006: got (0) Success 2020-11-16T20:57:21.849 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 395 v 0 (ObjNum 0 snap 0 seq_num 0) clean dne 2020-11-16T20:57:21.850 INFO:tasks.rados.rados.0.smithi166.stdout:1009: seq_num 633 ranges {638831=489916,1841690=677884} 2020-11-16T20:57:21.856 INFO:tasks.rados.rados.0.smithi166.stdout:1009: writing smithi16641208-131 from 638831 to 1128747 tid 1 2020-11-16T20:57:21.865 INFO:tasks.rados.rados.0.smithi166.stdout:1009: writing smithi16641208-131 from 1841690 to 2519574 tid 2 2020-11-16T20:57:21.865 INFO:tasks.rados.rados.0.smithi166.stdout:1006: done (4 left) 2020-11-16T20:57:21.865 INFO:tasks.rados.rados.0.smithi166.stdout:1010: copy_from oid 171 from oid 225 current snap is 39 2020-11-16T20:57:21.866 INFO:tasks.rados.rados.0.smithi166.stdout:1007: got (2) No such file or directory 2020-11-16T20:57:21.866 INFO:tasks.rados.rados.0.smithi166.stdout:1007: done (4 left) 2020-11-16T20:57:21.866 INFO:tasks.rados.rados.0.smithi166.stdout:1011: delete oid 495 current snap is 39 2020-11-16T20:57:21.866 INFO:tasks.rados.rados.0.smithi166.stdout:1008: finishing write tid 1 to smithi16641208-443 2020-11-16T20:57:21.866 INFO:tasks.rados.rados.0.smithi166.stdout:1005: finishing rollback tid 0 to smithi16641208-337 2020-11-16T20:57:21.875 INFO:tasks.rados.rados.0.smithi166.stdout:1009: finishing write tid 1 to smithi16641208-131 2020-11-16T20:57:21.880 INFO:tasks.rados.rados.0.smithi166.stdout:1008: finishing write tid 2 to smithi16641208-443 2020-11-16T20:57:21.880 INFO:tasks.rados.rados.0.smithi166.stdout:1011: done (4 left) 2020-11-16T20:57:21.881 INFO:tasks.rados.rados.0.smithi166.stdout:1012: cache_try_flush oid 309 snap 37 2020-11-16T20:57:21.881 INFO:tasks.rados.rados.0.smithi166.stdout:1013: read oid 339 snap -1 2020-11-16T20:57:21.881 INFO:tasks.rados.rados.0.smithi166.stdout:1013: expect (ObjNum 338 snap 0 seq_num 338) 2020-11-16T20:57:21.881 INFO:tasks.rados.rados.0.smithi166.stdout:1014: delete oid 458 current snap is 39 2020-11-16T20:57:21.881 INFO:tasks.rados.rados.0.smithi166.stdout:1008: finishing write tid 3 to smithi16641208-443 2020-11-16T20:57:21.884 INFO:tasks.rados.rados.0.smithi166.stdout:1008: finishing write tid 4 to smithi16641208-443 2020-11-16T20:57:21.885 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 443 v 727 (ObjNum 632 snap 39 seq_num 632) dirty exists 2020-11-16T20:57:21.885 INFO:tasks.rados.rados.0.smithi166.stdout:1008: left oid 443 (ObjNum 632 snap 39 seq_num 632) 2020-11-16T20:57:21.899 INFO:tasks.rados.rados.0.smithi166.stdout:1008: done (6 left) 2020-11-16T20:57:21.899 INFO:tasks.rados.rados.0.smithi166.stdout:1014: done (5 left) 2020-11-16T20:57:21.899 INFO:tasks.rados.rados.0.smithi166.stdout:1015: read oid 30 snap -1 2020-11-16T20:57:21.900 INFO:tasks.rados.rados.0.smithi166.stdout:1015: expect deleted 2020-11-16T20:57:21.900 INFO:tasks.rados.rados.0.smithi166.stdout:1016: write oid 283 current snap is 39 2020-11-16T20:57:21.900 INFO:tasks.rados.rados.0.smithi166.stdout:1016: seq_num 636 ranges {689252=715663,1900783=425211} 2020-11-16T20:57:21.907 INFO:tasks.rados.rados.0.smithi166.stdout:1016: writing smithi16641208-283 from 689252 to 1404915 tid 1 2020-11-16T20:57:21.913 INFO:tasks.rados.rados.0.smithi166.stdout:1016: writing smithi16641208-283 from 1900783 to 2325994 tid 2 2020-11-16T20:57:21.913 INFO:tasks.rados.rados.0.smithi166.stdout:1005: finishing rollback tid 1 to smithi16641208-337 2020-11-16T20:57:21.914 INFO:tasks.rados.rados.0.smithi166.stdout:1005: finishing rollback tid 2 to smithi16641208-337 2020-11-16T20:57:21.914 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 337 v 665 (ObjNum 336 snap 0 seq_num 336) dirty exists 2020-11-16T20:57:21.914 INFO:tasks.rados.rados.0.smithi166.stdout:1013: expect (ObjNum 338 snap 0 seq_num 338) 2020-11-16T20:57:21.923 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:21.927+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:22.023 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:22.028+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:22.024 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:22.024 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:22.033 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:57:22.035 INFO:tasks.rados.rados.0.smithi166.stdout:1009: finishing write tid 2 to smithi16641208-131 2020-11-16T20:57:22.036 INFO:tasks.rados.rados.0.smithi166.stdout:1009: finishing write tid 3 to smithi16641208-131 2020-11-16T20:57:22.036 INFO:tasks.rados.rados.0.smithi166.stdout:1009: finishing write tid 4 to smithi16641208-131 2020-11-16T20:57:22.036 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 131 v 729 (ObjNum 633 snap 39 seq_num 633) dirty exists 2020-11-16T20:57:22.036 INFO:tasks.rados.rados.0.smithi166.stdout:1009: left oid 131 (ObjNum 633 snap 39 seq_num 633) 2020-11-16T20:57:22.036 INFO:tasks.rados.rados.0.smithi166.stdout:1005: done (6 left) 2020-11-16T20:57:22.036 INFO:tasks.rados.rados.0.smithi166.stdout:1009: done (5 left) 2020-11-16T20:57:22.037 INFO:tasks.rados.rados.0.smithi166.stdout:1013: done (4 left) 2020-11-16T20:57:22.037 INFO:tasks.rados.rados.0.smithi166.stdout:1015: done (3 left) 2020-11-16T20:57:22.037 INFO:tasks.rados.rados.0.smithi166.stdout:1017: read oid 394 snap 36 2020-11-16T20:57:22.037 INFO:tasks.rados.rados.0.smithi166.stdout:1017: expect (ObjNum 393 snap 0 seq_num 393) 2020-11-16T20:57:22.037 INFO:tasks.rados.rados.0.smithi166.stdout:1018: write (excl) oid 432 current snap is 39 2020-11-16T20:57:22.037 INFO:tasks.rados.rados.0.smithi166.stdout:1010: finishing copy_from to smithi16641208-171 2020-11-16T20:57:22.037 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 171 v 29 (ObjNum 95 snap 0 seq_num 95) dirty exists 2020-11-16T20:57:22.038 INFO:tasks.rados.rados.0.smithi166.stdout:1016: finishing write tid 1 to smithi16641208-283 2020-11-16T20:57:22.038 INFO:tasks.rados.rados.0.smithi166.stdout:1012: got (0) Success 2020-11-16T20:57:22.038 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 309 v 0 (ObjNum 308 snap 0 seq_num 308) dirty exists 2020-11-16T20:57:22.038 INFO:tasks.rados.rados.0.smithi166.stdout:1016: finishing write tid 2 to smithi16641208-283 2020-11-16T20:57:22.038 INFO:tasks.rados.rados.0.smithi166.stdout:1016: finishing write tid 3 to smithi16641208-283 2020-11-16T20:57:22.038 INFO:tasks.rados.rados.0.smithi166.stdout:1016: finishing write tid 4 to smithi16641208-283 2020-11-16T20:57:22.038 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 283 v 732 (ObjNum 636 snap 39 seq_num 636) dirty exists 2020-11-16T20:57:22.039 INFO:tasks.rados.rados.0.smithi166.stdout:1016: left oid 283 (ObjNum 636 snap 39 seq_num 636) 2020-11-16T20:57:22.039 INFO:tasks.rados.rados.0.smithi166.stdout:1010: finishing copy_from racing read to smithi16641208-171 2020-11-16T20:57:22.039 INFO:tasks.rados.rados.0.smithi166.stdout:1018: seq_num 637 ranges {706059=790912,1959265=685222} 2020-11-16T20:57:22.043 INFO:tasks.rados.rados.0.smithi166.stdout:1018: writing smithi16641208-432 from 706059 to 1496971 tid 1 2020-11-16T20:57:22.050 INFO:tasks.rados.rados.0.smithi166.stdout:1018: writing smithi16641208-432 from 1959265 to 2644487 tid 2 2020-11-16T20:57:22.050 INFO:tasks.rados.rados.0.smithi166.stdout:1010: done (4 left) 2020-11-16T20:57:22.051 INFO:tasks.rados.rados.0.smithi166.stdout:1012: done (3 left) 2020-11-16T20:57:22.051 INFO:tasks.rados.rados.0.smithi166.stdout:1016: done (2 left) 2020-11-16T20:57:22.051 INFO:tasks.rados.rados.0.smithi166.stdout:1019: cache_flush oid 111 snap -1 2020-11-16T20:57:22.051 INFO:tasks.rados.rados.0.smithi166.stdout:1020: read oid 438 snap -1 2020-11-16T20:57:22.051 INFO:tasks.rados.rados.0.smithi166.stdout:1020: expect (ObjNum 511 snap 3 seq_num 511) 2020-11-16T20:57:22.051 INFO:tasks.rados.rados.0.smithi166.stdout:1021: snap_remove snap 37 2020-11-16T20:57:22.124 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:22.129+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:22.175 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:22.176 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:22.185 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:57:22.228 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:57:22.233+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:57:22.319 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:22.319 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:22.325 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:22.330+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:22.328 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:57:22.379 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:57:22.426 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:22.430+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:22.503 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:22.503 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:22.513 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:57:22.521 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:57:22.527 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:22.531+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:22.542 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:57:22.562 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:57:22.582 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:57:22.603 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:57:22.623 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:57:22.628 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:22.632+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:22.643 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:22.643 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:57:22.643 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:57:22.643 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:22.644 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:57:22.653 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:57:22.664 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:57:22.666 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:57:22.666 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:57:22.666 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:57:22.666 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:57:22.667 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:57:22.667 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:57:22.667 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:57:22.667 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:57:22.729 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:22.733+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:22.791 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:22.792 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:57:22.792 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:57:22.792 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:57:22.792 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:22.801 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:57:22.837 INFO:tasks.rados.rados.0.smithi166.stdout:1021: done (4 left) 2020-11-16T20:57:22.837 INFO:tasks.rados.rados.0.smithi166.stdout:1022: copy_from oid 2 from oid 326 current snap is 39 2020-11-16T20:57:22.838 INFO:tasks.rados.rados.0.smithi166.stdout:1017: expect (ObjNum 393 snap 0 seq_num 393) 2020-11-16T20:57:22.838 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:22.842+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:22.850 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2020-11-16T20:57:22.929 INFO:tasks.rados.rados.0.smithi166.stdout:1019: got (0) Success 2020-11-16T20:57:22.929 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 111 v 0 (ObjNum 340 snap 0 seq_num 340) dirty exists 2020-11-16T20:57:22.929 INFO:tasks.rados.rados.0.smithi166.stdout:1020: expect (ObjNum 511 snap 3 seq_num 511) 2020-11-16T20:57:22.931 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:22.936+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:22.955 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:22.956 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:57:22.956 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:57:22.956 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:57:22.956 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.956 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2345 4.3 4:c9160c9c:::smithi16641208-411:head [rollback 5] snapc 6=[6,5,4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e41)", 2020-11-16T20:57:22.956 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:04.115684+0000", 2020-11-16T20:57:22.956 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 78.843268183000006, 2020-11-16T20:57:22.957 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033152890999999997, 2020-11-16T20:57:22.957 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:22.957 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:22.957 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:22.957 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:22.957 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:22.957 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2345 2020-11-16T20:57:22.958 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.958 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:22.958 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.958 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:22.958 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115684+0000", 2020-11-16T20:57:22.958 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:22.958 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.959 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.959 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:22.959 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115684+0000", 2020-11-16T20:57:22.959 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5156e-05 2020-11-16T20:57:22.959 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.959 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.959 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:22.960 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115699+0000", 2020-11-16T20:57:22.960 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.852e-06 2020-11-16T20:57:22.960 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.960 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.960 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:22.960 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115702+0000", 2020-11-16T20:57:22.960 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.366e-06 2020-11-16T20:57:22.960 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.961 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.961 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:22.961 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115707+0000", 2020-11-16T20:57:22.961 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5110000000000002e-06 2020-11-16T20:57:22.961 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.961 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.961 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:22.962 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115710+0000", 2020-11-16T20:57:22.962 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00026113800000000001 2020-11-16T20:57:22.962 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.962 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.962 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:22.962 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115971+0000", 2020-11-16T20:57:22.962 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5478000000000002e-05 2020-11-16T20:57:22.963 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.963 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.963 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:22.963 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.116007+0000", 2020-11-16T20:57:22.963 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011434730000000001 2020-11-16T20:57:22.963 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.963 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.963 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:22.964 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.127441+0000", 2020-11-16T20:57:22.964 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000106121 2020-11-16T20:57:22.964 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.964 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.964 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:22.964 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.127547+0000", 2020-11-16T20:57:22.964 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019369799999999999 2020-11-16T20:57:22.965 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.965 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.965 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:22.965 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.127741+0000", 2020-11-16T20:57:22.965 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8986999999999999e-05 2020-11-16T20:57:22.965 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.965 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.965 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:22.966 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.127770+0000", 2020-11-16T20:57:22.966 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0079205560000000005 2020-11-16T20:57:22.966 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.966 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.966 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:22.966 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.135691+0000", 2020-11-16T20:57:22.966 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010364799999999999 2020-11-16T20:57:22.967 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.967 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.967 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:22.967 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.135794+0000", 2020-11-16T20:57:22.967 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000194532 2020-11-16T20:57:22.967 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.967 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.968 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:57:22.968 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.135989+0000", 2020-11-16T20:57:22.968 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001241301 2020-11-16T20:57:22.968 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.968 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.968 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:22.968 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.137230+0000", 2020-11-16T20:57:22.968 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9125000000000002e-05 2020-11-16T20:57:22.969 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.969 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.969 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for ondisk", 2020-11-16T20:57:22.969 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.137269+0000", 2020-11-16T20:57:22.969 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0014352239999999999 2020-11-16T20:57:22.969 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.969 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.970 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:22.970 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.138704+0000", 2020-11-16T20:57:22.970 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0076177900000000002 2020-11-16T20:57:22.970 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.970 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.970 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:22.970 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.146322+0000", 2020-11-16T20:57:22.970 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0024308260000000001 2020-11-16T20:57:22.971 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.971 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.971 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:22.971 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.148753+0000", 2020-11-16T20:57:22.971 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4169999999999999e-05 2020-11-16T20:57:22.971 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.971 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.972 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:22.972 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.148797+0000", 2020-11-16T20:57:22.972 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9681999999999997e-05 2020-11-16T20:57:22.972 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.972 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.972 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:22.972 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.148837+0000", 2020-11-16T20:57:22.972 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033152890999999997 2020-11-16T20:57:22.973 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:22.973 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:22.973 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:22.973 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.973 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.973 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2346 4.3 4:c9160c9c:::smithi16641208-411:head [append 0~0] snapc 6=[6,5,4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e41)", 2020-11-16T20:57:22.973 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:04.115728+0000", 2020-11-16T20:57:22.974 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 78.843224441999993, 2020-11-16T20:57:22.974 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035920868000000002, 2020-11-16T20:57:22.974 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:22.974 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:22.974 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:22.974 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:22.974 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:22.975 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2346 2020-11-16T20:57:22.975 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.975 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:22.975 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.975 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:22.975 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115728+0000", 2020-11-16T20:57:22.975 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:22.975 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.976 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.976 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:22.976 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115728+0000", 2020-11-16T20:57:22.976 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4843e-05 2020-11-16T20:57:22.976 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.976 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.976 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:22.977 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115743+0000", 2020-11-16T20:57:22.977 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6399999999999999e-06 2020-11-16T20:57:22.977 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.977 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.977 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:22.977 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115746+0000", 2020-11-16T20:57:22.977 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1749999999999996e-06 2020-11-16T20:57:22.977 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.978 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.978 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:22.978 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115751+0000", 2020-11-16T20:57:22.978 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2500000000000001e-06 2020-11-16T20:57:22.978 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.978 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.978 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:22.979 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115754+0000", 2020-11-16T20:57:22.979 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00027690100000000002 2020-11-16T20:57:22.979 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.979 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.979 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:22.979 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.116031+0000", 2020-11-16T20:57:22.979 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8213000000000001e-05 2020-11-16T20:57:22.979 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.980 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.980 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:22.980 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.116079+0000", 2020-11-16T20:57:22.980 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011729105 2020-11-16T20:57:22.980 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.980 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.980 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:22.981 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.127808+0000", 2020-11-16T20:57:22.981 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8734e-05 2020-11-16T20:57:22.981 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.981 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.981 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:22.981 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.127837+0000", 2020-11-16T20:57:22.981 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094608379999999992 2020-11-16T20:57:22.982 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.982 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.982 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:22.982 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.137297+0000", 2020-11-16T20:57:22.982 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8356999999999996e-05 2020-11-16T20:57:22.982 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.982 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.982 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:22.983 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.137366+0000", 2020-11-16T20:57:22.983 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010179300000000001 2020-11-16T20:57:22.983 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.983 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.983 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:57:22.983 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.137468+0000", 2020-11-16T20:57:22.983 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001540626 2020-11-16T20:57:22.984 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.984 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.984 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:22.984 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.139008+0000", 2020-11-16T20:57:22.984 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0073602659999999999 2020-11-16T20:57:22.984 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.984 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.984 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:22.985 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.146369+0000", 2020-11-16T20:57:22.985 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.005211467 2020-11-16T20:57:22.985 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.985 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.985 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:22.985 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.151580+0000", 2020-11-16T20:57:22.985 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2265000000000003e-05 2020-11-16T20:57:22.986 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.986 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.986 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:22.986 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.151622+0000", 2020-11-16T20:57:22.986 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6395000000000001e-05 2020-11-16T20:57:22.986 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.986 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.986 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:22.987 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.151649+0000", 2020-11-16T20:57:22.987 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035920868000000002 2020-11-16T20:57:22.987 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:22.987 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:22.987 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:22.987 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.987 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.988 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2423 4.3 4:c5716d1e:::smithi16641208-111:head [copy-from ver 265] snapc 7=[7,5] ondisk+write+known_if_redirected e46)", 2020-11-16T20:57:22.988 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.026587+0000", 2020-11-16T20:57:22.988 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 73.932365001999997, 2020-11-16T20:57:22.988 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039457442000000002, 2020-11-16T20:57:22.988 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:22.988 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:22.988 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:22.988 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:22.989 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:22.989 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2423 2020-11-16T20:57:22.989 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.989 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:22.989 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.989 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:22.989 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026587+0000", 2020-11-16T20:57:22.990 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:22.990 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.990 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.990 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:22.990 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026587+0000", 2020-11-16T20:57:22.990 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2777000000000001e-05 2020-11-16T20:57:22.990 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.990 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.991 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:22.991 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026630+0000", 2020-11-16T20:57:22.991 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.993e-06 2020-11-16T20:57:22.991 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.991 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.991 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:22.991 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026636+0000", 2020-11-16T20:57:22.992 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1423000000000001e-05 2020-11-16T20:57:22.992 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.992 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.992 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:22.992 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026647+0000", 2020-11-16T20:57:22.992 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1880000000000001e-06 2020-11-16T20:57:22.992 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.992 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.993 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:22.993 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026653+0000", 2020-11-16T20:57:22.993 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00021074700000000001 2020-11-16T20:57:22.993 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.993 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.993 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:22.993 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026863+0000", 2020-11-16T20:57:22.994 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039178896999999997 2020-11-16T20:57:22.994 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.994 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.994 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:22.994 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.066042+0000", 2020-11-16T20:57:22.994 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4169999999999999e-06 2020-11-16T20:57:22.994 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.994 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.995 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:22.995 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.066045+0000", 2020-11-16T20:57:22.995 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039457442000000002 2020-11-16T20:57:22.995 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:22.995 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:22.995 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:22.995 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.996 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.996 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2424 4.3 4:c5716d1e:::smithi16641208-111:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e46)", 2020-11-16T20:57:22.996 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.026685+0000", 2020-11-16T20:57:22.996 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 73.93226722, 2020-11-16T20:57:22.996 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065304164999999997, 2020-11-16T20:57:22.996 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:22.996 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:22.996 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:22.997 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:22.997 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:22.997 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2424 2020-11-16T20:57:22.997 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.997 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:22.997 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.997 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:22.998 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026685+0000", 2020-11-16T20:57:22.998 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:22.998 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.998 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.998 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:22.998 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026685+0000", 2020-11-16T20:57:22.998 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4087000000000001e-05 2020-11-16T20:57:22.999 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.999 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.999 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:22.999 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026719+0000", 2020-11-16T20:57:22.999 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2298e-05 2020-11-16T20:57:22.999 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:22.999 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:22.999 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.000 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026731+0000", 2020-11-16T20:57:23.000 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1001e-05 2020-11-16T20:57:23.000 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.000 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.000 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.000 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026742+0000", 2020-11-16T20:57:23.000 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6129999999999997e-06 2020-11-16T20:57:23.001 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.001 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.001 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.001 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026747+0000", 2020-11-16T20:57:23.001 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00047150600000000001 2020-11-16T20:57:23.001 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.001 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.001 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.002 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.027219+0000", 2020-11-16T20:57:23.002 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5602999999999998e-05 2020-11-16T20:57:23.002 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.002 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.002 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:23.002 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.027254+0000", 2020-11-16T20:57:23.002 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050318838999999997 2020-11-16T20:57:23.003 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.003 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.003 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.003 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.077573+0000", 2020-11-16T20:57:23.003 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6290000000000001e-05 2020-11-16T20:57:23.003 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.003 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.003 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:23.004 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.077669+0000", 2020-11-16T20:57:23.004 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014149599000000001 2020-11-16T20:57:23.004 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.004 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.004 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.004 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.091819+0000", 2020-11-16T20:57:23.004 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6891000000000005e-05 2020-11-16T20:57:23.005 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.005 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.005 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.005 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.091906+0000", 2020-11-16T20:57:23.005 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3437999999999996e-05 2020-11-16T20:57:23.005 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.005 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.005 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.006 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.091989+0000", 2020-11-16T20:57:23.006 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065304164999999997 2020-11-16T20:57:23.006 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.006 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.006 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.006 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.006 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.007 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.4.13:681 3.1 3:afc69464:::smithi16641208-110:head [copy-from ver 103] snapc 4=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e52)", 2020-11-16T20:57:23.007 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.786343+0000", 2020-11-16T20:57:23.007 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 68.172609578999996, 2020-11-16T20:57:23.007 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042629590000000002, 2020-11-16T20:57:23.007 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.007 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:23.007 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.008 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.008 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.008 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786343+0000", 2020-11-16T20:57:23.008 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.008 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.008 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.008 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.008 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786343+0000", 2020-11-16T20:57:23.009 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6380000000000002e-05 2020-11-16T20:57:23.009 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.009 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.009 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.009 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786369+0000", 2020-11-16T20:57:23.009 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8649999999999998e-06 2020-11-16T20:57:23.009 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.010 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.010 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.010 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786375+0000", 2020-11-16T20:57:23.010 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2170999999999999e-05 2020-11-16T20:57:23.010 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.010 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.010 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.011 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786387+0000", 2020-11-16T20:57:23.011 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8500000000000002e-06 2020-11-16T20:57:23.011 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.011 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.011 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.011 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786392+0000", 2020-11-16T20:57:23.011 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001049119 2020-11-16T20:57:23.011 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.012 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.012 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.012 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.787441+0000", 2020-11-16T20:57:23.012 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6489000000000006e-05 2020-11-16T20:57:23.012 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.012 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.012 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.013 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.787518+0000", 2020-11-16T20:57:23.013 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0097007229999999996 2020-11-16T20:57:23.013 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.013 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.013 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 3,4", 2020-11-16T20:57:23.013 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.797218+0000", 2020-11-16T20:57:23.013 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012009956 2020-11-16T20:57:23.013 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.014 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.014 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.014 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.809228+0000", 2020-11-16T20:57:23.014 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019396673 2020-11-16T20:57:23.014 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.014 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.014 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:23.015 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828625+0000", 2020-11-16T20:57:23.015 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023723099999999999 2020-11-16T20:57:23.015 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.015 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.015 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.015 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828862+0000", 2020-11-16T20:57:23.015 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2475000000000002e-05 2020-11-16T20:57:23.015 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.016 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:23.016 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828915+0000", 2020-11-16T20:57:23.016 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7658000000000003e-05 2020-11-16T20:57:23.016 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.016 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.017 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828972+0000", 2020-11-16T20:57:23.017 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042629590000000002 2020-11-16T20:57:23.017 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.017 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.017 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.017 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.017 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.017 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.4.13:682 3.1 3:b3ae2c4d:::smithi16641208-463:head [copy-from ver 402] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e52)", 2020-11-16T20:57:23.018 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.786452+0000", 2020-11-16T20:57:23.018 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 68.172500393999997, 2020-11-16T20:57:23.018 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042767143000000001, 2020-11-16T20:57:23.018 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.018 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:23.018 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.018 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.019 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.019 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786452+0000", 2020-11-16T20:57:23.019 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.019 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.019 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.019 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.019 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786452+0000", 2020-11-16T20:57:23.019 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.025e-05 2020-11-16T20:57:23.020 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.020 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.020 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.020 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786482+0000", 2020-11-16T20:57:23.020 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5779999999999999e-06 2020-11-16T20:57:23.020 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.020 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.021 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.021 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786486+0000", 2020-11-16T20:57:23.021 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0480000000000004e-06 2020-11-16T20:57:23.021 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.021 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.021 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.021 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786492+0000", 2020-11-16T20:57:23.021 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.101e-06 2020-11-16T20:57:23.022 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.022 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.022 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.022 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786495+0000", 2020-11-16T20:57:23.022 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001206213 2020-11-16T20:57:23.022 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.022 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.023 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.023 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.787701+0000", 2020-11-16T20:57:23.023 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0668999999999998e-05 2020-11-16T20:57:23.023 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.023 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.023 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.023 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.787762+0000", 2020-11-16T20:57:23.024 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014276095000000001 2020-11-16T20:57:23.024 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.024 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.024 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 3,4", 2020-11-16T20:57:23.024 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.802038+0000", 2020-11-16T20:57:23.024 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0099596760000000006 2020-11-16T20:57:23.024 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.024 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.025 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.025 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.811997+0000", 2020-11-16T20:57:23.025 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017095757999999999 2020-11-16T20:57:23.025 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.025 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.025 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.025 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.829093+0000", 2020-11-16T20:57:23.025 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4833999999999998e-05 2020-11-16T20:57:23.026 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.026 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.026 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:23.026 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.829138+0000", 2020-11-16T20:57:23.026 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4724000000000001e-05 2020-11-16T20:57:23.026 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.026 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.027 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:23.027 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.829183+0000", 2020-11-16T20:57:23.027 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6196999999999999e-05 2020-11-16T20:57:23.027 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.027 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.027 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.027 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.829219+0000", 2020-11-16T20:57:23.028 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042767143000000001 2020-11-16T20:57:23.028 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.028 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.028 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.028 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.028 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.028 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2589 4.3 4:f65e82cb:::smithi16641208-219:head [write 1800933~725518] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:57:23.028 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.782219+0000", 2020-11-16T20:57:23.029 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 63.176733423999998, 2020-11-16T20:57:23.029 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.069486665000000003, 2020-11-16T20:57:23.029 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.029 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:23.029 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:23.029 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:23.029 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:23.030 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2589 2020-11-16T20:57:23.030 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.030 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.030 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.030 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.030 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782219+0000", 2020-11-16T20:57:23.030 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.030 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.031 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.031 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.031 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782219+0000", 2020-11-16T20:57:23.031 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00038710600000000002 2020-11-16T20:57:23.031 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.031 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.031 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.032 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782606+0000", 2020-11-16T20:57:23.032 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.628e-06 2020-11-16T20:57:23.032 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.032 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.032 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.032 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782616+0000", 2020-11-16T20:57:23.032 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5631999999999999e-05 2020-11-16T20:57:23.032 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.033 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.033 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.033 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782631+0000", 2020-11-16T20:57:23.033 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6249999999999998e-06 2020-11-16T20:57:23.033 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.033 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.033 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.034 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782639+0000", 2020-11-16T20:57:23.034 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3213999999999997e-05 2020-11-16T20:57:23.034 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.034 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.034 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.034 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782672+0000", 2020-11-16T20:57:23.034 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9141000000000003e-05 2020-11-16T20:57:23.035 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.035 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.035 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:23.035 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782721+0000", 2020-11-16T20:57:23.035 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017807030000000001 2020-11-16T20:57:23.035 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.035 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.035 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.036 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800528+0000", 2020-11-16T20:57:23.036 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016577399999999999 2020-11-16T20:57:23.036 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.036 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.036 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.036 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800694+0000", 2020-11-16T20:57:23.036 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00026135900000000002 2020-11-16T20:57:23.037 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.037 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.037 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:57:23.037 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800955+0000", 2020-11-16T20:57:23.037 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0074407529999999996 2020-11-16T20:57:23.037 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.037 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.037 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:23.038 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808396+0000", 2020-11-16T20:57:23.038 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011788041000000001 2020-11-16T20:57:23.038 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.038 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.038 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.038 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.820184+0000", 2020-11-16T20:57:23.038 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031417394000000001 2020-11-16T20:57:23.039 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.039 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.039 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.039 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851602+0000", 2020-11-16T20:57:23.039 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0005e-05 2020-11-16T20:57:23.039 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.039 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.039 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:23.040 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851652+0000", 2020-11-16T20:57:23.040 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3962999999999998e-05 2020-11-16T20:57:23.040 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.040 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.040 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.040 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851705+0000", 2020-11-16T20:57:23.040 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.069486665000000003 2020-11-16T20:57:23.041 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.041 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.041 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.041 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.041 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.041 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2590 4.3 4:f65e82cb:::smithi16641208-219:head [write 2944601~232021] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:57:23.041 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.785957+0000", 2020-11-16T20:57:23.041 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 63.172995733999997, 2020-11-16T20:57:23.042 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065959045999999993, 2020-11-16T20:57:23.042 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.042 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:23.042 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:23.042 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:23.042 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:23.042 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2590 2020-11-16T20:57:23.043 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.043 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.043 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.043 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.043 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.785957+0000", 2020-11-16T20:57:23.043 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.043 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.043 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.044 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.044 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.785957+0000", 2020-11-16T20:57:23.044 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6058999999999998e-05 2020-11-16T20:57:23.044 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.044 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.044 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.044 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786033+0000", 2020-11-16T20:57:23.045 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1582999999999999e-05 2020-11-16T20:57:23.045 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.045 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.045 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.045 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786064+0000", 2020-11-16T20:57:23.045 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8099999999999992e-06 2020-11-16T20:57:23.045 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.045 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.046 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.046 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786074+0000", 2020-11-16T20:57:23.046 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.198e-06 2020-11-16T20:57:23.046 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.046 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.046 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.046 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786079+0000", 2020-11-16T20:57:23.047 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0587999999999997e-05 2020-11-16T20:57:23.047 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.047 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.047 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.047 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786130+0000", 2020-11-16T20:57:23.047 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5791000000000007e-05 2020-11-16T20:57:23.047 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.047 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.048 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:23.048 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786206+0000", 2020-11-16T20:57:23.048 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016623412000000001 2020-11-16T20:57:23.048 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.048 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.048 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.048 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.802829+0000", 2020-11-16T20:57:23.049 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012361699999999999 2020-11-16T20:57:23.049 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.049 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.049 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.049 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.802953+0000", 2020-11-16T20:57:23.049 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000161807 2020-11-16T20:57:23.049 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.049 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.050 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:57:23.050 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.803114+0000", 2020-11-16T20:57:23.050 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.005291535 2020-11-16T20:57:23.050 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.050 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.050 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:23.050 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808406+0000", 2020-11-16T20:57:23.051 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011819998999999999 2020-11-16T20:57:23.051 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.051 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.051 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.051 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.820226+0000", 2020-11-16T20:57:23.051 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031546375000000001 2020-11-16T20:57:23.051 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.051 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.052 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.052 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851772+0000", 2020-11-16T20:57:23.052 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9140000000000005e-05 2020-11-16T20:57:23.052 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.052 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.052 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:23.052 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851851+0000", 2020-11-16T20:57:23.053 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4132000000000002e-05 2020-11-16T20:57:23.053 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.053 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.053 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.053 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851916+0000", 2020-11-16T20:57:23.053 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065959045999999993 2020-11-16T20:57:23.053 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.053 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.054 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.054 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.054 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.054 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2591 4.3 4:f65e82cb:::smithi16641208-219:head [setxattr _header (58) in=7b,truncate 3176622] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:57:23.054 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.786110+0000", 2020-11-16T20:57:23.054 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 63.172842201000002, 2020-11-16T20:57:23.054 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066016654999999994, 2020-11-16T20:57:23.055 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.055 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:23.055 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:23.055 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:23.055 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:23.055 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2591 2020-11-16T20:57:23.055 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.055 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.056 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.056 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.056 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786110+0000", 2020-11-16T20:57:23.056 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.056 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.056 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.056 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.057 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786110+0000", 2020-11-16T20:57:23.057 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5616e-05 2020-11-16T20:57:23.057 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.057 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.057 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.057 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786136+0000", 2020-11-16T20:57:23.057 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5329999999999999e-06 2020-11-16T20:57:23.057 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.058 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.058 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.058 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786139+0000", 2020-11-16T20:57:23.058 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7440000000000004e-06 2020-11-16T20:57:23.058 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.058 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.058 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.059 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786145+0000", 2020-11-16T20:57:23.059 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0120000000000001e-06 2020-11-16T20:57:23.059 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.059 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.059 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.059 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786148+0000", 2020-11-16T20:57:23.059 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5617000000000004e-05 2020-11-16T20:57:23.060 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.060 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.060 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.060 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786234+0000", 2020-11-16T20:57:23.060 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0964000000000001e-05 2020-11-16T20:57:23.060 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.060 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.060 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:23.061 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786295+0000", 2020-11-16T20:57:23.061 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017673271000000001 2020-11-16T20:57:23.061 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.061 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.061 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.061 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.803968+0000", 2020-11-16T20:57:23.061 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000155272 2020-11-16T20:57:23.062 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.062 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.062 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.062 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.804123+0000", 2020-11-16T20:57:23.062 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00027357299999999999 2020-11-16T20:57:23.062 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.062 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.062 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:57:23.063 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.804397+0000", 2020-11-16T20:57:23.063 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040142659999999998 2020-11-16T20:57:23.063 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.063 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.063 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:23.063 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808411+0000", 2020-11-16T20:57:23.063 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011837194000000001 2020-11-16T20:57:23.064 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.064 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.064 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.064 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.820248+0000", 2020-11-16T20:57:23.064 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031735780999999998 2020-11-16T20:57:23.064 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.064 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.064 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.065 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851984+0000", 2020-11-16T20:57:23.065 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0603000000000001e-05 2020-11-16T20:57:23.065 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:23.065 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852054+0000", 2020-11-16T20:57:23.065 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2208999999999999e-05 2020-11-16T20:57:23.066 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.066 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.066 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852127+0000", 2020-11-16T20:57:23.066 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066016654999999994 2020-11-16T20:57:23.066 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.066 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.066 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.067 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.067 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.067 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2592 4.3 4:f65e82cb:::smithi16641208-219:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:57:23.067 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.786176+0000", 2020-11-16T20:57:23.067 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 63.172776718000001, 2020-11-16T20:57:23.067 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066389967999999994, 2020-11-16T20:57:23.067 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.068 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:23.068 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:23.068 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:23.068 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:23.068 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2592 2020-11-16T20:57:23.068 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.068 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.069 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.069 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.069 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786176+0000", 2020-11-16T20:57:23.069 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.069 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.069 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.069 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.069 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786176+0000", 2020-11-16T20:57:23.070 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1280999999999998e-05 2020-11-16T20:57:23.070 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.070 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.070 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.070 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786197+0000", 2020-11-16T20:57:23.070 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.349e-06 2020-11-16T20:57:23.070 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.071 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.071 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.071 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786200+0000", 2020-11-16T20:57:23.071 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4840000000000001e-06 2020-11-16T20:57:23.071 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.071 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.071 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.071 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786207+0000", 2020-11-16T20:57:23.072 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3390000000000001e-06 2020-11-16T20:57:23.072 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.072 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.072 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.072 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786210+0000", 2020-11-16T20:57:23.072 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000115748 2020-11-16T20:57:23.072 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.073 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.073 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.073 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786326+0000", 2020-11-16T20:57:23.073 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6062e-05 2020-11-16T20:57:23.073 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.073 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.073 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:23.073 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786372+0000", 2020-11-16T20:57:23.074 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021773975000000001 2020-11-16T20:57:23.074 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.074 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.074 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.074 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808146+0000", 2020-11-16T20:57:23.074 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014829900000000001 2020-11-16T20:57:23.074 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.075 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.075 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:23.075 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808294+0000", 2020-11-16T20:57:23.075 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.043877869999999999 2020-11-16T20:57:23.075 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.075 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.075 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.075 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852172+0000", 2020-11-16T20:57:23.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000145322 2020-11-16T20:57:23.076 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.076 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.076 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.076 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852317+0000", 2020-11-16T20:57:23.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024823899999999998 2020-11-16T20:57:23.076 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.077 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.077 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.077 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852565+0000", 2020-11-16T20:57:23.077 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066389967999999994 2020-11-16T20:57:23.077 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.077 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.077 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.077 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.078 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.078 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2593 4.3 4:f5f8fa2a:::smithi16641208-144:head [copy-from ver 64] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:57:23.078 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.786250+0000", 2020-11-16T20:57:23.078 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 63.172701939, 2020-11-16T20:57:23.078 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065186216000000005, 2020-11-16T20:57:23.078 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.078 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:23.079 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:23.079 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:23.079 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:23.079 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2593 2020-11-16T20:57:23.079 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.079 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.079 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.080 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.080 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786250+0000", 2020-11-16T20:57:23.080 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.080 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.080 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.080 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.080 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786250+0000", 2020-11-16T20:57:23.080 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2438999999999998e-05 2020-11-16T20:57:23.081 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.081 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.081 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.081 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786293+0000", 2020-11-16T20:57:23.081 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6840000000000001e-06 2020-11-16T20:57:23.081 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.081 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.082 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.082 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786298+0000", 2020-11-16T20:57:23.082 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4331999999999999e-05 2020-11-16T20:57:23.082 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.082 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.082 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.082 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786313+0000", 2020-11-16T20:57:23.082 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6460000000000001e-06 2020-11-16T20:57:23.083 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.083 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.083 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.083 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786317+0000", 2020-11-16T20:57:23.083 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5451999999999995e-05 2020-11-16T20:57:23.083 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.083 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.084 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.084 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786393+0000", 2020-11-16T20:57:23.084 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065041011999999995 2020-11-16T20:57:23.084 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.084 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.084 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:23.084 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851434+0000", 2020-11-16T20:57:23.085 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6510000000000001e-06 2020-11-16T20:57:23.085 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.085 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.085 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.085 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851437+0000", 2020-11-16T20:57:23.085 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065186216000000005 2020-11-16T20:57:23.085 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.085 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.086 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.086 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.086 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.086 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2594 4.3 4:f5f8fa2a:::smithi16641208-144:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:57:23.086 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.786352+0000", 2020-11-16T20:57:23.086 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 63.172600645999999, 2020-11-16T20:57:23.086 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.089305972999999997, 2020-11-16T20:57:23.087 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.087 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:23.087 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:23.087 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:23.087 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:23.087 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2594 2020-11-16T20:57:23.087 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.087 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.088 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.088 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.088 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786352+0000", 2020-11-16T20:57:23.088 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.088 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.088 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.088 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.089 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786352+0000", 2020-11-16T20:57:23.089 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5896000000000001e-05 2020-11-16T20:57:23.089 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.089 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.089 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.089 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786377+0000", 2020-11-16T20:57:23.089 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7700000000000004e-06 2020-11-16T20:57:23.089 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.090 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.090 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.090 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786384+0000", 2020-11-16T20:57:23.090 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.049e-05 2020-11-16T20:57:23.090 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.090 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.090 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.091 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786395+0000", 2020-11-16T20:57:23.091 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0440000000000003e-06 2020-11-16T20:57:23.091 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.091 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.091 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.091 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786400+0000", 2020-11-16T20:57:23.091 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000366771 2020-11-16T20:57:23.092 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.092 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.092 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.092 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786767+0000", 2020-11-16T20:57:23.092 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1366999999999998e-05 2020-11-16T20:57:23.092 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.092 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.092 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:23.093 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786818+0000", 2020-11-16T20:57:23.093 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.077259257999999997 2020-11-16T20:57:23.093 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.093 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.093 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.093 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.864077+0000", 2020-11-16T20:57:23.093 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018375499999999999 2020-11-16T20:57:23.093 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.094 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.094 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:23.094 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.864261+0000", 2020-11-16T20:57:23.094 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011122837 2020-11-16T20:57:23.094 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.094 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.094 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.095 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.875384+0000", 2020-11-16T20:57:23.095 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000135752 2020-11-16T20:57:23.095 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.095 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.095 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.095 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.875520+0000", 2020-11-16T20:57:23.095 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000138033 2020-11-16T20:57:23.096 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.096 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.096 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.096 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.875658+0000", 2020-11-16T20:57:23.096 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.089305972999999997 2020-11-16T20:57:23.096 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.096 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.096 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.097 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.097 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.097 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2872 4.3 4:d9c18080:::smithi16641208-173:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-11-16T20:57:23.097 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:34.745479+0000", 2020-11-16T20:57:23.097 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 48.213473381999997, 2020-11-16T20:57:23.097 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.059388271999999999, 2020-11-16T20:57:23.097 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.098 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:23.098 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:23.098 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:23.098 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:23.098 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2872 2020-11-16T20:57:23.098 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.098 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.098 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.099 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.099 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745479+0000", 2020-11-16T20:57:23.099 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.099 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.099 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.099 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.099 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745479+0000", 2020-11-16T20:57:23.100 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0491e-05 2020-11-16T20:57:23.100 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.100 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.100 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.100 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745509+0000", 2020-11-16T20:57:23.100 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9170000000000003e-06 2020-11-16T20:57:23.100 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.100 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.101 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.101 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745515+0000", 2020-11-16T20:57:23.101 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1267000000000001e-05 2020-11-16T20:57:23.101 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.101 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.101 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.101 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745527+0000", 2020-11-16T20:57:23.102 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.04e-06 2020-11-16T20:57:23.102 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.102 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.102 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.102 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745532+0000", 2020-11-16T20:57:23.102 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034800500000000003 2020-11-16T20:57:23.102 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.102 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.103 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.103 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745880+0000", 2020-11-16T20:57:23.103 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6010000000000003e-05 2020-11-16T20:57:23.103 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.103 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.103 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:23.103 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745916+0000", 2020-11-16T20:57:23.104 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042557927000000002 2020-11-16T20:57:23.104 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.104 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.104 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.104 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.788474+0000", 2020-11-16T20:57:23.104 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000160614 2020-11-16T20:57:23.104 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.104 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.105 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:23.105 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.788634+0000", 2020-11-16T20:57:23.105 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016066745 2020-11-16T20:57:23.105 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.105 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.105 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.105 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.804701+0000", 2020-11-16T20:57:23.106 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3805000000000001e-05 2020-11-16T20:57:23.106 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.106 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.106 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.106 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.804785+0000", 2020-11-16T20:57:23.106 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2451000000000001e-05 2020-11-16T20:57:23.106 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.106 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.107 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.107 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.804867+0000", 2020-11-16T20:57:23.107 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.059388271999999999 2020-11-16T20:57:23.107 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.107 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.107 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.107 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.108 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.108 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2961 4.3 4:c925a80f:::smithi16641208-375:head [write 531253~411999,stat] snapc 2d=[2d,25] ondisk+write+known_if_redirected e82)", 2020-11-16T20:57:23.108 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.744743+0000", 2020-11-16T20:57:23.108 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.214208743999997, 2020-11-16T20:57:23.108 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037689271000000003, 2020-11-16T20:57:23.108 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.108 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:23.108 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:23.109 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:23.109 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:23.109 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2961 2020-11-16T20:57:23.109 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.109 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.109 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.109 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.110 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.744743+0000", 2020-11-16T20:57:23.110 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.110 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.110 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.110 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.110 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.744743+0000", 2020-11-16T20:57:23.110 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033429999999999999 2020-11-16T20:57:23.111 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.111 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.111 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.111 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.745078+0000", 2020-11-16T20:57:23.111 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9050000000000003e-06 2020-11-16T20:57:23.111 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.111 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.111 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.112 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.745087+0000", 2020-11-16T20:57:23.112 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6243999999999999e-05 2020-11-16T20:57:23.112 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.112 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.112 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.112 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.745103+0000", 2020-11-16T20:57:23.112 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8470000000000008e-06 2020-11-16T20:57:23.113 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.113 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.113 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.745113+0000", 2020-11-16T20:57:23.113 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00050440200000000004 2020-11-16T20:57:23.113 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.113 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.114 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.745617+0000", 2020-11-16T20:57:23.114 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036809989000000001 2020-11-16T20:57:23.114 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.114 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.114 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:23.114 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.782427+0000", 2020-11-16T20:57:23.114 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5840000000000002e-06 2020-11-16T20:57:23.115 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.115 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.115 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.115 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.782433+0000", 2020-11-16T20:57:23.115 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037689271000000003 2020-11-16T20:57:23.115 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.115 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.115 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.116 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.116 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.116 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2962 4.3 4:c925a80f:::smithi16641208-375:head [write 1381780~411527] snapc 2d=[2d,25] ondisk+write+known_if_redirected e82)", 2020-11-16T20:57:23.116 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.749629+0000", 2020-11-16T20:57:23.116 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.209323624, 2020-11-16T20:57:23.116 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.052987905000000002, 2020-11-16T20:57:23.116 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.117 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:23.117 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:23.117 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:23.117 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:23.117 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2962 2020-11-16T20:57:23.117 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.117 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.117 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.118 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.118 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.749629+0000", 2020-11-16T20:57:23.118 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.118 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.118 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.118 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.118 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.749629+0000", 2020-11-16T20:57:23.119 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00039027700000000002 2020-11-16T20:57:23.119 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.119 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.119 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.119 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750019+0000", 2020-11-16T20:57:23.119 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0961000000000001e-05 2020-11-16T20:57:23.119 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.119 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.120 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.120 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750030+0000", 2020-11-16T20:57:23.120 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7931000000000002e-05 2020-11-16T20:57:23.120 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.120 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.120 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.120 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750048+0000", 2020-11-16T20:57:23.121 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3030000000000005e-06 2020-11-16T20:57:23.121 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.121 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.121 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.121 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750057+0000", 2020-11-16T20:57:23.121 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8351999999999999e-05 2020-11-16T20:57:23.121 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.121 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.122 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.122 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750125+0000", 2020-11-16T20:57:23.122 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010314000000000001 2020-11-16T20:57:23.122 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.122 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.122 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:23.122 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750229+0000", 2020-11-16T20:57:23.123 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039625369000000001 2020-11-16T20:57:23.123 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.123 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.123 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.123 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.789854+0000", 2020-11-16T20:57:23.123 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000153096 2020-11-16T20:57:23.123 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.123 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.124 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.124 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790007+0000", 2020-11-16T20:57:23.124 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022176699999999999 2020-11-16T20:57:23.124 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.124 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.124 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:57:23.124 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790229+0000", 2020-11-16T20:57:23.125 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0059379410000000004 2020-11-16T20:57:23.125 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.125 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.125 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:23.125 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.796167+0000", 2020-11-16T20:57:23.125 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0013346230000000001 2020-11-16T20:57:23.125 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.125 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.126 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.126 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.797501+0000", 2020-11-16T20:57:23.126 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0049809470000000003 2020-11-16T20:57:23.126 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.126 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.126 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.126 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802482+0000", 2020-11-16T20:57:23.127 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1831999999999998e-05 2020-11-16T20:57:23.127 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.127 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.127 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:23.127 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802574+0000", 2020-11-16T20:57:23.127 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2366000000000001e-05 2020-11-16T20:57:23.127 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.128 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.128 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.128 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802617+0000", 2020-11-16T20:57:23.128 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.052987905000000002 2020-11-16T20:57:23.128 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.128 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.128 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.128 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.129 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.129 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2963 4.3 4:c925a80f:::smithi16641208-375:head [write 2300501~586966] snapc 2d=[2d,25] ondisk+write+known_if_redirected e82)", 2020-11-16T20:57:23.129 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.756229+0000", 2020-11-16T20:57:23.129 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.202723319999997, 2020-11-16T20:57:23.129 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.046550438999999999, 2020-11-16T20:57:23.129 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.129 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:23.130 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:23.130 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:23.130 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:23.130 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2963 2020-11-16T20:57:23.130 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.130 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.130 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.130 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.131 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.756229+0000", 2020-11-16T20:57:23.131 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.131 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.131 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.131 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.131 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.756229+0000", 2020-11-16T20:57:23.131 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00042272700000000002 2020-11-16T20:57:23.132 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.132 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.132 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.132 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.756652+0000", 2020-11-16T20:57:23.132 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7900000000000005e-06 2020-11-16T20:57:23.132 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.132 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.132 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.133 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.756660+0000", 2020-11-16T20:57:23.133 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8972000000000001e-05 2020-11-16T20:57:23.133 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.133 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.133 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.133 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.756679+0000", 2020-11-16T20:57:23.133 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.4299999999999995e-06 2020-11-16T20:57:23.134 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.134 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.134 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.134 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.756689+0000", 2020-11-16T20:57:23.134 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002317586 2020-11-16T20:57:23.134 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.134 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.134 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.135 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759006+0000", 2020-11-16T20:57:23.135 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2758999999999997e-05 2020-11-16T20:57:23.135 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.135 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.135 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:23.135 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759099+0000", 2020-11-16T20:57:23.135 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032185841 2020-11-16T20:57:23.136 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.136 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.136 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.136 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.791285+0000", 2020-11-16T20:57:23.136 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018714299999999999 2020-11-16T20:57:23.136 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.136 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.136 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.137 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.791472+0000", 2020-11-16T20:57:23.137 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00025010899999999999 2020-11-16T20:57:23.137 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.137 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.137 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:57:23.137 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.791722+0000", 2020-11-16T20:57:23.137 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044518370000000002 2020-11-16T20:57:23.138 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.138 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.138 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:23.138 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.796174+0000", 2020-11-16T20:57:23.138 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0015727860000000001 2020-11-16T20:57:23.138 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.138 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.139 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.139 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.797747+0000", 2020-11-16T20:57:23.139 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0049201610000000002 2020-11-16T20:57:23.139 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.139 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.139 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.139 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802667+0000", 2020-11-16T20:57:23.139 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3230000000000003e-05 2020-11-16T20:57:23.140 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.140 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.140 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:23.140 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802730+0000", 2020-11-16T20:57:23.140 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9067999999999998e-05 2020-11-16T20:57:23.140 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.140 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.141 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.141 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802779+0000", 2020-11-16T20:57:23.141 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.046550438999999999 2020-11-16T20:57:23.141 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.141 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.141 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.141 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.141 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.142 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2964 4.3 4:c925a80f:::smithi16641208-375:head [write 3376974~354279] snapc 2d=[2d,25] ondisk+write+known_if_redirected e82)", 2020-11-16T20:57:23.142 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.761493+0000", 2020-11-16T20:57:23.142 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.197459090999999, 2020-11-16T20:57:23.142 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041469457000000001, 2020-11-16T20:57:23.142 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.142 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:23.142 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:23.143 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:23.143 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:23.143 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2964 2020-11-16T20:57:23.143 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.143 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.143 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.143 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.143 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761493+0000", 2020-11-16T20:57:23.144 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.144 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.144 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.144 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.144 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761493+0000", 2020-11-16T20:57:23.144 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00026002099999999998 2020-11-16T20:57:23.144 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.145 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.145 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.145 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761753+0000", 2020-11-16T20:57:23.145 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4440000000000008e-06 2020-11-16T20:57:23.145 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.145 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.145 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.145 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761762+0000", 2020-11-16T20:57:23.146 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3835000000000001e-05 2020-11-16T20:57:23.146 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.146 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.146 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.146 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761775+0000", 2020-11-16T20:57:23.146 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.876e-06 2020-11-16T20:57:23.146 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.147 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.147 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.147 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761785+0000", 2020-11-16T20:57:23.147 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017208666000000001 2020-11-16T20:57:23.147 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.147 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.147 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.147 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.778994+0000", 2020-11-16T20:57:23.148 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033175300000000001 2020-11-16T20:57:23.148 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.148 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.148 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:23.148 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.779326+0000", 2020-11-16T20:57:23.148 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013958096 2020-11-16T20:57:23.148 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.149 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.149 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.149 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.793284+0000", 2020-11-16T20:57:23.149 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015513300000000001 2020-11-16T20:57:23.149 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.149 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.149 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.149 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.793439+0000", 2020-11-16T20:57:23.150 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000223293 2020-11-16T20:57:23.150 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.150 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.150 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:57:23.150 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.793662+0000", 2020-11-16T20:57:23.150 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044197330000000003 2020-11-16T20:57:23.150 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.151 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.151 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:23.151 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.798082+0000", 2020-11-16T20:57:23.151 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0032816350000000002 2020-11-16T20:57:23.151 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.151 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.151 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.151 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.801364+0000", 2020-11-16T20:57:23.152 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0014819259999999999 2020-11-16T20:57:23.152 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.152 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.152 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.152 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802846+0000", 2020-11-16T20:57:23.152 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5000999999999996e-05 2020-11-16T20:57:23.152 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.152 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.153 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:23.153 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802911+0000", 2020-11-16T20:57:23.153 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2045000000000001e-05 2020-11-16T20:57:23.153 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.153 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.153 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.153 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802963+0000", 2020-11-16T20:57:23.154 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041469457000000001 2020-11-16T20:57:23.154 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.154 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.154 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.154 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.154 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.154 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2965 4.3 4:c925a80f:::smithi16641208-375:head [setxattr _header (58) in=7b,truncate 3731253] snapc 2d=[2d,25] ondisk+write+known_if_redirected e82)", 2020-11-16T20:57:23.155 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.761821+0000", 2020-11-16T20:57:23.155 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.197131566000003, 2020-11-16T20:57:23.155 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041339300000000002, 2020-11-16T20:57:23.155 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.155 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:23.155 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:23.155 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:23.155 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:23.156 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2965 2020-11-16T20:57:23.156 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.156 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.156 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.156 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.156 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761821+0000", 2020-11-16T20:57:23.156 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.157 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.157 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.157 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.157 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761821+0000", 2020-11-16T20:57:23.157 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2008999999999997e-05 2020-11-16T20:57:23.157 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.157 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.157 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.158 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761863+0000", 2020-11-16T20:57:23.158 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1800000000000001e-06 2020-11-16T20:57:23.158 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.158 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.158 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.158 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761869+0000", 2020-11-16T20:57:23.158 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1333000000000001e-05 2020-11-16T20:57:23.159 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.159 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.159 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.159 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761890+0000", 2020-11-16T20:57:23.159 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.361e-06 2020-11-16T20:57:23.159 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.159 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.159 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.160 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761896+0000", 2020-11-16T20:57:23.160 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017786705999999999 2020-11-16T20:57:23.160 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.160 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.160 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.160 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.779682+0000", 2020-11-16T20:57:23.160 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2055000000000003e-05 2020-11-16T20:57:23.161 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.161 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.161 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:23.161 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.779724+0000", 2020-11-16T20:57:23.161 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014764318 2020-11-16T20:57:23.161 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.161 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.161 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.162 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.794489+0000", 2020-11-16T20:57:23.162 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015123299999999999 2020-11-16T20:57:23.162 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.162 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.162 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.162 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.794640+0000", 2020-11-16T20:57:23.162 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00026568499999999999 2020-11-16T20:57:23.163 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.163 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.163 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:57:23.163 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.794906+0000", 2020-11-16T20:57:23.163 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003191925 2020-11-16T20:57:23.163 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.163 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.164 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:23.164 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.798097+0000", 2020-11-16T20:57:23.164 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033213790000000002 2020-11-16T20:57:23.164 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.164 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.164 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.164 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.801419+0000", 2020-11-16T20:57:23.164 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0016152409999999999 2020-11-16T20:57:23.165 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.165 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.165 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.165 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.803034+0000", 2020-11-16T20:57:23.165 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8489000000000002e-05 2020-11-16T20:57:23.165 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.165 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.165 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:23.166 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.803093+0000", 2020-11-16T20:57:23.166 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7385999999999995e-05 2020-11-16T20:57:23.166 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.166 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.166 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.166 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.803160+0000", 2020-11-16T20:57:23.166 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041339300000000002 2020-11-16T20:57:23.167 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.167 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.167 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.167 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.167 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.167 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2966 4.3 4:c925a80f:::smithi16641208-375:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e82)", 2020-11-16T20:57:23.167 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.761928+0000", 2020-11-16T20:57:23.168 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 38.197024208000002, 2020-11-16T20:57:23.168 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042111356000000003, 2020-11-16T20:57:23.168 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.168 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:23.168 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:23.168 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:23.168 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:23.168 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2966 2020-11-16T20:57:23.169 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.169 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.169 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.169 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.169 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761928+0000", 2020-11-16T20:57:23.169 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.169 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.169 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.170 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.170 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761928+0000", 2020-11-16T20:57:23.170 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8744000000000001e-05 2020-11-16T20:57:23.170 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.170 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.170 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.170 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761957+0000", 2020-11-16T20:57:23.171 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7930000000000003e-06 2020-11-16T20:57:23.171 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.171 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.171 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.171 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761963+0000", 2020-11-16T20:57:23.171 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.309e-05 2020-11-16T20:57:23.171 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.172 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.172 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.172 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761976+0000", 2020-11-16T20:57:23.172 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7609999999999998e-06 2020-11-16T20:57:23.172 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.172 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.172 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.172 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761980+0000", 2020-11-16T20:57:23.173 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017770805000000001 2020-11-16T20:57:23.173 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.173 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.173 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.173 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.779751+0000", 2020-11-16T20:57:23.173 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8778e-05 2020-11-16T20:57:23.173 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.174 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.174 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:23.174 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.779800+0000", 2020-11-16T20:57:23.174 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016025625000000002 2020-11-16T20:57:23.174 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.174 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.174 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.174 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.795826+0000", 2020-11-16T20:57:23.175 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032036800000000002 2020-11-16T20:57:23.175 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.175 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.175 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:23.175 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.796146+0000", 2020-11-16T20:57:23.175 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0070442580000000003 2020-11-16T20:57:23.175 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.176 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.176 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.176 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.803190+0000", 2020-11-16T20:57:23.176 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010655800000000001 2020-11-16T20:57:23.176 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.176 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.176 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.176 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.803297+0000", 2020-11-16T20:57:23.177 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000742576 2020-11-16T20:57:23.177 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.177 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.177 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.177 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.804039+0000", 2020-11-16T20:57:23.177 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042111356000000003 2020-11-16T20:57:23.177 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.178 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.178 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.178 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.178 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.178 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2997 4.3 4:f5e68fa8:::smithi16641208-361:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e86)", 2020-11-16T20:57:23.178 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838418+0000", 2020-11-16T20:57:23.178 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 34.120533913000003, 2020-11-16T20:57:23.178 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.056590020999999997, 2020-11-16T20:57:23.179 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.179 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:23.179 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:23.179 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:23.179 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:23.179 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2997 2020-11-16T20:57:23.179 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.180 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.180 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.180 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.180 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838418+0000", 2020-11-16T20:57:23.180 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.180 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.180 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.180 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.181 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838418+0000", 2020-11-16T20:57:23.181 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9998999999999999e-05 2020-11-16T20:57:23.181 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.181 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.181 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.181 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838448+0000", 2020-11-16T20:57:23.181 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3640000000000004e-06 2020-11-16T20:57:23.182 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.182 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.182 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.182 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838455+0000", 2020-11-16T20:57:23.182 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1902999999999999e-05 2020-11-16T20:57:23.182 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.182 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.183 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.183 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838467+0000", 2020-11-16T20:57:23.183 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1699999999999996e-06 2020-11-16T20:57:23.183 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.183 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.183 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.183 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838472+0000", 2020-11-16T20:57:23.183 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00047208200000000002 2020-11-16T20:57:23.184 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.184 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.184 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.184 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838944+0000", 2020-11-16T20:57:23.184 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6712000000000002e-05 2020-11-16T20:57:23.184 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.184 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.184 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:23.185 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.839001+0000", 2020-11-16T20:57:23.185 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038817664000000002 2020-11-16T20:57:23.185 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.185 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.185 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.185 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.877818+0000", 2020-11-16T20:57:23.185 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000119492 2020-11-16T20:57:23.186 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.186 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.186 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:23.186 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.877938+0000", 2020-11-16T20:57:23.186 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016797409999999999 2020-11-16T20:57:23.186 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.186 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.187 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.187 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.894735+0000", 2020-11-16T20:57:23.187 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015645500000000001 2020-11-16T20:57:23.187 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.187 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.187 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.187 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.894892+0000", 2020-11-16T20:57:23.187 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011677 2020-11-16T20:57:23.188 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.188 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.188 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.188 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.895008+0000", 2020-11-16T20:57:23.188 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.056590020999999997 2020-11-16T20:57:23.188 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.188 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.189 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.189 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.189 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.189 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:23.191 INFO:tasks.rados.rados.0.smithi166.stdout:1018: finishing write tid 1 to smithi16641208-432 2020-11-16T20:57:23.191 INFO:tasks.rados.rados.0.smithi166.stdout:1018: finishing write tid 2 to smithi16641208-432 2020-11-16T20:57:23.191 INFO:tasks.rados.rados.0.smithi166.stdout:1018: finishing write tid 3 to smithi16641208-432 2020-11-16T20:57:23.191 INFO:tasks.rados.rados.0.smithi166.stdout:1017: done (4 left) 2020-11-16T20:57:23.191 INFO:tasks.rados.rados.0.smithi166.stdout:1019: done (3 left) 2020-11-16T20:57:23.192 INFO:tasks.rados.rados.0.smithi166.stdout:1020: done (2 left) 2020-11-16T20:57:23.192 INFO:tasks.rados.rados.0.smithi166.stdout:1023: write (excl) oid 480 current snap is 39 2020-11-16T20:57:23.192 INFO:tasks.rados.rados.0.smithi166.stdout:1018: finishing write tid 4 to smithi16641208-432 2020-11-16T20:57:23.192 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 432 v 786 (ObjNum 637 snap 39 seq_num 637) dirty exists 2020-11-16T20:57:23.192 INFO:tasks.rados.rados.0.smithi166.stdout:1018: left oid 432 (ObjNum 637 snap 39 seq_num 637) 2020-11-16T20:57:23.192 INFO:tasks.rados.rados.0.smithi166.stdout:1022: finishing copy_from to smithi16641208-2 2020-11-16T20:57:23.192 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 2 v 200 (ObjNum 325 snap 0 seq_num 325) dirty exists 2020-11-16T20:57:23.193 INFO:tasks.rados.rados.0.smithi166.stdout:1022: finishing copy_from racing read to smithi16641208-2 2020-11-16T20:57:23.193 INFO:tasks.rados.rados.0.smithi166.stdout:1023: seq_num 638 ranges {722866=466161,1617747=428880,2587634=135232} 2020-11-16T20:57:23.193 INFO:tasks.rados.rados.0.smithi166.stdout:1023: writing smithi16641208-480 from 722866 to 1189027 tid 1 2020-11-16T20:57:23.193 INFO:tasks.rados.rados.0.smithi166.stdout:1023: writing smithi16641208-480 from 1617747 to 2046627 tid 2 2020-11-16T20:57:23.193 INFO:tasks.rados.rados.0.smithi166.stdout:1023: writing smithi16641208-480 from 2587634 to 2722866 tid 3 2020-11-16T20:57:23.193 INFO:tasks.rados.rados.0.smithi166.stdout:1018: done (2 left) 2020-11-16T20:57:23.193 INFO:tasks.rados.rados.0.smithi166.stdout:1022: done (1 left) 2020-11-16T20:57:23.193 INFO:tasks.rados.rados.0.smithi166.stdout:1024: snap_remove snap 32 2020-11-16T20:57:23.194 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:23.194+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:23.194 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:57:23.291 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:23.295+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:23.320 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:23.320 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:57:23.321 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:57:23.321 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:23.329 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:57:23.412 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:23.417+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:23.492 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:23.496+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:23.495 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:23.495 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:57:23.496 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:57:23.496 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:57:23.496 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:23.505 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:57:23.593 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:23.597+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:23.673 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:23.673 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:57:23.674 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:57:23.674 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:57:23.674 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.674 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2583 4.2 4:75836747:::smithi16641208-340:head [setxattr _header (58) in=7b,truncate 3159815] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:57:23.674 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.770345+0000", 2020-11-16T20:57:23.674 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 63.906537927999999, 2020-11-16T20:57:23.675 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.079764311000000004, 2020-11-16T20:57:23.675 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.675 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:23.675 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:23.675 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:23.675 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:23.675 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2583 2020-11-16T20:57:23.676 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.676 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.676 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.676 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.676 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770345+0000", 2020-11-16T20:57:23.676 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.676 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.677 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.677 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.677 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770345+0000", 2020-11-16T20:57:23.677 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9728999999999999e-05 2020-11-16T20:57:23.677 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.677 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.677 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.678 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770384+0000", 2020-11-16T20:57:23.678 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3849999999999999e-06 2020-11-16T20:57:23.678 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.678 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.678 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.678 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770391+0000", 2020-11-16T20:57:23.678 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0865e-05 2020-11-16T20:57:23.679 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.679 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.679 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.679 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770401+0000", 2020-11-16T20:57:23.679 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7599999999999999e-06 2020-11-16T20:57:23.679 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.679 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.679 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.680 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770407+0000", 2020-11-16T20:57:23.680 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00082697999999999995 2020-11-16T20:57:23.680 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.680 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.680 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.680 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771234+0000", 2020-11-16T20:57:23.680 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8841000000000001e-05 2020-11-16T20:57:23.681 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.681 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.681 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:23.681 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771293+0000", 2020-11-16T20:57:23.681 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.028773502999999999 2020-11-16T20:57:23.681 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.681 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.681 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.682 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800067+0000", 2020-11-16T20:57:23.682 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011809199999999999 2020-11-16T20:57:23.682 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.682 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.682 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.682 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800185+0000", 2020-11-16T20:57:23.682 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00041150300000000002 2020-11-16T20:57:23.683 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.683 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.683 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:57:23.683 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800596+0000", 2020-11-16T20:57:23.683 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078037820000000004 2020-11-16T20:57:23.683 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.683 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.684 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:23.684 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808400+0000", 2020-11-16T20:57:23.684 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.040583162999999998 2020-11-16T20:57:23.684 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.684 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.684 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.684 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.848983+0000", 2020-11-16T20:57:23.684 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00096703299999999996 2020-11-16T20:57:23.685 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.685 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.685 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.685 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.849950+0000", 2020-11-16T20:57:23.685 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6266999999999994e-05 2020-11-16T20:57:23.685 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.685 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.686 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:23.686 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850016+0000", 2020-11-16T20:57:23.686 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2408e-05 2020-11-16T20:57:23.686 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.686 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.686 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.686 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850109+0000", 2020-11-16T20:57:23.687 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.079764311000000004 2020-11-16T20:57:23.687 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.687 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.687 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.687 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.687 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.687 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2584 4.2 4:75836747:::smithi16641208-340:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:57:23.687 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.771084+0000", 2020-11-16T20:57:23.688 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 63.905798515000001, 2020-11-16T20:57:23.688 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.079415345999999998, 2020-11-16T20:57:23.688 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.688 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:23.688 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:23.688 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:23.688 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:23.689 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2584 2020-11-16T20:57:23.689 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.689 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.689 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.689 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.689 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771084+0000", 2020-11-16T20:57:23.689 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.689 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.690 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.690 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.690 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771084+0000", 2020-11-16T20:57:23.690 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3832999999999999e-05 2020-11-16T20:57:23.690 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.690 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.690 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.691 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771118+0000", 2020-11-16T20:57:23.691 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2299999999999996e-06 2020-11-16T20:57:23.691 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.691 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.691 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.691 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771124+0000", 2020-11-16T20:57:23.691 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1649e-05 2020-11-16T20:57:23.692 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.692 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.692 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.692 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771136+0000", 2020-11-16T20:57:23.692 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7389999999999996e-06 2020-11-16T20:57:23.692 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.692 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.692 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.693 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771141+0000", 2020-11-16T20:57:23.693 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000251332 2020-11-16T20:57:23.693 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.693 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.693 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.693 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771393+0000", 2020-11-16T20:57:23.693 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0130999999999997e-05 2020-11-16T20:57:23.694 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.694 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.694 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:23.694 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771453+0000", 2020-11-16T20:57:23.694 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036790163000000001 2020-11-16T20:57:23.694 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.694 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.694 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.695 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808243+0000", 2020-11-16T20:57:23.695 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000122781 2020-11-16T20:57:23.695 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.695 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.695 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:23.695 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808366+0000", 2020-11-16T20:57:23.695 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041793941000000001 2020-11-16T20:57:23.696 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.696 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.696 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.696 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850160+0000", 2020-11-16T20:57:23.696 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8177000000000005e-05 2020-11-16T20:57:23.696 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.696 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.697 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.697 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850258+0000", 2020-11-16T20:57:23.697 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024137 2020-11-16T20:57:23.697 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.697 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.697 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.697 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850499+0000", 2020-11-16T20:57:23.697 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.079415345999999998 2020-11-16T20:57:23.698 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.698 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.698 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.698 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.698 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.698 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3005 4.2 4:4fbd4ff5:::smithi16641208-419:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e87)", 2020-11-16T20:57:23.698 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.815522+0000", 2020-11-16T20:57:23.699 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 33.861360394000002, 2020-11-16T20:57:23.699 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.052525725000000002, 2020-11-16T20:57:23.699 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.699 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:23.699 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:23.699 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:23.699 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:23.700 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3005 2020-11-16T20:57:23.700 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.700 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.700 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.700 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.700 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.815522+0000", 2020-11-16T20:57:23.700 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.700 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.701 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.701 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.701 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.815522+0000", 2020-11-16T20:57:23.701 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6594000000000001e-05 2020-11-16T20:57:23.701 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.701 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.701 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.702 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.815569+0000", 2020-11-16T20:57:23.702 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8140000000000003e-06 2020-11-16T20:57:23.702 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.702 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.702 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.702 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.815575+0000", 2020-11-16T20:57:23.702 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2646999999999999e-05 2020-11-16T20:57:23.703 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.703 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.703 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.703 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.815588+0000", 2020-11-16T20:57:23.703 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2440000000000001e-06 2020-11-16T20:57:23.703 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.703 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.703 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.704 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.815593+0000", 2020-11-16T20:57:23.704 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000397551 2020-11-16T20:57:23.704 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.704 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.704 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.704 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.815991+0000", 2020-11-16T20:57:23.704 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6434999999999995e-05 2020-11-16T20:57:23.705 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.705 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.705 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:23.705 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816077+0000", 2020-11-16T20:57:23.705 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.051958295000000002 2020-11-16T20:57:23.705 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.705 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.706 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.706 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.868036+0000", 2020-11-16T20:57:23.706 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2145e-05 2020-11-16T20:57:23.706 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.706 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.706 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.706 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.868048+0000", 2020-11-16T20:57:23.706 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.052525725000000002 2020-11-16T20:57:23.707 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.707 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.707 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.707 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.707 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.707 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:14 3.0 3:3b92f709:::smithi16641208-69:head [copy-from ver 517] snapc 2b=[f] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e97)", 2020-11-16T20:57:23.707 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.813636+0000", 2020-11-16T20:57:23.708 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.863245984999999, 2020-11-16T20:57:23.708 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.068038797999999998, 2020-11-16T20:57:23.708 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.708 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:23.708 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.708 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.708 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.709 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813636+0000", 2020-11-16T20:57:23.709 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.709 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.709 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.709 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.709 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813636+0000", 2020-11-16T20:57:23.709 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4759000000000001e-05 2020-11-16T20:57:23.709 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.710 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.710 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.710 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813661+0000", 2020-11-16T20:57:23.710 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4690000000000002e-06 2020-11-16T20:57:23.710 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.710 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.710 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.711 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813665+0000", 2020-11-16T20:57:23.711 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0939999999999996e-06 2020-11-16T20:57:23.711 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.711 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.711 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.711 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813671+0000", 2020-11-16T20:57:23.711 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9490000000000001e-06 2020-11-16T20:57:23.712 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.712 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.712 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.712 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813674+0000", 2020-11-16T20:57:23.712 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035912158999999999 2020-11-16T20:57:23.712 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.712 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.712 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.713 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849586+0000", 2020-11-16T20:57:23.713 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000105225 2020-11-16T20:57:23.713 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.713 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.713 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.713 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849691+0000", 2020-11-16T20:57:23.713 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094697400000000008 2020-11-16T20:57:23.714 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.714 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.714 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,2", 2020-11-16T20:57:23.714 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.859161+0000", 2020-11-16T20:57:23.714 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022310784 2020-11-16T20:57:23.714 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.714 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.715 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:23.715 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881472+0000", 2020-11-16T20:57:23.715 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7089000000000003e-05 2020-11-16T20:57:23.715 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.715 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.715 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.715 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881519+0000", 2020-11-16T20:57:23.715 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9331000000000004e-05 2020-11-16T20:57:23.716 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.716 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.716 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.716 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881588+0000", 2020-11-16T20:57:23.716 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9375000000000001e-05 2020-11-16T20:57:23.716 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.716 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.717 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:23.717 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881637+0000", 2020-11-16T20:57:23.717 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7824000000000002e-05 2020-11-16T20:57:23.717 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.717 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.717 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.717 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881675+0000", 2020-11-16T20:57:23.718 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.068038797999999998 2020-11-16T20:57:23.718 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.718 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.718 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.718 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.718 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.718 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3084 3.0 3:0eeb4688:::smithi16641208-459:head [copy-from ver 165] snapc 38=[38] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e97)", 2020-11-16T20:57:23.718 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.814118+0000", 2020-11-16T20:57:23.719 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.862764227, 2020-11-16T20:57:23.719 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.078238367000000003, 2020-11-16T20:57:23.719 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.719 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:23.719 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.719 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.719 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.720 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814118+0000", 2020-11-16T20:57:23.720 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.720 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.720 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.720 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.720 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814118+0000", 2020-11-16T20:57:23.720 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.262e-05 2020-11-16T20:57:23.721 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.721 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.721 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.721 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814141+0000", 2020-11-16T20:57:23.721 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.169e-05 2020-11-16T20:57:23.721 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.721 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.721 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.722 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814153+0000", 2020-11-16T20:57:23.722 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5350000000000004e-06 2020-11-16T20:57:23.722 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.722 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.722 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.722 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814161+0000", 2020-11-16T20:57:23.722 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1760000000000003e-06 2020-11-16T20:57:23.723 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.723 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.723 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.723 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814165+0000", 2020-11-16T20:57:23.723 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035740382000000001 2020-11-16T20:57:23.723 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.723 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.724 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.724 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849906+0000", 2020-11-16T20:57:23.724 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2356999999999999e-05 2020-11-16T20:57:23.724 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.724 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.724 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.724 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849978+0000", 2020-11-16T20:57:23.725 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016929244999999999 2020-11-16T20:57:23.725 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.725 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.725 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,2", 2020-11-16T20:57:23.725 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.866907+0000", 2020-11-16T20:57:23.725 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024555357 2020-11-16T20:57:23.725 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.725 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.726 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.726 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.891463+0000", 2020-11-16T20:57:23.726 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00067812000000000005 2020-11-16T20:57:23.726 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.726 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.726 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.726 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892141+0000", 2020-11-16T20:57:23.727 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3387999999999997e-05 2020-11-16T20:57:23.727 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.727 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.727 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:23.727 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892204+0000", 2020-11-16T20:57:23.727 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4189999999999994e-05 2020-11-16T20:57:23.727 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.728 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.728 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:23.728 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892268+0000", 2020-11-16T20:57:23.728 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8306999999999993e-05 2020-11-16T20:57:23.728 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.728 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.728 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.728 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892357+0000", 2020-11-16T20:57:23.729 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.078238367000000003 2020-11-16T20:57:23.729 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.729 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.729 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.729 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.729 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.729 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:16 3.0 3:0eeb4688:::smithi16641208-459:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e97)", 2020-11-16T20:57:23.730 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.814220+0000", 2020-11-16T20:57:23.730 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.862662297, 2020-11-16T20:57:23.730 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.078457661999999997, 2020-11-16T20:57:23.730 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.730 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:23.730 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.730 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.731 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.731 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814220+0000", 2020-11-16T20:57:23.731 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.731 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.731 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.731 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.731 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814220+0000", 2020-11-16T20:57:23.731 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6680999999999998e-05 2020-11-16T20:57:23.732 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.732 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.732 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.732 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814237+0000", 2020-11-16T20:57:23.732 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4029999999999999e-06 2020-11-16T20:57:23.732 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.732 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.733 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.733 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814240+0000", 2020-11-16T20:57:23.733 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5980000000000002e-06 2020-11-16T20:57:23.733 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.733 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.733 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.733 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814247+0000", 2020-11-16T20:57:23.734 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1489999999999998e-06 2020-11-16T20:57:23.734 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.734 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.734 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.734 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814250+0000", 2020-11-16T20:57:23.734 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035894660000000002 2020-11-16T20:57:23.734 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.734 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.735 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.735 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850145+0000", 2020-11-16T20:57:23.735 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2685000000000001e-05 2020-11-16T20:57:23.735 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.735 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.735 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:23.735 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850197+0000", 2020-11-16T20:57:23.736 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030551076999999999 2020-11-16T20:57:23.736 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.736 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.736 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.736 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.880748+0000", 2020-11-16T20:57:23.736 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011375900000000001 2020-11-16T20:57:23.736 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.736 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.737 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:23.737 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.880862+0000", 2020-11-16T20:57:23.737 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011676122000000001 2020-11-16T20:57:23.737 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.737 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.737 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.737 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892538+0000", 2020-11-16T20:57:23.738 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7021999999999997e-05 2020-11-16T20:57:23.738 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.738 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.738 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.738 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892595+0000", 2020-11-16T20:57:23.738 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2505999999999999e-05 2020-11-16T20:57:23.738 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.739 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.739 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.739 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892678+0000", 2020-11-16T20:57:23.739 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.078457661999999997 2020-11-16T20:57:23.739 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.739 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.739 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.739 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.740 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.740 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:17 3.0 3:0eeb4688:::smithi16641208-459:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e97)", 2020-11-16T20:57:23.740 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.814270+0000", 2020-11-16T20:57:23.740 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.862612928000001, 2020-11-16T20:57:23.740 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.082632504999999995, 2020-11-16T20:57:23.740 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.740 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:23.741 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.741 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.741 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.741 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814270+0000", 2020-11-16T20:57:23.741 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.741 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.741 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.741 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.742 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814270+0000", 2020-11-16T20:57:23.742 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3700999999999999e-05 2020-11-16T20:57:23.742 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.742 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.742 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.742 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814293+0000", 2020-11-16T20:57:23.742 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7879999999999998e-06 2020-11-16T20:57:23.743 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.743 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.743 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.743 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814296+0000", 2020-11-16T20:57:23.743 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6509999999999998e-06 2020-11-16T20:57:23.743 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.743 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.744 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.744 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814302+0000", 2020-11-16T20:57:23.744 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1039999999999996e-06 2020-11-16T20:57:23.744 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.744 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.744 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.744 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814311+0000", 2020-11-16T20:57:23.744 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035912305999999998 2020-11-16T20:57:23.745 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.745 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.745 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.745 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850223+0000", 2020-11-16T20:57:23.745 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5476000000000003e-05 2020-11-16T20:57:23.745 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.745 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.746 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:23.746 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850269+0000", 2020-11-16T20:57:23.746 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030645256999999999 2020-11-16T20:57:23.746 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.746 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.746 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.746 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.880914+0000", 2020-11-16T20:57:23.746 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3608000000000004e-05 2020-11-16T20:57:23.747 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.747 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.747 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:23.747 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.880987+0000", 2020-11-16T20:57:23.747 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011720252 2020-11-16T20:57:23.747 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.747 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.748 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.748 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892708+0000", 2020-11-16T20:57:23.748 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4710000000000003e-05 2020-11-16T20:57:23.748 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.748 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.748 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.748 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892762+0000", 2020-11-16T20:57:23.749 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041396519999999997 2020-11-16T20:57:23.749 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.749 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.749 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.749 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.896902+0000", 2020-11-16T20:57:23.749 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.082632504999999995 2020-11-16T20:57:23.749 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.749 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.750 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.750 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.750 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.750 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:19 3.0 3:1e015f5d:::smithi16641208-120:head [copy-from ver 447] snapc e=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e97)", 2020-11-16T20:57:23.750 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.814940+0000", 2020-11-16T20:57:23.750 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.861942385999999, 2020-11-16T20:57:23.750 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.077559996000000006, 2020-11-16T20:57:23.751 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.751 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:23.751 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.751 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.751 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.751 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814940+0000", 2020-11-16T20:57:23.751 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.752 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.752 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.752 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.752 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814940+0000", 2020-11-16T20:57:23.752 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0903000000000003e-05 2020-11-16T20:57:23.752 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.752 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.752 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.753 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815001+0000", 2020-11-16T20:57:23.753 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1119999999999998e-06 2020-11-16T20:57:23.753 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.753 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.753 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.753 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815008+0000", 2020-11-16T20:57:23.753 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1421e-05 2020-11-16T20:57:23.754 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.754 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.754 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.754 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815019+0000", 2020-11-16T20:57:23.754 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6509999999999998e-06 2020-11-16T20:57:23.754 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.754 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.754 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.755 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815025+0000", 2020-11-16T20:57:23.755 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036337921000000002 2020-11-16T20:57:23.755 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.755 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.755 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.755 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851363+0000", 2020-11-16T20:57:23.755 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012654300000000001 2020-11-16T20:57:23.756 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.756 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.756 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.756 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851490+0000", 2020-11-16T20:57:23.756 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025530690000000002 2020-11-16T20:57:23.756 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.756 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.756 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,2", 2020-11-16T20:57:23.757 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.877020+0000", 2020-11-16T20:57:23.757 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01516898 2020-11-16T20:57:23.757 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.757 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.757 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.757 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892189+0000", 2020-11-16T20:57:23.757 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017819600000000001 2020-11-16T20:57:23.758 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.758 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.758 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:23.758 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892367+0000", 2020-11-16T20:57:23.758 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6916999999999999e-05 2020-11-16T20:57:23.758 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.758 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.759 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.759 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892404+0000", 2020-11-16T20:57:23.759 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1143999999999998e-05 2020-11-16T20:57:23.759 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.759 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.759 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:23.759 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892446+0000", 2020-11-16T20:57:23.760 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4518000000000002e-05 2020-11-16T20:57:23.760 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.760 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.760 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.760 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892500+0000", 2020-11-16T20:57:23.760 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.077559996000000006 2020-11-16T20:57:23.760 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.761 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.761 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.761 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.761 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.761 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3105 3.0 3:1ccd20f3:::smithi16641208-424:head [stat,delete] snapc 38=[38] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e97)", 2020-11-16T20:57:23.761 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.815082+0000", 2020-11-16T20:57:23.761 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.861800721000002, 2020-11-16T20:57:23.761 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066146218000000007, 2020-11-16T20:57:23.762 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.762 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:23.762 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.762 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.762 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.762 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815082+0000", 2020-11-16T20:57:23.762 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.763 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.763 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.763 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.763 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815082+0000", 2020-11-16T20:57:23.763 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0209000000000002e-05 2020-11-16T20:57:23.763 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.763 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.764 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.764 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815112+0000", 2020-11-16T20:57:23.764 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7830000000000004e-06 2020-11-16T20:57:23.764 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.764 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.764 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.764 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815118+0000", 2020-11-16T20:57:23.764 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0927000000000001e-05 2020-11-16T20:57:23.765 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.765 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.765 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.765 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815129+0000", 2020-11-16T20:57:23.765 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3059999999999997e-06 2020-11-16T20:57:23.765 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.765 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.766 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.766 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815134+0000", 2020-11-16T20:57:23.766 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036502199999999999 2020-11-16T20:57:23.766 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.766 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.766 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.766 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851636+0000", 2020-11-16T20:57:23.767 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016290900000000001 2020-11-16T20:57:23.767 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.767 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.767 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.767 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851799+0000", 2020-11-16T20:57:23.767 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00028645999999999999 2020-11-16T20:57:23.767 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.768 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.768 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,2", 2020-11-16T20:57:23.768 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852086+0000", 2020-11-16T20:57:23.768 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003854007 2020-11-16T20:57:23.768 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.768 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.768 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:23.769 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.855940+0000", 2020-11-16T20:57:23.769 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0019815750000000002 2020-11-16T20:57:23.769 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.769 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.769 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.769 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.857921+0000", 2020-11-16T20:57:23.769 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023126626000000001 2020-11-16T20:57:23.769 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.770 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.770 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.770 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881048+0000", 2020-11-16T20:57:23.770 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.0409999999999998e-05 2020-11-16T20:57:23.770 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.770 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.770 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:23.771 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881128+0000", 2020-11-16T20:57:23.771 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9806e-05 2020-11-16T20:57:23.771 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.771 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.771 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.771 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881228+0000", 2020-11-16T20:57:23.771 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066146218000000007 2020-11-16T20:57:23.772 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.772 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.772 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.772 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.772 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.772 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:21 3.0 3:1ccd20f3:::smithi16641208-424:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e97)", 2020-11-16T20:57:23.772 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.815178+0000", 2020-11-16T20:57:23.772 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.861704383999999, 2020-11-16T20:57:23.773 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066300320999999995, 2020-11-16T20:57:23.773 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.773 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:23.773 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.773 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.773 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.773 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815178+0000", 2020-11-16T20:57:23.774 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.774 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.774 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.774 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.774 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815178+0000", 2020-11-16T20:57:23.774 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8203000000000001e-05 2020-11-16T20:57:23.774 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.774 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.775 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.775 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815206+0000", 2020-11-16T20:57:23.775 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7729999999999996e-06 2020-11-16T20:57:23.775 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.775 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.775 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.775 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815212+0000", 2020-11-16T20:57:23.776 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.149e-05 2020-11-16T20:57:23.776 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.776 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.776 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.776 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815224+0000", 2020-11-16T20:57:23.776 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3900000000000001e-06 2020-11-16T20:57:23.776 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.777 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.777 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.777 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815229+0000", 2020-11-16T20:57:23.777 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039388232000000002 2020-11-16T20:57:23.777 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.777 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.777 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.777 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.854617+0000", 2020-11-16T20:57:23.778 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012693099999999999 2020-11-16T20:57:23.778 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.778 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.778 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:23.778 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.854744+0000", 2020-11-16T20:57:23.778 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026509525999999999 2020-11-16T20:57:23.778 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.779 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.779 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.779 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881254+0000", 2020-11-16T20:57:23.779 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2397000000000005e-05 2020-11-16T20:57:23.779 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.779 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.779 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.780 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881326+0000", 2020-11-16T20:57:23.780 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015237900000000001 2020-11-16T20:57:23.780 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.780 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.780 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.780 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881478+0000", 2020-11-16T20:57:23.780 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066300320999999995 2020-11-16T20:57:23.780 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.781 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.781 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.781 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.781 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.781 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:22 3.0 3:1ccd20f3:::smithi16641208-424:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e97)", 2020-11-16T20:57:23.781 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.815264+0000", 2020-11-16T20:57:23.781 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 21.861617943999999, 2020-11-16T20:57:23.782 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066644708999999996, 2020-11-16T20:57:23.782 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.782 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:23.782 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.782 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.782 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.782 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815264+0000", 2020-11-16T20:57:23.783 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.783 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.783 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.783 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.783 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815264+0000", 2020-11-16T20:57:23.783 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5266999999999999e-05 2020-11-16T20:57:23.783 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.783 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.784 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.784 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815310+0000", 2020-11-16T20:57:23.784 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3989999999999998e-06 2020-11-16T20:57:23.784 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.784 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.784 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.784 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815317+0000", 2020-11-16T20:57:23.785 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.082e-05 2020-11-16T20:57:23.785 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.785 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.785 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.785 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815328+0000", 2020-11-16T20:57:23.785 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0220000000000004e-06 2020-11-16T20:57:23.785 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.785 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.786 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.786 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815333+0000", 2020-11-16T20:57:23.786 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039899660000000003 2020-11-16T20:57:23.786 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.786 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.786 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.786 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.855233+0000", 2020-11-16T20:57:23.787 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2051000000000004e-05 2020-11-16T20:57:23.787 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.787 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.787 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:23.787 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.855315+0000", 2020-11-16T20:57:23.787 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026394424 2020-11-16T20:57:23.787 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.788 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.788 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.788 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881709+0000", 2020-11-16T20:57:23.788 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020006599999999999 2020-11-16T20:57:23.788 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.789 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.789 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.789 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881909+0000", 2020-11-16T20:57:23.789 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066644708999999996 2020-11-16T20:57:23.789 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.789 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.789 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.789 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.790 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.790 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:67 3.0 3:266da985:::smithi16641208-406:snapdir [list-snaps] snapc 0=[] RETRY=2 ondisk+retry+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:57:23.790 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.832030+0000", 2020-11-16T20:57:23.790 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.8448522039999999, 2020-11-16T20:57:23.790 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.049723522999999999, 2020-11-16T20:57:23.790 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.790 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:23.791 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.791 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.791 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.791 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832030+0000", 2020-11-16T20:57:23.791 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.791 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.791 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.792 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.792 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832030+0000", 2020-11-16T20:57:23.792 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0023999999999999e-05 2020-11-16T20:57:23.792 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.792 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.792 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.792 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832060+0000", 2020-11-16T20:57:23.793 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.219e-05 2020-11-16T20:57:23.793 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.793 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.793 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.793 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832072+0000", 2020-11-16T20:57:23.793 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1505000000000001e-05 2020-11-16T20:57:23.793 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.793 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.794 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.794 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832084+0000", 2020-11-16T20:57:23.794 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3650000000000003e-06 2020-11-16T20:57:23.794 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.794 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.794 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.794 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832089+0000", 2020-11-16T20:57:23.795 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3396999999999998e-05 2020-11-16T20:57:23.795 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.795 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.795 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.795 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832133+0000", 2020-11-16T20:57:23.795 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0780000000000002e-06 2020-11-16T20:57:23.795 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.795 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.796 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:57:23.796 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832142+0000", 2020-11-16T20:57:23.796 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.045393791000000003 2020-11-16T20:57:23.796 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.796 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.796 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.796 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.877536+0000", 2020-11-16T20:57:23.797 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000176937 2020-11-16T20:57:23.797 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.797 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.797 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:23.797 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.877713+0000", 2020-11-16T20:57:23.797 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0035765929999999999 2020-11-16T20:57:23.797 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.798 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.798 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.881289+0000", 2020-11-16T20:57:23.798 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000137854 2020-11-16T20:57:23.798 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.798 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.798 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.881427+0000", 2020-11-16T20:57:23.799 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032678900000000002 2020-11-16T20:57:23.799 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.799 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.799 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.799 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.881754+0000", 2020-11-16T20:57:23.799 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.049723522999999999 2020-11-16T20:57:23.799 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.800 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.800 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.800 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.800 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.800 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:68 3.0 3:266da985:::smithi16641208-406:head [copy-get max 8388608] snapc 0=[] RETRY=2 ondisk+retry+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:57:23.800 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.832133+0000", 2020-11-16T20:57:23.800 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.8447489450000001, 2020-11-16T20:57:23.800 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054097583999999997, 2020-11-16T20:57:23.801 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.801 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:23.801 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.801 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.801 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.801 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832133+0000", 2020-11-16T20:57:23.801 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.802 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.802 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.802 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.802 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832133+0000", 2020-11-16T20:57:23.802 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1003e-05 2020-11-16T20:57:23.802 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.802 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.803 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.803 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832175+0000", 2020-11-16T20:57:23.803 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7960000000000001e-06 2020-11-16T20:57:23.803 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.803 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.803 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.803 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832180+0000", 2020-11-16T20:57:23.804 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0349e-05 2020-11-16T20:57:23.804 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.804 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.804 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.804 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832191+0000", 2020-11-16T20:57:23.804 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3000000000000001e-06 2020-11-16T20:57:23.804 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.804 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.805 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.805 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832196+0000", 2020-11-16T20:57:23.805 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6594000000000001e-05 2020-11-16T20:57:23.805 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.805 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.805 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.805 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832243+0000", 2020-11-16T20:57:23.806 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2993000000000001e-05 2020-11-16T20:57:23.806 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.806 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.806 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:57:23.806 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832256+0000", 2020-11-16T20:57:23.806 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.045506131999999998 2020-11-16T20:57:23.806 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.807 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.807 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.807 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.877762+0000", 2020-11-16T20:57:23.807 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010955600000000001 2020-11-16T20:57:23.807 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.807 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.807 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:23.807 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.877871+0000", 2020-11-16T20:57:23.808 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042134119999999997 2020-11-16T20:57:23.808 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.808 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.808 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.808 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.882085+0000", 2020-11-16T20:57:23.808 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014105699999999999 2020-11-16T20:57:23.808 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.809 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.809 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.809 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.882226+0000", 2020-11-16T20:57:23.809 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004005392 2020-11-16T20:57:23.809 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.809 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.809 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.809 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886231+0000", 2020-11-16T20:57:23.810 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054097583999999997 2020-11-16T20:57:23.810 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.810 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.810 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.810 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.810 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.810 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3327 3.0 3:2949283c:::smithi16641208-44:head [write 537989~722069,stat] snapc 49=[49,48,44,41] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e115)", 2020-11-16T20:57:23.811 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.832232+0000", 2020-11-16T20:57:23.811 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.8446504639999999, 2020-11-16T20:57:23.811 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054524729000000001, 2020-11-16T20:57:23.811 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.811 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:23.811 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.811 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.811 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.812 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832232+0000", 2020-11-16T20:57:23.812 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.812 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.812 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.812 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.812 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832232+0000", 2020-11-16T20:57:23.812 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00040025400000000001 2020-11-16T20:57:23.813 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.813 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.813 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.813 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832632+0000", 2020-11-16T20:57:23.813 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5050000000000004e-06 2020-11-16T20:57:23.813 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.813 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.813 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.814 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832639+0000", 2020-11-16T20:57:23.814 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1299e-05 2020-11-16T20:57:23.814 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.814 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.814 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.814 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832650+0000", 2020-11-16T20:57:23.814 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8030000000000002e-06 2020-11-16T20:57:23.815 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.815 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.815 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.815 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832656+0000", 2020-11-16T20:57:23.815 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8779000000000003e-05 2020-11-16T20:57:23.815 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.815 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.816 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.816 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832695+0000", 2020-11-16T20:57:23.816 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9789999999999993e-06 2020-11-16T20:57:23.816 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.816 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.816 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:57:23.816 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832703+0000", 2020-11-16T20:57:23.816 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.045361931000000001 2020-11-16T20:57:23.817 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.817 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.817 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.817 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.878065+0000", 2020-11-16T20:57:23.817 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000221418 2020-11-16T20:57:23.817 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.817 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.818 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.818 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.878286+0000", 2020-11-16T20:57:23.818 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023917099999999999 2020-11-16T20:57:23.818 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.818 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.818 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 2,6", 2020-11-16T20:57:23.818 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.878525+0000", 2020-11-16T20:57:23.819 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003510988 2020-11-16T20:57:23.819 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.819 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.819 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.819 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.882036+0000", 2020-11-16T20:57:23.819 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044535720000000003 2020-11-16T20:57:23.819 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.819 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.820 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:23.820 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886490+0000", 2020-11-16T20:57:23.820 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0692999999999996e-05 2020-11-16T20:57:23.820 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.820 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.820 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.820 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886560+0000", 2020-11-16T20:57:23.821 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5710000000000001e-05 2020-11-16T20:57:23.821 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.821 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.821 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:23.821 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886606+0000", 2020-11-16T20:57:23.821 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015062699999999999 2020-11-16T20:57:23.821 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.821 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.822 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.822 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886757+0000", 2020-11-16T20:57:23.822 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054524729000000001 2020-11-16T20:57:23.822 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.822 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.822 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.822 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.823 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.823 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:70 3.0 3:2949283c:::smithi16641208-44:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:57:23.823 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.832688+0000", 2020-11-16T20:57:23.823 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.8441940450000001, 2020-11-16T20:57:23.823 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054473900999999998, 2020-11-16T20:57:23.823 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.823 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:23.823 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.824 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.824 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.824 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832688+0000", 2020-11-16T20:57:23.824 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.824 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.824 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.824 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.825 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832688+0000", 2020-11-16T20:57:23.825 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5730999999999999e-05 2020-11-16T20:57:23.825 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.825 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.825 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.825 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832704+0000", 2020-11-16T20:57:23.825 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0690000000000002e-06 2020-11-16T20:57:23.826 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.826 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.826 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.826 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832707+0000", 2020-11-16T20:57:23.826 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9719999999999997e-06 2020-11-16T20:57:23.826 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.826 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.826 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.827 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832713+0000", 2020-11-16T20:57:23.827 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8650000000000001e-06 2020-11-16T20:57:23.827 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.827 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.827 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.827 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832716+0000", 2020-11-16T20:57:23.827 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8541999999999998e-05 2020-11-16T20:57:23.828 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.828 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.828 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.828 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832755+0000", 2020-11-16T20:57:23.828 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.153e-05 2020-11-16T20:57:23.828 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.828 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.829 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:57:23.829 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832766+0000", 2020-11-16T20:57:23.829 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047763647999999999 2020-11-16T20:57:23.829 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.829 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.829 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.829 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.880530+0000", 2020-11-16T20:57:23.829 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016090599999999999 2020-11-16T20:57:23.830 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.830 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.830 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:23.830 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.880691+0000", 2020-11-16T20:57:23.830 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061198809999999998 2020-11-16T20:57:23.830 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.830 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.831 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.831 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886811+0000", 2020-11-16T20:57:23.831 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012478200000000001 2020-11-16T20:57:23.831 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.831 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.831 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.831 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886935+0000", 2020-11-16T20:57:23.831 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000226975 2020-11-16T20:57:23.832 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.832 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.832 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.832 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.887162+0000", 2020-11-16T20:57:23.832 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054473900999999998 2020-11-16T20:57:23.832 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.832 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.833 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.833 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.833 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.833 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:71 3.0 3:2949283c:::smithi16641208-44:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:57:23.833 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.832747+0000", 2020-11-16T20:57:23.833 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.8441351969999999, 2020-11-16T20:57:23.833 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.057126753000000002, 2020-11-16T20:57:23.833 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.834 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:23.834 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.834 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.834 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.834 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832747+0000", 2020-11-16T20:57:23.834 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.834 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.835 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.835 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.835 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832747+0000", 2020-11-16T20:57:23.835 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3911000000000001e-05 2020-11-16T20:57:23.835 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.835 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.835 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.836 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832781+0000", 2020-11-16T20:57:23.836 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2480000000000001e-06 2020-11-16T20:57:23.836 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.836 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.836 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.836 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832784+0000", 2020-11-16T20:57:23.836 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2040000000000002e-06 2020-11-16T20:57:23.837 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.837 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.837 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.837 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832791+0000", 2020-11-16T20:57:23.837 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2399999999999999e-06 2020-11-16T20:57:23.837 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.837 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.837 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.838 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832794+0000", 2020-11-16T20:57:23.838 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2548000000000002e-05 2020-11-16T20:57:23.838 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.838 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.838 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.838 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832816+0000", 2020-11-16T20:57:23.838 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4160000000000003e-06 2020-11-16T20:57:23.839 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.839 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.839 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:57:23.839 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832822+0000", 2020-11-16T20:57:23.839 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.053459245000000002 2020-11-16T20:57:23.839 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.839 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.839 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.840 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886281+0000", 2020-11-16T20:57:23.840 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018665399999999999 2020-11-16T20:57:23.840 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.840 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.840 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:23.840 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886468+0000", 2020-11-16T20:57:23.840 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00075232499999999998 2020-11-16T20:57:23.841 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.841 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.841 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.841 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.887220+0000", 2020-11-16T20:57:23.841 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000152974 2020-11-16T20:57:23.841 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.841 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.842 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.842 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.887373+0000", 2020-11-16T20:57:23.842 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002500988 2020-11-16T20:57:23.842 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.842 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.842 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.842 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.889874+0000", 2020-11-16T20:57:23.842 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.057126753000000002 2020-11-16T20:57:23.843 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.843 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.843 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.843 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.843 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.843 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3346 3.0 3:1e5364a0:::smithi16641208-320:head [write 588410~547816,stat] snapc 4a=[4a,49,48,44,41] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e115)", 2020-11-16T20:57:23.843 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.839179+0000", 2020-11-16T20:57:23.844 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.8377034430000001, 2020-11-16T20:57:23.844 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.084752201999999999, 2020-11-16T20:57:23.844 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.844 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:23.844 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.844 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.844 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.844 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839179+0000", 2020-11-16T20:57:23.845 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.845 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.845 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.845 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.845 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839179+0000", 2020-11-16T20:57:23.845 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000250175 2020-11-16T20:57:23.845 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.846 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.846 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.846 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839429+0000", 2020-11-16T20:57:23.846 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.22e-06 2020-11-16T20:57:23.846 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.846 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.846 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.847 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839434+0000", 2020-11-16T20:57:23.847 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0258000000000001e-05 2020-11-16T20:57:23.847 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.847 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.847 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.847 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839445+0000", 2020-11-16T20:57:23.847 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8019999999999999e-06 2020-11-16T20:57:23.847 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.848 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.848 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.848 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839449+0000", 2020-11-16T20:57:23.848 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1084999999999997e-05 2020-11-16T20:57:23.848 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.848 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.848 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.849 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839491+0000", 2020-11-16T20:57:23.849 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4239999999999993e-06 2020-11-16T20:57:23.849 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.849 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.849 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:57:23.849 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839499+0000", 2020-11-16T20:57:23.849 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050428550000000003 2020-11-16T20:57:23.850 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.850 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.850 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.850 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.889928+0000", 2020-11-16T20:57:23.850 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030713000000000002 2020-11-16T20:57:23.850 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.850 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.850 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.851 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.890235+0000", 2020-11-16T20:57:23.851 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00047229800000000001 2020-11-16T20:57:23.851 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.851 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.851 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 2,6", 2020-11-16T20:57:23.851 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.890707+0000", 2020-11-16T20:57:23.851 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0046488600000000003 2020-11-16T20:57:23.852 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.852 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.852 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.852 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895356+0000", 2020-11-16T20:57:23.852 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.028228664000000001 2020-11-16T20:57:23.852 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.852 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.852 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:23.853 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.923584+0000", 2020-11-16T20:57:23.853 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3496e-05 2020-11-16T20:57:23.853 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.853 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.853 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:23.853 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.923608+0000", 2020-11-16T20:57:23.853 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0390999999999997e-05 2020-11-16T20:57:23.854 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.854 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.854 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:23.854 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.923678+0000", 2020-11-16T20:57:23.854 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00025284899999999998 2020-11-16T20:57:23.854 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.854 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.855 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.855 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.923931+0000", 2020-11-16T20:57:23.855 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.084752201999999999 2020-11-16T20:57:23.855 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.855 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.855 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.855 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.855 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.856 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:73 3.0 3:1e5364a0:::smithi16641208-320:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:57:23.856 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.839479+0000", 2020-11-16T20:57:23.856 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.8374032119999999, 2020-11-16T20:57:23.856 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.089078473000000005, 2020-11-16T20:57:23.856 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.856 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:23.856 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.857 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.857 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.857 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839479+0000", 2020-11-16T20:57:23.857 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.857 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.857 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.857 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.857 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839479+0000", 2020-11-16T20:57:23.858 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8124000000000001e-05 2020-11-16T20:57:23.858 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.858 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.858 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.858 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839497+0000", 2020-11-16T20:57:23.858 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1580000000000001e-06 2020-11-16T20:57:23.858 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.859 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.859 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.859 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839501+0000", 2020-11-16T20:57:23.859 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6579999999999996e-06 2020-11-16T20:57:23.859 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.859 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.859 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.860 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839507+0000", 2020-11-16T20:57:23.860 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9720000000000001e-06 2020-11-16T20:57:23.860 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.860 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.860 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.860 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839510+0000", 2020-11-16T20:57:23.860 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1950000000000003e-05 2020-11-16T20:57:23.860 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.861 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.861 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.861 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839552+0000", 2020-11-16T20:57:23.861 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2225999999999999e-05 2020-11-16T20:57:23.861 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.861 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.861 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:57:23.862 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839564+0000", 2020-11-16T20:57:23.862 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.055483693000000001 2020-11-16T20:57:23.862 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.862 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.862 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.862 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895048+0000", 2020-11-16T20:57:23.862 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022632500000000001 2020-11-16T20:57:23.863 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.863 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.863 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:23.863 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895274+0000", 2020-11-16T20:57:23.863 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032777323999999997 2020-11-16T20:57:23.863 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.863 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.863 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.864 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928052+0000", 2020-11-16T20:57:23.864 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000150321 2020-11-16T20:57:23.864 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.864 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.864 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.864 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928202+0000", 2020-11-16T20:57:23.864 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00035572199999999999 2020-11-16T20:57:23.865 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.865 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.865 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.865 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928558+0000", 2020-11-16T20:57:23.865 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.089078473000000005 2020-11-16T20:57:23.865 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.865 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.865 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.866 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.866 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.866 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:74 3.0 3:1e5364a0:::smithi16641208-320:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:57:23.866 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.839542+0000", 2020-11-16T20:57:23.866 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.837340583, 2020-11-16T20:57:23.866 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.093226218, 2020-11-16T20:57:23.866 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.867 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:23.867 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.867 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.867 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.867 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839542+0000", 2020-11-16T20:57:23.867 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.867 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.868 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.868 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.868 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839542+0000", 2020-11-16T20:57:23.868 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6640000000000002e-05 2020-11-16T20:57:23.868 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.868 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.868 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.868 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839578+0000", 2020-11-16T20:57:23.869 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.416e-06 2020-11-16T20:57:23.869 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.869 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.869 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.869 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839582+0000", 2020-11-16T20:57:23.869 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9070000000000001e-06 2020-11-16T20:57:23.869 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.870 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.870 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.870 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839589+0000", 2020-11-16T20:57:23.870 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.994e-06 2020-11-16T20:57:23.870 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.870 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.870 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.870 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839592+0000", 2020-11-16T20:57:23.871 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4881000000000001e-05 2020-11-16T20:57:23.871 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.871 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.871 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.871 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839617+0000", 2020-11-16T20:57:23.871 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4330000000000003e-06 2020-11-16T20:57:23.871 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.872 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.872 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:57:23.872 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839622+0000", 2020-11-16T20:57:23.872 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.055765016000000001 2020-11-16T20:57:23.872 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.872 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.872 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.872 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895387+0000", 2020-11-16T20:57:23.873 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000145926 2020-11-16T20:57:23.873 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.873 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.873 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:23.873 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895533+0000", 2020-11-16T20:57:23.873 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033078547999999999 2020-11-16T20:57:23.873 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.874 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.874 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.874 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928612+0000", 2020-11-16T20:57:23.874 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114621 2020-11-16T20:57:23.874 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.874 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.874 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.875 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928726+0000", 2020-11-16T20:57:23.875 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004041836 2020-11-16T20:57:23.875 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.875 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.875 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.875 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.932768+0000", 2020-11-16T20:57:23.875 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.093226218 2020-11-16T20:57:23.875 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.876 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.876 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.876 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.876 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.876 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3359 4.2 4:4f2a8928:::smithi16641208-54:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e115)", 2020-11-16T20:57:23.876 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.861254+0000", 2020-11-16T20:57:23.876 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.8156279610000001, 2020-11-16T20:57:23.877 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.049851530999999998, 2020-11-16T20:57:23.877 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:23.877 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:23.877 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:23.877 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:23.877 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:23.877 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3359 2020-11-16T20:57:23.877 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.878 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:23.878 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.878 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:23.878 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.861254+0000", 2020-11-16T20:57:23.878 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:23.878 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.879 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.879 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:23.879 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.861254+0000", 2020-11-16T20:57:23.879 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2141000000000003e-05 2020-11-16T20:57:23.879 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.879 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.879 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:23.880 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.861287+0000", 2020-11-16T20:57:23.880 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3431999999999999e-05 2020-11-16T20:57:23.880 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.880 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.880 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:23.880 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.861310+0000", 2020-11-16T20:57:23.880 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.17e-05 2020-11-16T20:57:23.881 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.881 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.881 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:23.881 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.861322+0000", 2020-11-16T20:57:23.881 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.809e-06 2020-11-16T20:57:23.881 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.881 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.882 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:23.882 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.861327+0000", 2020-11-16T20:57:23.882 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000338256 2020-11-16T20:57:23.882 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.882 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.882 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.882 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.861665+0000", 2020-11-16T20:57:23.882 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4506999999999999e-05 2020-11-16T20:57:23.883 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.883 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.883 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:23.883 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.861709+0000", 2020-11-16T20:57:23.883 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037986348000000003 2020-11-16T20:57:23.883 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.883 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.884 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.884 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.899696+0000", 2020-11-16T20:57:23.884 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8857000000000006e-05 2020-11-16T20:57:23.884 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.884 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.884 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:23.884 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.899795+0000", 2020-11-16T20:57:23.884 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011098719 2020-11-16T20:57:23.885 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.885 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.885 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:23.885 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.910893+0000", 2020-11-16T20:57:23.885 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8752000000000006e-05 2020-11-16T20:57:23.885 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.885 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.886 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:23.886 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.910992+0000", 2020-11-16T20:57:23.886 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011401 2020-11-16T20:57:23.886 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:23.886 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:23.886 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:23.886 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.911106+0000", 2020-11-16T20:57:23.887 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.049851530999999998 2020-11-16T20:57:23.887 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.887 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.887 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.887 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:23.887 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:23.887 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:23.889 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:23.853+0000 7f1837789700 -1 osd.4 pg_epoch: 119 pg[3.3( v 118'734 (0'0,118'734] local-lis/les=19/20 n=124 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [4,0,6] r=0 lpr=19 crt=118'734 lcod 118'732 mlcod 118'732 active+clean+snaptrim trimq=[41~1] ps=[3d~1,3f~1,42~1,44~2,49~2]] removing snap head 2020-11-16T20:57:23.889 INFO:tasks.rados.rados.0.smithi166.stdout:1024: done (1 left) 2020-11-16T20:57:23.889 INFO:tasks.rados.rados.0.smithi166.stdout:1025: read oid 265 snap -1 2020-11-16T20:57:23.890 INFO:tasks.rados.rados.0.smithi166.stdout:1025: expect (ObjNum 618 snap 32 seq_num 618) 2020-11-16T20:57:23.890 INFO:tasks.rados.rados.0.smithi166.stdout:1026: snap_create 2020-11-16T20:57:23.890 INFO:tasks.rados.rados.0.smithi166.stdout:1023: finishing write tid 1 to smithi16641208-480 2020-11-16T20:57:23.890 INFO:tasks.rados.rados.0.smithi166.stdout:1023: finishing write tid 2 to smithi16641208-480 2020-11-16T20:57:23.890 INFO:tasks.rados.rados.0.smithi166.stdout:1023: finishing write tid 3 to smithi16641208-480 2020-11-16T20:57:23.890 INFO:tasks.rados.rados.0.smithi166.stdout:1023: finishing write tid 4 to smithi16641208-480 2020-11-16T20:57:23.891 INFO:tasks.rados.rados.0.smithi166.stdout:1023: finishing write tid 5 to smithi16641208-480 2020-11-16T20:57:23.891 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 480 v 737 (ObjNum 638 snap 39 seq_num 638) dirty exists 2020-11-16T20:57:23.891 INFO:tasks.rados.rados.0.smithi166.stdout:1023: left oid 480 (ObjNum 638 snap 39 seq_num 638) 2020-11-16T20:57:23.891 INFO:tasks.rados.rados.0.smithi166.stdout:1025: expect (ObjNum 618 snap 32 seq_num 618) 2020-11-16T20:57:23.891 INFO:teuthology.orchestra.run.smithi166.stderr:nodeep-scrub is set 2020-11-16T20:57:23.892 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:57:23.892 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:23.893+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:23.989 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:23.994+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:24.054 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:24.055 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:57:24.055 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:57:24.055 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:24.064 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:57:24.108 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:24.112+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:24.190 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:24.190 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:57:24.191 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:57:24.191 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:57:24.191 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:24.191 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:24.195+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:24.199 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:57:24.291 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:24.296+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:24.367 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:24.367 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:57:24.367 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:57:24.367 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:57:24.368 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.368 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2979 4.0 4:1852173c:::smithi16641208-329:head [write 581674~637746,stat] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:24.368 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:57:24.368 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 35.566328806000001, 2020-11-16T20:57:24.368 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.009457398, 2020-11-16T20:57:24.368 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:24.369 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:24.369 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:24.369 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:24.369 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:24.369 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2979 2020-11-16T20:57:24.369 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.370 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:24.370 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.370 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:24.370 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:57:24.370 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:24.370 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.371 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.371 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:24.371 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:57:24.371 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030732300000000003 2020-11-16T20:57:24.371 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.371 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.372 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:24.372 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803965+0000", 2020-11-16T20:57:24.372 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0319999999999992e-06 2020-11-16T20:57:24.372 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.372 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.372 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:24.373 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803974+0000", 2020-11-16T20:57:24.373 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5930000000000002e-05 2020-11-16T20:57:24.373 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.373 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.373 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:24.373 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803990+0000", 2020-11-16T20:57:24.373 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1910000000000006e-06 2020-11-16T20:57:24.374 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.374 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.374 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:24.374 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803999+0000", 2020-11-16T20:57:24.374 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5637000000000003e-05 2020-11-16T20:57:24.374 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.374 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.375 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.375 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.804055+0000", 2020-11-16T20:57:24.375 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3769000000000001e-05 2020-11-16T20:57:24.375 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.375 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.375 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:24.375 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.804088+0000", 2020-11-16T20:57:24.376 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.995239140000001 2020-11-16T20:57:24.376 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.376 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.376 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.376 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799328+0000", 2020-11-16T20:57:24.376 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0137818 2020-11-16T20:57:24.376 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.377 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.377 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:24.377 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813109+0000", 2020-11-16T20:57:24.377 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5759999999999996e-06 2020-11-16T20:57:24.377 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.377 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.378 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:24.378 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813115+0000", 2020-11-16T20:57:24.378 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.009457398 2020-11-16T20:57:24.378 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.378 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:24.378 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.378 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.378 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.379 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2980 4.0 4:1852173c:::smithi16641208-329:head [write 1840873~558854] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:24.379 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:57:24.379 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 35.560063073999999, 2020-11-16T20:57:24.379 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.039347508000001, 2020-11-16T20:57:24.379 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:24.379 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:24.379 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:24.380 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:24.380 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:24.380 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2980 2020-11-16T20:57:24.380 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.380 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:24.380 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.380 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:24.381 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:57:24.381 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:24.381 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.381 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.381 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:24.381 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:57:24.381 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024810899999999999 2020-11-16T20:57:24.382 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.382 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:24.382 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810171+0000", 2020-11-16T20:57:24.382 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5610000000000001e-06 2020-11-16T20:57:24.382 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.382 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:24.383 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810179+0000", 2020-11-16T20:57:24.383 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7418000000000002e-05 2020-11-16T20:57:24.383 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.383 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.383 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:24.383 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810196+0000", 2020-11-16T20:57:24.383 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0079999999999996e-06 2020-11-16T20:57:24.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.384 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:24.384 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810203+0000", 2020-11-16T20:57:24.384 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3705000000000002e-05 2020-11-16T20:57:24.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.385 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.385 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810257+0000", 2020-11-16T20:57:24.385 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3656999999999998e-05 2020-11-16T20:57:24.385 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.385 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.385 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:24.385 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810311+0000", 2020-11-16T20:57:24.385 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.989427508 2020-11-16T20:57:24.386 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.386 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.386 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.386 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799738+0000", 2020-11-16T20:57:24.386 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2526000000000003e-05 2020-11-16T20:57:24.386 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.386 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.387 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:24.387 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799811+0000", 2020-11-16T20:57:24.387 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027934184000000001 2020-11-16T20:57:24.387 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.387 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.387 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.387 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827745+0000", 2020-11-16T20:57:24.388 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015776700000000001 2020-11-16T20:57:24.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.388 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.388 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:24.388 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827903+0000", 2020-11-16T20:57:24.388 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000185539 2020-11-16T20:57:24.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.389 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:24.389 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.828088+0000", 2020-11-16T20:57:24.389 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018143857999999999 2020-11-16T20:57:24.389 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.389 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:24.390 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846232+0000", 2020-11-16T20:57:24.390 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00074682199999999996 2020-11-16T20:57:24.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.390 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.390 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:24.390 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846979+0000", 2020-11-16T20:57:24.390 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021617530000000002 2020-11-16T20:57:24.391 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.391 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:24.391 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849141+0000", 2020-11-16T20:57:24.391 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4513999999999998e-05 2020-11-16T20:57:24.391 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.391 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:24.392 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849215+0000", 2020-11-16T20:57:24.392 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5578999999999998e-05 2020-11-16T20:57:24.392 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.392 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.392 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:24.392 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849271+0000", 2020-11-16T20:57:24.392 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.039347508000001 2020-11-16T20:57:24.393 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.393 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:24.393 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.393 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.393 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.393 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2981 4.0 4:1852173c:::smithi16641208-329:head [write 3066417~537135] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:24.393 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:57:24.394 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 35.553146777000002, 2020-11-16T20:57:24.394 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.032910677, 2020-11-16T20:57:24.394 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:24.394 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:24.394 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:24.394 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:24.394 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:24.395 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2981 2020-11-16T20:57:24.395 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.395 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:24.395 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.395 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:24.395 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:57:24.395 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:24.395 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.396 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.396 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:24.396 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:57:24.396 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024974099999999999 2020-11-16T20:57:24.396 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.396 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.396 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:24.397 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817089+0000", 2020-11-16T20:57:24.397 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3829999999999992e-06 2020-11-16T20:57:24.397 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.397 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.397 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:24.397 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817098+0000", 2020-11-16T20:57:24.397 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2118e-05 2020-11-16T20:57:24.398 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.400 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.406 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:24.407 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817110+0000", 2020-11-16T20:57:24.407 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6050000000000004e-06 2020-11-16T20:57:24.407 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.408 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.408 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:24.408 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817119+0000", 2020-11-16T20:57:24.409 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7204000000000003e-05 2020-11-16T20:57:24.409 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.409 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.410 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.410 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817177+0000", 2020-11-16T20:57:24.410 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9932999999999998e-05 2020-11-16T20:57:24.411 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.411 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.411 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:24.412 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817227+0000", 2020-11-16T20:57:24.412 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.98265286 2020-11-16T20:57:24.412 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.413 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.413 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.414 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799879+0000", 2020-11-16T20:57:24.414 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.737e-05 2020-11-16T20:57:24.414 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.415 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.415 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:24.415 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799947+0000", 2020-11-16T20:57:24.416 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029940584999999999 2020-11-16T20:57:24.416 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.416 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.417 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.417 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.829887+0000", 2020-11-16T20:57:24.417 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000217505 2020-11-16T20:57:24.418 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.418 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.418 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:24.419 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.830105+0000", 2020-11-16T20:57:24.419 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029022100000000001 2020-11-16T20:57:24.419 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.420 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.420 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:24.420 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.830395+0000", 2020-11-16T20:57:24.421 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015847953000000001 2020-11-16T20:57:24.421 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.421 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.422 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:24.422 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846243+0000", 2020-11-16T20:57:24.422 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0011558250000000001 2020-11-16T20:57:24.423 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.423 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.423 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:24.424 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847399+0000", 2020-11-16T20:57:24.424 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021524500000000002 2020-11-16T20:57:24.424 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.425 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.425 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:24.426 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849551+0000", 2020-11-16T20:57:24.426 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000138787 2020-11-16T20:57:24.426 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.427 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.427 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:24.427 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849690+0000", 2020-11-16T20:57:24.428 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0136999999999997e-05 2020-11-16T20:57:24.428 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.428 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.429 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:24.429 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849750+0000", 2020-11-16T20:57:24.429 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.032910677 2020-11-16T20:57:24.430 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.430 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:24.430 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.431 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.431 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.431 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2982 4.0 4:1852173c:::smithi16641208-329:head [setxattr _header (58) in=7b,truncate 3781674] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:24.432 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:57:24.432 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 35.552828462000001, 2020-11-16T20:57:24.432 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.035208633, 2020-11-16T20:57:24.433 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:24.433 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:24.433 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:24.434 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:24.434 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:24.434 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2982 2020-11-16T20:57:24.435 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.435 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:24.435 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.436 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:24.436 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:57:24.436 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:24.437 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.437 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.437 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:24.438 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:57:24.438 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8856000000000002e-05 2020-11-16T20:57:24.439 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.439 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.439 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:24.440 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817197+0000", 2020-11-16T20:57:24.440 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.93e-06 2020-11-16T20:57:24.440 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.441 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.441 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:24.441 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817203+0000", 2020-11-16T20:57:24.442 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0932e-05 2020-11-16T20:57:24.442 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.442 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.443 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:24.443 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817214+0000", 2020-11-16T20:57:24.443 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3470000000000001e-06 2020-11-16T20:57:24.444 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.444 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.444 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:24.445 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817218+0000", 2020-11-16T20:57:24.445 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4603e-05 2020-11-16T20:57:24.445 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.446 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.446 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.446 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817263+0000", 2020-11-16T20:57:24.447 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6387000000000002e-05 2020-11-16T20:57:24.447 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.447 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.448 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:24.448 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817309+0000", 2020-11-16T20:57:24.448 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.982698653 2020-11-16T20:57:24.449 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.449 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.449 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.450 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800008+0000", 2020-11-16T20:57:24.450 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5400000000000004e-05 2020-11-16T20:57:24.451 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.451 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.451 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:24.452 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800073+0000", 2020-11-16T20:57:24.452 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.044932818999999999 2020-11-16T20:57:24.452 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.453 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.453 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.453 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845006+0000", 2020-11-16T20:57:24.454 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017285099999999999 2020-11-16T20:57:24.454 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.454 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.455 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:24.455 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845179+0000", 2020-11-16T20:57:24.455 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023420900000000001 2020-11-16T20:57:24.456 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.456 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.456 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:24.457 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845413+0000", 2020-11-16T20:57:24.457 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0020276000000000001 2020-11-16T20:57:24.457 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.458 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.458 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:24.458 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847441+0000", 2020-11-16T20:57:24.459 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00050358800000000002 2020-11-16T20:57:24.459 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.459 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.460 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:24.460 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847944+0000", 2020-11-16T20:57:24.460 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042758900000000001 2020-11-16T20:57:24.461 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.461 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.461 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:24.462 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852220+0000", 2020-11-16T20:57:24.462 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9648999999999997e-05 2020-11-16T20:57:24.462 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.463 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.463 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:24.463 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852290+0000", 2020-11-16T20:57:24.463 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6919e-05 2020-11-16T20:57:24.464 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.464 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.464 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:24.464 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852367+0000", 2020-11-16T20:57:24.464 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.035208633 2020-11-16T20:57:24.464 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.464 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:24.465 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.465 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.465 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.465 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2983 4.0 4:1852173c:::smithi16641208-329:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e86)", 2020-11-16T20:57:24.465 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:57:24.465 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 35.552737995000001, 2020-11-16T20:57:24.465 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.037016812999999, 2020-11-16T20:57:24.466 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:24.466 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:24.466 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:24.466 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:24.466 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:24.466 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2983 2020-11-16T20:57:24.466 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.467 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:24.467 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.467 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:24.467 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:57:24.467 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:24.467 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.467 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.468 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:24.468 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:57:24.468 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7317999999999999e-05 2020-11-16T20:57:24.468 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.468 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.468 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:24.468 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817266+0000", 2020-11-16T20:57:24.469 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3519999999999998e-06 2020-11-16T20:57:24.469 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.470 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.470 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:24.470 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817269+0000", 2020-11-16T20:57:24.470 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7859999999999999e-06 2020-11-16T20:57:24.470 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.470 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.470 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:24.471 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817276+0000", 2020-11-16T20:57:24.471 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5620000000000002e-06 2020-11-16T20:57:24.471 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.471 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.471 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:24.471 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817278+0000", 2020-11-16T20:57:24.471 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3251999999999996e-05 2020-11-16T20:57:24.472 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.472 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.472 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.472 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817352+0000", 2020-11-16T20:57:24.472 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7966000000000001e-05 2020-11-16T20:57:24.472 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.472 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.473 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:24.473 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817400+0000", 2020-11-16T20:57:24.473 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.982734203 2020-11-16T20:57:24.473 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.473 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.473 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.473 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800134+0000", 2020-11-16T20:57:24.473 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9765999999999997e-05 2020-11-16T20:57:24.474 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.474 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.474 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:24.474 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800194+0000", 2020-11-16T20:57:24.474 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.046087276000000003 2020-11-16T20:57:24.474 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.474 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.475 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.475 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846281+0000", 2020-11-16T20:57:24.475 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000115396 2020-11-16T20:57:24.475 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.475 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.475 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:24.475 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846396+0000", 2020-11-16T20:57:24.476 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006004573 2020-11-16T20:57:24.476 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.476 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.476 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.476 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852401+0000", 2020-11-16T20:57:24.476 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013211599999999999 2020-11-16T20:57:24.476 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.477 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.477 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:24.477 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852533+0000", 2020-11-16T20:57:24.477 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0017322469999999999 2020-11-16T20:57:24.477 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.477 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.478 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:24.478 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.854265+0000", 2020-11-16T20:57:24.478 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.037016812999999 2020-11-16T20:57:24.478 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.478 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:24.478 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.479 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.479 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.479 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2984 4.0 4:033219d6:::smithi16641208-386:head [write 598481~712995,stat] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:24.479 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:57:24.479 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 35.545678152999997, 2020-11-16T20:57:24.479 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.003104742, 2020-11-16T20:57:24.479 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:24.480 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:24.480 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:24.480 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:24.480 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:24.480 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2984 2020-11-16T20:57:24.480 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.480 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:24.481 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.481 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:24.481 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:57:24.481 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:24.481 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.481 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.481 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:24.481 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:57:24.482 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00037173000000000002 2020-11-16T20:57:24.482 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.482 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.482 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:24.482 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824680+0000", 2020-11-16T20:57:24.482 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.146e-05 2020-11-16T20:57:24.482 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.483 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.483 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:24.483 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824691+0000", 2020-11-16T20:57:24.483 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6951000000000001e-05 2020-11-16T20:57:24.483 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.483 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.483 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:24.484 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824708+0000", 2020-11-16T20:57:24.484 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2082000000000001e-05 2020-11-16T20:57:24.484 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.484 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.484 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:24.484 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824720+0000", 2020-11-16T20:57:24.484 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0284000000000002e-05 2020-11-16T20:57:24.485 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.485 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.485 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.485 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824771+0000", 2020-11-16T20:57:24.485 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1241000000000001e-05 2020-11-16T20:57:24.485 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.485 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.485 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:24.486 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824802+0000", 2020-11-16T20:57:24.486 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.975455838 2020-11-16T20:57:24.486 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.486 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.486 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.486 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800258+0000", 2020-11-16T20:57:24.486 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027151194999999999 2020-11-16T20:57:24.487 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.487 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.487 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:24.487 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827409+0000", 2020-11-16T20:57:24.487 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9609999999999999e-06 2020-11-16T20:57:24.487 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.487 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.488 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:24.488 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827413+0000", 2020-11-16T20:57:24.488 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.003104742 2020-11-16T20:57:24.488 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.488 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:24.488 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.488 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.488 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.489 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2985 4.0 4:033219d6:::smithi16641208-386:head [write 1899355~418865] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:24.489 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:57:24.489 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 35.540066871000001, 2020-11-16T20:57:24.489 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.021091737000001, 2020-11-16T20:57:24.489 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:24.489 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:24.489 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:24.490 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:24.490 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:24.490 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2985 2020-11-16T20:57:24.490 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.490 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:24.490 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.490 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:24.491 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:57:24.491 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:24.491 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.491 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.491 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:24.491 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:57:24.491 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023221799999999999 2020-11-16T20:57:24.492 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.492 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.492 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:24.492 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830152+0000", 2020-11-16T20:57:24.492 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9769999999999995e-06 2020-11-16T20:57:24.492 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.492 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.493 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:24.493 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830162+0000", 2020-11-16T20:57:24.493 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5545000000000001e-05 2020-11-16T20:57:24.493 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.493 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.493 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:24.493 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830177+0000", 2020-11-16T20:57:24.493 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0334e-05 2020-11-16T20:57:24.494 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.494 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.494 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:24.494 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830188+0000", 2020-11-16T20:57:24.494 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3430999999999996e-05 2020-11-16T20:57:24.494 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.495 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.495 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.495 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830251+0000", 2020-11-16T20:57:24.495 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2651999999999997e-05 2020-11-16T20:57:24.495 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.495 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.495 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:24.495 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830304+0000", 2020-11-16T20:57:24.496 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.970289857999999 2020-11-16T20:57:24.496 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.496 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.496 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.496 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800594+0000", 2020-11-16T20:57:24.496 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8948999999999993e-05 2020-11-16T20:57:24.496 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.497 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.497 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:24.497 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800663+0000", 2020-11-16T20:57:24.497 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036018513000000002 2020-11-16T20:57:24.497 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.497 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.497 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.498 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836681+0000", 2020-11-16T20:57:24.498 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013201099999999999 2020-11-16T20:57:24.498 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.498 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.498 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:24.498 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836813+0000", 2020-11-16T20:57:24.498 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000126635 2020-11-16T20:57:24.498 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.499 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.499 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:24.499 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836940+0000", 2020-11-16T20:57:24.499 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010477907 2020-11-16T20:57:24.499 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.499 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.499 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:24.500 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847418+0000", 2020-11-16T20:57:24.500 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000158796 2020-11-16T20:57:24.500 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.500 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.500 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:24.500 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847576+0000", 2020-11-16T20:57:24.500 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033023729999999999 2020-11-16T20:57:24.501 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.501 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.501 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:24.501 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850879+0000", 2020-11-16T20:57:24.501 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6360999999999996e-05 2020-11-16T20:57:24.501 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.501 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.501 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:24.502 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850955+0000", 2020-11-16T20:57:24.502 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6177000000000001e-05 2020-11-16T20:57:24.502 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.502 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.502 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:24.502 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851011+0000", 2020-11-16T20:57:24.502 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.021091737000001 2020-11-16T20:57:24.503 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.503 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:24.503 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.503 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.503 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.503 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2986 4.0 4:033219d6:::smithi16641208-386:head [write 3093840~704641] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:24.503 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:57:24.504 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 35.531841169000003, 2020-11-16T20:57:24.504 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013155362999999, 2020-11-16T20:57:24.504 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:24.504 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:24.504 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:24.504 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:24.504 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:24.505 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2986 2020-11-16T20:57:24.505 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.505 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:24.505 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.505 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:24.505 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:57:24.505 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:24.506 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.506 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.506 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:24.506 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:57:24.506 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00038247200000000002 2020-11-16T20:57:24.506 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.506 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.506 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:24.507 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838528+0000", 2020-11-16T20:57:24.507 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3299999999999999e-06 2020-11-16T20:57:24.507 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.507 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.507 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:24.507 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838536+0000", 2020-11-16T20:57:24.507 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3438000000000001e-05 2020-11-16T20:57:24.508 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.508 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.508 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:24.508 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838549+0000", 2020-11-16T20:57:24.508 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0213e-05 2020-11-16T20:57:24.508 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.508 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.509 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:24.509 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838560+0000", 2020-11-16T20:57:24.509 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1894999999999997e-05 2020-11-16T20:57:24.509 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.509 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.509 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.509 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838612+0000", 2020-11-16T20:57:24.510 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8209e-05 2020-11-16T20:57:24.510 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.510 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.510 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:24.510 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838650+0000", 2020-11-16T20:57:24.510 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962061715000001 2020-11-16T20:57:24.510 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.511 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.511 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.511 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800712+0000", 2020-11-16T20:57:24.511 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6964e-05 2020-11-16T20:57:24.511 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.511 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.511 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:24.512 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800748+0000", 2020-11-16T20:57:24.512 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037209265999999998 2020-11-16T20:57:24.512 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.512 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.512 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.512 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.837958+0000", 2020-11-16T20:57:24.512 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000160304 2020-11-16T20:57:24.513 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.513 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.513 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:24.513 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.838118+0000", 2020-11-16T20:57:24.513 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022362799999999999 2020-11-16T20:57:24.513 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.513 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.514 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:24.514 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.838342+0000", 2020-11-16T20:57:24.514 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0090844710000000002 2020-11-16T20:57:24.514 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.514 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.514 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:24.514 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847426+0000", 2020-11-16T20:57:24.515 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000219199 2020-11-16T20:57:24.515 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.515 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.515 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:24.515 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847645+0000", 2020-11-16T20:57:24.515 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003411603 2020-11-16T20:57:24.515 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.515 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.516 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:24.516 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851057+0000", 2020-11-16T20:57:24.516 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014736799999999999 2020-11-16T20:57:24.516 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.516 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.516 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:24.516 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851204+0000", 2020-11-16T20:57:24.517 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6287999999999997e-05 2020-11-16T20:57:24.517 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.517 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.517 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:24.517 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851301+0000", 2020-11-16T20:57:24.517 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013155362999999 2020-11-16T20:57:24.517 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.518 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:24.518 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.518 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.518 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.518 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2987 4.0 4:033219d6:::smithi16641208-386:head [setxattr _header (58) in=7b,truncate 3798481] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:24.518 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:57:24.518 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 35.531382530000002, 2020-11-16T20:57:24.519 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.012971041, 2020-11-16T20:57:24.519 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:24.519 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:24.519 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:24.519 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:24.519 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:24.519 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2987 2020-11-16T20:57:24.520 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.520 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:24.520 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.520 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:24.520 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:57:24.520 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:24.520 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.520 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.521 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:24.521 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:57:24.521 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4530000000000002e-05 2020-11-16T20:57:24.521 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.521 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.521 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:24.521 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838648+0000", 2020-11-16T20:57:24.522 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8390000000000001e-06 2020-11-16T20:57:24.522 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.522 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.522 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:24.522 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838655+0000", 2020-11-16T20:57:24.522 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0341e-05 2020-11-16T20:57:24.522 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.523 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.523 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:24.523 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838666+0000", 2020-11-16T20:57:24.523 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0929999999999999e-06 2020-11-16T20:57:24.523 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.523 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.523 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:24.523 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838672+0000", 2020-11-16T20:57:24.524 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8074999999999997e-05 2020-11-16T20:57:24.524 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.524 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.524 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.524 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838710+0000", 2020-11-16T20:57:24.524 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1121000000000002e-05 2020-11-16T20:57:24.524 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.525 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.525 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:24.525 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838751+0000", 2020-11-16T20:57:24.525 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962044797000001 2020-11-16T20:57:24.525 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.525 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.525 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.525 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800796+0000", 2020-11-16T20:57:24.526 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6808999999999998e-05 2020-11-16T20:57:24.526 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.526 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.526 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:24.526 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800852+0000", 2020-11-16T20:57:24.526 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042964599999999999 2020-11-16T20:57:24.526 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.527 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.527 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.527 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843817+0000", 2020-11-16T20:57:24.527 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017807899999999999 2020-11-16T20:57:24.527 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.527 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.527 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:24.528 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843995+0000", 2020-11-16T20:57:24.528 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023680500000000001 2020-11-16T20:57:24.528 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.528 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.528 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:24.528 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844232+0000", 2020-11-16T20:57:24.528 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00320163 2020-11-16T20:57:24.528 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.529 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.529 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:24.529 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847434+0000", 2020-11-16T20:57:24.529 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00042527899999999998 2020-11-16T20:57:24.529 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.529 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.529 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:24.530 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847859+0000", 2020-11-16T20:57:24.530 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0034987920000000001 2020-11-16T20:57:24.530 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.530 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.530 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:24.530 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851358+0000", 2020-11-16T20:57:24.530 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014067300000000001 2020-11-16T20:57:24.531 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.531 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.531 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:24.531 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851498+0000", 2020-11-16T20:57:24.531 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6577999999999998e-05 2020-11-16T20:57:24.531 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.531 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.531 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:24.532 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851575+0000", 2020-11-16T20:57:24.532 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.012971041 2020-11-16T20:57:24.532 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.532 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:24.532 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.532 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.532 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.533 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2988 4.0 4:033219d6:::smithi16641208-386:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e86)", 2020-11-16T20:57:24.533 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:57:24.533 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 35.531280031000001, 2020-11-16T20:57:24.533 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013229791000001, 2020-11-16T20:57:24.533 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:24.533 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:24.533 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:24.534 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:24.534 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:24.534 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2988 2020-11-16T20:57:24.534 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.534 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:24.534 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.534 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:24.535 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:57:24.535 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:24.535 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.535 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.535 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:24.535 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:57:24.535 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9252999999999999e-05 2020-11-16T20:57:24.535 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.536 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.536 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:24.536 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838736+0000", 2020-11-16T20:57:24.536 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3980000000000004e-06 2020-11-16T20:57:24.536 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.536 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.536 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:24.537 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838742+0000", 2020-11-16T20:57:24.537 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1144999999999999e-05 2020-11-16T20:57:24.537 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.537 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.537 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:24.537 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838753+0000", 2020-11-16T20:57:24.537 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6229999999999996e-06 2020-11-16T20:57:24.537 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.538 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.538 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:24.538 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838758+0000", 2020-11-16T20:57:24.538 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5130000000000003e-05 2020-11-16T20:57:24.538 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.538 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.538 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.539 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838803+0000", 2020-11-16T20:57:24.539 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0132000000000001e-05 2020-11-16T20:57:24.539 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.539 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.539 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:24.539 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838843+0000", 2020-11-16T20:57:24.539 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962066786999999 2020-11-16T20:57:24.540 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.540 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.540 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.540 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800910+0000", 2020-11-16T20:57:24.540 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6925999999999997e-05 2020-11-16T20:57:24.540 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.540 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.540 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:24.541 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800967+0000", 2020-11-16T20:57:24.541 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.043837752000000001 2020-11-16T20:57:24.541 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.541 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.541 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.541 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844805+0000", 2020-11-16T20:57:24.541 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012337000000000001 2020-11-16T20:57:24.542 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.542 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.542 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:24.542 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844928+0000", 2020-11-16T20:57:24.542 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0066885149999999999 2020-11-16T20:57:24.542 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.542 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.543 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.543 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851616+0000", 2020-11-16T20:57:24.543 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5716000000000005e-05 2020-11-16T20:57:24.543 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.543 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.543 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:24.543 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851692+0000", 2020-11-16T20:57:24.544 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024404400000000001 2020-11-16T20:57:24.544 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.544 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.544 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:24.544 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851936+0000", 2020-11-16T20:57:24.544 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013229791000001 2020-11-16T20:57:24.544 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.545 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:24.545 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.545 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.545 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.545 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2992 4.0 4:0f4a2e46:::smithi16641208-399:head [cache-evict] snapc 0=[] ondisk+read+ignore_cache+known_if_redirected e86)", 2020-11-16T20:57:24.545 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:57:24.545 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 35.531193694000002, 2020-11-16T20:57:24.545 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962433468, 2020-11-16T20:57:24.546 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:24.546 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:24.546 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:24.546 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:24.546 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:24.546 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2992 2020-11-16T20:57:24.546 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.547 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:24.547 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.547 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:24.547 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:57:24.547 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:24.547 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.547 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.548 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:24.548 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:57:24.548 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7780000000000002e-05 2020-11-16T20:57:24.548 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.548 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.548 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:24.548 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838820+0000", 2020-11-16T20:57:24.548 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1200000000000001e-06 2020-11-16T20:57:24.549 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.549 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.549 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:24.549 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838826+0000", 2020-11-16T20:57:24.549 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0008e-05 2020-11-16T20:57:24.549 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.549 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.550 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:24.550 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838836+0000", 2020-11-16T20:57:24.550 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3749999999999996e-06 2020-11-16T20:57:24.550 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.550 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.550 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:24.550 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838840+0000", 2020-11-16T20:57:24.551 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0889000000000002e-05 2020-11-16T20:57:24.551 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.551 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.551 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.551 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838871+0000", 2020-11-16T20:57:24.551 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6891000000000003e-05 2020-11-16T20:57:24.551 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.552 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.552 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:24.552 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838908+0000", 2020-11-16T20:57:24.552 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962115045999999 2020-11-16T20:57:24.552 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.552 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.552 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.552 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801023+0000", 2020-11-16T20:57:24.553 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020335899999999999 2020-11-16T20:57:24.553 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.553 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.553 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:24.553 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801226+0000", 2020-11-16T20:57:24.553 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962433468 2020-11-16T20:57:24.553 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.554 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:24.554 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.554 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.554 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.554 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3051 4.0 4:2ceac9f9:::smithi16641208-61:head [write 699323~480842] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:57:24.554 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:57:24.554 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 30.529073387, 2020-11-16T20:57:24.555 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9728349610000002, 2020-11-16T20:57:24.555 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:24.555 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:24.555 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:24.555 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:24.555 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:24.555 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3051 2020-11-16T20:57:24.556 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.556 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:24.556 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.556 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:24.556 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:57:24.556 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:24.556 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.556 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.557 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:24.557 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:57:24.557 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032526199999999999 2020-11-16T20:57:24.557 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.557 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.557 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:24.557 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841238+0000", 2020-11-16T20:57:24.558 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9822000000000001e-05 2020-11-16T20:57:24.558 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.558 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.558 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:24.558 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841258+0000", 2020-11-16T20:57:24.558 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.507e-05 2020-11-16T20:57:24.558 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.559 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.559 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:24.559 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841273+0000", 2020-11-16T20:57:24.559 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8900000000000007e-06 2020-11-16T20:57:24.559 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.559 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.559 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:24.559 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841281+0000", 2020-11-16T20:57:24.560 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4356000000000003e-05 2020-11-16T20:57:24.560 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.560 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.560 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.560 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841365+0000", 2020-11-16T20:57:24.560 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0232000000000002e-05 2020-11-16T20:57:24.560 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.561 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.561 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:24.561 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841426+0000", 2020-11-16T20:57:24.561 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9604309439999996 2020-11-16T20:57:24.561 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.561 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.561 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.562 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801857+0000", 2020-11-16T20:57:24.562 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000164897 2020-11-16T20:57:24.562 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.562 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.562 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:24.562 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.802021+0000", 2020-11-16T20:57:24.562 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020576500000000001 2020-11-16T20:57:24.562 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.563 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.563 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:24.563 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.802227+0000", 2020-11-16T20:57:24.563 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0066237170000000003 2020-11-16T20:57:24.563 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.563 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.563 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:24.564 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808851+0000", 2020-11-16T20:57:24.564 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037712430000000001 2020-11-16T20:57:24.564 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.564 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.564 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:24.564 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812622+0000", 2020-11-16T20:57:24.564 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00099110800000000009 2020-11-16T20:57:24.565 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.565 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.565 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:24.565 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813613+0000", 2020-11-16T20:57:24.565 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1646e-05 2020-11-16T20:57:24.565 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.565 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.565 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:24.566 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813665+0000", 2020-11-16T20:57:24.566 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3009000000000004e-05 2020-11-16T20:57:24.566 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.566 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.566 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:24.566 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813748+0000", 2020-11-16T20:57:24.566 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9728349610000002 2020-11-16T20:57:24.567 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.567 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:24.567 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.567 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.567 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.567 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3052 4.0 4:2ceac9f9:::smithi16641208-61:head [write 1850247~429872] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:57:24.567 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:57:24.568 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 30.520882348000001, 2020-11-16T20:57:24.568 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9911138360000002, 2020-11-16T20:57:24.568 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:24.568 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:24.568 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:24.568 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:24.568 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:24.569 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3052 2020-11-16T20:57:24.569 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.569 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:24.569 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.569 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:24.569 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:57:24.569 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:24.569 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.570 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.570 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:24.570 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:57:24.570 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000296166 2020-11-16T20:57:24.570 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.570 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.571 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:24.571 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849400+0000", 2020-11-16T20:57:24.571 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0699999999999996e-06 2020-11-16T20:57:24.571 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.571 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.571 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:24.571 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849409+0000", 2020-11-16T20:57:24.572 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3725e-05 2020-11-16T20:57:24.572 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.572 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.572 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:24.572 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849423+0000", 2020-11-16T20:57:24.572 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9929999999999998e-06 2020-11-16T20:57:24.572 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.572 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.573 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:24.573 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849430+0000", 2020-11-16T20:57:24.573 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9708000000000002e-05 2020-11-16T20:57:24.573 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.573 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.573 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.573 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849520+0000", 2020-11-16T20:57:24.574 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2088000000000002e-05 2020-11-16T20:57:24.574 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.574 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.574 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:24.574 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849552+0000", 2020-11-16T20:57:24.574 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.954526692 2020-11-16T20:57:24.574 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.575 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.575 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.575 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804079+0000", 2020-11-16T20:57:24.575 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015456899999999999 2020-11-16T20:57:24.575 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.575 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.575 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:24.575 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804233+0000", 2020-11-16T20:57:24.576 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019627800000000001 2020-11-16T20:57:24.576 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.576 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.576 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:24.576 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804429+0000", 2020-11-16T20:57:24.576 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006762316 2020-11-16T20:57:24.576 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.577 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.577 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:24.577 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811192+0000", 2020-11-16T20:57:24.577 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002630467 2020-11-16T20:57:24.577 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.577 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.577 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:24.578 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813822+0000", 2020-11-16T20:57:24.578 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026302065999999999 2020-11-16T20:57:24.578 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.578 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.578 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:24.578 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840124+0000", 2020-11-16T20:57:24.578 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.274e-05 2020-11-16T20:57:24.578 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.579 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.579 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:24.579 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840177+0000", 2020-11-16T20:57:24.579 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0958000000000003e-05 2020-11-16T20:57:24.579 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.579 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.579 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:24.580 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840218+0000", 2020-11-16T20:57:24.580 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9911138360000002 2020-11-16T20:57:24.580 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.580 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:24.580 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.580 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.580 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.580 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3053 4.0 4:2ceac9f9:::smithi16641208-61:head [write 2858378~532392] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:57:24.581 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:57:24.581 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 30.512425017000002, 2020-11-16T20:57:24.581 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9828430529999999, 2020-11-16T20:57:24.581 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:24.581 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:24.581 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:24.581 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:24.582 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:24.582 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3053 2020-11-16T20:57:24.582 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.582 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:24.582 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.582 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:24.582 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:57:24.583 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:24.583 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.583 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.583 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:24.583 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:57:24.583 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000647082 2020-11-16T20:57:24.583 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.584 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.584 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:24.584 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858208+0000", 2020-11-16T20:57:24.584 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.269e-05 2020-11-16T20:57:24.584 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.584 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.584 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:24.584 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858221+0000", 2020-11-16T20:57:24.585 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0361e-05 2020-11-16T20:57:24.585 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.585 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.585 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:24.585 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858242+0000", 2020-11-16T20:57:24.585 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1184e-05 2020-11-16T20:57:24.585 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.586 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.586 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:24.586 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858253+0000", 2020-11-16T20:57:24.586 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7032000000000004e-05 2020-11-16T20:57:24.586 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.586 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.586 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.587 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858330+0000", 2020-11-16T20:57:24.587 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4135999999999998e-05 2020-11-16T20:57:24.587 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.587 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.587 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:24.587 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858384+0000", 2020-11-16T20:57:24.587 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9487614310000003 2020-11-16T20:57:24.587 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.588 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.588 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.588 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807145+0000", 2020-11-16T20:57:24.588 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9426000000000007e-05 2020-11-16T20:57:24.588 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.588 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.588 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:24.589 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807245+0000", 2020-11-16T20:57:24.589 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018410799999999999 2020-11-16T20:57:24.589 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.589 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.589 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:24.589 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807429+0000", 2020-11-16T20:57:24.589 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0064067339999999999 2020-11-16T20:57:24.589 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.590 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.590 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:24.590 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813836+0000", 2020-11-16T20:57:24.590 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001513267 2020-11-16T20:57:24.590 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.590 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.590 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:24.591 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815349+0000", 2020-11-16T20:57:24.591 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024962895999999998 2020-11-16T20:57:24.591 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.591 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.591 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:24.591 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840312+0000", 2020-11-16T20:57:24.591 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7781999999999997e-05 2020-11-16T20:57:24.592 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.592 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.592 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:24.592 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840370+0000", 2020-11-16T20:57:24.592 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4924e-05 2020-11-16T20:57:24.592 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.592 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.592 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:24.593 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840404+0000", 2020-11-16T20:57:24.593 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9828430529999999 2020-11-16T20:57:24.593 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.593 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:24.593 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.593 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.593 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.594 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3054 4.0 4:2ceac9f9:::smithi16641208-61:head [setxattr _header (57) in=7b,truncate 3899323] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:57:24.594 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:57:24.594 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 30.51167251, 2020-11-16T20:57:24.594 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9822430049999999, 2020-11-16T20:57:24.594 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:24.594 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:24.594 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:24.595 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:24.595 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:24.595 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3054 2020-11-16T20:57:24.595 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.595 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:24.595 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.595 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:24.596 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:57:24.596 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:24.596 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.596 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.596 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:24.596 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:57:24.596 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8208999999999999e-05 2020-11-16T20:57:24.597 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.597 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.597 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:24.597 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858362+0000", 2020-11-16T20:57:24.597 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5539999999999998e-06 2020-11-16T20:57:24.597 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.597 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.597 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:24.598 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858371+0000", 2020-11-16T20:57:24.598 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.005e-05 2020-11-16T20:57:24.598 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.598 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.598 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:24.598 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858381+0000", 2020-11-16T20:57:24.598 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8099999999999997e-06 2020-11-16T20:57:24.599 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.599 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.599 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:24.599 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858386+0000", 2020-11-16T20:57:24.599 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6168000000000005e-05 2020-11-16T20:57:24.599 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.599 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.600 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.600 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858482+0000", 2020-11-16T20:57:24.600 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7954999999999999e-05 2020-11-16T20:57:24.600 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.600 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.600 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:24.600 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858510+0000", 2020-11-16T20:57:24.600 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9498925639999998 2020-11-16T20:57:24.601 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.601 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.601 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.601 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808402+0000", 2020-11-16T20:57:24.601 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3084000000000005e-05 2020-11-16T20:57:24.601 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.601 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.602 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:24.602 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808495+0000", 2020-11-16T20:57:24.602 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114826 2020-11-16T20:57:24.602 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.602 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.602 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:24.602 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808610+0000", 2020-11-16T20:57:24.603 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052363219999999999 2020-11-16T20:57:24.603 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.603 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.603 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:24.603 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813846+0000", 2020-11-16T20:57:24.603 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0015700709999999999 2020-11-16T20:57:24.603 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.604 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.604 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:24.604 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815417+0000", 2020-11-16T20:57:24.604 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025048682999999999 2020-11-16T20:57:24.604 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.604 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.604 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:24.604 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840465+0000", 2020-11-16T20:57:24.605 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5473000000000003e-05 2020-11-16T20:57:24.605 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.605 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.605 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:24.605 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840511+0000", 2020-11-16T20:57:24.605 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6236000000000003e-05 2020-11-16T20:57:24.605 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.606 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.606 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:24.606 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840557+0000", 2020-11-16T20:57:24.606 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9822430049999999 2020-11-16T20:57:24.606 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.606 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:24.606 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.607 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.607 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.607 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3055 4.0 4:2ceac9f9:::smithi16641208-61:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e91)", 2020-11-16T20:57:24.607 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:57:24.607 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 30.511497314, 2020-11-16T20:57:24.607 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9852841799999998, 2020-11-16T20:57:24.607 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:24.607 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:24.608 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:24.608 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:24.608 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:24.608 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3055 2020-11-16T20:57:24.608 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.608 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:24.608 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.609 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:24.609 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:57:24.609 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:24.609 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.609 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.609 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:24.609 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:57:24.609 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4403000000000002e-05 2020-11-16T20:57:24.610 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.610 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.610 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:24.610 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858523+0000", 2020-11-16T20:57:24.610 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4670000000000001e-06 2020-11-16T20:57:24.610 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.610 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.611 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:24.611 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858530+0000", 2020-11-16T20:57:24.611 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2469999999999999e-05 2020-11-16T20:57:24.611 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.611 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.611 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:24.611 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858542+0000", 2020-11-16T20:57:24.612 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2449999999999998e-06 2020-11-16T20:57:24.612 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.612 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.612 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:24.612 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858548+0000", 2020-11-16T20:57:24.612 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9604000000000002e-05 2020-11-16T20:57:24.612 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.612 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.613 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.613 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858587+0000", 2020-11-16T20:57:24.613 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4863000000000001e-05 2020-11-16T20:57:24.613 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.613 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.613 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:24.613 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858632+0000", 2020-11-16T20:57:24.614 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9521692039999996 2020-11-16T20:57:24.614 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.614 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.614 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.614 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.810801+0000", 2020-11-16T20:57:24.614 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014886700000000001 2020-11-16T20:57:24.614 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.615 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.615 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:24.615 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.810950+0000", 2020-11-16T20:57:24.615 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029669781999999999 2020-11-16T20:57:24.615 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.615 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.615 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.615 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840620+0000", 2020-11-16T20:57:24.616 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010005699999999999 2020-11-16T20:57:24.616 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.616 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.616 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:24.616 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840720+0000", 2020-11-16T20:57:24.616 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030532179999999999 2020-11-16T20:57:24.616 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.617 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.617 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:24.617 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843773+0000", 2020-11-16T20:57:24.617 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9852841799999998 2020-11-16T20:57:24.617 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.617 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:24.617 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.618 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.618 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.618 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3065 4.0 4:2f657946:::smithi16641208-73:head [read 0~3210104,checksum] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:57:24.618 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:57:24.618 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 30.403222290999999, 2020-11-16T20:57:24.618 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8738324339999997, 2020-11-16T20:57:24.618 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:24.618 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:24.619 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:24.619 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:24.619 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:24.619 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3065 2020-11-16T20:57:24.619 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.619 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:24.619 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.620 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:24.620 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:57:24.620 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:24.620 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.620 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.620 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:24.620 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:57:24.621 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3065999999999999e-05 2020-11-16T20:57:24.621 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.621 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.621 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:24.621 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966787+0000", 2020-11-16T20:57:24.621 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8329999999999998e-06 2020-11-16T20:57:24.621 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.621 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.622 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:24.622 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966790+0000", 2020-11-16T20:57:24.622 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1780000000000002e-06 2020-11-16T20:57:24.622 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.622 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.622 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:24.622 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966795+0000", 2020-11-16T20:57:24.623 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3460000000000001e-06 2020-11-16T20:57:24.623 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.623 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.623 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:24.623 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966798+0000", 2020-11-16T20:57:24.623 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6675000000000003e-05 2020-11-16T20:57:24.623 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.624 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.624 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.624 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966844+0000", 2020-11-16T20:57:24.624 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5497999999999999e-05 2020-11-16T20:57:24.624 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.624 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.624 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:24.624 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966870+0000", 2020-11-16T20:57:24.625 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8445859479999998 2020-11-16T20:57:24.625 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.625 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.625 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.625 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811456+0000", 2020-11-16T20:57:24.625 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029140889999999999 2020-11-16T20:57:24.625 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.626 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.626 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:24.626 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840597+0000", 2020-11-16T20:57:24.626 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8738324339999997 2020-11-16T20:57:24.626 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.626 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:24.626 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.627 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.627 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.627 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3066 4.0 4:356864c0:::smithi16641208-150:head [read 0~2504243,checksum,omap-get-vals-by-keys,omap-get-keys,omap-get-vals,omap-get-header,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:57:24.627 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:57:24.627 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 30.403171065999999, 2020-11-16T20:57:24.627 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8778990499999999, 2020-11-16T20:57:24.627 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:24.627 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:24.628 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:24.628 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:24.628 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:24.628 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3066 2020-11-16T20:57:24.628 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.628 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:24.628 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.629 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:24.629 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:57:24.629 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:24.629 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.629 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.629 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:24.629 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:57:24.630 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1704000000000001e-05 2020-11-16T20:57:24.630 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.630 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.630 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:24.630 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966837+0000", 2020-11-16T20:57:24.630 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6850000000000001e-06 2020-11-16T20:57:24.630 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.631 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.631 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:24.631 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966840+0000", 2020-11-16T20:57:24.631 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7479999999999999e-06 2020-11-16T20:57:24.631 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.631 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.631 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:24.631 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966845+0000", 2020-11-16T20:57:24.632 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5059999999999998e-06 2020-11-16T20:57:24.632 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.632 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.632 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:24.632 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966848+0000", 2020-11-16T20:57:24.632 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4314000000000002e-05 2020-11-16T20:57:24.632 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.633 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.633 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.633 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966902+0000", 2020-11-16T20:57:24.633 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.561e-05 2020-11-16T20:57:24.633 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.633 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.633 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:24.634 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:57:24.634 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8448102110000004 2020-11-16T20:57:24.634 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.634 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.634 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.634 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811738+0000", 2020-11-16T20:57:24.634 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032976272000000001 2020-11-16T20:57:24.634 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.635 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.635 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:24.635 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844714+0000", 2020-11-16T20:57:24.635 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8778990499999999 2020-11-16T20:57:24.635 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.635 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:24.635 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.636 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.636 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.636 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3067 4.0 4:356864c0:::smithi16641208-150:head [sparse-read 0~2504243] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:57:24.636 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:57:24.636 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 30.403119609000001, 2020-11-16T20:57:24.636 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8780898150000001, 2020-11-16T20:57:24.636 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:24.637 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:24.637 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:24.637 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:24.637 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:24.637 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3067 2020-11-16T20:57:24.637 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.637 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:24.637 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.638 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:24.638 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:57:24.638 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:24.638 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.638 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.638 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:24.638 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:57:24.639 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2826e-05 2020-11-16T20:57:24.639 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.639 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.639 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:24.639 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966900+0000", 2020-11-16T20:57:24.639 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.694e-06 2020-11-16T20:57:24.639 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.640 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.640 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:24.640 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966902+0000", 2020-11-16T20:57:24.640 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0889999999999999e-06 2020-11-16T20:57:24.640 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.640 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.640 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:24.640 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966907+0000", 2020-11-16T20:57:24.641 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3910000000000001e-06 2020-11-16T20:57:24.641 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.641 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.641 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:24.641 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966910+0000", 2020-11-16T20:57:24.641 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2771000000000002e-05 2020-11-16T20:57:24.641 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.642 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.642 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.642 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966943+0000", 2020-11-16T20:57:24.642 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5301000000000001e-05 2020-11-16T20:57:24.642 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.642 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.642 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:24.643 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966968+0000", 2020-11-16T20:57:24.643 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.845055017 2020-11-16T20:57:24.643 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.643 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.643 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.643 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812023+0000", 2020-11-16T20:57:24.643 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032933726000000003 2020-11-16T20:57:24.643 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.644 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.644 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:24.644 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844957+0000", 2020-11-16T20:57:24.644 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8780898150000001 2020-11-16T20:57:24.644 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.644 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:24.644 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.645 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.645 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.645 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3068 4.0 4:356864c0:::smithi16641208-150:head [read 0~2504243,checksum] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:57:24.645 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:57:24.645 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 30.403058270999999, 2020-11-16T20:57:24.645 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8828719500000002, 2020-11-16T20:57:24.645 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:24.645 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:24.646 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:24.646 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:24.646 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:24.646 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3068 2020-11-16T20:57:24.646 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.646 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:24.646 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.647 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:24.647 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:57:24.647 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:24.647 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.647 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.647 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:24.647 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:57:24.648 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0942999999999999e-05 2020-11-16T20:57:24.648 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.648 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.648 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:24.648 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966949+0000", 2020-11-16T20:57:24.648 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.712e-06 2020-11-16T20:57:24.648 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.648 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.649 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:24.649 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966952+0000", 2020-11-16T20:57:24.649 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8479999999999997e-06 2020-11-16T20:57:24.649 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.649 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.649 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:24.649 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966958+0000", 2020-11-16T20:57:24.650 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9170000000000002e-06 2020-11-16T20:57:24.650 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.650 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.650 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:24.650 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966961+0000", 2020-11-16T20:57:24.650 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4105999999999999e-05 2020-11-16T20:57:24.650 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.651 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.651 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.651 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966985+0000", 2020-11-16T20:57:24.651 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2056e-05 2020-11-16T20:57:24.651 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.651 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.651 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:24.651 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.967007+0000", 2020-11-16T20:57:24.652 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8456606430000004 2020-11-16T20:57:24.652 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.652 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.652 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:24.652 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812667+0000", 2020-11-16T20:57:24.652 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037132724999999998 2020-11-16T20:57:24.652 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:24.653 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:24.653 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:24.653 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849800+0000", 2020-11-16T20:57:24.653 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8828719500000002 2020-11-16T20:57:24.653 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.653 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:24.653 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.654 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:24.654 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:24.654 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:24.655 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:24.660+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:24.655 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:57:24.677 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:57:24.744 INFO:tasks.rados.rados.0.smithi166.stdout:1023: done (2 left) 2020-11-16T20:57:24.745 INFO:tasks.rados.rados.0.smithi166.stdout:1025: done (1 left) 2020-11-16T20:57:24.745 INFO:tasks.rados.rados.0.smithi166.stdout:1026: done (0 left) 2020-11-16T20:57:24.745 INFO:tasks.rados.rados.0.smithi166.stdout:1027: copy_from oid 423 from oid 386 current snap is 40 2020-11-16T20:57:24.746 INFO:tasks.rados.rados.0.smithi166.stdout:1028: cache_flush oid 454 snap 36 2020-11-16T20:57:24.746 INFO:tasks.rados.rados.0.smithi166.stdout:1029: read oid 134 snap -1 2020-11-16T20:57:24.746 INFO:tasks.rados.rados.0.smithi166.stdout:1029: expect (ObjNum 133 snap 0 seq_num 133) 2020-11-16T20:57:24.746 INFO:tasks.rados.rados.0.smithi166.stdout:1030: delete oid 421 current snap is 40 2020-11-16T20:57:24.755 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:24.760+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:24.758 INFO:tasks.rados.rados.0.smithi166.stdout:1030: done (3 left) 2020-11-16T20:57:24.758 INFO:tasks.rados.rados.0.smithi166.stdout:1031: read oid 267 snap -1 2020-11-16T20:57:24.759 INFO:tasks.rados.rados.0.smithi166.stdout:1031: expect (ObjNum 266 snap 0 seq_num 266) 2020-11-16T20:57:24.759 INFO:tasks.rados.rados.0.smithi166.stdout:1032: write oid 385 current snap is 40 2020-11-16T20:57:24.759 INFO:tasks.rados.rados.0.smithi166.stdout:1032: seq_num 640 ranges {756480=733012,2134711=432549} 2020-11-16T20:57:24.766 INFO:tasks.rados.rados.0.smithi166.stdout:1032: writing smithi16641208-385 from 756480 to 1489492 tid 1 2020-11-16T20:57:24.772 INFO:tasks.rados.rados.0.smithi166.stdout:1032: writing smithi16641208-385 from 2134711 to 2567260 tid 2 2020-11-16T20:57:24.772 INFO:tasks.rados.rados.0.smithi166.stdout:1033: snap_remove snap 39 2020-11-16T20:57:24.852 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:24.852 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:57:24.852 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:57:24.852 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:24.856 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:24.860+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:24.862 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:57:24.867 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:57:24.887 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:57:24.907 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:57:24.926 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:57:24.947 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:57:24.956 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:24.961+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:24.967 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:57:24.987 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:57:24.996 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:24.996 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:25.006 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:57:25.007 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:57:25.009 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:57:25.009 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:57:25.009 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:57:25.010 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:57:25.010 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:57:25.010 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:57:25.010 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:57:25.010 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:57:25.060 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:25.065+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:25.134 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:25.135 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:25.144 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:57:25.185 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:25.189+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:25.259 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:57:25.264+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:57:25.285 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:25.286 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:25.295 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:57:25.360 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:25.365+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:25.461 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:25.466+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:25.474 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:25.474 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:25.479 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:57:25.562 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:25.567+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:25.655 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:25.656 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:25.663 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:25.667+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:25.665 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:57:25.752 INFO:tasks.rados.rados.0.smithi166.stdout:1033: done (5 left) 2020-11-16T20:57:25.753 INFO:tasks.rados.rados.0.smithi166.stdout:1034: write oid 399 current snap is 40 2020-11-16T20:57:25.753 INFO:tasks.rados.rados.0.smithi166.stdout:1034: seq_num 641 ranges {773287=408261,1793193=576207} 2020-11-16T20:57:25.759 INFO:tasks.rados.rados.0.smithi166.stdout:1034: writing smithi16641208-399 from 773287 to 1181548 tid 1 2020-11-16T20:57:25.764 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:25.768+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:25.766 INFO:tasks.rados.rados.0.smithi166.stdout:1034: writing smithi16641208-399 from 1793193 to 2369400 tid 2 2020-11-16T20:57:25.766 INFO:tasks.rados.rados.0.smithi166.stdout:1035: rollback oid 332 current snap is 40 2020-11-16T20:57:25.766 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 332 to 36 2020-11-16T20:57:25.767 INFO:tasks.rados.rados.0.smithi166.stdout:1029: expect (ObjNum 133 snap 0 seq_num 133) 2020-11-16T20:57:25.844 INFO:tasks.rados.rados.0.smithi166.stdout:1031: expect (ObjNum 266 snap 0 seq_num 266) 2020-11-16T20:57:25.851 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:25.851 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:25.861 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:57:25.865 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:25.870+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:25.893 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2020-11-16T20:57:25.924 INFO:tasks.rados.rados.0.smithi166.stdout:1032: finishing write tid 1 to smithi16641208-385 2020-11-16T20:57:25.924 INFO:tasks.rados.rados.0.smithi166.stdout:1027: finishing copy_from to smithi16641208-423 2020-11-16T20:57:25.924 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 423 v 586 (ObjNum 583 snap 25 seq_num 583) dirty exists 2020-11-16T20:57:25.924 INFO:tasks.rados.rados.0.smithi166.stdout:1027: finishing copy_from racing read to smithi16641208-423 2020-11-16T20:57:25.924 INFO:tasks.rados.rados.0.smithi166.stdout:1032: finishing write tid 2 to smithi16641208-385 2020-11-16T20:57:25.925 INFO:tasks.rados.rados.0.smithi166.stdout:1027: done (6 left) 2020-11-16T20:57:25.925 INFO:tasks.rados.rados.0.smithi166.stdout:1029: done (5 left) 2020-11-16T20:57:25.925 INFO:tasks.rados.rados.0.smithi166.stdout:1031: done (4 left) 2020-11-16T20:57:25.925 INFO:tasks.rados.rados.0.smithi166.stdout:1036: delete oid 188 current snap is 40 2020-11-16T20:57:25.925 INFO:tasks.rados.rados.0.smithi166.stdout:1032: finishing write tid 3 to smithi16641208-385 2020-11-16T20:57:25.925 INFO:tasks.rados.rados.0.smithi166.stdout:1028: got (0) Success 2020-11-16T20:57:25.925 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 454 v 0 (ObjNum 453 snap 0 seq_num 453) dirty exists 2020-11-16T20:57:25.926 INFO:tasks.rados.rados.0.smithi166.stdout:1032: finishing write tid 4 to smithi16641208-385 2020-11-16T20:57:25.926 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 385 v 802 (ObjNum 640 snap 40 seq_num 640) dirty exists 2020-11-16T20:57:25.926 INFO:tasks.rados.rados.0.smithi166.stdout:1032: left oid 385 (ObjNum 640 snap 40 seq_num 640) 2020-11-16T20:57:25.926 INFO:tasks.rados.rados.0.smithi166.stdout:1035: finishing rollback tid 0 to smithi16641208-332 2020-11-16T20:57:25.926 INFO:tasks.rados.rados.0.smithi166.stdout:1034: finishing write tid 1 to smithi16641208-399 2020-11-16T20:57:25.926 INFO:tasks.rados.rados.0.smithi166.stdout:1034: finishing write tid 2 to smithi16641208-399 2020-11-16T20:57:25.926 INFO:tasks.rados.rados.0.smithi166.stdout:1034: finishing write tid 3 to smithi16641208-399 2020-11-16T20:57:25.927 INFO:tasks.rados.rados.0.smithi166.stdout:1034: finishing write tid 4 to smithi16641208-399 2020-11-16T20:57:25.927 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 399 v 689 (ObjNum 641 snap 40 seq_num 641) dirty exists 2020-11-16T20:57:25.927 INFO:tasks.rados.rados.0.smithi166.stdout:1034: left oid 399 (ObjNum 641 snap 40 seq_num 641) 2020-11-16T20:57:25.927 INFO:tasks.rados.rados.0.smithi166.stdout:1035: finishing rollback tid 1 to smithi16641208-332 2020-11-16T20:57:25.927 INFO:tasks.rados.rados.0.smithi166.stdout:1035: finishing rollback tid 2 to smithi16641208-332 2020-11-16T20:57:25.927 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 332 v 661 (ObjNum 331 snap 0 seq_num 331) dirty exists 2020-11-16T20:57:25.928 INFO:tasks.rados.rados.0.smithi166.stdout:1028: done (4 left) 2020-11-16T20:57:25.928 INFO:tasks.rados.rados.0.smithi166.stdout:1032: done (3 left) 2020-11-16T20:57:25.928 INFO:tasks.rados.rados.0.smithi166.stdout:1034: done (2 left) 2020-11-16T20:57:25.928 INFO:tasks.rados.rados.0.smithi166.stdout:1035: done (1 left) 2020-11-16T20:57:25.928 INFO:tasks.rados.rados.0.smithi166.stdout:1036: done (0 left) 2020-11-16T20:57:25.929 INFO:tasks.rados.rados.0.smithi166.stdout:1037: delete oid 451 current snap is 40 2020-11-16T20:57:25.930 INFO:tasks.rados.rados.0.smithi166.stdout:1037: done (0 left) 2020-11-16T20:57:25.930 INFO:tasks.rados.rados.0.smithi166.stdout:1038: snap_remove snap 36 2020-11-16T20:57:25.966 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:25.970+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:25.996 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:25.997 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:26.006 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:57:26.067 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:26.071+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:26.168 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:26.172+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:26.181 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:26.181 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:26.191 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:57:26.268 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:57:26.273+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:57:26.326 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:26.327 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:26.336 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:57:26.378 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:26.382+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:26.477 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:26.481+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:26.511 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:26.512 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:26.521 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:57:26.605 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:26.610+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:26.672 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:26.677+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:26.696 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:26.697 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:26.706 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:57:26.774 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:26.779+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:26.850 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:26.854+0000 7ff3c9a43700 -1 osd.0 pg_epoch: 122 pg[3.1( v 121'802 (0'0,121'802] local-lis/les=19/20 n=135 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [0,4,3] r=0 lpr=19 crt=121'802 lcod 120'800 mlcod 120'800 active+clean+snaptrim trimq=[48~1] ps=[41~1,44~1,49~2,4f~1]] removing snap head 2020-11-16T20:57:26.853 INFO:tasks.rados.rados.0.smithi166.stdout:1038: done (0 left) 2020-11-16T20:57:26.853 INFO:tasks.rados.rados.0.smithi166.stdout:1039: write oid 12 current snap is 40 2020-11-16T20:57:26.854 INFO:tasks.rados.rados.0.smithi166.stdout:1039: seq_num 644 ranges {423708=634008,1852286=439887,2752172=71536} 2020-11-16T20:57:26.856 INFO:teuthology.orchestra.run.smithi166.stderr:noscrub is unset 2020-11-16T20:57:26.859 INFO:tasks.rados.rados.0.smithi166.stdout:1039: writing smithi16641208-12 from 423708 to 1057716 tid 1 2020-11-16T20:57:26.863 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:57:26.863 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:57:26.863 INFO:tasks.thrashosds.thrasher:Removing osd 1, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:57:26.864 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 1 2020-11-16T20:57:26.864 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:26.867+0000 7f1d7a7ed700 -1 osd.3 pg_epoch: 122 pg[3.2( v 122'661 (0'0,122'661] local-lis/les=19/20 n=115 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [3,5,6] r=0 lpr=19 luod=121'659 crt=122'661 lcod 119'657 mlcod 119'657 active+clean+snaptrim trimq=[48~1] ps=[41~1,44~1,49~2,4f~1]] removing snap head 2020-11-16T20:57:26.874 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:26.873+0000 7f1d7e7f5700 -1 osd.3 pg_epoch: 122 pg[3.2( v 122'663 (0'0,122'663] local-lis/les=19/20 n=113 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [3,5,6] r=0 lpr=19 crt=122'663 lcod 122'661 mlcod 122'661 active+clean+snaptrim trimq=[48~1] ps=[41~1,44~1,49~2,4f~1]] removing snap head 2020-11-16T20:57:26.875 INFO:tasks.rados.rados.0.smithi166.stdout:1039: writing smithi16641208-12 from 1852286 to 2292173 tid 2 2020-11-16T20:57:26.875 INFO:tasks.rados.rados.0.smithi166.stdout:1039: writing smithi16641208-12 from 2752172 to 2823708 tid 3 2020-11-16T20:57:26.875 INFO:tasks.rados.rados.0.smithi166.stdout:1040: cache_evict oid 270 snap -1 2020-11-16T20:57:26.875 INFO:tasks.rados.rados.0.smithi166.stdout:1041: cache_evict oid 451 snap -1 2020-11-16T20:57:26.875 INFO:tasks.rados.rados.0.smithi166.stdout:1042: cache_try_flush oid 403 snap -1 2020-11-16T20:57:26.875 INFO:tasks.rados.rados.0.smithi166.stdout:1043: copy_from oid 398 from oid 20 current snap is 40 2020-11-16T20:57:26.875 INFO:tasks.rados.rados.0.smithi166.stdout:1044: cache_flush oid 499 snap -1 2020-11-16T20:57:26.876 INFO:tasks.rados.rados.0.smithi166.stdout:1045: read oid 380 snap -1 2020-11-16T20:57:26.876 INFO:tasks.rados.rados.0.smithi166.stdout:1045: expect (ObjNum 578 snap 23 seq_num 578) 2020-11-16T20:57:26.876 INFO:tasks.rados.rados.0.smithi166.stdout:1046: cache_flush oid 462 snap -1 2020-11-16T20:57:26.876 INFO:tasks.rados.rados.0.smithi166.stdout:1047: snap_create 2020-11-16T20:57:26.877 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:26.879+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:26.877 INFO:tasks.rados.rados.0.smithi166.stdout:1046: got (2) No such file or directory 2020-11-16T20:57:26.880 INFO:tasks.rados.rados.0.smithi166.stdout:1044: got (0) Success 2020-11-16T20:57:26.880 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 499 v 0 (ObjNum 548 snap 13 seq_num 548) dirty exists 2020-11-16T20:57:26.881 INFO:tasks.rados.rados.0.smithi166.stdout:1040: got (2) No such file or directory 2020-11-16T20:57:26.881 INFO:tasks.rados.rados.0.smithi166.stdout:1041: got (16) Device or resource busy 2020-11-16T20:57:26.881 INFO:tasks.rados.rados.0.smithi166.stdout:1042: got (2) No such file or directory 2020-11-16T20:57:26.885 INFO:tasks.rados.rados.0.smithi166.stdout:1039: finishing write tid 1 to smithi16641208-12 2020-11-16T20:57:26.896 INFO:tasks.rados.rados.0.smithi166.stdout:1045: expect (ObjNum 578 snap 23 seq_num 578) 2020-11-16T20:57:26.898 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:26.899 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:31.171 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:57:31.171 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2020-11-16T20:57:31.175 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:26.934+0000 7f8686d1b700 -1 osd.1 pg_epoch: 122 pg[3.0( v 122'702 (0'0,122'702] local-lis/les=116/117 n=114 ec=19/19 lis/c=116/116 les/c/f=117/117/0 sis=116) [1,2,6] r=0 lpr=116 luod=122'700 crt=122'702 lcod 122'698 mlcod 122'698 active+clean+snaptrim trimq=[48~1] ps=[41~1,44~1,49~2,4f~1]] removing snap head 2020-11-16T20:57:31.175 INFO:tasks.rados.rados.0.smithi166.stdout:1039: finishing write tid 2 to smithi16641208-12 2020-11-16T20:57:31.175 INFO:tasks.rados.rados.0.smithi166.stdout:1039: finishing write tid 3 to smithi16641208-12 2020-11-16T20:57:31.176 INFO:tasks.rados.rados.0.smithi166.stdout:1039: finishing write tid 4 to smithi16641208-12 2020-11-16T20:57:31.176 INFO:tasks.rados.rados.0.smithi166.stdout:1039: finishing write tid 5 to smithi16641208-12 2020-11-16T20:57:31.176 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 12 v 694 (ObjNum 644 snap 40 seq_num 644) dirty exists 2020-11-16T20:57:31.176 INFO:tasks.rados.rados.0.smithi166.stdout:1039: left oid 12 (ObjNum 644 snap 40 seq_num 644) 2020-11-16T20:57:31.176 INFO:tasks.rados.rados.0.smithi166.stdout:1043: finishing copy_from to smithi16641208-398 2020-11-16T20:57:31.176 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 398 v 15 (ObjNum 19 snap 0 seq_num 19) dirty exists 2020-11-16T20:57:31.176 INFO:tasks.rados.rados.0.smithi166.stdout:1043: finishing copy_from racing read to smithi16641208-398 2020-11-16T20:57:31.177 INFO:tasks.rados.rados.0.smithi166.stdout:1039: done (8 left) 2020-11-16T20:57:31.177 INFO:tasks.rados.rados.0.smithi166.stdout:1040: done (7 left) 2020-11-16T20:57:31.177 INFO:tasks.rados.rados.0.smithi166.stdout:1041: done (6 left) 2020-11-16T20:57:31.177 INFO:tasks.rados.rados.0.smithi166.stdout:1042: done (5 left) 2020-11-16T20:57:31.177 INFO:tasks.rados.rados.0.smithi166.stdout:1043: done (4 left) 2020-11-16T20:57:31.177 INFO:tasks.rados.rados.0.smithi166.stdout:1044: done (3 left) 2020-11-16T20:57:31.177 INFO:tasks.rados.rados.0.smithi166.stdout:1045: done (2 left) 2020-11-16T20:57:31.178 INFO:tasks.rados.rados.0.smithi166.stdout:1046: done (1 left) 2020-11-16T20:57:31.178 INFO:tasks.rados.rados.0.smithi166.stdout:1047: done (0 left) 2020-11-16T20:57:31.178 INFO:tasks.rados.rados.0.smithi166.stdout:1048: rollback oid 172 current snap is 41 2020-11-16T20:57:31.178 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 172 to 40 2020-11-16T20:57:31.178 INFO:tasks.rados.rados.0.smithi166.stdout:1049: delete oid 433 current snap is 41 2020-11-16T20:57:31.178 INFO:tasks.rados.rados.0.smithi166.stdout:1049: done (1 left) 2020-11-16T20:57:31.178 INFO:tasks.rados.rados.0.smithi166.stdout:1050: cache_try_flush oid 259 snap -1 2020-11-16T20:57:31.179 INFO:tasks.rados.rados.0.smithi166.stdout:1051: write oid 270 current snap is 41 2020-11-16T20:57:31.179 INFO:tasks.rados.rados.0.smithi166.stdout:1051: seq_num 646 ranges {457322=784506,1969250=443556} 2020-11-16T20:57:31.179 INFO:tasks.rados.rados.0.smithi166.stdout:1051: writing smithi16641208-270 from 457322 to 1241828 tid 1 2020-11-16T20:57:31.179 INFO:tasks.rados.rados.0.smithi166.stdout:1051: writing smithi16641208-270 from 1969250 to 2412806 tid 2 2020-11-16T20:57:31.179 INFO:tasks.rados.rados.0.smithi166.stdout:1048: finishing rollback tid 0 to smithi16641208-172 2020-11-16T20:57:31.179 INFO:tasks.rados.rados.0.smithi166.stdout:1050: got (2) No such file or directory 2020-11-16T20:57:31.179 INFO:tasks.rados.rados.0.smithi166.stdout:1050: done (2 left) 2020-11-16T20:57:31.179 INFO:tasks.rados.rados.0.smithi166.stdout:1052: write (excl) oid 110 current snap is 41 2020-11-16T20:57:31.180 INFO:tasks.rados.rados.0.smithi166.stdout:1052: seq_num 647 ranges {474129=576108,1627732=587214,2718088=156041} 2020-11-16T20:57:31.180 INFO:tasks.rados.rados.0.smithi166.stdout:1052: writing smithi16641208-110 from 474129 to 1050237 tid 1 2020-11-16T20:57:31.180 INFO:tasks.rados.rados.0.smithi166.stdout:1052: writing smithi16641208-110 from 1627732 to 2214946 tid 2 2020-11-16T20:57:31.180 INFO:tasks.rados.rados.0.smithi166.stdout:1052: writing smithi16641208-110 from 2718088 to 2874129 tid 3 2020-11-16T20:57:31.180 INFO:tasks.rados.rados.0.smithi166.stdout:1053: snap_create 2020-11-16T20:57:31.180 INFO:tasks.rados.rados.0.smithi166.stdout:1051: finishing write tid 1 to smithi16641208-270 2020-11-16T20:57:31.180 INFO:tasks.rados.rados.0.smithi166.stdout:1052: finishing write tid 1 to smithi16641208-110 2020-11-16T20:57:31.181 INFO:tasks.rados.rados.0.smithi166.stdout:1052: finishing write tid 2 to smithi16641208-110 2020-11-16T20:57:31.181 INFO:tasks.rados.rados.0.smithi166.stdout:1051: finishing write tid 2 to smithi16641208-270 2020-11-16T20:57:31.181 INFO:tasks.rados.rados.0.smithi166.stdout:1051: finishing write tid 3 to smithi16641208-270 2020-11-16T20:57:31.181 INFO:tasks.rados.rados.0.smithi166.stdout:1052: finishing write tid 3 to smithi16641208-110 2020-11-16T20:57:31.181 INFO:tasks.rados.rados.0.smithi166.stdout:1052: finishing write tid 4 to smithi16641208-110 2020-11-16T20:57:31.181 INFO:tasks.rados.rados.0.smithi166.stdout:1051: finishing write tid 4 to smithi16641208-270 2020-11-16T20:57:31.181 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 270 v 678 (ObjNum 646 snap 41 seq_num 646) dirty exists 2020-11-16T20:57:31.181 INFO:tasks.rados.rados.0.smithi166.stdout:1051: left oid 270 (ObjNum 646 snap 41 seq_num 646) 2020-11-16T20:57:31.182 INFO:tasks.rados.rados.0.smithi166.stdout:1052: finishing write tid 5 to smithi16641208-110 2020-11-16T20:57:31.182 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 110 v 806 (ObjNum 647 snap 41 seq_num 647) dirty exists 2020-11-16T20:57:31.182 INFO:tasks.rados.rados.0.smithi166.stdout:1052: left oid 110 (ObjNum 647 snap 41 seq_num 647) 2020-11-16T20:57:31.182 INFO:tasks.rados.rados.0.smithi166.stdout:1048: finishing rollback tid 1 to smithi16641208-172 2020-11-16T20:57:31.182 INFO:tasks.rados.rados.0.smithi166.stdout:1048: finishing rollback tid 2 to smithi16641208-172 2020-11-16T20:57:31.182 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 172 v 710 (ObjNum 171 snap 0 seq_num 171) dirty exists 2020-11-16T20:57:31.183 INFO:tasks.rados.rados.0.smithi166.stdout:1048: done (3 left) 2020-11-16T20:57:31.183 INFO:tasks.rados.rados.0.smithi166.stdout:1051: done (2 left) 2020-11-16T20:57:31.183 INFO:tasks.rados.rados.0.smithi166.stdout:1052: done (1 left) 2020-11-16T20:57:31.183 INFO:tasks.rados.rados.0.smithi166.stdout:1053: done (0 left) 2020-11-16T20:57:31.183 INFO:tasks.rados.rados.0.smithi166.stdout:1054: cache_try_flush oid 54 snap -1 2020-11-16T20:57:31.183 INFO:tasks.rados.rados.0.smithi166.stdout:1055: read oid 467 snap -1 2020-11-16T20:57:31.183 INFO:tasks.rados.rados.0.smithi166.stdout:1055: expect (ObjNum 324 snap 0 seq_num 324) 2020-11-16T20:57:31.183 INFO:tasks.rados.rados.0.smithi166.stdout:1056: rollback oid 443 current snap is 42 2020-11-16T20:57:31.184 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 443 to 41 2020-11-16T20:57:31.184 INFO:tasks.rados.rados.0.smithi166.stdout:1057: cache_flush oid 300 snap -1 2020-11-16T20:57:31.184 INFO:tasks.rados.rados.0.smithi166.stdout:1058: snap_create 2020-11-16T20:57:31.184 INFO:teuthology.orchestra.run.smithi166.stderr:marked out osd.1. 2020-11-16T20:57:31.184 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:31.176+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:31.185 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:57:31.186 INFO:tasks.ceph.mon.b.smithi059.stderr:2020-11-16T20:57:27.229+0000 7fe2b1942700 -1 mon.b@0(leader).osd e122 definitely_dead 0 2020-11-16T20:57:31.272 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:31.276+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:31.321 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:31.321 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:31.330 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:57:31.366 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:57:31.373 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:31.378+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:31.388 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:57:31.466 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:31.467 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:31.474 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:31.479+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:31.476 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:57:31.575 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:31.580+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:31.604 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:31.604 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:57:31.605 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:57:31.605 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:31.609 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:57:31.614 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:57:31.631 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:57:31.652 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:57:31.672 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:57:31.676 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:31.680+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:31.694 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:57:31.714 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:57:31.715 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:57:31.716 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:57:31.716 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:57:31.716 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:57:31.716 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:57:31.716 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:57:31.716 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:57:31.717 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:57:31.746 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:31.747 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:57:31.747 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:57:31.747 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:57:31.747 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:31.756 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:57:31.777 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:31.781+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:31.878 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:31.882+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:31.887 INFO:tasks.rados.rados.0.smithi166.stdout:1058: done (4 left) 2020-11-16T20:57:31.888 INFO:tasks.rados.rados.0.smithi166.stdout:1059: snap_create 2020-11-16T20:57:31.894 INFO:tasks.rados.rados.0.smithi166.stdout:1054: got (0) Success 2020-11-16T20:57:31.894 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 54 v 0 (ObjNum 536 snap 11 seq_num 536) dirty exists 2020-11-16T20:57:31.895 INFO:teuthology.orchestra.run.smithi166.stderr:nodeep-scrub is unset 2020-11-16T20:57:31.905 INFO:tasks.rados.rados.0.smithi166.stdout:1057: got (2) No such file or directory 2020-11-16T20:57:31.905 INFO:tasks.rados.rados.0.smithi166.stdout:1056: finishing rollback tid 0 to smithi16641208-443 2020-11-16T20:57:31.905 INFO:tasks.rados.rados.0.smithi166.stdout:1056: finishing rollback tid 1 to smithi16641208-443 2020-11-16T20:57:31.906 INFO:tasks.rados.rados.0.smithi166.stdout:1056: finishing rollback tid 2 to smithi16641208-443 2020-11-16T20:57:31.906 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 443 v 740 (ObjNum 632 snap 39 seq_num 632) dirty exists 2020-11-16T20:57:31.914 INFO:tasks.rados.rados.0.smithi166.stdout:1055: expect (ObjNum 324 snap 0 seq_num 324) 2020-11-16T20:57:31.942 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:31.943 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:57:31.943 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:57:31.943 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:57:31.943 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:31.943 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2345 4.3 4:c9160c9c:::smithi16641208-411:head [rollback 5] snapc 6=[6,5,4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e41)", 2020-11-16T20:57:31.943 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:04.115684+0000", 2020-11-16T20:57:31.943 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 87.829983235, 2020-11-16T20:57:31.944 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033152890999999997, 2020-11-16T20:57:31.944 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:36.174 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:36.174 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:36.175 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:36.175 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:36.175 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2345 2020-11-16T20:57:36.175 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.175 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:36.175 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.176 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:36.176 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115684+0000", 2020-11-16T20:57:36.176 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:36.176 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.176 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.176 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:36.176 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115684+0000", 2020-11-16T20:57:36.177 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5156e-05 2020-11-16T20:57:36.177 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.177 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.177 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:36.177 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115699+0000", 2020-11-16T20:57:36.177 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.852e-06 2020-11-16T20:57:36.177 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.178 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.178 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:36.178 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115702+0000", 2020-11-16T20:57:36.178 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.366e-06 2020-11-16T20:57:36.178 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.178 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.178 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:36.179 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115707+0000", 2020-11-16T20:57:36.179 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5110000000000002e-06 2020-11-16T20:57:36.179 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.179 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.179 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:36.179 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115710+0000", 2020-11-16T20:57:36.179 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00026113800000000001 2020-11-16T20:57:36.180 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.180 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.180 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.180 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115971+0000", 2020-11-16T20:57:36.180 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5478000000000002e-05 2020-11-16T20:57:36.180 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.180 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.181 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:36.181 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.116007+0000", 2020-11-16T20:57:36.181 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011434730000000001 2020-11-16T20:57:36.181 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.181 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.181 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.181 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.127441+0000", 2020-11-16T20:57:36.182 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000106121 2020-11-16T20:57:36.182 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.182 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.182 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:36.182 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.127547+0000", 2020-11-16T20:57:36.182 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019369799999999999 2020-11-16T20:57:36.182 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.182 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.183 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:36.183 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.127741+0000", 2020-11-16T20:57:36.183 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8986999999999999e-05 2020-11-16T20:57:36.183 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.183 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.183 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:36.183 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.127770+0000", 2020-11-16T20:57:36.184 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0079205560000000005 2020-11-16T20:57:36.184 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.184 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.184 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.184 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.135691+0000", 2020-11-16T20:57:36.184 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010364799999999999 2020-11-16T20:57:36.184 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.185 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.185 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:36.185 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.135794+0000", 2020-11-16T20:57:36.185 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000194532 2020-11-16T20:57:36.185 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.185 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.185 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:57:36.185 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.135989+0000", 2020-11-16T20:57:36.186 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001241301 2020-11-16T20:57:36.186 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.186 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.186 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.186 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.137230+0000", 2020-11-16T20:57:36.186 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9125000000000002e-05 2020-11-16T20:57:36.186 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.187 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.187 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for ondisk", 2020-11-16T20:57:36.187 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.137269+0000", 2020-11-16T20:57:36.187 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0014352239999999999 2020-11-16T20:57:36.187 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.187 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.187 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:36.188 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.138704+0000", 2020-11-16T20:57:36.188 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0076177900000000002 2020-11-16T20:57:36.188 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.188 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.188 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:36.188 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.146322+0000", 2020-11-16T20:57:36.188 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0024308260000000001 2020-11-16T20:57:36.189 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.189 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.189 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:36.189 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.148753+0000", 2020-11-16T20:57:36.189 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4169999999999999e-05 2020-11-16T20:57:36.189 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.189 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.190 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:36.190 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.148797+0000", 2020-11-16T20:57:36.190 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9681999999999997e-05 2020-11-16T20:57:36.190 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.190 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.190 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:36.190 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.148837+0000", 2020-11-16T20:57:36.191 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033152890999999997 2020-11-16T20:57:36.191 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.191 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.191 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.191 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.191 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.191 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2346 4.3 4:c9160c9c:::smithi16641208-411:head [append 0~0] snapc 6=[6,5,4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e41)", 2020-11-16T20:57:36.191 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:04.115728+0000", 2020-11-16T20:57:36.192 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 87.829939494000001, 2020-11-16T20:57:36.192 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035920868000000002, 2020-11-16T20:57:36.192 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:36.192 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:36.192 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:36.192 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:36.192 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:36.193 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2346 2020-11-16T20:57:36.193 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.193 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:36.193 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.193 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:36.193 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115728+0000", 2020-11-16T20:57:36.193 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:36.194 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.194 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.194 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:36.194 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115728+0000", 2020-11-16T20:57:36.194 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4843e-05 2020-11-16T20:57:36.194 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.194 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.195 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:36.195 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115743+0000", 2020-11-16T20:57:36.195 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6399999999999999e-06 2020-11-16T20:57:36.195 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.195 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.195 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:36.195 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115746+0000", 2020-11-16T20:57:36.195 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1749999999999996e-06 2020-11-16T20:57:36.196 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.196 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.196 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:36.196 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115751+0000", 2020-11-16T20:57:36.196 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2500000000000001e-06 2020-11-16T20:57:36.196 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.196 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.197 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:36.197 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.115754+0000", 2020-11-16T20:57:36.197 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00027690100000000002 2020-11-16T20:57:36.197 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.197 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.197 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.197 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.116031+0000", 2020-11-16T20:57:36.198 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8213000000000001e-05 2020-11-16T20:57:36.198 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.198 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.198 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:36.198 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.116079+0000", 2020-11-16T20:57:36.198 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011729105 2020-11-16T20:57:36.198 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.198 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.199 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.199 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.127808+0000", 2020-11-16T20:57:36.199 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8734e-05 2020-11-16T20:57:36.199 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.199 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.199 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:36.199 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.127837+0000", 2020-11-16T20:57:36.200 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094608379999999992 2020-11-16T20:57:36.200 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.200 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.200 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.200 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.137297+0000", 2020-11-16T20:57:36.200 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8356999999999996e-05 2020-11-16T20:57:36.201 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.201 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.201 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:36.201 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.137366+0000", 2020-11-16T20:57:36.201 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010179300000000001 2020-11-16T20:57:36.201 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.201 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.202 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:57:36.202 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.137468+0000", 2020-11-16T20:57:36.202 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001540626 2020-11-16T20:57:36.202 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.202 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.202 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:36.202 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.139008+0000", 2020-11-16T20:57:36.203 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0073602659999999999 2020-11-16T20:57:36.203 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.203 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.203 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:36.203 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.146369+0000", 2020-11-16T20:57:36.203 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.005211467 2020-11-16T20:57:36.203 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.203 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.204 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:36.204 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.151580+0000", 2020-11-16T20:57:36.204 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2265000000000003e-05 2020-11-16T20:57:36.204 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.204 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.204 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:36.204 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.151622+0000", 2020-11-16T20:57:36.205 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6395000000000001e-05 2020-11-16T20:57:36.205 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.205 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.205 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:36.205 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:04.151649+0000", 2020-11-16T20:57:36.205 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035920868000000002 2020-11-16T20:57:36.205 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.206 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.206 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.206 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.206 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.206 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2423 4.3 4:c5716d1e:::smithi16641208-111:head [copy-from ver 265] snapc 7=[7,5] ondisk+write+known_if_redirected e46)", 2020-11-16T20:57:36.206 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.026587+0000", 2020-11-16T20:57:36.206 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 82.919080054000005, 2020-11-16T20:57:36.207 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039457442000000002, 2020-11-16T20:57:36.207 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:36.207 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:36.207 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:36.207 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:36.207 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:36.207 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2423 2020-11-16T20:57:36.207 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.208 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:36.208 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.208 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:36.208 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026587+0000", 2020-11-16T20:57:36.208 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:36.208 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.208 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.209 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:36.209 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026587+0000", 2020-11-16T20:57:36.209 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2777000000000001e-05 2020-11-16T20:57:36.209 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.209 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.209 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:36.209 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026630+0000", 2020-11-16T20:57:36.210 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.993e-06 2020-11-16T20:57:36.210 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.210 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.210 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:36.210 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026636+0000", 2020-11-16T20:57:36.210 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1423000000000001e-05 2020-11-16T20:57:36.210 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.210 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.211 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:36.211 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026647+0000", 2020-11-16T20:57:36.211 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1880000000000001e-06 2020-11-16T20:57:36.211 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.211 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.211 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:36.211 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026653+0000", 2020-11-16T20:57:36.212 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00021074700000000001 2020-11-16T20:57:36.212 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.212 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.212 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.212 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026863+0000", 2020-11-16T20:57:36.212 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039178896999999997 2020-11-16T20:57:36.212 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.212 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.213 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:36.213 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.066042+0000", 2020-11-16T20:57:36.213 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4169999999999999e-06 2020-11-16T20:57:36.213 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.213 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.213 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:36.213 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.066045+0000", 2020-11-16T20:57:36.214 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039457442000000002 2020-11-16T20:57:36.214 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.214 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.214 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.214 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.214 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.214 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2424 4.3 4:c5716d1e:::smithi16641208-111:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e46)", 2020-11-16T20:57:36.215 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.026685+0000", 2020-11-16T20:57:36.215 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 82.918982271999994, 2020-11-16T20:57:36.215 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065304164999999997, 2020-11-16T20:57:36.215 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:36.215 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:36.215 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:36.215 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:36.215 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:36.216 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2424 2020-11-16T20:57:36.216 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.216 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:36.216 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.216 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:36.216 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026685+0000", 2020-11-16T20:57:36.216 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:36.217 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.217 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.217 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:36.217 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026685+0000", 2020-11-16T20:57:36.217 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4087000000000001e-05 2020-11-16T20:57:36.217 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.217 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.218 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:36.218 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026719+0000", 2020-11-16T20:57:36.218 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2298e-05 2020-11-16T20:57:36.218 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.218 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.218 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:36.218 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026731+0000", 2020-11-16T20:57:36.219 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1001e-05 2020-11-16T20:57:36.219 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.219 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.219 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:36.219 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026742+0000", 2020-11-16T20:57:36.219 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6129999999999997e-06 2020-11-16T20:57:36.219 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.219 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.220 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:36.220 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026747+0000", 2020-11-16T20:57:36.220 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00047150600000000001 2020-11-16T20:57:36.220 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.220 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.220 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.220 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.027219+0000", 2020-11-16T20:57:36.221 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5602999999999998e-05 2020-11-16T20:57:36.221 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.221 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.221 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:36.221 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.027254+0000", 2020-11-16T20:57:36.221 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050318838999999997 2020-11-16T20:57:36.221 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.221 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.222 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.222 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.077573+0000", 2020-11-16T20:57:36.222 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6290000000000001e-05 2020-11-16T20:57:36.222 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.222 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.222 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:36.222 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.077669+0000", 2020-11-16T20:57:36.223 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014149599000000001 2020-11-16T20:57:36.223 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.223 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.223 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.223 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.091819+0000", 2020-11-16T20:57:36.223 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6891000000000005e-05 2020-11-16T20:57:36.223 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.223 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.224 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:36.224 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.091906+0000", 2020-11-16T20:57:36.224 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3437999999999996e-05 2020-11-16T20:57:36.224 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.224 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.224 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:36.224 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.091989+0000", 2020-11-16T20:57:36.225 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065304164999999997 2020-11-16T20:57:36.225 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.225 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.225 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.225 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.225 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.225 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.4.13:681 3.1 3:afc69464:::smithi16641208-110:head [copy-from ver 103] snapc 4=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e52)", 2020-11-16T20:57:36.226 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.786343+0000", 2020-11-16T20:57:36.226 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 77.159324631000004, 2020-11-16T20:57:36.226 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042629590000000002, 2020-11-16T20:57:36.226 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:36.226 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:36.226 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:36.226 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.227 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:36.227 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786343+0000", 2020-11-16T20:57:36.227 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:36.227 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.227 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.227 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:36.227 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786343+0000", 2020-11-16T20:57:36.227 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6380000000000002e-05 2020-11-16T20:57:36.228 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.228 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.228 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:36.228 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786369+0000", 2020-11-16T20:57:36.228 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8649999999999998e-06 2020-11-16T20:57:36.228 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.228 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.229 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:36.229 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786375+0000", 2020-11-16T20:57:36.229 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2170999999999999e-05 2020-11-16T20:57:36.229 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.229 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.229 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:36.229 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786387+0000", 2020-11-16T20:57:36.229 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8500000000000002e-06 2020-11-16T20:57:36.230 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.230 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.230 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:36.230 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786392+0000", 2020-11-16T20:57:36.230 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001049119 2020-11-16T20:57:36.230 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.230 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.231 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.231 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.787441+0000", 2020-11-16T20:57:36.231 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6489000000000006e-05 2020-11-16T20:57:36.231 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.231 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.231 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:36.231 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.787518+0000", 2020-11-16T20:57:36.232 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0097007229999999996 2020-11-16T20:57:36.232 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.232 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.232 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 3,4", 2020-11-16T20:57:36.232 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.797218+0000", 2020-11-16T20:57:36.232 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012009956 2020-11-16T20:57:36.232 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.232 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.233 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:36.233 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.809228+0000", 2020-11-16T20:57:36.233 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019396673 2020-11-16T20:57:36.233 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.233 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.233 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:36.233 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828625+0000", 2020-11-16T20:57:36.234 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023723099999999999 2020-11-16T20:57:36.234 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.234 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.234 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:36.234 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828862+0000", 2020-11-16T20:57:36.234 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2475000000000002e-05 2020-11-16T20:57:36.234 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.235 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.235 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:36.235 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828915+0000", 2020-11-16T20:57:36.235 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7658000000000003e-05 2020-11-16T20:57:36.235 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.235 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.235 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:36.235 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828972+0000", 2020-11-16T20:57:36.236 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042629590000000002 2020-11-16T20:57:36.236 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.236 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.236 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.236 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.236 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.236 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.4.13:682 3.1 3:b3ae2c4d:::smithi16641208-463:head [copy-from ver 402] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e52)", 2020-11-16T20:57:36.237 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.786452+0000", 2020-11-16T20:57:36.237 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 77.159215446000005, 2020-11-16T20:57:36.237 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042767143000000001, 2020-11-16T20:57:36.237 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:36.237 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:36.237 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:36.237 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.237 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:36.238 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786452+0000", 2020-11-16T20:57:36.238 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:36.238 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.238 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.238 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:36.238 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786452+0000", 2020-11-16T20:57:36.238 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.025e-05 2020-11-16T20:57:36.239 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.239 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.239 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:36.239 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786482+0000", 2020-11-16T20:57:36.239 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5779999999999999e-06 2020-11-16T20:57:36.239 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.239 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.240 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:36.240 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786486+0000", 2020-11-16T20:57:36.240 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0480000000000004e-06 2020-11-16T20:57:36.240 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.240 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.240 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:36.240 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786492+0000", 2020-11-16T20:57:36.240 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.101e-06 2020-11-16T20:57:36.241 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.241 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.241 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:36.241 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786495+0000", 2020-11-16T20:57:36.241 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001206213 2020-11-16T20:57:36.241 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.241 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.242 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.242 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.787701+0000", 2020-11-16T20:57:36.242 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0668999999999998e-05 2020-11-16T20:57:36.242 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.242 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.242 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:36.242 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.787762+0000", 2020-11-16T20:57:36.243 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014276095000000001 2020-11-16T20:57:36.243 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.243 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.243 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 3,4", 2020-11-16T20:57:36.243 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.802038+0000", 2020-11-16T20:57:36.243 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0099596760000000006 2020-11-16T20:57:36.243 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.243 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.244 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:36.244 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.811997+0000", 2020-11-16T20:57:36.244 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017095757999999999 2020-11-16T20:57:36.244 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.244 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.244 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:36.244 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.829093+0000", 2020-11-16T20:57:36.245 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4833999999999998e-05 2020-11-16T20:57:36.245 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.245 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.245 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:36.245 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.829138+0000", 2020-11-16T20:57:36.245 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4724000000000001e-05 2020-11-16T20:57:36.245 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.245 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.246 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:36.246 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.829183+0000", 2020-11-16T20:57:36.246 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6196999999999999e-05 2020-11-16T20:57:36.246 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.246 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.246 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:36.246 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.829219+0000", 2020-11-16T20:57:36.247 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042767143000000001 2020-11-16T20:57:36.247 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.247 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.247 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.247 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.247 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.247 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2589 4.3 4:f65e82cb:::smithi16641208-219:head [write 1800933~725518] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:57:36.247 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.782219+0000", 2020-11-16T20:57:36.248 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 72.163448475999999, 2020-11-16T20:57:36.248 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.069486665000000003, 2020-11-16T20:57:36.248 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:36.248 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:36.248 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:36.248 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:36.248 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:36.249 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2589 2020-11-16T20:57:36.249 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.249 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:36.249 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.249 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:36.249 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782219+0000", 2020-11-16T20:57:36.249 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:36.250 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.250 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.250 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:36.250 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782219+0000", 2020-11-16T20:57:36.250 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00038710600000000002 2020-11-16T20:57:36.250 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.250 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.250 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:36.251 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782606+0000", 2020-11-16T20:57:36.251 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.628e-06 2020-11-16T20:57:36.251 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.251 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.251 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:36.251 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782616+0000", 2020-11-16T20:57:36.251 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5631999999999999e-05 2020-11-16T20:57:36.252 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.252 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.252 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:36.252 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782631+0000", 2020-11-16T20:57:36.252 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6249999999999998e-06 2020-11-16T20:57:36.252 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.252 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.253 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:36.253 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782639+0000", 2020-11-16T20:57:36.253 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3213999999999997e-05 2020-11-16T20:57:36.253 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.253 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.253 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.253 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782672+0000", 2020-11-16T20:57:36.253 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9141000000000003e-05 2020-11-16T20:57:36.254 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.254 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.254 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:36.254 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782721+0000", 2020-11-16T20:57:36.254 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017807030000000001 2020-11-16T20:57:36.254 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.254 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.255 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.255 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800528+0000", 2020-11-16T20:57:36.255 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016577399999999999 2020-11-16T20:57:36.255 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.255 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.255 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:36.255 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800694+0000", 2020-11-16T20:57:36.256 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00026135900000000002 2020-11-16T20:57:36.256 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.256 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.256 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:57:36.256 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800955+0000", 2020-11-16T20:57:36.256 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0074407529999999996 2020-11-16T20:57:36.256 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.256 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.257 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:36.257 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808396+0000", 2020-11-16T20:57:36.257 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011788041000000001 2020-11-16T20:57:36.257 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.257 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.257 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:36.257 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.820184+0000", 2020-11-16T20:57:36.258 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031417394000000001 2020-11-16T20:57:36.258 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.258 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.258 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:36.258 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851602+0000", 2020-11-16T20:57:36.258 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0005e-05 2020-11-16T20:57:36.258 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.259 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.259 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:36.259 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851652+0000", 2020-11-16T20:57:36.259 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3962999999999998e-05 2020-11-16T20:57:36.259 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.259 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.259 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:36.259 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851705+0000", 2020-11-16T20:57:36.260 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.069486665000000003 2020-11-16T20:57:36.260 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.260 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.260 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.260 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.260 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.260 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2590 4.3 4:f65e82cb:::smithi16641208-219:head [write 2944601~232021] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:57:36.261 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.785957+0000", 2020-11-16T20:57:36.261 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 72.159710786000005, 2020-11-16T20:57:36.261 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065959045999999993, 2020-11-16T20:57:36.261 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:36.261 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:36.261 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:36.261 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:36.261 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:36.262 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2590 2020-11-16T20:57:36.262 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.262 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:36.262 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.262 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:36.262 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.785957+0000", 2020-11-16T20:57:36.262 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:36.263 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.263 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.263 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:36.263 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.785957+0000", 2020-11-16T20:57:36.263 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6058999999999998e-05 2020-11-16T20:57:36.263 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.263 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.264 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:36.264 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786033+0000", 2020-11-16T20:57:36.264 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1582999999999999e-05 2020-11-16T20:57:36.264 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.264 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.264 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:36.264 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786064+0000", 2020-11-16T20:57:36.264 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8099999999999992e-06 2020-11-16T20:57:36.265 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.265 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.265 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:36.265 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786074+0000", 2020-11-16T20:57:36.265 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.198e-06 2020-11-16T20:57:36.265 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.265 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.266 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:36.266 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786079+0000", 2020-11-16T20:57:36.266 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0587999999999997e-05 2020-11-16T20:57:36.266 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.266 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.266 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.266 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786130+0000", 2020-11-16T20:57:36.267 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5791000000000007e-05 2020-11-16T20:57:36.267 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.267 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.267 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:36.267 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786206+0000", 2020-11-16T20:57:36.267 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016623412000000001 2020-11-16T20:57:36.267 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.267 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.268 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.268 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.802829+0000", 2020-11-16T20:57:36.268 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012361699999999999 2020-11-16T20:57:36.268 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.268 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.268 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:36.268 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.802953+0000", 2020-11-16T20:57:36.269 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000161807 2020-11-16T20:57:36.269 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.269 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.269 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:57:36.269 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.803114+0000", 2020-11-16T20:57:36.269 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.005291535 2020-11-16T20:57:36.269 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.269 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.270 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:36.270 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808406+0000", 2020-11-16T20:57:36.270 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011819998999999999 2020-11-16T20:57:36.270 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.270 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.270 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:36.270 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.820226+0000", 2020-11-16T20:57:36.271 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031546375000000001 2020-11-16T20:57:36.271 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.271 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.271 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:36.271 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851772+0000", 2020-11-16T20:57:36.271 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9140000000000005e-05 2020-11-16T20:57:36.271 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.272 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.272 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:36.272 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851851+0000", 2020-11-16T20:57:36.272 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4132000000000002e-05 2020-11-16T20:57:36.272 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.272 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.272 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:36.272 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851916+0000", 2020-11-16T20:57:36.273 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065959045999999993 2020-11-16T20:57:36.273 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.273 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.273 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.273 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.273 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.273 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2591 4.3 4:f65e82cb:::smithi16641208-219:head [setxattr _header (58) in=7b,truncate 3176622] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:57:36.274 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.786110+0000", 2020-11-16T20:57:36.274 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 72.159557253000003, 2020-11-16T20:57:36.274 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066016654999999994, 2020-11-16T20:57:36.274 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:36.274 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:36.274 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:36.274 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:36.275 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:36.275 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2591 2020-11-16T20:57:36.275 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.275 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:36.275 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.275 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:36.275 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786110+0000", 2020-11-16T20:57:36.276 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:36.276 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.276 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.276 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:36.276 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786110+0000", 2020-11-16T20:57:36.276 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5616e-05 2020-11-16T20:57:36.276 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.276 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.277 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:36.277 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786136+0000", 2020-11-16T20:57:36.277 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5329999999999999e-06 2020-11-16T20:57:36.277 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.277 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.277 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:36.277 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786139+0000", 2020-11-16T20:57:36.278 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7440000000000004e-06 2020-11-16T20:57:36.278 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.278 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.278 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:36.278 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786145+0000", 2020-11-16T20:57:36.278 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0120000000000001e-06 2020-11-16T20:57:36.278 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.279 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.279 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:36.279 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786148+0000", 2020-11-16T20:57:36.279 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5617000000000004e-05 2020-11-16T20:57:36.279 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.279 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.279 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.279 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786234+0000", 2020-11-16T20:57:36.280 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0964000000000001e-05 2020-11-16T20:57:36.280 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.280 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.280 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:36.280 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786295+0000", 2020-11-16T20:57:36.280 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017673271000000001 2020-11-16T20:57:36.280 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.281 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.281 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.281 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.803968+0000", 2020-11-16T20:57:36.281 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000155272 2020-11-16T20:57:36.281 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.281 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.281 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:36.281 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.804123+0000", 2020-11-16T20:57:36.282 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00027357299999999999 2020-11-16T20:57:36.282 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.282 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.282 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:57:36.282 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.804397+0000", 2020-11-16T20:57:36.282 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040142659999999998 2020-11-16T20:57:36.282 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.283 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.283 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:36.283 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808411+0000", 2020-11-16T20:57:36.283 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011837194000000001 2020-11-16T20:57:36.283 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.283 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.283 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:36.284 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.820248+0000", 2020-11-16T20:57:36.284 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031735780999999998 2020-11-16T20:57:36.284 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.284 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.284 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:36.284 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851984+0000", 2020-11-16T20:57:36.284 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0603000000000001e-05 2020-11-16T20:57:36.284 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.285 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.285 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:36.285 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852054+0000", 2020-11-16T20:57:36.285 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2208999999999999e-05 2020-11-16T20:57:36.285 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.285 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.285 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:36.286 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852127+0000", 2020-11-16T20:57:36.286 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066016654999999994 2020-11-16T20:57:36.286 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.286 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.286 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.286 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.286 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.286 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2592 4.3 4:f65e82cb:::smithi16641208-219:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:57:36.287 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.786176+0000", 2020-11-16T20:57:36.287 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 72.159491770000002, 2020-11-16T20:57:36.287 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066389967999999994, 2020-11-16T20:57:36.287 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:36.287 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:36.287 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:36.287 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:36.288 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:36.288 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2592 2020-11-16T20:57:36.288 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.288 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:36.288 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.288 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:36.288 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786176+0000", 2020-11-16T20:57:36.289 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:36.289 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.289 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.289 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:36.289 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786176+0000", 2020-11-16T20:57:36.289 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1280999999999998e-05 2020-11-16T20:57:36.289 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.290 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.290 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:36.290 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786197+0000", 2020-11-16T20:57:36.290 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.349e-06 2020-11-16T20:57:36.290 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.290 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.290 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:36.290 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786200+0000", 2020-11-16T20:57:36.291 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4840000000000001e-06 2020-11-16T20:57:36.291 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.291 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.291 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:36.291 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786207+0000", 2020-11-16T20:57:36.291 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3390000000000001e-06 2020-11-16T20:57:36.291 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.292 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.292 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:36.292 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786210+0000", 2020-11-16T20:57:36.292 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000115748 2020-11-16T20:57:36.292 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.292 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.292 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.292 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786326+0000", 2020-11-16T20:57:36.293 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6062e-05 2020-11-16T20:57:36.293 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.293 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.293 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:36.293 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786372+0000", 2020-11-16T20:57:36.293 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021773975000000001 2020-11-16T20:57:36.293 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.294 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.294 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.294 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808146+0000", 2020-11-16T20:57:36.294 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014829900000000001 2020-11-16T20:57:36.294 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.294 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.294 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:36.295 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808294+0000", 2020-11-16T20:57:36.295 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.043877869999999999 2020-11-16T20:57:36.295 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.295 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.295 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.295 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852172+0000", 2020-11-16T20:57:36.295 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000145322 2020-11-16T20:57:36.295 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.296 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.296 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:36.296 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852317+0000", 2020-11-16T20:57:36.296 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024823899999999998 2020-11-16T20:57:36.296 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.296 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.296 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:36.297 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852565+0000", 2020-11-16T20:57:36.297 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066389967999999994 2020-11-16T20:57:36.297 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.297 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.297 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.297 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.297 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.297 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2593 4.3 4:f5f8fa2a:::smithi16641208-144:head [copy-from ver 64] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:57:36.298 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.786250+0000", 2020-11-16T20:57:36.298 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 72.159416991000001, 2020-11-16T20:57:36.298 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065186216000000005, 2020-11-16T20:57:36.298 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:36.298 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:36.298 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:36.298 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:36.299 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:36.299 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2593 2020-11-16T20:57:36.299 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.299 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:36.299 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.299 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:36.299 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786250+0000", 2020-11-16T20:57:36.300 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:36.300 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.300 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.300 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:36.300 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786250+0000", 2020-11-16T20:57:36.300 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2438999999999998e-05 2020-11-16T20:57:36.300 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.300 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.301 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:36.301 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786293+0000", 2020-11-16T20:57:36.301 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6840000000000001e-06 2020-11-16T20:57:36.301 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.301 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.301 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:36.301 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786298+0000", 2020-11-16T20:57:36.302 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4331999999999999e-05 2020-11-16T20:57:36.302 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.302 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.302 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:36.302 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786313+0000", 2020-11-16T20:57:36.302 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6460000000000001e-06 2020-11-16T20:57:36.302 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.303 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.303 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:36.303 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786317+0000", 2020-11-16T20:57:36.303 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5451999999999995e-05 2020-11-16T20:57:36.303 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.303 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.303 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.304 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786393+0000", 2020-11-16T20:57:36.304 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065041011999999995 2020-11-16T20:57:36.304 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.304 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.304 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:36.304 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851434+0000", 2020-11-16T20:57:36.304 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6510000000000001e-06 2020-11-16T20:57:36.304 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.305 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.305 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:36.305 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851437+0000", 2020-11-16T20:57:36.305 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065186216000000005 2020-11-16T20:57:36.305 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.305 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.305 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.306 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.306 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.306 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2594 4.3 4:f5f8fa2a:::smithi16641208-144:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:57:36.306 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.786352+0000", 2020-11-16T20:57:36.306 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 72.159315698, 2020-11-16T20:57:36.306 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.089305972999999997, 2020-11-16T20:57:36.306 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:36.307 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:36.307 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:36.307 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:36.307 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:36.307 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2594 2020-11-16T20:57:36.307 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.307 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:36.307 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.308 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:36.308 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786352+0000", 2020-11-16T20:57:36.308 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:36.308 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.308 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.308 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:36.308 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786352+0000", 2020-11-16T20:57:36.309 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5896000000000001e-05 2020-11-16T20:57:36.309 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.309 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.309 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:36.309 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786377+0000", 2020-11-16T20:57:36.309 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7700000000000004e-06 2020-11-16T20:57:36.309 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.309 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.310 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:36.310 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786384+0000", 2020-11-16T20:57:36.310 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.049e-05 2020-11-16T20:57:36.310 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.310 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.310 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:36.310 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786395+0000", 2020-11-16T20:57:36.311 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0440000000000003e-06 2020-11-16T20:57:36.311 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.311 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.311 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:36.311 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786400+0000", 2020-11-16T20:57:36.311 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000366771 2020-11-16T20:57:36.311 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.312 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.312 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.312 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786767+0000", 2020-11-16T20:57:36.312 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1366999999999998e-05 2020-11-16T20:57:36.312 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.312 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.312 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:36.312 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786818+0000", 2020-11-16T20:57:36.313 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.077259257999999997 2020-11-16T20:57:36.313 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.313 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.313 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.864077+0000", 2020-11-16T20:57:36.313 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018375499999999999 2020-11-16T20:57:36.313 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.314 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.314 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:36.314 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.864261+0000", 2020-11-16T20:57:36.314 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011122837 2020-11-16T20:57:36.314 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.314 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.314 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.314 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.875384+0000", 2020-11-16T20:57:36.315 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000135752 2020-11-16T20:57:36.315 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.315 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.315 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:36.315 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.875520+0000", 2020-11-16T20:57:36.315 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000138033 2020-11-16T20:57:36.315 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.316 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.316 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:36.316 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.875658+0000", 2020-11-16T20:57:36.316 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.089305972999999997 2020-11-16T20:57:36.316 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.316 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.316 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.316 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.317 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.317 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2872 4.3 4:d9c18080:::smithi16641208-173:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-11-16T20:57:36.317 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:34.745479+0000", 2020-11-16T20:57:36.317 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 57.200188433999998, 2020-11-16T20:57:36.317 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.059388271999999999, 2020-11-16T20:57:36.317 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:36.317 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:36.318 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:36.318 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:36.318 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:36.318 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2872 2020-11-16T20:57:36.318 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.318 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:36.318 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.319 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:36.319 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745479+0000", 2020-11-16T20:57:36.319 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:36.319 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.319 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.319 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:36.319 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745479+0000", 2020-11-16T20:57:36.320 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0491e-05 2020-11-16T20:57:36.320 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.320 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.320 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:36.320 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745509+0000", 2020-11-16T20:57:36.320 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9170000000000003e-06 2020-11-16T20:57:36.320 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.320 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.321 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:36.321 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745515+0000", 2020-11-16T20:57:36.321 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1267000000000001e-05 2020-11-16T20:57:36.321 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.321 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.321 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:36.321 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745527+0000", 2020-11-16T20:57:36.322 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.04e-06 2020-11-16T20:57:36.322 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.322 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.322 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:36.322 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745532+0000", 2020-11-16T20:57:36.322 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034800500000000003 2020-11-16T20:57:36.322 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.322 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.323 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.323 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745880+0000", 2020-11-16T20:57:36.323 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6010000000000003e-05 2020-11-16T20:57:36.323 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.323 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.323 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:36.323 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745916+0000", 2020-11-16T20:57:36.324 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042557927000000002 2020-11-16T20:57:36.324 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.324 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.324 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.324 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.788474+0000", 2020-11-16T20:57:36.324 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000160614 2020-11-16T20:57:36.324 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.324 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.325 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:36.325 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.788634+0000", 2020-11-16T20:57:36.325 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016066745 2020-11-16T20:57:36.325 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.325 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.325 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.325 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.804701+0000", 2020-11-16T20:57:36.326 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3805000000000001e-05 2020-11-16T20:57:36.326 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.326 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.326 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:36.326 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.804785+0000", 2020-11-16T20:57:36.326 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2451000000000001e-05 2020-11-16T20:57:36.326 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.327 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.327 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:36.327 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.804867+0000", 2020-11-16T20:57:36.327 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.059388271999999999 2020-11-16T20:57:36.327 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.327 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.327 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.327 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.328 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.328 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2961 4.3 4:c925a80f:::smithi16641208-375:head [write 531253~411999,stat] snapc 2d=[2d,25] ondisk+write+known_if_redirected e82)", 2020-11-16T20:57:36.328 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.744743+0000", 2020-11-16T20:57:36.328 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 47.200923795999998, 2020-11-16T20:57:36.328 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037689271000000003, 2020-11-16T20:57:36.328 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:36.328 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:36.329 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:36.329 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:36.329 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:36.329 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2961 2020-11-16T20:57:36.329 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.329 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:36.330 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.330 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:36.330 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.744743+0000", 2020-11-16T20:57:36.330 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:36.330 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.330 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.330 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:36.331 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.744743+0000", 2020-11-16T20:57:36.331 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033429999999999999 2020-11-16T20:57:36.331 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.331 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.331 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:36.331 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.745078+0000", 2020-11-16T20:57:36.331 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9050000000000003e-06 2020-11-16T20:57:36.331 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.332 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.332 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:36.332 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.745087+0000", 2020-11-16T20:57:36.332 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6243999999999999e-05 2020-11-16T20:57:36.332 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.332 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.332 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:36.333 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.745103+0000", 2020-11-16T20:57:36.333 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8470000000000008e-06 2020-11-16T20:57:36.333 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.333 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.333 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:36.333 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.745113+0000", 2020-11-16T20:57:36.333 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00050440200000000004 2020-11-16T20:57:36.333 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.334 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.334 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.334 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.745617+0000", 2020-11-16T20:57:36.334 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036809989000000001 2020-11-16T20:57:36.334 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.334 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.334 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:36.335 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.782427+0000", 2020-11-16T20:57:36.335 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5840000000000002e-06 2020-11-16T20:57:36.335 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:36.335 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.782433+0000", 2020-11-16T20:57:36.335 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037689271000000003 2020-11-16T20:57:36.336 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.336 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.336 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.336 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.336 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.336 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2962 4.3 4:c925a80f:::smithi16641208-375:head [write 1381780~411527] snapc 2d=[2d,25] ondisk+write+known_if_redirected e82)", 2020-11-16T20:57:36.336 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.749629+0000", 2020-11-16T20:57:36.336 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 47.196038676000001, 2020-11-16T20:57:36.337 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.052987905000000002, 2020-11-16T20:57:36.337 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:36.337 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:36.337 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:36.337 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:36.337 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:36.337 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2962 2020-11-16T20:57:36.338 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.338 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:36.338 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.338 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:36.338 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.749629+0000", 2020-11-16T20:57:36.338 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:36.338 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.338 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.339 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:36.339 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.749629+0000", 2020-11-16T20:57:36.339 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00039027700000000002 2020-11-16T20:57:36.339 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.339 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.339 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:36.339 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750019+0000", 2020-11-16T20:57:36.340 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0961000000000001e-05 2020-11-16T20:57:36.340 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.340 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.340 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:36.340 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750030+0000", 2020-11-16T20:57:36.340 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7931000000000002e-05 2020-11-16T20:57:36.340 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.340 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.341 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:36.341 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750048+0000", 2020-11-16T20:57:36.341 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3030000000000005e-06 2020-11-16T20:57:36.341 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.341 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.341 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:36.341 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750057+0000", 2020-11-16T20:57:36.342 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8351999999999999e-05 2020-11-16T20:57:36.342 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.342 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.342 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.342 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750125+0000", 2020-11-16T20:57:36.342 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010314000000000001 2020-11-16T20:57:36.342 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.343 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.343 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:36.343 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750229+0000", 2020-11-16T20:57:36.343 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039625369000000001 2020-11-16T20:57:36.343 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.343 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.343 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.343 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.789854+0000", 2020-11-16T20:57:36.344 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000153096 2020-11-16T20:57:36.344 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.344 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.344 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:36.344 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790007+0000", 2020-11-16T20:57:36.344 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022176699999999999 2020-11-16T20:57:36.344 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.345 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.345 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:57:36.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790229+0000", 2020-11-16T20:57:36.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0059379410000000004 2020-11-16T20:57:36.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.345 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.345 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:36.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.796167+0000", 2020-11-16T20:57:36.346 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0013346230000000001 2020-11-16T20:57:36.346 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.346 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.346 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:36.346 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.797501+0000", 2020-11-16T20:57:36.346 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0049809470000000003 2020-11-16T20:57:36.346 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.347 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.347 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:36.347 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802482+0000", 2020-11-16T20:57:36.347 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1831999999999998e-05 2020-11-16T20:57:36.347 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.347 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.347 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:36.348 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802574+0000", 2020-11-16T20:57:36.348 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2366000000000001e-05 2020-11-16T20:57:36.348 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.348 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.348 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:36.348 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802617+0000", 2020-11-16T20:57:36.348 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.052987905000000002 2020-11-16T20:57:36.348 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.349 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.349 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.349 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.349 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.349 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2963 4.3 4:c925a80f:::smithi16641208-375:head [write 2300501~586966] snapc 2d=[2d,25] ondisk+write+known_if_redirected e82)", 2020-11-16T20:57:36.349 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.756229+0000", 2020-11-16T20:57:36.349 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 47.189438371999998, 2020-11-16T20:57:36.350 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.046550438999999999, 2020-11-16T20:57:36.350 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:36.350 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:36.350 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:36.350 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:36.350 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:36.350 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2963 2020-11-16T20:57:36.350 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.351 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:36.351 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.351 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:36.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.756229+0000", 2020-11-16T20:57:36.351 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:36.351 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.351 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.352 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:36.352 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.756229+0000", 2020-11-16T20:57:36.352 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00042272700000000002 2020-11-16T20:57:36.352 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.352 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:36.352 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.756652+0000", 2020-11-16T20:57:36.353 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7900000000000005e-06 2020-11-16T20:57:36.353 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.353 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.353 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:36.353 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.756660+0000", 2020-11-16T20:57:36.353 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8972000000000001e-05 2020-11-16T20:57:36.353 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.353 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.354 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:36.354 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.756679+0000", 2020-11-16T20:57:36.354 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.4299999999999995e-06 2020-11-16T20:57:36.354 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.354 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.354 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:36.354 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.756689+0000", 2020-11-16T20:57:36.355 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002317586 2020-11-16T20:57:36.355 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.355 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.355 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.355 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759006+0000", 2020-11-16T20:57:36.355 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2758999999999997e-05 2020-11-16T20:57:36.355 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.356 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.356 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:36.356 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759099+0000", 2020-11-16T20:57:36.356 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032185841 2020-11-16T20:57:36.356 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.356 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.356 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.356 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.791285+0000", 2020-11-16T20:57:36.357 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018714299999999999 2020-11-16T20:57:36.357 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.357 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.357 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:36.357 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.791472+0000", 2020-11-16T20:57:36.357 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00025010899999999999 2020-11-16T20:57:36.357 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.358 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.358 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:57:36.358 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.791722+0000", 2020-11-16T20:57:36.358 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044518370000000002 2020-11-16T20:57:36.358 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.358 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.358 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:36.359 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.796174+0000", 2020-11-16T20:57:36.359 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0015727860000000001 2020-11-16T20:57:36.359 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.359 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.359 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:36.359 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.797747+0000", 2020-11-16T20:57:36.359 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0049201610000000002 2020-11-16T20:57:36.359 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.360 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.360 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:36.360 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802667+0000", 2020-11-16T20:57:36.360 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3230000000000003e-05 2020-11-16T20:57:36.360 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.360 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.360 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:36.361 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802730+0000", 2020-11-16T20:57:36.361 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9067999999999998e-05 2020-11-16T20:57:36.361 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.361 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.361 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:36.361 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802779+0000", 2020-11-16T20:57:36.361 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.046550438999999999 2020-11-16T20:57:36.361 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.362 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.362 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.362 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.362 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.362 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2964 4.3 4:c925a80f:::smithi16641208-375:head [write 3376974~354279] snapc 2d=[2d,25] ondisk+write+known_if_redirected e82)", 2020-11-16T20:57:36.362 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.761493+0000", 2020-11-16T20:57:36.362 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 47.184174143, 2020-11-16T20:57:36.363 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041469457000000001, 2020-11-16T20:57:36.363 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:36.363 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:36.363 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:36.363 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:36.363 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:36.363 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2964 2020-11-16T20:57:36.364 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.364 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:36.364 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.364 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:36.364 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761493+0000", 2020-11-16T20:57:36.364 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:36.364 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.364 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.365 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:36.365 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761493+0000", 2020-11-16T20:57:36.365 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00026002099999999998 2020-11-16T20:57:36.365 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.365 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.365 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:36.365 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761753+0000", 2020-11-16T20:57:36.366 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4440000000000008e-06 2020-11-16T20:57:36.366 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.366 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.366 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:36.366 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761762+0000", 2020-11-16T20:57:36.366 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3835000000000001e-05 2020-11-16T20:57:36.366 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.366 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.367 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:36.367 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761775+0000", 2020-11-16T20:57:36.367 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.876e-06 2020-11-16T20:57:36.367 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.367 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.367 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:36.367 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761785+0000", 2020-11-16T20:57:36.368 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017208666000000001 2020-11-16T20:57:36.368 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.368 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.368 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.368 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.778994+0000", 2020-11-16T20:57:36.368 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033175300000000001 2020-11-16T20:57:36.368 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.369 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.369 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:36.369 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.779326+0000", 2020-11-16T20:57:36.369 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013958096 2020-11-16T20:57:36.369 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.369 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.369 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.369 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.793284+0000", 2020-11-16T20:57:36.370 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015513300000000001 2020-11-16T20:57:36.370 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.370 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.370 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:36.370 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.793439+0000", 2020-11-16T20:57:36.370 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000223293 2020-11-16T20:57:36.370 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.371 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.371 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:57:36.371 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.793662+0000", 2020-11-16T20:57:36.371 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044197330000000003 2020-11-16T20:57:36.371 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.371 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.371 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:36.372 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.798082+0000", 2020-11-16T20:57:36.372 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0032816350000000002 2020-11-16T20:57:36.372 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.372 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.372 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:36.372 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.801364+0000", 2020-11-16T20:57:36.372 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0014819259999999999 2020-11-16T20:57:36.372 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.373 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.373 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:36.373 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802846+0000", 2020-11-16T20:57:36.373 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5000999999999996e-05 2020-11-16T20:57:36.373 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.373 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.373 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:36.374 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802911+0000", 2020-11-16T20:57:36.374 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2045000000000001e-05 2020-11-16T20:57:36.374 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.374 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.374 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:36.374 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802963+0000", 2020-11-16T20:57:36.374 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041469457000000001 2020-11-16T20:57:36.374 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.375 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.375 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.375 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.375 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.375 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2965 4.3 4:c925a80f:::smithi16641208-375:head [setxattr _header (58) in=7b,truncate 3731253] snapc 2d=[2d,25] ondisk+write+known_if_redirected e82)", 2020-11-16T20:57:36.375 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.761821+0000", 2020-11-16T20:57:36.375 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 47.183846617999997, 2020-11-16T20:57:36.376 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041339300000000002, 2020-11-16T20:57:36.376 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:36.376 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:36.376 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:36.376 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:36.376 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:36.376 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2965 2020-11-16T20:57:36.377 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.377 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:36.377 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.377 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:36.377 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761821+0000", 2020-11-16T20:57:36.377 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:36.377 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.377 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.378 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:36.378 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761821+0000", 2020-11-16T20:57:36.378 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2008999999999997e-05 2020-11-16T20:57:36.378 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.378 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.378 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:36.378 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761863+0000", 2020-11-16T20:57:36.379 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1800000000000001e-06 2020-11-16T20:57:36.379 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.379 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.379 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:36.379 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761869+0000", 2020-11-16T20:57:36.379 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1333000000000001e-05 2020-11-16T20:57:36.379 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.379 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.380 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:36.380 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761890+0000", 2020-11-16T20:57:36.380 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.361e-06 2020-11-16T20:57:36.380 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.380 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.380 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:36.380 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761896+0000", 2020-11-16T20:57:36.381 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017786705999999999 2020-11-16T20:57:36.381 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.381 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.381 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.381 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.779682+0000", 2020-11-16T20:57:36.381 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2055000000000003e-05 2020-11-16T20:57:36.381 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.382 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:36.382 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.779724+0000", 2020-11-16T20:57:36.382 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014764318 2020-11-16T20:57:36.382 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.383 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.383 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.794489+0000", 2020-11-16T20:57:36.383 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015123299999999999 2020-11-16T20:57:36.383 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.383 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.383 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:36.383 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.794640+0000", 2020-11-16T20:57:36.384 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00026568499999999999 2020-11-16T20:57:36.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.384 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:57:36.384 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.794906+0000", 2020-11-16T20:57:36.384 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003191925 2020-11-16T20:57:36.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.385 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:36.385 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.798097+0000", 2020-11-16T20:57:36.385 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033213790000000002 2020-11-16T20:57:36.385 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.385 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.385 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:36.385 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.801419+0000", 2020-11-16T20:57:36.386 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0016152409999999999 2020-11-16T20:57:36.386 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.386 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.386 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:36.386 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.803034+0000", 2020-11-16T20:57:36.386 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8489000000000002e-05 2020-11-16T20:57:36.386 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.386 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.387 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:36.387 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.803093+0000", 2020-11-16T20:57:36.387 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7385999999999995e-05 2020-11-16T20:57:36.387 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.387 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.387 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:36.387 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.803160+0000", 2020-11-16T20:57:36.388 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041339300000000002 2020-11-16T20:57:36.388 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.388 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.388 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.388 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.388 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2966 4.3 4:c925a80f:::smithi16641208-375:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e82)", 2020-11-16T20:57:36.388 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.761928+0000", 2020-11-16T20:57:36.389 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 47.183739260000003, 2020-11-16T20:57:36.389 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042111356000000003, 2020-11-16T20:57:36.389 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:36.389 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:36.389 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:36.389 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:36.389 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:36.390 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2966 2020-11-16T20:57:36.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.390 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:36.390 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.390 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:36.390 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761928+0000", 2020-11-16T20:57:36.390 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:36.391 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.391 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:36.391 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761928+0000", 2020-11-16T20:57:36.391 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8744000000000001e-05 2020-11-16T20:57:36.391 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.391 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:36.392 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761957+0000", 2020-11-16T20:57:36.392 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7930000000000003e-06 2020-11-16T20:57:36.392 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.392 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.392 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:36.392 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761963+0000", 2020-11-16T20:57:36.392 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.309e-05 2020-11-16T20:57:36.393 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.393 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.393 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:36.393 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761976+0000", 2020-11-16T20:57:36.393 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7609999999999998e-06 2020-11-16T20:57:36.393 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.393 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.393 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:36.394 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.761980+0000", 2020-11-16T20:57:36.394 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017770805000000001 2020-11-16T20:57:36.394 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.394 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.394 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.394 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.779751+0000", 2020-11-16T20:57:36.394 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8778e-05 2020-11-16T20:57:36.395 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.395 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.395 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:36.395 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.779800+0000", 2020-11-16T20:57:36.395 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016025625000000002 2020-11-16T20:57:36.395 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.395 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.396 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.396 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.795826+0000", 2020-11-16T20:57:36.396 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032036800000000002 2020-11-16T20:57:36.396 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.396 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.396 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:36.396 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.796146+0000", 2020-11-16T20:57:36.396 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0070442580000000003 2020-11-16T20:57:36.397 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.397 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.397 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.397 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.803190+0000", 2020-11-16T20:57:36.397 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010655800000000001 2020-11-16T20:57:36.397 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.397 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.398 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:36.398 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.803297+0000", 2020-11-16T20:57:36.398 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000742576 2020-11-16T20:57:36.398 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.398 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.398 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:36.398 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.804039+0000", 2020-11-16T20:57:36.399 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042111356000000003 2020-11-16T20:57:36.399 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.399 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.399 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.399 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.399 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.399 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2997 4.3 4:f5e68fa8:::smithi16641208-361:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e86)", 2020-11-16T20:57:36.399 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838418+0000", 2020-11-16T20:57:36.400 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 43.107248964999997, 2020-11-16T20:57:36.400 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.056590020999999997, 2020-11-16T20:57:36.400 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:36.400 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:36.400 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:36.400 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:36.400 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:36.401 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2997 2020-11-16T20:57:36.401 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.401 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:36.401 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.401 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:36.401 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838418+0000", 2020-11-16T20:57:36.401 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:36.401 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.402 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.402 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:36.402 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838418+0000", 2020-11-16T20:57:36.402 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9998999999999999e-05 2020-11-16T20:57:36.402 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.402 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.402 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:36.403 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838448+0000", 2020-11-16T20:57:36.403 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3640000000000004e-06 2020-11-16T20:57:36.403 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.403 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.403 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:36.403 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838455+0000", 2020-11-16T20:57:36.403 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1902999999999999e-05 2020-11-16T20:57:36.404 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.404 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.404 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:36.404 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838467+0000", 2020-11-16T20:57:36.404 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1699999999999996e-06 2020-11-16T20:57:36.404 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.404 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.405 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:36.405 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838472+0000", 2020-11-16T20:57:36.405 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00047208200000000002 2020-11-16T20:57:36.405 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.405 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.405 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.405 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838944+0000", 2020-11-16T20:57:36.405 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6712000000000002e-05 2020-11-16T20:57:36.406 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.406 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.406 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:36.406 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.839001+0000", 2020-11-16T20:57:36.406 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038817664000000002 2020-11-16T20:57:36.406 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.406 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.407 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.407 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.877818+0000", 2020-11-16T20:57:36.407 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000119492 2020-11-16T20:57:36.407 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.407 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.407 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:36.407 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.877938+0000", 2020-11-16T20:57:36.408 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016797409999999999 2020-11-16T20:57:36.408 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.408 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.408 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:36.408 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.894735+0000", 2020-11-16T20:57:36.408 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015645500000000001 2020-11-16T20:57:36.408 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.408 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.409 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:36.409 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.894892+0000", 2020-11-16T20:57:36.409 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011677 2020-11-16T20:57:36.409 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.409 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.409 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:36.409 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.895008+0000", 2020-11-16T20:57:36.410 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.056590020999999997 2020-11-16T20:57:36.410 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.410 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.410 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.410 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.410 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.410 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:36.411 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:57:36.412 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2020-11-16T20:57:36.412 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7] out_osds: [1] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:57:36.412 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:57:36.413 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2020-11-16T20:57:36.418 INFO:tasks.rados.rados.0.smithi166.stdout:1054: done (4 left) 2020-11-16T20:57:36.418 INFO:tasks.rados.rados.0.smithi166.stdout:1055: done (3 left) 2020-11-16T20:57:36.419 INFO:tasks.rados.rados.0.smithi166.stdout:1056: done (2 left) 2020-11-16T20:57:36.419 INFO:tasks.rados.rados.0.smithi166.stdout:1057: done (1 left) 2020-11-16T20:57:36.419 INFO:tasks.rados.rados.0.smithi166.stdout:1059: done (0 left) 2020-11-16T20:57:36.419 INFO:tasks.rados.rados.0.smithi166.stdout:1060: copy_from oid 185 from oid 433 current snap is 44 2020-11-16T20:57:36.419 INFO:tasks.rados.rados.0.smithi166.stdout:1061: read oid 261 snap -1 2020-11-16T20:57:36.419 INFO:tasks.rados.rados.0.smithi166.stdout:1061: expect (ObjNum 260 snap 0 seq_num 260) 2020-11-16T20:57:36.419 INFO:tasks.rados.rados.0.smithi166.stdout:1062: cache_evict oid 496 snap 43 2020-11-16T20:57:36.420 INFO:tasks.rados.rados.0.smithi166.stdout:1063: write oid 229 current snap is 44 2020-11-16T20:57:36.420 INFO:tasks.rados.rados.0.smithi166.stdout:1063: seq_num 648 ranges {490936=651357,1686214=447225,2861864=29072} 2020-11-16T20:57:36.420 INFO:tasks.rados.rados.0.smithi166.stdout:1063: writing smithi16641208-229 from 490936 to 1142293 tid 1 2020-11-16T20:57:36.420 INFO:tasks.rados.rados.0.smithi166.stdout:1063: writing smithi16641208-229 from 1686214 to 2133439 tid 2 2020-11-16T20:57:36.420 INFO:tasks.rados.rados.0.smithi166.stdout:1063: writing smithi16641208-229 from 2861864 to 2890936 tid 3 2020-11-16T20:57:36.420 INFO:tasks.rados.rados.0.smithi166.stdout:1064: cache_try_flush oid 308 snap -1 2020-11-16T20:57:36.420 INFO:tasks.rados.rados.0.smithi166.stdout:1065: copy_from oid 68 from oid 259 current snap is 44 2020-11-16T20:57:36.421 INFO:tasks.rados.rados.0.smithi166.stdout:1066: write (excl) oid 255 current snap is 44 2020-11-16T20:57:36.421 INFO:tasks.rados.rados.0.smithi166.stdout:1066: seq_num 649 ranges {507743=726606,1744696=590883,2772934=134809} 2020-11-16T20:57:36.421 INFO:tasks.rados.rados.0.smithi166.stdout:1066: writing smithi16641208-255 from 507743 to 1234349 tid 1 2020-11-16T20:57:36.421 INFO:tasks.rados.rados.0.smithi166.stdout:1066: writing smithi16641208-255 from 1744696 to 2335579 tid 2 2020-11-16T20:57:36.421 INFO:tasks.rados.rados.0.smithi166.stdout:1066: writing smithi16641208-255 from 2772934 to 2907743 tid 3 2020-11-16T20:57:36.421 INFO:tasks.rados.rados.0.smithi166.stdout:1067: snap_remove snap 40 2020-11-16T20:57:36.421 INFO:tasks.rados.rados.0.smithi166.stdout:1067: done (7 left) 2020-11-16T20:57:36.421 INFO:tasks.rados.rados.0.smithi166.stdout:1068: cache_try_flush oid 166 snap -1 2020-11-16T20:57:36.422 INFO:tasks.rados.rados.0.smithi166.stdout:1062: got (2) No such file or directory 2020-11-16T20:57:36.422 INFO:tasks.rados.rados.0.smithi166.stdout:1060: finishing copy_from to smithi16641208-185 2020-11-16T20:57:36.422 INFO:tasks.rados.rados.0.smithi166.stdout:1060: got expected ENOENT (src dne) 2020-11-16T20:57:36.422 INFO:tasks.rados.rados.0.smithi166.stdout:1061: expect (ObjNum 260 snap 0 seq_num 260) 2020-11-16T20:57:36.422 INFO:tasks.rados.rados.0.smithi166.stdout:1063: finishing write tid 1 to smithi16641208-229 2020-11-16T20:57:36.422 INFO:tasks.rados.rados.0.smithi166.stdout:1063: finishing write tid 2 to smithi16641208-229 2020-11-16T20:57:36.422 INFO:tasks.rados.rados.0.smithi166.stdout:1063: finishing write tid 3 to smithi16641208-229 2020-11-16T20:57:36.423 INFO:tasks.rados.rados.0.smithi166.stdout:1064: got (2) No such file or directory 2020-11-16T20:57:36.423 INFO:tasks.rados.rados.0.smithi166.stdout:1063: finishing write tid 4 to smithi16641208-229 2020-11-16T20:57:36.423 INFO:tasks.rados.rados.0.smithi166.stdout:1061: done (7 left) 2020-11-16T20:57:36.423 INFO:tasks.rados.rados.0.smithi166.stdout:1062: done (6 left) 2020-11-16T20:57:36.423 INFO:tasks.rados.rados.0.smithi166.stdout:1064: done (5 left) 2020-11-16T20:57:36.423 INFO:tasks.rados.rados.0.smithi166.stdout:1069: write oid 119 current snap is 44 2020-11-16T20:57:36.423 INFO:tasks.rados.rados.0.smithi166.stdout:1063: finishing write tid 5 to smithi16641208-229 2020-11-16T20:57:36.424 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 229 v 714 (ObjNum 648 snap 44 seq_num 648) dirty exists 2020-11-16T20:57:36.424 INFO:tasks.rados.rados.0.smithi166.stdout:1063: left oid 229 (ObjNum 648 snap 44 seq_num 648) 2020-11-16T20:57:36.424 INFO:tasks.rados.rados.0.smithi166.stdout:1060: finishing copy_from racing read to smithi16641208-185 2020-11-16T20:57:36.424 INFO:tasks.rados.rados.0.smithi166.stdout:1065: finishing copy_from to smithi16641208-68 2020-11-16T20:57:36.424 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 68 v 191 (ObjNum 258 snap 0 seq_num 258) dirty exists 2020-11-16T20:57:36.424 INFO:tasks.rados.rados.0.smithi166.stdout:1066: finishing write tid 1 to smithi16641208-255 2020-11-16T20:57:36.424 INFO:tasks.rados.rados.0.smithi166.stdout:1066: finishing write tid 2 to smithi16641208-255 2020-11-16T20:57:36.424 INFO:tasks.rados.rados.0.smithi166.stdout:1066: finishing write tid 3 to smithi16641208-255 2020-11-16T20:57:36.425 INFO:tasks.rados.rados.0.smithi166.stdout:1065: finishing copy_from racing read to smithi16641208-68 2020-11-16T20:57:36.425 INFO:tasks.rados.rados.0.smithi166.stdout:1066: finishing write tid 4 to smithi16641208-255 2020-11-16T20:57:36.425 INFO:tasks.rados.rados.0.smithi166.stdout:1066: finishing write tid 5 to smithi16641208-255 2020-11-16T20:57:36.425 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 255 v 681 (ObjNum 649 snap 44 seq_num 649) dirty exists 2020-11-16T20:57:36.425 INFO:tasks.rados.rados.0.smithi166.stdout:1066: left oid 255 (ObjNum 649 snap 44 seq_num 649) 2020-11-16T20:57:36.425 INFO:tasks.rados.rados.0.smithi166.stdout:1069: seq_num 650 ranges {524550=401855,1403178=450894,2516710=407840} 2020-11-16T20:57:36.425 INFO:tasks.rados.rados.0.smithi166.stdout:1069: writing smithi16641208-119 from 524550 to 926405 tid 1 2020-11-16T20:57:36.426 INFO:tasks.rados.rados.0.smithi166.stdout:1069: writing smithi16641208-119 from 1403178 to 1854072 tid 2 2020-11-16T20:57:36.426 INFO:tasks.rados.rados.0.smithi166.stdout:1069: writing smithi16641208-119 from 2516710 to 2924550 tid 3 2020-11-16T20:57:36.426 INFO:tasks.rados.rados.0.smithi166.stdout:1060: done (5 left) 2020-11-16T20:57:36.426 INFO:tasks.rados.rados.0.smithi166.stdout:1063: done (4 left) 2020-11-16T20:57:36.426 INFO:tasks.rados.rados.0.smithi166.stdout:1065: done (3 left) 2020-11-16T20:57:36.426 INFO:tasks.rados.rados.0.smithi166.stdout:1066: done (2 left) 2020-11-16T20:57:36.426 INFO:tasks.rados.rados.0.smithi166.stdout:1070: read oid 374 snap 41 2020-11-16T20:57:36.426 INFO:tasks.rados.rados.0.smithi166.stdout:1070: expect (ObjNum 373 snap 0 seq_num 373) 2020-11-16T20:57:36.427 INFO:tasks.rados.rados.0.smithi166.stdout:1071: cache_evict oid 375 snap -1 2020-11-16T20:57:36.427 INFO:tasks.rados.rados.0.smithi166.stdout:1072: read oid 179 snap -1 2020-11-16T20:57:36.427 INFO:tasks.rados.rados.0.smithi166.stdout:1072: expect (ObjNum 178 snap 0 seq_num 178) 2020-11-16T20:57:36.427 INFO:tasks.rados.rados.0.smithi166.stdout:1073: write (excl) oid 152 current snap is 44 2020-11-16T20:57:36.427 INFO:tasks.rados.rados.0.smithi166.stdout:1073: seq_num 651 ranges {541357=477104,1745307=594552} 2020-11-16T20:57:36.427 INFO:tasks.rados.rados.0.smithi166.stdout:1073: writing smithi16641208-152 from 541357 to 1018461 tid 1 2020-11-16T20:57:36.427 INFO:tasks.rados.rados.0.smithi166.stdout:1073: writing smithi16641208-152 from 1745307 to 2339859 tid 2 2020-11-16T20:57:36.428 INFO:tasks.rados.rados.0.smithi166.stdout:1074: cache_evict oid 231 snap -1 2020-11-16T20:57:36.428 INFO:tasks.rados.rados.0.smithi166.stdout:1075: rollback oid 260 current snap is 44 2020-11-16T20:57:36.428 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 260 to 42 2020-11-16T20:57:36.428 INFO:tasks.rados.rados.0.smithi166.stdout:1076: copy_from oid 134 from oid 420 current snap is 44 2020-11-16T20:57:36.428 INFO:tasks.rados.rados.0.smithi166.stdout:1077: read oid 245 snap -1 2020-11-16T20:57:36.428 INFO:tasks.rados.rados.0.smithi166.stdout:1077: expect (ObjNum 244 snap 0 seq_num 244) 2020-11-16T20:57:36.428 INFO:tasks.rados.rados.0.smithi166.stdout:1078: read oid 98 snap 43 2020-11-16T20:57:36.428 INFO:tasks.rados.rados.0.smithi166.stdout:1078: expect (ObjNum 97 snap 0 seq_num 97) 2020-11-16T20:57:36.429 INFO:tasks.rados.rados.0.smithi166.stdout:1079: delete oid 227 current snap is 44 2020-11-16T20:57:36.429 INFO:tasks.rados.rados.0.smithi166.stdout:1068: got (2) No such file or directory 2020-11-16T20:57:36.429 INFO:tasks.rados.rados.0.smithi166.stdout:1069: finishing write tid 1 to smithi16641208-119 2020-11-16T20:57:36.429 INFO:tasks.rados.rados.0.smithi166.stdout:1069: finishing write tid 2 to smithi16641208-119 2020-11-16T20:57:36.429 INFO:tasks.rados.rados.0.smithi166.stdout:1071: got (16) Device or resource busy 2020-11-16T20:57:36.429 INFO:tasks.rados.rados.0.smithi166.stdout:1070: expect (ObjNum 373 snap 0 seq_num 373) 2020-11-16T20:57:36.429 INFO:tasks.rados.rados.0.smithi166.stdout:1069: finishing write tid 3 to smithi16641208-119 2020-11-16T20:57:36.430 INFO:tasks.rados.rados.0.smithi166.stdout:1069: finishing write tid 4 to smithi16641208-119 2020-11-16T20:57:36.430 INFO:tasks.rados.rados.0.smithi166.stdout:1068: done (11 left) 2020-11-16T20:57:36.430 INFO:tasks.rados.rados.0.smithi166.stdout:1070: done (10 left) 2020-11-16T20:57:36.430 INFO:tasks.rados.rados.0.smithi166.stdout:1071: done (9 left) 2020-11-16T20:57:36.430 INFO:tasks.rados.rados.0.smithi166.stdout:1079: done (8 left) 2020-11-16T20:57:36.430 INFO:tasks.rados.rados.0.smithi166.stdout:1080: snap_remove snap 41 2020-11-16T20:57:36.430 INFO:tasks.rados.rados.0.smithi166.stdout:1080: done (8 left) 2020-11-16T20:57:36.431 INFO:tasks.rados.rados.0.smithi166.stdout:1081: read oid 493 snap 42 2020-11-16T20:57:36.431 INFO:tasks.rados.rados.0.smithi166.stdout:1081: expect (ObjNum 492 snap 0 seq_num 492) 2020-11-16T20:57:36.431 INFO:tasks.rados.rados.0.smithi166.stdout:1082: copy_from oid 217 from oid 342 current snap is 44 2020-11-16T20:57:36.431 INFO:tasks.rados.rados.0.smithi166.stdout:1083: rollback oid 291 current snap is 44 2020-11-16T20:57:36.431 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 291 to 43 2020-11-16T20:57:36.431 INFO:tasks.rados.rados.0.smithi166.stdout:1084: read oid 384 snap -1 2020-11-16T20:57:36.431 INFO:tasks.rados.rados.0.smithi166.stdout:1084: expect (ObjNum 383 snap 0 seq_num 383) 2020-11-16T20:57:36.431 INFO:tasks.rados.rados.0.smithi166.stdout:1085: write oid 378 current snap is 44 2020-11-16T20:57:36.432 INFO:tasks.rados.rados.0.smithi166.stdout:1085: seq_num 653 ranges {574971=627602,1862271=598221} 2020-11-16T20:57:36.432 INFO:tasks.rados.rados.0.smithi166.stdout:1085: writing smithi16641208-378 from 574971 to 1202573 tid 1 2020-11-16T20:57:36.432 INFO:tasks.rados.rados.0.smithi166.stdout:1085: writing smithi16641208-378 from 1862271 to 2460492 tid 2 2020-11-16T20:57:36.432 INFO:tasks.rados.rados.0.smithi166.stdout:1086: snap_create 2020-11-16T20:57:36.432 INFO:tasks.rados.rados.0.smithi166.stdout:1073: finishing write tid 1 to smithi16641208-152 2020-11-16T20:57:36.432 INFO:tasks.rados.rados.0.smithi166.stdout:1069: finishing write tid 5 to smithi16641208-119 2020-11-16T20:57:36.432 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 119 v 718 (ObjNum 650 snap 44 seq_num 650) dirty exists 2020-11-16T20:57:36.433 INFO:tasks.rados.rados.0.smithi166.stdout:1069: left oid 119 (ObjNum 650 snap 44 seq_num 650) 2020-11-16T20:57:36.433 INFO:tasks.rados.rados.0.smithi166.stdout:1074: got (2) No such file or directory 2020-11-16T20:57:36.433 INFO:tasks.rados.rados.0.smithi166.stdout:1072: expect (ObjNum 178 snap 0 seq_num 178) 2020-11-16T20:57:36.433 INFO:tasks.rados.rados.0.smithi166.stdout:1073: finishing write tid 2 to smithi16641208-152 2020-11-16T20:57:36.433 INFO:tasks.rados.rados.0.smithi166.stdout:1073: finishing write tid 3 to smithi16641208-152 2020-11-16T20:57:36.433 INFO:tasks.rados.rados.0.smithi166.stdout:1077: expect (ObjNum 244 snap 0 seq_num 244) 2020-11-16T20:57:36.433 INFO:tasks.rados.rados.0.smithi166.stdout:1075: finishing rollback tid 1 to smithi16641208-260 2020-11-16T20:57:36.434 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 260 v 0 (ObjNum 1 snap 32601 seq_num 1727320560) dirty dne 2020-11-16T20:57:36.434 INFO:tasks.rados.rados.0.smithi166.stdout:1073: finishing write tid 4 to smithi16641208-152 2020-11-16T20:57:36.434 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 152 v 754 (ObjNum 651 snap 44 seq_num 651) dirty exists 2020-11-16T20:57:36.434 INFO:tasks.rados.rados.0.smithi166.stdout:1073: left oid 152 (ObjNum 651 snap 44 seq_num 651) 2020-11-16T20:57:36.434 INFO:tasks.rados.rados.0.smithi166.stdout:1078: expect (ObjNum 97 snap 0 seq_num 97) 2020-11-16T20:57:36.434 INFO:tasks.rados.rados.0.smithi166.stdout:1076: finishing copy_from to smithi16641208-134 2020-11-16T20:57:36.434 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 134 v 290 (ObjNum 419 snap 0 seq_num 419) dirty exists 2020-11-16T20:57:36.434 INFO:tasks.rados.rados.0.smithi166.stdout:1076: finishing copy_from racing read to smithi16641208-134 2020-11-16T20:57:36.435 INFO:tasks.rados.rados.0.smithi166.stdout:1081: expect (ObjNum 492 snap 0 seq_num 492) 2020-11-16T20:57:36.435 INFO:tasks.rados.rados.0.smithi166.stdout:1083: finishing rollback tid 0 to smithi16641208-291 2020-11-16T20:57:36.435 INFO:tasks.rados.rados.0.smithi166.stdout:1084: expect (ObjNum 383 snap 0 seq_num 383) 2020-11-16T20:57:36.435 INFO:tasks.rados.rados.0.smithi166.stdout:1085: finishing write tid 1 to smithi16641208-378 2020-11-16T20:57:36.435 INFO:tasks.rados.rados.0.smithi166.stdout:1083: finishing rollback tid 1 to smithi16641208-291 2020-11-16T20:57:36.435 INFO:tasks.rados.rados.0.smithi166.stdout:1082: finishing copy_from to smithi16641208-217 2020-11-16T20:57:36.435 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 217 v 367 (ObjNum 504 snap 2 seq_num 504) dirty exists 2020-11-16T20:57:36.436 INFO:tasks.rados.rados.0.smithi166.stdout:1083: finishing rollback tid 2 to smithi16641208-291 2020-11-16T20:57:36.436 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 291 v 823 (ObjNum 290 snap 0 seq_num 290) dirty exists 2020-11-16T20:57:36.436 INFO:tasks.rados.rados.0.smithi166.stdout:1085: finishing write tid 2 to smithi16641208-378 2020-11-16T20:57:36.436 INFO:tasks.rados.rados.0.smithi166.stdout:1085: finishing write tid 3 to smithi16641208-378 2020-11-16T20:57:36.436 INFO:tasks.rados.rados.0.smithi166.stdout:1085: finishing write tid 4 to smithi16641208-378 2020-11-16T20:57:36.436 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 378 v 744 (ObjNum 653 snap 44 seq_num 653) dirty exists 2020-11-16T20:57:36.436 INFO:tasks.rados.rados.0.smithi166.stdout:1085: left oid 378 (ObjNum 653 snap 44 seq_num 653) 2020-11-16T20:57:36.436 INFO:tasks.rados.rados.0.smithi166.stdout:1082: finishing copy_from racing read to smithi16641208-217 2020-11-16T20:57:36.437 INFO:tasks.rados.rados.0.smithi166.stdout:1069: done (13 left) 2020-11-16T20:57:36.437 INFO:tasks.rados.rados.0.smithi166.stdout:1072: done (12 left) 2020-11-16T20:57:36.437 INFO:tasks.rados.rados.0.smithi166.stdout:1073: done (11 left) 2020-11-16T20:57:36.437 INFO:tasks.rados.rados.0.smithi166.stdout:1074: done (10 left) 2020-11-16T20:57:36.437 INFO:tasks.rados.rados.0.smithi166.stdout:1075: done (9 left) 2020-11-16T20:57:36.437 INFO:tasks.rados.rados.0.smithi166.stdout:1076: done (8 left) 2020-11-16T20:57:36.437 INFO:tasks.rados.rados.0.smithi166.stdout:1077: done (7 left) 2020-11-16T20:57:36.438 INFO:tasks.rados.rados.0.smithi166.stdout:1078: done (6 left) 2020-11-16T20:57:36.438 INFO:tasks.rados.rados.0.smithi166.stdout:1081: done (5 left) 2020-11-16T20:57:36.438 INFO:tasks.rados.rados.0.smithi166.stdout:1082: done (4 left) 2020-11-16T20:57:36.438 INFO:tasks.rados.rados.0.smithi166.stdout:1083: done (3 left) 2020-11-16T20:57:36.438 INFO:tasks.rados.rados.0.smithi166.stdout:1084: done (2 left) 2020-11-16T20:57:36.438 INFO:tasks.rados.rados.0.smithi166.stdout:1085: done (1 left) 2020-11-16T20:57:36.438 INFO:tasks.rados.rados.0.smithi166.stdout:1086: done (0 left) 2020-11-16T20:57:36.438 INFO:tasks.rados.rados.0.smithi166.stdout:1087: snap_remove snap 44 2020-11-16T20:57:36.439 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:34.001+0000 7f0103291700 -1 osd.2 pg_epoch: 129 pg[3.0( v 129'711 (0'0,129'711] local-lis/les=127/128 n=113 ec=19/19 lis/c=127/127 les/c/f=128/128/0 sis=127) [2,6,0] r=0 lpr=127 luod=125'710 crt=129'711 lcod 125'708 mlcod 0'0 active+clean+snaptrim trimq=[52~1] ps=[41~1,44~1,48~3,4f~1]] removing snap head 2020-11-16T20:57:36.439 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:36.416+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:36.440 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:57:36.512 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:36.517+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:36.613 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:36.618+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:36.622 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:36.622 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:57:36.622 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:57:36.622 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:36.630 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:57:36.632 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:57:36.651 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:57:36.672 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:57:36.693 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:57:36.714 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:57:36.715 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:36.719+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:36.735 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:57:36.756 INFO:tasks.rados.rados.0.smithi166.stdout:1087: done (0 left) 2020-11-16T20:57:36.757 INFO:tasks.rados.rados.0.smithi166.stdout:1088: snap_remove snap 42 2020-11-16T20:57:36.759 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:57:36.781 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:57:36.782 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:57:36.782 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:57:36.782 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:57:36.783 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:57:36.783 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:57:36.783 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:57:36.783 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:57:36.783 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:57:36.789 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:36.789 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:36.800 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:57:36.815 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:36.820+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:36.823 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:57:36.823 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:36.823 INFO:teuthology.orchestra.run.smithi166.stdout: "epoch": 132, 2020-11-16T20:57:36.823 INFO:teuthology.orchestra.run.smithi166.stdout: "fsid": "a14fd848-4cfe-4cd9-9140-5b3c4b4e904d", 2020-11-16T20:57:36.823 INFO:teuthology.orchestra.run.smithi166.stdout: "created": "2020-11-16T20:54:44.938121+0000", 2020-11-16T20:57:36.824 INFO:teuthology.orchestra.run.smithi166.stdout: "modified": "2020-11-16T20:57:36.749712+0000", 2020-11-16T20:57:36.824 INFO:teuthology.orchestra.run.smithi166.stdout: "last_up_change": "2020-11-16T20:54:52.080163+0000", 2020-11-16T20:57:36.824 INFO:teuthology.orchestra.run.smithi166.stdout: "last_in_change": "2020-11-16T20:57:27.859480+0000", 2020-11-16T20:57:36.824 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-11-16T20:57:36.824 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_num": 5799936, 2020-11-16T20:57:36.824 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_set": [ 2020-11-16T20:57:36.824 INFO:teuthology.orchestra.run.smithi166.stdout: "pglog_hardlimit", 2020-11-16T20:57:36.825 INFO:teuthology.orchestra.run.smithi166.stdout: "purged_snapdirs", 2020-11-16T20:57:36.825 INFO:teuthology.orchestra.run.smithi166.stdout: "recovery_deletes", 2020-11-16T20:57:36.825 INFO:teuthology.orchestra.run.smithi166.stdout: "sortbitwise" 2020-11-16T20:57:36.825 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:36.825 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_version": 7, 2020-11-16T20:57:36.825 INFO:teuthology.orchestra.run.smithi166.stdout: "full_ratio": 0.94999998807907104, 2020-11-16T20:57:36.825 INFO:teuthology.orchestra.run.smithi166.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-11-16T20:57:36.826 INFO:teuthology.orchestra.run.smithi166.stdout: "nearfull_ratio": 0.85000002384185791, 2020-11-16T20:57:36.826 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_snapshot": "", 2020-11-16T20:57:36.826 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_max": 4, 2020-11-16T20:57:36.826 INFO:teuthology.orchestra.run.smithi166.stdout: "max_osd": 8, 2020-11-16T20:57:36.826 INFO:teuthology.orchestra.run.smithi166.stdout: "require_min_compat_client": "luminous", 2020-11-16T20:57:36.826 INFO:teuthology.orchestra.run.smithi166.stdout: "min_compat_client": "luminous", 2020-11-16T20:57:36.826 INFO:teuthology.orchestra.run.smithi166.stdout: "require_osd_release": "pacific", 2020-11-16T20:57:36.827 INFO:teuthology.orchestra.run.smithi166.stdout: "pools": [ 2020-11-16T20:57:36.827 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.827 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 1, 2020-11-16T20:57:36.827 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "device_health_metrics", 2020-11-16T20:57:36.827 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:54:49.109999+0000", 2020-11-16T20:57:36.827 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 1, 2020-11-16T20:57:36.827 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool", 2020-11-16T20:57:36.828 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:57:36.828 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:57:36.828 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:57:36.828 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:57:36.828 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:57:36.828 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:57:36.828 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:57:36.829 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:57:36.829 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:57:36.829 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:57:36.829 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 1, 2020-11-16T20:57:36.829 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 1, 2020-11-16T20:57:36.829 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 1, 2020-11-16T20:57:36.829 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 1, 2020-11-16T20:57:36.830 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 1, 2020-11-16T20:57:36.830 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:57:36.830 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:57:36.830 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:57:36.830 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:57:36.830 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:57:36.830 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:57:36.831 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:57:36.831 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.831 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "15", 2020-11-16T20:57:36.831 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "0", 2020-11-16T20:57:36.831 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-16T20:57:36.831 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "0", 2020-11-16T20:57:36.831 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:57:36.832 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:57:36.832 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 0, 2020-11-16T20:57:36.832 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 0, 2020-11-16T20:57:36.832 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:57:36.832 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:57:36.832 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:57:36.832 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:57:36.832 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:57:36.833 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:57:36.833 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:57:36.833 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:57:36.833 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:57:36.833 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:57:36.833 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:57:36.833 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:57:36.834 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:57:36.834 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:57:36.834 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:57:36.834 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:57:36.834 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:57:36.834 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:57:36.834 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:57:36.835 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.835 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:57:36.835 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:57:36.835 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:57:36.835 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:57:36.835 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:57:36.835 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:57:36.836 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:57:36.836 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:57:36.836 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:57:36.836 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:57:36.836 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:57:36.836 INFO:teuthology.orchestra.run.smithi166.stdout: "options": { 2020-11-16T20:57:36.836 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_min": 1 2020-11-16T20:57:36.836 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.837 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:57:36.837 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_devicehealth": {} 2020-11-16T20:57:36.837 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.837 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.837 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.837 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 2, 2020-11-16T20:57:36.837 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "rbd", 2020-11-16T20:57:36.838 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:54:53.253680+0000", 2020-11-16T20:57:36.838 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 1, 2020-11-16T20:57:36.838 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool", 2020-11-16T20:57:36.838 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:57:36.838 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:57:36.838 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:57:36.839 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:57:36.839 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:57:36.839 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:57:36.839 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:57:36.839 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:57:36.839 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:57:36.840 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:57:36.840 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 18, 2020-11-16T20:57:36.840 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 18, 2020-11-16T20:57:36.840 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 18, 2020-11-16T20:57:36.840 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 18, 2020-11-16T20:57:36.840 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 18, 2020-11-16T20:57:36.840 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:57:36.841 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:57:36.841 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:57:36.841 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:57:36.841 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:57:36.841 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:57:36.841 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:57:36.841 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.841 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "34", 2020-11-16T20:57:36.842 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "0", 2020-11-16T20:57:36.842 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-16T20:57:36.842 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "32", 2020-11-16T20:57:36.842 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:57:36.842 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:57:36.842 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 0, 2020-11-16T20:57:36.842 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 0, 2020-11-16T20:57:36.843 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:57:36.843 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:57:36.843 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:57:36.843 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:57:36.843 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:57:36.843 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:57:36.843 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:57:36.844 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:57:36.844 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:57:36.844 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:57:36.844 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:57:36.844 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:57:36.844 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:57:36.844 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:57:36.845 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:57:36.845 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:57:36.845 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:57:36.845 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:57:36.845 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:57:36.845 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.845 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:57:36.846 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:57:36.846 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:57:36.846 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:57:36.846 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:57:36.846 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:57:36.846 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:57:36.846 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:57:36.847 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:57:36.847 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:57:36.847 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:57:36.847 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:57:36.847 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:57:36.847 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd": {} 2020-11-16T20:57:36.847 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.847 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.848 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.848 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 3, 2020-11-16T20:57:36.848 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "base", 2020-11-16T20:57:36.848 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:55:23.597952+0000", 2020-11-16T20:57:36.848 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 8193, 2020-11-16T20:57:36.848 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2020-11-16T20:57:36.848 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:57:36.849 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:57:36.849 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:57:36.849 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:57:36.849 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:57:36.849 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:57:36.849 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:57:36.849 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:57:36.850 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:57:36.850 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:57:36.850 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 4, 2020-11-16T20:57:36.850 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 4, 2020-11-16T20:57:36.850 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 4, 2020-11-16T20:57:36.850 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 4, 2020-11-16T20:57:36.850 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 4, 2020-11-16T20:57:36.851 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:57:36.851 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:57:36.851 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:57:36.851 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:57:36.851 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:57:36.851 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:57:36.851 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:57:36.851 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.852 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "132", 2020-11-16T20:57:36.852 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "27", 2020-11-16T20:57:36.852 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "27", 2020-11-16T20:57:36.852 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "27", 2020-11-16T20:57:36.852 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:57:36.852 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:57:36.852 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 89, 2020-11-16T20:57:36.853 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 132, 2020-11-16T20:57:36.853 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:57:36.853 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:57:36.853 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:57:36.853 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:57:36.853 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [ 2020-11-16T20:57:36.853 INFO:teuthology.orchestra.run.smithi166.stdout: 4 2020-11-16T20:57:36.854 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:36.854 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:57:36.854 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": 4, 2020-11-16T20:57:36.854 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": 4, 2020-11-16T20:57:36.854 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:57:36.854 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:57:36.854 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:57:36.855 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:57:36.855 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:57:36.855 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:57:36.855 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:57:36.855 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:57:36.855 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:57:36.855 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:57:36.856 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:57:36.856 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.856 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:57:36.856 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:57:36.856 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:57:36.856 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:57:36.856 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:57:36.857 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:57:36.857 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:57:36.857 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:57:36.857 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:57:36.857 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:57:36.857 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:57:36.857 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:57:36.858 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:57:36.858 INFO:teuthology.orchestra.run.smithi166.stdout: "rados": {} 2020-11-16T20:57:36.858 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.858 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.858 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.858 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 4, 2020-11-16T20:57:36.858 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "cache", 2020-11-16T20:57:36.859 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:55:28.901773+0000", 2020-11-16T20:57:36.859 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 8201, 2020-11-16T20:57:36.859 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool,incomplete_clones,selfmanaged_snaps", 2020-11-16T20:57:36.859 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:57:36.859 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:57:36.859 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:57:36.859 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:57:36.860 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:57:36.860 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:57:36.860 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:57:36.860 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:57:36.860 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:57:36.860 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:57:36.860 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 4, 2020-11-16T20:57:36.861 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 4, 2020-11-16T20:57:36.861 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 4, 2020-11-16T20:57:36.861 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 4, 2020-11-16T20:57:36.861 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 4, 2020-11-16T20:57:36.861 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:57:36.861 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:57:36.861 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:57:36.862 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:57:36.862 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:57:36.862 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:57:36.862 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:57:36.862 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.862 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "132", 2020-11-16T20:57:36.862 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "27", 2020-11-16T20:57:36.863 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "27", 2020-11-16T20:57:36.863 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "27", 2020-11-16T20:57:36.863 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:57:36.863 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:57:36.863 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 89, 2020-11-16T20:57:36.863 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 132, 2020-11-16T20:57:36.863 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:57:36.863 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:57:36.864 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:57:36.864 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:57:36.864 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:57:36.864 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": 3, 2020-11-16T20:57:36.864 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:57:36.864 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:57:36.864 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "writeback", 2020-11-16T20:57:36.865 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:57:36.865 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 250, 2020-11-16T20:57:36.865 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:57:36.865 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:57:36.865 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:57:36.865 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:57:36.865 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:57:36.865 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:57:36.866 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:57:36.866 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "bloom", 2020-11-16T20:57:36.866 INFO:teuthology.orchestra.run.smithi166.stdout: "false_positive_probability": 0.050000000000000003, 2020-11-16T20:57:36.866 INFO:teuthology.orchestra.run.smithi166.stdout: "target_size": 0, 2020-11-16T20:57:36.866 INFO:teuthology.orchestra.run.smithi166.stdout: "seed": 0 2020-11-16T20:57:36.866 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.866 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 3600, 2020-11-16T20:57:36.867 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 8, 2020-11-16T20:57:36.867 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:57:36.867 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 2, 2020-11-16T20:57:36.867 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:57:36.867 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:57:36.867 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:57:36.867 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [ 2020-11-16T20:57:36.868 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:57:36.868 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:57:36.868 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:57:36.868 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:57:36.868 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:57:36.868 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:57:36.868 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:57:36.868 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000 2020-11-16T20:57:36.869 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:36.869 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:57:36.869 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:57:36.869 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:57:36.869 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:57:36.869 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": {} 2020-11-16T20:57:36.869 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.870 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:36.870 INFO:teuthology.orchestra.run.smithi166.stdout: "osds": [ 2020-11-16T20:57:36.870 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.870 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 0, 2020-11-16T20:57:36.870 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "35950122-efbd-420e-b07a-f5730f26df17", 2020-11-16T20:57:36.870 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:57:36.870 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:57:36.871 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:57:36.871 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:57:36.871 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:57:36.871 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:57:36.871 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:57:36.871 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 126, 2020-11-16T20:57:36.871 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:57:36.871 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:57:36.872 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:57:36.872 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.872 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.872 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.872 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6800", 2020-11-16T20:57:36.872 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:57:36.872 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.873 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.873 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.873 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:57:36.873 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.873 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.873 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.873 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6802", 2020-11-16T20:57:36.874 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:57:36.874 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.874 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.874 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.874 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:57:36.874 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.874 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.875 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.875 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6806", 2020-11-16T20:57:36.875 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:57:36.875 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.875 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.875 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.875 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:57:36.876 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.876 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.876 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.876 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6804", 2020-11-16T20:57:36.876 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:57:36.876 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.876 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.877 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.877 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6800/35293", 2020-11-16T20:57:36.877 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6802/35293", 2020-11-16T20:57:36.877 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6806/35293", 2020-11-16T20:57:36.877 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6804/35293", 2020-11-16T20:57:36.877 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:57:36.877 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:57:36.877 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:57:36.878 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.878 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.878 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.878 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 1, 2020-11-16T20:57:36.878 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "f768a1ff-3e8a-4131-a6ed-10f93b3ca900", 2020-11-16T20:57:36.878 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:57:36.878 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 0, 2020-11-16T20:57:36.879 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 0, 2020-11-16T20:57:36.879 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:57:36.879 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:57:36.879 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:57:36.879 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:57:36.879 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 125, 2020-11-16T20:57:36.879 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:57:36.880 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:57:36.880 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:57:36.880 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.880 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.880 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.880 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6808", 2020-11-16T20:57:36.880 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:57:36.880 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.881 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.881 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.881 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:57:36.881 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.881 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.881 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.881 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6809", 2020-11-16T20:57:36.882 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:57:36.882 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.882 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.882 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.882 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:57:36.882 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.882 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.883 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.883 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6811", 2020-11-16T20:57:36.883 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:57:36.883 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.883 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.883 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.883 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:57:36.883 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.884 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.884 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.884 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6810", 2020-11-16T20:57:36.884 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:57:36.884 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.884 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.884 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.885 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6808/35323", 2020-11-16T20:57:36.885 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6809/35323", 2020-11-16T20:57:36.885 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6811/35323", 2020-11-16T20:57:36.885 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6810/35323", 2020-11-16T20:57:36.885 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:57:36.885 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:57:36.885 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:57:36.886 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.886 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.886 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.886 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 2, 2020-11-16T20:57:36.886 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "88734179-84a6-4a9b-8af0-692805815875", 2020-11-16T20:57:36.886 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:57:36.886 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:57:36.886 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:57:36.887 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:57:36.887 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:57:36.887 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:57:36.887 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:57:36.887 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 127, 2020-11-16T20:57:36.887 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:57:36.887 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:57:36.888 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:57:36.888 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.888 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.888 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.888 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6801", 2020-11-16T20:57:36.888 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:57:36.888 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.888 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.889 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.889 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:57:36.889 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.889 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.889 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.889 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6803", 2020-11-16T20:57:36.889 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:57:36.890 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.890 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.890 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.890 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:57:36.890 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.890 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.890 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.891 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6807", 2020-11-16T20:57:36.891 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:57:36.891 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.891 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.891 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.891 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:57:36.891 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.892 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.892 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.892 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6805", 2020-11-16T20:57:36.892 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:57:36.892 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.892 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.892 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.892 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6801/35294", 2020-11-16T20:57:36.893 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6803/35294", 2020-11-16T20:57:36.893 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6807/35294", 2020-11-16T20:57:36.893 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6805/35294", 2020-11-16T20:57:36.893 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:57:36.893 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:57:36.893 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:57:36.893 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.894 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.894 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.894 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 3, 2020-11-16T20:57:36.894 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "319e54e8-3f03-4388-8de6-678d148e25d4", 2020-11-16T20:57:36.894 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:57:36.894 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:57:36.894 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:57:36.895 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:57:36.895 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:57:36.895 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:57:36.895 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:57:36.895 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 126, 2020-11-16T20:57:36.895 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:57:36.895 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:57:36.896 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:57:36.896 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.896 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.896 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.896 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6812", 2020-11-16T20:57:36.896 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:57:36.896 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.896 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.897 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.897 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:57:36.897 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.897 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.897 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.897 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6813", 2020-11-16T20:57:36.897 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:57:36.898 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.898 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.898 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.898 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:57:36.898 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.898 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.898 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.899 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6815", 2020-11-16T20:57:36.899 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:57:36.899 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.899 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.899 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.899 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:57:36.899 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.899 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.900 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.900 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6814", 2020-11-16T20:57:36.900 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:57:36.900 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.900 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.900 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.900 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6812/35324", 2020-11-16T20:57:36.901 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6813/35324", 2020-11-16T20:57:36.901 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6815/35324", 2020-11-16T20:57:36.901 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6814/35324", 2020-11-16T20:57:36.901 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:57:36.901 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:57:36.901 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:57:36.901 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.902 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.902 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.902 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 4, 2020-11-16T20:57:36.902 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "3edbb68e-e030-4379-891e-2412f1235ffb", 2020-11-16T20:57:36.902 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:57:36.902 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:57:36.902 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:57:36.903 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:57:36.903 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:57:36.903 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:57:36.903 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:57:36.903 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 123, 2020-11-16T20:57:36.903 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:57:36.903 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:57:36.903 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:57:36.904 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.904 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.904 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.904 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6804", 2020-11-16T20:57:36.904 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:57:36.904 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.904 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.905 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.905 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:57:36.905 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.905 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.905 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.905 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6805", 2020-11-16T20:57:36.905 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:57:36.905 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.906 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.906 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.906 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:57:36.906 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.906 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.906 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.906 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6807", 2020-11-16T20:57:36.907 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:57:36.907 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.907 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.907 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.907 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:57:36.907 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.907 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.908 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.908 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6806", 2020-11-16T20:57:36.908 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:57:36.908 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.908 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.908 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.908 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6804/31586", 2020-11-16T20:57:36.909 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6805/31586", 2020-11-16T20:57:36.909 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6807/31586", 2020-11-16T20:57:36.909 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6806/31586", 2020-11-16T20:57:36.909 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:57:36.909 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:57:36.909 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:57:36.909 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.909 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.910 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.910 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 5, 2020-11-16T20:57:36.910 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "44fbf5ac-4484-48a8-a846-1f5c01a6ec2c", 2020-11-16T20:57:36.910 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:57:36.910 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:57:36.910 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:57:36.910 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:57:36.911 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:57:36.911 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:57:36.911 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:57:36.911 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 126, 2020-11-16T20:57:36.911 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:57:36.911 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:57:36.911 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:57:36.912 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.912 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.912 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.912 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6808", 2020-11-16T20:57:36.912 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:57:36.912 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.912 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.913 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.913 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:57:36.913 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.913 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.913 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.913 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6810", 2020-11-16T20:57:36.913 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:57:36.913 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.914 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.914 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.914 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:57:36.914 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.914 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.914 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.914 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6813", 2020-11-16T20:57:36.915 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:57:36.915 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.915 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.915 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.915 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:57:36.915 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.915 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.916 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.916 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6812", 2020-11-16T20:57:36.916 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:57:36.916 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.916 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.916 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.916 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6808/31610", 2020-11-16T20:57:36.916 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6810/31610", 2020-11-16T20:57:36.917 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6813/31610", 2020-11-16T20:57:36.917 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6812/31610", 2020-11-16T20:57:36.917 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:57:36.917 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:57:36.917 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:57:36.917 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.917 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.918 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.918 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 6, 2020-11-16T20:57:36.918 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "f93b82df-f537-4601-8247-388bf100b5b5", 2020-11-16T20:57:36.918 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:57:36.918 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:57:36.918 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 0.592620849609375, 2020-11-16T20:57:36.918 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:57:36.919 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:57:36.919 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:57:36.919 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:57:36.919 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 34, 2020-11-16T20:57:36.919 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:57:36.919 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:57:36.919 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:57:36.920 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.920 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.920 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.920 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6800", 2020-11-16T20:57:36.920 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:57:36.920 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.920 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.920 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.921 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:57:36.921 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.921 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.921 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.921 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6801", 2020-11-16T20:57:36.921 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:57:36.921 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.922 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.922 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.922 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:57:36.922 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.922 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.922 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.922 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6803", 2020-11-16T20:57:36.923 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:57:36.923 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.923 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.923 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.923 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:57:36.923 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.924 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.924 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.924 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6802", 2020-11-16T20:57:36.924 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:57:36.924 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.924 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.925 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.925 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6800/31587", 2020-11-16T20:57:36.925 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6801/31587", 2020-11-16T20:57:36.925 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6803/31587", 2020-11-16T20:57:36.925 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6802/31587", 2020-11-16T20:57:36.925 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:57:36.925 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:57:36.926 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:57:36.926 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.926 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.926 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.926 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 7, 2020-11-16T20:57:36.926 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "e5485c88-d267-4a6a-b9b6-15d869d28f28", 2020-11-16T20:57:36.927 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:57:36.927 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:57:36.927 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:57:36.927 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:57:36.927 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:57:36.927 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:57:36.927 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:57:36.928 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 123, 2020-11-16T20:57:36.928 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:57:36.928 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:57:36.928 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:57:36.928 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.929 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.929 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.929 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6809", 2020-11-16T20:57:36.929 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:57:36.929 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.930 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.930 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.930 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:57:36.930 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.930 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.930 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.930 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6811", 2020-11-16T20:57:36.931 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:57:36.931 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.931 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.931 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.931 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:57:36.931 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.932 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.932 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.932 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6815", 2020-11-16T20:57:36.932 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:57:36.932 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.932 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.932 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.933 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:57:36.933 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:57:36.933 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.933 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:57:36.933 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6814", 2020-11-16T20:57:36.933 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:57:36.933 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.934 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.934 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.934 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6809/31617", 2020-11-16T20:57:36.934 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6811/31617", 2020-11-16T20:57:36.934 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6815/31617", 2020-11-16T20:57:36.934 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6814/31617", 2020-11-16T20:57:36.934 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:57:36.935 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:57:36.935 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:57:36.935 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.935 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.935 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:36.935 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_xinfo": [ 2020-11-16T20:57:36.935 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.935 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 0, 2020-11-16T20:57:36.936 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:57:36.936 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:57:36.936 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:57:36.936 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:57:36.936 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:57:36.936 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:50.907461+0000", 2020-11-16T20:57:36.936 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:57:36.937 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.937 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.937 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 1, 2020-11-16T20:57:36.937 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:57:36.937 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:57:36.937 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:57:36.937 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:57:36.938 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 65536, 2020-11-16T20:57:36.938 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:50.563693+0000", 2020-11-16T20:57:36.938 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:57:36.938 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.938 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.938 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 2, 2020-11-16T20:57:36.938 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:57:36.938 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:57:36.939 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:57:36.939 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:57:36.939 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:57:36.939 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:50.630147+0000", 2020-11-16T20:57:36.939 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:57:36.939 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.939 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.940 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 3, 2020-11-16T20:57:36.940 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:57:36.940 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:57:36.940 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:57:36.940 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:57:36.940 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:57:36.940 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:51.401993+0000", 2020-11-16T20:57:36.941 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:57:36.941 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.941 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.941 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 4, 2020-11-16T20:57:36.941 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:57:36.941 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:57:36.941 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:57:36.941 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:57:36.942 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:57:36.942 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:50.833464+0000", 2020-11-16T20:57:36.942 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:57:36.942 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.942 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.942 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 5, 2020-11-16T20:57:36.942 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:57:36.943 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:57:36.943 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:57:36.943 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:57:36.943 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:57:36.943 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:52.120480+0000", 2020-11-16T20:57:36.943 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:57:36.943 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.944 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.944 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 6, 2020-11-16T20:57:36.944 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:57:36.944 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:57:36.944 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:57:36.944 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:57:36.944 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:57:36.944 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:51.579262+0000", 2020-11-16T20:57:36.945 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:57:36.945 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.945 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.945 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 7, 2020-11-16T20:57:36.945 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:57:36.945 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:57:36.945 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:57:36.946 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:57:36.946 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:57:36.946 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:56:50.854798+0000", 2020-11-16T20:57:36.946 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:57:36.946 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.946 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:36.946 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_upmap": [ 2020-11-16T20:57:36.947 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.947 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "2.c", 2020-11-16T20:57:36.947 INFO:teuthology.orchestra.run.smithi166.stdout: "osds": [ 2020-11-16T20:57:36.947 INFO:teuthology.orchestra.run.smithi166.stdout: 4, 2020-11-16T20:57:36.947 INFO:teuthology.orchestra.run.smithi166.stdout: 5, 2020-11-16T20:57:36.947 INFO:teuthology.orchestra.run.smithi166.stdout: 6 2020-11-16T20:57:36.947 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.947 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.948 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.948 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "4.0", 2020-11-16T20:57:36.948 INFO:teuthology.orchestra.run.smithi166.stdout: "osds": [ 2020-11-16T20:57:36.948 INFO:teuthology.orchestra.run.smithi166.stdout: 2, 2020-11-16T20:57:36.948 INFO:teuthology.orchestra.run.smithi166.stdout: 1, 2020-11-16T20:57:36.948 INFO:teuthology.orchestra.run.smithi166.stdout: 0 2020-11-16T20:57:36.948 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.949 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.949 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:36.949 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_upmap_items": [ 2020-11-16T20:57:36.949 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.949 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "4.1", 2020-11-16T20:57:36.949 INFO:teuthology.orchestra.run.smithi166.stdout: "mappings": [ 2020-11-16T20:57:36.949 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.950 INFO:teuthology.orchestra.run.smithi166.stdout: "from": 5, 2020-11-16T20:57:36.950 INFO:teuthology.orchestra.run.smithi166.stdout: "to": 3 2020-11-16T20:57:36.950 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.950 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.950 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.950 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.950 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "4.3", 2020-11-16T20:57:36.950 INFO:teuthology.orchestra.run.smithi166.stdout: "mappings": [ 2020-11-16T20:57:36.951 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.951 INFO:teuthology.orchestra.run.smithi166.stdout: "from": 5, 2020-11-16T20:57:36.951 INFO:teuthology.orchestra.run.smithi166.stdout: "to": 7 2020-11-16T20:57:36.951 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.951 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.951 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.951 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:36.952 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_temp": [], 2020-11-16T20:57:36.952 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_temp": [], 2020-11-16T20:57:36.952 INFO:teuthology.orchestra.run.smithi166.stdout: "blocklist": {}, 2020-11-16T20:57:36.952 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profiles": { 2020-11-16T20:57:36.952 INFO:teuthology.orchestra.run.smithi166.stdout: "default": { 2020-11-16T20:57:36.952 INFO:teuthology.orchestra.run.smithi166.stdout: "crush-failure-domain": "osd", 2020-11-16T20:57:36.952 INFO:teuthology.orchestra.run.smithi166.stdout: "k": "2", 2020-11-16T20:57:36.952 INFO:teuthology.orchestra.run.smithi166.stdout: "m": "1", 2020-11-16T20:57:36.953 INFO:teuthology.orchestra.run.smithi166.stdout: "plugin": "jerasure", 2020-11-16T20:57:36.953 INFO:teuthology.orchestra.run.smithi166.stdout: "ruleset-failure-domain": "osd", 2020-11-16T20:57:36.953 INFO:teuthology.orchestra.run.smithi166.stdout: "technique": "reed_sol_van" 2020-11-16T20:57:36.953 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.953 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.953 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps_queue": [ 2020-11-16T20:57:36.953 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.954 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 3, 2020-11-16T20:57:36.954 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:57:36.954 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.954 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 82, 2020-11-16T20:57:36.954 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 2 2020-11-16T20:57:36.954 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.954 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.955 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 88, 2020-11-16T20:57:36.955 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:57:36.955 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.955 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.955 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.955 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.955 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 4, 2020-11-16T20:57:36.956 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:57:36.956 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.956 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 82, 2020-11-16T20:57:36.956 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 2 2020-11-16T20:57:36.956 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.956 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.956 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 88, 2020-11-16T20:57:36.957 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:57:36.957 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.957 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.957 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.957 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:36.957 INFO:teuthology.orchestra.run.smithi166.stdout: "new_removed_snaps": [ 2020-11-16T20:57:36.957 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.957 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 3, 2020-11-16T20:57:36.958 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:57:36.958 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.958 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 88, 2020-11-16T20:57:36.958 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:57:36.958 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.958 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.958 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:36.959 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.959 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 4, 2020-11-16T20:57:36.959 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:57:36.959 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:36.959 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 88, 2020-11-16T20:57:36.959 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:57:36.959 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.959 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:36.960 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.960 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:57:36.960 INFO:teuthology.orchestra.run.smithi166.stdout: "new_purged_snaps": [], 2020-11-16T20:57:36.960 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_node_flags": {}, 2020-11-16T20:57:36.960 INFO:teuthology.orchestra.run.smithi166.stdout: "device_class_flags": {}, 2020-11-16T20:57:36.960 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode": { 2020-11-16T20:57:36.960 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode_enabled": false, 2020-11-16T20:57:36.961 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_bucket_count": 0, 2020-11-16T20:57:36.961 INFO:teuthology.orchestra.run.smithi166.stdout: "degraded_stretch_mode": 0, 2020-11-16T20:57:36.961 INFO:teuthology.orchestra.run.smithi166.stdout: "recovering_stretch_mode": 0, 2020-11-16T20:57:36.961 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode_bucket": 0 2020-11-16T20:57:36.961 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:36.961 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:36.963 INFO:tasks.thrashosds.thrasher:j is {'epoch': 132, 'fsid': 'a14fd848-4cfe-4cd9-9140-5b3c4b4e904d', 'created': '2020-11-16T20:54:44.938121+0000', 'modified': '2020-11-16T20:57:36.749712+0000', 'last_up_change': '2020-11-16T20:54:52.080163+0000', 'last_in_change': '2020-11-16T20:57:27.859480+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 7, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-16T20:54:49.109999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-16T20:54:53.253680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 18, 'pg_placement_num': 18, 'pg_placement_num_target': 18, 'pg_num_target': 18, 'pg_num_pending': 18, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '32', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'base', 'create_time': '2020-11-16T20:55:23.597952+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 4, 'pg_placement_num': 4, 'pg_placement_num_target': 4, 'pg_num_target': 4, 'pg_num_pending': 4, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '132', 'last_force_op_resend': '27', 'last_force_op_resend_prenautilus': '27', 'last_force_op_resend_preluminous': '27', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 89, 'snap_epoch': 132, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [4], 'tier_of': -1, 'read_tier': 4, 'write_tier': 4, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 4, 'pool_name': 'cache', 'create_time': '2020-11-16T20:55:28.901773+0000', 'flags': 8201, 'flags_names': 'hashpspool,incomplete_clones,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 4, 'pg_placement_num': 4, 'pg_placement_num_target': 4, 'pg_num_target': 4, 'pg_num_pending': 4, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '132', 'last_force_op_resend': '27', 'last_force_op_resend_prenautilus': '27', 'last_force_op_resend_preluminous': '27', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 89, 'snap_epoch': 132, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': 3, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'writeback', 'target_max_bytes': 0, 'target_max_objects': 250, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'bloom', 'false_positive_probability': 0.05, 'target_size': 0, 'seed': 0}, 'hit_set_period': 3600, 'hit_set_count': 8, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 2, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [1000000, 1000000, 1000000, 1000000, 1000000, 1000000, 1000000, 1000000], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}}], 'osds': [{'osd': 0, 'uuid': '35950122-efbd-420e-b07a-f5730f26df17', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 126, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6800', 'nonce': 35293}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6802', 'nonce': 35293}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6806', 'nonce': 35293}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6804', 'nonce': 35293}]}, 'public_addr': '172.21.15.166:6800/35293', 'cluster_addr': '172.21.15.166:6802/35293', 'heartbeat_back_addr': '172.21.15.166:6806/35293', 'heartbeat_front_addr': '172.21.15.166:6804/35293', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f768a1ff-3e8a-4131-a6ed-10f93b3ca900', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 125, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6808', 'nonce': 35323}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6809', 'nonce': 35323}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6811', 'nonce': 35323}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6810', 'nonce': 35323}]}, 'public_addr': '172.21.15.166:6808/35323', 'cluster_addr': '172.21.15.166:6809/35323', 'heartbeat_back_addr': '172.21.15.166:6811/35323', 'heartbeat_front_addr': '172.21.15.166:6810/35323', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '88734179-84a6-4a9b-8af0-692805815875', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 127, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6801', 'nonce': 35294}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6803', 'nonce': 35294}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6807', 'nonce': 35294}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6805', 'nonce': 35294}]}, 'public_addr': '172.21.15.166:6801/35294', 'cluster_addr': '172.21.15.166:6803/35294', 'heartbeat_back_addr': '172.21.15.166:6807/35294', 'heartbeat_front_addr': '172.21.15.166:6805/35294', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '319e54e8-3f03-4388-8de6-678d148e25d4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 126, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6812', 'nonce': 35324}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6813', 'nonce': 35324}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6815', 'nonce': 35324}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6814', 'nonce': 35324}]}, 'public_addr': '172.21.15.166:6812/35324', 'cluster_addr': '172.21.15.166:6813/35324', 'heartbeat_back_addr': '172.21.15.166:6815/35324', 'heartbeat_front_addr': '172.21.15.166:6814/35324', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '3edbb68e-e030-4379-891e-2412f1235ffb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 123, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6804', 'nonce': 31586}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6805', 'nonce': 31586}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6807', 'nonce': 31586}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6806', 'nonce': 31586}]}, 'public_addr': '172.21.15.59:6804/31586', 'cluster_addr': '172.21.15.59:6805/31586', 'heartbeat_back_addr': '172.21.15.59:6807/31586', 'heartbeat_front_addr': '172.21.15.59:6806/31586', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '44fbf5ac-4484-48a8-a846-1f5c01a6ec2c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 126, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6808', 'nonce': 31610}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6810', 'nonce': 31610}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6813', 'nonce': 31610}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6812', 'nonce': 31610}]}, 'public_addr': '172.21.15.59:6808/31610', 'cluster_addr': '172.21.15.59:6810/31610', 'heartbeat_back_addr': '172.21.15.59:6813/31610', 'heartbeat_front_addr': '172.21.15.59:6812/31610', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'f93b82df-f537-4601-8247-388bf100b5b5', 'up': 1, 'in': 1, 'weight': 0.592620849609375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6800', 'nonce': 31587}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6801', 'nonce': 31587}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6803', 'nonce': 31587}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6802', 'nonce': 31587}]}, 'public_addr': '172.21.15.59:6800/31587', 'cluster_addr': '172.21.15.59:6801/31587', 'heartbeat_back_addr': '172.21.15.59:6803/31587', 'heartbeat_front_addr': '172.21.15.59:6802/31587', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'e5485c88-d267-4a6a-b9b6-15d869d28f28', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 123, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6809', 'nonce': 31617}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6811', 'nonce': 31617}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6815', 'nonce': 31617}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6814', 'nonce': 31617}]}, 'public_addr': '172.21.15.59:6809/31617', 'cluster_addr': '172.21.15.59:6811/31617', 'heartbeat_back_addr': '172.21.15.59:6815/31617', 'heartbeat_front_addr': '172.21.15.59:6814/31617', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:50.907461+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 65536, 'last_purged_snaps_scrub': '2020-11-16T20:56:50.563693+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:50.630147+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:51.401993+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:50.833464+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:52.120480+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:51.579262+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:56:50.854798+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.c', 'osds': [4, 5, 6]}, {'pgid': '4.0', 'osds': [2, 1, 0]}], 'pg_upmap_items': [{'pgid': '4.1', 'mappings': [{'from': 5, 'to': 3}]}, {'pgid': '4.3', 'mappings': [{'from': 5, 'to': 7}]}], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 82, 'length': 2}, {'begin': 88, 'length': 1}]}, {'pool': 4, 'snaps': [{'begin': 82, 'length': 2}, {'begin': 88, 'length': 1}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 88, 'length': 1}]}, {'pool': 4, 'snaps': [{'begin': 88, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2020-11-16T20:57:36.964 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-16T20:57:36.965 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:36.967+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:37.064 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:37.068+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:37.092 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:37.092 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:37.103 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:57:37.187 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:37.191+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:37.267 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:57:37.272+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:57:37.275 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:37.275 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:37.285 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:57:41.563 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:57:41.572 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:40.946+0000 7f183b791700 -1 osd.4 pg_epoch: 136 pg[3.3( v 134'785 (0'0,134'785] local-lis/les=19/20 n=128 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [4,0,6] r=0 lpr=19 crt=134'785 lcod 134'784 mlcod 134'784 active+clean+snaptrim trimq=[55~1] ps=[52~3,58~1]] removing snap head 2020-11-16T20:57:41.572 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:40.959+0000 7f183b791700 -1 osd.4 pg_epoch: 136 pg[3.3( v 136'789 (0'0,136'789] local-lis/les=19/20 n=126 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [4,0,6] r=0 lpr=19 crt=136'789 lcod 136'787 mlcod 136'787 active+clean+snaptrim trimq=[55~1] ps=[52~3,58~1]] removing snap head 2020-11-16T20:57:41.573 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:41.568+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:41.573 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:57:41.573 INFO:teuthology.orchestra.run.smithi166.stdout:{"pg_ready":true,"pg_map":{"version":207,"stamp":"2020-11-16T20:57:37.104186+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1864241449,"num_objects":670,"num_object_clones":8,"num_object_copies":2010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":573,"num_whiteouts":20,"num_read":2185,"num_read_kb":951528,"num_write":3146,"num_write_kb":1324697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":792,"num_bytes_recovered":1156032848,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":144,"num_flush_kb":403295,"num_evict":70,"num_evict_kb":198766,"num_promote":279,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4664,"ondisk_log_size":4664,"up":81,"acting":81,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":4140908,"kb_used_data":4011604,"kb_used_omap":0,"kb_used_meta":128384,"kb_avail":656461972,"statfs":{"total":676457349120,"available":672217059328,"internally_reserved":0,"allocated":4107882496,"data_stored":4110283418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":131465216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000792"},"pg_stats":[{"pgid":"2.11","version":"0'0","reported_seq":"86","reported_epoch":"126","state":"active+clean","last_fresh":"2020-11-16T20:57:30.891309+0000","last_change":"2020-11-16T20:57:28.881806+0000","last_active":"2020-11-16T20:57:30.891309+0000","last_peered":"2020-11-16T20:57:30.891309+0000","last_clean":"2020-11-16T20:57:30.891309+0000","last_became_active":"2020-11-16T20:57:28.881277+0000","last_became_peered":"2020-11-16T20:57:28.881277+0000","last_unstale":"2020-11-16T20:57:30.891309+0000","last_undegraded":"2020-11-16T20:57:30.891309+0000","last_fullsized":"2020-11-16T20:57:30.891309+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:30.376014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:30.376014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,2],"acting":[4,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"113","reported_epoch":"126","state":"active+clean","last_fresh":"2020-11-16T20:57:30.892679+0000","last_change":"2020-11-16T20:57:28.881722+0000","last_active":"2020-11-16T20:57:30.892679+0000","last_peered":"2020-11-16T20:57:30.892679+0000","last_clean":"2020-11-16T20:57:30.892679+0000","last_became_active":"2020-11-16T20:57:28.881184+0000","last_became_peered":"2020-11-16T20:57:28.881184+0000","last_unstale":"2020-11-16T20:57:30.892679+0000","last_undegraded":"2020-11-16T20:57:30.892679+0000","last_fullsized":"2020-11-16T20:57:30.892679+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.416654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.416654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":"106","reported_epoch":"126","state":"active+clean","last_fresh":"2020-11-16T20:57:30.891720+0000","last_change":"2020-11-16T20:57:28.424551+0000","last_active":"2020-11-16T20:57:30.891720+0000","last_peered":"2020-11-16T20:57:30.891720+0000","last_clean":"2020-11-16T20:57:30.891720+0000","last_became_active":"2020-11-16T20:55:52.922023+0000","last_became_peered":"2020-11-16T20:55:52.922023+0000","last_unstale":"2020-11-16T20:57:30.891720+0000","last_undegraded":"2020-11-16T20:57:30.891720+0000","last_fullsized":"2020-11-16T20:57:30.891720+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:28.424444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:28.424444+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":"38","reported_epoch":"126","state":"active+clean","last_fresh":"2020-11-16T20:57:30.890287+0000","last_change":"2020-11-16T20:57:13.756286+0000","last_active":"2020-11-16T20:57:30.890287+0000","last_peered":"2020-11-16T20:57:30.890287+0000","last_clean":"2020-11-16T20:57:30.890287+0000","last_became_active":"2020-11-16T20:57:06.893046+0000","last_became_peered":"2020-11-16T20:57:06.893046+0000","last_unstale":"2020-11-16T20:57:30.890287+0000","last_undegraded":"2020-11-16T20:57:30.890287+0000","last_fullsized":"2020-11-16T20:57:30.890287+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:13.756223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:13.756223+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"40","reported_epoch":"126","state":"active+clean","last_fresh":"2020-11-16T20:57:30.891550+0000","last_change":"2020-11-16T20:57:28.883444+0000","last_active":"2020-11-16T20:57:30.891550+0000","last_peered":"2020-11-16T20:57:30.891550+0000","last_clean":"2020-11-16T20:57:30.891550+0000","last_became_active":"2020-11-16T20:57:28.882773+0000","last_became_peered":"2020-11-16T20:57:28.882773+0000","last_unstale":"2020-11-16T20:57:30.891550+0000","last_undegraded":"2020-11-16T20:57:30.891550+0000","last_fullsized":"2020-11-16T20:57:30.891550+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:11.940423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:11.940423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"22","reported_epoch":"126","state":"active+clean","last_fresh":"2020-11-16T20:57:31.452433+0000","last_change":"2020-11-16T20:57:31.452433+0000","last_active":"2020-11-16T20:57:31.452433+0000","last_peered":"2020-11-16T20:57:31.452433+0000","last_clean":"2020-11-16T20:57:31.452433+0000","last_became_active":"2020-11-16T20:57:22.852259+0000","last_became_peered":"2020-11-16T20:57:22.852259+0000","last_unstale":"2020-11-16T20:57:31.452433+0000","last_undegraded":"2020-11-16T20:57:31.452433+0000","last_fullsized":"2020-11-16T20:57:31.452433+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:31.452379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:31.452379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"131","reported_epoch":"126","state":"active+clean","last_fresh":"2020-11-16T20:57:30.885057+0000","last_change":"2020-11-16T20:56:02.565668+0000","last_active":"2020-11-16T20:57:30.885057+0000","last_peered":"2020-11-16T20:57:30.885057+0000","last_clean":"2020-11-16T20:57:30.885057+0000","last_became_active":"2020-11-16T20:55:52.917496+0000","last_became_peered":"2020-11-16T20:55:52.917496+0000","last_unstale":"2020-11-16T20:57:30.885057+0000","last_undegraded":"2020-11-16T20:57:30.885057+0000","last_fullsized":"2020-11-16T20:57:30.885057+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:02.565607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:56:02.565607+0000","last_clean_scrub_stamp":"2020-11-16T20:56:02.565607+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"42","reported_epoch":"126","state":"active+clean","last_fresh":"2020-11-16T20:57:30.886067+0000","last_change":"2020-11-16T20:57:28.882375+0000","last_active":"2020-11-16T20:57:30.886067+0000","last_peered":"2020-11-16T20:57:30.886067+0000","last_clean":"2020-11-16T20:57:30.886067+0000","last_became_active":"2020-11-16T20:57:28.881825+0000","last_became_peered":"2020-11-16T20:57:28.881825+0000","last_unstale":"2020-11-16T20:57:30.886067+0000","last_undegraded":"2020-11-16T20:57:30.886067+0000","last_fullsized":"2020-11-16T20:57:30.886067+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:01.955691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:01.955691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,5],"acting":[3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"49","reported_epoch":"126","state":"active+clean","last_fresh":"2020-11-16T20:57:30.891127+0000","last_change":"2020-11-16T20:57:28.884517+0000","last_active":"2020-11-16T20:57:30.891127+0000","last_peered":"2020-11-16T20:57:30.891127+0000","last_clean":"2020-11-16T20:57:30.891127+0000","last_became_active":"2020-11-16T20:57:28.884038+0000","last_became_peered":"2020-11-16T20:57:28.884038+0000","last_unstale":"2020-11-16T20:57:30.891127+0000","last_undegraded":"2020-11-16T20:57:30.891127+0000","last_fullsized":"2020-11-16T20:57:30.891127+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:20.810314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:20.810314+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"152","reported_epoch":"126","state":"active+clean","last_fresh":"2020-11-16T20:57:30.884899+0000","last_change":"2020-11-16T20:57:28.882165+0000","last_active":"2020-11-16T20:57:30.884899+0000","last_peered":"2020-11-16T20:57:30.884899+0000","last_clean":"2020-11-16T20:57:30.884899+0000","last_became_active":"2020-11-16T20:57:28.881606+0000","last_became_peered":"2020-11-16T20:57:28.881606+0000","last_unstale":"2020-11-16T20:57:30.884899+0000","last_undegraded":"2020-11-16T20:57:30.884899+0000","last_fullsized":"2020-11-16T20:57:30.884899+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:11.459190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:11.459190+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"44","reported_epoch":"127","state":"active+clean","last_fresh":"2020-11-16T20:57:31.892205+0000","last_change":"2020-11-16T20:57:31.684983+0000","last_active":"2020-11-16T20:57:31.892205+0000","last_peered":"2020-11-16T20:57:31.892205+0000","last_clean":"2020-11-16T20:57:31.892205+0000","last_became_active":"2020-11-16T20:57:28.882557+0000","last_became_peered":"2020-11-16T20:57:28.882557+0000","last_unstale":"2020-11-16T20:57:31.892205+0000","last_undegraded":"2020-11-16T20:57:31.892205+0000","last_fullsized":"2020-11-16T20:57:31.892205+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:31.684928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:31.684928+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"128'417","reported_seq":"952","reported_epoch":"128","state":"active+clean","last_fresh":"2020-11-16T20:57:32.960007+0000","last_change":"2020-11-16T20:57:31.900061+0000","last_active":"2020-11-16T20:57:32.960007+0000","last_peered":"2020-11-16T20:57:32.960007+0000","last_clean":"2020-11-16T20:57:32.960007+0000","last_became_active":"2020-11-16T20:57:31.898488+0000","last_became_peered":"2020-11-16T20:57:31.898488+0000","last_unstale":"2020-11-16T20:57:32.960007+0000","last_undegraded":"2020-11-16T20:57:32.960007+0000","last_fullsized":"2020-11-16T20:57:32.960007+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'382","last_scrub_stamp":"2020-11-16T20:57:18.780374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:57:18.780374+0000","log_size":417,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123281127,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":6,"num_read":101,"num_read_kb":47654,"num_write":202,"num_write_kb":36174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":77,"num_bytes_recovered":101996064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":38,"num_flush_kb":99037,"num_evict":8,"num_evict_kb":15973,"num_promote":65,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"41","length":"1"},{"start":"48","length":"2"},{"start":"4f","length":"1"}]},{"pgid":"2.2","version":"0'0","reported_seq":"153","reported_epoch":"127","state":"active+clean","last_fresh":"2020-11-16T20:57:31.895198+0000","last_change":"2020-11-16T20:57:28.883622+0000","last_active":"2020-11-16T20:57:31.895198+0000","last_peered":"2020-11-16T20:57:31.895198+0000","last_clean":"2020-11-16T20:57:31.895198+0000","last_became_active":"2020-11-16T20:57:28.882817+0000","last_became_peered":"2020-11-16T20:57:28.882817+0000","last_unstale":"2020-11-16T20:57:31.895198+0000","last_undegraded":"2020-11-16T20:57:31.895198+0000","last_fullsized":"2020-11-16T20:57:31.895198+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:27.458903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:27.458903+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"122'751","reported_seq":"1220","reported_epoch":"126","state":"active+clean","last_fresh":"2020-11-16T20:57:30.891426+0000","last_change":"2020-11-16T20:57:26.866352+0000","last_active":"2020-11-16T20:57:30.891426+0000","last_peered":"2020-11-16T20:57:30.891426+0000","last_clean":"2020-11-16T20:57:30.891426+0000","last_became_active":"2020-11-16T20:55:25.103851+0000","last_became_peered":"2020-11-16T20:55:25.103851+0000","last_unstale":"2020-11-16T20:57:30.891426+0000","last_undegraded":"2020-11-16T20:57:30.891426+0000","last_fullsized":"2020-11-16T20:57:30.891426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'686","last_scrub_stamp":"2020-11-16T20:56:54.448375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:56:54.448375+0000","log_size":751,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":345332234,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":0,"num_read":404,"num_read_kb":115020,"num_write":562,"num_write_kb":287715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"41","length":"1"},{"start":"44","length":"1"},{"start":"48","length":"3"},{"start":"4f","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":"133","reported_epoch":"126","state":"active+clean","last_fresh":"2020-11-16T20:57:30.889844+0000","last_change":"2020-11-16T20:57:18.747236+0000","last_active":"2020-11-16T20:57:30.889844+0000","last_peered":"2020-11-16T20:57:30.889844+0000","last_clean":"2020-11-16T20:57:30.889844+0000","last_became_active":"2020-11-16T20:55:50.905925+0000","last_became_peered":"2020-11-16T20:55:50.905925+0000","last_unstale":"2020-11-16T20:57:30.889844+0000","last_undegraded":"2020-11-16T20:57:30.889844+0000","last_fullsized":"2020-11-16T20:57:30.889844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:18.747156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:18.747156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"125'710","reported_seq":"2099","reported_epoch":"127","state":"peering","last_fresh":"2020-11-16T20:57:31.891339+0000","last_change":"2020-11-16T20:57:31.891668+0000","last_active":"2020-11-16T20:57:31.891339+0000","last_peered":"2020-11-16T20:57:31.004350+0000","last_clean":"2020-11-16T20:57:26.947316+0000","last_became_active":"2020-11-16T20:57:29.910651+0000","last_became_peered":"2020-11-16T20:57:29.910651+0000","last_unstale":"2020-11-16T20:57:31.891339+0000","last_undegraded":"2020-11-16T20:57:31.891339+0000","last_fullsized":"2020-11-16T20:57:31.891339+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:55:23.782254+0000","log_size":710,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":322903162,"num_objects":114,"num_object_clones":3,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":1,"num_read":343,"num_read_kb":88225,"num_write":550,"num_write_kb":281619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":450,"num_bytes_recovered":596961011,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1,6],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"41","length":"1"},{"start":"44","length":"1"},{"start":"48","length":"3"},{"start":"4f","length":"1"}]},{"pgid":"2.3","version":"0'0","reported_seq":"135","reported_epoch":"127","state":"active+clean","last_fresh":"2020-11-16T20:57:31.894893+0000","last_change":"2020-11-16T20:57:12.498318+0000","last_active":"2020-11-16T20:57:31.894893+0000","last_peered":"2020-11-16T20:57:31.894893+0000","last_clean":"2020-11-16T20:57:31.894893+0000","last_became_active":"2020-11-16T20:55:50.903578+0000","last_became_peered":"2020-11-16T20:55:50.903578+0000","last_unstale":"2020-11-16T20:57:31.894893+0000","last_undegraded":"2020-11-16T20:57:31.894893+0000","last_fullsized":"2020-11-16T20:57:31.894893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:12.498241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:12.498241+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"130","reported_epoch":"126","state":"active+clean","last_fresh":"2020-11-16T20:57:30.885012+0000","last_change":"2020-11-16T20:57:28.434051+0000","last_active":"2020-11-16T20:57:30.885012+0000","last_peered":"2020-11-16T20:57:30.885012+0000","last_clean":"2020-11-16T20:57:30.885012+0000","last_became_active":"2020-11-16T20:54:53.112038+0000","last_became_peered":"2020-11-16T20:54:53.112038+0000","last_unstale":"2020-11-16T20:57:30.885012+0000","last_undegraded":"2020-11-16T20:57:30.885012+0000","last_fullsized":"2020-11-16T20:57:30.885012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'2","last_scrub_stamp":"2020-11-16T20:57:28.433971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:50.068882+0000","last_clean_scrub_stamp":"2020-11-16T20:57:28.433971+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"125'676","reported_seq":"1128","reported_epoch":"126","state":"active+clean","last_fresh":"2020-11-16T20:57:30.885955+0000","last_change":"2020-11-16T20:57:26.905604+0000","last_active":"2020-11-16T20:57:30.885955+0000","last_peered":"2020-11-16T20:57:30.885955+0000","last_clean":"2020-11-16T20:57:30.885955+0000","last_became_active":"2020-11-16T20:55:25.106302+0000","last_became_peered":"2020-11-16T20:55:25.106302+0000","last_unstale":"2020-11-16T20:57:30.885955+0000","last_undegraded":"2020-11-16T20:57:30.885955+0000","last_fullsized":"2020-11-16T20:57:30.885955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'549","last_scrub_stamp":"2020-11-16T20:56:39.880955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:56:39.880955+0000","log_size":676,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":304908836,"num_objects":110,"num_object_clones":1,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":365,"num_read_kb":122883,"num_write":523,"num_write_kb":270030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"41","length":"1"},{"start":"44","length":"1"},{"start":"48","length":"3"},{"start":"4f","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":"144","reported_epoch":"126","state":"active+clean","last_fresh":"2020-11-16T20:57:30.885084+0000","last_change":"2020-11-16T20:57:28.882353+0000","last_active":"2020-11-16T20:57:30.885084+0000","last_peered":"2020-11-16T20:57:30.885084+0000","last_clean":"2020-11-16T20:57:30.885084+0000","last_became_active":"2020-11-16T20:57:28.881823+0000","last_became_peered":"2020-11-16T20:57:28.881823+0000","last_unstale":"2020-11-16T20:57:30.885084+0000","last_undegraded":"2020-11-16T20:57:30.885084+0000","last_fullsized":"2020-11-16T20:57:30.885084+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:19.447373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:19.447373+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,3],"acting":[7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"128'815","reported_seq":"1326","reported_epoch":"128","state":"active+clean","last_fresh":"2020-11-16T20:57:32.938329+0000","last_change":"2020-11-16T20:57:26.887689+0000","last_active":"2020-11-16T20:57:32.938329+0000","last_peered":"2020-11-16T20:57:32.938329+0000","last_clean":"2020-11-16T20:57:32.938329+0000","last_became_active":"2020-11-16T20:55:24.802649+0000","last_became_peered":"2020-11-16T20:55:24.802649+0000","last_unstale":"2020-11-16T20:57:32.938329+0000","last_undegraded":"2020-11-16T20:57:32.938329+0000","last_fullsized":"2020-11-16T20:57:32.938329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'650","last_scrub_stamp":"2020-11-16T20:56:37.941529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:56:37.941529+0000","log_size":815,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":384314368,"num_objects":131,"num_object_clones":1,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":506,"num_read_kb":224289,"num_write":641,"num_write_kb":318348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"41","length":"1"},{"start":"44","length":"1"},{"start":"48","length":"3"},{"start":"4f","length":"1"}]},{"pgid":"4.3","version":"127'418","reported_seq":"839","reported_epoch":"127","state":"active+clean","last_fresh":"2020-11-16T20:57:31.915755+0000","last_change":"2020-11-16T20:57:31.898989+0000","last_active":"2020-11-16T20:57:31.915755+0000","last_peered":"2020-11-16T20:57:31.915755+0000","last_clean":"2020-11-16T20:57:31.915755+0000","last_became_active":"2020-11-16T20:57:31.897482+0000","last_became_peered":"2020-11-16T20:57:31.897482+0000","last_unstale":"2020-11-16T20:57:31.915755+0000","last_undegraded":"2020-11-16T20:57:31.915755+0000","last_fullsized":"2020-11-16T20:57:31.915755+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'387","last_scrub_stamp":"2020-11-16T20:57:19.796359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:57:19.796359+0000","log_size":418,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":128694202,"num_objects":47,"num_object_clones":1,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":2,"num_read":156,"num_read_kb":114100,"num_write":238,"num_write_kb":41073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":242421408,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":32,"num_flush_kb":91651,"num_evict":24,"num_evict_kb":68290,"num_promote":72,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"41","length":"1"},{"start":"48","length":"2"},{"start":"4f","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":"135","reported_epoch":"126","state":"active+clean","last_fresh":"2020-11-16T20:57:30.884979+0000","last_change":"2020-11-16T20:57:15.403335+0000","last_active":"2020-11-16T20:57:30.884979+0000","last_peered":"2020-11-16T20:57:30.884979+0000","last_clean":"2020-11-16T20:57:30.884979+0000","last_became_active":"2020-11-16T20:55:50.901014+0000","last_became_peered":"2020-11-16T20:55:50.901014+0000","last_unstale":"2020-11-16T20:57:30.884979+0000","last_undegraded":"2020-11-16T20:57:30.884979+0000","last_fullsized":"2020-11-16T20:57:30.884979+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:15.403250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:15.403250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"23","reported_epoch":"126","state":"active+clean","last_fresh":"2020-11-16T20:57:30.890186+0000","last_change":"2020-11-16T20:57:18.834213+0000","last_active":"2020-11-16T20:57:30.890186+0000","last_peered":"2020-11-16T20:57:30.890186+0000","last_clean":"2020-11-16T20:57:30.890186+0000","last_became_active":"2020-11-16T20:57:18.833699+0000","last_became_peered":"2020-11-16T20:57:18.833699+0000","last_unstale":"2020-11-16T20:57:30.890186+0000","last_undegraded":"2020-11-16T20:57:30.890186+0000","last_fullsized":"2020-11-16T20:57:30.890186+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.950219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.950219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"125'436","reported_seq":"854","reported_epoch":"127","state":"active+clean","last_fresh":"2020-11-16T20:57:31.900300+0000","last_change":"2020-11-16T20:57:31.900300+0000","last_active":"2020-11-16T20:57:31.900300+0000","last_peered":"2020-11-16T20:57:31.900300+0000","last_clean":"2020-11-16T20:57:31.900300+0000","last_became_active":"2020-11-16T20:57:31.898744+0000","last_became_peered":"2020-11-16T20:57:31.898744+0000","last_unstale":"2020-11-16T20:57:31.900300+0000","last_undegraded":"2020-11-16T20:57:31.900300+0000","last_fullsized":"2020-11-16T20:57:31.900300+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'320","last_scrub_stamp":"2020-11-16T20:56:54.815437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:56:54.815437+0000","log_size":436,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":124827833,"num_objects":49,"num_object_clones":1,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":5,"num_read":170,"num_read_kb":138675,"num_write":200,"num_write_kb":41103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":63,"num_bytes_recovered":122901039,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":36,"num_flush_kb":103028,"num_evict":20,"num_evict_kb":59968,"num_promote":72,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"41","length":"1"},{"start":"48","length":"2"},{"start":"4f","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":"134","reported_epoch":"126","state":"active+clean","last_fresh":"2020-11-16T20:57:31.451067+0000","last_change":"2020-11-16T20:57:17.577037+0000","last_active":"2020-11-16T20:57:31.451067+0000","last_peered":"2020-11-16T20:57:31.451067+0000","last_clean":"2020-11-16T20:57:31.451067+0000","last_became_active":"2020-11-16T20:55:50.905649+0000","last_became_peered":"2020-11-16T20:55:50.905649+0000","last_unstale":"2020-11-16T20:57:31.451067+0000","last_undegraded":"2020-11-16T20:57:31.451067+0000","last_fullsized":"2020-11-16T20:57:31.451067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:17.576958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:17.576958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"125'439","reported_seq":"924","reported_epoch":"126","state":"active+clean","last_fresh":"2020-11-16T20:57:30.891954+0000","last_change":"2020-11-16T20:57:26.875767+0000","last_active":"2020-11-16T20:57:30.891954+0000","last_peered":"2020-11-16T20:57:30.891954+0000","last_clean":"2020-11-16T20:57:30.891954+0000","last_became_active":"2020-11-16T20:56:16.750108+0000","last_became_peered":"2020-11-16T20:56:16.750108+0000","last_unstale":"2020-11-16T20:57:30.891954+0000","last_undegraded":"2020-11-16T20:57:30.891954+0000","last_fullsized":"2020-11-16T20:57:30.891954+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'266","last_scrub_stamp":"2020-11-16T20:56:42.351294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:56:42.351294+0000","log_size":439,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":129979687,"num_objects":49,"num_object_clones":1,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":6,"num_read":140,"num_read_kb":100682,"num_write":228,"num_write_kb":48625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":91753326,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":38,"num_flush_kb":109579,"num_evict":18,"num_evict_kb":54535,"num_promote":70,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"41","length":"1"},{"start":"48","length":"2"},{"start":"4f","length":"1"}]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":506782849,"num_objects":193,"num_object_clones":3,"num_object_copies":579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":19,"num_read":567,"num_read_kb":401111,"num_write":868,"num_write_kb":166975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":342,"num_bytes_recovered":559071837,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":144,"num_flush_kb":403295,"num_evict":70,"num_evict_kb":198766,"num_promote":279,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1767071744,"data_stored":1781973422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1710,"ondisk_log_size":1710,"up":12,"acting":12,"num_store_stats":8},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":1357458600,"num_objects":475,"num_object_clones":5,"num_object_copies":1425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":475,"num_whiteouts":1,"num_read":1618,"num_read_kb":550417,"num_write":2276,"num_write_kb":1157712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":450,"num_bytes_recovered":596961011,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2874339328,"data_stored":2868987123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2952,"ondisk_log_size":2952,"up":12,"acting":12,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":18,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243528,"kb_used_data":230464,"kb_used_omap":0,"kb_used_meta":13056,"kb_avail":94128312,"statfs":{"total":96636764160,"available":96387391488,"internally_reserved":0,"allocated":235995136,"data_stored":237719357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13369344},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.96699999999999997,"15min":0.96799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.90000000000000002,"15min":0.91600000000000004},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.252,"5min":1.48,"15min":1.48},"last":1.113}]},{"osd":1,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.93999999999999995,"15min":0.94499999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.03,"5min":0.997,"15min":0.99099999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.1679999999999999}]},{"osd":2,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.97399999999999998,"15min":0.98899999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.994},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.97999999999999998,"15min":0.98299999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.198}]},{"osd":3,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.1279999999999999,"15min":1.1359999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.0620000000000001,"15min":1.0549999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":2.1299999999999999}]},{"osd":4,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.98499999999999999,"15min":0.99299999999999999},"min":{"1min":0.63400000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.387,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.304},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.159,"15min":1.161},"min":{"1min":0.70999999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2,"5min":2,"15min":2},"last":2.488}]},{"osd":5,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.103,"15min":1.107},"min":{"1min":0.71199999999999997,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":2.2509999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.181,"15min":1.1970000000000001},"min":{"1min":0.74299999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.4730000000000001,"5min":1.583,"15min":1.583},"last":1.569}]},{"osd":6,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.264,"15min":1.25},"min":{"1min":0.89300000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.927},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.359,"15min":1.375},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":2.3730000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":759148,"kb_used_data":737700,"kb_used_omap":0,"kb_used_meta":21440,"kb_avail":93612692,"statfs":{"total":96636764160,"available":95859396608,"internally_reserved":0,"allocated":755404800,"data_stored":754188994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21954560},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.94899999999999995,"15min":0.95299999999999996},"min":{"1min":0.55500000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.421,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.2809999999999999},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.93300000000000005,"15min":0.93000000000000005},"min":{"1min":0.62,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.66600000000000004}]},{"osd":1,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.018,"15min":1.016},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.4650000000000001,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":0.96399999999999997,"15min":0.94099999999999995},"min":{"1min":0.64900000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.413}]},{"osd":2,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.86399999999999999,"15min":0.872},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.748},{"interface":"front","average":{"1min":1.083,"5min":1.123,"15min":1.1299999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.6559999999999999,"5min":1.897,"15min":1.897},"last":0.78100000000000003}]},{"osd":3,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.089,"15min":1.103},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.369,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1259999999999999,"15min":1.123},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.4730000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.0660000000000001}]},{"osd":4,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.129,"15min":1.1419999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.7390000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1759999999999999,"15min":1.1799999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.093}]},{"osd":5,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0920000000000001,"15min":1.1020000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.327,"5min":1.4339999999999999,"15min":1.452},"min":{"1min":1.0860000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":1.901,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.591}]},{"osd":7,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.3009999999999999,"15min":1.3100000000000001},"min":{"1min":0.96799999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.1830000000000001}]}]},{"osd":1,"up_from":0,"seq":55834574882,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1014980,"kb_used_data":989628,"kb_used_omap":0,"kb_used_meta":25344,"kb_avail":93356860,"statfs":{"total":96636764160,"available":95597424640,"internally_reserved":0,"allocated":1013379072,"data_stored":1016261317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25952256},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 16 20:56:55 2020","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.71999999999999997,"15min":0.73099999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0249999999999999,"5min":1.05,"15min":1.05},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.877,"15min":0.873},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.7269999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":0.876}]},{"osd":2,"last update":"Mon Nov 16 20:56:55 2020","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.75900000000000001,"15min":0.77600000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.86799999999999999,"15min":0.877},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.66700000000000004}]},{"osd":3,"last update":"Mon Nov 16 20:56:55 2020","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.92300000000000004,"15min":0.93700000000000006},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.93700000000000006,"15min":0.95499999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.97799999999999998}]},{"osd":4,"last update":"Mon Nov 16 20:56:55 2020","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.145,"15min":1.137},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":3.3100000000000001,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":1.02},{"interface":"front","average":{"1min":1.075,"5min":1.216,"15min":1.24},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.2290000000000001}]},{"osd":5,"last update":"Mon Nov 16 20:56:55 2020","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2929999999999999,"15min":1.3049999999999999},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.1799999999999999,"15min":1.1879999999999999},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.198}]},{"osd":6,"last update":"Mon Nov 16 20:56:55 2020","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.236,"15min":1.2549999999999999},"min":{"1min":0.79100000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.3240000000000001,"15min":1.3360000000000001},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.5670000000000002,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":1.0940000000000001}]},{"osd":7,"last update":"Mon Nov 16 20:56:55 2020","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.3799999999999999,"15min":1.3999999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.365,"15min":1.3919999999999999},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.2309999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.325}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":324032,"kb_used_data":311096,"kb_used_omap":0,"kb_used_meta":12928,"kb_avail":94047808,"statfs":{"total":96636764160,"available":96304955392,"internally_reserved":0,"allocated":318562304,"data_stored":318276276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13238272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:56:52 2020","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.72199999999999998,"15min":0.69999999999999996},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.78000000000000003,"15min":0.75800000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.758,"5min":2.758,"15min":2.758},"last":0.60699999999999998}]},{"osd":1,"last update":"Mon Nov 16 20:56:52 2020","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.84799999999999998,"15min":0.83399999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":3.3090000000000002,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.052,"5min":0.90600000000000003,"15min":0.88200000000000001},"min":{"1min":0.61799999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.3580000000000001,"5min":3.3580000000000001,"15min":3.3580000000000001},"last":0.751}]},{"osd":3,"last update":"Mon Nov 16 20:56:53 2020","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.751,"15min":0.73699999999999999},"min":{"1min":0.53600000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.90500000000000003,"15min":0.89100000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.95399999999999996}]},{"osd":4,"last update":"Mon Nov 16 20:56:52 2020","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1259999999999999,"15min":1.1279999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4379999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.165,"15min":1.143},"min":{"1min":0.82299999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.80800000000000005}]},{"osd":5,"last update":"Mon Nov 16 20:56:52 2020","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.157,"15min":1.145},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.173,"15min":1.1699999999999999},"min":{"1min":0.77100000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.90300000000000002}]},{"osd":6,"last update":"Mon Nov 16 20:56:52 2020","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.113,"15min":1.1000000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.26,"5min":1.208,"15min":1.2},"min":{"1min":0.93300000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.016}]},{"osd":7,"last update":"Mon Nov 16 20:56:52 2020","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2490000000000001,"15min":1.2529999999999999},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.2809999999999999,"15min":1.2789999999999999},"min":{"1min":0.91600000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.79,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.036}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":675276,"kb_used_data":654596,"kb_used_omap":0,"kb_used_meta":20672,"kb_avail":93696564,"statfs":{"total":96636764160,"available":95945281536,"internally_reserved":0,"allocated":670306304,"data_stored":671165336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21168128},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:56:53 2020","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.65200000000000002,"15min":0.65400000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.621},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.67500000000000004,"15min":0.67900000000000005},"min":{"1min":0.52600000000000002,"5min":0.495,"15min":0.495},"max":{"1min":0.93200000000000005,"5min":0.996,"15min":0.996},"last":0.55200000000000005}]},{"osd":1,"last update":"Mon Nov 16 20:56:53 2020","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.79100000000000004,"15min":0.81000000000000005},"min":{"1min":0.47699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1850000000000001,"5min":2.105,"15min":2.105},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.93500000000000005,"15min":0.95699999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2450000000000001,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.74199999999999999}]},{"osd":2,"last update":"Mon Nov 16 20:56:53 2020","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.93200000000000005,"15min":0.95399999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3160000000000001,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0129999999999999,"15min":1.0209999999999999},"min":{"1min":0.73299999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4379999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.85899999999999999}]},{"osd":4,"last update":"Mon Nov 16 20:56:53 2020","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.117,"15min":1.1359999999999999},"min":{"1min":0.73499999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.6779999999999999,"5min":2.923,"15min":2.923},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.165,"15min":1.173},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.016,"5min":2.968,"15min":2.968},"last":1.2250000000000001}]},{"osd":5,"last update":"Mon Nov 16 20:56:53 2020","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.2450000000000001,"15min":1.2729999999999999},"min":{"1min":0.76200000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.1789999999999998,"5min":2.8479999999999999,"15min":2.8479999999999999},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.121,"15min":1.111},"min":{"1min":0.89200000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.0760000000000001}]},{"osd":6,"last update":"Mon Nov 16 20:56:53 2020","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.218,"15min":1.2450000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.4430000000000001,"5min":2.859,"15min":2.859},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.3899999999999999,"15min":1.4239999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.2890000000000001,"5min":3.5390000000000001,"15min":3.5390000000000001},"last":1.113}]},{"osd":7,"last update":"Mon Nov 16 20:56:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.296,"15min":1.3129999999999999},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.512,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.2849999999999999,"15min":1.3109999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.538,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":1.282}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":697176,"kb_used_data":676448,"kb_used_omap":0,"kb_used_meta":20288,"kb_avail":93674664,"statfs":{"total":96636764160,"available":95922855936,"internally_reserved":0,"allocated":692682752,"data_stored":689963135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20774912},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.077,"15min":1.075},"min":{"1min":0.70099999999999996,"5min":0.629,"15min":0.629},"max":{"1min":1.5229999999999999,"5min":1.571,"15min":1.571},"last":0.84399999999999997}]},{"osd":1,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.873,"15min":0.877},"min":{"1min":0.52700000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1879999999999999,"5min":1.196,"15min":1.196},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.871,"15min":0.86899999999999999},"min":{"1min":0.58799999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3200000000000001,"5min":1.331,"15min":1.331},"last":0.72399999999999998}]},{"osd":2,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.022,"15min":1.0269999999999999},"min":{"1min":0.70999999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2889999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.0429999999999999,"15min":1.0609999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.306,"5min":1.609,"15min":1.609},"last":1.038}]},{"osd":3,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0209999999999999,"15min":1.024},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.90600000000000003,"5min":1.135,"15min":1.173},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1619999999999999,"5min":1.528,"15min":1.528},"last":0.82499999999999996}]},{"osd":5,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.0680000000000001,"15min":1.091},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.419,"5min":1.643,"15min":1.643},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.163,"5min":1.1990000000000001,"15min":1.2050000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.6519999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.94699999999999995}]},{"osd":6,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.1419999999999999,"15min":1.163},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.2889999999999999,"15min":1.304},"min":{"1min":0.93899999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.6379999999999999,"5min":1.79,"15min":1.79},"last":1.131}]},{"osd":7,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.4059999999999999,"15min":1.421},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":1.827,"5min":2.4369999999999998,"15min":2.4369999999999998},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.198,"5min":1.383,"15min":1.4139999999999999},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.5509999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.97099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":426768,"kb_used_data":411672,"kb_used_omap":0,"kb_used_meta":14656,"kb_avail":93945072,"statfs":{"total":96636764160,"available":96199753728,"internally_reserved":0,"allocated":421552128,"data_stored":422709003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15007744},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.89500000000000002,"15min":0.89100000000000001},"min":{"1min":0.58899999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":1.032},{"interface":"front","average":{"1min":0.879,"5min":0.90400000000000003,"15min":0.90800000000000003},"min":{"1min":0.505,"5min":0.497,"15min":0.497},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.91100000000000003}]},{"osd":1,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.93999999999999995,"15min":0.94999999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.95599999999999996,"15min":0.95699999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.86499999999999999}]},{"osd":2,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0149999999999999,"15min":1.0189999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.3340000000000001}]},{"osd":3,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.052,"15min":1.0569999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.165},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.153,"15min":1.1519999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.3560000000000001}]},{"osd":4,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0389999999999999,"15min":1.0269999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1679999999999999,"15min":1.1819999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.252}]},{"osd":6,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.2010000000000001,"15min":1.21},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.272},{"interface":"front","average":{"1min":1.272,"5min":1.333,"15min":1.343},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.1950000000000001}]},{"osd":7,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":1.454},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.4239999999999999,"15min":1.4430000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7949999999999999,"5min":1.909,"15min":1.909},"last":1.4179999999999999}]}]}]}} 2020-11-16T20:57:41.575 INFO:teuthology.orchestra.run.smithi166.stderr:dumped all 2020-11-16T20:57:41.577 INFO:tasks.thrashosds.thrasher:Setting 4.3 to [4, 3, 2] 2020-11-16T20:57:41.577 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.3', '4', '3', '2'] 2020-11-16T20:57:41.577 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.3 4 3 2 2020-11-16T20:57:41.578 INFO:tasks.rados.rados.0.smithi166.stdout:1088: done (0 left) 2020-11-16T20:57:41.578 INFO:tasks.rados.rados.0.smithi166.stdout:1089: copy_from oid 270 from oid 264 current snap is 45 2020-11-16T20:57:41.578 INFO:tasks.rados.rados.0.smithi166.stdout:1090: cache_try_flush oid 394 snap -1 2020-11-16T20:57:41.578 INFO:tasks.rados.rados.0.smithi166.stdout:1091: copy_from oid 415 from oid 117 current snap is 45 2020-11-16T20:57:41.579 INFO:tasks.rados.rados.0.smithi166.stdout:1092: read oid 46 snap -1 2020-11-16T20:57:41.579 INFO:tasks.rados.rados.0.smithi166.stdout:1092: expect (ObjNum 377 snap 0 seq_num 377) 2020-11-16T20:57:41.579 INFO:tasks.rados.rados.0.smithi166.stdout:1093: rollback oid 290 current snap is 45 2020-11-16T20:57:41.579 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 290 to 43 2020-11-16T20:57:41.579 INFO:tasks.rados.rados.0.smithi166.stdout:1094: cache_flush oid 84 snap -1 2020-11-16T20:57:41.579 INFO:tasks.rados.rados.0.smithi166.stdout:1095: write (excl) oid 69 current snap is 45 2020-11-16T20:57:41.579 INFO:tasks.rados.rados.0.smithi166.stdout:1095: seq_num 654 ranges {591778=419204,1637106=741879,2910049=81729} 2020-11-16T20:57:41.580 INFO:tasks.rados.rados.0.smithi166.stdout:1095: writing smithi16641208-69 from 591778 to 1010982 tid 1 2020-11-16T20:57:41.580 INFO:tasks.rados.rados.0.smithi166.stdout:1095: writing smithi16641208-69 from 1637106 to 2378985 tid 2 2020-11-16T20:57:41.580 INFO:tasks.rados.rados.0.smithi166.stdout:1095: writing smithi16641208-69 from 2910049 to 2991778 tid 3 2020-11-16T20:57:41.580 INFO:tasks.rados.rados.0.smithi166.stdout:1096: write oid 289 current snap is 45 2020-11-16T20:57:41.580 INFO:tasks.rados.rados.0.smithi166.stdout:1096: seq_num 655 ranges {608585=494453,1579235=601890,2821119=187466} 2020-11-16T20:57:41.580 INFO:tasks.rados.rados.0.smithi166.stdout:1096: writing smithi16641208-289 from 608585 to 1103038 tid 1 2020-11-16T20:57:41.580 INFO:tasks.rados.rados.0.smithi166.stdout:1096: writing smithi16641208-289 from 1579235 to 2181125 tid 2 2020-11-16T20:57:41.581 INFO:tasks.rados.rados.0.smithi166.stdout:1096: writing smithi16641208-289 from 2821119 to 3008585 tid 3 2020-11-16T20:57:41.581 INFO:tasks.rados.rados.0.smithi166.stdout:1097: cache_flush oid 500 snap 43 2020-11-16T20:57:41.581 INFO:tasks.rados.rados.0.smithi166.stdout:1098: delete oid 220 current snap is 45 2020-11-16T20:57:41.581 INFO:tasks.rados.rados.0.smithi166.stdout:1090: got (2) No such file or directory 2020-11-16T20:57:41.581 INFO:tasks.rados.rados.0.smithi166.stdout:1092: expect (ObjNum 377 snap 0 seq_num 377) 2020-11-16T20:57:41.581 INFO:tasks.rados.rados.0.smithi166.stdout:1094: got (2) No such file or directory 2020-11-16T20:57:41.581 INFO:tasks.rados.rados.0.smithi166.stdout:1093: finishing rollback tid 0 to smithi16641208-290 2020-11-16T20:57:41.582 INFO:tasks.rados.rados.0.smithi166.stdout:1095: finishing write tid 1 to smithi16641208-69 2020-11-16T20:57:41.582 INFO:tasks.rados.rados.0.smithi166.stdout:1095: finishing write tid 2 to smithi16641208-69 2020-11-16T20:57:41.582 INFO:tasks.rados.rados.0.smithi166.stdout:1090: done (9 left) 2020-11-16T20:57:41.582 INFO:tasks.rados.rados.0.smithi166.stdout:1092: done (8 left) 2020-11-16T20:57:41.582 INFO:tasks.rados.rados.0.smithi166.stdout:1094: done (7 left) 2020-11-16T20:57:41.582 INFO:tasks.rados.rados.0.smithi166.stdout:1098: done (6 left) 2020-11-16T20:57:41.582 INFO:tasks.rados.rados.0.smithi166.stdout:1099: write oid 417 current snap is 45 2020-11-16T20:57:41.583 INFO:tasks.rados.rados.0.smithi166.stdout:1095: finishing write tid 3 to smithi16641208-69 2020-11-16T20:57:41.583 INFO:tasks.rados.rados.0.smithi166.stdout:1095: finishing write tid 4 to smithi16641208-69 2020-11-16T20:57:41.583 INFO:tasks.rados.rados.0.smithi166.stdout:1099: seq_num 657 ranges {642199=644951,1696199=605559,2992318=49881} 2020-11-16T20:57:41.583 INFO:tasks.rados.rados.0.smithi166.stdout:1099: writing smithi16641208-417 from 642199 to 1287150 tid 1 2020-11-16T20:57:41.583 INFO:tasks.rados.rados.0.smithi166.stdout:1099: writing smithi16641208-417 from 1696199 to 2301758 tid 2 2020-11-16T20:57:41.583 INFO:tasks.rados.rados.0.smithi166.stdout:1099: writing smithi16641208-417 from 2992318 to 3042199 tid 3 2020-11-16T20:57:41.583 INFO:tasks.rados.rados.0.smithi166.stdout:1100: delete oid 173 current snap is 45 2020-11-16T20:57:41.584 INFO:tasks.rados.rados.0.smithi166.stdout:1095: finishing write tid 5 to smithi16641208-69 2020-11-16T20:57:41.584 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 69 v 748 (ObjNum 654 snap 45 seq_num 654) dirty exists 2020-11-16T20:57:41.584 INFO:tasks.rados.rados.0.smithi166.stdout:1095: left oid 69 (ObjNum 654 snap 45 seq_num 654) 2020-11-16T20:57:41.584 INFO:tasks.rados.rados.0.smithi166.stdout:1091: finishing copy_from to smithi16641208-415 2020-11-16T20:57:41.584 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 415 v 72 (ObjNum 116 snap 0 seq_num 116) dirty exists 2020-11-16T20:57:41.584 INFO:tasks.rados.rados.0.smithi166.stdout:1096: finishing write tid 1 to smithi16641208-289 2020-11-16T20:57:41.584 INFO:tasks.rados.rados.0.smithi166.stdout:1096: finishing write tid 2 to smithi16641208-289 2020-11-16T20:57:41.584 INFO:tasks.rados.rados.0.smithi166.stdout:1096: finishing write tid 3 to smithi16641208-289 2020-11-16T20:57:41.585 INFO:tasks.rados.rados.0.smithi166.stdout:1096: finishing write tid 4 to smithi16641208-289 2020-11-16T20:57:41.585 INFO:tasks.rados.rados.0.smithi166.stdout:1096: finishing write tid 5 to smithi16641208-289 2020-11-16T20:57:41.585 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 289 v 685 (ObjNum 655 snap 45 seq_num 655) dirty exists 2020-11-16T20:57:41.585 INFO:tasks.rados.rados.0.smithi166.stdout:1096: left oid 289 (ObjNum 655 snap 45 seq_num 655) 2020-11-16T20:57:41.585 INFO:tasks.rados.rados.0.smithi166.stdout:1097: got (2) No such file or directory 2020-11-16T20:57:41.585 INFO:tasks.rados.rados.0.smithi166.stdout:1093: finishing rollback tid 1 to smithi16641208-290 2020-11-16T20:57:41.585 INFO:tasks.rados.rados.0.smithi166.stdout:1093: finishing rollback tid 2 to smithi16641208-290 2020-11-16T20:57:41.586 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 290 v 768 (ObjNum 289 snap 0 seq_num 289) dirty exists 2020-11-16T20:57:41.586 INFO:tasks.rados.rados.0.smithi166.stdout:1091: finishing copy_from racing read to smithi16641208-415 2020-11-16T20:57:41.586 INFO:tasks.rados.rados.0.smithi166.stdout:1099: finishing write tid 1 to smithi16641208-417 2020-11-16T20:57:41.586 INFO:tasks.rados.rados.0.smithi166.stdout:1091: done (7 left) 2020-11-16T20:57:41.586 INFO:tasks.rados.rados.0.smithi166.stdout:1093: done (6 left) 2020-11-16T20:57:41.586 INFO:tasks.rados.rados.0.smithi166.stdout:1095: done (5 left) 2020-11-16T20:57:41.586 INFO:tasks.rados.rados.0.smithi166.stdout:1096: done (4 left) 2020-11-16T20:57:41.587 INFO:tasks.rados.rados.0.smithi166.stdout:1097: done (3 left) 2020-11-16T20:57:41.587 INFO:tasks.rados.rados.0.smithi166.stdout:1100: done (2 left) 2020-11-16T20:57:41.587 INFO:tasks.rados.rados.0.smithi166.stdout:1101: copy_from oid 151 from oid 285 current snap is 45 2020-11-16T20:57:41.587 INFO:tasks.rados.rados.0.smithi166.stdout:1102: read oid 483 snap 43 2020-11-16T20:57:41.587 INFO:tasks.rados.rados.0.smithi166.stdout:1102: expect (ObjNum 537 snap 11 seq_num 537) 2020-11-16T20:57:41.587 INFO:tasks.rados.rados.0.smithi166.stdout:1103: write oid 447 current snap is 45 2020-11-16T20:57:41.587 INFO:tasks.rados.rados.0.smithi166.stdout:1103: seq_num 659 ranges {675813=795449,2096810=609228} 2020-11-16T20:57:41.587 INFO:tasks.rados.rados.0.smithi166.stdout:1103: writing smithi16641208-447 from 675813 to 1471262 tid 1 2020-11-16T20:57:41.588 INFO:tasks.rados.rados.0.smithi166.stdout:1103: writing smithi16641208-447 from 2096810 to 2706038 tid 2 2020-11-16T20:57:41.588 INFO:tasks.rados.rados.0.smithi166.stdout:1104: rollback oid 144 current snap is 45 2020-11-16T20:57:41.588 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 144 to 43 2020-11-16T20:57:41.588 INFO:tasks.rados.rados.0.smithi166.stdout:1105: write oid 482 current snap is 45 2020-11-16T20:57:41.588 INFO:tasks.rados.rados.0.smithi166.stdout:1099: finishing write tid 2 to smithi16641208-417 2020-11-16T20:57:41.588 INFO:tasks.rados.rados.0.smithi166.stdout:1099: finishing write tid 3 to smithi16641208-417 2020-11-16T20:57:41.588 INFO:tasks.rados.rados.0.smithi166.stdout:1099: finishing write tid 4 to smithi16641208-417 2020-11-16T20:57:41.589 INFO:tasks.rados.rados.0.smithi166.stdout:1099: finishing write tid 5 to smithi16641208-417 2020-11-16T20:57:41.589 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 417 v 690 (ObjNum 657 snap 45 seq_num 657) dirty exists 2020-11-16T20:57:41.589 INFO:tasks.rados.rados.0.smithi166.stdout:1099: left oid 417 (ObjNum 657 snap 45 seq_num 657) 2020-11-16T20:57:41.589 INFO:tasks.rados.rados.0.smithi166.stdout:1105: seq_num 660 ranges {692620=470698,1755292=752886} 2020-11-16T20:57:41.589 INFO:tasks.rados.rados.0.smithi166.stdout:1105: writing smithi16641208-482 from 692620 to 1163318 tid 1 2020-11-16T20:57:41.589 INFO:tasks.rados.rados.0.smithi166.stdout:1105: writing smithi16641208-482 from 1755292 to 2508178 tid 2 2020-11-16T20:57:41.589 INFO:tasks.rados.rados.0.smithi166.stdout:1099: done (6 left) 2020-11-16T20:57:41.589 INFO:tasks.rados.rados.0.smithi166.stdout:1106: cache_evict oid 165 snap -1 2020-11-16T20:57:41.590 INFO:tasks.rados.rados.0.smithi166.stdout:1101: finishing copy_from to smithi16641208-151 2020-11-16T20:57:41.590 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 151 v 197 (ObjNum 284 snap 0 seq_num 284) dirty exists 2020-11-16T20:57:41.590 INFO:tasks.rados.rados.0.smithi166.stdout:1102: expect (ObjNum 537 snap 11 seq_num 537) 2020-11-16T20:57:41.590 INFO:tasks.rados.rados.0.smithi166.stdout:1102: done (6 left) 2020-11-16T20:57:41.590 INFO:tasks.rados.rados.0.smithi166.stdout:1107: snap_create 2020-11-16T20:57:41.590 INFO:tasks.rados.rados.0.smithi166.stdout:1106: got (2) No such file or directory 2020-11-16T20:57:41.590 INFO:tasks.rados.rados.0.smithi166.stdout:1103: finishing write tid 1 to smithi16641208-447 2020-11-16T20:57:41.591 INFO:tasks.rados.rados.0.smithi166.stdout:1101: finishing copy_from racing read to smithi16641208-151 2020-11-16T20:57:41.591 INFO:tasks.rados.rados.0.smithi166.stdout:1104: finishing rollback tid 0 to smithi16641208-144 2020-11-16T20:57:41.591 INFO:tasks.rados.rados.0.smithi166.stdout:1105: finishing write tid 1 to smithi16641208-482 2020-11-16T20:57:41.591 INFO:tasks.rados.rados.0.smithi166.stdout:1105: finishing write tid 2 to smithi16641208-482 2020-11-16T20:57:41.591 INFO:tasks.rados.rados.0.smithi166.stdout:1105: finishing write tid 3 to smithi16641208-482 2020-11-16T20:57:41.591 INFO:tasks.rados.rados.0.smithi166.stdout:1105: finishing write tid 4 to smithi16641208-482 2020-11-16T20:57:41.591 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 482 v 833 (ObjNum 660 snap 45 seq_num 660) dirty exists 2020-11-16T20:57:41.592 INFO:tasks.rados.rados.0.smithi166.stdout:1105: left oid 482 (ObjNum 660 snap 45 seq_num 660) 2020-11-16T20:57:41.592 INFO:tasks.rados.rados.0.smithi166.stdout:1103: finishing write tid 2 to smithi16641208-447 2020-11-16T20:57:41.592 INFO:tasks.rados.rados.0.smithi166.stdout:1103: finishing write tid 3 to smithi16641208-447 2020-11-16T20:57:41.592 INFO:tasks.rados.rados.0.smithi166.stdout:1103: finishing write tid 4 to smithi16641208-447 2020-11-16T20:57:41.592 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 447 v 772 (ObjNum 659 snap 45 seq_num 659) dirty exists 2020-11-16T20:57:41.592 INFO:tasks.rados.rados.0.smithi166.stdout:1103: left oid 447 (ObjNum 659 snap 45 seq_num 659) 2020-11-16T20:57:41.592 INFO:tasks.rados.rados.0.smithi166.stdout:1104: finishing rollback tid 1 to smithi16641208-144 2020-11-16T20:57:41.592 INFO:tasks.rados.rados.0.smithi166.stdout:1104: finishing rollback tid 2 to smithi16641208-144 2020-11-16T20:57:41.593 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 144 v 775 (ObjNum 103 snap 0 seq_num 103) dirty exists 2020-11-16T20:57:41.593 INFO:tasks.rados.rados.0.smithi166.stdout:1089: finishing copy_from to smithi16641208-270 2020-11-16T20:57:41.593 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 270 v 138 (ObjNum 263 snap 0 seq_num 263) dirty exists 2020-11-16T20:57:41.593 INFO:tasks.rados.rados.0.smithi166.stdout:1089: finishing copy_from racing read to smithi16641208-270 2020-11-16T20:57:41.593 INFO:tasks.rados.rados.0.smithi166.stdout:1089: done (6 left) 2020-11-16T20:57:41.593 INFO:tasks.rados.rados.0.smithi166.stdout:1101: done (5 left) 2020-11-16T20:57:41.593 INFO:tasks.rados.rados.0.smithi166.stdout:1103: done (4 left) 2020-11-16T20:57:41.594 INFO:tasks.rados.rados.0.smithi166.stdout:1104: done (3 left) 2020-11-16T20:57:41.594 INFO:tasks.rados.rados.0.smithi166.stdout:1105: done (2 left) 2020-11-16T20:57:41.594 INFO:tasks.rados.rados.0.smithi166.stdout:1106: done (1 left) 2020-11-16T20:57:41.594 INFO:tasks.rados.rados.0.smithi166.stdout:1107: done (0 left) 2020-11-16T20:57:41.594 INFO:tasks.rados.rados.0.smithi166.stdout:1108: cache_try_flush oid 391 snap -1 2020-11-16T20:57:41.594 INFO:tasks.rados.rados.0.smithi166.stdout:1109: rollback oid 287 current snap is 46 2020-11-16T20:57:41.594 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 287 to 43 2020-11-16T20:57:41.594 INFO:tasks.rados.rados.0.smithi166.stdout:1110: write (excl) oid 261 current snap is 46 2020-11-16T20:57:41.595 INFO:tasks.rados.rados.0.smithi166.stdout:1110: seq_num 661 ranges {709427=545947,1813774=612897,2985657=123770} 2020-11-16T20:57:41.595 INFO:tasks.rados.rados.0.smithi166.stdout:1110: writing smithi16641208-261 from 709427 to 1255374 tid 1 2020-11-16T20:57:41.595 INFO:tasks.rados.rados.0.smithi166.stdout:1110: writing smithi16641208-261 from 1813774 to 2426671 tid 2 2020-11-16T20:57:41.595 INFO:tasks.rados.rados.0.smithi166.stdout:1110: writing smithi16641208-261 from 2985657 to 3109427 tid 3 2020-11-16T20:57:41.595 INFO:tasks.rados.rados.0.smithi166.stdout:1111: cache_try_flush oid 370 snap -1 2020-11-16T20:57:41.595 INFO:tasks.rados.rados.0.smithi166.stdout:1108: got (2) No such file or directory 2020-11-16T20:57:41.595 INFO:tasks.rados.rados.0.smithi166.stdout:1109: finishing rollback tid 0 to smithi16641208-287 2020-11-16T20:57:41.596 INFO:tasks.rados.rados.0.smithi166.stdout:1110: finishing write tid 1 to smithi16641208-261 2020-11-16T20:57:41.596 INFO:tasks.rados.rados.0.smithi166.stdout:1108: done (3 left) 2020-11-16T20:57:41.596 INFO:tasks.rados.rados.0.smithi166.stdout:1112: write (excl) oid 388 current snap is 46 2020-11-16T20:57:41.596 INFO:tasks.rados.rados.0.smithi166.stdout:1112: seq_num 662 ranges {726234=737549,1988609=756555} 2020-11-16T20:57:41.596 INFO:tasks.rados.rados.0.smithi166.stdout:1112: writing smithi16641208-388 from 726234 to 1463783 tid 1 2020-11-16T20:57:41.596 INFO:tasks.rados.rados.0.smithi166.stdout:1112: writing smithi16641208-388 from 1988609 to 2745164 tid 2 2020-11-16T20:57:41.596 INFO:tasks.rados.rados.0.smithi166.stdout:1113: write oid 394 current snap is 46 2020-11-16T20:57:41.596 INFO:tasks.rados.rados.0.smithi166.stdout:1113: seq_num 663 ranges {743041=412798,1930738=616566,3040503=102538} 2020-11-16T20:57:41.597 INFO:tasks.rados.rados.0.smithi166.stdout:1113: writing smithi16641208-394 from 743041 to 1155839 tid 1 2020-11-16T20:57:41.597 INFO:tasks.rados.rados.0.smithi166.stdout:1113: writing smithi16641208-394 from 1930738 to 2547304 tid 2 2020-11-16T20:57:41.597 INFO:tasks.rados.rados.0.smithi166.stdout:1113: writing smithi16641208-394 from 3040503 to 3143041 tid 3 2020-11-16T20:57:41.597 INFO:tasks.rados.rados.0.smithi166.stdout:1114: snap_create 2020-11-16T20:57:41.597 INFO:tasks.rados.rados.0.smithi166.stdout:1111: got (2) No such file or directory 2020-11-16T20:57:41.597 INFO:tasks.rados.rados.0.smithi166.stdout:1110: finishing write tid 2 to smithi16641208-261 2020-11-16T20:57:41.597 INFO:tasks.rados.rados.0.smithi166.stdout:1112: finishing write tid 1 to smithi16641208-388 2020-11-16T20:57:41.597 INFO:tasks.rados.rados.0.smithi166.stdout:1109: finishing rollback tid 1 to smithi16641208-287 2020-11-16T20:57:41.598 INFO:tasks.rados.rados.0.smithi166.stdout:1109: finishing rollback tid 2 to smithi16641208-287 2020-11-16T20:57:41.598 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 287 v 699 (ObjNum 286 snap 0 seq_num 286) dirty exists 2020-11-16T20:57:41.598 INFO:tasks.rados.rados.0.smithi166.stdout:1110: finishing write tid 3 to smithi16641208-261 2020-11-16T20:57:41.598 INFO:tasks.rados.rados.0.smithi166.stdout:1110: finishing write tid 4 to smithi16641208-261 2020-11-16T20:57:41.598 INFO:tasks.rados.rados.0.smithi166.stdout:1110: finishing write tid 5 to smithi16641208-261 2020-11-16T20:57:41.598 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 261 v 787 (ObjNum 661 snap 46 seq_num 661) dirty exists 2020-11-16T20:57:41.598 INFO:tasks.rados.rados.0.smithi166.stdout:1110: left oid 261 (ObjNum 661 snap 46 seq_num 661) 2020-11-16T20:57:41.599 INFO:tasks.rados.rados.0.smithi166.stdout:1113: finishing write tid 1 to smithi16641208-394 2020-11-16T20:57:41.599 INFO:tasks.rados.rados.0.smithi166.stdout:1112: finishing write tid 2 to smithi16641208-388 2020-11-16T20:57:41.599 INFO:tasks.rados.rados.0.smithi166.stdout:1112: finishing write tid 3 to smithi16641208-388 2020-11-16T20:57:41.599 INFO:tasks.rados.rados.0.smithi166.stdout:1112: finishing write tid 4 to smithi16641208-388 2020-11-16T20:57:41.599 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 388 v 832 (ObjNum 662 snap 46 seq_num 662) dirty exists 2020-11-16T20:57:41.599 INFO:tasks.rados.rados.0.smithi166.stdout:1112: left oid 388 (ObjNum 662 snap 46 seq_num 662) 2020-11-16T20:57:41.599 INFO:tasks.rados.rados.0.smithi166.stdout:1113: finishing write tid 2 to smithi16641208-394 2020-11-16T20:57:41.599 INFO:tasks.rados.rados.0.smithi166.stdout:1113: finishing write tid 3 to smithi16641208-394 2020-11-16T20:57:41.600 INFO:tasks.rados.rados.0.smithi166.stdout:1113: finishing write tid 4 to smithi16641208-394 2020-11-16T20:57:41.600 INFO:tasks.rados.rados.0.smithi166.stdout:1113: finishing write tid 5 to smithi16641208-394 2020-11-16T20:57:41.600 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 394 v 842 (ObjNum 663 snap 46 seq_num 663) dirty exists 2020-11-16T20:57:41.600 INFO:tasks.rados.rados.0.smithi166.stdout:1113: left oid 394 (ObjNum 663 snap 46 seq_num 663) 2020-11-16T20:57:41.603 INFO:tasks.rados.rados.0.smithi166.stdout:1109: done (5 left) 2020-11-16T20:57:41.603 INFO:tasks.rados.rados.0.smithi166.stdout:1110: done (4 left) 2020-11-16T20:57:41.603 INFO:tasks.rados.rados.0.smithi166.stdout:1111: done (3 left) 2020-11-16T20:57:41.603 INFO:tasks.rados.rados.0.smithi166.stdout:1112: done (2 left) 2020-11-16T20:57:41.603 INFO:tasks.rados.rados.0.smithi166.stdout:1113: done (1 left) 2020-11-16T20:57:41.604 INFO:tasks.rados.rados.0.smithi166.stdout:1114: done (0 left) 2020-11-16T20:57:41.604 INFO:tasks.rados.rados.0.smithi166.stdout:1115: cache_flush oid 432 snap -1 2020-11-16T20:57:41.604 INFO:tasks.rados.rados.0.smithi166.stdout:1116: snap_remove snap 43 2020-11-16T20:57:41.604 INFO:tasks.rados.rados.0.smithi166.stdout:1116: done (1 left) 2020-11-16T20:57:41.604 INFO:tasks.rados.rados.0.smithi166.stdout:1117: read oid 167 snap 45 2020-11-16T20:57:41.604 INFO:tasks.rados.rados.0.smithi166.stdout:1117: expect (ObjNum 166 snap 0 seq_num 166) 2020-11-16T20:57:41.605 INFO:tasks.rados.rados.0.smithi166.stdout:1118: write (excl) oid 457 current snap is 47 2020-11-16T20:57:41.605 INFO:tasks.rados.rados.0.smithi166.stdout:1118: seq_num 664 ranges {759848=488047,1989220=760224} 2020-11-16T20:57:41.605 INFO:tasks.rados.rados.0.smithi166.stdout:1118: writing smithi16641208-457 from 759848 to 1247895 tid 1 2020-11-16T20:57:41.605 INFO:tasks.rados.rados.0.smithi166.stdout:1118: writing smithi16641208-457 from 1989220 to 2749444 tid 2 2020-11-16T20:57:41.605 INFO:tasks.rados.rados.0.smithi166.stdout:1119: write (excl) oid 125 current snap is 47 2020-11-16T20:57:41.605 INFO:tasks.rados.rados.0.smithi166.stdout:1119: seq_num 665 ranges {776655=563296,2047702=620235,3095349=81306} 2020-11-16T20:57:41.605 INFO:tasks.rados.rados.0.smithi166.stdout:1119: writing smithi16641208-125 from 776655 to 1339951 tid 1 2020-11-16T20:57:41.605 INFO:tasks.rados.rados.0.smithi166.stdout:1119: writing smithi16641208-125 from 2047702 to 2667937 tid 2 2020-11-16T20:57:41.606 INFO:tasks.rados.rados.0.smithi166.stdout:1119: writing smithi16641208-125 from 3095349 to 3176655 tid 3 2020-11-16T20:57:41.606 INFO:tasks.rados.rados.0.smithi166.stdout:1120: snap_create 2020-11-16T20:57:41.606 INFO:tasks.rados.rados.0.smithi166.stdout:1115: got (0) Success 2020-11-16T20:57:41.606 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 432 v 0 (ObjNum 637 snap 39 seq_num 637) dirty exists 2020-11-16T20:57:41.606 INFO:tasks.rados.rados.0.smithi166.stdout:1117: expect (ObjNum 166 snap 0 seq_num 166) 2020-11-16T20:57:41.606 INFO:tasks.rados.rados.0.smithi166.stdout:1118: finishing write tid 1 to smithi16641208-457 2020-11-16T20:57:41.606 INFO:tasks.rados.rados.0.smithi166.stdout:1119: finishing write tid 1 to smithi16641208-125 2020-11-16T20:57:41.607 INFO:tasks.rados.rados.0.smithi166.stdout:1119: finishing write tid 2 to smithi16641208-125 2020-11-16T20:57:41.607 INFO:tasks.rados.rados.0.smithi166.stdout:1119: finishing write tid 3 to smithi16641208-125 2020-11-16T20:57:41.607 INFO:tasks.rados.rados.0.smithi166.stdout:1119: finishing write tid 4 to smithi16641208-125 2020-11-16T20:57:41.607 INFO:tasks.rados.rados.0.smithi166.stdout:1119: finishing write tid 5 to smithi16641208-125 2020-11-16T20:57:41.607 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 125 v 703 (ObjNum 665 snap 47 seq_num 665) dirty exists 2020-11-16T20:57:41.607 INFO:tasks.rados.rados.0.smithi166.stdout:1119: left oid 125 (ObjNum 665 snap 47 seq_num 665) 2020-11-16T20:57:41.607 INFO:tasks.rados.rados.0.smithi166.stdout:1118: finishing write tid 2 to smithi16641208-457 2020-11-16T20:57:41.608 INFO:tasks.rados.rados.0.smithi166.stdout:1118: finishing write tid 3 to smithi16641208-457 2020-11-16T20:57:41.608 INFO:tasks.rados.rados.0.smithi166.stdout:1118: finishing write tid 4 to smithi16641208-457 2020-11-16T20:57:41.608 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 457 v 852 (ObjNum 664 snap 47 seq_num 664) dirty exists 2020-11-16T20:57:41.608 INFO:tasks.rados.rados.0.smithi166.stdout:1118: left oid 457 (ObjNum 664 snap 47 seq_num 664) 2020-11-16T20:57:41.608 INFO:teuthology.orchestra.run.smithi166.stderr:noscrub is set 2020-11-16T20:57:41.664 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:41.669+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:41.744 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:41.744 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:41.754 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:57:41.759 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:57:41.765 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:41.769+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:41.779 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:57:41.799 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:57:41.819 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:57:41.840 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:57:41.861 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:57:41.865 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:41.870+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:41.882 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:57:41.887 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:41.887 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:57:41.887 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:57:41.887 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:57:41.888 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.888 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2979 4.0 4:1852173c:::smithi16641208-329:head [write 581674~637746,stat] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:41.888 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:57:41.888 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 53.087188101999999, 2020-11-16T20:57:41.888 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.009457398, 2020-11-16T20:57:41.888 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:41.889 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:41.889 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:41.889 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:41.889 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:41.889 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2979 2020-11-16T20:57:41.889 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.889 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:41.890 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.890 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:41.890 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:57:41.890 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:41.890 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.890 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.890 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:41.891 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:57:41.891 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030732300000000003 2020-11-16T20:57:41.891 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.891 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.891 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:41.891 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803965+0000", 2020-11-16T20:57:41.891 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0319999999999992e-06 2020-11-16T20:57:41.892 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.892 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.892 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:41.892 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803974+0000", 2020-11-16T20:57:41.892 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5930000000000002e-05 2020-11-16T20:57:41.892 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.892 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.893 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:41.893 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803990+0000", 2020-11-16T20:57:41.893 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1910000000000006e-06 2020-11-16T20:57:41.893 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.893 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.893 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:41.894 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803999+0000", 2020-11-16T20:57:41.894 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5637000000000003e-05 2020-11-16T20:57:41.894 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.894 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.894 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:41.894 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.804055+0000", 2020-11-16T20:57:41.894 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3769000000000001e-05 2020-11-16T20:57:41.895 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.895 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.895 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:41.895 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.804088+0000", 2020-11-16T20:57:41.895 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.995239140000001 2020-11-16T20:57:41.895 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.896 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.896 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:41.896 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799328+0000", 2020-11-16T20:57:41.896 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0137818 2020-11-16T20:57:41.896 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.896 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.896 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:41.897 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813109+0000", 2020-11-16T20:57:41.897 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5759999999999996e-06 2020-11-16T20:57:41.897 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.897 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.897 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:41.897 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813115+0000", 2020-11-16T20:57:41.897 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.009457398 2020-11-16T20:57:41.898 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:41.898 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:41.898 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:41.898 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.898 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.898 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2980 4.0 4:1852173c:::smithi16641208-329:head [write 1840873~558854] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:41.898 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:57:41.899 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 53.080922370000003, 2020-11-16T20:57:41.899 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.039347508000001, 2020-11-16T20:57:41.899 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:41.899 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:41.899 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:41.899 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:41.899 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:41.900 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2980 2020-11-16T20:57:41.900 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.900 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:41.900 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.900 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:41.900 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:57:41.900 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:41.901 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.901 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.901 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:41.901 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:57:41.901 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024810899999999999 2020-11-16T20:57:41.901 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.901 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.902 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:41.902 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810171+0000", 2020-11-16T20:57:41.902 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5610000000000001e-06 2020-11-16T20:57:41.902 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.902 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.902 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:41.902 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810179+0000", 2020-11-16T20:57:41.903 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7418000000000002e-05 2020-11-16T20:57:41.903 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.903 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.903 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:41.903 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810196+0000", 2020-11-16T20:57:41.903 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0079999999999996e-06 2020-11-16T20:57:41.904 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.904 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.904 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:41.904 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810203+0000", 2020-11-16T20:57:41.904 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3705000000000002e-05 2020-11-16T20:57:41.904 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.904 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.904 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:41.905 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810257+0000", 2020-11-16T20:57:41.905 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3656999999999998e-05 2020-11-16T20:57:41.905 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.905 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.905 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:41.905 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810311+0000", 2020-11-16T20:57:41.905 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.989427508 2020-11-16T20:57:41.906 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.906 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.906 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:41.906 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799738+0000", 2020-11-16T20:57:41.906 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2526000000000003e-05 2020-11-16T20:57:41.906 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.907 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.907 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:41.907 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799811+0000", 2020-11-16T20:57:41.907 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027934184000000001 2020-11-16T20:57:41.907 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.907 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.907 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:41.908 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827745+0000", 2020-11-16T20:57:41.908 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015776700000000001 2020-11-16T20:57:41.908 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.908 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.908 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:41.908 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827903+0000", 2020-11-16T20:57:41.909 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000185539 2020-11-16T20:57:41.909 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.909 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.909 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:41.909 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.828088+0000", 2020-11-16T20:57:41.909 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018143857999999999 2020-11-16T20:57:41.909 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.910 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.910 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:41.910 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846232+0000", 2020-11-16T20:57:41.910 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00074682199999999996 2020-11-16T20:57:41.910 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.910 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.910 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:41.911 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846979+0000", 2020-11-16T20:57:41.911 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021617530000000002 2020-11-16T20:57:41.911 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.911 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.911 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:41.911 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849141+0000", 2020-11-16T20:57:41.911 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4513999999999998e-05 2020-11-16T20:57:41.912 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.912 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.912 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:41.912 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849215+0000", 2020-11-16T20:57:41.912 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5578999999999998e-05 2020-11-16T20:57:41.912 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.912 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.913 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:41.913 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849271+0000", 2020-11-16T20:57:41.913 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.039347508000001 2020-11-16T20:57:41.913 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:41.913 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:41.913 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:41.913 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.914 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.914 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2981 4.0 4:1852173c:::smithi16641208-329:head [write 3066417~537135] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:41.914 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:57:41.914 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 53.074006073, 2020-11-16T20:57:41.914 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.032910677, 2020-11-16T20:57:41.914 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:41.914 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:41.915 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:41.915 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:41.915 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:41.915 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2981 2020-11-16T20:57:41.915 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.915 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:41.916 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.916 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:41.916 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:57:41.916 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:41.916 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.916 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.917 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:41.917 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:57:41.917 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024974099999999999 2020-11-16T20:57:41.917 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.917 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.917 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:41.917 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817089+0000", 2020-11-16T20:57:41.918 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3829999999999992e-06 2020-11-16T20:57:41.918 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.918 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.918 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:41.918 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817098+0000", 2020-11-16T20:57:41.918 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2118e-05 2020-11-16T20:57:41.918 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.919 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.919 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:41.919 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817110+0000", 2020-11-16T20:57:41.919 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6050000000000004e-06 2020-11-16T20:57:41.919 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.919 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.919 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:41.919 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817119+0000", 2020-11-16T20:57:41.920 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7204000000000003e-05 2020-11-16T20:57:41.920 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.920 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.920 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:41.920 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817177+0000", 2020-11-16T20:57:41.920 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9932999999999998e-05 2020-11-16T20:57:41.920 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.921 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.921 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:41.921 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817227+0000", 2020-11-16T20:57:41.921 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.98265286 2020-11-16T20:57:41.921 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.921 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.921 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:41.922 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799879+0000", 2020-11-16T20:57:41.922 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.737e-05 2020-11-16T20:57:41.922 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.922 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.922 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:41.922 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799947+0000", 2020-11-16T20:57:41.922 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029940584999999999 2020-11-16T20:57:41.923 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.923 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.923 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:41.923 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.829887+0000", 2020-11-16T20:57:41.923 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000217505 2020-11-16T20:57:41.923 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.923 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.924 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:41.924 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.830105+0000", 2020-11-16T20:57:41.924 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029022100000000001 2020-11-16T20:57:41.924 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.924 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.924 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:41.924 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.830395+0000", 2020-11-16T20:57:41.924 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015847953000000001 2020-11-16T20:57:41.925 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.925 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.925 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:41.925 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846243+0000", 2020-11-16T20:57:41.925 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0011558250000000001 2020-11-16T20:57:41.925 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.926 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.926 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:41.926 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847399+0000", 2020-11-16T20:57:41.926 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021524500000000002 2020-11-16T20:57:41.926 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.926 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.926 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:41.927 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849551+0000", 2020-11-16T20:57:41.927 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000138787 2020-11-16T20:57:41.927 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.927 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.927 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:41.927 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849690+0000", 2020-11-16T20:57:41.927 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0136999999999997e-05 2020-11-16T20:57:41.928 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.928 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.928 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:41.928 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849750+0000", 2020-11-16T20:57:41.928 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.032910677 2020-11-16T20:57:41.928 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:41.928 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:41.929 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:41.929 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.929 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.929 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2982 4.0 4:1852173c:::smithi16641208-329:head [setxattr _header (58) in=7b,truncate 3781674] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:41.929 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:57:41.929 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 53.073687757999998, 2020-11-16T20:57:41.929 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.035208633, 2020-11-16T20:57:41.930 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:41.930 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:41.930 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:41.930 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:41.930 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:41.930 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2982 2020-11-16T20:57:41.930 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.931 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:41.931 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.931 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:41.931 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:57:41.931 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:41.931 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.931 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.932 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:41.932 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:57:41.932 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8856000000000002e-05 2020-11-16T20:57:41.932 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.932 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.932 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:41.932 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817197+0000", 2020-11-16T20:57:41.933 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.93e-06 2020-11-16T20:57:41.933 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.933 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.933 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:41.933 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817203+0000", 2020-11-16T20:57:41.933 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0932e-05 2020-11-16T20:57:41.933 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.934 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.934 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:41.934 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817214+0000", 2020-11-16T20:57:41.934 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3470000000000001e-06 2020-11-16T20:57:41.934 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.934 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.934 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:41.934 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817218+0000", 2020-11-16T20:57:41.935 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4603e-05 2020-11-16T20:57:41.935 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.935 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.935 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:41.935 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817263+0000", 2020-11-16T20:57:41.935 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6387000000000002e-05 2020-11-16T20:57:41.935 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.936 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.936 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:41.936 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817309+0000", 2020-11-16T20:57:41.936 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.982698653 2020-11-16T20:57:41.936 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.936 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.936 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:41.937 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800008+0000", 2020-11-16T20:57:41.937 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5400000000000004e-05 2020-11-16T20:57:41.937 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.937 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.937 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:41.937 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800073+0000", 2020-11-16T20:57:41.937 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.044932818999999999 2020-11-16T20:57:41.938 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.938 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.938 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:41.938 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845006+0000", 2020-11-16T20:57:41.938 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017285099999999999 2020-11-16T20:57:41.938 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.938 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.939 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:41.939 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845179+0000", 2020-11-16T20:57:41.939 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023420900000000001 2020-11-16T20:57:41.939 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.939 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.939 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:41.939 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845413+0000", 2020-11-16T20:57:41.939 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0020276000000000001 2020-11-16T20:57:41.940 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.940 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.940 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:41.940 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847441+0000", 2020-11-16T20:57:41.940 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00050358800000000002 2020-11-16T20:57:41.940 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.940 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.941 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:41.941 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847944+0000", 2020-11-16T20:57:41.941 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042758900000000001 2020-11-16T20:57:41.941 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.941 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.941 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:41.941 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852220+0000", 2020-11-16T20:57:41.941 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9648999999999997e-05 2020-11-16T20:57:41.942 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.942 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.942 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:41.942 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852290+0000", 2020-11-16T20:57:41.942 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6919e-05 2020-11-16T20:57:41.942 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.943 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.943 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:41.943 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852367+0000", 2020-11-16T20:57:41.943 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.035208633 2020-11-16T20:57:41.943 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:41.943 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:41.943 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:41.944 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.944 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.944 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2983 4.0 4:1852173c:::smithi16641208-329:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e86)", 2020-11-16T20:57:41.944 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:57:41.944 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 53.073597290999999, 2020-11-16T20:57:41.944 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.037016812999999, 2020-11-16T20:57:41.944 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:41.944 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:41.945 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:41.945 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:41.945 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:41.945 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2983 2020-11-16T20:57:41.945 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.945 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:41.945 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.946 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:41.946 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:57:41.946 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:41.946 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.946 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.946 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:41.947 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:57:41.947 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7317999999999999e-05 2020-11-16T20:57:41.947 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.947 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.947 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:41.947 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817266+0000", 2020-11-16T20:57:41.947 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3519999999999998e-06 2020-11-16T20:57:41.948 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.948 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.948 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:41.948 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817269+0000", 2020-11-16T20:57:41.948 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7859999999999999e-06 2020-11-16T20:57:41.948 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.948 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.949 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:41.949 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817276+0000", 2020-11-16T20:57:41.949 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5620000000000002e-06 2020-11-16T20:57:41.949 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.949 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.949 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:41.949 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817278+0000", 2020-11-16T20:57:41.950 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3251999999999996e-05 2020-11-16T20:57:41.950 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.950 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.950 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:41.950 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817352+0000", 2020-11-16T20:57:41.950 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7966000000000001e-05 2020-11-16T20:57:41.951 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.951 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.951 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:41.951 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817400+0000", 2020-11-16T20:57:41.951 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.982734203 2020-11-16T20:57:41.951 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.951 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.952 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:41.952 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800134+0000", 2020-11-16T20:57:41.952 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9765999999999997e-05 2020-11-16T20:57:41.952 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.952 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.952 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:41.952 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800194+0000", 2020-11-16T20:57:41.953 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.046087276000000003 2020-11-16T20:57:41.953 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.953 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.953 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:41.953 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846281+0000", 2020-11-16T20:57:41.953 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000115396 2020-11-16T20:57:41.953 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.953 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.954 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:41.954 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846396+0000", 2020-11-16T20:57:41.954 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006004573 2020-11-16T20:57:41.954 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.954 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.954 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:41.954 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852401+0000", 2020-11-16T20:57:41.955 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013211599999999999 2020-11-16T20:57:41.955 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.955 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.955 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:41.955 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852533+0000", 2020-11-16T20:57:41.955 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0017322469999999999 2020-11-16T20:57:41.955 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.956 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.956 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:41.956 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.854265+0000", 2020-11-16T20:57:41.956 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.037016812999999 2020-11-16T20:57:41.956 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:41.956 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:41.956 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:41.957 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.957 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.957 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2984 4.0 4:033219d6:::smithi16641208-386:head [write 598481~712995,stat] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:41.957 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:57:41.957 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 53.066537449000002, 2020-11-16T20:57:41.957 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.003104742, 2020-11-16T20:57:41.957 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:41.958 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:41.958 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:41.958 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:41.958 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:41.958 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2984 2020-11-16T20:57:41.958 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.958 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:41.959 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.959 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:41.959 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:57:41.959 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:41.959 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.959 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.959 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:41.959 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:57:41.960 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00037173000000000002 2020-11-16T20:57:41.960 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.960 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.960 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:41.960 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824680+0000", 2020-11-16T20:57:41.960 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.146e-05 2020-11-16T20:57:41.960 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.961 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.961 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:41.961 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824691+0000", 2020-11-16T20:57:41.961 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6951000000000001e-05 2020-11-16T20:57:41.961 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.961 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.961 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:41.962 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824708+0000", 2020-11-16T20:57:41.962 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2082000000000001e-05 2020-11-16T20:57:41.962 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.962 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.962 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:41.962 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824720+0000", 2020-11-16T20:57:41.962 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0284000000000002e-05 2020-11-16T20:57:41.963 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.963 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.963 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:41.963 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824771+0000", 2020-11-16T20:57:41.963 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1241000000000001e-05 2020-11-16T20:57:41.963 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.963 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.963 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:41.964 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824802+0000", 2020-11-16T20:57:41.964 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.975455838 2020-11-16T20:57:41.964 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.964 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.964 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:41.964 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800258+0000", 2020-11-16T20:57:41.964 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027151194999999999 2020-11-16T20:57:41.965 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.965 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.965 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:41.965 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827409+0000", 2020-11-16T20:57:41.965 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9609999999999999e-06 2020-11-16T20:57:41.965 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.965 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.966 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:41.966 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827413+0000", 2020-11-16T20:57:41.966 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.003104742 2020-11-16T20:57:41.966 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:41.966 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:41.966 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:41.966 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.967 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.967 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2985 4.0 4:033219d6:::smithi16641208-386:head [write 1899355~418865] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:41.967 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:57:41.967 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 53.060926166999998, 2020-11-16T20:57:41.967 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.021091737000001, 2020-11-16T20:57:41.967 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:41.967 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:41.968 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:41.968 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:41.968 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:41.968 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2985 2020-11-16T20:57:41.968 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.968 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:41.968 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.969 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:41.969 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:57:41.969 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:41.969 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.969 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.969 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:41.969 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:57:41.970 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023221799999999999 2020-11-16T20:57:41.970 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.970 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.970 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:41.970 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830152+0000", 2020-11-16T20:57:41.970 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9769999999999995e-06 2020-11-16T20:57:41.970 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.971 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.971 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:41.971 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830162+0000", 2020-11-16T20:57:41.971 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5545000000000001e-05 2020-11-16T20:57:41.971 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.971 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.971 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:41.972 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830177+0000", 2020-11-16T20:57:41.972 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0334e-05 2020-11-16T20:57:41.972 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.972 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.972 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:41.972 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830188+0000", 2020-11-16T20:57:41.972 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3430999999999996e-05 2020-11-16T20:57:41.973 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.973 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.973 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:41.973 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830251+0000", 2020-11-16T20:57:41.973 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2651999999999997e-05 2020-11-16T20:57:41.973 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.973 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.974 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:41.974 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830304+0000", 2020-11-16T20:57:41.974 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.970289857999999 2020-11-16T20:57:41.974 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.974 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.974 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:41.975 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800594+0000", 2020-11-16T20:57:41.975 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8948999999999993e-05 2020-11-16T20:57:41.975 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.975 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.975 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:41.975 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800663+0000", 2020-11-16T20:57:41.975 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036018513000000002 2020-11-16T20:57:41.976 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.976 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.976 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:41.976 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836681+0000", 2020-11-16T20:57:41.976 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013201099999999999 2020-11-16T20:57:41.976 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.976 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.976 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:41.977 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836813+0000", 2020-11-16T20:57:41.977 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000126635 2020-11-16T20:57:41.977 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.977 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.977 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:41.977 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836940+0000", 2020-11-16T20:57:41.977 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010477907 2020-11-16T20:57:41.978 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.978 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.978 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:41.978 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847418+0000", 2020-11-16T20:57:41.978 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000158796 2020-11-16T20:57:41.978 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.978 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.979 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:41.979 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847576+0000", 2020-11-16T20:57:41.979 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033023729999999999 2020-11-16T20:57:41.979 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.979 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.979 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:41.979 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850879+0000", 2020-11-16T20:57:41.980 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6360999999999996e-05 2020-11-16T20:57:41.980 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.980 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.980 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:41.980 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850955+0000", 2020-11-16T20:57:41.980 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6177000000000001e-05 2020-11-16T20:57:41.980 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.981 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.981 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:41.981 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851011+0000", 2020-11-16T20:57:41.981 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.021091737000001 2020-11-16T20:57:41.981 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:41.981 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:41.981 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:41.981 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.982 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.982 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2986 4.0 4:033219d6:::smithi16641208-386:head [write 3093840~704641] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:41.982 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:57:41.982 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 53.052700465000001, 2020-11-16T20:57:41.982 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013155362999999, 2020-11-16T20:57:41.982 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:41.982 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:41.983 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:41.983 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:41.983 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:41.983 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2986 2020-11-16T20:57:41.983 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.983 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:41.983 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.984 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:41.984 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:57:41.984 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:41.984 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.984 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.984 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:41.984 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:57:41.985 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00038247200000000002 2020-11-16T20:57:41.985 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.985 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.985 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:41.985 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838528+0000", 2020-11-16T20:57:41.985 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3299999999999999e-06 2020-11-16T20:57:41.985 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.985 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.986 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:41.986 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838536+0000", 2020-11-16T20:57:41.986 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3438000000000001e-05 2020-11-16T20:57:41.986 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.986 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.986 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:41.986 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838549+0000", 2020-11-16T20:57:41.987 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0213e-05 2020-11-16T20:57:41.987 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.987 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.987 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:41.987 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838560+0000", 2020-11-16T20:57:41.987 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1894999999999997e-05 2020-11-16T20:57:41.987 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.988 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.988 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:41.988 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838612+0000", 2020-11-16T20:57:41.988 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8209e-05 2020-11-16T20:57:41.988 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.988 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.988 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:41.989 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838650+0000", 2020-11-16T20:57:41.989 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962061715000001 2020-11-16T20:57:41.989 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.989 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.989 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:41.989 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800712+0000", 2020-11-16T20:57:41.989 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6964e-05 2020-11-16T20:57:41.990 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.990 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.990 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:41.990 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800748+0000", 2020-11-16T20:57:41.990 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037209265999999998 2020-11-16T20:57:41.990 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.990 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.990 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:41.991 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.837958+0000", 2020-11-16T20:57:41.991 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000160304 2020-11-16T20:57:41.991 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.991 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.991 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:41.991 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.838118+0000", 2020-11-16T20:57:41.991 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022362799999999999 2020-11-16T20:57:41.992 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.992 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.992 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:41.992 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.838342+0000", 2020-11-16T20:57:41.992 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0090844710000000002 2020-11-16T20:57:41.992 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.992 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.992 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:41.993 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847426+0000", 2020-11-16T20:57:41.993 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000219199 2020-11-16T20:57:41.993 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.993 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.993 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:41.993 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847645+0000", 2020-11-16T20:57:41.993 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003411603 2020-11-16T20:57:41.994 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.994 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.994 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:41.994 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851057+0000", 2020-11-16T20:57:41.994 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014736799999999999 2020-11-16T20:57:41.994 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.994 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.995 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:41.995 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851204+0000", 2020-11-16T20:57:41.995 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6287999999999997e-05 2020-11-16T20:57:41.995 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.995 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.995 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:41.995 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851301+0000", 2020-11-16T20:57:41.996 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013155362999999 2020-11-16T20:57:41.996 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:41.996 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:41.996 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:41.996 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.996 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.996 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2987 4.0 4:033219d6:::smithi16641208-386:head [setxattr _header (58) in=7b,truncate 3798481] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:41.997 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:57:41.997 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 53.052241825999999, 2020-11-16T20:57:41.997 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.012971041, 2020-11-16T20:57:41.997 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:41.997 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:41.997 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:41.997 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:41.998 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:41.998 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2987 2020-11-16T20:57:41.998 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.998 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:41.998 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.998 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:41.998 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:57:41.998 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:41.999 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.999 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:41.999 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:41.999 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:57:41.999 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4530000000000002e-05 2020-11-16T20:57:41.999 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:41.999 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.000 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.000 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838648+0000", 2020-11-16T20:57:42.000 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8390000000000001e-06 2020-11-16T20:57:42.000 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.000 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.000 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.000 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838655+0000", 2020-11-16T20:57:42.001 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0341e-05 2020-11-16T20:57:42.001 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.001 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.001 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.001 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838666+0000", 2020-11-16T20:57:42.001 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0929999999999999e-06 2020-11-16T20:57:42.001 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.001 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.002 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.002 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838672+0000", 2020-11-16T20:57:42.002 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8074999999999997e-05 2020-11-16T20:57:42.002 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.002 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.002 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.002 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838710+0000", 2020-11-16T20:57:42.003 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1121000000000002e-05 2020-11-16T20:57:42.003 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.003 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.003 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:42.003 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838751+0000", 2020-11-16T20:57:42.003 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962044797000001 2020-11-16T20:57:42.003 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.004 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.004 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.004 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800796+0000", 2020-11-16T20:57:42.004 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6808999999999998e-05 2020-11-16T20:57:42.004 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.004 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.004 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:42.005 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800852+0000", 2020-11-16T20:57:42.005 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042964599999999999 2020-11-16T20:57:42.005 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.005 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.005 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.005 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843817+0000", 2020-11-16T20:57:42.005 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017807899999999999 2020-11-16T20:57:42.005 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.006 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.006 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.006 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843995+0000", 2020-11-16T20:57:42.006 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023680500000000001 2020-11-16T20:57:42.006 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.006 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.006 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:42.007 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844232+0000", 2020-11-16T20:57:42.007 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00320163 2020-11-16T20:57:42.007 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.007 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.007 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:42.007 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847434+0000", 2020-11-16T20:57:42.007 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00042527899999999998 2020-11-16T20:57:42.008 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.008 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.008 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.008 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847859+0000", 2020-11-16T20:57:42.008 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0034987920000000001 2020-11-16T20:57:42.008 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.008 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.009 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.009 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851358+0000", 2020-11-16T20:57:42.009 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014067300000000001 2020-11-16T20:57:42.009 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.009 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.009 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:42.009 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851498+0000", 2020-11-16T20:57:42.010 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6577999999999998e-05 2020-11-16T20:57:42.010 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.010 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.010 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.010 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851575+0000", 2020-11-16T20:57:42.010 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.012971041 2020-11-16T20:57:42.010 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.011 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.011 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.011 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.011 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.011 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2988 4.0 4:033219d6:::smithi16641208-386:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e86)", 2020-11-16T20:57:42.011 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:57:42.011 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 53.052139326999999, 2020-11-16T20:57:42.012 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013229791000001, 2020-11-16T20:57:42.012 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.012 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:42.012 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:42.012 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:42.012 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:42.012 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2988 2020-11-16T20:57:42.013 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.013 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.013 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.013 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.013 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:57:42.013 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.013 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.014 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.014 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.014 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:57:42.014 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9252999999999999e-05 2020-11-16T20:57:42.014 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.014 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.014 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.014 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838736+0000", 2020-11-16T20:57:42.015 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3980000000000004e-06 2020-11-16T20:57:42.015 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.015 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.015 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.015 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838742+0000", 2020-11-16T20:57:42.015 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1144999999999999e-05 2020-11-16T20:57:42.015 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.016 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.016 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838753+0000", 2020-11-16T20:57:42.016 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6229999999999996e-06 2020-11-16T20:57:42.016 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.016 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.017 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838758+0000", 2020-11-16T20:57:42.017 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5130000000000003e-05 2020-11-16T20:57:42.017 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.017 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.017 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.017 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838803+0000", 2020-11-16T20:57:42.017 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0132000000000001e-05 2020-11-16T20:57:42.018 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.018 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.018 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:42.018 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838843+0000", 2020-11-16T20:57:42.018 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962066786999999 2020-11-16T20:57:42.018 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.018 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.019 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.019 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800910+0000", 2020-11-16T20:57:42.019 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6925999999999997e-05 2020-11-16T20:57:42.019 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.019 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.019 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:42.019 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800967+0000", 2020-11-16T20:57:42.019 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.043837752000000001 2020-11-16T20:57:42.020 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.020 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.020 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.020 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844805+0000", 2020-11-16T20:57:42.020 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012337000000000001 2020-11-16T20:57:42.020 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.020 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.021 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:42.021 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844928+0000", 2020-11-16T20:57:42.021 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0066885149999999999 2020-11-16T20:57:42.021 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.021 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.021 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.021 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851616+0000", 2020-11-16T20:57:42.022 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5716000000000005e-05 2020-11-16T20:57:42.022 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.022 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.022 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.022 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851692+0000", 2020-11-16T20:57:42.022 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024404400000000001 2020-11-16T20:57:42.022 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.023 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.023 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.023 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851936+0000", 2020-11-16T20:57:42.023 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013229791000001 2020-11-16T20:57:42.023 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.023 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.023 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.024 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.024 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.024 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2992 4.0 4:0f4a2e46:::smithi16641208-399:head [cache-evict] snapc 0=[] ondisk+read+ignore_cache+known_if_redirected e86)", 2020-11-16T20:57:42.024 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:57:42.024 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 53.05205299, 2020-11-16T20:57:42.024 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962433468, 2020-11-16T20:57:42.024 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.025 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:42.025 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:42.025 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:42.025 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:42.025 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2992 2020-11-16T20:57:42.025 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.025 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.026 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.026 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.026 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:57:42.026 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.026 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.026 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.026 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.026 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:57:42.027 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7780000000000002e-05 2020-11-16T20:57:42.027 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.027 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.027 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.027 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838820+0000", 2020-11-16T20:57:42.027 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1200000000000001e-06 2020-11-16T20:57:42.027 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.028 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.028 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.028 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838826+0000", 2020-11-16T20:57:42.028 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0008e-05 2020-11-16T20:57:42.028 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.028 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.028 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.029 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838836+0000", 2020-11-16T20:57:42.029 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3749999999999996e-06 2020-11-16T20:57:42.029 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.029 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.029 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.029 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838840+0000", 2020-11-16T20:57:42.029 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0889000000000002e-05 2020-11-16T20:57:42.030 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.030 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.030 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.030 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838871+0000", 2020-11-16T20:57:42.030 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6891000000000003e-05 2020-11-16T20:57:42.030 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.030 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.031 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:42.031 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838908+0000", 2020-11-16T20:57:42.031 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962115045999999 2020-11-16T20:57:42.031 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.031 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.031 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.031 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801023+0000", 2020-11-16T20:57:42.031 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020335899999999999 2020-11-16T20:57:42.032 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.032 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.032 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.032 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801226+0000", 2020-11-16T20:57:42.032 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962433468 2020-11-16T20:57:42.032 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.032 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.033 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.033 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.033 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.033 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3051 4.0 4:2ceac9f9:::smithi16641208-61:head [write 699323~480842] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:57:42.033 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:57:42.033 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 48.049932683000002, 2020-11-16T20:57:42.033 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9728349610000002, 2020-11-16T20:57:42.034 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.034 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:42.034 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:42.034 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:42.034 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:42.034 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3051 2020-11-16T20:57:42.034 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.035 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.035 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.035 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.035 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:57:42.035 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.035 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.035 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.036 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.036 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:57:42.036 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032526199999999999 2020-11-16T20:57:42.036 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.036 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.036 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.036 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841238+0000", 2020-11-16T20:57:42.037 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9822000000000001e-05 2020-11-16T20:57:42.037 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.037 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.037 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.037 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841258+0000", 2020-11-16T20:57:42.037 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.507e-05 2020-11-16T20:57:42.037 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.038 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.038 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.038 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841273+0000", 2020-11-16T20:57:42.038 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8900000000000007e-06 2020-11-16T20:57:42.038 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.038 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.039 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.039 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841281+0000", 2020-11-16T20:57:42.039 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4356000000000003e-05 2020-11-16T20:57:42.039 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.039 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.039 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.039 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841365+0000", 2020-11-16T20:57:42.040 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0232000000000002e-05 2020-11-16T20:57:42.040 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.040 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.040 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:42.040 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841426+0000", 2020-11-16T20:57:42.040 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9604309439999996 2020-11-16T20:57:42.040 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.041 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.041 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.041 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801857+0000", 2020-11-16T20:57:42.041 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000164897 2020-11-16T20:57:42.041 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.041 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.041 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.042 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.802021+0000", 2020-11-16T20:57:42.042 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020576500000000001 2020-11-16T20:57:42.042 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.042 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.042 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:42.042 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.802227+0000", 2020-11-16T20:57:42.042 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0066237170000000003 2020-11-16T20:57:42.043 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.043 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.043 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:42.043 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808851+0000", 2020-11-16T20:57:42.043 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037712430000000001 2020-11-16T20:57:42.043 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.043 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.044 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.044 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812622+0000", 2020-11-16T20:57:42.044 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00099110800000000009 2020-11-16T20:57:42.044 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.044 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.044 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.044 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813613+0000", 2020-11-16T20:57:42.045 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1646e-05 2020-11-16T20:57:42.045 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.045 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.045 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:42.045 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813665+0000", 2020-11-16T20:57:42.045 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3009000000000004e-05 2020-11-16T20:57:42.045 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.045 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.046 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.046 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813748+0000", 2020-11-16T20:57:42.046 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9728349610000002 2020-11-16T20:57:42.046 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.046 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.046 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.046 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.047 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.047 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3052 4.0 4:2ceac9f9:::smithi16641208-61:head [write 1850247~429872] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:57:42.047 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:57:42.047 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 48.041741643999998, 2020-11-16T20:57:42.047 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9911138360000002, 2020-11-16T20:57:42.047 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.047 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:42.048 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:42.048 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:42.048 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:42.048 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3052 2020-11-16T20:57:42.048 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.048 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.048 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.049 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.049 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:57:42.049 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.049 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.049 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.049 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.049 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:57:42.050 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000296166 2020-11-16T20:57:42.050 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.050 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.050 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.050 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849400+0000", 2020-11-16T20:57:42.050 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0699999999999996e-06 2020-11-16T20:57:42.050 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.051 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.051 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.051 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849409+0000", 2020-11-16T20:57:42.051 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3725e-05 2020-11-16T20:57:42.051 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.051 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.051 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.052 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849423+0000", 2020-11-16T20:57:42.052 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9929999999999998e-06 2020-11-16T20:57:42.052 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.052 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.052 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.052 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849430+0000", 2020-11-16T20:57:42.052 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9708000000000002e-05 2020-11-16T20:57:42.053 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.053 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.053 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.053 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849520+0000", 2020-11-16T20:57:42.053 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2088000000000002e-05 2020-11-16T20:57:42.053 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.053 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.054 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:42.054 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849552+0000", 2020-11-16T20:57:42.054 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.954526692 2020-11-16T20:57:42.054 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.054 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.054 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.054 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804079+0000", 2020-11-16T20:57:42.055 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015456899999999999 2020-11-16T20:57:42.055 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.055 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.055 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.055 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804233+0000", 2020-11-16T20:57:42.055 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019627800000000001 2020-11-16T20:57:42.055 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.055 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.056 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:42.056 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804429+0000", 2020-11-16T20:57:42.056 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006762316 2020-11-16T20:57:42.056 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.056 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.056 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:42.056 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811192+0000", 2020-11-16T20:57:42.057 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002630467 2020-11-16T20:57:42.057 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.057 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.057 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.057 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813822+0000", 2020-11-16T20:57:42.057 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026302065999999999 2020-11-16T20:57:42.057 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.058 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.058 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.058 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840124+0000", 2020-11-16T20:57:42.058 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.274e-05 2020-11-16T20:57:42.058 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.058 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.058 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:42.059 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840177+0000", 2020-11-16T20:57:42.059 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0958000000000003e-05 2020-11-16T20:57:42.059 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.059 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.059 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.059 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840218+0000", 2020-11-16T20:57:42.059 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9911138360000002 2020-11-16T20:57:42.060 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.060 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.060 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.060 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.060 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.060 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3053 4.0 4:2ceac9f9:::smithi16641208-61:head [write 2858378~532392] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:57:42.060 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:57:42.061 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 48.033284313000003, 2020-11-16T20:57:42.061 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9828430529999999, 2020-11-16T20:57:42.061 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.061 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:42.061 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:42.061 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:42.061 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:42.062 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3053 2020-11-16T20:57:42.062 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.062 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.062 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.062 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.062 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:57:42.062 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.063 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.063 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.063 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.063 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:57:42.063 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000647082 2020-11-16T20:57:42.063 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.063 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.063 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.064 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858208+0000", 2020-11-16T20:57:42.064 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.269e-05 2020-11-16T20:57:42.064 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.064 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.064 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.064 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858221+0000", 2020-11-16T20:57:42.064 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0361e-05 2020-11-16T20:57:42.065 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.065 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858242+0000", 2020-11-16T20:57:42.065 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1184e-05 2020-11-16T20:57:42.065 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.066 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858253+0000", 2020-11-16T20:57:42.066 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7032000000000004e-05 2020-11-16T20:57:42.066 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.066 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.066 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858330+0000", 2020-11-16T20:57:42.067 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4135999999999998e-05 2020-11-16T20:57:42.067 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.067 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.067 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:42.067 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858384+0000", 2020-11-16T20:57:42.067 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9487614310000003 2020-11-16T20:57:42.067 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.068 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.068 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.068 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807145+0000", 2020-11-16T20:57:42.068 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9426000000000007e-05 2020-11-16T20:57:42.068 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.068 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.068 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.068 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807245+0000", 2020-11-16T20:57:42.069 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018410799999999999 2020-11-16T20:57:42.069 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.069 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.069 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:42.069 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807429+0000", 2020-11-16T20:57:42.069 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0064067339999999999 2020-11-16T20:57:42.069 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.070 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.070 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:42.070 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813836+0000", 2020-11-16T20:57:42.070 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001513267 2020-11-16T20:57:42.070 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.070 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.070 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.071 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815349+0000", 2020-11-16T20:57:42.071 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024962895999999998 2020-11-16T20:57:42.071 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.071 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.071 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.071 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840312+0000", 2020-11-16T20:57:42.071 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7781999999999997e-05 2020-11-16T20:57:42.072 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.072 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.072 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:42.072 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840370+0000", 2020-11-16T20:57:42.072 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4924e-05 2020-11-16T20:57:42.072 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.072 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.072 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.073 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840404+0000", 2020-11-16T20:57:42.073 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9828430529999999 2020-11-16T20:57:42.073 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.073 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.073 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.073 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.073 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.074 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3054 4.0 4:2ceac9f9:::smithi16641208-61:head [setxattr _header (57) in=7b,truncate 3899323] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:57:42.074 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:57:42.074 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 48.032531806000001, 2020-11-16T20:57:42.074 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9822430049999999, 2020-11-16T20:57:42.074 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.074 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:42.074 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:42.075 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:42.075 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:42.075 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3054 2020-11-16T20:57:42.075 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.075 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.075 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.075 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.076 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:57:42.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.076 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.076 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.076 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.076 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:57:42.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8208999999999999e-05 2020-11-16T20:57:42.077 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.077 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.077 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.077 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858362+0000", 2020-11-16T20:57:42.077 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5539999999999998e-06 2020-11-16T20:57:42.077 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.077 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.078 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.078 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858371+0000", 2020-11-16T20:57:42.078 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.005e-05 2020-11-16T20:57:42.078 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.078 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.078 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.078 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858381+0000", 2020-11-16T20:57:42.079 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8099999999999997e-06 2020-11-16T20:57:42.079 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.079 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.079 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.079 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858386+0000", 2020-11-16T20:57:42.079 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6168000000000005e-05 2020-11-16T20:57:42.079 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.079 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.080 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.080 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858482+0000", 2020-11-16T20:57:42.080 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7954999999999999e-05 2020-11-16T20:57:42.080 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.080 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.080 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:42.080 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858510+0000", 2020-11-16T20:57:42.081 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9498925639999998 2020-11-16T20:57:42.081 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.081 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.081 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.081 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808402+0000", 2020-11-16T20:57:42.081 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3084000000000005e-05 2020-11-16T20:57:42.081 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.082 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.082 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.082 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808495+0000", 2020-11-16T20:57:42.082 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114826 2020-11-16T20:57:42.082 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.082 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.082 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:42.082 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808610+0000", 2020-11-16T20:57:42.083 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052363219999999999 2020-11-16T20:57:42.083 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.083 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.083 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:42.083 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813846+0000", 2020-11-16T20:57:42.083 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0015700709999999999 2020-11-16T20:57:42.083 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.084 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.084 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.084 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815417+0000", 2020-11-16T20:57:42.084 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025048682999999999 2020-11-16T20:57:42.084 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.084 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.084 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.085 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840465+0000", 2020-11-16T20:57:42.085 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5473000000000003e-05 2020-11-16T20:57:42.085 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.085 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.085 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:42.085 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840511+0000", 2020-11-16T20:57:42.085 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6236000000000003e-05 2020-11-16T20:57:42.086 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.086 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.086 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.086 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840557+0000", 2020-11-16T20:57:42.086 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9822430049999999 2020-11-16T20:57:42.086 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.086 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.087 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.087 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.087 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.087 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3055 4.0 4:2ceac9f9:::smithi16641208-61:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e91)", 2020-11-16T20:57:42.087 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:57:42.087 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 48.032356610000001, 2020-11-16T20:57:42.088 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9852841799999998, 2020-11-16T20:57:42.088 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.088 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:42.088 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:42.088 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:42.088 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:42.088 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3055 2020-11-16T20:57:42.089 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.089 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.089 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.089 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.089 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:57:42.089 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.089 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.090 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.090 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.090 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:57:42.090 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4403000000000002e-05 2020-11-16T20:57:42.090 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.090 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.090 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.091 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858523+0000", 2020-11-16T20:57:42.091 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4670000000000001e-06 2020-11-16T20:57:42.091 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.091 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.091 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.091 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858530+0000", 2020-11-16T20:57:42.091 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2469999999999999e-05 2020-11-16T20:57:42.092 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.092 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.092 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.092 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858542+0000", 2020-11-16T20:57:42.092 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2449999999999998e-06 2020-11-16T20:57:42.092 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.092 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.093 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.093 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858548+0000", 2020-11-16T20:57:42.093 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9604000000000002e-05 2020-11-16T20:57:42.093 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.093 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.093 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.093 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858587+0000", 2020-11-16T20:57:42.094 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4863000000000001e-05 2020-11-16T20:57:42.094 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.094 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.094 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:42.094 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858632+0000", 2020-11-16T20:57:42.094 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9521692039999996 2020-11-16T20:57:42.094 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.095 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.095 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.095 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.810801+0000", 2020-11-16T20:57:42.095 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014886700000000001 2020-11-16T20:57:42.095 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.095 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.095 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:42.096 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.810950+0000", 2020-11-16T20:57:42.096 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029669781999999999 2020-11-16T20:57:42.096 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.096 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.096 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.096 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840620+0000", 2020-11-16T20:57:42.096 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010005699999999999 2020-11-16T20:57:42.097 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.097 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.097 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.097 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840720+0000", 2020-11-16T20:57:42.097 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030532179999999999 2020-11-16T20:57:42.097 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.097 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.098 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.098 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843773+0000", 2020-11-16T20:57:42.098 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9852841799999998 2020-11-16T20:57:42.098 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.098 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.098 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.098 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.098 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.099 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3065 4.0 4:2f657946:::smithi16641208-73:head [read 0~3210104,checksum] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:57:42.099 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:57:42.099 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 47.924081587000003, 2020-11-16T20:57:42.099 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8738324339999997, 2020-11-16T20:57:42.099 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.099 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:42.099 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:42.100 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:42.100 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:42.100 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3065 2020-11-16T20:57:42.100 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.100 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.100 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.100 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.101 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:57:42.101 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.101 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.101 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.101 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.101 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:57:42.101 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3065999999999999e-05 2020-11-16T20:57:42.101 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.102 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.102 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.102 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966787+0000", 2020-11-16T20:57:42.102 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8329999999999998e-06 2020-11-16T20:57:42.102 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.102 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.102 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.103 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966790+0000", 2020-11-16T20:57:42.103 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1780000000000002e-06 2020-11-16T20:57:42.103 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.103 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.103 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.103 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966795+0000", 2020-11-16T20:57:42.104 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3460000000000001e-06 2020-11-16T20:57:42.104 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.104 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.104 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.104 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966798+0000", 2020-11-16T20:57:42.104 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6675000000000003e-05 2020-11-16T20:57:42.104 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.105 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.105 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.105 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966844+0000", 2020-11-16T20:57:42.105 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5497999999999999e-05 2020-11-16T20:57:42.105 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.105 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.105 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:42.106 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966870+0000", 2020-11-16T20:57:42.106 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8445859479999998 2020-11-16T20:57:42.106 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.106 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.106 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.106 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811456+0000", 2020-11-16T20:57:42.106 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029140889999999999 2020-11-16T20:57:42.107 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.107 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.107 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.107 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840597+0000", 2020-11-16T20:57:42.107 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8738324339999997 2020-11-16T20:57:42.107 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.107 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.107 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.108 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.108 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.108 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3066 4.0 4:356864c0:::smithi16641208-150:head [read 0~2504243,checksum,omap-get-vals-by-keys,omap-get-keys,omap-get-vals,omap-get-header,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:57:42.108 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:57:42.108 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 47.924030362000003, 2020-11-16T20:57:42.108 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8778990499999999, 2020-11-16T20:57:42.108 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.109 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:42.109 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:42.109 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:42.109 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:42.109 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3066 2020-11-16T20:57:42.109 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.109 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.109 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.110 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.110 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:57:42.110 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.110 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.110 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.110 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.110 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:57:42.111 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1704000000000001e-05 2020-11-16T20:57:42.111 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.111 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.111 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.111 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966837+0000", 2020-11-16T20:57:42.111 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6850000000000001e-06 2020-11-16T20:57:42.111 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.112 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.112 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.112 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966840+0000", 2020-11-16T20:57:42.112 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7479999999999999e-06 2020-11-16T20:57:42.112 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.112 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.112 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.112 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966845+0000", 2020-11-16T20:57:42.113 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5059999999999998e-06 2020-11-16T20:57:42.113 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.113 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.113 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966848+0000", 2020-11-16T20:57:42.113 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4314000000000002e-05 2020-11-16T20:57:42.113 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.114 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.114 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.114 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966902+0000", 2020-11-16T20:57:42.114 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.561e-05 2020-11-16T20:57:42.114 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.114 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.114 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:42.115 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:57:42.115 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8448102110000004 2020-11-16T20:57:42.115 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.115 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.115 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.115 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811738+0000", 2020-11-16T20:57:42.115 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032976272000000001 2020-11-16T20:57:42.115 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.116 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.116 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.116 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844714+0000", 2020-11-16T20:57:42.116 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8778990499999999 2020-11-16T20:57:42.116 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.116 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.116 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.117 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.117 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.117 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3067 4.0 4:356864c0:::smithi16641208-150:head [sparse-read 0~2504243] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:57:42.117 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:57:42.117 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 47.923978904999998, 2020-11-16T20:57:42.117 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8780898150000001, 2020-11-16T20:57:42.117 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.118 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:42.118 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:42.118 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:42.118 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:42.118 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3067 2020-11-16T20:57:42.118 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.118 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.119 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.119 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.119 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:57:42.119 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.119 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.119 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.119 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.119 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:57:42.120 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2826e-05 2020-11-16T20:57:42.120 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.120 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.120 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.120 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966900+0000", 2020-11-16T20:57:42.120 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.694e-06 2020-11-16T20:57:42.120 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.121 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.121 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.121 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966902+0000", 2020-11-16T20:57:42.121 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0889999999999999e-06 2020-11-16T20:57:42.121 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.121 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.121 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.122 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966907+0000", 2020-11-16T20:57:42.122 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3910000000000001e-06 2020-11-16T20:57:42.122 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.122 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.122 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.122 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966910+0000", 2020-11-16T20:57:42.122 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2771000000000002e-05 2020-11-16T20:57:42.123 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.123 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.123 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.123 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966943+0000", 2020-11-16T20:57:42.123 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5301000000000001e-05 2020-11-16T20:57:42.123 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.123 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.123 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:42.124 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966968+0000", 2020-11-16T20:57:42.124 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.845055017 2020-11-16T20:57:42.124 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.124 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.124 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.124 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812023+0000", 2020-11-16T20:57:42.124 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032933726000000003 2020-11-16T20:57:42.125 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.125 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.125 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.125 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844957+0000", 2020-11-16T20:57:42.125 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8780898150000001 2020-11-16T20:57:42.125 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.125 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.126 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.126 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.126 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.126 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3068 4.0 4:356864c0:::smithi16641208-150:head [read 0~2504243,checksum] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:57:42.126 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:57:42.126 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 47.923917566999997, 2020-11-16T20:57:42.126 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8828719500000002, 2020-11-16T20:57:42.126 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.127 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:42.127 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:42.127 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:42.127 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:42.127 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3068 2020-11-16T20:57:42.127 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.127 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.128 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.128 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.128 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:57:42.128 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.128 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.128 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.128 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.129 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:57:42.129 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0942999999999999e-05 2020-11-16T20:57:42.129 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.129 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.129 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.129 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966949+0000", 2020-11-16T20:57:42.129 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.712e-06 2020-11-16T20:57:42.130 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.130 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.130 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.130 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966952+0000", 2020-11-16T20:57:42.130 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8479999999999997e-06 2020-11-16T20:57:42.130 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.130 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.130 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.131 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966958+0000", 2020-11-16T20:57:42.131 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9170000000000002e-06 2020-11-16T20:57:42.131 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.131 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.131 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.131 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966961+0000", 2020-11-16T20:57:42.131 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4105999999999999e-05 2020-11-16T20:57:42.132 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.132 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.132 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.132 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966985+0000", 2020-11-16T20:57:42.132 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2056e-05 2020-11-16T20:57:42.132 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.132 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.132 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:42.133 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.967007+0000", 2020-11-16T20:57:42.133 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8456606430000004 2020-11-16T20:57:42.133 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.133 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.133 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.133 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812667+0000", 2020-11-16T20:57:42.134 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037132724999999998 2020-11-16T20:57:42.134 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.134 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.134 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.134 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849800+0000", 2020-11-16T20:57:42.134 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8828719500000002 2020-11-16T20:57:42.134 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.135 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.135 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.135 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.135 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.135 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:42.138 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:57:42.138 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:57:42.138 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:57:42.139 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:57:42.139 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:57:42.139 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:57:42.139 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:57:42.139 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:57:42.139 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:57:42.140 INFO:tasks.rados.rados.0.smithi166.stdout:1115: done (4 left) 2020-11-16T20:57:42.140 INFO:tasks.rados.rados.0.smithi166.stdout:1117: done (3 left) 2020-11-16T20:57:42.140 INFO:tasks.rados.rados.0.smithi166.stdout:1118: done (2 left) 2020-11-16T20:57:42.140 INFO:tasks.rados.rados.0.smithi166.stdout:1119: done (1 left) 2020-11-16T20:57:42.140 INFO:tasks.rados.rados.0.smithi166.stdout:1120: done (0 left) 2020-11-16T20:57:42.140 INFO:tasks.rados.rados.0.smithi166.stdout:1121: write (excl) oid 11 current snap is 48 2020-11-16T20:57:42.140 INFO:tasks.rados.rados.0.smithi166.stdout:1121: seq_num 666 ranges {793462=638545,2106184=763893} 2020-11-16T20:57:42.141 INFO:tasks.rados.rados.0.smithi166.stdout:1121: writing smithi16641208-11 from 793462 to 1432007 tid 1 2020-11-16T20:57:42.141 INFO:tasks.rados.rados.0.smithi166.stdout:1121: writing smithi16641208-11 from 2106184 to 2870077 tid 2 2020-11-16T20:57:42.141 INFO:tasks.rados.rados.0.smithi166.stdout:1122: cache_flush oid 352 snap -1 2020-11-16T20:57:42.141 INFO:tasks.rados.rados.0.smithi166.stdout:1123: rollback oid 34 current snap is 48 2020-11-16T20:57:42.141 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 34 to 47 2020-11-16T20:57:42.141 INFO:tasks.rados.rados.0.smithi166.stdout:1124: cache_evict oid 475 snap -1 2020-11-16T20:57:42.141 INFO:tasks.rados.rados.0.smithi166.stdout:1125: copy_from oid 86 from oid 328 current snap is 48 2020-11-16T20:57:42.142 INFO:tasks.rados.rados.0.smithi166.stdout:1126: write (excl) oid 14 current snap is 48 2020-11-16T20:57:42.142 INFO:tasks.rados.rados.0.smithi166.stdout:1126: seq_num 667 ranges {410269=713794,1648313=507551,2917489=292780} 2020-11-16T20:57:42.142 INFO:tasks.rados.rados.0.smithi166.stdout:1126: writing smithi16641208-14 from 410269 to 1124063 tid 1 2020-11-16T20:57:42.142 INFO:tasks.rados.rados.0.smithi166.stdout:1126: writing smithi16641208-14 from 1648313 to 2155864 tid 2 2020-11-16T20:57:42.142 INFO:tasks.rados.rados.0.smithi166.stdout:1126: writing smithi16641208-14 from 2917489 to 3210269 tid 3 2020-11-16T20:57:42.142 INFO:tasks.rados.rados.0.smithi166.stdout:1127: cache_try_flush oid 126 snap -1 2020-11-16T20:57:42.142 INFO:tasks.rados.rados.0.smithi166.stdout:1124: got (2) No such file or directory 2020-11-16T20:57:42.143 INFO:tasks.rados.rados.0.smithi166.stdout:1121: finishing write tid 1 to smithi16641208-11 2020-11-16T20:57:42.143 INFO:tasks.rados.rados.0.smithi166.stdout:1123: finishing rollback tid 1 to smithi16641208-34 2020-11-16T20:57:42.143 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 34 v 538 (ObjNum 1208337584 snap 32601 seq_num 1207961808) dirty dne 2020-11-16T20:57:42.143 INFO:tasks.rados.rados.0.smithi166.stdout:1126: finishing write tid 1 to smithi16641208-14 2020-11-16T20:57:42.143 INFO:tasks.rados.rados.0.smithi166.stdout:1123: done (6 left) 2020-11-16T20:57:42.143 INFO:tasks.rados.rados.0.smithi166.stdout:1124: done (5 left) 2020-11-16T20:57:42.143 INFO:tasks.rados.rados.0.smithi166.stdout:1128: rollback oid 180 current snap is 48 2020-11-16T20:57:42.144 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 180 to 47 2020-11-16T20:57:42.144 INFO:tasks.rados.rados.0.smithi166.stdout:1129: snap_remove snap 45 2020-11-16T20:57:42.144 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:42.141+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:42.144 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:57:42.237 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:42.241+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:42.303 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:42.304 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:57:42.304 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:57:42.304 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:42.313 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:57:42.354 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:42.359+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:42.439 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:42.444+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:42.479 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:42.479 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:57:42.479 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:57:42.479 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:57:42.479 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:42.488 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:57:42.570 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:42.576+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:42.641 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:42.646+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:42.656 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:42.657 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:57:42.657 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:57:42.657 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:57:42.657 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.657 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:554 3.2 3:769099fd:::smithi16641208-247:head [copy-from ver 123] snapc 1=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:57:42.658 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:57:42.658 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 97.609906421999995, 2020-11-16T20:57:42.658 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998, 2020-11-16T20:57:42.658 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.658 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:42.658 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.659 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.659 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.659 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:57:42.659 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.659 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.659 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.660 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.660 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:57:42.660 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6705999999999997e-05 2020-11-16T20:57:42.660 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.660 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.660 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.660 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050139+0000", 2020-11-16T20:57:42.660 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6199999999999998e-06 2020-11-16T20:57:42.661 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.661 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.661 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.661 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050144+0000", 2020-11-16T20:57:42.661 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.944e-06 2020-11-16T20:57:42.661 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.661 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.662 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.662 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050154+0000", 2020-11-16T20:57:42.662 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4043999999999999e-05 2020-11-16T20:57:42.662 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.662 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.662 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.662 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050178+0000", 2020-11-16T20:57:42.663 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078971409999999999 2020-11-16T20:57:42.663 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.663 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.663 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.663 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058075+0000", 2020-11-16T20:57:42.663 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012776500000000001 2020-11-16T20:57:42.663 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.664 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.664 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.664 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058203+0000", 2020-11-16T20:57:42.664 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011807013 2020-11-16T20:57:42.664 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.664 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.664 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:42.665 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070010+0000", 2020-11-16T20:57:42.665 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029522160000000001 2020-11-16T20:57:42.665 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.665 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.666 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:42.666 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.072962+0000", 2020-11-16T20:57:42.666 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017845006 2020-11-16T20:57:42.666 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.666 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.666 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.667 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.090807+0000", 2020-11-16T20:57:42.667 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.009301808 2020-11-16T20:57:42.667 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.667 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.667 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.667 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100109+0000", 2020-11-16T20:57:42.667 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7076999999999995e-05 2020-11-16T20:57:42.667 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.668 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.668 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:42.668 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100176+0000", 2020-11-16T20:57:42.668 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9790999999999999e-05 2020-11-16T20:57:42.668 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.668 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.668 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.669 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100216+0000", 2020-11-16T20:57:42.669 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998 2020-11-16T20:57:42.669 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.669 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.669 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.669 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.669 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.670 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2429 4.0 4:3b92f709:::smithi16641208-69:head [rollback 7] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:57:42.670 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:57:42.670 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 92.643988160000006, 2020-11-16T20:57:42.670 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003, 2020-11-16T20:57:42.670 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.670 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:42.670 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:42.671 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:42.671 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:42.671 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2429 2020-11-16T20:57:42.671 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.671 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.671 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.671 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.671 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:57:42.672 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.672 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.672 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.672 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.672 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:57:42.672 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3710000000000002e-05 2020-11-16T20:57:42.672 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.673 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.673 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.673 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016044+0000", 2020-11-16T20:57:42.673 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7090000000000001e-06 2020-11-16T20:57:42.673 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.673 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.674 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.674 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016049+0000", 2020-11-16T20:57:42.674 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8820000000000003e-06 2020-11-16T20:57:42.674 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.674 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.674 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.674 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016056+0000", 2020-11-16T20:57:42.675 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.27e-06 2020-11-16T20:57:42.675 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.675 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.675 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.675 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016059+0000", 2020-11-16T20:57:42.675 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.537e-05 2020-11-16T20:57:42.675 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.676 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.676 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.676 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016115+0000", 2020-11-16T20:57:42.677 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8690000000000003e-06 2020-11-16T20:57:42.677 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.677 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.677 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:42.678 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016120+0000", 2020-11-16T20:57:42.678 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021405730000000002 2020-11-16T20:57:42.678 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.679 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.679 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.679 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018260+0000", 2020-11-16T20:57:42.679 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0137999999999999e-05 2020-11-16T20:57:42.679 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.680 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.680 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:42.680 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018320+0000", 2020-11-16T20:57:42.680 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011799352000000001 2020-11-16T20:57:42.680 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.681 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.681 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.681 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030120+0000", 2020-11-16T20:57:42.681 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000163139 2020-11-16T20:57:42.681 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.681 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.681 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.682 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030283+0000", 2020-11-16T20:57:42.682 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029657000000000002 2020-11-16T20:57:42.682 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.682 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.682 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:42.682 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030579+0000", 2020-11-16T20:57:42.682 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3058000000000001e-05 2020-11-16T20:57:42.683 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.683 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.683 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:42.683 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030612+0000", 2020-11-16T20:57:42.683 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0075168259999999999 2020-11-16T20:57:42.683 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.683 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.684 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.684 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038129+0000", 2020-11-16T20:57:42.684 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012914299999999999 2020-11-16T20:57:42.684 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.684 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.684 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.684 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038258+0000", 2020-11-16T20:57:42.685 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034292799999999999 2020-11-16T20:57:42.685 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.685 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.685 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:57:42.685 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038601+0000", 2020-11-16T20:57:42.686 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0025181159999999999 2020-11-16T20:57:42.686 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.686 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.686 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.686 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041119+0000", 2020-11-16T20:57:42.686 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2331999999999997e-05 2020-11-16T20:57:42.687 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.687 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.687 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for ondisk", 2020-11-16T20:57:42.687 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041202+0000", 2020-11-16T20:57:42.687 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028481750000000001 2020-11-16T20:57:42.687 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.687 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.688 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:42.688 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044050+0000", 2020-11-16T20:57:42.688 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001269921 2020-11-16T20:57:42.688 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.688 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.688 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.688 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045320+0000", 2020-11-16T20:57:42.688 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054215490000000003 2020-11-16T20:57:42.689 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.689 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.689 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.689 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050741+0000", 2020-11-16T20:57:42.689 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6981000000000001e-05 2020-11-16T20:57:42.689 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.690 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.690 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:42.690 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050808+0000", 2020-11-16T20:57:42.690 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8841e-05 2020-11-16T20:57:42.690 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.690 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.690 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.691 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050877+0000", 2020-11-16T20:57:42.691 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003 2020-11-16T20:57:42.691 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.691 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.691 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.691 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.691 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.692 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2430 4.0 4:3b92f709:::smithi16641208-69:head [append 0~0] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:57:42.692 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:57:42.692 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 92.643931836999997, 2020-11-16T20:57:42.692 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001, 2020-11-16T20:57:42.692 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.692 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:42.692 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:42.692 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:42.693 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:42.693 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2430 2020-11-16T20:57:42.693 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.693 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.693 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.693 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.693 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:57:42.694 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.694 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.694 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.694 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.695 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:57:42.695 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0857e-05 2020-11-16T20:57:42.695 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.695 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.695 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.695 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016098+0000", 2020-11-16T20:57:42.695 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9179999999999999e-06 2020-11-16T20:57:42.695 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.696 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.696 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.696 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016104+0000", 2020-11-16T20:57:42.696 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8230000000000006e-06 2020-11-16T20:57:42.696 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.696 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.696 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.697 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016114+0000", 2020-11-16T20:57:42.697 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2180000000000001e-06 2020-11-16T20:57:42.697 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.697 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.697 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.697 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016118+0000", 2020-11-16T20:57:42.697 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3547999999999995e-05 2020-11-16T20:57:42.698 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.698 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.698 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.698 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016181+0000", 2020-11-16T20:57:42.698 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8730000000000007e-06 2020-11-16T20:57:42.698 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.698 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.699 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:42.699 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016189+0000", 2020-11-16T20:57:42.699 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021577200000000001 2020-11-16T20:57:42.699 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.699 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.699 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.699 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018347+0000", 2020-11-16T20:57:42.700 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6832000000000001e-05 2020-11-16T20:57:42.700 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.700 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.700 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:42.700 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018404+0000", 2020-11-16T20:57:42.700 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012272913999999999 2020-11-16T20:57:42.700 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.700 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.701 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.701 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030677+0000", 2020-11-16T20:57:42.701 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2555000000000002e-05 2020-11-16T20:57:42.701 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.701 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.701 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:42.701 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030719+0000", 2020-11-16T20:57:42.702 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010518684 2020-11-16T20:57:42.702 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.702 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.702 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.702 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041238+0000", 2020-11-16T20:57:42.702 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000144723 2020-11-16T20:57:42.702 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.703 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.703 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.703 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041383+0000", 2020-11-16T20:57:42.703 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000214575 2020-11-16T20:57:42.703 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.704 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.704 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:57:42.704 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041597+0000", 2020-11-16T20:57:42.704 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002463196 2020-11-16T20:57:42.704 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.704 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.705 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:42.705 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044060+0000", 2020-11-16T20:57:42.705 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001654066 2020-11-16T20:57:42.705 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.705 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.705 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.705 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045715+0000", 2020-11-16T20:57:42.706 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053780599999999996 2020-11-16T20:57:42.706 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.706 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.706 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.706 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051093+0000", 2020-11-16T20:57:42.706 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8189999999999996e-05 2020-11-16T20:57:42.706 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.707 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.707 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:42.707 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051161+0000", 2020-11-16T20:57:42.707 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4910000000000001e-05 2020-11-16T20:57:42.707 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.707 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.707 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.708 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051216+0000", 2020-11-16T20:57:42.708 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001 2020-11-16T20:57:42.708 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.708 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.708 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.708 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.708 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.709 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "MOSDPGPush(4.1 52/51 [PushOp(4:9ab04c4a:::smithi16641208-1:head, version: 33'3, data_included: [0~892056,1542129~156520], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:9ab04c4a:::smithi16641208-1:head@33'3, size: 2016807, copy_subset: [0~2016807], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1698649, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:a1eef07d:::smithi16641208-13:head, version: 33'9, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:a1eef07d:::smithi16641208-13:head@33'9, size: 2201684, copy_subset: [0~2201684], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:929564f0:::smithi16641208-24:head, version: 33'18, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:929564f0:::smithi16641208-24:head@33'18, size: 2386561, copy_subset: [0~2386561], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b565f7d2:::smithi16641208-35:head, version: 33'27, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b565f7d2:::smithi16641208-35:head@33'27, size: 2571438, copy_subset: [0~2571438], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b6545a47:::smithi16641208-46:head, version: 33'29, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b6545a47:::smithi16641208-46:head@33'29, size: 2756315, copy_subset: [0~2756315], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:9bd9f31d:::smithi16641208-48:head, version: 33'35, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:9bd9f31d:::smithi16641208-48:head@33'35, size: 2789929, copy_subset: [0~2789929], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:83205103:::smithi16641208-103:head, version: 34'38, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:83205103:::smithi16641208-103:head@34'38, size: 3714314, copy_subset: [0~3714314], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:86a0a5b7:::smithi16641208-108:head, version: 34'42, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:86a0a5b7:::smithi16641208-108:head@34'42, size: 3798349, copy_subset: [0~3798349], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-16T20:57:42.709 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:57:42.709 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 87.889335231000004, 2020-11-16T20:57:42.709 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032552672999999997, 2020-11-16T20:57:42.709 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.709 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:42.709 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.710 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.710 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.710 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:57:42.710 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.710 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.710 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.710 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.711 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:57:42.711 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017498692999999999 2020-11-16T20:57:42.711 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.711 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.711 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.711 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788172+0000", 2020-11-16T20:57:42.712 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4147999999999999e-05 2020-11-16T20:57:42.712 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.712 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.712 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.712 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788206+0000", 2020-11-16T20:57:42.712 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0016000000000002e-05 2020-11-16T20:57:42.712 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.713 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.713 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.713 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788276+0000", 2020-11-16T20:57:42.713 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2172000000000002e-05 2020-11-16T20:57:42.713 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.713 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.713 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.714 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788319+0000", 2020-11-16T20:57:42.714 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000154337 2020-11-16T20:57:42.714 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.714 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.714 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.715 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788473+0000", 2020-11-16T20:57:42.715 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7690000000000002e-06 2020-11-16T20:57:42.715 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.715 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.715 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.715 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788482+0000", 2020-11-16T20:57:42.716 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014744538 2020-11-16T20:57:42.716 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.716 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.716 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.716 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803226+0000", 2020-11-16T20:57:42.716 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032552672999999997 2020-11-16T20:57:42.716 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.717 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.717 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.717 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.717 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.717 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.0:552 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'128, mlcod=0'0)", 2020-11-16T20:57:42.717 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:57:42.718 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 87.869369813000006, 2020-11-16T20:57:42.718 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038033168999999999, 2020-11-16T20:57:42.718 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.718 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:42.718 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.719 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.719 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.719 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:57:42.719 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.719 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.719 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.720 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.720 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:57:42.720 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0031023880000000002 2020-11-16T20:57:42.720 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.720 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.721 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.721 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793741+0000", 2020-11-16T20:57:42.721 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1496e-05 2020-11-16T20:57:42.721 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.722 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.722 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.722 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793753+0000", 2020-11-16T20:57:42.722 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9009999999999999e-05 2020-11-16T20:57:42.723 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.723 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.723 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.723 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793772+0000", 2020-11-16T20:57:42.724 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3318e-05 2020-11-16T20:57:42.724 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.724 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.724 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.724 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793785+0000", 2020-11-16T20:57:42.724 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012534775 2020-11-16T20:57:42.725 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.725 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.725 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.725 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806320+0000", 2020-11-16T20:57:42.725 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8144999999999999e-05 2020-11-16T20:57:42.725 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.726 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.726 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.726 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806348+0000", 2020-11-16T20:57:42.726 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022285688000000001 2020-11-16T20:57:42.727 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.727 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.727 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:42.727 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828634+0000", 2020-11-16T20:57:42.728 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8349000000000002e-05 2020-11-16T20:57:42.728 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.728 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.728 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.729 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828672+0000", 2020-11-16T20:57:42.729 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038033168999999999 2020-11-16T20:57:42.729 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.729 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.730 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.730 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.730 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.731 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2503 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'129, mlcod=0'0)", 2020-11-16T20:57:42.731 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:57:42.731 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 87.866181632999997, 2020-11-16T20:57:42.731 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034870998, 2020-11-16T20:57:42.732 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.732 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:42.732 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.732 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.732 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.733 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:57:42.733 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.733 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.733 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.734 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.734 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:57:42.734 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00093048899999999995 2020-11-16T20:57:42.734 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.735 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.735 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.735 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794758+0000", 2020-11-16T20:57:42.735 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.169e-05 2020-11-16T20:57:42.736 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.736 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.736 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.736 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794769+0000", 2020-11-16T20:57:42.737 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3998999999999999e-05 2020-11-16T20:57:42.737 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.737 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.737 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.738 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794783+0000", 2020-11-16T20:57:42.738 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.481e-06 2020-11-16T20:57:42.738 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.739 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.739 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.739 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794791+0000", 2020-11-16T20:57:42.739 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.02524036 2020-11-16T20:57:42.740 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.740 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.740 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.740 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820031+0000", 2020-11-16T20:57:42.741 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.811e-05 2020-11-16T20:57:42.741 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.741 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.741 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.742 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820059+0000", 2020-11-16T20:57:42.742 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.008614577 2020-11-16T20:57:42.742 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.743 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.743 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:42.743 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828674+0000", 2020-11-16T20:57:42.743 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4292000000000001e-05 2020-11-16T20:57:42.744 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.744 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.744 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.744 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828698+0000", 2020-11-16T20:57:42.744 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034870998 2020-11-16T20:57:42.745 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.745 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.745 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.745 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.746 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.746 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2504 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'130, mlcod=0'0)", 2020-11-16T20:57:42.746 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:57:42.747 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 87.865175950999998, 2020-11-16T20:57:42.747 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033888776000000002, 2020-11-16T20:57:42.747 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.748 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:42.748 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.748 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.748 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.749 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:57:42.749 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.749 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.749 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.750 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.750 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:57:42.750 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3896999999999997e-05 2020-11-16T20:57:42.750 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.751 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.751 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.751 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794877+0000", 2020-11-16T20:57:42.751 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7019999999999998e-06 2020-11-16T20:57:42.752 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.752 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.752 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.752 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794883+0000", 2020-11-16T20:57:42.753 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.789e-06 2020-11-16T20:57:42.753 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.753 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.753 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.754 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794888+0000", 2020-11-16T20:57:42.754 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.852e-06 2020-11-16T20:57:42.754 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.754 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.755 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.755 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794891+0000", 2020-11-16T20:57:42.755 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026152822999999999 2020-11-16T20:57:42.755 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.756 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.756 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.756 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.821044+0000", 2020-11-16T20:57:42.756 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6900999999999999e-05 2020-11-16T20:57:42.757 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.757 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.757 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.757 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.821071+0000", 2020-11-16T20:57:42.758 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0076283210000000004 2020-11-16T20:57:42.758 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.758 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.758 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:42.759 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828699+0000", 2020-11-16T20:57:42.759 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2490999999999999e-05 2020-11-16T20:57:42.759 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.759 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.760 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.760 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828722+0000", 2020-11-16T20:57:42.760 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033888776000000002 2020-11-16T20:57:42.760 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.761 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.761 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.761 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.761 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.762 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.13:681 3.1 e52/19 3:afc69464:::smithi16641208-110:head v 52'546, mlcod=52'544)", 2020-11-16T20:57:42.762 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:57:42.762 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 87.862515880999993, 2020-11-16T20:57:42.762 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.03113606, 2020-11-16T20:57:42.763 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.763 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:42.763 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.763 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.764 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.764 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:57:42.764 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.764 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.765 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.765 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.765 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:57:42.765 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0026681809999999999 2020-11-16T20:57:42.766 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.766 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.766 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.766 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800161+0000", 2020-11-16T20:57:42.767 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3499000000000001e-05 2020-11-16T20:57:42.767 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.767 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.767 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.768 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800175+0000", 2020-11-16T20:57:42.768 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8301999999999999e-05 2020-11-16T20:57:42.768 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.769 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.769 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.769 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800193+0000", 2020-11-16T20:57:42.769 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0465999999999999e-05 2020-11-16T20:57:42.770 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.770 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.770 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.770 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800203+0000", 2020-11-16T20:57:42.771 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061432479999999996 2020-11-16T20:57:42.771 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.771 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.771 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.772 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806347+0000", 2020-11-16T20:57:42.772 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.641e-05 2020-11-16T20:57:42.772 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.772 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.773 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.773 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806373+0000", 2020-11-16T20:57:42.773 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022190887999999999 2020-11-16T20:57:42.773 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.774 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.774 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:42.774 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828564+0000", 2020-11-16T20:57:42.774 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5066000000000003e-05 2020-11-16T20:57:42.775 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.775 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.775 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.775 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828629+0000", 2020-11-16T20:57:42.776 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.03113606 2020-11-16T20:57:42.776 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.776 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.776 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.777 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.777 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.777 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:603 3.2 3:5a2e7c26:::smithi16641208-130:head [copy-from ver 67] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:57:42.777 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:57:42.778 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 82.908767886999996, 2020-11-16T20:57:42.778 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036631116999999998, 2020-11-16T20:57:42.778 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.778 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:42.778 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.779 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.779 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.779 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:57:42.779 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.779 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.779 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.779 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.780 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:57:42.780 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9854000000000002e-05 2020-11-16T20:57:42.780 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.780 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.780 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.780 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751281+0000", 2020-11-16T20:57:42.780 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1840000000000004e-06 2020-11-16T20:57:42.781 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.781 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.781 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.781 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751287+0000", 2020-11-16T20:57:42.781 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0231000000000001e-05 2020-11-16T20:57:42.781 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.781 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.782 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.782 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751297+0000", 2020-11-16T20:57:42.782 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.639e-06 2020-11-16T20:57:42.782 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.782 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.782 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.782 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751302+0000", 2020-11-16T20:57:42.783 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030012000000000002 2020-11-16T20:57:42.783 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.783 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.783 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.783 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751602+0000", 2020-11-16T20:57:42.783 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013830200000000001 2020-11-16T20:57:42.783 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.783 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.784 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.784 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751740+0000", 2020-11-16T20:57:42.784 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019538969999999999 2020-11-16T20:57:42.784 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.784 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.784 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:42.784 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771279+0000", 2020-11-16T20:57:42.785 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007630403 2020-11-16T20:57:42.785 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.785 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.785 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:42.785 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.778910+0000", 2020-11-16T20:57:42.785 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0065002009999999997 2020-11-16T20:57:42.785 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.786 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.786 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.786 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.785410+0000", 2020-11-16T20:57:42.786 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0023914140000000001 2020-11-16T20:57:42.786 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.786 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.786 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.787 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787801+0000", 2020-11-16T20:57:42.787 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9629999999999998e-05 2020-11-16T20:57:42.787 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.787 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.787 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:42.787 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787841+0000", 2020-11-16T20:57:42.787 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1168999999999999e-05 2020-11-16T20:57:42.787 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.788 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.788 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.788 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787872+0000", 2020-11-16T20:57:42.788 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036631116999999998 2020-11-16T20:57:42.788 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.788 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.788 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.789 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.789 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.789 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:609 3.2 3:5eead97c:::smithi16641208-34:head [copy-from ver 27] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:57:42.789 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:57:42.789 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 82.870970757999999, 2020-11-16T20:57:42.789 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.062626424, 2020-11-16T20:57:42.789 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.790 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:42.790 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.790 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.790 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.790 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:57:42.790 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.790 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.791 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.791 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.791 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:57:42.791 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3596000000000001e-05 2020-11-16T20:57:42.791 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.791 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.791 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.791 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789082+0000", 2020-11-16T20:57:42.792 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3209999999999999e-06 2020-11-16T20:57:42.792 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.792 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.792 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.792 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789089+0000", 2020-11-16T20:57:42.792 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3498e-05 2020-11-16T20:57:42.792 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.793 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.793 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.793 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789103+0000", 2020-11-16T20:57:42.793 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3679999999999998e-06 2020-11-16T20:57:42.793 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.793 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.793 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.794 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789109+0000", 2020-11-16T20:57:42.794 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007399638 2020-11-16T20:57:42.794 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.794 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.794 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.794 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.796509+0000", 2020-11-16T20:57:42.795 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000181168 2020-11-16T20:57:42.795 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.795 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.795 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.795 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.796690+0000", 2020-11-16T20:57:42.795 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01336562 2020-11-16T20:57:42.795 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.795 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.796 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:42.796 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.810055+0000", 2020-11-16T20:57:42.796 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044828350000000001 2020-11-16T20:57:42.796 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.796 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.796 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:42.796 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.814538+0000", 2020-11-16T20:57:42.797 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035609628999999997 2020-11-16T20:57:42.797 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.797 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.797 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.797 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850148+0000", 2020-11-16T20:57:42.797 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0013754730000000001 2020-11-16T20:57:42.797 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.798 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.798 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851523+0000", 2020-11-16T20:57:42.798 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9935e-05 2020-11-16T20:57:42.798 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.798 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:42.798 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851603+0000", 2020-11-16T20:57:42.799 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1342999999999999e-05 2020-11-16T20:57:42.799 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.799 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.799 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.799 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851665+0000", 2020-11-16T20:57:42.799 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.062626424 2020-11-16T20:57:42.799 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.800 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.800 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.800 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.800 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.800 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2605 4.0 4:2294fced:::smithi16641208-278:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:57:42.800 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:57:42.800 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 82.743135641999999, 2020-11-16T20:57:42.800 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032301128999999998, 2020-11-16T20:57:42.801 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.801 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:42.801 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:42.801 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:42.801 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:42.801 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2605 2020-11-16T20:57:42.801 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.802 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.802 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.802 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.802 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:57:42.802 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.802 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.802 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.803 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.803 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:57:42.803 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.811e-05 2020-11-16T20:57:42.803 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.803 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.803 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.803 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916901+0000", 2020-11-16T20:57:42.803 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2939999999999996e-06 2020-11-16T20:57:42.804 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.804 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.804 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.804 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916907+0000", 2020-11-16T20:57:42.804 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0589e-05 2020-11-16T20:57:42.804 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.804 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.805 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.805 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916917+0000", 2020-11-16T20:57:42.805 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2549999999999999e-06 2020-11-16T20:57:42.805 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.805 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.805 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.805 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916921+0000", 2020-11-16T20:57:42.806 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033789099999999999 2020-11-16T20:57:42.806 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.806 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.806 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.806 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.917259+0000", 2020-11-16T20:57:42.806 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.25e-05 2020-11-16T20:57:42.806 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.807 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.807 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:42.807 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.917332+0000", 2020-11-16T20:57:42.807 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.028336376999999999 2020-11-16T20:57:42.807 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.807 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.807 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.807 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.945668+0000", 2020-11-16T20:57:42.808 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0983000000000006e-05 2020-11-16T20:57:42.808 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.808 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.808 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:42.808 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.945759+0000", 2020-11-16T20:57:42.808 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00324756 2020-11-16T20:57:42.808 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.809 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.809 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.809 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949007+0000", 2020-11-16T20:57:42.809 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0583999999999999e-05 2020-11-16T20:57:42.809 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.809 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.809 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.810 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949097+0000", 2020-11-16T20:57:42.810 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6985999999999998e-05 2020-11-16T20:57:42.810 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.810 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.810 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.810 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949174+0000", 2020-11-16T20:57:42.810 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032301128999999998 2020-11-16T20:57:42.811 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.811 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.811 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.811 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.811 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.811 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2874 4.0 4:055e14cb:::smithi16641208-187:head [copy-from ver 402] snapc 25=[25,23,21,f] ondisk+write+known_if_redirected e72)", 2020-11-16T20:57:42.811 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:57:42.812 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 67.914611972000003, 2020-11-16T20:57:42.812 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031663616999999998, 2020-11-16T20:57:42.812 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.812 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:42.812 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:42.812 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:42.812 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:42.813 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2874 2020-11-16T20:57:42.813 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.813 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.813 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.813 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.813 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:57:42.813 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.813 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.814 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.814 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.814 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:57:42.814 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6754000000000001e-05 2020-11-16T20:57:42.814 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.814 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.814 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.815 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745434+0000", 2020-11-16T20:57:42.815 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5049999999999998e-06 2020-11-16T20:57:42.815 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.815 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.815 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.815 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745439+0000", 2020-11-16T20:57:42.815 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0803e-05 2020-11-16T20:57:42.816 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.816 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.816 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.816 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745450+0000", 2020-11-16T20:57:42.816 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8810000000000004e-06 2020-11-16T20:57:42.816 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.816 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.817 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.817 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745455+0000", 2020-11-16T20:57:42.817 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022866499999999999 2020-11-16T20:57:42.817 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.817 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.817 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.817 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745684+0000", 2020-11-16T20:57:42.818 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000132714 2020-11-16T20:57:42.818 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.818 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.818 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.818 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745816+0000", 2020-11-16T20:57:42.818 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050117850000000004 2020-11-16T20:57:42.818 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.818 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.819 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:57:42.819 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.750828+0000", 2020-11-16T20:57:42.819 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010413489 2020-11-16T20:57:42.819 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.819 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.819 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:42.819 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.761241+0000", 2020-11-16T20:57:42.820 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028274289999999998 2020-11-16T20:57:42.820 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.820 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.820 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.820 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.764069+0000", 2020-11-16T20:57:42.820 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012880057 2020-11-16T20:57:42.820 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.821 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.821 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.821 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.776949+0000", 2020-11-16T20:57:42.821 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2536e-05 2020-11-16T20:57:42.821 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.821 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.821 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:42.821 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777002+0000", 2020-11-16T20:57:42.822 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8999000000000002e-05 2020-11-16T20:57:42.822 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.822 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.822 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.822 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777061+0000", 2020-11-16T20:57:42.822 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031663616999999998 2020-11-16T20:57:42.822 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.823 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.823 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.823 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.823 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.823 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2875 4.0 4:055e14cb:::smithi16641208-187:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-11-16T20:57:42.823 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:57:42.823 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 67.914522746000003, 2020-11-16T20:57:42.824 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031888061000000002, 2020-11-16T20:57:42.824 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.824 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:42.824 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:42.824 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:42.824 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:42.824 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2875 2020-11-16T20:57:42.824 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.825 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.825 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.825 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.825 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:57:42.825 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.825 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.825 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.826 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.826 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:57:42.826 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0239000000000001e-05 2020-11-16T20:57:42.826 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.826 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.826 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.826 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745506+0000", 2020-11-16T20:57:42.826 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.252e-06 2020-11-16T20:57:42.827 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.827 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.827 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.827 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745510+0000", 2020-11-16T20:57:42.827 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3670000000000002e-06 2020-11-16T20:57:42.827 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.827 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.828 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.828 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745516+0000", 2020-11-16T20:57:42.828 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1089999999999998e-06 2020-11-16T20:57:42.828 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.828 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.828 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.828 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745519+0000", 2020-11-16T20:57:42.828 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045188999999999998 2020-11-16T20:57:42.829 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.829 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.829 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.829 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745971+0000", 2020-11-16T20:57:42.829 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7822999999999998e-05 2020-11-16T20:57:42.829 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.829 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.830 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:42.830 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.746029+0000", 2020-11-16T20:57:42.830 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013333563999999999 2020-11-16T20:57:42.830 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.830 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.830 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.830 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.759362+0000", 2020-11-16T20:57:42.831 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000170896 2020-11-16T20:57:42.831 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.831 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.831 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:42.831 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.759533+0000", 2020-11-16T20:57:42.831 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017572878 2020-11-16T20:57:42.831 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.831 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.832 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.832 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777106+0000", 2020-11-16T20:57:42.832 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014436399999999999 2020-11-16T20:57:42.832 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.832 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.832 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.832 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777251+0000", 2020-11-16T20:57:42.833 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012367899999999999 2020-11-16T20:57:42.833 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.833 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.833 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.833 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777374+0000", 2020-11-16T20:57:42.833 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031888061000000002 2020-11-16T20:57:42.833 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.834 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.834 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.834 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.834 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.834 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3004 3.2 3:4fbd4ff5:::smithi16641208-419:head [copy-from ver 366] snapc 33=[33,25] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e87)", 2020-11-16T20:57:42.834 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.815968+0000", 2020-11-16T20:57:42.834 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 52.844041132999998, 2020-11-16T20:57:42.835 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042048220999999997, 2020-11-16T20:57:42.835 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.835 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:42.835 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.835 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.835 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.835 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.815968+0000", 2020-11-16T20:57:42.835 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.836 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.836 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.836 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.836 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.815968+0000", 2020-11-16T20:57:42.836 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3235000000000002e-05 2020-11-16T20:57:42.836 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.836 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.837 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.837 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816011+0000", 2020-11-16T20:57:42.837 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.303e-06 2020-11-16T20:57:42.837 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.837 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.837 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.837 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816019+0000", 2020-11-16T20:57:42.838 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9714999999999999e-05 2020-11-16T20:57:42.838 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.838 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.838 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.838 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816049+0000", 2020-11-16T20:57:42.838 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2960000000000001e-06 2020-11-16T20:57:42.839 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.839 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.839 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.839 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816056+0000", 2020-11-16T20:57:42.839 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000241606 2020-11-16T20:57:42.839 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.839 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.840 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.840 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816298+0000", 2020-11-16T20:57:42.840 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016421599999999999 2020-11-16T20:57:42.840 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.840 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.840 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.840 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816462+0000", 2020-11-16T20:57:42.841 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025803994 2020-11-16T20:57:42.841 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.841 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.841 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:42.841 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.842266+0000", 2020-11-16T20:57:42.841 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0072860549999999996 2020-11-16T20:57:42.841 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.841 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.842 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:42.842 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.849552+0000", 2020-11-16T20:57:42.842 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0077911389999999999 2020-11-16T20:57:42.842 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.842 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.842 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.842 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.857343+0000", 2020-11-16T20:57:42.843 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00049728000000000001 2020-11-16T20:57:42.843 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.843 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.843 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.843 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.857841+0000", 2020-11-16T20:57:42.843 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.1997999999999997e-05 2020-11-16T20:57:42.843 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.844 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.844 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:42.844 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.857923+0000", 2020-11-16T20:57:42.844 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3383999999999999e-05 2020-11-16T20:57:42.844 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.844 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.844 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.844 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858016+0000", 2020-11-16T20:57:42.845 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042048220999999997 2020-11-16T20:57:42.845 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.845 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.845 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.845 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.845 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.845 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:650 3.2 3:4fbd4ff5:::smithi16641208-419:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e87)", 2020-11-16T20:57:42.846 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.816105+0000", 2020-11-16T20:57:42.846 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 52.843903503, 2020-11-16T20:57:42.846 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042242304000000001, 2020-11-16T20:57:42.846 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.846 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:42.846 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.846 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.847 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.847 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816105+0000", 2020-11-16T20:57:42.847 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.847 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.847 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.847 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.847 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816105+0000", 2020-11-16T20:57:42.847 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6486999999999999e-05 2020-11-16T20:57:42.848 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.848 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.848 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.848 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816132+0000", 2020-11-16T20:57:42.848 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5230000000000003e-06 2020-11-16T20:57:42.848 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.848 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.849 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.849 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816137+0000", 2020-11-16T20:57:42.849 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1498000000000001e-05 2020-11-16T20:57:42.849 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.849 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.849 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.849 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816149+0000", 2020-11-16T20:57:42.849 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5789999999999997e-06 2020-11-16T20:57:42.850 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.850 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.850 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.850 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816153+0000", 2020-11-16T20:57:42.850 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00044901199999999999 2020-11-16T20:57:42.850 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.850 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.851 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.851 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816602+0000", 2020-11-16T20:57:42.851 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6134000000000002e-05 2020-11-16T20:57:42.851 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.851 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.851 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:42.851 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816649+0000", 2020-11-16T20:57:42.852 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032065206999999998 2020-11-16T20:57:42.852 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.852 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.852 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.852 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848714+0000", 2020-11-16T20:57:42.852 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000103695 2020-11-16T20:57:42.852 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.852 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.853 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:42.853 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848818+0000", 2020-11-16T20:57:42.853 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092315220000000007 2020-11-16T20:57:42.853 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.853 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.853 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.853 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858049+0000", 2020-11-16T20:57:42.854 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000104415 2020-11-16T20:57:42.854 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.854 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.854 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.854 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858153+0000", 2020-11-16T20:57:42.854 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019423199999999999 2020-11-16T20:57:42.854 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.854 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.855 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.855 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858348+0000", 2020-11-16T20:57:42.855 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042242304000000001 2020-11-16T20:57:42.855 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.855 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.855 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.855 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.856 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.856 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:651 3.2 3:4fbd4ff5:::smithi16641208-419:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e87)", 2020-11-16T20:57:42.856 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.816182+0000", 2020-11-16T20:57:42.856 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 52.843827007999998, 2020-11-16T20:57:42.856 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047784220000000002, 2020-11-16T20:57:42.856 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.856 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:42.857 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.857 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.857 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.857 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816182+0000", 2020-11-16T20:57:42.857 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.857 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.857 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.857 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.858 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816182+0000", 2020-11-16T20:57:42.858 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6310999999999998e-05 2020-11-16T20:57:42.858 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.858 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.858 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.858 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816218+0000", 2020-11-16T20:57:42.858 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6110000000000001e-06 2020-11-16T20:57:42.859 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.859 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.859 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.859 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816224+0000", 2020-11-16T20:57:42.859 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9189999999999994e-06 2020-11-16T20:57:42.859 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.859 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.860 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.860 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816234+0000", 2020-11-16T20:57:42.860 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3220000000000003e-06 2020-11-16T20:57:42.860 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.860 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.860 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.860 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816238+0000", 2020-11-16T20:57:42.860 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00043294900000000002 2020-11-16T20:57:42.861 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.861 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.861 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.861 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816671+0000", 2020-11-16T20:57:42.861 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3359999999999998e-05 2020-11-16T20:57:42.861 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.861 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.862 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:42.862 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816714+0000", 2020-11-16T20:57:42.862 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032137410999999998 2020-11-16T20:57:42.862 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.862 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.862 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.862 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848852+0000", 2020-11-16T20:57:42.863 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000103235 2020-11-16T20:57:42.863 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.863 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.863 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:42.863 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848955+0000", 2020-11-16T20:57:42.863 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094266409999999995 2020-11-16T20:57:42.863 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.863 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.864 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.864 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858382+0000", 2020-11-16T20:57:42.864 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7973999999999995e-05 2020-11-16T20:57:42.864 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.864 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.864 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.864 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858470+0000", 2020-11-16T20:57:42.865 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054964870000000004 2020-11-16T20:57:42.865 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.865 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.865 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.865 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.863966+0000", 2020-11-16T20:57:42.865 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047784220000000002 2020-11-16T20:57:42.865 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.866 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.866 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.866 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.866 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.866 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:732 3.2 3:4f2a8928:::smithi16641208-54:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:57:42.866 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.861780+0000", 2020-11-16T20:57:42.866 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 22.798229269, 2020-11-16T20:57:42.866 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029888644999999998, 2020-11-16T20:57:42.867 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.867 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:42.867 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.867 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.867 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.867 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.861780+0000", 2020-11-16T20:57:42.867 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.868 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.868 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.868 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.868 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.861780+0000", 2020-11-16T20:57:42.868 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7092000000000002e-05 2020-11-16T20:57:42.868 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.868 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.868 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.869 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.861837+0000", 2020-11-16T20:57:42.869 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0851e-05 2020-11-16T20:57:42.869 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.869 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.869 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.869 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.861848+0000", 2020-11-16T20:57:42.870 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2167999999999999e-05 2020-11-16T20:57:42.870 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.870 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.870 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.870 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.861860+0000", 2020-11-16T20:57:42.870 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.708e-06 2020-11-16T20:57:42.870 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.870 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.871 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.871 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.861866+0000", 2020-11-16T20:57:42.871 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016967999999999999 2020-11-16T20:57:42.871 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.871 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.871 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.871 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.862036+0000", 2020-11-16T20:57:42.872 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5148999999999998e-05 2020-11-16T20:57:42.872 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.872 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.872 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:42.872 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.862081+0000", 2020-11-16T20:57:42.872 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016940553000000001 2020-11-16T20:57:42.872 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.873 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.873 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.873 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.879022+0000", 2020-11-16T20:57:42.873 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6178000000000003e-05 2020-11-16T20:57:42.873 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.873 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.873 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:42.873 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.879078+0000", 2020-11-16T20:57:42.874 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0084192199999999998 2020-11-16T20:57:42.874 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.874 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.874 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.874 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.887497+0000", 2020-11-16T20:57:42.874 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8679999999999997e-05 2020-11-16T20:57:42.874 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.875 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.875 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.875 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.887596+0000", 2020-11-16T20:57:42.875 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004072366 2020-11-16T20:57:42.875 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.875 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.875 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.875 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.891668+0000", 2020-11-16T20:57:42.876 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029888644999999998 2020-11-16T20:57:42.876 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.876 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.876 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.876 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.876 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.876 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3541 4.0 4:251c4c06:::smithi16641208-378:head [write 1862271~598221] snapc 55=[55,54] ondisk+write+known_if_redirected e130)", 2020-11-16T20:57:42.877 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.764037+0000", 2020-11-16T20:57:42.877 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 7.895972349, 2020-11-16T20:57:42.877 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037702297000000003, 2020-11-16T20:57:42.877 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.877 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:42.877 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:42.877 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:42.878 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:42.878 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3541 2020-11-16T20:57:42.878 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.878 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.878 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.878 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.878 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764037+0000", 2020-11-16T20:57:42.879 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.879 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.879 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.879 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.879 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764037+0000", 2020-11-16T20:57:42.879 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018829599999999999 2020-11-16T20:57:42.879 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.880 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.880 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.880 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764225+0000", 2020-11-16T20:57:42.880 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7600000000000002e-06 2020-11-16T20:57:42.880 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.880 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.880 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.880 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764233+0000", 2020-11-16T20:57:42.881 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2991e-05 2020-11-16T20:57:42.881 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.881 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.881 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.881 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764246+0000", 2020-11-16T20:57:42.881 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7379999999999997e-06 2020-11-16T20:57:42.881 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.882 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.882 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.882 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764252+0000", 2020-11-16T20:57:42.882 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000195482 2020-11-16T20:57:42.882 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.882 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.882 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.883 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764448+0000", 2020-11-16T20:57:42.883 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3134999999999998e-05 2020-11-16T20:57:42.883 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.883 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.883 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:42.883 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764511+0000", 2020-11-16T20:57:42.883 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024010632000000001 2020-11-16T20:57:42.884 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.884 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.884 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.884 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788522+0000", 2020-11-16T20:57:42.884 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014091200000000001 2020-11-16T20:57:42.884 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.884 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.885 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.885 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788662+0000", 2020-11-16T20:57:42.885 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015662400000000001 2020-11-16T20:57:42.885 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.885 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.885 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:57:42.885 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788819+0000", 2020-11-16T20:57:42.885 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0045297089999999998 2020-11-16T20:57:42.886 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.886 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.886 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.886 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.793349+0000", 2020-11-16T20:57:42.886 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061836570000000004 2020-11-16T20:57:42.886 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.886 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.887 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:42.887 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.799532+0000", 2020-11-16T20:57:42.887 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0020861299999999998 2020-11-16T20:57:42.887 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.887 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.887 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.887 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801619+0000", 2020-11-16T20:57:42.888 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9320999999999996e-05 2020-11-16T20:57:42.888 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.888 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.888 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:42.888 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801688+0000", 2020-11-16T20:57:42.888 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0909999999999999e-05 2020-11-16T20:57:42.888 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.888 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.889 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.889 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801739+0000", 2020-11-16T20:57:42.889 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037702297000000003 2020-11-16T20:57:42.889 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.889 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.889 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.889 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.890 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.890 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3542 4.0 4:251c4c06:::smithi16641208-378:head [setxattr _header (58) in=7b,truncate 2974971] snapc 55=[55,54] ondisk+write+known_if_redirected e130)", 2020-11-16T20:57:42.890 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.764282+0000", 2020-11-16T20:57:42.890 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 7.8957264660000002, 2020-11-16T20:57:42.890 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037622296999999999, 2020-11-16T20:57:42.890 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.890 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:42.891 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:42.891 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:42.891 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:42.891 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3542 2020-11-16T20:57:42.891 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.891 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.891 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.892 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.892 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764282+0000", 2020-11-16T20:57:42.892 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.892 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.892 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.892 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.892 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764282+0000", 2020-11-16T20:57:42.892 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0065000000000001e-05 2020-11-16T20:57:42.893 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.893 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.893 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.893 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764312+0000", 2020-11-16T20:57:42.893 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2180000000000002e-06 2020-11-16T20:57:42.893 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.893 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.894 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.894 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764320+0000", 2020-11-16T20:57:42.894 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1029000000000001e-05 2020-11-16T20:57:42.894 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.894 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.894 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.894 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764331+0000", 2020-11-16T20:57:42.895 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4589999999999998e-06 2020-11-16T20:57:42.895 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.895 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.895 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.895 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764334+0000", 2020-11-16T20:57:42.895 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020802799999999999 2020-11-16T20:57:42.895 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.895 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.896 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.896 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764542+0000", 2020-11-16T20:57:42.896 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7712e-05 2020-11-16T20:57:42.896 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.896 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.896 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:42.896 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764590+0000", 2020-11-16T20:57:42.897 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025536256 2020-11-16T20:57:42.897 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.897 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.897 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.897 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790126+0000", 2020-11-16T20:57:42.897 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8548000000000007e-05 2020-11-16T20:57:42.897 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.898 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.898 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.898 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790215+0000", 2020-11-16T20:57:42.898 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013994800000000001 2020-11-16T20:57:42.898 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.898 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.898 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:57:42.898 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790355+0000", 2020-11-16T20:57:42.899 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0032107820000000001 2020-11-16T20:57:42.899 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.899 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.899 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.899 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.793565+0000", 2020-11-16T20:57:42.899 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0059758709999999998 2020-11-16T20:57:42.899 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.900 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.900 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:42.900 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.799541+0000", 2020-11-16T20:57:42.900 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002240999 2020-11-16T20:57:42.900 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.900 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.900 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:42.901 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801782+0000", 2020-11-16T20:57:42.901 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9985000000000003e-05 2020-11-16T20:57:42.901 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.901 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.901 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:42.901 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801842+0000", 2020-11-16T20:57:42.902 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2397000000000006e-05 2020-11-16T20:57:42.902 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.902 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.902 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.902 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801905+0000", 2020-11-16T20:57:42.902 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037622296999999999 2020-11-16T20:57:42.902 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.903 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.903 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.903 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.903 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.903 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3543 4.0 4:251c4c06:::smithi16641208-378:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e130)", 2020-11-16T20:57:42.903 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.764352+0000", 2020-11-16T20:57:42.903 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 7.8956564609999997, 2020-11-16T20:57:42.904 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038764630000000001, 2020-11-16T20:57:42.904 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:42.904 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:42.904 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:42.904 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:42.904 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:42.904 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3543 2020-11-16T20:57:42.904 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.905 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:42.905 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.905 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:42.905 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764352+0000", 2020-11-16T20:57:42.905 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:42.905 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.905 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.906 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:42.906 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764352+0000", 2020-11-16T20:57:42.906 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5197999999999999e-05 2020-11-16T20:57:42.906 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.906 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.906 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:42.906 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764368+0000", 2020-11-16T20:57:42.907 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9960000000000002e-06 2020-11-16T20:57:42.907 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.907 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.907 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:42.907 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764371+0000", 2020-11-16T20:57:42.907 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8810000000000001e-06 2020-11-16T20:57:42.907 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.908 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.908 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:42.908 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764376+0000", 2020-11-16T20:57:42.908 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3949999999999999e-06 2020-11-16T20:57:42.908 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.908 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.908 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:42.908 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764379+0000", 2020-11-16T20:57:42.909 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023363999999999999 2020-11-16T20:57:42.909 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.909 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.909 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.909 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764613+0000", 2020-11-16T20:57:42.909 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3958999999999997e-05 2020-11-16T20:57:42.909 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.910 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.910 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:42.910 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764656+0000", 2020-11-16T20:57:42.910 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026048794 2020-11-16T20:57:42.910 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.910 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.910 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.911 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790705+0000", 2020-11-16T20:57:42.911 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013058500000000001 2020-11-16T20:57:42.911 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.911 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.911 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:42.911 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790836+0000", 2020-11-16T20:57:42.911 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011100066 2020-11-16T20:57:42.912 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.912 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.912 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:42.912 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801936+0000", 2020-11-16T20:57:42.912 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3307999999999996e-05 2020-11-16T20:57:42.912 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.912 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.912 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:42.913 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.802019+0000", 2020-11-16T20:57:42.913 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001097808 2020-11-16T20:57:42.913 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:42.913 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:42.913 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:42.913 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.803117+0000", 2020-11-16T20:57:42.913 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038764630000000001 2020-11-16T20:57:42.914 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.914 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.914 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.914 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:42.914 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:42.914 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:42.916 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:57:42.920+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:57:42.916 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:57:42.945 INFO:tasks.rados.rados.0.smithi166.stdout:1129: done (6 left) 2020-11-16T20:57:42.946 INFO:tasks.rados.rados.0.smithi166.stdout:1130: cache_flush oid 490 snap 47 2020-11-16T20:57:42.946 INFO:tasks.rados.rados.0.smithi166.stdout:1122: got (0) Success 2020-11-16T20:57:42.946 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 352 v 0 (ObjNum 597 snap 28 seq_num 597) dirty exists 2020-11-16T20:57:42.946 INFO:tasks.rados.rados.0.smithi166.stdout:1126: finishing write tid 2 to smithi16641208-14 2020-11-16T20:57:42.946 INFO:tasks.rados.rados.0.smithi166.stdout:1126: finishing write tid 3 to smithi16641208-14 2020-11-16T20:57:42.946 INFO:tasks.rados.rados.0.smithi166.stdout:1126: finishing write tid 4 to smithi16641208-14 2020-11-16T20:57:42.947 INFO:tasks.rados.rados.0.smithi166.stdout:1126: finishing write tid 5 to smithi16641208-14 2020-11-16T20:57:42.947 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 14 v 707 (ObjNum 667 snap 48 seq_num 667) dirty exists 2020-11-16T20:57:42.947 INFO:tasks.rados.rados.0.smithi166.stdout:1126: left oid 14 (ObjNum 667 snap 48 seq_num 667) 2020-11-16T20:57:42.947 INFO:tasks.rados.rados.0.smithi166.stdout:1128: finishing rollback tid 0 to smithi16641208-180 2020-11-16T20:57:42.947 INFO:tasks.rados.rados.0.smithi166.stdout:1128: finishing rollback tid 1 to smithi16641208-180 2020-11-16T20:57:42.947 INFO:tasks.rados.rados.0.smithi166.stdout:1125: finishing copy_from to smithi16641208-86 2020-11-16T20:57:42.947 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 86 v 237 (ObjNum 327 snap 0 seq_num 327) dirty exists 2020-11-16T20:57:42.948 INFO:tasks.rados.rados.0.smithi166.stdout:1125: finishing copy_from racing read to smithi16641208-86 2020-11-16T20:57:42.948 INFO:tasks.rados.rados.0.smithi166.stdout:1127: got (0) Success 2020-11-16T20:57:42.948 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 126 v 0 (ObjNum 512 snap 4 seq_num 512) dirty exists 2020-11-16T20:57:42.948 INFO:tasks.rados.rados.0.smithi166.stdout:1121: finishing write tid 2 to smithi16641208-11 2020-11-16T20:57:42.948 INFO:tasks.rados.rados.0.smithi166.stdout:1121: finishing write tid 3 to smithi16641208-11 2020-11-16T20:57:42.948 INFO:tasks.rados.rados.0.smithi166.stdout:1122: done (6 left) 2020-11-16T20:57:42.948 INFO:tasks.rados.rados.0.smithi166.stdout:1125: done (5 left) 2020-11-16T20:57:42.949 INFO:tasks.rados.rados.0.smithi166.stdout:1126: done (4 left) 2020-11-16T20:57:42.949 INFO:tasks.rados.rados.0.smithi166.stdout:1127: done (3 left) 2020-11-16T20:57:42.949 INFO:tasks.rados.rados.0.smithi166.stdout:1131: snap_remove snap 46 2020-11-16T20:57:42.950 INFO:teuthology.orchestra.run.smithi166.stderr:set 4.3 pg_upmap mapping to [4,3,2] 2020-11-16T20:57:43.016 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:43.021+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:43.071 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:43.071 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:57:43.071 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:57:43.071 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:43.081 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:57:43.117 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:43.122+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:43.216 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:43.216 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:57:43.216 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:57:43.217 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:57:43.217 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:43.219 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:43.224+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:43.225 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:57:43.320 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:43.325+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:43.363 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:43.363 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:57:43.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:57:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:57:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2370 4.1 4:82bb0fe7:::smithi16641208-101:head [write 2346424~426830] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:57:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:57:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.312077928999997, 2020-11-16T20:57:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04706581, 2020-11-16T20:57:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2370 2020-11-16T20:57:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:57:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:57:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011081520000000001 2020-11-16T20:57:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055391+0000", 2020-11-16T20:57:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8289999999999996e-06 2020-11-16T20:57:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055397+0000", 2020-11-16T20:57:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7599999999999997e-06 2020-11-16T20:57:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055407+0000", 2020-11-16T20:57:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4180000000000002e-06 2020-11-16T20:57:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055413+0000", 2020-11-16T20:57:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1767000000000001e-05 2020-11-16T20:57:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055465+0000", 2020-11-16T20:57:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1916999999999998e-05 2020-11-16T20:57:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055517+0000", 2020-11-16T20:57:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027302192999999999 2020-11-16T20:57:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.082819+0000", 2020-11-16T20:57:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013272199999999999 2020-11-16T20:57:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.082952+0000", 2020-11-16T20:57:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000218574 2020-11-16T20:57:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083171+0000", 2020-11-16T20:57:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016037374 2020-11-16T20:57:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099208+0000", 2020-11-16T20:57:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001621248 2020-11-16T20:57:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100829+0000", 2020-11-16T20:57:43.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039884700000000003 2020-11-16T20:57:43.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:43.375 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101228+0000", 2020-11-16T20:57:43.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1977000000000006e-05 2020-11-16T20:57:43.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:43.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101300+0000", 2020-11-16T20:57:43.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9032000000000001e-05 2020-11-16T20:57:43.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:43.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101349+0000", 2020-11-16T20:57:43.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04706581 2020-11-16T20:57:43.377 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.377 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:43.377 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.377 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2372 4.1 4:82bb0fe7:::smithi16641208-101:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e42)", 2020-11-16T20:57:43.378 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:57:43.378 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.310848983, 2020-11-16T20:57:43.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046557016999999999, 2020-11-16T20:57:43.378 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:43.378 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:43.378 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:43.378 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:43.379 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:43.379 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2372 2020-11-16T20:57:43.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.379 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:43.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:43.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:57:43.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:43.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.380 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:43.380 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:57:43.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9907000000000001e-05 2020-11-16T20:57:43.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055532+0000", 2020-11-16T20:57:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0599999999999999e-06 2020-11-16T20:57:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:43.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055535+0000", 2020-11-16T20:57:43.382 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1430000000000003e-06 2020-11-16T20:57:43.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.382 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:43.382 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055541+0000", 2020-11-16T20:57:43.382 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6819999999999999e-06 2020-11-16T20:57:43.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.383 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:43.383 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055544+0000", 2020-11-16T20:57:43.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000102643 2020-11-16T20:57:43.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.383 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.383 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055647+0000", 2020-11-16T20:57:43.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7197000000000003e-05 2020-11-16T20:57:43.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:43.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055684+0000", 2020-11-16T20:57:43.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029347807 2020-11-16T20:57:43.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.385 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.085032+0000", 2020-11-16T20:57:43.385 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6130000000000005e-05 2020-11-16T20:57:43.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:43.386 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.085108+0000", 2020-11-16T20:57:43.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016542980999999998 2020-11-16T20:57:43.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.386 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.386 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.386 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101651+0000", 2020-11-16T20:57:43.387 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000118733 2020-11-16T20:57:43.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.387 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:43.387 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101769+0000", 2020-11-16T20:57:43.387 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029973400000000001 2020-11-16T20:57:43.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.388 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:43.388 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.102069+0000", 2020-11-16T20:57:43.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046557016999999999 2020-11-16T20:57:43.388 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.388 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:43.388 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.389 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2503 4.1 4:b0538c7c:::smithi16641208-136:head [write 1790337~563515] snapc f=[f,e,d,5] ondisk+write+known_if_redirected e52)", 2020-11-16T20:57:43.389 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:57:43.389 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 88.619653479999997, 2020-11-16T20:57:43.389 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089724989000000005, 2020-11-16T20:57:43.389 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:43.389 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:43.390 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:43.390 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:43.390 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:43.390 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2503 2020-11-16T20:57:43.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.390 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:43.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.391 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:43.391 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:57:43.391 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:43.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.391 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.391 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:43.391 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:57:43.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00060419599999999999 2020-11-16T20:57:43.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.392 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.392 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:43.392 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747312+0000", 2020-11-16T20:57:43.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.319e-06 2020-11-16T20:57:43.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:43.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747318+0000", 2020-11-16T20:57:43.393 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5100000000000004e-06 2020-11-16T20:57:43.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:43.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747328+0000", 2020-11-16T20:57:43.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6369999999999999e-06 2020-11-16T20:57:43.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:43.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747335+0000", 2020-11-16T20:57:43.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001800479 2020-11-16T20:57:43.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.395 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.395 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749136+0000", 2020-11-16T20:57:43.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7970000000000002e-05 2020-11-16T20:57:43.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.396 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:43.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749194+0000", 2020-11-16T20:57:43.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030847998000000001 2020-11-16T20:57:43.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.396 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780042+0000", 2020-11-16T20:57:43.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013142199999999999 2020-11-16T20:57:43.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:43.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780173+0000", 2020-11-16T20:57:43.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022398200000000001 2020-11-16T20:57:43.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:57:43.398 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780397+0000", 2020-11-16T20:57:43.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061389269999999998 2020-11-16T20:57:43.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:43.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786536+0000", 2020-11-16T20:57:43.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3673999999999998e-05 2020-11-16T20:57:43.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:43.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786630+0000", 2020-11-16T20:57:43.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049513384000000001 2020-11-16T20:57:43.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.400 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:43.400 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836143+0000", 2020-11-16T20:57:43.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4713000000000001e-05 2020-11-16T20:57:43.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:43.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836218+0000", 2020-11-16T20:57:43.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000214778 2020-11-16T20:57:43.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:43.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836433+0000", 2020-11-16T20:57:43.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089724989000000005 2020-11-16T20:57:43.402 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.402 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:43.402 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.402 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2504 4.1 4:b0538c7c:::smithi16641208-136:head [setxattr _header (58) in=7b,truncate 2991745] snapc f=[f,e,d,5] ondisk+write+known_if_redirected e52)", 2020-11-16T20:57:43.403 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:57:43.403 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 88.618979109999998, 2020-11-16T20:57:43.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089341162000000002, 2020-11-16T20:57:43.403 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:43.403 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:43.403 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:43.403 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:43.403 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:43.404 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2504 2020-11-16T20:57:43.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.404 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:43.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.404 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:43.404 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:57:43.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:43.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.405 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:43.405 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:57:43.405 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5520999999999999e-05 2020-11-16T20:57:43.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.406 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:43.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747438+0000", 2020-11-16T20:57:43.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2020-11-16T20:57:43.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.406 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:43.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747444+0000", 2020-11-16T20:57:43.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.661e-06 2020-11-16T20:57:43.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:43.407 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747451+0000", 2020-11-16T20:57:43.407 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6920000000000001e-06 2020-11-16T20:57:43.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:43.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747456+0000", 2020-11-16T20:57:43.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0017949769999999999 2020-11-16T20:57:43.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749251+0000", 2020-11-16T20:57:43.409 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114708 2020-11-16T20:57:43.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.409 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.409 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:43.409 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749366+0000", 2020-11-16T20:57:43.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032215049000000003 2020-11-16T20:57:43.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.410 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.410 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.781581+0000", 2020-11-16T20:57:43.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000181452 2020-11-16T20:57:43.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:43.411 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.781762+0000", 2020-11-16T20:57:43.411 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024118300000000001 2020-11-16T20:57:43.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:57:43.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782003+0000", 2020-11-16T20:57:43.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045997939999999999 2020-11-16T20:57:43.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:43.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786603+0000", 2020-11-16T20:57:43.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8782000000000002e-05 2020-11-16T20:57:43.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:43.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786642+0000", 2020-11-16T20:57:43.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049869098000000001 2020-11-16T20:57:43.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.414 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:43.414 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836511+0000", 2020-11-16T20:57:43.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4498000000000005e-05 2020-11-16T20:57:43.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.414 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:43.414 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836576+0000", 2020-11-16T20:57:43.415 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000147615 2020-11-16T20:57:43.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.415 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:43.415 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836723+0000", 2020-11-16T20:57:43.415 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089341162000000002 2020-11-16T20:57:43.416 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.416 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:43.416 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.416 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2505 4.1 4:b0538c7c:::smithi16641208-136:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e52)", 2020-11-16T20:57:43.416 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:57:43.416 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 88.618869982000007, 2020-11-16T20:57:43.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089929617000000003, 2020-11-16T20:57:43.417 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:43.417 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:43.417 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:43.417 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:43.417 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:43.417 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2505 2020-11-16T20:57:43.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.418 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:43.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:43.419 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:57:43.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:43.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.419 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:43.419 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:57:43.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1894999999999999e-05 2020-11-16T20:57:43.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.420 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:43.420 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747523+0000", 2020-11-16T20:57:43.420 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3900000000000003e-06 2020-11-16T20:57:43.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.420 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:43.421 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747527+0000", 2020-11-16T20:57:43.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8169999999999999e-06 2020-11-16T20:57:43.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.421 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:43.421 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747535+0000", 2020-11-16T20:57:43.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6449999999999998e-06 2020-11-16T20:57:43.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.422 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:43.422 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747539+0000", 2020-11-16T20:57:43.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0018868209999999999 2020-11-16T20:57:43.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.423 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.423 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749426+0000", 2020-11-16T20:57:43.423 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4963000000000002e-05 2020-11-16T20:57:43.423 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.423 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:43.423 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749481+0000", 2020-11-16T20:57:43.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032915959000000002 2020-11-16T20:57:43.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.424 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782397+0000", 2020-11-16T20:57:43.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018449499999999999 2020-11-16T20:57:43.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.425 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:43.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782581+0000", 2020-11-16T20:57:43.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054195457000000002 2020-11-16T20:57:43.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.425 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836777+0000", 2020-11-16T20:57:43.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000214584 2020-11-16T20:57:43.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:43.426 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836991+0000", 2020-11-16T20:57:43.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000429591 2020-11-16T20:57:43.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.427 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:43.427 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.837421+0000", 2020-11-16T20:57:43.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089929617000000003 2020-11-16T20:57:43.427 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.427 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:43.427 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.428 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2593 3.3 3:f5f8fa2a:::smithi16641208-144:head [copy-from ver 64] snapc 14=[12,f,5] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e57)", 2020-11-16T20:57:43.428 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:57:43.428 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 83.579721121000006, 2020-11-16T20:57:43.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064638111999999998, 2020-11-16T20:57:43.428 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:43.428 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:43.429 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:43.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:43.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:57:43.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:43.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:43.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:57:43.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3655999999999998e-05 2020-11-16T20:57:43.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:43.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786664+0000", 2020-11-16T20:57:43.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1850000000000003e-06 2020-11-16T20:57:43.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:43.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786669+0000", 2020-11-16T20:57:43.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0861e-05 2020-11-16T20:57:43.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:43.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786680+0000", 2020-11-16T20:57:43.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6749999999999996e-06 2020-11-16T20:57:43.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:43.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786686+0000", 2020-11-16T20:57:43.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2327000000000003e-05 2020-11-16T20:57:43.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.433 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.433 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786729+0000", 2020-11-16T20:57:43.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000156143 2020-11-16T20:57:43.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:43.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786885+0000", 2020-11-16T20:57:43.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024103846000000002 2020-11-16T20:57:43.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:57:43.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810989+0000", 2020-11-16T20:57:43.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018870436000000001 2020-11-16T20:57:43.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:43.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829859+0000", 2020-11-16T20:57:43.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021210896 2020-11-16T20:57:43.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.436 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:43.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851070+0000", 2020-11-16T20:57:43.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3708e-05 2020-11-16T20:57:43.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.436 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:43.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851084+0000", 2020-11-16T20:57:43.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7329e-05 2020-11-16T20:57:43.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:43.437 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851131+0000", 2020-11-16T20:57:43.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014705 2020-11-16T20:57:43.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.438 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:43.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851278+0000", 2020-11-16T20:57:43.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064638111999999998 2020-11-16T20:57:43.438 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.438 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:43.438 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.439 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:616 3.3 3:f5f8fa2a:::smithi16641208-144:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e57)", 2020-11-16T20:57:43.439 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:57:43.439 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 83.579630467000001, 2020-11-16T20:57:43.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064784234999999996, 2020-11-16T20:57:43.439 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:43.439 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:43.440 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:43.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:43.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:57:43.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:43.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:43.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:57:43.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8559999999999998e-05 2020-11-16T20:57:43.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:43.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786749+0000", 2020-11-16T20:57:43.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4549999999999997e-06 2020-11-16T20:57:43.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:43.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786754+0000", 2020-11-16T20:57:43.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4980000000000006e-06 2020-11-16T20:57:43.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:43.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786762+0000", 2020-11-16T20:57:43.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9790000000000004e-06 2020-11-16T20:57:43.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:43.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786766+0000", 2020-11-16T20:57:43.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029976900000000002 2020-11-16T20:57:43.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787066+0000", 2020-11-16T20:57:43.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3581999999999998e-05 2020-11-16T20:57:43.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:43.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787100+0000", 2020-11-16T20:57:43.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.037252078000000001 2020-11-16T20:57:43.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824352+0000", 2020-11-16T20:57:43.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000124189 2020-11-16T20:57:43.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:43.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824476+0000", 2020-11-16T20:57:43.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026883987000000002 2020-11-16T20:57:43.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851360+0000", 2020-11-16T20:57:43.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6365999999999994e-05 2020-11-16T20:57:43.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:43.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851426+0000", 2020-11-16T20:57:43.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8771999999999996e-05 2020-11-16T20:57:43.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:43.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851515+0000", 2020-11-16T20:57:43.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064784234999999996 2020-11-16T20:57:43.448 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.449 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:43.449 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.449 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:617 3.3 3:f5f8fa2a:::smithi16641208-144:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e57)", 2020-11-16T20:57:43.449 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:57:43.449 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 83.579560151999999, 2020-11-16T20:57:43.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.069756316999999998, 2020-11-16T20:57:43.450 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:43.450 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:43.450 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:43.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:43.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:57:43.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:43.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.451 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:43.451 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:57:43.451 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3865000000000002e-05 2020-11-16T20:57:43.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:43.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786835+0000", 2020-11-16T20:57:43.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6949999999999999e-06 2020-11-16T20:57:43.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:43.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786840+0000", 2020-11-16T20:57:43.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3559999999999999e-06 2020-11-16T20:57:43.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:43.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786849+0000", 2020-11-16T20:57:43.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.045e-06 2020-11-16T20:57:43.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:43.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786854+0000", 2020-11-16T20:57:43.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026743999999999997 2020-11-16T20:57:43.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787121+0000", 2020-11-16T20:57:43.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8912000000000001e-05 2020-11-16T20:57:43.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:43.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787180+0000", 2020-11-16T20:57:43.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.042545010000000001 2020-11-16T20:57:43.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.456 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829725+0000", 2020-11-16T20:57:43.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3979000000000003e-05 2020-11-16T20:57:43.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:43.456 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829819+0000", 2020-11-16T20:57:43.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021745652000000001 2020-11-16T20:57:43.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851565+0000", 2020-11-16T20:57:43.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000102064 2020-11-16T20:57:43.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:43.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851667+0000", 2020-11-16T20:57:43.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048902989999999999 2020-11-16T20:57:43.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:43.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856557+0000", 2020-11-16T20:57:43.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.069756316999999998 2020-11-16T20:57:43.459 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.459 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:43.459 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.459 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:618 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'243, mlcod=57'241)", 2020-11-16T20:57:43.460 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:57:43.460 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 83.566741027999996, 2020-11-16T20:57:43.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048895281999999998, 2020-11-16T20:57:43.460 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:43.460 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:43.460 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:43.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:43.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:57:43.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:43.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:43.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:57:43.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017163861999999998 2020-11-16T20:57:43.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:43.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816784+0000", 2020-11-16T20:57:43.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7071e-05 2020-11-16T20:57:43.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:43.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816801+0000", 2020-11-16T20:57:43.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6405e-05 2020-11-16T20:57:43.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.463 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:43.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816818+0000", 2020-11-16T20:57:43.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3030999999999999e-05 2020-11-16T20:57:43.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:43.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816831+0000", 2020-11-16T20:57:43.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4610000000000007e-05 2020-11-16T20:57:43.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816895+0000", 2020-11-16T20:57:43.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4202999999999998e-05 2020-11-16T20:57:43.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:43.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816929+0000", 2020-11-16T20:57:43.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.031527016999999997 2020-11-16T20:57:43.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:43.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.848456+0000", 2020-11-16T20:57:43.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9083000000000003e-05 2020-11-16T20:57:43.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:43.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.848515+0000", 2020-11-16T20:57:43.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048895281999999998 2020-11-16T20:57:43.467 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.467 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:43.467 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.468 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:618 3.3 3:d775beee:::smithi16641208-10:head [copy-from ver 12] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:57:43.468 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:57:43.468 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 83.557558959000005, 2020-11-16T20:57:43.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047870862, 2020-11-16T20:57:43.468 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:43.468 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:43.468 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:43.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:43.469 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:57:43.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:43.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:43.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:57:43.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0958999999999999e-05 2020-11-16T20:57:43.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:43.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808843+0000", 2020-11-16T20:57:43.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1294000000000001e-05 2020-11-16T20:57:43.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:43.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808854+0000", 2020-11-16T20:57:43.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8553999999999997e-05 2020-11-16T20:57:43.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:43.472 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808893+0000", 2020-11-16T20:57:43.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1985e-05 2020-11-16T20:57:43.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.472 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.472 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:43.472 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808905+0000", 2020-11-16T20:57:43.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7309000000000001e-05 2020-11-16T20:57:43.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.473 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.473 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.473 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808982+0000", 2020-11-16T20:57:43.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016374099999999999 2020-11-16T20:57:43.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.473 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.473 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:43.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809146+0000", 2020-11-16T20:57:43.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015955815000000002 2020-11-16T20:57:43.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:57:43.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.825102+0000", 2020-11-16T20:57:43.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048434799999999998 2020-11-16T20:57:43.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.475 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:43.475 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829945+0000", 2020-11-16T20:57:43.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021349677000000001 2020-11-16T20:57:43.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:43.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851295+0000", 2020-11-16T20:57:43.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052994100000000001 2020-11-16T20:57:43.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:43.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856594+0000", 2020-11-16T20:57:43.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3349000000000001e-05 2020-11-16T20:57:43.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.477 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:43.477 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856638+0000", 2020-11-16T20:57:43.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5289e-05 2020-11-16T20:57:43.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.478 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:43.478 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856673+0000", 2020-11-16T20:57:43.478 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047870862 2020-11-16T20:57:43.478 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.478 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:43.478 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.479 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:619 3.3 3:d79d68cf:::smithi16641208-37:head [copy-from ver 27] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:57:43.479 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:57:43.479 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 83.557000368999994, 2020-11-16T20:57:43.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047415915000000003, 2020-11-16T20:57:43.479 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:43.479 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:43.479 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:43.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:43.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:57:43.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:43.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:43.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:57:43.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3012000000000002e-05 2020-11-16T20:57:43.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:43.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809394+0000", 2020-11-16T20:57:43.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1699999999999996e-06 2020-11-16T20:57:43.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.482 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:43.482 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809399+0000", 2020-11-16T20:57:43.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2390000000000008e-06 2020-11-16T20:57:43.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.482 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:43.483 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809408+0000", 2020-11-16T20:57:43.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0259999999999998e-06 2020-11-16T20:57:43.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.483 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:43.483 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809413+0000", 2020-11-16T20:57:43.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0359999999999996e-05 2020-11-16T20:57:43.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809494+0000", 2020-11-16T20:57:43.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019616600000000001 2020-11-16T20:57:43.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:43.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809690+0000", 2020-11-16T20:57:43.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017673003999999999 2020-11-16T20:57:43.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:57:43.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.827363+0000", 2020-11-16T20:57:43.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006463033 2020-11-16T20:57:43.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:43.486 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.833826+0000", 2020-11-16T20:57:43.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017479913999999999 2020-11-16T20:57:43.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:43.487 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851306+0000", 2020-11-16T20:57:43.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054026500000000002 2020-11-16T20:57:43.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.487 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:43.487 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856708+0000", 2020-11-16T20:57:43.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8121999999999999e-05 2020-11-16T20:57:43.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:43.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856747+0000", 2020-11-16T20:57:43.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0219e-05 2020-11-16T20:57:43.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:43.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856777+0000", 2020-11-16T20:57:43.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047415915000000003 2020-11-16T20:57:43.489 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.489 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:43.489 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.490 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2994 4.1 4:81514658:::smithi16641208-76:head [rollback 25] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:43.490 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:48.838310+0000", 2020-11-16T20:57:43.490 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 54.528051175999998, 2020-11-16T20:57:43.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.058717898999999997, 2020-11-16T20:57:43.490 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:43.490 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:43.490 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:43.491 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:43.491 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:43.491 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2994 2020-11-16T20:57:43.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.491 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:43.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.491 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:43.491 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838310+0000", 2020-11-16T20:57:43.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:43.492 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.492 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.492 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:43.492 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838310+0000", 2020-11-16T20:57:43.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6189e-05 2020-11-16T20:57:43.492 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:43.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838326+0000", 2020-11-16T20:57:43.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7750000000000001e-06 2020-11-16T20:57:43.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:43.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838329+0000", 2020-11-16T20:57:43.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1170000000000003e-06 2020-11-16T20:57:43.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:43.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838334+0000", 2020-11-16T20:57:43.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5509999999999998e-06 2020-11-16T20:57:43.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.495 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:43.495 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838337+0000", 2020-11-16T20:57:43.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4969999999999995e-05 2020-11-16T20:57:43.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.495 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838422+0000", 2020-11-16T20:57:43.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6809999999999998e-06 2020-11-16T20:57:43.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.496 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:43.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838429+0000", 2020-11-16T20:57:43.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0036974120000000002 2020-11-16T20:57:43.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.497 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.842127+0000", 2020-11-16T20:57:43.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7267000000000005e-05 2020-11-16T20:57:43.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:43.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.842194+0000", 2020-11-16T20:57:43.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036580992999999999 2020-11-16T20:57:43.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.878775+0000", 2020-11-16T20:57:43.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015282199999999999 2020-11-16T20:57:43.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:43.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.878928+0000", 2020-11-16T20:57:43.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025942000000000001 2020-11-16T20:57:43.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:43.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879187+0000", 2020-11-16T20:57:43.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6735000000000003e-05 2020-11-16T20:57:43.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:43.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879264+0000", 2020-11-16T20:57:43.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0079699739999999995 2020-11-16T20:57:43.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.887234+0000", 2020-11-16T20:57:43.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011584899999999999 2020-11-16T20:57:43.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:43.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.887350+0000", 2020-11-16T20:57:43.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019960799999999999 2020-11-16T20:57:43.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:57:43.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.887549+0000", 2020-11-16T20:57:43.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059496410000000003 2020-11-16T20:57:43.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893499+0000", 2020-11-16T20:57:43.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8387999999999997e-05 2020-11-16T20:57:43.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for ondisk", 2020-11-16T20:57:43.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893557+0000", 2020-11-16T20:57:43.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1730000000000005e-05 2020-11-16T20:57:43.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:43.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893639+0000", 2020-11-16T20:57:43.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0030284309999999998 2020-11-16T20:57:43.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:43.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.896668+0000", 2020-11-16T20:57:43.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024878999999999998 2020-11-16T20:57:43.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:43.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.896916+0000", 2020-11-16T20:57:43.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6546999999999998e-05 2020-11-16T20:57:43.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:43.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.896983+0000", 2020-11-16T20:57:43.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5009000000000002e-05 2020-11-16T20:57:43.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:43.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.897028+0000", 2020-11-16T20:57:43.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.058717898999999997 2020-11-16T20:57:43.507 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.507 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:43.508 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.508 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2995 4.1 4:81514658:::smithi16641208-76:head [append 0~0] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:43.508 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:48.838353+0000", 2020-11-16T20:57:43.508 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 54.528007916, 2020-11-16T20:57:43.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.061235559000000002, 2020-11-16T20:57:43.509 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:43.509 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:43.509 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:43.509 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:43.509 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:43.509 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2995 2020-11-16T20:57:43.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.509 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:43.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:43.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838353+0000", 2020-11-16T20:57:43.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:43.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:43.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838353+0000", 2020-11-16T20:57:43.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5333e-05 2020-11-16T20:57:43.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:43.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838369+0000", 2020-11-16T20:57:43.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6699999999999998e-06 2020-11-16T20:57:43.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.512 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:43.512 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838371+0000", 2020-11-16T20:57:43.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9450000000000001e-06 2020-11-16T20:57:43.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.512 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:43.513 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838376+0000", 2020-11-16T20:57:43.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3810000000000002e-06 2020-11-16T20:57:43.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.513 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:43.513 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838379+0000", 2020-11-16T20:57:43.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6501000000000006e-05 2020-11-16T20:57:43.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.514 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.514 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838445+0000", 2020-11-16T20:57:43.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7589999999999999e-06 2020-11-16T20:57:43.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.514 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:43.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838449+0000", 2020-11-16T20:57:43.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003788249 2020-11-16T20:57:43.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.842237+0000", 2020-11-16T20:57:43.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4104999999999997e-05 2020-11-16T20:57:43.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:43.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.842301+0000", 2020-11-16T20:57:43.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.037139272000000001 2020-11-16T20:57:43.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.517 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879440+0000", 2020-11-16T20:57:43.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3401e-05 2020-11-16T20:57:43.517 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.517 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:43.517 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879484+0000", 2020-11-16T20:57:43.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014179615 2020-11-16T20:57:43.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.518 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893664+0000", 2020-11-16T20:57:43.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6710000000000002e-05 2020-11-16T20:57:43.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:43.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893750+0000", 2020-11-16T20:57:43.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015452900000000001 2020-11-16T20:57:43.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:57:43.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893905+0000", 2020-11-16T20:57:43.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0013753280000000001 2020-11-16T20:57:43.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:43.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.895280+0000", 2020-11-16T20:57:43.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014309889999999999 2020-11-16T20:57:43.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:43.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.896711+0000", 2020-11-16T20:57:43.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0027635649999999999 2020-11-16T20:57:43.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:43.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.899475+0000", 2020-11-16T20:57:43.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3380999999999997e-05 2020-11-16T20:57:43.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.522 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:43.522 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.899518+0000", 2020-11-16T20:57:43.522 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0826000000000003e-05 2020-11-16T20:57:43.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:43.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.899589+0000", 2020-11-16T20:57:43.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.061235559000000002 2020-11-16T20:57:43.523 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.523 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:43.523 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.524 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3414 3.3 3:cf270c70:::smithi16641208-423:head [copy-from ver 586] snapc 4f=[4f,48] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e120)", 2020-11-16T20:57:43.524 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:24.761756+0000", 2020-11-16T20:57:43.524 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.604605070000002, 2020-11-16T20:57:43.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.053488604000000002, 2020-11-16T20:57:43.524 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:43.524 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:43.524 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:43.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.525 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:43.525 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761756+0000", 2020-11-16T20:57:43.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:43.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.525 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:43.525 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761756+0000", 2020-11-16T20:57:43.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5970000000000006e-05 2020-11-16T20:57:43.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.526 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:43.526 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761832+0000", 2020-11-16T20:57:43.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4884e-05 2020-11-16T20:57:43.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:43.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761847+0000", 2020-11-16T20:57:43.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6169999999999998e-05 2020-11-16T20:57:43.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:43.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761873+0000", 2020-11-16T20:57:43.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5098e-05 2020-11-16T20:57:43.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:43.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761888+0000", 2020-11-16T20:57:43.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6729000000000003e-05 2020-11-16T20:57:43.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761965+0000", 2020-11-16T20:57:43.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0786e-05 2020-11-16T20:57:43.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2020-11-16T20:57:43.530 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761976+0000", 2020-11-16T20:57:43.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011800241 2020-11-16T20:57:43.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.530 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.530 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.773776+0000", 2020-11-16T20:57:43.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000228559 2020-11-16T20:57:43.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:43.531 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.774005+0000", 2020-11-16T20:57:43.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020761585999999999 2020-11-16T20:57:43.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:57:43.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.794766+0000", 2020-11-16T20:57:43.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013313459 2020-11-16T20:57:43.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:43.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.808080+0000", 2020-11-16T20:57:43.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0063703730000000004 2020-11-16T20:57:43.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:43.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.814450+0000", 2020-11-16T20:57:43.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00063777099999999998 2020-11-16T20:57:43.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:43.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.815088+0000", 2020-11-16T20:57:43.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4383999999999998e-05 2020-11-16T20:57:43.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:43.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.815162+0000", 2020-11-16T20:57:43.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2594000000000002e-05 2020-11-16T20:57:43.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.535 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:43.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.815245+0000", 2020-11-16T20:57:43.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.053488604000000002 2020-11-16T20:57:43.535 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.535 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:43.535 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.536 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.1.13:756 3.3 3:cf270c70:::smithi16641208-423:head [stat] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+known_if_redirected e120)", 2020-11-16T20:57:43.536 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:24.761953+0000", 2020-11-16T20:57:43.536 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.604408072999998, 2020-11-16T20:57:43.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.053471185999999997, 2020-11-16T20:57:43.536 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:43.537 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:43.537 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:43.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:43.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761953+0000", 2020-11-16T20:57:43.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:43.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.538 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:43.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761953+0000", 2020-11-16T20:57:43.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9965000000000001e-05 2020-11-16T20:57:43.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.538 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:43.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761993+0000", 2020-11-16T20:57:43.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2689999999999999e-06 2020-11-16T20:57:43.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.539 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:43.539 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762001+0000", 2020-11-16T20:57:43.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0395999999999999e-05 2020-11-16T20:57:43.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:43.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762022+0000", 2020-11-16T20:57:43.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0159000000000001e-05 2020-11-16T20:57:43.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:43.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762042+0000", 2020-11-16T20:57:43.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6938000000000002e-05 2020-11-16T20:57:43.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762109+0000", 2020-11-16T20:57:43.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1065e-05 2020-11-16T20:57:43.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:43.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762120+0000", 2020-11-16T20:57:43.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012140096 2020-11-16T20:57:43.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.774260+0000", 2020-11-16T20:57:43.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6675999999999997e-05 2020-11-16T20:57:43.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.543 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:43.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.774327+0000", 2020-11-16T20:57:43.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029616773999999998 2020-11-16T20:57:43.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.803943+0000", 2020-11-16T20:57:43.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9145e-05 2020-11-16T20:57:43.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:43.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.804043+0000", 2020-11-16T20:57:43.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011230571 2020-11-16T20:57:43.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.545 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.815273+0000", 2020-11-16T20:57:43.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7762999999999995e-05 2020-11-16T20:57:43.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:43.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.815341+0000", 2020-11-16T20:57:43.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3368999999999994e-05 2020-11-16T20:57:43.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:43.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.815424+0000", 2020-11-16T20:57:43.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.053471185999999997 2020-11-16T20:57:43.547 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.547 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:43.547 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.548 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.1.13:757 3.3 3:f6d44bd7:::smithi16641208-454:head [copy-from ver 347] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e120)", 2020-11-16T20:57:43.548 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:24.762096+0000", 2020-11-16T20:57:43.548 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.604265445999999, 2020-11-16T20:57:43.548 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054426929999999998, 2020-11-16T20:57:43.548 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:43.548 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:43.548 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:43.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.549 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:43.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762096+0000", 2020-11-16T20:57:43.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:43.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.549 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:43.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762096+0000", 2020-11-16T20:57:43.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1792000000000002e-05 2020-11-16T20:57:43.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:43.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762148+0000", 2020-11-16T20:57:43.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7875000000000001e-05 2020-11-16T20:57:43.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:43.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762165+0000", 2020-11-16T20:57:43.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8303000000000001e-05 2020-11-16T20:57:43.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:43.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762184+0000", 2020-11-16T20:57:43.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.499e-06 2020-11-16T20:57:43.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.552 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:43.552 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762193+0000", 2020-11-16T20:57:43.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6016999999999997e-05 2020-11-16T20:57:43.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762239+0000", 2020-11-16T20:57:43.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5139e-05 2020-11-16T20:57:43.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:43.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762254+0000", 2020-11-16T20:57:43.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01212732 2020-11-16T20:57:43.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.774382+0000", 2020-11-16T20:57:43.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000163406 2020-11-16T20:57:43.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:43.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.774545+0000", 2020-11-16T20:57:43.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.025303895 2020-11-16T20:57:43.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:57:43.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.799849+0000", 2020-11-16T20:57:43.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011849052000000001 2020-11-16T20:57:43.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.556 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:43.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.811698+0000", 2020-11-16T20:57:43.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0042176150000000001 2020-11-16T20:57:43.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:43.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.815916+0000", 2020-11-16T20:57:43.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00050456899999999996 2020-11-16T20:57:43.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:43.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.816420+0000", 2020-11-16T20:57:43.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8441000000000004e-05 2020-11-16T20:57:43.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:43.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.816489+0000", 2020-11-16T20:57:43.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4007000000000002e-05 2020-11-16T20:57:43.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:43.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.816523+0000", 2020-11-16T20:57:43.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054426929999999998 2020-11-16T20:57:43.559 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.559 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:43.559 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.560 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3532 4.1 4:b7adb356:::smithi16641208-217:head [copy-from ver 367] snapc 55=[55,54] ondisk+write+known_if_redirected e130)", 2020-11-16T20:57:43.560 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:34.748337+0000", 2020-11-16T20:57:43.560 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 8.618024535, 2020-11-16T20:57:43.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.052818308000000001, 2020-11-16T20:57:43.560 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:43.560 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:43.561 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:43.561 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:43.561 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:43.561 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3532 2020-11-16T20:57:43.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.561 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:43.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:43.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748337+0000", 2020-11-16T20:57:43.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:43.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:43.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748337+0000", 2020-11-16T20:57:43.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6903999999999997e-05 2020-11-16T20:57:43.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:43.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748384+0000", 2020-11-16T20:57:43.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5290000000000008e-06 2020-11-16T20:57:43.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:43.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748392+0000", 2020-11-16T20:57:43.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4324999999999999e-05 2020-11-16T20:57:43.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:43.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748406+0000", 2020-11-16T20:57:43.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0919999999999998e-06 2020-11-16T20:57:43.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:43.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748415+0000", 2020-11-16T20:57:43.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0488000000000001e-05 2020-11-16T20:57:43.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748475+0000", 2020-11-16T20:57:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1545999999999999e-05 2020-11-16T20:57:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2020-11-16T20:57:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748487+0000", 2020-11-16T20:57:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045843469999999999 2020-11-16T20:57:43.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.753071+0000", 2020-11-16T20:57:43.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048079260999999998 2020-11-16T20:57:43.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:43.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.801150+0000", 2020-11-16T20:57:43.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8160000000000001e-06 2020-11-16T20:57:43.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:43.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.801155+0000", 2020-11-16T20:57:43.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.052818308000000001 2020-11-16T20:57:43.569 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.569 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:43.569 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.569 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3533 4.1 4:b7adb356:::smithi16641208-217:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e130)", 2020-11-16T20:57:43.569 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:34.748456+0000", 2020-11-16T20:57:43.570 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 8.6179049400000007, 2020-11-16T20:57:43.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.068028942999999995, 2020-11-16T20:57:43.570 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:43.570 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:43.570 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:43.570 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:43.570 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:43.571 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3533 2020-11-16T20:57:43.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.571 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:43.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.571 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:43.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748456+0000", 2020-11-16T20:57:43.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:43.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:43.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748456+0000", 2020-11-16T20:57:43.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3272000000000003e-05 2020-11-16T20:57:43.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:43.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748490+0000", 2020-11-16T20:57:43.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8499999999999999e-06 2020-11-16T20:57:43.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:43.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748495+0000", 2020-11-16T20:57:43.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.188e-05 2020-11-16T20:57:43.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:43.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748507+0000", 2020-11-16T20:57:43.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6810000000000003e-06 2020-11-16T20:57:43.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:43.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748513+0000", 2020-11-16T20:57:43.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2339999999999998e-05 2020-11-16T20:57:43.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748555+0000", 2020-11-16T20:57:43.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2700000000000004e-06 2020-11-16T20:57:43.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:43.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748564+0000", 2020-11-16T20:57:43.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004936607 2020-11-16T20:57:43.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.753500+0000", 2020-11-16T20:57:43.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5847999999999998e-05 2020-11-16T20:57:43.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:43.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.753556+0000", 2020-11-16T20:57:43.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056272167999999997 2020-11-16T20:57:43.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.809828+0000", 2020-11-16T20:57:43.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000131536 2020-11-16T20:57:43.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:43.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.809960+0000", 2020-11-16T20:57:43.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0063663030000000002 2020-11-16T20:57:43.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.816326+0000", 2020-11-16T20:57:43.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1303000000000004e-05 2020-11-16T20:57:43.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:43.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.816407+0000", 2020-11-16T20:57:43.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7885000000000004e-05 2020-11-16T20:57:43.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:43.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.816485+0000", 2020-11-16T20:57:43.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.068028942999999995 2020-11-16T20:57:43.581 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.581 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:43.581 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3535 4.1 4:b803c1f1:::smithi16641208-291:head [rollback 55] snapc 55=[55,54] ondisk+write+known_if_redirected e130)", 2020-11-16T20:57:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:34.748646+0000", 2020-11-16T20:57:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 8.6177153840000003, 2020-11-16T20:57:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.052434296999999998, 2020-11-16T20:57:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3535 2020-11-16T20:57:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748646+0000", 2020-11-16T20:57:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748646+0000", 2020-11-16T20:57:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4683000000000001e-05 2020-11-16T20:57:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748670+0000", 2020-11-16T20:57:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7220000000000002e-06 2020-11-16T20:57:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748677+0000", 2020-11-16T20:57:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8769999999999993e-06 2020-11-16T20:57:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748685+0000", 2020-11-16T20:57:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2120000000000002e-06 2020-11-16T20:57:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748690+0000", 2020-11-16T20:57:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4085000000000003e-05 2020-11-16T20:57:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748724+0000", 2020-11-16T20:57:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3529999999999995e-06 2020-11-16T20:57:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748733+0000", 2020-11-16T20:57:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052195999999999996 2020-11-16T20:57:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.753952+0000", 2020-11-16T20:57:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9178000000000003e-05 2020-11-16T20:57:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.753992+0000", 2020-11-16T20:57:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022619554 2020-11-16T20:57:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.776611+0000", 2020-11-16T20:57:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000185613 2020-11-16T20:57:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.776797+0000", 2020-11-16T20:57:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00033552199999999999 2020-11-16T20:57:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.777132+0000", 2020-11-16T20:57:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8034000000000001e-05 2020-11-16T20:57:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.777180+0000", 2020-11-16T20:57:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0075869199999999996 2020-11-16T20:57:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.784767+0000", 2020-11-16T20:57:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000104366 2020-11-16T20:57:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.784872+0000", 2020-11-16T20:57:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018961 2020-11-16T20:57:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:57:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.785061+0000", 2020-11-16T20:57:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056996800000000004 2020-11-16T20:57:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.790761+0000", 2020-11-16T20:57:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6718999999999995e-05 2020-11-16T20:57:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for ondisk", 2020-11-16T20:57:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.790838+0000", 2020-11-16T20:57:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002494029 2020-11-16T20:57:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.793332+0000", 2020-11-16T20:57:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00038463800000000003 2020-11-16T20:57:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.793716+0000", 2020-11-16T20:57:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072152859999999996 2020-11-16T20:57:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.800931+0000", 2020-11-16T20:57:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4564e-05 2020-11-16T20:57:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.801006+0000", 2020-11-16T20:57:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4052000000000002e-05 2020-11-16T20:57:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.801080+0000", 2020-11-16T20:57:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.052434296999999998 2020-11-16T20:57:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3536 4.1 4:b803c1f1:::smithi16641208-291:head [append 0~0] snapc 55=[55,54] ondisk+write+known_if_redirected e130)", 2020-11-16T20:57:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:34.748726+0000", 2020-11-16T20:57:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 8.6176349240000008, 2020-11-16T20:57:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.052564835999999997, 2020-11-16T20:57:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:43.601 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:43.601 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:43.601 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:43.601 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:43.601 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3536 2020-11-16T20:57:43.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.601 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:43.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:43.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748726+0000", 2020-11-16T20:57:43.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:43.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:43.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748726+0000", 2020-11-16T20:57:43.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1303999999999997e-05 2020-11-16T20:57:43.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:43.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748758+0000", 2020-11-16T20:57:43.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4749999999999998e-06 2020-11-16T20:57:43.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:43.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748764+0000", 2020-11-16T20:57:43.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1039999999999999e-05 2020-11-16T20:57:43.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:43.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748775+0000", 2020-11-16T20:57:43.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0326000000000001e-05 2020-11-16T20:57:43.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:43.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748785+0000", 2020-11-16T20:57:43.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5252000000000003e-05 2020-11-16T20:57:43.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748871+0000", 2020-11-16T20:57:43.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6369999999999999e-06 2020-11-16T20:57:43.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:43.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748878+0000", 2020-11-16T20:57:43.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.005142509 2020-11-16T20:57:43.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.754021+0000", 2020-11-16T20:57:43.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9263000000000001e-05 2020-11-16T20:57:43.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:43.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.754050+0000", 2020-11-16T20:57:43.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023184664000000001 2020-11-16T20:57:43.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.777235+0000", 2020-11-16T20:57:43.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0120999999999998e-05 2020-11-16T20:57:43.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:43.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.777265+0000", 2020-11-16T20:57:43.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013605528 2020-11-16T20:57:43.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:43.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.790870+0000", 2020-11-16T20:57:43.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000135308 2020-11-16T20:57:43.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:43.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.791006+0000", 2020-11-16T20:57:43.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00021127799999999999 2020-11-16T20:57:43.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:57:43.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.791217+0000", 2020-11-16T20:57:43.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0024643 2020-11-16T20:57:43.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:43.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.793681+0000", 2020-11-16T20:57:43.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1199000000000003e-05 2020-11-16T20:57:43.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:43.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.793722+0000", 2020-11-16T20:57:43.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074752639999999997 2020-11-16T20:57:43.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.613 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:43.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.801198+0000", 2020-11-16T20:57:43.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3113000000000004e-05 2020-11-16T20:57:43.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:43.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.801261+0000", 2020-11-16T20:57:43.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0255000000000001e-05 2020-11-16T20:57:43.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:43.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:43.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:43.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.801291+0000", 2020-11-16T20:57:43.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.052564835999999997 2020-11-16T20:57:43.615 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.615 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:43.615 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.615 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:43.615 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:43.615 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:43.620 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2020-11-16T20:57:43.621 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:43.625+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:43.622 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:57:43.721 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:57:43.725+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:57:43.759 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:43.759 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:57:43.759 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:57:43.760 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:43.768 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:57:43.821 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:43.827+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:43.922 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:43.927+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:43.943 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:43.943 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:57:43.943 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:57:43.944 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:57:43.944 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:43.953 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:57:43.964 INFO:tasks.rados.rados.0.smithi166.stdout:1131: done (3 left) 2020-11-16T20:57:43.965 INFO:tasks.rados.rados.0.smithi166.stdout:1132: read oid 10 snap -1 2020-11-16T20:57:43.965 INFO:tasks.rados.rados.0.smithi166.stdout:1132: expect (ObjNum 443 snap 0 seq_num 443) 2020-11-16T20:57:43.965 INFO:tasks.rados.rados.0.smithi166.stdout:1133: read oid 140 snap -1 2020-11-16T20:57:43.965 INFO:tasks.rados.rados.0.smithi166.stdout:1133: expect (ObjNum 525 snap 6 seq_num 525) 2020-11-16T20:57:43.965 INFO:tasks.rados.rados.0.smithi166.stdout:1134: rollback oid 223 current snap is 48 2020-11-16T20:57:43.965 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 223 to 47 2020-11-16T20:57:43.966 INFO:tasks.rados.rados.0.smithi166.stdout:1135: cache_evict oid 67 snap 47 2020-11-16T20:57:43.966 INFO:tasks.rados.rados.0.smithi166.stdout:1136: read oid 27 snap 47 2020-11-16T20:57:43.966 INFO:tasks.rados.rados.0.smithi166.stdout:1136: expect (ObjNum 26 snap 0 seq_num 26) 2020-11-16T20:57:43.966 INFO:tasks.rados.rados.0.smithi166.stdout:1137: write oid 483 current snap is 48 2020-11-16T20:57:43.966 INFO:tasks.rados.rados.0.smithi166.stdout:1137: seq_num 668 ranges {427076=789043,1706795=767562,2944912=282164} 2020-11-16T20:57:43.966 INFO:teuthology.orchestra.run.smithi166.stderr:nodeep-scrub is set 2020-11-16T20:57:43.968 INFO:tasks.rados.rados.0.smithi166.stdout:1137: writing smithi16641208-483 from 427076 to 1216119 tid 1 2020-11-16T20:57:43.976 INFO:tasks.rados.rados.0.smithi166.stdout:1137: writing smithi16641208-483 from 1706795 to 2474357 tid 2 2020-11-16T20:57:43.981 INFO:tasks.rados.rados.0.smithi166.stdout:1137: writing smithi16641208-483 from 2944912 to 3227076 tid 3 2020-11-16T20:57:43.981 INFO:tasks.rados.rados.0.smithi166.stdout:1138: write (excl) oid 402 current snap is 48 2020-11-16T20:57:43.981 INFO:tasks.rados.rados.0.smithi166.stdout:1121: finishing write tid 4 to smithi16641208-11 2020-11-16T20:57:43.981 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 11 v 803 (ObjNum 666 snap 48 seq_num 666) dirty exists 2020-11-16T20:57:43.981 INFO:tasks.rados.rados.0.smithi166.stdout:1121: left oid 11 (ObjNum 666 snap 48 seq_num 666) 2020-11-16T20:57:43.982 INFO:tasks.rados.rados.0.smithi166.stdout:1138: seq_num 669 ranges {443883=464292,1365277=511220,2572335=671548} 2020-11-16T20:57:43.986 INFO:tasks.rados.rados.0.smithi166.stdout:1138: writing smithi16641208-402 from 443883 to 908175 tid 1 2020-11-16T20:57:43.992 INFO:tasks.rados.rados.0.smithi166.stdout:1138: writing smithi16641208-402 from 1365277 to 1876497 tid 2 2020-11-16T20:57:44.001 INFO:tasks.rados.rados.0.smithi166.stdout:1138: writing smithi16641208-402 from 2572335 to 3243883 tid 3 2020-11-16T20:57:44.001 INFO:tasks.rados.rados.0.smithi166.stdout:1121: done (9 left) 2020-11-16T20:57:44.001 INFO:tasks.rados.rados.0.smithi166.stdout:1139: cache_try_flush oid 101 snap 47 2020-11-16T20:57:44.001 INFO:tasks.rados.rados.0.smithi166.stdout:1128: finishing rollback tid 2 to smithi16641208-180 2020-11-16T20:57:44.001 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 180 v 708 (ObjNum 179 snap 0 seq_num 179) dirty exists 2020-11-16T20:57:44.001 INFO:tasks.rados.rados.0.smithi166.stdout:1128: done (9 left) 2020-11-16T20:57:44.002 INFO:tasks.rados.rados.0.smithi166.stdout:1140: cache_evict oid 391 snap -1 2020-11-16T20:57:44.002 INFO:tasks.rados.rados.0.smithi166.stdout:1130: got (2) No such file or directory 2020-11-16T20:57:44.002 INFO:tasks.rados.rados.0.smithi166.stdout:1130: done (9 left) 2020-11-16T20:57:44.002 INFO:tasks.rados.rados.0.smithi166.stdout:1141: write oid 354 current snap is 48 2020-11-16T20:57:44.002 INFO:tasks.rados.rados.0.smithi166.stdout:1141: seq_num 670 ranges {460690=655894,1540112=771231,2716111=539778} 2020-11-16T20:57:44.007 INFO:tasks.rados.rados.0.smithi166.stdout:1141: writing smithi16641208-354 from 460690 to 1116584 tid 1 2020-11-16T20:57:44.014 INFO:tasks.rados.rados.0.smithi166.stdout:1141: writing smithi16641208-354 from 1540112 to 2311343 tid 2 2020-11-16T20:57:44.020 INFO:tasks.rados.rados.0.smithi166.stdout:1141: writing smithi16641208-354 from 2716111 to 3255889 tid 3 2020-11-16T20:57:44.020 INFO:tasks.rados.rados.0.smithi166.stdout:1142: cache_try_flush oid 261 snap -1 2020-11-16T20:57:44.020 INFO:tasks.rados.rados.0.smithi166.stdout:1133: expect (ObjNum 525 snap 6 seq_num 525) 2020-11-16T20:57:44.023 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:44.027+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:44.123 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:57:44.128+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:57:44.125 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:44.126 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:57:44.126 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:57:44.126 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:57:44.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.126 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:538 4.3 e41/22 4:c9160c9c:::smithi16641208-411:head v 41'95, mlcod=37'93)", 2020-11-16T20:57:44.127 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:57:44.127 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 100.003979036, 2020-11-16T20:57:44.127 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021023377999999999, 2020-11-16T20:57:44.127 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:44.127 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:44.127 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:44.127 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.127 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:44.128 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:57:44.128 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:44.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.128 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.128 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:44.128 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:57:44.128 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052206140000000002 2020-11-16T20:57:44.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:44.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130866+0000", 2020-11-16T20:57:44.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0824e-05 2020-11-16T20:57:44.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:44.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130877+0000", 2020-11-16T20:57:44.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5384e-05 2020-11-16T20:57:44.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:44.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130893+0000", 2020-11-16T20:57:44.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0064999999999999e-05 2020-11-16T20:57:44.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.131 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.131 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:44.131 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130903+0000", 2020-11-16T20:57:44.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3051000000000003e-05 2020-11-16T20:57:44.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.131 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130966+0000", 2020-11-16T20:57:44.132 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9724e-05 2020-11-16T20:57:44.132 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:44.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130985+0000", 2020-11-16T20:57:44.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015638332000000001 2020-11-16T20:57:44.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:44.133 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.146624+0000", 2020-11-16T20:57:44.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5383999999999998e-05 2020-11-16T20:57:44.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.134 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:44.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.146669+0000", 2020-11-16T20:57:44.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021023377999999999 2020-11-16T20:57:44.134 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.134 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:44.134 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.135 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2367 4.2 e42/22 4:581c1e5b:::smithi16641208-124:head v 42'136, mlcod=42'133)", 2020-11-16T20:57:44.135 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:57:44.135 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.076280658000002, 2020-11-16T20:57:44.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021196474999999999, 2020-11-16T20:57:44.135 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:44.135 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:44.136 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:44.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:44.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:57:44.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:44.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:44.137 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:57:44.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070663000000000002 2020-11-16T20:57:44.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.137 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.137 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:44.137 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060411+0000", 2020-11-16T20:57:44.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0189999999999995e-06 2020-11-16T20:57:44.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:44.138 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060420+0000", 2020-11-16T20:57:44.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0069e-05 2020-11-16T20:57:44.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:44.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060430+0000", 2020-11-16T20:57:44.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6879999999999999e-06 2020-11-16T20:57:44.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:44.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060437+0000", 2020-11-16T20:57:44.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3671999999999995e-05 2020-11-16T20:57:44.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.140 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060511+0000", 2020-11-16T20:57:44.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6801999999999998e-05 2020-11-16T20:57:44.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:44.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060548+0000", 2020-11-16T20:57:44.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013927701000000001 2020-11-16T20:57:44.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:44.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074475+0000", 2020-11-16T20:57:44.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5223999999999998e-05 2020-11-16T20:57:44.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:44.142 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074541+0000", 2020-11-16T20:57:44.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021196474999999999 2020-11-16T20:57:44.142 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.142 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:44.143 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.143 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:554 3.2 e42/19 3:769099fd:::smithi16641208-247:head v 42'386, mlcod=42'384)", 2020-11-16T20:57:44.143 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:57:44.143 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.059361684999999, 2020-11-16T20:57:44.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029531213000000001, 2020-11-16T20:57:44.144 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:44.144 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:44.144 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:44.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:44.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:57:44.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:44.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.145 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:44.145 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:57:44.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007828448 2020-11-16T20:57:44.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.145 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:44.146 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078092+0000", 2020-11-16T20:57:44.146 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2031000000000001e-05 2020-11-16T20:57:44.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.146 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.146 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:44.146 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078104+0000", 2020-11-16T20:57:44.146 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3950000000000001e-06 2020-11-16T20:57:44.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.147 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:44.147 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078112+0000", 2020-11-16T20:57:44.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.434e-06 2020-11-16T20:57:44.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.147 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:44.148 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078117+0000", 2020-11-16T20:57:44.148 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0217999999999999e-05 2020-11-16T20:57:44.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.148 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.148 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078168+0000", 2020-11-16T20:57:44.148 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6242e-05 2020-11-16T20:57:44.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.149 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:44.149 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078194+0000", 2020-11-16T20:57:44.149 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021550488 2020-11-16T20:57:44.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.149 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:44.150 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099744+0000", 2020-11-16T20:57:44.150 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9957000000000003e-05 2020-11-16T20:57:44.150 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.150 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.150 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:44.150 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099794+0000", 2020-11-16T20:57:44.150 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029531213000000001 2020-11-16T20:57:44.151 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.151 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:44.151 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.151 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.151 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:555 3.2 e42/19 3:590e6edd:::smithi16641208-203:head v 42'387, mlcod=42'384)", 2020-11-16T20:57:44.151 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:57:44.152 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.051480841, 2020-11-16T20:57:44.152 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021681786000000002, 2020-11-16T20:57:44.152 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:44.152 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:44.152 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:44.152 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.152 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:44.152 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:57:44.153 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:44.153 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.153 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.153 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:44.153 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:57:44.153 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6817999999999998e-05 2020-11-16T20:57:44.153 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.154 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.154 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:44.154 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078191+0000", 2020-11-16T20:57:44.154 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7800000000000003e-06 2020-11-16T20:57:44.154 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.154 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.154 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:44.155 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078198+0000", 2020-11-16T20:57:44.155 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0331e-05 2020-11-16T20:57:44.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.155 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:44.155 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078208+0000", 2020-11-16T20:57:44.155 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8429999999999998e-06 2020-11-16T20:57:44.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.156 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.156 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:44.156 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078214+0000", 2020-11-16T20:57:44.156 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0025044690000000001 2020-11-16T20:57:44.156 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.156 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.156 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.157 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080718+0000", 2020-11-16T20:57:44.157 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027441100000000001 2020-11-16T20:57:44.157 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.157 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.157 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:44.157 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080993+0000", 2020-11-16T20:57:44.157 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018806976999999999 2020-11-16T20:57:44.157 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.158 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.158 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:44.158 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099800+0000", 2020-11-16T20:57:44.158 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6157e-05 2020-11-16T20:57:44.158 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.158 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.158 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:44.159 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099826+0000", 2020-11-16T20:57:44.159 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021681786000000002 2020-11-16T20:57:44.159 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.159 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:44.159 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.159 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.159 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.160 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:485 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'94, mlcod=41'92)", 2020-11-16T20:57:44.160 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:57:44.160 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 99.050911873999993, 2020-11-16T20:57:44.160 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021768460999999999, 2020-11-16T20:57:44.160 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:44.160 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:44.160 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:44.160 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.161 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:44.161 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:57:44.161 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:44.161 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.161 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.161 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:44.161 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:57:44.162 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001603103 2020-11-16T20:57:44.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.162 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:44.162 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080316+0000", 2020-11-16T20:57:44.162 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4956e-05 2020-11-16T20:57:44.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.163 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:44.163 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080331+0000", 2020-11-16T20:57:44.163 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6291e-05 2020-11-16T20:57:44.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.163 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.163 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:44.163 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080347+0000", 2020-11-16T20:57:44.164 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3090000000000001e-06 2020-11-16T20:57:44.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.164 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.164 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:44.164 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080357+0000", 2020-11-16T20:57:44.164 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7073000000000001e-05 2020-11-16T20:57:44.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.165 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.165 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.165 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080414+0000", 2020-11-16T20:57:44.165 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5877e-05 2020-11-16T20:57:44.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.165 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.165 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:44.165 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080440+0000", 2020-11-16T20:57:44.166 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019927006000000001 2020-11-16T20:57:44.166 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.166 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.166 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:44.166 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100367+0000", 2020-11-16T20:57:44.166 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114846 2020-11-16T20:57:44.166 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.167 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.167 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:44.167 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100481+0000", 2020-11-16T20:57:44.167 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021768460999999999 2020-11-16T20:57:44.167 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.167 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:44.167 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.167 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.168 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.168 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:663 4.3 e57/22 4:f65e82cb:::smithi16641208-219:head v 57'179, mlcod=57'176)", 2020-11-16T20:57:44.168 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:57:44.168 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 84.332796803999997, 2020-11-16T20:57:44.168 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022540092000000001, 2020-11-16T20:57:44.168 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:44.168 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:44.169 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:44.169 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.169 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:44.169 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:57:44.169 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:44.169 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.169 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.169 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:44.170 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:57:44.170 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013414394 2020-11-16T20:57:44.170 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.170 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.170 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:44.170 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810242+0000", 2020-11-16T20:57:44.170 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1864e-05 2020-11-16T20:57:44.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.171 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.171 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:44.171 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810254+0000", 2020-11-16T20:57:44.171 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3716e-05 2020-11-16T20:57:44.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.171 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.171 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:44.172 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810268+0000", 2020-11-16T20:57:44.172 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.064e-06 2020-11-16T20:57:44.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.172 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.172 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:44.172 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810277+0000", 2020-11-16T20:57:44.172 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0560999999999998e-05 2020-11-16T20:57:44.173 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.173 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.173 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.173 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810338+0000", 2020-11-16T20:57:44.173 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7523999999999999e-05 2020-11-16T20:57:44.173 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.173 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.173 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:44.174 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810365+0000", 2020-11-16T20:57:44.174 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089020890000000002 2020-11-16T20:57:44.174 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.174 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.174 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:44.174 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819267+0000", 2020-11-16T20:57:44.174 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010088 2020-11-16T20:57:44.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.175 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:44.175 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819368+0000", 2020-11-16T20:57:44.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022540092000000001 2020-11-16T20:57:44.175 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.175 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:44.176 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.176 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:618 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'243, mlcod=57'241)", 2020-11-16T20:57:44.176 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:57:44.176 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 84.329290728999993, 2020-11-16T20:57:44.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049183098000000001, 2020-11-16T20:57:44.176 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:44.177 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:44.177 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:44.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:44.177 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:57:44.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:44.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.178 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:44.178 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:57:44.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019114651 2020-11-16T20:57:44.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.178 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:44.179 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819449+0000", 2020-11-16T20:57:44.179 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.398e-05 2020-11-16T20:57:44.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.179 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.179 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:44.179 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819463+0000", 2020-11-16T20:57:44.179 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1139e-05 2020-11-16T20:57:44.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:44.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819474+0000", 2020-11-16T20:57:44.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1860000000000003e-06 2020-11-16T20:57:44.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:44.181 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819481+0000", 2020-11-16T20:57:44.181 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015472700000000001 2020-11-16T20:57:44.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.181 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.181 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.181 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819636+0000", 2020-11-16T20:57:44.181 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9632e-05 2020-11-16T20:57:44.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.182 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.182 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:44.182 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819665+0000", 2020-11-16T20:57:44.182 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029788289999999999 2020-11-16T20:57:44.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.182 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.182 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:44.183 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849454+0000", 2020-11-16T20:57:44.183 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3492999999999997e-05 2020-11-16T20:57:44.183 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.183 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.183 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:44.183 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849517+0000", 2020-11-16T20:57:44.183 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049183098000000001 2020-11-16T20:57:44.184 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.184 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:44.184 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.184 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.184 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:609 3.2 e57/19 3:5eead97c:::smithi16641208-34:head v 57'498, mlcod=57'495)", 2020-11-16T20:57:44.184 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:57:44.184 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 84.319011230000001, 2020-11-16T20:57:44.185 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039221579999999999, 2020-11-16T20:57:44.185 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:44.185 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:44.185 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:44.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.185 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:44.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:57:44.186 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:44.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.186 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.186 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:44.186 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:57:44.186 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008889859 2020-11-16T20:57:44.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.187 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.187 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:44.187 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819503+0000", 2020-11-16T20:57:44.187 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0149000000000001e-05 2020-11-16T20:57:44.187 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.187 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.187 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:44.187 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819514+0000", 2020-11-16T20:57:44.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1049999999999999e-05 2020-11-16T20:57:44.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:44.188 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819525+0000", 2020-11-16T20:57:44.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4829999999999999e-06 2020-11-16T20:57:44.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:44.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819533+0000", 2020-11-16T20:57:44.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031805760000000001 2020-11-16T20:57:44.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.189 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822714+0000", 2020-11-16T20:57:44.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0954000000000002e-05 2020-11-16T20:57:44.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.190 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:44.190 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822745+0000", 2020-11-16T20:57:44.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027044038999999999 2020-11-16T20:57:44.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.191 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.191 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:44.191 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849789+0000", 2020-11-16T20:57:44.191 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6470000000000001e-05 2020-11-16T20:57:44.191 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.191 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.191 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:44.192 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849835+0000", 2020-11-16T20:57:44.192 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039221579999999999 2020-11-16T20:57:44.192 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.192 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:44.192 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.192 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2583 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'244, mlcod=57'241)", 2020-11-16T20:57:44.193 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:57:44.193 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 84.310093695000006, 2020-11-16T20:57:44.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030101836999999999, 2020-11-16T20:57:44.193 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:44.193 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:44.193 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:44.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.194 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:44.194 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:57:44.194 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:44.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.194 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:44.194 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:57:44.195 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3781e-05 2020-11-16T20:57:44.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.195 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.195 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:44.195 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819575+0000", 2020-11-16T20:57:44.195 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3355e-05 2020-11-16T20:57:44.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.195 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.196 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:44.196 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819588+0000", 2020-11-16T20:57:44.196 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8198e-05 2020-11-16T20:57:44.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.196 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.196 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:44.196 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819657+0000", 2020-11-16T20:57:44.196 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5849999999999999e-05 2020-11-16T20:57:44.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:44.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819672+0000", 2020-11-16T20:57:44.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003042473 2020-11-16T20:57:44.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822715+0000", 2020-11-16T20:57:44.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9779999999999999e-05 2020-11-16T20:57:44.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:44.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822745+0000", 2020-11-16T20:57:44.199 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026828521000000001 2020-11-16T20:57:44.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.199 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:44.199 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849573+0000", 2020-11-16T20:57:44.199 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9879e-05 2020-11-16T20:57:44.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.200 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:44.200 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849633+0000", 2020-11-16T20:57:44.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030101836999999999 2020-11-16T20:57:44.200 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.200 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:44.200 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.200 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.201 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3495 4.2 4:7e155756:::smithi16641208-255:head [write 1744696~590883] snapc 55=[55,54,53,52] ondisk+write+known_if_redirected e128)", 2020-11-16T20:57:44.201 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:32.932748+0000", 2020-11-16T20:57:44.201 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.196876435, 2020-11-16T20:57:44.201 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026656984000000002, 2020-11-16T20:57:44.201 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:44.201 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:44.201 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:44.202 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:44.202 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:44.202 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3495 2020-11-16T20:57:44.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.202 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:44.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:44.203 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.932748+0000", 2020-11-16T20:57:44.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:44.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.203 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.203 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:44.203 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.932748+0000", 2020-11-16T20:57:44.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00053288900000000004 2020-11-16T20:57:44.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.204 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.204 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:44.204 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.933281+0000", 2020-11-16T20:57:44.204 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.14e-06 2020-11-16T20:57:44.204 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.204 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.204 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:44.205 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.933289+0000", 2020-11-16T20:57:44.205 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6081000000000001e-05 2020-11-16T20:57:44.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.205 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:44.205 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.933306+0000", 2020-11-16T20:57:44.205 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9020000000000005e-06 2020-11-16T20:57:44.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.206 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.206 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:44.206 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.933314+0000", 2020-11-16T20:57:44.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9695999999999999e-05 2020-11-16T20:57:44.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.206 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.206 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.207 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.933374+0000", 2020-11-16T20:57:44.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0871000000000005e-05 2020-11-16T20:57:44.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:44.207 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.933465+0000", 2020-11-16T20:57:44.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015534772000000001 2020-11-16T20:57:44.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.949000+0000", 2020-11-16T20:57:44.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00020149499999999999 2020-11-16T20:57:44.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:44.209 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.949201+0000", 2020-11-16T20:57:44.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024771899999999998 2020-11-16T20:57:44.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,4", 2020-11-16T20:57:44.209 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.949449+0000", 2020-11-16T20:57:44.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0035366379999999999 2020-11-16T20:57:44.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:44.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.952986+0000", 2020-11-16T20:57:44.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0026778399999999999 2020-11-16T20:57:44.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:44.211 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.955663+0000", 2020-11-16T20:57:44.211 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0036202550000000002 2020-11-16T20:57:44.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.211 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:44.211 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.959284+0000", 2020-11-16T20:57:44.211 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7249000000000006e-05 2020-11-16T20:57:44.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.212 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:44.212 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.959351+0000", 2020-11-16T20:57:44.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4437000000000001e-05 2020-11-16T20:57:44.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.212 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:44.213 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.959405+0000", 2020-11-16T20:57:44.213 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026656984000000002 2020-11-16T20:57:44.213 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.213 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:44.213 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.213 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3496 4.2 4:7e155756:::smithi16641208-255:head [write 2772934~134809] snapc 55=[55,54,53,52] ondisk+write+known_if_redirected e128)", 2020-11-16T20:57:44.214 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:32.935878+0000", 2020-11-16T20:57:44.214 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.193746854, 2020-11-16T20:57:44.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023700191999999998, 2020-11-16T20:57:44.214 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:44.214 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:44.214 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:44.214 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:44.215 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:44.215 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3496 2020-11-16T20:57:44.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.215 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:44.215 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.215 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:44.215 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.935878+0000", 2020-11-16T20:57:44.215 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:44.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:44.216 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.935878+0000", 2020-11-16T20:57:44.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6582000000000005e-05 2020-11-16T20:57:44.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:44.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.935975+0000", 2020-11-16T20:57:44.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.956e-06 2020-11-16T20:57:44.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.217 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:44.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.935982+0000", 2020-11-16T20:57:44.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3502999999999999e-05 2020-11-16T20:57:44.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:44.218 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.935995+0000", 2020-11-16T20:57:44.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2150000000000004e-06 2020-11-16T20:57:44.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.219 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:44.219 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936002+0000", 2020-11-16T20:57:44.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9329999999999997e-05 2020-11-16T20:57:44.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.219 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.219 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936052+0000", 2020-11-16T20:57:44.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5052000000000002e-05 2020-11-16T20:57:44.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:44.220 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936097+0000", 2020-11-16T20:57:44.220 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014771909 2020-11-16T20:57:44.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.950869+0000", 2020-11-16T20:57:44.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000104421 2020-11-16T20:57:44.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:44.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.950973+0000", 2020-11-16T20:57:44.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022628000000000001 2020-11-16T20:57:44.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,4", 2020-11-16T20:57:44.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.951199+0000", 2020-11-16T20:57:44.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023977569999999999 2020-11-16T20:57:44.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:44.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.953597+0000", 2020-11-16T20:57:44.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0044840269999999998 2020-11-16T20:57:44.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:44.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.958081+0000", 2020-11-16T20:57:44.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0013765349999999999 2020-11-16T20:57:44.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.224 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:44.224 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.959458+0000", 2020-11-16T20:57:44.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5678000000000004e-05 2020-11-16T20:57:44.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:44.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.959523+0000", 2020-11-16T20:57:44.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4947000000000001e-05 2020-11-16T20:57:44.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:44.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.959578+0000", 2020-11-16T20:57:44.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023700191999999998 2020-11-16T20:57:44.226 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.226 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:44.226 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.226 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3497 4.2 4:7e155756:::smithi16641208-255:head [setxattr _header (58) in=7b,truncate 2907743] snapc 55=[55,54,53,52] ondisk+write+known_if_redirected e128)", 2020-11-16T20:57:44.226 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:32.936049+0000", 2020-11-16T20:57:44.227 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.193576325, 2020-11-16T20:57:44.227 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024052206, 2020-11-16T20:57:44.227 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:44.227 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:44.227 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:44.227 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:44.227 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:44.227 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3497 2020-11-16T20:57:44.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.228 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:44.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.228 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:44.228 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936049+0000", 2020-11-16T20:57:44.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:44.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:44.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936049+0000", 2020-11-16T20:57:44.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7271e-05 2020-11-16T20:57:44.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:44.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936076+0000", 2020-11-16T20:57:44.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1779999999999996e-06 2020-11-16T20:57:44.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.230 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:44.230 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936080+0000", 2020-11-16T20:57:44.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7039999999999997e-06 2020-11-16T20:57:44.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.231 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:44.231 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936087+0000", 2020-11-16T20:57:44.231 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.473e-06 2020-11-16T20:57:44.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.231 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:44.232 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936090+0000", 2020-11-16T20:57:44.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3069999999999999e-05 2020-11-16T20:57:44.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.232 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.232 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936133+0000", 2020-11-16T20:57:44.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4410000000000001e-05 2020-11-16T20:57:44.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:44.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936208+0000", 2020-11-16T20:57:44.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015674410999999999 2020-11-16T20:57:44.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.234 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.951882+0000", 2020-11-16T20:57:44.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000167233 2020-11-16T20:57:44.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.234 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:44.234 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.952049+0000", 2020-11-16T20:57:44.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025541000000000002 2020-11-16T20:57:44.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.235 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,4", 2020-11-16T20:57:44.235 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.952305+0000", 2020-11-16T20:57:44.235 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0021373550000000001 2020-11-16T20:57:44.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.235 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:44.236 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.954442+0000", 2020-11-16T20:57:44.236 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0036480499999999999 2020-11-16T20:57:44.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.236 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:44.236 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.958090+0000", 2020-11-16T20:57:44.236 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0018286380000000001 2020-11-16T20:57:44.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:44.237 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.959919+0000", 2020-11-16T20:57:44.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7004999999999998e-05 2020-11-16T20:57:44.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:44.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.960006+0000", 2020-11-16T20:57:44.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4998000000000001e-05 2020-11-16T20:57:44.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:44.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.960101+0000", 2020-11-16T20:57:44.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024052206 2020-11-16T20:57:44.239 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.239 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:44.239 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.239 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.239 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3498 4.2 4:7e155756:::smithi16641208-255:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e128)", 2020-11-16T20:57:44.239 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:32.936126+0000", 2020-11-16T20:57:44.239 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.193498615999999, 2020-11-16T20:57:44.240 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024682154000000001, 2020-11-16T20:57:44.240 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:44.240 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:44.240 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:44.240 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:44.240 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:44.240 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3498 2020-11-16T20:57:44.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.241 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:44.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.241 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:44.241 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936126+0000", 2020-11-16T20:57:44.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:44.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:44.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936126+0000", 2020-11-16T20:57:44.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3691e-05 2020-11-16T20:57:44.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:44.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936160+0000", 2020-11-16T20:57:44.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2190000000000001e-06 2020-11-16T20:57:44.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.243 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:44.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936166+0000", 2020-11-16T20:57:44.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9751000000000001e-05 2020-11-16T20:57:44.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.244 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:44.244 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936186+0000", 2020-11-16T20:57:44.244 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8449999999999999e-06 2020-11-16T20:57:44.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.244 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:44.244 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936192+0000", 2020-11-16T20:57:44.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0973000000000002e-05 2020-11-16T20:57:44.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.245 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.245 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.245 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936233+0000", 2020-11-16T20:57:44.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4511000000000002e-05 2020-11-16T20:57:44.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:44.246 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936267+0000", 2020-11-16T20:57:44.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016346407 2020-11-16T20:57:44.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.952614+0000", 2020-11-16T20:57:44.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5446999999999998e-05 2020-11-16T20:57:44.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:44.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.952689+0000", 2020-11-16T20:57:44.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074636269999999996 2020-11-16T20:57:44.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.248 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.248 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.960153+0000", 2020-11-16T20:57:44.248 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026278599999999999 2020-11-16T20:57:44.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.248 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:44.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.960416+0000", 2020-11-16T20:57:44.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039289700000000002 2020-11-16T20:57:44.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.249 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.249 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:44.249 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.960808+0000", 2020-11-16T20:57:44.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024682154000000001 2020-11-16T20:57:44.250 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.250 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:44.250 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.250 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3512 4.2 4:6f41abc7:::smithi16641208-179:head [read 0~2991646,checksum] snapc 0=[] ondisk+read+known_if_redirected e129)", 2020-11-16T20:57:44.250 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:34.001748+0000", 2020-11-16T20:57:44.250 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.127876936, 2020-11-16T20:57:44.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020636748, 2020-11-16T20:57:44.251 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:44.251 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2020-11-16T20:57:44.251 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:44.251 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:44.251 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:44.251 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3512 2020-11-16T20:57:44.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.252 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:44.252 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.252 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:44.252 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.001748+0000", 2020-11-16T20:57:44.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:44.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.253 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:44.253 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.001748+0000", 2020-11-16T20:57:44.253 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9986e-05 2020-11-16T20:57:44.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.253 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:44.253 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.001788+0000", 2020-11-16T20:57:44.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5100000000000004e-06 2020-11-16T20:57:44.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:44.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.001794+0000", 2020-11-16T20:57:44.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3481e-05 2020-11-16T20:57:44.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:44.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.001808+0000", 2020-11-16T20:57:44.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7919999999999998e-06 2020-11-16T20:57:44.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:44.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.001814+0000", 2020-11-16T20:57:44.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011458670000000001 2020-11-16T20:57:44.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.002960+0000", 2020-11-16T20:57:44.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019425112000000001 2020-11-16T20:57:44.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.257 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.257 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:44.257 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.022385+0000", 2020-11-16T20:57:44.257 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020636748 2020-11-16T20:57:44.257 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.257 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:44.257 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.258 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3526 4.2 4:74e10358:::smithi16641208-98:55 [read 0~3630279,checksum] snapc 0=[] ondisk+read+known_if_redirected e129)", 2020-11-16T20:57:44.258 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:34.017588+0000", 2020-11-16T20:57:44.258 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.112036843, 2020-11-16T20:57:44.258 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021067525, 2020-11-16T20:57:44.258 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:44.258 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2020-11-16T20:57:44.259 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:44.259 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:44.259 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:44.259 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3526 2020-11-16T20:57:44.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.259 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:44.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:44.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.017588+0000", 2020-11-16T20:57:44.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:44.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:44.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.017588+0000", 2020-11-16T20:57:44.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3799999999999999e-05 2020-11-16T20:57:44.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.261 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:44.261 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.017612+0000", 2020-11-16T20:57:44.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8709999999999999e-06 2020-11-16T20:57:44.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.262 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:44.262 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.017616+0000", 2020-11-16T20:57:44.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0310000000000004e-06 2020-11-16T20:57:44.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.262 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.262 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:44.262 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.017622+0000", 2020-11-16T20:57:44.262 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1389999999999999e-06 2020-11-16T20:57:44.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.263 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:44.263 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.017625+0000", 2020-11-16T20:57:44.263 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000718014 2020-11-16T20:57:44.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.018343+0000", 2020-11-16T20:57:44.264 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020312670000000001 2020-11-16T20:57:44.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.264 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:44.264 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.038656+0000", 2020-11-16T20:57:44.265 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021067525 2020-11-16T20:57:44.265 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.265 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:44.265 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.265 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.265 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3539 4.2 4:47e2d3ca:::smithi16641208-384:head [read 0~2437081,checksum] snapc 0=[] ondisk+read+known_if_redirected e130)", 2020-11-16T20:57:44.265 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:34.748641+0000", 2020-11-16T20:57:44.266 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.3809837369999993, 2020-11-16T20:57:44.266 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023726226, 2020-11-16T20:57:44.266 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:44.266 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2020-11-16T20:57:44.266 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:44.266 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:44.266 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:44.267 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3539 2020-11-16T20:57:44.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.267 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:44.267 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.267 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:44.267 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748641+0000", 2020-11-16T20:57:44.267 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:44.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.268 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:44.268 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748641+0000", 2020-11-16T20:57:44.268 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8232000000000003e-05 2020-11-16T20:57:44.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.268 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:44.269 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748679+0000", 2020-11-16T20:57:44.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1430000000000003e-06 2020-11-16T20:57:44.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.269 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:44.269 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748686+0000", 2020-11-16T20:57:44.269 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1487e-05 2020-11-16T20:57:44.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.270 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:44.270 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748697+0000", 2020-11-16T20:57:44.270 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5609999999999998e-06 2020-11-16T20:57:44.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.270 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.270 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:44.271 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748703+0000", 2020-11-16T20:57:44.271 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024659600000000002 2020-11-16T20:57:44.271 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.271 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.271 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.271 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748949+0000", 2020-11-16T20:57:44.271 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023418207 2020-11-16T20:57:44.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.272 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.272 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:44.272 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.772367+0000", 2020-11-16T20:57:44.272 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023726226 2020-11-16T20:57:44.272 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.272 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:44.272 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.273 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.273 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.273 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:769 4.2 4:5e002a8b:::smithi16641208-342:head [assert-version v367,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected e130)", 2020-11-16T20:57:44.273 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:34.755146+0000", 2020-11-16T20:57:44.273 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.3744786629999997, 2020-11-16T20:57:44.273 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020866262999999999, 2020-11-16T20:57:44.274 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:44.274 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2020-11-16T20:57:44.274 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:44.274 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.274 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:44.274 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.755146+0000", 2020-11-16T20:57:44.274 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:44.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.275 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.275 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:44.275 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.755146+0000", 2020-11-16T20:57:44.275 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1903999999999997e-05 2020-11-16T20:57:44.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.275 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.275 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:44.276 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.755188+0000", 2020-11-16T20:57:44.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2490000000000004e-06 2020-11-16T20:57:44.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.276 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:44.276 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.755195+0000", 2020-11-16T20:57:44.276 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6143000000000001e-05 2020-11-16T20:57:44.277 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.277 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.277 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:44.277 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.755212+0000", 2020-11-16T20:57:44.277 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4799999999999998e-06 2020-11-16T20:57:44.277 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.277 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.278 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:44.278 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.755218+0000", 2020-11-16T20:57:44.278 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1761999999999996e-05 2020-11-16T20:57:44.278 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.278 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.278 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.278 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.755280+0000", 2020-11-16T20:57:44.278 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020732725 2020-11-16T20:57:44.279 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.279 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.279 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:44.279 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.776012+0000", 2020-11-16T20:57:44.279 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020866262999999999 2020-11-16T20:57:44.279 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.279 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:44.280 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.280 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.280 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3647 4.2 4:4f093770:::smithi16641208-180:head [append 0~0] snapc 5e=[5e,5c,5b] ondisk+write+known_if_redirected e137)", 2020-11-16T20:57:44.280 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:41.986315+0000", 2020-11-16T20:57:44.280 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 2.1433096859999998, 2020-11-16T20:57:44.280 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.034212326000000001, 2020-11-16T20:57:44.281 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:44.281 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:44.281 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:44.281 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:44.281 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:44.281 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3647 2020-11-16T20:57:44.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.281 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:44.282 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.282 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:44.282 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:41.986315+0000", 2020-11-16T20:57:44.282 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:44.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.282 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.282 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:44.283 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:41.986315+0000", 2020-11-16T20:57:44.283 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9006999999999999e-05 2020-11-16T20:57:44.283 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.283 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.283 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:44.283 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:41.986334+0000", 2020-11-16T20:57:44.283 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9699999999999996e-06 2020-11-16T20:57:44.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.284 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.284 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:44.284 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:41.986340+0000", 2020-11-16T20:57:44.284 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6699999999999994e-06 2020-11-16T20:57:44.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.284 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.284 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:44.285 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:41.986348+0000", 2020-11-16T20:57:44.285 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0709999999999999e-06 2020-11-16T20:57:44.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.285 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:44.285 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:41.986351+0000", 2020-11-16T20:57:44.285 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023678990000000001 2020-11-16T20:57:44.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.286 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:41.988719+0000", 2020-11-16T20:57:44.286 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4289999999999999e-05 2020-11-16T20:57:44.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.287 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:44.287 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:41.988753+0000", 2020-11-16T20:57:44.287 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.025774689 2020-11-16T20:57:44.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.287 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.287 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.287 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:42.014528+0000", 2020-11-16T20:57:44.287 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013804799999999999 2020-11-16T20:57:44.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.288 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.288 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:44.288 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:42.014666+0000", 2020-11-16T20:57:44.288 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000243081 2020-11-16T20:57:44.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.288 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,4", 2020-11-16T20:57:44.289 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:42.014909+0000", 2020-11-16T20:57:44.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00096478700000000004 2020-11-16T20:57:44.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:44.289 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:42.015874+0000", 2020-11-16T20:57:44.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014369059999999999 2020-11-16T20:57:44.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.290 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:44.290 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:42.017311+0000", 2020-11-16T20:57:44.290 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031052010000000001 2020-11-16T20:57:44.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.291 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:44.291 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:42.020416+0000", 2020-11-16T20:57:44.291 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5228999999999994e-05 2020-11-16T20:57:44.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.291 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.291 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:44.291 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:42.020491+0000", 2020-11-16T20:57:44.291 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6477999999999999e-05 2020-11-16T20:57:44.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.292 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.292 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:44.292 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:42.020528+0000", 2020-11-16T20:57:44.292 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.034212326000000001 2020-11-16T20:57:44.292 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.292 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:44.293 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.293 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3661 4.2 4:7c4a7ccf:::smithi16641208-27:5e [read 0~2436982,checksum] snapc 0=[] ondisk+read+known_if_redirected e139)", 2020-11-16T20:57:44.293 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:43.965978+0000", 2020-11-16T20:57:44.293 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.16364658000000001, 2020-11-16T20:57:44.293 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020534841000000002, 2020-11-16T20:57:44.293 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:44.294 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2020-11-16T20:57:44.294 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:44.294 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:44.294 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:44.294 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3661 2020-11-16T20:57:44.294 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.294 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:44.295 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.295 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:44.295 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.965978+0000", 2020-11-16T20:57:44.295 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:44.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.295 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.295 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:44.296 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.965978+0000", 2020-11-16T20:57:44.296 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6570999999999998e-05 2020-11-16T20:57:44.296 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.296 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.296 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:44.296 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.966025+0000", 2020-11-16T20:57:44.296 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0780000000000001e-06 2020-11-16T20:57:44.296 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.297 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.297 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:44.297 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.966031+0000", 2020-11-16T20:57:44.297 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1233000000000001e-05 2020-11-16T20:57:44.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.297 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.297 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:44.298 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.966042+0000", 2020-11-16T20:57:44.298 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.955e-06 2020-11-16T20:57:44.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.298 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.298 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:44.298 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.966047+0000", 2020-11-16T20:57:44.298 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7679000000000003e-05 2020-11-16T20:57:44.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.299 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.299 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.299 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.966085+0000", 2020-11-16T20:57:44.299 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0609999999999998e-06 2020-11-16T20:57:44.299 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.299 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.299 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:44.300 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.966092+0000", 2020-11-16T20:57:44.300 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0027655000000000002 2020-11-16T20:57:44.300 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.300 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.300 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.300 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.968857+0000", 2020-11-16T20:57:44.300 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017655764000000001 2020-11-16T20:57:44.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.301 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.301 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:44.301 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.986513+0000", 2020-11-16T20:57:44.301 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020534841000000002 2020-11-16T20:57:44.301 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.301 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:44.301 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.302 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.302 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.302 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3668 4.2 4:43ad827e:::smithi16641208-402:head [write 1365277~511220] snapc 5e=[5e] ondisk+write+known_if_redirected e139)", 2020-11-16T20:57:44.302 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:43.998093+0000", 2020-11-16T20:57:44.302 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.13153147500000001, 2020-11-16T20:57:44.302 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.025480011, 2020-11-16T20:57:44.302 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:44.303 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:44.303 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:44.303 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:44.303 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:44.303 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3668 2020-11-16T20:57:44.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.303 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:44.303 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.304 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:44.304 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.998093+0000", 2020-11-16T20:57:44.304 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:44.304 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.304 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.304 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:44.304 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.998093+0000", 2020-11-16T20:57:44.305 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00048407700000000002 2020-11-16T20:57:44.305 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.305 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.305 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:44.305 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.998577+0000", 2020-11-16T20:57:44.305 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8569999999999997e-06 2020-11-16T20:57:44.305 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.306 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.306 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:44.306 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.998584+0000", 2020-11-16T20:57:44.306 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5218999999999999e-05 2020-11-16T20:57:44.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.306 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.306 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:44.306 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.998600+0000", 2020-11-16T20:57:44.307 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1049999999999995e-06 2020-11-16T20:57:44.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.307 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:44.307 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.998608+0000", 2020-11-16T20:57:44.307 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3278000000000001e-05 2020-11-16T20:57:44.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.308 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.308 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.998651+0000", 2020-11-16T20:57:44.308 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0895000000000005e-05 2020-11-16T20:57:44.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.308 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:44.308 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.998722+0000", 2020-11-16T20:57:44.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015162044 2020-11-16T20:57:44.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.309 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.309 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:44.309 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:44.013884+0000", 2020-11-16T20:57:44.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017694 2020-11-16T20:57:44.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:44.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:44.014061+0000", 2020-11-16T20:57:44.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030028900000000002 2020-11-16T20:57:44.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,4", 2020-11-16T20:57:44.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:44.014361+0000", 2020-11-16T20:57:44.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074555899999999998 2020-11-16T20:57:44.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:44.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:44.021817+0000", 2020-11-16T20:57:44.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001490288 2020-11-16T20:57:44.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.312 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:44.312 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:44.023307+0000", 2020-11-16T20:57:44.312 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000120949 2020-11-16T20:57:44.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.312 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:44.312 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:44.023428+0000", 2020-11-16T20:57:44.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9171000000000005e-05 2020-11-16T20:57:44.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.313 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:44.313 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:44.023507+0000", 2020-11-16T20:57:44.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6309000000000005e-05 2020-11-16T20:57:44.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:44.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:44.314 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:44.314 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:44.023573+0000", 2020-11-16T20:57:44.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.025480011 2020-11-16T20:57:44.314 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.314 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:44.314 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.314 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:44.315 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:44.315 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:44.315 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:57:44.318 INFO:tasks.rados.rados.0.smithi166.stdout:1135: got (2) No such file or directory 2020-11-16T20:57:44.318 INFO:tasks.rados.rados.0.smithi166.stdout:1134: finishing rollback tid 1 to smithi16641208-223 2020-11-16T20:57:44.319 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 223 v 0 (ObjNum 1715160128 snap 32601 seq_num 1715160128) dirty dne 2020-11-16T20:57:44.319 INFO:tasks.rados.rados.0.smithi166.stdout:1136: expect (ObjNum 26 snap 0 seq_num 26) 2020-11-16T20:57:44.319 INFO:tasks.rados.rados.0.smithi166.stdout:1137: finishing write tid 1 to smithi16641208-483 2020-11-16T20:57:44.319 INFO:tasks.rados.rados.0.smithi166.stdout:1137: finishing write tid 2 to smithi16641208-483 2020-11-16T20:57:44.319 INFO:tasks.rados.rados.0.smithi166.stdout:1137: finishing write tid 3 to smithi16641208-483 2020-11-16T20:57:44.319 INFO:tasks.rados.rados.0.smithi166.stdout:1137: finishing write tid 4 to smithi16641208-483 2020-11-16T20:57:44.319 INFO:tasks.rados.rados.0.smithi166.stdout:1137: finishing write tid 5 to smithi16641208-483 2020-11-16T20:57:44.320 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 483 v 712 (ObjNum 668 snap 48 seq_num 668) dirty exists 2020-11-16T20:57:44.320 INFO:tasks.rados.rados.0.smithi166.stdout:1137: left oid 483 (ObjNum 668 snap 48 seq_num 668) 2020-11-16T20:57:44.320 INFO:tasks.rados.rados.0.smithi166.stdout:1133: done (10 left) 2020-11-16T20:57:44.320 INFO:tasks.rados.rados.0.smithi166.stdout:1134: done (9 left) 2020-11-16T20:57:44.320 INFO:tasks.rados.rados.0.smithi166.stdout:1135: done (8 left) 2020-11-16T20:57:44.320 INFO:tasks.rados.rados.0.smithi166.stdout:1136: done (7 left) 2020-11-16T20:57:44.320 INFO:tasks.rados.rados.0.smithi166.stdout:1137: done (6 left) 2020-11-16T20:57:44.321 INFO:tasks.rados.rados.0.smithi166.stdout:1143: read oid 302 snap -1 2020-11-16T20:57:44.321 INFO:tasks.rados.rados.0.smithi166.stdout:1143: expect (ObjNum 301 snap 0 seq_num 301) 2020-11-16T20:57:44.321 INFO:tasks.rados.rados.0.smithi166.stdout:1144: write oid 387 current snap is 48 2020-11-16T20:57:44.321 INFO:tasks.rados.rados.0.smithi166.stdout:1138: finishing write tid 1 to smithi16641208-402 2020-11-16T20:57:44.321 INFO:tasks.rados.rados.0.smithi166.stdout:1139: got (2) No such file or directory 2020-11-16T20:57:44.321 INFO:tasks.rados.rados.0.smithi166.stdout:1140: got (2) No such file or directory 2020-11-16T20:57:44.321 INFO:tasks.rados.rados.0.smithi166.stdout:1138: finishing write tid 2 to smithi16641208-402 2020-11-16T20:57:44.321 INFO:tasks.rados.rados.0.smithi166.stdout:1138: finishing write tid 3 to smithi16641208-402 2020-11-16T20:57:44.322 INFO:tasks.rados.rados.0.smithi166.stdout:1141: finishing write tid 1 to smithi16641208-354 2020-11-16T20:57:44.322 INFO:tasks.rados.rados.0.smithi166.stdout:1138: finishing write tid 4 to smithi16641208-402 2020-11-16T20:57:44.322 INFO:tasks.rados.rados.0.smithi166.stdout:1144: seq_num 671 ranges {477497=731143,1998594=514889,3143534=133963} 2020-11-16T20:57:44.322 INFO:tasks.rados.rados.0.smithi166.stdout:1144: writing smithi16641208-387 from 477497 to 1208640 tid 1 2020-11-16T20:57:44.322 INFO:tasks.rados.rados.0.smithi166.stdout:1144: writing smithi16641208-387 from 1998594 to 2513483 tid 2 2020-11-16T20:57:44.322 INFO:tasks.rados.rados.0.smithi166.stdout:1144: writing smithi16641208-387 from 3143534 to 3277497 tid 3 2020-11-16T20:57:44.322 INFO:tasks.rados.rados.0.smithi166.stdout:1139: done (7 left) 2020-11-16T20:57:44.323 INFO:tasks.rados.rados.0.smithi166.stdout:1140: done (6 left) 2020-11-16T20:57:44.323 INFO:tasks.rados.rados.0.smithi166.stdout:1145: copy_from oid 96 from oid 190 current snap is 48 2020-11-16T20:57:44.323 INFO:tasks.rados.rados.0.smithi166.stdout:1138: finishing write tid 5 to smithi16641208-402 2020-11-16T20:57:44.323 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 402 v 718 (ObjNum 669 snap 48 seq_num 669) dirty exists 2020-11-16T20:57:44.323 INFO:tasks.rados.rados.0.smithi166.stdout:1138: left oid 402 (ObjNum 669 snap 48 seq_num 669) 2020-11-16T20:57:44.323 INFO:tasks.rados.rados.0.smithi166.stdout:1141: finishing write tid 2 to smithi16641208-354 2020-11-16T20:57:44.323 INFO:tasks.rados.rados.0.smithi166.stdout:1141: finishing write tid 3 to smithi16641208-354 2020-11-16T20:57:44.323 INFO:tasks.rados.rados.0.smithi166.stdout:1141: finishing write tid 4 to smithi16641208-354 2020-11-16T20:57:44.324 INFO:tasks.rados.rados.0.smithi166.stdout:1141: finishing write tid 5 to smithi16641208-354 2020-11-16T20:57:44.324 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 354 v 864 (ObjNum 670 snap 48 seq_num 670) dirty exists 2020-11-16T20:57:44.324 INFO:tasks.rados.rados.0.smithi166.stdout:1141: left oid 354 (ObjNum 670 snap 48 seq_num 670) 2020-11-16T20:57:44.324 INFO:tasks.rados.rados.0.smithi166.stdout:1138: done (6 left) 2020-11-16T20:57:44.324 INFO:tasks.rados.rados.0.smithi166.stdout:1141: done (5 left) 2020-11-16T20:57:44.324 INFO:tasks.rados.rados.0.smithi166.stdout:1146: read oid 467 snap -1 2020-11-16T20:57:44.324 INFO:tasks.rados.rados.0.smithi166.stdout:1146: expect (ObjNum 324 snap 0 seq_num 324) 2020-11-16T20:57:44.325 INFO:tasks.rados.rados.0.smithi166.stdout:1147: write oid 443 current snap is 48 2020-11-16T20:57:44.325 INFO:tasks.rados.rados.0.smithi166.stdout:1147: seq_num 672 ranges {494304=406392,1540723=774900,2770957=523347} 2020-11-16T20:57:44.325 INFO:tasks.rados.rados.0.smithi166.stdout:1147: writing smithi16641208-443 from 494304 to 900696 tid 1 2020-11-16T20:57:44.325 INFO:tasks.rados.rados.0.smithi166.stdout:1147: writing smithi16641208-443 from 1540723 to 2315623 tid 2 2020-11-16T20:57:44.325 INFO:tasks.rados.rados.0.smithi166.stdout:1147: writing smithi16641208-443 from 2770957 to 3294304 tid 3 2020-11-16T20:57:44.325 INFO:tasks.rados.rados.0.smithi166.stdout:1148: cache_try_flush oid 171 snap -1 2020-11-16T20:57:44.325 INFO:tasks.rados.rados.0.smithi166.stdout:1143: expect (ObjNum 301 snap 0 seq_num 301) 2020-11-16T20:57:44.326 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:44.322+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:44.326 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:57:44.355 INFO:tasks.rados.rados.0.smithi166.stdout:1144: finishing write tid 1 to smithi16641208-387 2020-11-16T20:57:44.355 INFO:tasks.rados.rados.0.smithi166.stdout:1143: done (7 left) 2020-11-16T20:57:44.355 INFO:tasks.rados.rados.0.smithi166.stdout:1149: copy_from oid 227 from oid 80 current snap is 48 2020-11-16T20:57:44.355 INFO:tasks.rados.rados.0.smithi166.stdout:1144: finishing write tid 2 to smithi16641208-387 2020-11-16T20:57:44.355 INFO:tasks.rados.rados.0.smithi166.stdout:1144: finishing write tid 3 to smithi16641208-387 2020-11-16T20:57:44.356 INFO:tasks.rados.rados.0.smithi166.stdout:1144: finishing write tid 4 to smithi16641208-387 2020-11-16T20:57:44.356 INFO:tasks.rados.rados.0.smithi166.stdout:1144: finishing write tid 5 to smithi16641208-387 2020-11-16T20:57:44.356 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 387 v 867 (ObjNum 671 snap 48 seq_num 671) dirty exists 2020-11-16T20:57:44.356 INFO:tasks.rados.rados.0.smithi166.stdout:1144: left oid 387 (ObjNum 671 snap 48 seq_num 671) 2020-11-16T20:57:44.356 INFO:tasks.rados.rados.0.smithi166.stdout:1146: expect (ObjNum 324 snap 0 seq_num 324) 2020-11-16T20:57:44.417 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:44.423+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:44.465 INFO:tasks.rados.rados.0.smithi166.stdout:1148: got (0) Success 2020-11-16T20:57:44.466 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 171 v 0 (ObjNum 95 snap 0 seq_num 95) dirty exists 2020-11-16T20:57:44.466 INFO:tasks.rados.rados.0.smithi166.stdout:1144: done (7 left) 2020-11-16T20:57:44.466 INFO:tasks.rados.rados.0.smithi166.stdout:1146: done (6 left) 2020-11-16T20:57:44.466 INFO:tasks.rados.rados.0.smithi166.stdout:1148: done (5 left) 2020-11-16T20:57:44.466 INFO:tasks.rados.rados.0.smithi166.stdout:1150: read oid 239 snap -1 2020-11-16T20:57:44.467 INFO:tasks.rados.rados.0.smithi166.stdout:1150: expect (ObjNum 238 snap 0 seq_num 238) 2020-11-16T20:57:44.467 INFO:tasks.rados.rados.0.smithi166.stdout:1151: cache_try_flush oid 5 snap -1 2020-11-16T20:57:44.467 INFO:tasks.rados.rados.0.smithi166.stdout:1152: cache_evict oid 388 snap -1 2020-11-16T20:57:44.467 INFO:tasks.rados.rados.0.smithi166.stdout:1153: read oid 301 snap -1 2020-11-16T20:57:44.467 INFO:tasks.rados.rados.0.smithi166.stdout:1153: expect deleted 2020-11-16T20:57:44.467 INFO:tasks.rados.rados.0.smithi166.stdout:1154: snap_create 2020-11-16T20:57:44.468 INFO:tasks.rados.rados.0.smithi166.stdout:1152: got (16) Device or resource busy 2020-11-16T20:57:44.468 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:57:44.471 INFO:tasks.rados.rados.0.smithi166.stdout:1150: expect (ObjNum 238 snap 0 seq_num 238) 2020-11-16T20:57:44.489 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:57:44.496 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:44.496 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:57:44.497 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:57:44.497 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:44.506 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:57:44.509 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:57:44.529 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:57:44.549 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:44.554+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:44.550 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:57:44.570 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:57:44.592 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:57:44.611 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:57:44.612 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:57:44.613 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:57:44.613 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:57:44.613 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:57:44.613 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:57:44.613 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:57:44.613 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:57:44.614 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:57:44.619 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:44.624+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:44.644 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:44.644 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:44.654 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:57:44.736 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:57:44.741+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:57:44.746 INFO:tasks.rados.rados.0.smithi166.stdout:1150: done (9 left) 2020-11-16T20:57:44.747 INFO:tasks.rados.rados.0.smithi166.stdout:1152: done (8 left) 2020-11-16T20:57:44.747 INFO:tasks.rados.rados.0.smithi166.stdout:1153: done (7 left) 2020-11-16T20:57:44.747 INFO:tasks.rados.rados.0.smithi166.stdout:1154: done (6 left) 2020-11-16T20:57:44.747 INFO:tasks.rados.rados.0.smithi166.stdout:1155: rollback oid 130 current snap is 49 2020-11-16T20:57:44.747 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 130 to 47 2020-11-16T20:57:44.747 INFO:tasks.rados.rados.0.smithi166.stdout:1156: read oid 398 snap -1 2020-11-16T20:57:44.748 INFO:tasks.rados.rados.0.smithi166.stdout:1156: expect (ObjNum 19 snap 0 seq_num 19) 2020-11-16T20:57:44.748 INFO:tasks.rados.rados.0.smithi166.stdout:1157: write (excl) oid 417 current snap is 49 2020-11-16T20:57:44.748 INFO:tasks.rados.rados.0.smithi166.stdout:1157: seq_num 673 ranges {511111=481641,1599205=518558,2682027=489947} 2020-11-16T20:57:44.752 INFO:tasks.rados.rados.0.smithi166.stdout:1157: writing smithi16641208-417 from 511111 to 992752 tid 1 2020-11-16T20:57:44.759 INFO:tasks.rados.rados.0.smithi166.stdout:1157: writing smithi16641208-417 from 1599205 to 2117763 tid 2 2020-11-16T20:57:44.765 INFO:tasks.rados.rados.0.smithi166.stdout:1157: writing smithi16641208-417 from 2682027 to 3171974 tid 3 2020-11-16T20:57:44.765 INFO:tasks.rados.rados.0.smithi166.stdout:1158: read oid 343 snap -1 2020-11-16T20:57:44.766 INFO:tasks.rados.rados.0.smithi166.stdout:1158: expect (ObjNum 342 snap 0 seq_num 342) 2020-11-16T20:57:44.766 INFO:tasks.rados.rados.0.smithi166.stdout:1159: copy_from oid 199 from oid 262 current snap is 49 2020-11-16T20:57:44.766 INFO:tasks.rados.rados.0.smithi166.stdout:1160: copy_from oid 233 from oid 311 current snap is 49 2020-11-16T20:57:44.767 INFO:tasks.rados.rados.0.smithi166.stdout:1155: finishing rollback tid 0 to smithi16641208-130 2020-11-16T20:57:44.767 INFO:tasks.rados.rados.0.smithi166.stdout:1161: read oid 73 snap 47 2020-11-16T20:57:44.767 INFO:tasks.rados.rados.0.smithi166.stdout:1161: expect (ObjNum 72 snap 0 seq_num 72) 2020-11-16T20:57:44.767 INFO:tasks.rados.rados.0.smithi166.stdout:1162: snap_create 2020-11-16T20:57:44.777 INFO:tasks.rados.rados.0.smithi166.stdout:1157: finishing write tid 1 to smithi16641208-417 2020-11-16T20:57:44.782 INFO:tasks.rados.rados.0.smithi166.stdout:1158: expect (ObjNum 342 snap 0 seq_num 342) 2020-11-16T20:57:44.820 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:44.825+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:44.863 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:44.863 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:44.879 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:57:44.921 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:44.927+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:44.930 INFO:tasks.rados.rados.0.smithi166.stdout:1161: expect (ObjNum 72 snap 0 seq_num 72) 2020-11-16T20:57:45.022 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:45.027+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:45.053 INFO:tasks.rados.rados.0.smithi166.stdout:1155: finishing rollback tid 1 to smithi16641208-130 2020-11-16T20:57:45.054 INFO:tasks.rados.rados.0.smithi166.stdout:1155: finishing rollback tid 2 to smithi16641208-130 2020-11-16T20:57:45.054 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 130 v 724 (ObjNum 129 snap 0 seq_num 129) dirty exists 2020-11-16T20:57:45.054 INFO:tasks.rados.rados.0.smithi166.stdout:1157: finishing write tid 2 to smithi16641208-417 2020-11-16T20:57:45.054 INFO:tasks.rados.rados.0.smithi166.stdout:1157: finishing write tid 3 to smithi16641208-417 2020-11-16T20:57:45.054 INFO:tasks.rados.rados.0.smithi166.stdout:1157: finishing write tid 4 to smithi16641208-417 2020-11-16T20:57:45.054 INFO:tasks.rados.rados.0.smithi166.stdout:1157: finishing write tid 5 to smithi16641208-417 2020-11-16T20:57:45.055 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 417 v 727 (ObjNum 673 snap 49 seq_num 673) dirty exists 2020-11-16T20:57:45.055 INFO:tasks.rados.rados.0.smithi166.stdout:1157: left oid 417 (ObjNum 673 snap 49 seq_num 673) 2020-11-16T20:57:45.055 INFO:tasks.rados.rados.0.smithi166.stdout:1132: expect (ObjNum 443 snap 0 seq_num 443) 2020-11-16T20:57:45.066 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:45.066 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:45.077 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:57:45.123 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:45.128+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:45.183 INFO:tasks.rados.rados.0.smithi166.stdout:1147: finishing write tid 1 to smithi16641208-443 2020-11-16T20:57:45.183 INFO:tasks.rados.rados.0.smithi166.stdout:1159: finishing copy_from to smithi16641208-199 2020-11-16T20:57:45.183 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 199 v 197 (ObjNum 261 snap 0 seq_num 261) dirty exists 2020-11-16T20:57:45.184 INFO:tasks.rados.rados.0.smithi166.stdout:1147: finishing write tid 2 to smithi16641208-443 2020-11-16T20:57:45.184 INFO:tasks.rados.rados.0.smithi166.stdout:1145: finishing copy_from to smithi16641208-96 2020-11-16T20:57:45.184 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 96 v 118 (ObjNum 189 snap 0 seq_num 189) dirty exists 2020-11-16T20:57:45.184 INFO:tasks.rados.rados.0.smithi166.stdout:1156: expect (ObjNum 19 snap 0 seq_num 19) 2020-11-16T20:57:45.224 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:45.229+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:45.233 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:45.233 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:45.244 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:57:45.275 INFO:tasks.rados.rados.0.smithi166.stdout:1159: finishing copy_from racing read to smithi16641208-199 2020-11-16T20:57:45.275 INFO:tasks.rados.rados.0.smithi166.stdout:1142: got (0) Success 2020-11-16T20:57:45.275 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 261 v 0 (ObjNum 661 snap 46 seq_num 661) dirty exists 2020-11-16T20:57:45.275 INFO:tasks.rados.rados.0.smithi166.stdout:1147: finishing write tid 3 to smithi16641208-443 2020-11-16T20:57:45.275 INFO:tasks.rados.rados.0.smithi166.stdout:1147: finishing write tid 4 to smithi16641208-443 2020-11-16T20:57:45.275 INFO:tasks.rados.rados.0.smithi166.stdout:1147: finishing write tid 5 to smithi16641208-443 2020-11-16T20:57:45.276 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 443 v 807 (ObjNum 672 snap 48 seq_num 672) dirty exists 2020-11-16T20:57:45.276 INFO:tasks.rados.rados.0.smithi166.stdout:1147: left oid 443 (ObjNum 672 snap 48 seq_num 672) 2020-11-16T20:57:45.276 INFO:tasks.rados.rados.0.smithi166.stdout:1145: finishing copy_from racing read to smithi16641208-96 2020-11-16T20:57:45.276 INFO:tasks.rados.rados.0.smithi166.stdout:1151: got (0) Success 2020-11-16T20:57:45.276 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 5 v 0 (ObjNum 4 snap 0 seq_num 4) dirty exists 2020-11-16T20:57:45.276 INFO:tasks.rados.rados.0.smithi166.stdout:1149: finishing copy_from to smithi16641208-227 2020-11-16T20:57:45.276 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 227 v 63 (ObjNum 79 snap 0 seq_num 79) dirty exists 2020-11-16T20:57:45.277 INFO:tasks.rados.rados.0.smithi166.stdout:1149: finishing copy_from racing read to smithi16641208-227 2020-11-16T20:57:45.277 INFO:tasks.rados.rados.0.smithi166.stdout:1160: finishing copy_from to smithi16641208-233 2020-11-16T20:57:45.277 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 233 v 182 (ObjNum 310 snap 0 seq_num 310) dirty exists 2020-11-16T20:57:45.277 INFO:tasks.rados.rados.0.smithi166.stdout:1160: finishing copy_from racing read to smithi16641208-233 2020-11-16T20:57:45.327 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:45.332+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:45.426 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:45.430+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:45.438 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:45.438 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:45.450 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:57:45.527 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:45.532+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:45.604 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:45.605 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:45.614 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:57:45.686 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:45.632+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:45.729 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:45.733+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:45.748 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:45.748 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:45.757 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:57:45.763 INFO:tasks.rados.rados.0.smithi166.stdout:1132: done (13 left) 2020-11-16T20:57:45.763 INFO:tasks.rados.rados.0.smithi166.stdout:1142: done (12 left) 2020-11-16T20:57:45.763 INFO:tasks.rados.rados.0.smithi166.stdout:1145: done (11 left) 2020-11-16T20:57:45.763 INFO:tasks.rados.rados.0.smithi166.stdout:1147: done (10 left) 2020-11-16T20:57:45.764 INFO:tasks.rados.rados.0.smithi166.stdout:1149: done (9 left) 2020-11-16T20:57:45.764 INFO:tasks.rados.rados.0.smithi166.stdout:1151: done (8 left) 2020-11-16T20:57:45.764 INFO:tasks.rados.rados.0.smithi166.stdout:1155: done (7 left) 2020-11-16T20:57:45.764 INFO:tasks.rados.rados.0.smithi166.stdout:1156: done (6 left) 2020-11-16T20:57:45.764 INFO:tasks.rados.rados.0.smithi166.stdout:1157: done (5 left) 2020-11-16T20:57:45.764 INFO:tasks.rados.rados.0.smithi166.stdout:1158: done (4 left) 2020-11-16T20:57:45.764 INFO:tasks.rados.rados.0.smithi166.stdout:1159: done (3 left) 2020-11-16T20:57:45.765 INFO:tasks.rados.rados.0.smithi166.stdout:1160: done (2 left) 2020-11-16T20:57:45.765 INFO:tasks.rados.rados.0.smithi166.stdout:1161: done (1 left) 2020-11-16T20:57:45.765 INFO:tasks.rados.rados.0.smithi166.stdout:1162: done (0 left) 2020-11-16T20:57:45.765 INFO:tasks.rados.rados.0.smithi166.stdout:1163: rollback oid 85 current snap is 50 2020-11-16T20:57:45.765 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 85 to 48 2020-11-16T20:57:45.765 INFO:tasks.rados.rados.0.smithi166.stdout:1164: write oid 156 current snap is 50 2020-11-16T20:57:45.765 INFO:tasks.rados.rados.0.smithi166.stdout:1164: seq_num 674 ranges {527918=556890,1657687=778569,3225803=102115} 2020-11-16T20:57:45.769 INFO:tasks.rados.rados.0.smithi166.stdout:1164: writing smithi16641208-156 from 527918 to 1084808 tid 1 2020-11-16T20:57:45.777 INFO:tasks.rados.rados.0.smithi166.stdout:1164: writing smithi16641208-156 from 1657687 to 2436256 tid 2 2020-11-16T20:57:45.782 INFO:tasks.rados.rados.0.smithi166.stdout:1164: writing smithi16641208-156 from 3225803 to 3327918 tid 3 2020-11-16T20:57:45.782 INFO:tasks.rados.rados.0.smithi166.stdout:1165: cache_flush oid 110 snap -1 2020-11-16T20:57:45.782 INFO:tasks.rados.rados.0.smithi166.stdout:1164: finishing write tid 1 to smithi16641208-156 2020-11-16T20:57:45.783 INFO:tasks.rados.rados.0.smithi166.stdout:1166: delete oid 428 current snap is 50 2020-11-16T20:57:45.791 INFO:tasks.rados.rados.0.smithi166.stdout:1166: done (3 left) 2020-11-16T20:57:45.792 INFO:tasks.rados.rados.0.smithi166.stdout:1167: snap_remove snap 49 2020-11-16T20:57:45.829 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:45.834+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:45.902 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:45.902 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:45.911 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:57:45.929 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:45.934+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:45.980 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2020-11-16T20:57:46.035 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:46.041+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:46.083 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:46.083 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:46.093 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:57:46.131 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:57:46.136+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:57:46.232 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:46.237+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:46.264 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:46.264 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:46.273 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:57:46.333 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:57:46.338+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:57:46.400 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:46.400 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:46.409 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:57:46.452 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:46.458+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:46.533 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:46.534 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:46.536 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:46.541+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:46.543 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:57:46.623 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:57:46.667 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:46.673+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:46.713 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:46.713 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:46.723 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:57:46.763 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:46.769+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:46.765 INFO:tasks.rados.rados.0.smithi166.stdout:1167: done (3 left) 2020-11-16T20:57:46.766 INFO:tasks.rados.rados.0.smithi166.stdout:1168: write oid 242 current snap is 50 2020-11-16T20:57:46.766 INFO:tasks.rados.rados.0.smithi166.stdout:1168: seq_num 676 ranges {561532=707388,2058298=782238} 2020-11-16T20:57:46.772 INFO:teuthology.orchestra.run.smithi166.stderr:noscrub is unset 2020-11-16T20:57:46.773 INFO:tasks.rados.rados.0.smithi166.stdout:1168: writing smithi16641208-242 from 561532 to 1268920 tid 1 2020-11-16T20:57:46.774 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:57:46.782 INFO:tasks.rados.rados.0.smithi166.stdout:1168: writing smithi16641208-242 from 2058298 to 2840536 tid 2 2020-11-16T20:57:46.782 INFO:tasks.rados.rados.0.smithi166.stdout:1169: cache_try_flush oid 155 snap -1 2020-11-16T20:57:46.783 INFO:tasks.rados.rados.0.smithi166.stdout:1170: snap_create 2020-11-16T20:57:46.783 INFO:tasks.rados.rados.0.smithi166.stdout:1164: finishing write tid 2 to smithi16641208-156 2020-11-16T20:57:46.783 INFO:tasks.rados.rados.0.smithi166.stdout:1164: finishing write tid 3 to smithi16641208-156 2020-11-16T20:57:46.783 INFO:tasks.rados.rados.0.smithi166.stdout:1164: finishing write tid 4 to smithi16641208-156 2020-11-16T20:57:46.783 INFO:tasks.rados.rados.0.smithi166.stdout:1164: finishing write tid 5 to smithi16641208-156 2020-11-16T20:57:46.783 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 156 v 730 (ObjNum 674 snap 50 seq_num 674) dirty exists 2020-11-16T20:57:46.783 INFO:tasks.rados.rados.0.smithi166.stdout:1164: left oid 156 (ObjNum 674 snap 50 seq_num 674) 2020-11-16T20:57:46.784 INFO:tasks.rados.rados.0.smithi166.stdout:1165: got (0) Success 2020-11-16T20:57:46.784 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 110 v 0 (ObjNum 647 snap 41 seq_num 647) dirty exists 2020-11-16T20:57:46.798 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:57:46.820 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:57:46.838 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:46.843+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:46.844 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:57:46.865 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:57:46.885 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:57:46.906 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:57:46.923 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:46.923 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:57:46.923 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:57:46.924 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:57:46.924 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.924 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2979 4.0 4:1852173c:::smithi16641208-329:head [write 581674~637746,stat] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:46.924 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:57:46.924 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 58.123332028999997, 2020-11-16T20:57:46.924 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.009457398, 2020-11-16T20:57:46.924 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:46.925 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:46.925 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:46.925 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:46.925 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:46.925 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2979 2020-11-16T20:57:46.925 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.925 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:46.926 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.926 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:46.926 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:57:46.926 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:46.926 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.926 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.926 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:46.927 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:57:46.927 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030732300000000003 2020-11-16T20:57:46.927 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.927 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.927 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:46.927 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803965+0000", 2020-11-16T20:57:46.927 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0319999999999992e-06 2020-11-16T20:57:46.927 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.928 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.928 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:46.928 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803974+0000", 2020-11-16T20:57:46.928 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5930000000000002e-05 2020-11-16T20:57:46.928 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.928 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.928 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:46.929 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803990+0000", 2020-11-16T20:57:46.929 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1910000000000006e-06 2020-11-16T20:57:46.929 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.929 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.929 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:46.929 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803999+0000", 2020-11-16T20:57:46.929 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5637000000000003e-05 2020-11-16T20:57:46.929 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.930 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.930 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:46.930 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.804055+0000", 2020-11-16T20:57:46.930 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3769000000000001e-05 2020-11-16T20:57:46.930 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.930 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.930 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:46.931 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.804088+0000", 2020-11-16T20:57:46.931 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.995239140000001 2020-11-16T20:57:46.931 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.931 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.931 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:46.931 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799328+0000", 2020-11-16T20:57:46.931 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0137818 2020-11-16T20:57:46.932 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.932 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.932 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:46.932 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813109+0000", 2020-11-16T20:57:46.932 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5759999999999996e-06 2020-11-16T20:57:46.932 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.932 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.932 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:46.933 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813115+0000", 2020-11-16T20:57:46.933 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.009457398 2020-11-16T20:57:46.933 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:46.933 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:46.933 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:46.933 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.933 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.934 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2980 4.0 4:1852173c:::smithi16641208-329:head [write 1840873~558854] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:46.934 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:57:46.934 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 58.117066297000001, 2020-11-16T20:57:46.934 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.039347508000001, 2020-11-16T20:57:46.934 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:46.934 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:46.934 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:46.934 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:46.935 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:46.935 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2980 2020-11-16T20:57:46.935 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.935 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:46.935 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.935 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:46.935 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:57:46.936 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:46.936 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.936 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.936 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:46.936 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:57:46.936 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024810899999999999 2020-11-16T20:57:46.936 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.937 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.937 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:46.937 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810171+0000", 2020-11-16T20:57:46.937 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5610000000000001e-06 2020-11-16T20:57:46.937 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.937 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.937 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:46.937 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810179+0000", 2020-11-16T20:57:46.938 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7418000000000002e-05 2020-11-16T20:57:46.938 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.938 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.938 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:46.938 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810196+0000", 2020-11-16T20:57:46.938 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0079999999999996e-06 2020-11-16T20:57:46.938 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.939 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.939 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:46.939 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810203+0000", 2020-11-16T20:57:46.939 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3705000000000002e-05 2020-11-16T20:57:46.939 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.939 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.939 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:46.939 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810257+0000", 2020-11-16T20:57:46.940 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3656999999999998e-05 2020-11-16T20:57:46.940 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.940 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.940 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:46.940 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810311+0000", 2020-11-16T20:57:46.940 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.989427508 2020-11-16T20:57:46.940 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.941 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.941 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:46.941 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799738+0000", 2020-11-16T20:57:46.941 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2526000000000003e-05 2020-11-16T20:57:46.941 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.941 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.941 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:46.941 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799811+0000", 2020-11-16T20:57:46.942 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027934184000000001 2020-11-16T20:57:46.942 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.942 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.942 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:46.942 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827745+0000", 2020-11-16T20:57:46.942 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015776700000000001 2020-11-16T20:57:46.942 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.943 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.943 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:46.943 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827903+0000", 2020-11-16T20:57:46.943 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000185539 2020-11-16T20:57:46.943 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.943 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.943 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:46.944 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.828088+0000", 2020-11-16T20:57:46.944 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018143857999999999 2020-11-16T20:57:46.944 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.944 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.944 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:46.944 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846232+0000", 2020-11-16T20:57:46.944 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00074682199999999996 2020-11-16T20:57:46.944 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.945 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.945 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:46.945 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846979+0000", 2020-11-16T20:57:46.945 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021617530000000002 2020-11-16T20:57:46.945 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.945 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.945 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:46.946 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849141+0000", 2020-11-16T20:57:46.946 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4513999999999998e-05 2020-11-16T20:57:46.946 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.946 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.946 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:46.946 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849215+0000", 2020-11-16T20:57:46.946 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5578999999999998e-05 2020-11-16T20:57:46.947 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.947 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.947 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:46.947 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849271+0000", 2020-11-16T20:57:46.947 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.039347508000001 2020-11-16T20:57:46.947 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:46.947 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:46.947 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:46.948 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.948 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.948 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2981 4.0 4:1852173c:::smithi16641208-329:head [write 3066417~537135] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:46.948 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:57:46.948 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 58.110149999999997, 2020-11-16T20:57:46.948 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.032910677, 2020-11-16T20:57:46.948 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:46.949 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:46.949 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:46.949 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:46.949 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:46.949 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2981 2020-11-16T20:57:46.949 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.949 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:46.949 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.950 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:46.950 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:57:46.950 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:46.950 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.950 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.950 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:46.950 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:57:46.951 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024974099999999999 2020-11-16T20:57:46.951 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.951 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.951 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:46.951 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817089+0000", 2020-11-16T20:57:46.951 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3829999999999992e-06 2020-11-16T20:57:46.951 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.952 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.952 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:46.952 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817098+0000", 2020-11-16T20:57:46.952 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2118e-05 2020-11-16T20:57:46.952 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.952 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.952 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:46.952 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817110+0000", 2020-11-16T20:57:46.953 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6050000000000004e-06 2020-11-16T20:57:46.953 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.953 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.953 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:46.953 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817119+0000", 2020-11-16T20:57:46.953 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7204000000000003e-05 2020-11-16T20:57:46.953 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.954 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.954 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:46.954 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817177+0000", 2020-11-16T20:57:46.954 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9932999999999998e-05 2020-11-16T20:57:46.954 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.954 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.954 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:46.954 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817227+0000", 2020-11-16T20:57:46.955 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.98265286 2020-11-16T20:57:46.955 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.955 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.955 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:46.955 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799879+0000", 2020-11-16T20:57:46.955 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.737e-05 2020-11-16T20:57:46.955 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.956 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.956 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:46.956 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799947+0000", 2020-11-16T20:57:46.956 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029940584999999999 2020-11-16T20:57:46.956 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.956 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.956 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:46.956 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.829887+0000", 2020-11-16T20:57:46.957 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000217505 2020-11-16T20:57:46.957 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.957 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.957 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:46.957 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.830105+0000", 2020-11-16T20:57:46.957 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029022100000000001 2020-11-16T20:57:46.957 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.958 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.958 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:46.958 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.830395+0000", 2020-11-16T20:57:46.958 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015847953000000001 2020-11-16T20:57:46.958 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.958 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.958 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:46.959 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846243+0000", 2020-11-16T20:57:46.959 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0011558250000000001 2020-11-16T20:57:46.959 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.959 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.959 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:46.959 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847399+0000", 2020-11-16T20:57:46.959 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021524500000000002 2020-11-16T20:57:46.959 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.960 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.960 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:46.960 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849551+0000", 2020-11-16T20:57:46.960 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000138787 2020-11-16T20:57:46.960 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.960 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.960 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:46.961 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849690+0000", 2020-11-16T20:57:46.961 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0136999999999997e-05 2020-11-16T20:57:46.961 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.961 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.961 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:46.961 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849750+0000", 2020-11-16T20:57:46.961 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.032910677 2020-11-16T20:57:46.961 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:46.962 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:46.962 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:46.962 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.962 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.962 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2982 4.0 4:1852173c:::smithi16641208-329:head [setxattr _header (58) in=7b,truncate 3781674] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:46.962 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:57:46.962 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 58.109831685000003, 2020-11-16T20:57:46.963 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.035208633, 2020-11-16T20:57:46.963 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:46.963 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:46.963 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:46.963 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:46.963 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:46.963 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2982 2020-11-16T20:57:46.963 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.964 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:46.964 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.964 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:46.964 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:57:46.964 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:46.964 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.964 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.965 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:46.965 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:57:46.965 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8856000000000002e-05 2020-11-16T20:57:46.965 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.965 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.965 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:46.965 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817197+0000", 2020-11-16T20:57:46.965 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.93e-06 2020-11-16T20:57:46.966 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.966 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.966 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:46.966 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817203+0000", 2020-11-16T20:57:46.966 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0932e-05 2020-11-16T20:57:46.966 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.966 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.967 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:46.967 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817214+0000", 2020-11-16T20:57:46.967 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3470000000000001e-06 2020-11-16T20:57:46.967 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.967 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.967 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:46.967 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817218+0000", 2020-11-16T20:57:46.968 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4603e-05 2020-11-16T20:57:46.968 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.968 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.968 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:46.968 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817263+0000", 2020-11-16T20:57:46.968 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6387000000000002e-05 2020-11-16T20:57:46.968 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.968 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.969 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:46.969 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817309+0000", 2020-11-16T20:57:46.969 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.982698653 2020-11-16T20:57:46.969 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.969 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.969 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:46.969 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800008+0000", 2020-11-16T20:57:46.970 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5400000000000004e-05 2020-11-16T20:57:46.970 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.970 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.970 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:46.970 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800073+0000", 2020-11-16T20:57:46.970 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.044932818999999999 2020-11-16T20:57:46.970 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.970 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.971 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:46.971 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845006+0000", 2020-11-16T20:57:46.971 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017285099999999999 2020-11-16T20:57:46.971 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.971 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.971 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:46.971 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845179+0000", 2020-11-16T20:57:46.972 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023420900000000001 2020-11-16T20:57:46.972 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.972 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.972 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:46.972 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845413+0000", 2020-11-16T20:57:46.972 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0020276000000000001 2020-11-16T20:57:46.972 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.972 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.973 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:46.973 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847441+0000", 2020-11-16T20:57:46.973 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00050358800000000002 2020-11-16T20:57:46.973 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.973 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.973 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:46.973 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847944+0000", 2020-11-16T20:57:46.974 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042758900000000001 2020-11-16T20:57:46.974 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.974 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.974 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:46.974 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852220+0000", 2020-11-16T20:57:46.974 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9648999999999997e-05 2020-11-16T20:57:46.974 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.974 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.975 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:46.975 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852290+0000", 2020-11-16T20:57:46.975 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6919e-05 2020-11-16T20:57:46.975 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.975 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.975 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:46.975 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852367+0000", 2020-11-16T20:57:46.976 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.035208633 2020-11-16T20:57:46.976 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:46.976 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:46.976 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:46.976 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.976 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.976 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2983 4.0 4:1852173c:::smithi16641208-329:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e86)", 2020-11-16T20:57:46.977 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:57:46.977 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 58.109741218000003, 2020-11-16T20:57:46.977 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.037016812999999, 2020-11-16T20:57:46.977 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:46.977 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:46.977 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:46.977 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:46.978 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:46.978 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2983 2020-11-16T20:57:46.978 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.978 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:46.978 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.978 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:46.978 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:57:46.979 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:46.979 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.979 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.979 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:46.979 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:57:46.979 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7317999999999999e-05 2020-11-16T20:57:46.979 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.979 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.980 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:46.980 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817266+0000", 2020-11-16T20:57:46.980 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3519999999999998e-06 2020-11-16T20:57:46.980 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.980 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.980 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:46.980 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817269+0000", 2020-11-16T20:57:46.981 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7859999999999999e-06 2020-11-16T20:57:46.981 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.981 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.981 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:46.981 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817276+0000", 2020-11-16T20:57:46.981 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5620000000000002e-06 2020-11-16T20:57:46.981 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.981 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.982 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:46.982 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817278+0000", 2020-11-16T20:57:46.982 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3251999999999996e-05 2020-11-16T20:57:46.982 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.982 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.982 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:46.982 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817352+0000", 2020-11-16T20:57:46.983 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7966000000000001e-05 2020-11-16T20:57:46.983 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.983 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.983 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:46.983 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817400+0000", 2020-11-16T20:57:46.983 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.982734203 2020-11-16T20:57:46.983 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.984 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.984 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:46.984 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800134+0000", 2020-11-16T20:57:46.984 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9765999999999997e-05 2020-11-16T20:57:46.984 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.984 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.984 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:46.984 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800194+0000", 2020-11-16T20:57:46.985 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.046087276000000003 2020-11-16T20:57:46.985 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.985 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.985 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:46.985 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846281+0000", 2020-11-16T20:57:46.985 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000115396 2020-11-16T20:57:46.985 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.985 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.986 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:46.986 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846396+0000", 2020-11-16T20:57:46.986 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006004573 2020-11-16T20:57:46.986 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.986 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.986 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:46.986 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852401+0000", 2020-11-16T20:57:46.987 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013211599999999999 2020-11-16T20:57:46.987 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.987 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.987 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:46.987 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852533+0000", 2020-11-16T20:57:46.987 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0017322469999999999 2020-11-16T20:57:46.987 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.988 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.988 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:46.988 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.854265+0000", 2020-11-16T20:57:46.988 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.037016812999999 2020-11-16T20:57:46.988 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:46.988 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:46.988 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:46.988 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.989 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.989 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2984 4.0 4:033219d6:::smithi16641208-386:head [write 598481~712995,stat] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:46.989 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:57:46.989 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 58.102681376, 2020-11-16T20:57:46.989 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.003104742, 2020-11-16T20:57:46.989 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:46.989 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:46.990 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:46.990 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:46.990 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:46.990 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2984 2020-11-16T20:57:46.990 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.990 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:46.990 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.990 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:46.991 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:57:46.991 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:46.991 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.991 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.991 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:46.991 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:57:46.991 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00037173000000000002 2020-11-16T20:57:46.992 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.992 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.992 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:46.992 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824680+0000", 2020-11-16T20:57:46.992 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.146e-05 2020-11-16T20:57:46.992 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.992 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.992 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:46.993 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824691+0000", 2020-11-16T20:57:46.993 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6951000000000001e-05 2020-11-16T20:57:46.993 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.993 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.993 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:46.993 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824708+0000", 2020-11-16T20:57:46.993 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2082000000000001e-05 2020-11-16T20:57:46.994 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.994 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.994 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:46.994 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824720+0000", 2020-11-16T20:57:46.994 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0284000000000002e-05 2020-11-16T20:57:46.994 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.994 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.995 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:46.995 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824771+0000", 2020-11-16T20:57:46.995 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1241000000000001e-05 2020-11-16T20:57:46.995 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.995 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.995 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:46.995 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824802+0000", 2020-11-16T20:57:46.995 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.975455838 2020-11-16T20:57:46.996 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.996 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.996 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:46.996 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800258+0000", 2020-11-16T20:57:46.996 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027151194999999999 2020-11-16T20:57:46.996 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.996 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.997 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:46.997 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827409+0000", 2020-11-16T20:57:46.997 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9609999999999999e-06 2020-11-16T20:57:46.997 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.997 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.997 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:46.997 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827413+0000", 2020-11-16T20:57:46.997 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.003104742 2020-11-16T20:57:46.998 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:46.998 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:46.998 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:46.998 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:46.998 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:46.998 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2985 4.0 4:033219d6:::smithi16641208-386:head [write 1899355~418865] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:46.998 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:57:46.999 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 58.097070094000003, 2020-11-16T20:57:46.999 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.021091737000001, 2020-11-16T20:57:46.999 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:46.999 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:46.999 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:46.999 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:46.999 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:47.000 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2985 2020-11-16T20:57:47.000 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.000 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.000 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.000 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.000 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:57:47.000 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.000 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.001 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.001 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.001 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:57:47.001 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023221799999999999 2020-11-16T20:57:47.001 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.001 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.001 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.002 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830152+0000", 2020-11-16T20:57:47.002 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9769999999999995e-06 2020-11-16T20:57:47.002 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.002 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.002 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.002 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830162+0000", 2020-11-16T20:57:47.002 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5545000000000001e-05 2020-11-16T20:57:47.003 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.003 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.003 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.003 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830177+0000", 2020-11-16T20:57:47.003 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0334e-05 2020-11-16T20:57:47.003 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.003 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.003 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.004 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830188+0000", 2020-11-16T20:57:47.004 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3430999999999996e-05 2020-11-16T20:57:47.004 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.004 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.004 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.004 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830251+0000", 2020-11-16T20:57:47.004 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2651999999999997e-05 2020-11-16T20:57:47.005 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.005 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.005 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:47.005 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830304+0000", 2020-11-16T20:57:47.005 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.970289857999999 2020-11-16T20:57:47.005 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.005 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.005 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.006 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800594+0000", 2020-11-16T20:57:47.006 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8948999999999993e-05 2020-11-16T20:57:47.006 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.006 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.006 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:47.006 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800663+0000", 2020-11-16T20:57:47.007 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036018513000000002 2020-11-16T20:57:47.007 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.007 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.007 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.007 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836681+0000", 2020-11-16T20:57:47.007 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013201099999999999 2020-11-16T20:57:47.007 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.007 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.008 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.008 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836813+0000", 2020-11-16T20:57:47.008 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000126635 2020-11-16T20:57:47.008 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.008 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.008 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:47.008 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836940+0000", 2020-11-16T20:57:47.009 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010477907 2020-11-16T20:57:47.009 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.009 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.009 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:47.009 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847418+0000", 2020-11-16T20:57:47.009 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000158796 2020-11-16T20:57:47.009 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.009 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.010 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.010 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847576+0000", 2020-11-16T20:57:47.010 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033023729999999999 2020-11-16T20:57:47.010 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.010 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.010 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.010 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850879+0000", 2020-11-16T20:57:47.011 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6360999999999996e-05 2020-11-16T20:57:47.011 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.011 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.011 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:47.011 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850955+0000", 2020-11-16T20:57:47.011 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6177000000000001e-05 2020-11-16T20:57:47.011 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.011 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.012 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.012 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851011+0000", 2020-11-16T20:57:47.012 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.021091737000001 2020-11-16T20:57:47.012 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.012 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.012 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.012 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.013 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.013 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2986 4.0 4:033219d6:::smithi16641208-386:head [write 3093840~704641] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:47.013 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:57:47.013 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 58.088844391999999, 2020-11-16T20:57:47.013 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013155362999999, 2020-11-16T20:57:47.013 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.013 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:47.013 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:47.014 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:47.014 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:47.014 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2986 2020-11-16T20:57:47.014 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.014 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.014 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.014 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.015 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:57:47.015 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.015 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.015 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.015 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.015 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:57:47.015 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00038247200000000002 2020-11-16T20:57:47.016 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.016 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.016 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838528+0000", 2020-11-16T20:57:47.016 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3299999999999999e-06 2020-11-16T20:57:47.016 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.016 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.017 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838536+0000", 2020-11-16T20:57:47.017 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3438000000000001e-05 2020-11-16T20:57:47.017 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.017 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.017 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.017 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838549+0000", 2020-11-16T20:57:47.017 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0213e-05 2020-11-16T20:57:47.018 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.018 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.018 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.018 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838560+0000", 2020-11-16T20:57:47.018 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1894999999999997e-05 2020-11-16T20:57:47.018 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.018 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.018 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.019 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838612+0000", 2020-11-16T20:57:47.019 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8209e-05 2020-11-16T20:57:47.019 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.019 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.019 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:47.019 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838650+0000", 2020-11-16T20:57:47.019 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962061715000001 2020-11-16T20:57:47.020 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.020 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.020 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.020 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800712+0000", 2020-11-16T20:57:47.020 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6964e-05 2020-11-16T20:57:47.020 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.020 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.020 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:47.021 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800748+0000", 2020-11-16T20:57:47.021 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037209265999999998 2020-11-16T20:57:47.021 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.021 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.021 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.021 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.837958+0000", 2020-11-16T20:57:47.021 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000160304 2020-11-16T20:57:47.022 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.022 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.022 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.022 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.838118+0000", 2020-11-16T20:57:47.022 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022362799999999999 2020-11-16T20:57:47.022 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.022 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.022 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:47.023 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.838342+0000", 2020-11-16T20:57:47.023 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0090844710000000002 2020-11-16T20:57:47.023 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.023 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.023 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:47.023 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847426+0000", 2020-11-16T20:57:47.023 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000219199 2020-11-16T20:57:47.024 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.024 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.024 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.024 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847645+0000", 2020-11-16T20:57:47.024 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003411603 2020-11-16T20:57:47.024 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.024 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.024 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.025 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851057+0000", 2020-11-16T20:57:47.025 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014736799999999999 2020-11-16T20:57:47.025 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.025 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.025 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:47.025 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851204+0000", 2020-11-16T20:57:47.025 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6287999999999997e-05 2020-11-16T20:57:47.026 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.026 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.026 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.026 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851301+0000", 2020-11-16T20:57:47.026 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013155362999999 2020-11-16T20:57:47.026 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.026 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.027 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.027 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.027 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.027 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2987 4.0 4:033219d6:::smithi16641208-386:head [setxattr _header (58) in=7b,truncate 3798481] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:47.027 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:57:47.027 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 58.088385752999997, 2020-11-16T20:57:47.027 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.012971041, 2020-11-16T20:57:47.027 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.028 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:47.028 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:47.028 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:47.028 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:47.028 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2987 2020-11-16T20:57:47.028 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.028 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.029 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.029 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.029 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:57:47.029 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.029 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.029 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.029 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.029 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:57:47.030 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4530000000000002e-05 2020-11-16T20:57:47.030 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.030 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.030 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.030 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838648+0000", 2020-11-16T20:57:47.030 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8390000000000001e-06 2020-11-16T20:57:47.030 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.031 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.031 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.031 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838655+0000", 2020-11-16T20:57:47.031 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0341e-05 2020-11-16T20:57:47.031 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.031 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.031 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.031 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838666+0000", 2020-11-16T20:57:47.032 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0929999999999999e-06 2020-11-16T20:57:47.032 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.032 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.032 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.032 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838672+0000", 2020-11-16T20:57:47.032 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8074999999999997e-05 2020-11-16T20:57:47.032 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.033 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.033 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.033 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838710+0000", 2020-11-16T20:57:47.033 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1121000000000002e-05 2020-11-16T20:57:47.033 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.033 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.033 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:47.033 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838751+0000", 2020-11-16T20:57:47.034 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962044797000001 2020-11-16T20:57:47.034 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.034 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.034 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.034 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800796+0000", 2020-11-16T20:57:47.034 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6808999999999998e-05 2020-11-16T20:57:47.034 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.035 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.035 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:47.035 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800852+0000", 2020-11-16T20:57:47.035 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042964599999999999 2020-11-16T20:57:47.035 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.035 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.035 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.036 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843817+0000", 2020-11-16T20:57:47.036 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017807899999999999 2020-11-16T20:57:47.036 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.036 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.036 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.036 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843995+0000", 2020-11-16T20:57:47.036 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023680500000000001 2020-11-16T20:57:47.036 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.037 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.037 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:47.037 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844232+0000", 2020-11-16T20:57:47.037 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00320163 2020-11-16T20:57:47.037 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.037 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.037 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:47.038 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847434+0000", 2020-11-16T20:57:47.038 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00042527899999999998 2020-11-16T20:57:47.038 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.038 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.038 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.038 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847859+0000", 2020-11-16T20:57:47.038 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0034987920000000001 2020-11-16T20:57:47.038 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.039 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.039 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.039 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851358+0000", 2020-11-16T20:57:47.039 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014067300000000001 2020-11-16T20:57:47.039 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.039 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.039 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:47.040 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851498+0000", 2020-11-16T20:57:47.040 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6577999999999998e-05 2020-11-16T20:57:47.040 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.040 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.040 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.040 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851575+0000", 2020-11-16T20:57:47.040 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.012971041 2020-11-16T20:57:47.040 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.041 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.041 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.041 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.041 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.041 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2988 4.0 4:033219d6:::smithi16641208-386:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e86)", 2020-11-16T20:57:47.041 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:57:47.041 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 58.088283253999997, 2020-11-16T20:57:47.042 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013229791000001, 2020-11-16T20:57:47.042 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.042 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:47.042 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:47.042 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:47.042 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:47.042 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2988 2020-11-16T20:57:47.043 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.043 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.043 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.043 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.043 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:57:47.043 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.043 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.044 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.044 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.044 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:57:47.044 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9252999999999999e-05 2020-11-16T20:57:47.044 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.044 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.044 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.044 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838736+0000", 2020-11-16T20:57:47.045 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3980000000000004e-06 2020-11-16T20:57:47.045 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.045 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.045 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.045 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838742+0000", 2020-11-16T20:57:47.045 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1144999999999999e-05 2020-11-16T20:57:47.045 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.046 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.046 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.046 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838753+0000", 2020-11-16T20:57:47.046 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6229999999999996e-06 2020-11-16T20:57:47.046 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.046 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.046 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.047 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838758+0000", 2020-11-16T20:57:47.047 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5130000000000003e-05 2020-11-16T20:57:47.047 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.047 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.047 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.047 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838803+0000", 2020-11-16T20:57:47.047 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0132000000000001e-05 2020-11-16T20:57:47.048 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.048 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.048 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:47.048 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838843+0000", 2020-11-16T20:57:47.048 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962066786999999 2020-11-16T20:57:47.048 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.048 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.048 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.049 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800910+0000", 2020-11-16T20:57:47.049 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6925999999999997e-05 2020-11-16T20:57:47.049 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.049 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.049 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:47.049 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800967+0000", 2020-11-16T20:57:47.049 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.043837752000000001 2020-11-16T20:57:47.050 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.050 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.050 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.050 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844805+0000", 2020-11-16T20:57:47.050 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012337000000000001 2020-11-16T20:57:47.050 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.050 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.050 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:47.051 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844928+0000", 2020-11-16T20:57:47.051 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0066885149999999999 2020-11-16T20:57:47.051 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.051 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.051 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.051 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851616+0000", 2020-11-16T20:57:47.051 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5716000000000005e-05 2020-11-16T20:57:47.052 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.052 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.052 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.052 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851692+0000", 2020-11-16T20:57:47.052 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024404400000000001 2020-11-16T20:57:47.052 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.052 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.053 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.053 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851936+0000", 2020-11-16T20:57:47.053 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013229791000001 2020-11-16T20:57:47.053 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.053 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.053 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.053 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.053 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.054 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2992 4.0 4:0f4a2e46:::smithi16641208-399:head [cache-evict] snapc 0=[] ondisk+read+ignore_cache+known_if_redirected e86)", 2020-11-16T20:57:47.054 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:57:47.054 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 58.088196916999998, 2020-11-16T20:57:47.054 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962433468, 2020-11-16T20:57:47.054 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.054 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:47.054 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:47.055 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:47.055 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:47.055 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2992 2020-11-16T20:57:47.055 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.055 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.055 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.055 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.055 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:57:47.056 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.056 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.056 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.056 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.056 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:57:47.056 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7780000000000002e-05 2020-11-16T20:57:47.056 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.057 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.057 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.057 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838820+0000", 2020-11-16T20:57:47.057 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1200000000000001e-06 2020-11-16T20:57:47.057 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.057 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.057 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.057 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838826+0000", 2020-11-16T20:57:47.058 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0008e-05 2020-11-16T20:57:47.058 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.058 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.058 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.058 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838836+0000", 2020-11-16T20:57:47.058 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3749999999999996e-06 2020-11-16T20:57:47.058 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.059 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.059 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.059 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838840+0000", 2020-11-16T20:57:47.059 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0889000000000002e-05 2020-11-16T20:57:47.059 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.059 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.059 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.059 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838871+0000", 2020-11-16T20:57:47.060 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6891000000000003e-05 2020-11-16T20:57:47.060 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.060 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.060 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:47.060 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838908+0000", 2020-11-16T20:57:47.060 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962115045999999 2020-11-16T20:57:47.060 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.061 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.061 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.061 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801023+0000", 2020-11-16T20:57:47.061 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020335899999999999 2020-11-16T20:57:47.061 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.061 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.061 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.061 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801226+0000", 2020-11-16T20:57:47.062 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962433468 2020-11-16T20:57:47.062 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.062 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.062 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.062 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.062 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.062 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3051 4.0 4:2ceac9f9:::smithi16641208-61:head [write 699323~480842] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:57:47.063 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:57:47.063 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 53.086076609999999, 2020-11-16T20:57:47.063 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9728349610000002, 2020-11-16T20:57:47.063 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.063 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:47.063 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:47.063 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:47.063 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:47.064 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3051 2020-11-16T20:57:47.064 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.064 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.064 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.064 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.064 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:57:47.064 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.065 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.065 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:57:47.065 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032526199999999999 2020-11-16T20:57:47.065 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841238+0000", 2020-11-16T20:57:47.066 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9822000000000001e-05 2020-11-16T20:57:47.066 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.066 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.066 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841258+0000", 2020-11-16T20:57:47.066 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.507e-05 2020-11-16T20:57:47.067 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.067 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.067 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.067 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841273+0000", 2020-11-16T20:57:47.067 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8900000000000007e-06 2020-11-16T20:57:47.067 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.067 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.067 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.068 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841281+0000", 2020-11-16T20:57:47.068 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4356000000000003e-05 2020-11-16T20:57:47.068 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.068 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.068 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.068 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841365+0000", 2020-11-16T20:57:47.068 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0232000000000002e-05 2020-11-16T20:57:47.069 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.069 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.069 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:47.069 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841426+0000", 2020-11-16T20:57:47.069 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9604309439999996 2020-11-16T20:57:47.069 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.069 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.070 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.070 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801857+0000", 2020-11-16T20:57:47.070 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000164897 2020-11-16T20:57:47.070 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.070 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.070 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.070 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.802021+0000", 2020-11-16T20:57:47.070 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020576500000000001 2020-11-16T20:57:47.071 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.071 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.071 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:47.071 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.802227+0000", 2020-11-16T20:57:47.071 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0066237170000000003 2020-11-16T20:57:47.071 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.071 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.072 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:47.072 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808851+0000", 2020-11-16T20:57:47.072 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037712430000000001 2020-11-16T20:57:47.072 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.072 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.072 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.072 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812622+0000", 2020-11-16T20:57:47.072 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00099110800000000009 2020-11-16T20:57:47.073 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.073 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.073 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.073 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813613+0000", 2020-11-16T20:57:47.073 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1646e-05 2020-11-16T20:57:47.073 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.073 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.074 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:47.074 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813665+0000", 2020-11-16T20:57:47.074 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3009000000000004e-05 2020-11-16T20:57:47.074 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.074 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.074 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.074 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813748+0000", 2020-11-16T20:57:47.075 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9728349610000002 2020-11-16T20:57:47.075 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.075 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.075 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.075 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.075 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.075 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3052 4.0 4:2ceac9f9:::smithi16641208-61:head [write 1850247~429872] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:57:47.075 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:57:47.076 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 53.077885571000003, 2020-11-16T20:57:47.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9911138360000002, 2020-11-16T20:57:47.076 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.076 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:47.076 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:47.076 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:47.076 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:47.077 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3052 2020-11-16T20:57:47.077 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.077 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.077 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.077 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.077 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:57:47.077 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.077 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.078 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.078 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.078 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:57:47.078 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000296166 2020-11-16T20:57:47.078 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.078 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.078 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.079 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849400+0000", 2020-11-16T20:57:47.079 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0699999999999996e-06 2020-11-16T20:57:47.079 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.079 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.079 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.079 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849409+0000", 2020-11-16T20:57:47.079 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3725e-05 2020-11-16T20:57:47.080 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.080 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.080 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.080 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849423+0000", 2020-11-16T20:57:47.080 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9929999999999998e-06 2020-11-16T20:57:47.080 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.080 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.080 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.081 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849430+0000", 2020-11-16T20:57:47.081 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9708000000000002e-05 2020-11-16T20:57:47.081 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.081 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.081 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.081 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849520+0000", 2020-11-16T20:57:47.081 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2088000000000002e-05 2020-11-16T20:57:47.082 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.082 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.082 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:47.082 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849552+0000", 2020-11-16T20:57:47.082 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.954526692 2020-11-16T20:57:47.082 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.082 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.082 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.083 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804079+0000", 2020-11-16T20:57:47.083 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015456899999999999 2020-11-16T20:57:47.083 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.083 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.083 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.083 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804233+0000", 2020-11-16T20:57:47.083 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019627800000000001 2020-11-16T20:57:47.084 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.084 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.084 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:47.084 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804429+0000", 2020-11-16T20:57:47.084 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006762316 2020-11-16T20:57:47.084 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.084 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.085 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:47.085 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811192+0000", 2020-11-16T20:57:47.085 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002630467 2020-11-16T20:57:47.085 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.085 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.085 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.085 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813822+0000", 2020-11-16T20:57:47.085 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026302065999999999 2020-11-16T20:57:47.086 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.086 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.086 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.086 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840124+0000", 2020-11-16T20:57:47.086 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.274e-05 2020-11-16T20:57:47.086 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.086 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.087 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:47.087 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840177+0000", 2020-11-16T20:57:47.087 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0958000000000003e-05 2020-11-16T20:57:47.087 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.087 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.087 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.087 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840218+0000", 2020-11-16T20:57:47.087 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9911138360000002 2020-11-16T20:57:47.088 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.088 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.088 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.088 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.088 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.088 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3053 4.0 4:2ceac9f9:::smithi16641208-61:head [write 2858378~532392] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:57:47.088 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:57:47.089 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 53.069428240000001, 2020-11-16T20:57:47.089 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9828430529999999, 2020-11-16T20:57:47.089 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.089 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:47.089 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:47.089 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:47.089 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:47.090 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3053 2020-11-16T20:57:47.090 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.090 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.090 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.090 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.090 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:57:47.090 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.091 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.091 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.091 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.091 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:57:47.091 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000647082 2020-11-16T20:57:47.091 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.091 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.092 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.092 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858208+0000", 2020-11-16T20:57:47.092 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.269e-05 2020-11-16T20:57:47.092 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.092 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.092 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.092 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858221+0000", 2020-11-16T20:57:47.092 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0361e-05 2020-11-16T20:57:47.093 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.093 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.093 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.093 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858242+0000", 2020-11-16T20:57:47.093 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1184e-05 2020-11-16T20:57:47.093 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.093 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.094 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.094 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858253+0000", 2020-11-16T20:57:47.094 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7032000000000004e-05 2020-11-16T20:57:47.094 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.094 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.094 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.094 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858330+0000", 2020-11-16T20:57:47.094 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4135999999999998e-05 2020-11-16T20:57:47.095 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.095 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.095 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:47.095 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858384+0000", 2020-11-16T20:57:47.095 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9487614310000003 2020-11-16T20:57:47.095 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.095 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.096 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.096 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807145+0000", 2020-11-16T20:57:47.096 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9426000000000007e-05 2020-11-16T20:57:47.096 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.096 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.096 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.096 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807245+0000", 2020-11-16T20:57:47.097 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018410799999999999 2020-11-16T20:57:47.097 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.097 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.097 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:47.097 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807429+0000", 2020-11-16T20:57:47.097 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0064067339999999999 2020-11-16T20:57:47.097 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.098 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.098 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:47.098 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813836+0000", 2020-11-16T20:57:47.098 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001513267 2020-11-16T20:57:47.098 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.098 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.098 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.098 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815349+0000", 2020-11-16T20:57:47.099 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024962895999999998 2020-11-16T20:57:47.099 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.099 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.099 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.099 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840312+0000", 2020-11-16T20:57:47.099 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7781999999999997e-05 2020-11-16T20:57:47.099 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.100 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.100 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:47.100 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840370+0000", 2020-11-16T20:57:47.100 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4924e-05 2020-11-16T20:57:47.100 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.100 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.100 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.101 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840404+0000", 2020-11-16T20:57:47.101 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9828430529999999 2020-11-16T20:57:47.101 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.101 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.101 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.101 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.101 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.101 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3054 4.0 4:2ceac9f9:::smithi16641208-61:head [setxattr _header (57) in=7b,truncate 3899323] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:57:47.102 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:57:47.102 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 53.068675732999999, 2020-11-16T20:57:47.102 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9822430049999999, 2020-11-16T20:57:47.102 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.102 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:47.102 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:47.102 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:47.103 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:47.103 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3054 2020-11-16T20:57:47.103 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.103 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.103 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.103 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.103 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:57:47.104 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.104 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.104 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.104 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.104 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:57:47.104 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8208999999999999e-05 2020-11-16T20:57:47.104 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.104 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.105 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.105 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858362+0000", 2020-11-16T20:57:47.105 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5539999999999998e-06 2020-11-16T20:57:47.105 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.105 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.105 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.105 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858371+0000", 2020-11-16T20:57:47.106 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.005e-05 2020-11-16T20:57:47.106 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.106 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.106 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.106 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858381+0000", 2020-11-16T20:57:47.106 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8099999999999997e-06 2020-11-16T20:57:47.106 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.106 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.107 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.107 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858386+0000", 2020-11-16T20:57:47.107 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6168000000000005e-05 2020-11-16T20:57:47.107 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.107 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.107 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.107 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858482+0000", 2020-11-16T20:57:47.108 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7954999999999999e-05 2020-11-16T20:57:47.108 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.108 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.108 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:47.108 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858510+0000", 2020-11-16T20:57:47.108 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9498925639999998 2020-11-16T20:57:47.108 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.108 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.109 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.109 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808402+0000", 2020-11-16T20:57:47.109 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3084000000000005e-05 2020-11-16T20:57:47.109 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.109 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.109 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.109 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808495+0000", 2020-11-16T20:57:47.110 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114826 2020-11-16T20:57:47.110 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.110 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.110 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:57:47.110 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808610+0000", 2020-11-16T20:57:47.110 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052363219999999999 2020-11-16T20:57:47.110 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.111 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.111 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:47.111 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813846+0000", 2020-11-16T20:57:47.111 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0015700709999999999 2020-11-16T20:57:47.111 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.111 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.111 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.112 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815417+0000", 2020-11-16T20:57:47.112 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025048682999999999 2020-11-16T20:57:47.112 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.112 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.112 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.112 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840465+0000", 2020-11-16T20:57:47.112 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5473000000000003e-05 2020-11-16T20:57:47.112 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.113 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:47.113 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840511+0000", 2020-11-16T20:57:47.113 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6236000000000003e-05 2020-11-16T20:57:47.113 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.113 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.114 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840557+0000", 2020-11-16T20:57:47.114 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9822430049999999 2020-11-16T20:57:47.114 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.114 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.114 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.114 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.114 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.114 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3055 4.0 4:2ceac9f9:::smithi16641208-61:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e91)", 2020-11-16T20:57:47.115 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:57:47.115 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 53.068500536999998, 2020-11-16T20:57:47.115 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9852841799999998, 2020-11-16T20:57:47.115 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.115 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:47.115 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:47.115 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:47.116 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:47.116 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3055 2020-11-16T20:57:47.116 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.116 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.116 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.116 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.116 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:57:47.116 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.117 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.117 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.117 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.117 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:57:47.117 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4403000000000002e-05 2020-11-16T20:57:47.117 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.117 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.118 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.118 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858523+0000", 2020-11-16T20:57:47.118 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4670000000000001e-06 2020-11-16T20:57:47.118 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.118 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.118 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.118 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858530+0000", 2020-11-16T20:57:47.119 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2469999999999999e-05 2020-11-16T20:57:47.119 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.119 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.119 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.119 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858542+0000", 2020-11-16T20:57:47.119 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2449999999999998e-06 2020-11-16T20:57:47.119 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.119 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.120 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.120 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858548+0000", 2020-11-16T20:57:47.120 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9604000000000002e-05 2020-11-16T20:57:47.120 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.120 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.120 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.120 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858587+0000", 2020-11-16T20:57:47.121 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4863000000000001e-05 2020-11-16T20:57:47.121 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.121 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.121 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:47.121 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858632+0000", 2020-11-16T20:57:47.121 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9521692039999996 2020-11-16T20:57:47.121 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.121 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.122 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.122 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.810801+0000", 2020-11-16T20:57:47.122 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014886700000000001 2020-11-16T20:57:47.122 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.122 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.122 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:47.122 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.810950+0000", 2020-11-16T20:57:47.123 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029669781999999999 2020-11-16T20:57:47.123 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.123 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.123 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.123 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840620+0000", 2020-11-16T20:57:47.123 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010005699999999999 2020-11-16T20:57:47.123 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.124 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.124 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.124 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840720+0000", 2020-11-16T20:57:47.124 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030532179999999999 2020-11-16T20:57:47.124 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.124 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.124 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.124 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843773+0000", 2020-11-16T20:57:47.125 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9852841799999998 2020-11-16T20:57:47.125 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.125 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.125 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.125 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.125 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.125 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3065 4.0 4:2f657946:::smithi16641208-73:head [read 0~3210104,checksum] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:57:47.126 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:57:47.126 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 52.960225514000001, 2020-11-16T20:57:47.126 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8738324339999997, 2020-11-16T20:57:47.126 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.126 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:47.126 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:47.126 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:47.127 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:47.127 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3065 2020-11-16T20:57:47.127 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.127 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.127 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.127 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.127 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:57:47.128 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.128 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.128 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.128 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.128 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:57:47.128 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3065999999999999e-05 2020-11-16T20:57:47.128 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.128 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.129 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.129 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966787+0000", 2020-11-16T20:57:47.129 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8329999999999998e-06 2020-11-16T20:57:47.129 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.129 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.129 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.129 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966790+0000", 2020-11-16T20:57:47.130 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1780000000000002e-06 2020-11-16T20:57:47.130 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.130 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.130 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.131 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966795+0000", 2020-11-16T20:57:47.131 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3460000000000001e-06 2020-11-16T20:57:47.131 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.131 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.131 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.131 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966798+0000", 2020-11-16T20:57:47.131 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6675000000000003e-05 2020-11-16T20:57:47.132 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.132 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.132 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.132 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966844+0000", 2020-11-16T20:57:47.132 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5497999999999999e-05 2020-11-16T20:57:47.132 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.133 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.133 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:47.133 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966870+0000", 2020-11-16T20:57:47.133 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8445859479999998 2020-11-16T20:57:47.133 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.133 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.134 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.134 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811456+0000", 2020-11-16T20:57:47.134 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029140889999999999 2020-11-16T20:57:47.134 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.134 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.135 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.135 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840597+0000", 2020-11-16T20:57:47.135 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8738324339999997 2020-11-16T20:57:47.135 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.135 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.135 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.135 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.135 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.136 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3066 4.0 4:356864c0:::smithi16641208-150:head [read 0~2504243,checksum,omap-get-vals-by-keys,omap-get-keys,omap-get-vals,omap-get-header,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:57:47.136 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:57:47.136 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 52.960174289000001, 2020-11-16T20:57:47.136 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8778990499999999, 2020-11-16T20:57:47.136 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.136 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:47.136 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:47.137 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:47.137 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:47.137 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3066 2020-11-16T20:57:47.137 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.137 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.137 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.137 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.137 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:57:47.138 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.138 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.138 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.138 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.138 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:57:47.138 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1704000000000001e-05 2020-11-16T20:57:47.138 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.139 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.139 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.139 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966837+0000", 2020-11-16T20:57:47.139 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6850000000000001e-06 2020-11-16T20:57:47.139 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.139 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.139 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.140 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966840+0000", 2020-11-16T20:57:47.140 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7479999999999999e-06 2020-11-16T20:57:47.140 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.140 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.140 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.140 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966845+0000", 2020-11-16T20:57:47.140 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5059999999999998e-06 2020-11-16T20:57:47.140 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.141 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.141 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.141 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966848+0000", 2020-11-16T20:57:47.141 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4314000000000002e-05 2020-11-16T20:57:47.141 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.141 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.142 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.142 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966902+0000", 2020-11-16T20:57:47.142 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.561e-05 2020-11-16T20:57:47.142 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.142 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.142 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:47.143 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:57:47.143 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8448102110000004 2020-11-16T20:57:47.143 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.143 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.143 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.143 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811738+0000", 2020-11-16T20:57:47.143 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032976272000000001 2020-11-16T20:57:47.144 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.144 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.144 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.144 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844714+0000", 2020-11-16T20:57:47.144 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8778990499999999 2020-11-16T20:57:47.144 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.145 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.145 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.145 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.145 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.145 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3067 4.0 4:356864c0:::smithi16641208-150:head [sparse-read 0~2504243] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:57:47.145 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:57:47.145 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 52.960122832000003, 2020-11-16T20:57:47.146 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8780898150000001, 2020-11-16T20:57:47.146 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.146 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:47.146 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:47.146 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:47.146 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:47.147 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3067 2020-11-16T20:57:47.147 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.147 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.147 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.147 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.147 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:57:47.147 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.147 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.148 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.148 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.148 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:57:47.148 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2826e-05 2020-11-16T20:57:47.148 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.148 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.148 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.149 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966900+0000", 2020-11-16T20:57:47.149 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.694e-06 2020-11-16T20:57:47.149 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.149 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.149 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.149 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966902+0000", 2020-11-16T20:57:47.149 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0889999999999999e-06 2020-11-16T20:57:47.149 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.150 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.150 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.150 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966907+0000", 2020-11-16T20:57:47.150 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3910000000000001e-06 2020-11-16T20:57:47.150 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.150 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.151 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.151 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966910+0000", 2020-11-16T20:57:47.151 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2771000000000002e-05 2020-11-16T20:57:47.151 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.151 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.151 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.151 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966943+0000", 2020-11-16T20:57:47.151 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5301000000000001e-05 2020-11-16T20:57:47.152 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.152 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.152 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:47.152 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966968+0000", 2020-11-16T20:57:47.152 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.845055017 2020-11-16T20:57:47.152 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.152 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.153 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.153 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812023+0000", 2020-11-16T20:57:47.153 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032933726000000003 2020-11-16T20:57:47.153 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.153 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.153 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.153 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844957+0000", 2020-11-16T20:57:47.154 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8780898150000001 2020-11-16T20:57:47.154 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.154 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.154 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.154 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.154 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.154 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3068 4.0 4:356864c0:::smithi16641208-150:head [read 0~2504243,checksum] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:57:47.154 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:57:47.155 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 52.960061494000001, 2020-11-16T20:57:47.155 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8828719500000002, 2020-11-16T20:57:47.155 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.155 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:57:47.155 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:47.155 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:47.155 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:47.156 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3068 2020-11-16T20:57:47.156 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.156 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.156 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.156 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.156 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:57:47.156 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.157 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.157 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.157 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.157 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:57:47.157 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0942999999999999e-05 2020-11-16T20:57:47.157 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.157 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.158 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.158 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966949+0000", 2020-11-16T20:57:47.158 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.712e-06 2020-11-16T20:57:47.158 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.158 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.158 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.158 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966952+0000", 2020-11-16T20:57:47.159 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8479999999999997e-06 2020-11-16T20:57:47.159 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.159 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.159 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.159 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966958+0000", 2020-11-16T20:57:47.159 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9170000000000002e-06 2020-11-16T20:57:47.159 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.160 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.160 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.160 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966961+0000", 2020-11-16T20:57:47.160 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4105999999999999e-05 2020-11-16T20:57:47.160 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.160 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.160 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.160 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966985+0000", 2020-11-16T20:57:47.161 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2056e-05 2020-11-16T20:57:47.161 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.161 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.161 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:57:47.161 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.967007+0000", 2020-11-16T20:57:47.161 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8456606430000004 2020-11-16T20:57:47.161 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.162 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.162 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.162 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812667+0000", 2020-11-16T20:57:47.162 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037132724999999998 2020-11-16T20:57:47.162 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.162 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.162 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.163 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849800+0000", 2020-11-16T20:57:47.163 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8828719500000002 2020-11-16T20:57:47.163 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.163 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.163 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.163 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.163 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.164 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:47.165 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:57:47.165 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:57:47.166 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:57:47.166 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:57:47.166 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:57:47.166 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:57:47.166 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:57:47.166 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:57:47.167 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:57:47.167 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:57:47.168 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:47.170+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:47.266 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:47.271+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:47.332 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:47.333 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:57:47.333 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:57:47.333 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:47.342 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:57:47.383 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:47.388+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:47.467 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:47.472+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:47.508 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:47.509 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:57:47.509 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:57:47.509 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:57:47.509 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:47.518 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:57:47.569 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:47.574+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:47.646 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:47.646 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:57:47.646 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:57:47.647 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:57:47.647 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.651 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:554 3.2 3:769099fd:::smithi16641208-247:head [copy-from ver 123] snapc 1=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:57:47.651 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:57:47.652 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 102.59958051300001, 2020-11-16T20:57:47.652 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998, 2020-11-16T20:57:47.652 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.652 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:47.652 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.652 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.653 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.653 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:57:47.653 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.653 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.653 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.653 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.653 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:57:47.654 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6705999999999997e-05 2020-11-16T20:57:47.654 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.654 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.654 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.654 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050139+0000", 2020-11-16T20:57:47.654 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6199999999999998e-06 2020-11-16T20:57:47.654 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.655 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.655 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.655 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050144+0000", 2020-11-16T20:57:47.655 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.944e-06 2020-11-16T20:57:47.655 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.655 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.655 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.655 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050154+0000", 2020-11-16T20:57:47.656 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4043999999999999e-05 2020-11-16T20:57:47.656 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.656 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.656 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.656 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050178+0000", 2020-11-16T20:57:47.656 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078971409999999999 2020-11-16T20:57:47.656 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.657 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.657 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.657 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058075+0000", 2020-11-16T20:57:47.657 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012776500000000001 2020-11-16T20:57:47.657 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.657 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.657 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.658 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058203+0000", 2020-11-16T20:57:47.658 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011807013 2020-11-16T20:57:47.658 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.658 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.658 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:47.658 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070010+0000", 2020-11-16T20:57:47.658 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029522160000000001 2020-11-16T20:57:47.658 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.659 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.659 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:47.659 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.072962+0000", 2020-11-16T20:57:47.660 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017845006 2020-11-16T20:57:47.660 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.660 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.660 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.660 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.090807+0000", 2020-11-16T20:57:47.660 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.009301808 2020-11-16T20:57:47.660 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.661 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.661 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.661 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100109+0000", 2020-11-16T20:57:47.661 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7076999999999995e-05 2020-11-16T20:57:47.661 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.661 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.661 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:47.662 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100176+0000", 2020-11-16T20:57:47.662 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9790999999999999e-05 2020-11-16T20:57:47.662 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.662 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.662 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.662 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100216+0000", 2020-11-16T20:57:47.662 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998 2020-11-16T20:57:47.663 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.663 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.663 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.663 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.663 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.663 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2429 4.0 4:3b92f709:::smithi16641208-69:head [rollback 7] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:57:47.663 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:57:47.664 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 97.633662251000004, 2020-11-16T20:57:47.664 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003, 2020-11-16T20:57:47.664 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.664 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:47.664 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:47.664 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:47.664 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:47.665 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2429 2020-11-16T20:57:47.665 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.665 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.665 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.665 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.665 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:57:47.665 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.665 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.666 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.666 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.666 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:57:47.666 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3710000000000002e-05 2020-11-16T20:57:47.666 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.666 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.666 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.667 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016044+0000", 2020-11-16T20:57:47.667 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7090000000000001e-06 2020-11-16T20:57:47.667 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.667 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.667 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.667 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016049+0000", 2020-11-16T20:57:47.668 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8820000000000003e-06 2020-11-16T20:57:47.668 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.668 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.668 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.668 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016056+0000", 2020-11-16T20:57:47.668 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.27e-06 2020-11-16T20:57:47.668 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.669 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.669 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.669 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016059+0000", 2020-11-16T20:57:47.669 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.537e-05 2020-11-16T20:57:47.669 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.669 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.669 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.670 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016115+0000", 2020-11-16T20:57:47.670 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8690000000000003e-06 2020-11-16T20:57:47.670 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.670 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.670 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:47.670 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016120+0000", 2020-11-16T20:57:47.671 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021405730000000002 2020-11-16T20:57:47.671 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.671 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.671 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.671 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018260+0000", 2020-11-16T20:57:47.671 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0137999999999999e-05 2020-11-16T20:57:47.671 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.672 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.672 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:47.672 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018320+0000", 2020-11-16T20:57:47.672 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011799352000000001 2020-11-16T20:57:47.672 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.672 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.672 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.673 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030120+0000", 2020-11-16T20:57:47.673 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000163139 2020-11-16T20:57:47.673 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.673 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.673 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.673 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030283+0000", 2020-11-16T20:57:47.673 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029657000000000002 2020-11-16T20:57:47.673 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.674 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.674 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:47.674 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030579+0000", 2020-11-16T20:57:47.674 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3058000000000001e-05 2020-11-16T20:57:47.674 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.674 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.675 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:47.675 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030612+0000", 2020-11-16T20:57:47.675 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0075168259999999999 2020-11-16T20:57:47.675 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.675 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.675 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.675 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038129+0000", 2020-11-16T20:57:47.676 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012914299999999999 2020-11-16T20:57:47.676 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.676 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.676 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.676 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038258+0000", 2020-11-16T20:57:47.676 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034292799999999999 2020-11-16T20:57:47.676 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.677 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.677 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:57:47.677 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038601+0000", 2020-11-16T20:57:47.677 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0025181159999999999 2020-11-16T20:57:47.677 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.677 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.677 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.678 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041119+0000", 2020-11-16T20:57:47.678 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2331999999999997e-05 2020-11-16T20:57:47.678 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.678 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.678 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for ondisk", 2020-11-16T20:57:47.678 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041202+0000", 2020-11-16T20:57:47.678 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028481750000000001 2020-11-16T20:57:47.679 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.679 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.679 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:47.679 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044050+0000", 2020-11-16T20:57:47.679 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001269921 2020-11-16T20:57:47.679 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.679 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.680 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.680 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045320+0000", 2020-11-16T20:57:47.680 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054215490000000003 2020-11-16T20:57:47.680 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.680 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.680 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.680 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050741+0000", 2020-11-16T20:57:47.681 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6981000000000001e-05 2020-11-16T20:57:47.681 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.681 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.681 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:47.681 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050808+0000", 2020-11-16T20:57:47.681 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8841e-05 2020-11-16T20:57:47.681 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.682 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.682 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.682 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050877+0000", 2020-11-16T20:57:47.682 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003 2020-11-16T20:57:47.682 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.682 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.682 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.683 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.683 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.683 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2430 4.0 4:3b92f709:::smithi16641208-69:head [append 0~0] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:57:47.683 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:57:47.683 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 97.633605927999994, 2020-11-16T20:57:47.683 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001, 2020-11-16T20:57:47.683 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.683 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:47.684 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:47.684 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:47.684 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:47.684 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2430 2020-11-16T20:57:47.684 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.684 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.684 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.685 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.685 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:57:47.685 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.685 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.685 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.685 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.685 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:57:47.685 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0857e-05 2020-11-16T20:57:47.686 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.686 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.686 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.686 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016098+0000", 2020-11-16T20:57:47.686 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9179999999999999e-06 2020-11-16T20:57:47.686 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.686 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.687 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.687 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016104+0000", 2020-11-16T20:57:47.687 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8230000000000006e-06 2020-11-16T20:57:47.687 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.687 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.687 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.687 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016114+0000", 2020-11-16T20:57:47.688 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2180000000000001e-06 2020-11-16T20:57:47.688 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.688 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.688 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.688 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016118+0000", 2020-11-16T20:57:47.688 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3547999999999995e-05 2020-11-16T20:57:47.688 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.689 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.689 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.689 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016181+0000", 2020-11-16T20:57:47.689 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8730000000000007e-06 2020-11-16T20:57:47.689 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.689 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.689 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:47.689 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016189+0000", 2020-11-16T20:57:47.690 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021577200000000001 2020-11-16T20:57:47.690 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.690 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.690 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.690 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018347+0000", 2020-11-16T20:57:47.690 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6832000000000001e-05 2020-11-16T20:57:47.690 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.691 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.691 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:47.691 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018404+0000", 2020-11-16T20:57:47.691 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012272913999999999 2020-11-16T20:57:47.691 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.691 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.691 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.692 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030677+0000", 2020-11-16T20:57:47.692 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2555000000000002e-05 2020-11-16T20:57:47.692 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.692 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.692 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:47.692 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030719+0000", 2020-11-16T20:57:47.692 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010518684 2020-11-16T20:57:47.692 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.693 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.693 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.693 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041238+0000", 2020-11-16T20:57:47.693 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000144723 2020-11-16T20:57:47.693 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.693 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.693 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.694 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041383+0000", 2020-11-16T20:57:47.694 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000214575 2020-11-16T20:57:47.694 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.694 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.694 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:57:47.694 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041597+0000", 2020-11-16T20:57:47.694 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002463196 2020-11-16T20:57:47.695 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.695 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.695 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:47.695 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044060+0000", 2020-11-16T20:57:47.695 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001654066 2020-11-16T20:57:47.695 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.695 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.696 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.696 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045715+0000", 2020-11-16T20:57:47.696 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053780599999999996 2020-11-16T20:57:47.696 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.696 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.696 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.696 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051093+0000", 2020-11-16T20:57:47.696 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8189999999999996e-05 2020-11-16T20:57:47.697 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.697 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.697 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:47.697 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051161+0000", 2020-11-16T20:57:47.697 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4910000000000001e-05 2020-11-16T20:57:47.697 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.697 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.698 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.698 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051216+0000", 2020-11-16T20:57:47.698 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001 2020-11-16T20:57:47.698 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.698 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.698 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.698 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.699 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.699 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "MOSDPGPush(4.1 52/51 [PushOp(4:9ab04c4a:::smithi16641208-1:head, version: 33'3, data_included: [0~892056,1542129~156520], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:9ab04c4a:::smithi16641208-1:head@33'3, size: 2016807, copy_subset: [0~2016807], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1698649, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:a1eef07d:::smithi16641208-13:head, version: 33'9, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:a1eef07d:::smithi16641208-13:head@33'9, size: 2201684, copy_subset: [0~2201684], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:929564f0:::smithi16641208-24:head, version: 33'18, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:929564f0:::smithi16641208-24:head@33'18, size: 2386561, copy_subset: [0~2386561], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b565f7d2:::smithi16641208-35:head, version: 33'27, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b565f7d2:::smithi16641208-35:head@33'27, size: 2571438, copy_subset: [0~2571438], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b6545a47:::smithi16641208-46:head, version: 33'29, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b6545a47:::smithi16641208-46:head@33'29, size: 2756315, copy_subset: [0~2756315], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:9bd9f31d:::smithi16641208-48:head, version: 33'35, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:9bd9f31d:::smithi16641208-48:head@33'35, size: 2789929, copy_subset: [0~2789929], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:83205103:::smithi16641208-103:head, version: 34'38, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:83205103:::smithi16641208-103:head@34'38, size: 3714314, copy_subset: [0~3714314], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:86a0a5b7:::smithi16641208-108:head, version: 34'42, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:86a0a5b7:::smithi16641208-108:head@34'42, size: 3798349, copy_subset: [0~3798349], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-16T20:57:47.699 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:57:47.699 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 92.879009322000002, 2020-11-16T20:57:47.699 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032552672999999997, 2020-11-16T20:57:47.699 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.699 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:47.700 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.700 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.700 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.700 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:57:47.700 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.700 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.700 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.700 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.701 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:57:47.701 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017498692999999999 2020-11-16T20:57:47.701 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.701 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.701 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.701 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788172+0000", 2020-11-16T20:57:47.701 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4147999999999999e-05 2020-11-16T20:57:47.702 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.702 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.702 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.702 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788206+0000", 2020-11-16T20:57:47.702 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0016000000000002e-05 2020-11-16T20:57:47.702 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.702 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.703 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.703 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788276+0000", 2020-11-16T20:57:47.703 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2172000000000002e-05 2020-11-16T20:57:47.703 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.703 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.703 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.703 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788319+0000", 2020-11-16T20:57:47.703 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000154337 2020-11-16T20:57:47.704 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.704 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.704 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.704 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788473+0000", 2020-11-16T20:57:47.704 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7690000000000002e-06 2020-11-16T20:57:47.704 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.704 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.705 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.705 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788482+0000", 2020-11-16T20:57:47.705 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014744538 2020-11-16T20:57:47.705 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.705 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.705 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.705 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803226+0000", 2020-11-16T20:57:47.706 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032552672999999997 2020-11-16T20:57:47.706 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.706 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.706 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.706 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.706 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.706 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.0:552 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'128, mlcod=0'0)", 2020-11-16T20:57:47.706 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:57:47.707 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 92.859043904000004, 2020-11-16T20:57:47.707 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038033168999999999, 2020-11-16T20:57:47.707 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.707 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:47.707 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.707 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.707 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.708 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:57:47.708 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.708 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.708 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.708 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.708 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:57:47.708 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0031023880000000002 2020-11-16T20:57:47.708 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.709 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.709 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.709 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793741+0000", 2020-11-16T20:57:47.709 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1496e-05 2020-11-16T20:57:47.709 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.709 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.709 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.710 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793753+0000", 2020-11-16T20:57:47.710 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9009999999999999e-05 2020-11-16T20:57:47.710 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.710 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.710 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.710 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793772+0000", 2020-11-16T20:57:47.710 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3318e-05 2020-11-16T20:57:47.711 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.711 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.711 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.711 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793785+0000", 2020-11-16T20:57:47.711 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012534775 2020-11-16T20:57:47.711 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.711 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.711 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.712 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806320+0000", 2020-11-16T20:57:47.712 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8144999999999999e-05 2020-11-16T20:57:47.712 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.712 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.712 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.712 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806348+0000", 2020-11-16T20:57:47.712 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022285688000000001 2020-11-16T20:57:47.713 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.713 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.713 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:47.713 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828634+0000", 2020-11-16T20:57:47.713 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8349000000000002e-05 2020-11-16T20:57:47.713 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.713 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.713 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.714 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828672+0000", 2020-11-16T20:57:47.714 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038033168999999999 2020-11-16T20:57:47.714 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.714 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.714 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.714 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.714 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.715 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2503 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'129, mlcod=0'0)", 2020-11-16T20:57:47.715 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:57:47.715 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 92.855855723999994, 2020-11-16T20:57:47.715 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034870998, 2020-11-16T20:57:47.715 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.715 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:47.715 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.716 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.716 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.716 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:57:47.716 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.716 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.716 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.716 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.717 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:57:47.717 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00093048899999999995 2020-11-16T20:57:47.717 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.717 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.717 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.717 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794758+0000", 2020-11-16T20:57:47.717 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.169e-05 2020-11-16T20:57:47.717 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.718 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.718 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.718 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794769+0000", 2020-11-16T20:57:47.718 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3998999999999999e-05 2020-11-16T20:57:47.718 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.718 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.718 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.719 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794783+0000", 2020-11-16T20:57:47.719 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.481e-06 2020-11-16T20:57:47.719 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.719 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.719 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.719 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794791+0000", 2020-11-16T20:57:47.719 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.02524036 2020-11-16T20:57:47.720 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.720 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.720 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.720 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820031+0000", 2020-11-16T20:57:47.720 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.811e-05 2020-11-16T20:57:47.720 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.720 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.721 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.721 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820059+0000", 2020-11-16T20:57:47.721 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.008614577 2020-11-16T20:57:47.721 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.721 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.721 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:47.721 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828674+0000", 2020-11-16T20:57:47.721 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4292000000000001e-05 2020-11-16T20:57:47.722 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.722 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.722 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.722 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828698+0000", 2020-11-16T20:57:47.722 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034870998 2020-11-16T20:57:47.722 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.722 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.723 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.723 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.723 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.723 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2504 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'130, mlcod=0'0)", 2020-11-16T20:57:47.723 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:57:47.723 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 92.854850041999995, 2020-11-16T20:57:47.723 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033888776000000002, 2020-11-16T20:57:47.723 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.724 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:47.724 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.724 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.724 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.724 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:57:47.724 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.724 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.725 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.725 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.725 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:57:47.725 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3896999999999997e-05 2020-11-16T20:57:47.725 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.725 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.725 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.726 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794877+0000", 2020-11-16T20:57:47.726 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7019999999999998e-06 2020-11-16T20:57:47.726 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.726 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.726 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.726 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794883+0000", 2020-11-16T20:57:47.726 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.789e-06 2020-11-16T20:57:47.726 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.727 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.727 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.727 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794888+0000", 2020-11-16T20:57:47.727 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.852e-06 2020-11-16T20:57:47.727 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.727 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.727 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.728 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794891+0000", 2020-11-16T20:57:47.728 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026152822999999999 2020-11-16T20:57:47.728 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.728 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.728 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.728 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.821044+0000", 2020-11-16T20:57:47.728 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6900999999999999e-05 2020-11-16T20:57:47.728 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.729 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.729 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.729 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.821071+0000", 2020-11-16T20:57:47.729 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0076283210000000004 2020-11-16T20:57:47.729 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.729 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.729 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:47.730 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828699+0000", 2020-11-16T20:57:47.730 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2490999999999999e-05 2020-11-16T20:57:47.730 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.730 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.730 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.730 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828722+0000", 2020-11-16T20:57:47.730 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033888776000000002 2020-11-16T20:57:47.731 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.731 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.731 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.731 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.731 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.731 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.13:681 3.1 e52/19 3:afc69464:::smithi16641208-110:head v 52'546, mlcod=52'544)", 2020-11-16T20:57:47.731 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:57:47.732 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 92.852189972000005, 2020-11-16T20:57:47.732 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.03113606, 2020-11-16T20:57:47.732 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.732 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:47.732 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.732 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.732 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.732 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:57:47.733 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.733 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.733 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.733 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.733 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:57:47.733 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0026681809999999999 2020-11-16T20:57:47.733 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.734 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.734 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.734 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800161+0000", 2020-11-16T20:57:47.734 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3499000000000001e-05 2020-11-16T20:57:47.734 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.734 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.734 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.734 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800175+0000", 2020-11-16T20:57:47.735 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8301999999999999e-05 2020-11-16T20:57:47.735 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.735 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.735 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.735 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800193+0000", 2020-11-16T20:57:47.735 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0465999999999999e-05 2020-11-16T20:57:47.735 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.736 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.736 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.736 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800203+0000", 2020-11-16T20:57:47.736 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061432479999999996 2020-11-16T20:57:47.736 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.736 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.736 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.737 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806347+0000", 2020-11-16T20:57:47.737 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.641e-05 2020-11-16T20:57:47.737 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.737 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.737 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.737 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806373+0000", 2020-11-16T20:57:47.737 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022190887999999999 2020-11-16T20:57:47.737 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.738 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.738 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:47.738 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828564+0000", 2020-11-16T20:57:47.738 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5066000000000003e-05 2020-11-16T20:57:47.738 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.738 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.738 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.739 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828629+0000", 2020-11-16T20:57:47.739 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.03113606 2020-11-16T20:57:47.739 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.739 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.739 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.739 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.739 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.739 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:603 3.2 3:5a2e7c26:::smithi16641208-130:head [copy-from ver 67] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:57:47.740 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:57:47.740 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 87.898441977999994, 2020-11-16T20:57:47.740 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036631116999999998, 2020-11-16T20:57:47.740 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.740 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:47.740 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.740 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.741 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.741 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:57:47.741 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.741 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.741 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.741 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.741 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:57:47.742 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9854000000000002e-05 2020-11-16T20:57:47.742 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.742 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.742 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.742 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751281+0000", 2020-11-16T20:57:47.742 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1840000000000004e-06 2020-11-16T20:57:47.742 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.742 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.743 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.743 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751287+0000", 2020-11-16T20:57:47.743 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0231000000000001e-05 2020-11-16T20:57:47.743 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.743 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.743 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.743 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751297+0000", 2020-11-16T20:57:47.744 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.639e-06 2020-11-16T20:57:47.744 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.744 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.744 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.744 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751302+0000", 2020-11-16T20:57:47.744 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030012000000000002 2020-11-16T20:57:47.744 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.745 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.745 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.745 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751602+0000", 2020-11-16T20:57:47.745 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013830200000000001 2020-11-16T20:57:47.745 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.745 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.745 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.745 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751740+0000", 2020-11-16T20:57:47.746 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019538969999999999 2020-11-16T20:57:47.746 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.746 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.746 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:47.746 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771279+0000", 2020-11-16T20:57:47.746 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007630403 2020-11-16T20:57:47.746 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.747 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.747 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:47.747 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.778910+0000", 2020-11-16T20:57:47.747 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0065002009999999997 2020-11-16T20:57:47.747 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.747 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.747 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.747 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.785410+0000", 2020-11-16T20:57:47.748 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0023914140000000001 2020-11-16T20:57:47.748 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.748 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.748 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.748 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787801+0000", 2020-11-16T20:57:47.748 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9629999999999998e-05 2020-11-16T20:57:47.748 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.749 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.749 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:47.749 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787841+0000", 2020-11-16T20:57:47.749 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1168999999999999e-05 2020-11-16T20:57:47.749 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.749 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.749 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.749 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787872+0000", 2020-11-16T20:57:47.750 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036631116999999998 2020-11-16T20:57:47.750 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.750 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.750 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.750 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.750 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.750 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:609 3.2 3:5eead97c:::smithi16641208-34:head [copy-from ver 27] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:57:47.751 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:57:47.751 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 87.860644848999996, 2020-11-16T20:57:47.751 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.062626424, 2020-11-16T20:57:47.751 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.751 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:47.751 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.751 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.752 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.752 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:57:47.752 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.752 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.752 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.752 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.752 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:57:47.752 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3596000000000001e-05 2020-11-16T20:57:47.753 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.753 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.753 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.753 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789082+0000", 2020-11-16T20:57:47.753 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3209999999999999e-06 2020-11-16T20:57:47.753 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.753 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.754 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.754 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789089+0000", 2020-11-16T20:57:47.754 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3498e-05 2020-11-16T20:57:47.754 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.754 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.754 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.754 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789103+0000", 2020-11-16T20:57:47.755 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3679999999999998e-06 2020-11-16T20:57:47.755 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.755 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.755 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.755 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789109+0000", 2020-11-16T20:57:47.755 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007399638 2020-11-16T20:57:47.755 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.755 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.756 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.756 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.796509+0000", 2020-11-16T20:57:47.756 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000181168 2020-11-16T20:57:47.756 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.756 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.756 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.756 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.796690+0000", 2020-11-16T20:57:47.757 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01336562 2020-11-16T20:57:47.757 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.757 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.757 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:47.757 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.810055+0000", 2020-11-16T20:57:47.757 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044828350000000001 2020-11-16T20:57:47.757 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.758 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.758 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:47.758 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.814538+0000", 2020-11-16T20:57:47.758 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035609628999999997 2020-11-16T20:57:47.758 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.758 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.758 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.759 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850148+0000", 2020-11-16T20:57:47.759 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0013754730000000001 2020-11-16T20:57:47.759 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.759 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.759 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.759 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851523+0000", 2020-11-16T20:57:47.759 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9935e-05 2020-11-16T20:57:47.759 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.760 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.760 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:47.760 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851603+0000", 2020-11-16T20:57:47.760 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1342999999999999e-05 2020-11-16T20:57:47.760 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.760 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.760 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.761 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851665+0000", 2020-11-16T20:57:47.761 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.062626424 2020-11-16T20:57:47.761 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.761 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.761 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.761 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.761 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.762 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2605 4.0 4:2294fced:::smithi16641208-278:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:57:47.762 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:57:47.762 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 87.732809732999996, 2020-11-16T20:57:47.762 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032301128999999998, 2020-11-16T20:57:47.762 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.762 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:47.762 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:47.762 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:47.763 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:47.763 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2605 2020-11-16T20:57:47.763 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.763 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.763 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.763 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.763 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:57:47.764 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.764 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.764 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.764 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.764 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:57:47.764 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.811e-05 2020-11-16T20:57:47.764 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.765 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.765 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.765 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916901+0000", 2020-11-16T20:57:47.765 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2939999999999996e-06 2020-11-16T20:57:47.765 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.765 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.765 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.765 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916907+0000", 2020-11-16T20:57:47.766 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0589e-05 2020-11-16T20:57:47.766 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.766 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.766 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.766 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916917+0000", 2020-11-16T20:57:47.766 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2549999999999999e-06 2020-11-16T20:57:47.766 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.767 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.767 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.767 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916921+0000", 2020-11-16T20:57:47.767 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033789099999999999 2020-11-16T20:57:47.767 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.767 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.767 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.768 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.917259+0000", 2020-11-16T20:57:47.768 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.25e-05 2020-11-16T20:57:47.768 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.768 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.768 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:47.768 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.917332+0000", 2020-11-16T20:57:47.768 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.028336376999999999 2020-11-16T20:57:47.768 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.769 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.769 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.769 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.945668+0000", 2020-11-16T20:57:47.769 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0983000000000006e-05 2020-11-16T20:57:47.769 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.769 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.769 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:47.770 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.945759+0000", 2020-11-16T20:57:47.770 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00324756 2020-11-16T20:57:47.770 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.770 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.770 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.770 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949007+0000", 2020-11-16T20:57:47.770 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0583999999999999e-05 2020-11-16T20:57:47.771 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.771 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.771 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.771 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949097+0000", 2020-11-16T20:57:47.771 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6985999999999998e-05 2020-11-16T20:57:47.771 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.771 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.771 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.772 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949174+0000", 2020-11-16T20:57:47.772 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032301128999999998 2020-11-16T20:57:47.772 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.772 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.772 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.772 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.772 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.773 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2874 4.0 4:055e14cb:::smithi16641208-187:head [copy-from ver 402] snapc 25=[25,23,21,f] ondisk+write+known_if_redirected e72)", 2020-11-16T20:57:47.773 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:57:47.773 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 72.904286063000001, 2020-11-16T20:57:47.773 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031663616999999998, 2020-11-16T20:57:47.773 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.773 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:47.773 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:47.773 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:47.774 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:47.774 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2874 2020-11-16T20:57:47.774 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.774 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.774 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.774 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.774 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:57:47.775 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.775 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.775 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.775 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.775 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:57:47.775 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6754000000000001e-05 2020-11-16T20:57:47.775 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.776 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.776 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.776 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745434+0000", 2020-11-16T20:57:47.776 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5049999999999998e-06 2020-11-16T20:57:47.776 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.776 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.776 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.777 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745439+0000", 2020-11-16T20:57:47.777 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0803e-05 2020-11-16T20:57:47.777 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.777 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.777 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.777 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745450+0000", 2020-11-16T20:57:47.777 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8810000000000004e-06 2020-11-16T20:57:47.778 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.778 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.778 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.778 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745455+0000", 2020-11-16T20:57:47.778 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022866499999999999 2020-11-16T20:57:47.778 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.778 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.778 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.779 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745684+0000", 2020-11-16T20:57:47.779 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000132714 2020-11-16T20:57:47.779 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.779 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.779 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.779 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745816+0000", 2020-11-16T20:57:47.779 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050117850000000004 2020-11-16T20:57:47.780 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.780 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.780 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:57:47.780 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.750828+0000", 2020-11-16T20:57:47.780 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010413489 2020-11-16T20:57:47.780 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.780 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.780 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:47.781 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.761241+0000", 2020-11-16T20:57:47.781 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028274289999999998 2020-11-16T20:57:47.781 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.781 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.781 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.781 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.764069+0000", 2020-11-16T20:57:47.781 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012880057 2020-11-16T20:57:47.782 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.782 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.782 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.782 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.776949+0000", 2020-11-16T20:57:47.782 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2536e-05 2020-11-16T20:57:47.782 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.782 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.782 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:47.783 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777002+0000", 2020-11-16T20:57:47.783 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8999000000000002e-05 2020-11-16T20:57:47.783 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.783 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.783 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.783 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777061+0000", 2020-11-16T20:57:47.783 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031663616999999998 2020-11-16T20:57:47.784 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.784 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.784 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.784 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.784 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.784 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2875 4.0 4:055e14cb:::smithi16641208-187:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-11-16T20:57:47.784 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:57:47.785 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 72.904196837000001, 2020-11-16T20:57:47.785 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031888061000000002, 2020-11-16T20:57:47.785 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.785 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:47.785 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:47.785 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:47.785 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:47.785 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2875 2020-11-16T20:57:47.786 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.786 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.786 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.786 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.786 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:57:47.786 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.786 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.787 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.787 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.787 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:57:47.787 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0239000000000001e-05 2020-11-16T20:57:47.787 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.787 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.787 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.787 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745506+0000", 2020-11-16T20:57:47.788 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.252e-06 2020-11-16T20:57:47.788 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.788 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.788 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.788 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745510+0000", 2020-11-16T20:57:47.788 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3670000000000002e-06 2020-11-16T20:57:47.788 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.789 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.789 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.789 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745516+0000", 2020-11-16T20:57:47.789 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1089999999999998e-06 2020-11-16T20:57:47.789 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.789 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.789 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.790 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745519+0000", 2020-11-16T20:57:47.790 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045188999999999998 2020-11-16T20:57:47.790 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.790 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.790 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.790 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745971+0000", 2020-11-16T20:57:47.790 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7822999999999998e-05 2020-11-16T20:57:47.791 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.791 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.791 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:47.791 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.746029+0000", 2020-11-16T20:57:47.791 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013333563999999999 2020-11-16T20:57:47.791 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.791 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.791 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.792 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.759362+0000", 2020-11-16T20:57:47.792 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000170896 2020-11-16T20:57:47.792 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.792 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.792 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:47.792 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.759533+0000", 2020-11-16T20:57:47.792 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017572878 2020-11-16T20:57:47.793 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.793 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.793 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.793 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777106+0000", 2020-11-16T20:57:47.793 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014436399999999999 2020-11-16T20:57:47.793 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.793 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.793 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.794 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777251+0000", 2020-11-16T20:57:47.794 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012367899999999999 2020-11-16T20:57:47.794 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.794 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.794 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.794 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777374+0000", 2020-11-16T20:57:47.794 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031888061000000002 2020-11-16T20:57:47.795 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.795 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.795 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.795 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.795 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.795 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3004 3.2 3:4fbd4ff5:::smithi16641208-419:head [copy-from ver 366] snapc 33=[33,25] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e87)", 2020-11-16T20:57:47.795 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.815968+0000", 2020-11-16T20:57:47.796 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 57.833715224000002, 2020-11-16T20:57:47.796 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042048220999999997, 2020-11-16T20:57:47.796 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.796 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:47.796 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.796 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.796 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.796 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.815968+0000", 2020-11-16T20:57:47.797 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.797 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.797 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.797 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.797 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.815968+0000", 2020-11-16T20:57:47.797 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3235000000000002e-05 2020-11-16T20:57:47.797 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.798 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.798 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816011+0000", 2020-11-16T20:57:47.798 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.303e-06 2020-11-16T20:57:47.798 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.798 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.798 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816019+0000", 2020-11-16T20:57:47.799 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9714999999999999e-05 2020-11-16T20:57:47.799 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.799 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.799 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.799 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816049+0000", 2020-11-16T20:57:47.799 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2960000000000001e-06 2020-11-16T20:57:47.799 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.800 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.800 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.800 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816056+0000", 2020-11-16T20:57:47.800 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000241606 2020-11-16T20:57:47.800 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.800 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.800 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.800 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816298+0000", 2020-11-16T20:57:47.801 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016421599999999999 2020-11-16T20:57:47.801 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.801 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.801 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.801 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816462+0000", 2020-11-16T20:57:47.801 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025803994 2020-11-16T20:57:47.801 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.802 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.802 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:47.802 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.842266+0000", 2020-11-16T20:57:47.802 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0072860549999999996 2020-11-16T20:57:47.802 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.802 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.802 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:47.803 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.849552+0000", 2020-11-16T20:57:47.803 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0077911389999999999 2020-11-16T20:57:47.803 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.803 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.803 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.803 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.857343+0000", 2020-11-16T20:57:47.803 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00049728000000000001 2020-11-16T20:57:47.803 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.804 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.804 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.804 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.857841+0000", 2020-11-16T20:57:47.804 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.1997999999999997e-05 2020-11-16T20:57:47.804 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.804 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.804 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:47.805 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.857923+0000", 2020-11-16T20:57:47.805 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3383999999999999e-05 2020-11-16T20:57:47.805 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.805 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.805 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.805 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858016+0000", 2020-11-16T20:57:47.805 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042048220999999997 2020-11-16T20:57:47.805 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.806 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.806 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.806 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.806 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.806 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:650 3.2 3:4fbd4ff5:::smithi16641208-419:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e87)", 2020-11-16T20:57:47.806 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.816105+0000", 2020-11-16T20:57:47.806 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 57.833577593999998, 2020-11-16T20:57:47.807 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042242304000000001, 2020-11-16T20:57:47.807 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.807 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:47.807 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.807 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.807 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.807 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816105+0000", 2020-11-16T20:57:47.808 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.808 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.808 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.808 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.808 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816105+0000", 2020-11-16T20:57:47.808 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6486999999999999e-05 2020-11-16T20:57:47.808 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.808 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.809 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.809 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816132+0000", 2020-11-16T20:57:47.809 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5230000000000003e-06 2020-11-16T20:57:47.809 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.809 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.809 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.809 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816137+0000", 2020-11-16T20:57:47.810 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1498000000000001e-05 2020-11-16T20:57:47.810 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.810 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.810 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.810 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816149+0000", 2020-11-16T20:57:47.810 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5789999999999997e-06 2020-11-16T20:57:47.810 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.811 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.811 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.811 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816153+0000", 2020-11-16T20:57:47.811 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00044901199999999999 2020-11-16T20:57:47.811 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.811 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.811 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.812 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816602+0000", 2020-11-16T20:57:47.812 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6134000000000002e-05 2020-11-16T20:57:47.812 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.812 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.812 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:47.812 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816649+0000", 2020-11-16T20:57:47.812 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032065206999999998 2020-11-16T20:57:47.812 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.813 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.813 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.813 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848714+0000", 2020-11-16T20:57:47.813 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000103695 2020-11-16T20:57:47.813 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.813 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.813 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:47.814 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848818+0000", 2020-11-16T20:57:47.814 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092315220000000007 2020-11-16T20:57:47.814 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.814 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.814 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.814 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858049+0000", 2020-11-16T20:57:47.814 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000104415 2020-11-16T20:57:47.815 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.815 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.815 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.815 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858153+0000", 2020-11-16T20:57:47.815 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019423199999999999 2020-11-16T20:57:47.815 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.815 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.816 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.816 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858348+0000", 2020-11-16T20:57:47.816 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042242304000000001 2020-11-16T20:57:47.816 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.816 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.816 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.816 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.817 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.817 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:651 3.2 3:4fbd4ff5:::smithi16641208-419:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e87)", 2020-11-16T20:57:47.817 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.816182+0000", 2020-11-16T20:57:47.817 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 57.833501099000003, 2020-11-16T20:57:47.817 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047784220000000002, 2020-11-16T20:57:47.817 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.817 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:47.818 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.818 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.818 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.818 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816182+0000", 2020-11-16T20:57:47.818 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.818 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.818 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.818 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.819 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816182+0000", 2020-11-16T20:57:47.819 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6310999999999998e-05 2020-11-16T20:57:47.819 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.819 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.819 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.819 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816218+0000", 2020-11-16T20:57:47.819 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6110000000000001e-06 2020-11-16T20:57:47.820 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.820 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.820 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.820 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816224+0000", 2020-11-16T20:57:47.820 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9189999999999994e-06 2020-11-16T20:57:47.820 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.820 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.821 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.821 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816234+0000", 2020-11-16T20:57:47.821 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3220000000000003e-06 2020-11-16T20:57:47.821 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.821 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.821 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.821 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816238+0000", 2020-11-16T20:57:47.821 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00043294900000000002 2020-11-16T20:57:47.822 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.822 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.822 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.822 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816671+0000", 2020-11-16T20:57:47.822 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3359999999999998e-05 2020-11-16T20:57:47.822 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.822 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.823 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:47.823 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816714+0000", 2020-11-16T20:57:47.823 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032137410999999998 2020-11-16T20:57:47.823 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.823 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.823 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.823 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848852+0000", 2020-11-16T20:57:47.824 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000103235 2020-11-16T20:57:47.824 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.824 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.824 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:47.824 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848955+0000", 2020-11-16T20:57:47.824 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094266409999999995 2020-11-16T20:57:47.824 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.824 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.825 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.825 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858382+0000", 2020-11-16T20:57:47.825 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7973999999999995e-05 2020-11-16T20:57:47.825 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.825 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.825 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.825 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858470+0000", 2020-11-16T20:57:47.826 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054964870000000004 2020-11-16T20:57:47.826 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.826 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.826 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.826 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.863966+0000", 2020-11-16T20:57:47.826 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047784220000000002 2020-11-16T20:57:47.826 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.827 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.827 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.827 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.827 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.827 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3541 4.0 4:251c4c06:::smithi16641208-378:head [write 1862271~598221] snapc 55=[55,54] ondisk+write+known_if_redirected e130)", 2020-11-16T20:57:47.827 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.764037+0000", 2020-11-16T20:57:47.827 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 12.88564644, 2020-11-16T20:57:47.827 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037702297000000003, 2020-11-16T20:57:47.828 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.828 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:47.828 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:47.828 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:47.828 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:47.828 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3541 2020-11-16T20:57:47.828 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.829 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.829 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.829 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.829 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764037+0000", 2020-11-16T20:57:47.829 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.829 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.829 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.830 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.830 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764037+0000", 2020-11-16T20:57:47.830 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018829599999999999 2020-11-16T20:57:47.830 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.830 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.830 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.830 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764225+0000", 2020-11-16T20:57:47.830 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7600000000000002e-06 2020-11-16T20:57:47.831 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.831 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.831 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.831 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764233+0000", 2020-11-16T20:57:47.831 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2991e-05 2020-11-16T20:57:47.831 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.831 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.832 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.832 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764246+0000", 2020-11-16T20:57:47.832 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7379999999999997e-06 2020-11-16T20:57:47.832 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.832 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.832 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.832 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764252+0000", 2020-11-16T20:57:47.832 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000195482 2020-11-16T20:57:47.833 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.833 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.833 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.833 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764448+0000", 2020-11-16T20:57:47.833 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3134999999999998e-05 2020-11-16T20:57:47.833 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.833 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.834 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:47.834 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764511+0000", 2020-11-16T20:57:47.834 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024010632000000001 2020-11-16T20:57:47.834 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.834 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.834 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.834 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788522+0000", 2020-11-16T20:57:47.835 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014091200000000001 2020-11-16T20:57:47.835 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.835 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.835 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.835 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788662+0000", 2020-11-16T20:57:47.835 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015662400000000001 2020-11-16T20:57:47.835 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.835 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.836 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:57:47.836 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788819+0000", 2020-11-16T20:57:47.836 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0045297089999999998 2020-11-16T20:57:47.836 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.836 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.836 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.836 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.793349+0000", 2020-11-16T20:57:47.837 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061836570000000004 2020-11-16T20:57:47.837 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.837 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.837 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:47.837 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.799532+0000", 2020-11-16T20:57:47.837 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0020861299999999998 2020-11-16T20:57:47.837 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.837 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.838 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.838 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801619+0000", 2020-11-16T20:57:47.838 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9320999999999996e-05 2020-11-16T20:57:47.838 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.838 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.838 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:47.838 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801688+0000", 2020-11-16T20:57:47.839 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0909999999999999e-05 2020-11-16T20:57:47.839 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.839 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.839 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.839 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801739+0000", 2020-11-16T20:57:47.839 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037702297000000003 2020-11-16T20:57:47.839 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.839 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.840 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.840 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.840 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.840 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3542 4.0 4:251c4c06:::smithi16641208-378:head [setxattr _header (58) in=7b,truncate 2974971] snapc 55=[55,54] ondisk+write+known_if_redirected e130)", 2020-11-16T20:57:47.840 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.764282+0000", 2020-11-16T20:57:47.840 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 12.885400557000001, 2020-11-16T20:57:47.840 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037622296999999999, 2020-11-16T20:57:47.841 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.841 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:47.841 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:47.841 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:47.841 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:47.841 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3542 2020-11-16T20:57:47.841 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.841 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.842 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.842 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.842 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764282+0000", 2020-11-16T20:57:47.842 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.842 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.842 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.842 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.843 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764282+0000", 2020-11-16T20:57:47.843 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0065000000000001e-05 2020-11-16T20:57:47.843 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.843 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.843 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.843 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764312+0000", 2020-11-16T20:57:47.843 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2180000000000002e-06 2020-11-16T20:57:47.844 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.844 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.844 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.844 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764320+0000", 2020-11-16T20:57:47.844 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1029000000000001e-05 2020-11-16T20:57:47.844 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.844 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.844 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.845 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764331+0000", 2020-11-16T20:57:47.845 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4589999999999998e-06 2020-11-16T20:57:47.845 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.845 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.845 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.845 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764334+0000", 2020-11-16T20:57:47.845 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020802799999999999 2020-11-16T20:57:47.846 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.846 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.846 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.846 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764542+0000", 2020-11-16T20:57:47.846 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7712e-05 2020-11-16T20:57:47.846 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.846 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.847 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:47.847 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764590+0000", 2020-11-16T20:57:47.847 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025536256 2020-11-16T20:57:47.847 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.847 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.847 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.847 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790126+0000", 2020-11-16T20:57:47.847 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8548000000000007e-05 2020-11-16T20:57:47.848 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.848 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.848 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.848 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790215+0000", 2020-11-16T20:57:47.848 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013994800000000001 2020-11-16T20:57:47.848 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.848 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.849 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:57:47.849 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790355+0000", 2020-11-16T20:57:47.849 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0032107820000000001 2020-11-16T20:57:47.849 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.849 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.849 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.849 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.793565+0000", 2020-11-16T20:57:47.850 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0059758709999999998 2020-11-16T20:57:47.850 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.850 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.850 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:47.850 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.799541+0000", 2020-11-16T20:57:47.850 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002240999 2020-11-16T20:57:47.850 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.850 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.851 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.851 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801782+0000", 2020-11-16T20:57:47.851 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9985000000000003e-05 2020-11-16T20:57:47.851 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.851 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.851 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:47.851 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801842+0000", 2020-11-16T20:57:47.852 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2397000000000006e-05 2020-11-16T20:57:47.852 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.852 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.852 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.852 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801905+0000", 2020-11-16T20:57:47.852 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037622296999999999 2020-11-16T20:57:47.852 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.852 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.853 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.853 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.853 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.853 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3543 4.0 4:251c4c06:::smithi16641208-378:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e130)", 2020-11-16T20:57:47.853 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.764352+0000", 2020-11-16T20:57:47.853 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 12.885330551999999, 2020-11-16T20:57:47.853 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038764630000000001, 2020-11-16T20:57:47.854 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.854 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:47.854 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:47.854 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:47.854 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:47.854 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3543 2020-11-16T20:57:47.854 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.855 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.855 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.855 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.855 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764352+0000", 2020-11-16T20:57:47.855 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.855 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.855 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.855 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.856 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764352+0000", 2020-11-16T20:57:47.856 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5197999999999999e-05 2020-11-16T20:57:47.856 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.856 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.856 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.856 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764368+0000", 2020-11-16T20:57:47.856 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9960000000000002e-06 2020-11-16T20:57:47.857 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.857 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.857 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.857 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764371+0000", 2020-11-16T20:57:47.857 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8810000000000001e-06 2020-11-16T20:57:47.857 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.857 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.857 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.858 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764376+0000", 2020-11-16T20:57:47.858 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3949999999999999e-06 2020-11-16T20:57:47.858 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.858 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.858 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.858 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764379+0000", 2020-11-16T20:57:47.858 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023363999999999999 2020-11-16T20:57:47.859 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.859 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.859 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.859 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764613+0000", 2020-11-16T20:57:47.859 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3958999999999997e-05 2020-11-16T20:57:47.859 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.859 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.859 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:47.860 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764656+0000", 2020-11-16T20:57:47.860 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026048794 2020-11-16T20:57:47.860 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.860 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.860 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.860 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790705+0000", 2020-11-16T20:57:47.860 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013058500000000001 2020-11-16T20:57:47.861 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.861 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.861 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:47.861 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790836+0000", 2020-11-16T20:57:47.861 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011100066 2020-11-16T20:57:47.861 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.861 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.861 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.862 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801936+0000", 2020-11-16T20:57:47.862 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3307999999999996e-05 2020-11-16T20:57:47.862 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.862 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.862 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.862 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.802019+0000", 2020-11-16T20:57:47.862 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001097808 2020-11-16T20:57:47.863 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.863 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.863 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.863 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.803117+0000", 2020-11-16T20:57:47.863 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038764630000000001 2020-11-16T20:57:47.863 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.863 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.864 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.864 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.864 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.864 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.5.13:51 3.2 3:4427cc2e:::smithi16641208-332:head [copy-from ver 661] snapc 4f=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e139)", 2020-11-16T20:57:47.864 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:43.986780+0000", 2020-11-16T20:57:47.864 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 3.662903032, 2020-11-16T20:57:47.864 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.040884263999999997, 2020-11-16T20:57:47.864 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:47.865 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:47.865 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:47.865 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.865 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:47.865 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.986780+0000", 2020-11-16T20:57:47.865 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:47.865 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.866 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.866 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:47.866 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.986780+0000", 2020-11-16T20:57:47.866 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0978e-05 2020-11-16T20:57:47.866 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.866 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.866 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:47.866 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.986821+0000", 2020-11-16T20:57:47.867 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6009999999999997e-06 2020-11-16T20:57:47.867 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.867 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.867 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:47.867 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.986826+0000", 2020-11-16T20:57:47.867 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0190000000000001e-05 2020-11-16T20:57:47.867 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.868 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.868 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:47.868 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.986836+0000", 2020-11-16T20:57:47.868 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7900000000000001e-06 2020-11-16T20:57:47.868 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.868 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.868 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:47.868 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.986839+0000", 2020-11-16T20:57:47.869 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002115179 2020-11-16T20:57:47.869 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.869 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.869 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:47.869 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.988955+0000", 2020-11-16T20:57:47.869 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5797000000000006e-05 2020-11-16T20:57:47.869 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.870 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.870 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:47.870 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.989030+0000", 2020-11-16T20:57:47.870 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016622987999999998 2020-11-16T20:57:47.870 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.870 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.870 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:47.870 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:44.005653+0000", 2020-11-16T20:57:47.871 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042403629999999996 2020-11-16T20:57:47.871 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.871 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.871 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:47.871 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:44.009894+0000", 2020-11-16T20:57:47.871 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014512321999999999 2020-11-16T20:57:47.871 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.872 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.872 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.872 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:44.024406+0000", 2020-11-16T20:57:47.872 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003165204 2020-11-16T20:57:47.872 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.872 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.872 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:47.873 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:44.027571+0000", 2020-11-16T20:57:47.873 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3579999999999999e-05 2020-11-16T20:57:47.873 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.873 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.873 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:47.873 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:44.027615+0000", 2020-11-16T20:57:47.873 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9271999999999999e-05 2020-11-16T20:57:47.873 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:47.874 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:47.874 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:47.874 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:44.027664+0000", 2020-11-16T20:57:47.874 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.040884263999999997 2020-11-16T20:57:47.874 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.874 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.874 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.875 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:47.875 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:47.875 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:47.876 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:57:47.877 INFO:tasks.rados.rados.0.smithi166.stdout:1164: done (5 left) 2020-11-16T20:57:47.877 INFO:tasks.rados.rados.0.smithi166.stdout:1165: done (4 left) 2020-11-16T20:57:47.877 INFO:tasks.rados.rados.0.smithi166.stdout:1170: done (3 left) 2020-11-16T20:57:47.877 INFO:tasks.rados.rados.0.smithi166.stdout:1171: snap_create 2020-11-16T20:57:47.878 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:47.881+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:47.962 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7] out_osds: [1] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:57:47.962 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:57:47.963 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-16T20:57:48.006 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:48.012+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:48.025 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:48.026 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:57:48.026 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:57:48.026 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:48.035 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:57:48.077 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:48.082+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:48.172 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:48.172 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:57:48.173 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:57:48.173 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:57:48.173 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:48.178 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:48.183+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:48.182 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:57:48.255 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:57:48.256 INFO:teuthology.orchestra.run.smithi166.stderr:dumped all 2020-11-16T20:57:48.266 INFO:teuthology.orchestra.run.smithi166.stdout:{"pg_ready":true,"pg_map":{"version":223,"stamp":"2020-11-16T20:57:47.785486+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1869320565,"num_objects":670,"num_object_clones":14,"num_object_copies":2010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572,"num_whiteouts":18,"num_read":2400,"num_read_kb":1142744,"num_write":3334,"num_write_kb":1457418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":888,"num_bytes_recovered":1270047204,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":169,"num_flush_kb":467122,"num_evict":100,"num_evict_kb":273836,"num_promote":311,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5174,"ondisk_log_size":5174,"up":81,"acting":81,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":4515456,"kb_used_data":4372620,"kb_used_omap":0,"kb_used_meta":140544,"kb_avail":656087424,"statfs":{"total":676457349120,"available":671833522176,"internally_reserved":0,"allocated":4477562880,"data_stored":4503575509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":143917056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22257385,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":83181,"num_write":43,"num_write_kb":40561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":114014356,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":3,"num_flush_kb":7831,"num_evict":3,"num_evict_kb":9275,"num_promote":7,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.822957"},"pg_stats":[{"pgid":"2.11","version":"0'0","reported_seq":"101","reported_epoch":"141","state":"active+clean","last_fresh":"2020-11-16T20:57:45.768524+0000","last_change":"2020-11-16T20:57:28.881806+0000","last_active":"2020-11-16T20:57:45.768524+0000","last_peered":"2020-11-16T20:57:45.768524+0000","last_clean":"2020-11-16T20:57:45.768524+0000","last_became_active":"2020-11-16T20:57:28.881277+0000","last_became_peered":"2020-11-16T20:57:28.881277+0000","last_unstale":"2020-11-16T20:57:45.768524+0000","last_undegraded":"2020-11-16T20:57:45.768524+0000","last_fullsized":"2020-11-16T20:57:45.768524+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:30.376014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:30.376014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,2],"acting":[4,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"127","reported_epoch":"141","state":"active+clean","last_fresh":"2020-11-16T20:57:45.767643+0000","last_change":"2020-11-16T20:57:28.881722+0000","last_active":"2020-11-16T20:57:45.767643+0000","last_peered":"2020-11-16T20:57:45.767643+0000","last_clean":"2020-11-16T20:57:45.767643+0000","last_became_active":"2020-11-16T20:57:28.881184+0000","last_became_peered":"2020-11-16T20:57:28.881184+0000","last_unstale":"2020-11-16T20:57:45.767643+0000","last_undegraded":"2020-11-16T20:57:45.767643+0000","last_fullsized":"2020-11-16T20:57:45.767643+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:55:59.416654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:55:59.416654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":"121","reported_epoch":"141","state":"active+clean","last_fresh":"2020-11-16T20:57:45.768445+0000","last_change":"2020-11-16T20:57:28.424551+0000","last_active":"2020-11-16T20:57:45.768445+0000","last_peered":"2020-11-16T20:57:45.768445+0000","last_clean":"2020-11-16T20:57:45.768445+0000","last_became_active":"2020-11-16T20:55:52.922023+0000","last_became_peered":"2020-11-16T20:55:52.922023+0000","last_unstale":"2020-11-16T20:57:45.768445+0000","last_undegraded":"2020-11-16T20:57:45.768445+0000","last_fullsized":"2020-11-16T20:57:45.768445+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:28.424444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:28.424444+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":"52","reported_epoch":"141","state":"active+clean","last_fresh":"2020-11-16T20:57:45.768134+0000","last_change":"2020-11-16T20:57:13.756286+0000","last_active":"2020-11-16T20:57:45.768134+0000","last_peered":"2020-11-16T20:57:45.768134+0000","last_clean":"2020-11-16T20:57:45.768134+0000","last_became_active":"2020-11-16T20:57:06.893046+0000","last_became_peered":"2020-11-16T20:57:06.893046+0000","last_unstale":"2020-11-16T20:57:45.768134+0000","last_undegraded":"2020-11-16T20:57:45.768134+0000","last_fullsized":"2020-11-16T20:57:45.768134+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:13.756223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:13.756223+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"58","reported_epoch":"141","state":"active+clean","last_fresh":"2020-11-16T20:57:45.768401+0000","last_change":"2020-11-16T20:57:35.451852+0000","last_active":"2020-11-16T20:57:45.768401+0000","last_peered":"2020-11-16T20:57:45.768401+0000","last_clean":"2020-11-16T20:57:45.768401+0000","last_became_active":"2020-11-16T20:57:28.882773+0000","last_became_peered":"2020-11-16T20:57:28.882773+0000","last_unstale":"2020-11-16T20:57:45.768401+0000","last_undegraded":"2020-11-16T20:57:45.768401+0000","last_fullsized":"2020-11-16T20:57:45.768401+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:35.451773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:35.451773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"37","reported_epoch":"141","state":"active+clean","last_fresh":"2020-11-16T20:57:45.768503+0000","last_change":"2020-11-16T20:57:31.452433+0000","last_active":"2020-11-16T20:57:45.768503+0000","last_peered":"2020-11-16T20:57:45.768503+0000","last_clean":"2020-11-16T20:57:45.768503+0000","last_became_active":"2020-11-16T20:57:22.852259+0000","last_became_peered":"2020-11-16T20:57:22.852259+0000","last_unstale":"2020-11-16T20:57:45.768503+0000","last_undegraded":"2020-11-16T20:57:45.768503+0000","last_fullsized":"2020-11-16T20:57:45.768503+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:31.452379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:31.452379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"149","reported_epoch":"141","state":"active+clean","last_fresh":"2020-11-16T20:57:45.771900+0000","last_change":"2020-11-16T20:57:36.432291+0000","last_active":"2020-11-16T20:57:45.771900+0000","last_peered":"2020-11-16T20:57:45.771900+0000","last_clean":"2020-11-16T20:57:45.771900+0000","last_became_active":"2020-11-16T20:55:52.917496+0000","last_became_peered":"2020-11-16T20:55:52.917496+0000","last_unstale":"2020-11-16T20:57:45.771900+0000","last_undegraded":"2020-11-16T20:57:45.771900+0000","last_fullsized":"2020-11-16T20:57:45.771900+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:36.432209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:56:02.565607+0000","last_clean_scrub_stamp":"2020-11-16T20:57:36.432209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"60","reported_epoch":"141","state":"active+clean","last_fresh":"2020-11-16T20:57:45.766756+0000","last_change":"2020-11-16T20:57:36.832058+0000","last_active":"2020-11-16T20:57:45.766756+0000","last_peered":"2020-11-16T20:57:45.766756+0000","last_clean":"2020-11-16T20:57:45.766756+0000","last_became_active":"2020-11-16T20:57:28.881825+0000","last_became_peered":"2020-11-16T20:57:28.881825+0000","last_unstale":"2020-11-16T20:57:45.766756+0000","last_undegraded":"2020-11-16T20:57:45.766756+0000","last_fullsized":"2020-11-16T20:57:45.766756+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:36.831977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:36.831977+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,5],"acting":[3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"64","reported_epoch":"141","state":"active+clean","last_fresh":"2020-11-16T20:57:45.768404+0000","last_change":"2020-11-16T20:57:28.884517+0000","last_active":"2020-11-16T20:57:45.768404+0000","last_peered":"2020-11-16T20:57:45.768404+0000","last_clean":"2020-11-16T20:57:45.768404+0000","last_became_active":"2020-11-16T20:57:28.884038+0000","last_became_peered":"2020-11-16T20:57:28.884038+0000","last_unstale":"2020-11-16T20:57:45.768404+0000","last_undegraded":"2020-11-16T20:57:45.768404+0000","last_fullsized":"2020-11-16T20:57:45.768404+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:20.810314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:20.810314+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"167","reported_epoch":"141","state":"active+clean","last_fresh":"2020-11-16T20:57:45.771296+0000","last_change":"2020-11-16T20:57:28.882165+0000","last_active":"2020-11-16T20:57:45.771296+0000","last_peered":"2020-11-16T20:57:45.771296+0000","last_clean":"2020-11-16T20:57:45.771296+0000","last_became_active":"2020-11-16T20:57:28.881606+0000","last_became_peered":"2020-11-16T20:57:28.881606+0000","last_unstale":"2020-11-16T20:57:45.771296+0000","last_undegraded":"2020-11-16T20:57:45.771296+0000","last_fullsized":"2020-11-16T20:57:45.771296+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:11.459190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:11.459190+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"54","reported_epoch":"137","state":"active+clean","last_fresh":"2020-11-16T20:57:41.947626+0000","last_change":"2020-11-16T20:57:31.684983+0000","last_active":"2020-11-16T20:57:41.947626+0000","last_peered":"2020-11-16T20:57:41.947626+0000","last_clean":"2020-11-16T20:57:41.947626+0000","last_became_active":"2020-11-16T20:57:28.882557+0000","last_became_peered":"2020-11-16T20:57:28.882557+0000","last_unstale":"2020-11-16T20:57:41.947626+0000","last_undegraded":"2020-11-16T20:57:41.947626+0000","last_fullsized":"2020-11-16T20:57:41.947626+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:31.684928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:31.684928+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"138'467","reported_seq":"1041","reported_epoch":"138","state":"active+clean","last_fresh":"2020-11-16T20:57:42.967451+0000","last_change":"2020-11-16T20:57:42.967845+0000","last_active":"2020-11-16T20:57:42.967451+0000","last_peered":"2020-11-16T20:57:42.967451+0000","last_clean":"2020-11-16T20:57:42.967451+0000","last_became_active":"2020-11-16T20:57:31.898488+0000","last_became_peered":"2020-11-16T20:57:31.898488+0000","last_unstale":"2020-11-16T20:57:42.967451+0000","last_undegraded":"2020-11-16T20:57:42.967451+0000","last_fullsized":"2020-11-16T20:57:42.967451+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'382","last_scrub_stamp":"2020-11-16T20:57:18.780374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:57:18.780374+0000","log_size":467,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":118564508,"num_objects":47,"num_object_clones":2,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":6,"num_read":118,"num_read_kb":65392,"num_write":230,"num_write_kb":43151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":77,"num_bytes_recovered":101996064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":42,"num_flush_kb":105177,"num_evict":14,"num_evict_kb":31814,"num_promote":69,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"52","length":"4"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"2.2","version":"0'0","reported_seq":"163","reported_epoch":"137","state":"active+clean","last_fresh":"2020-11-16T20:57:41.966871+0000","last_change":"2020-11-16T20:57:28.883622+0000","last_active":"2020-11-16T20:57:41.966871+0000","last_peered":"2020-11-16T20:57:41.966871+0000","last_clean":"2020-11-16T20:57:41.966871+0000","last_became_active":"2020-11-16T20:57:28.882817+0000","last_became_peered":"2020-11-16T20:57:28.882817+0000","last_unstale":"2020-11-16T20:57:41.966871+0000","last_undegraded":"2020-11-16T20:57:41.966871+0000","last_fullsized":"2020-11-16T20:57:41.966871+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:27.458903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:27.458903+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"140'814","reported_seq":"1343","reported_epoch":"142","state":"active+clean","last_fresh":"2020-11-16T20:57:46.774388+0000","last_change":"2020-11-16T20:57:46.775111+0000","last_active":"2020-11-16T20:57:46.774388+0000","last_peered":"2020-11-16T20:57:46.774388+0000","last_clean":"2020-11-16T20:57:46.774388+0000","last_became_active":"2020-11-16T20:55:25.103851+0000","last_became_peered":"2020-11-16T20:55:25.103851+0000","last_unstale":"2020-11-16T20:57:46.774388+0000","last_undegraded":"2020-11-16T20:57:46.774388+0000","last_fullsized":"2020-11-16T20:57:46.774388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'686","last_scrub_stamp":"2020-11-16T20:56:54.448375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:56:54.448375+0000","log_size":814,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":353358069,"num_objects":122,"num_object_clones":3,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":427,"num_read_kb":125237,"num_write":587,"num_write_kb":323415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"5b","length":"2"},{"start":"62","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":"147","reported_epoch":"141","state":"active+clean","last_fresh":"2020-11-16T20:57:45.767815+0000","last_change":"2020-11-16T20:57:18.747236+0000","last_active":"2020-11-16T20:57:45.767815+0000","last_peered":"2020-11-16T20:57:45.767815+0000","last_clean":"2020-11-16T20:57:45.767815+0000","last_became_active":"2020-11-16T20:55:50.905925+0000","last_became_peered":"2020-11-16T20:55:50.905925+0000","last_unstale":"2020-11-16T20:57:45.767815+0000","last_undegraded":"2020-11-16T20:57:45.767815+0000","last_fullsized":"2020-11-16T20:57:45.767815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:18.747156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:18.747156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"138'846","reported_seq":"2308","reported_epoch":"142","state":"active+clean","last_fresh":"2020-11-16T20:57:46.775736+0000","last_change":"2020-11-16T20:57:46.776282+0000","last_active":"2020-11-16T20:57:46.775736+0000","last_peered":"2020-11-16T20:57:46.775736+0000","last_clean":"2020-11-16T20:57:46.775736+0000","last_became_active":"2020-11-16T20:57:32.907464+0000","last_became_peered":"2020-11-16T20:57:32.907464+0000","last_unstale":"2020-11-16T20:57:46.775736+0000","last_undegraded":"2020-11-16T20:57:46.775736+0000","last_fullsized":"2020-11-16T20:57:46.775736+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'822","last_scrub_stamp":"2020-11-16T20:57:35.157265+0000","last_deep_scrub":"130'822","last_deep_scrub_stamp":"2020-11-16T20:57:35.157265+0000","last_clean_scrub_stamp":"2020-11-16T20:57:35.157265+0000","log_size":846,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":316315148,"num_objects":111,"num_object_clones":1,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":381,"num_read_kb":122618,"num_write":561,"num_write_kb":304919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":450,"num_bytes_recovered":596961011,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"5b","length":"2"},{"start":"62","length":"1"}]},{"pgid":"2.3","version":"0'0","reported_seq":"145","reported_epoch":"137","state":"active+clean","last_fresh":"2020-11-16T20:57:41.966841+0000","last_change":"2020-11-16T20:57:12.498318+0000","last_active":"2020-11-16T20:57:41.966841+0000","last_peered":"2020-11-16T20:57:41.966841+0000","last_clean":"2020-11-16T20:57:41.966841+0000","last_became_active":"2020-11-16T20:55:50.903578+0000","last_became_peered":"2020-11-16T20:55:50.903578+0000","last_unstale":"2020-11-16T20:57:41.966841+0000","last_undegraded":"2020-11-16T20:57:41.966841+0000","last_fullsized":"2020-11-16T20:57:41.966841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:12.498241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:12.498241+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"145","reported_epoch":"141","state":"active+clean","last_fresh":"2020-11-16T20:57:45.771396+0000","last_change":"2020-11-16T20:57:28.434051+0000","last_active":"2020-11-16T20:57:45.771396+0000","last_peered":"2020-11-16T20:57:45.771396+0000","last_clean":"2020-11-16T20:57:45.771396+0000","last_became_active":"2020-11-16T20:54:53.112038+0000","last_became_peered":"2020-11-16T20:54:53.112038+0000","last_unstale":"2020-11-16T20:57:45.771396+0000","last_undegraded":"2020-11-16T20:57:45.771396+0000","last_fullsized":"2020-11-16T20:57:45.771396+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'2","last_scrub_stamp":"2020-11-16T20:57:28.433971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:50.068882+0000","last_clean_scrub_stamp":"2020-11-16T20:57:28.433971+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"142'734","reported_seq":"1268","reported_epoch":"142","state":"active+clean","last_fresh":"2020-11-16T20:57:46.845274+0000","last_change":"2020-11-16T20:57:46.845392+0000","last_active":"2020-11-16T20:57:46.845274+0000","last_peered":"2020-11-16T20:57:46.845274+0000","last_clean":"2020-11-16T20:57:46.845274+0000","last_became_active":"2020-11-16T20:55:25.106302+0000","last_became_peered":"2020-11-16T20:55:25.106302+0000","last_unstale":"2020-11-16T20:57:46.845274+0000","last_undegraded":"2020-11-16T20:57:46.845274+0000","last_fullsized":"2020-11-16T20:57:46.845274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'734","last_scrub_stamp":"2020-11-16T20:57:46.845273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:57:46.845273+0000","log_size":734,"ondisk_log_size":734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":303649281,"num_objects":112,"num_object_clones":5,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":427,"num_read_kb":188526,"num_write":549,"num_write_kb":297683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"5b","length":"2"},{"start":"62","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":"159","reported_epoch":"141","state":"active+clean","last_fresh":"2020-11-16T20:57:45.771459+0000","last_change":"2020-11-16T20:57:28.882353+0000","last_active":"2020-11-16T20:57:45.771459+0000","last_peered":"2020-11-16T20:57:45.771459+0000","last_clean":"2020-11-16T20:57:45.771459+0000","last_became_active":"2020-11-16T20:57:28.881823+0000","last_became_peered":"2020-11-16T20:57:28.881823+0000","last_unstale":"2020-11-16T20:57:45.771459+0000","last_undegraded":"2020-11-16T20:57:45.771459+0000","last_fullsized":"2020-11-16T20:57:45.771459+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:19.447373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:19.447373+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,3],"acting":[7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"138'857","reported_seq":"1405","reported_epoch":"138","state":"active+clean","last_fresh":"2020-11-16T20:57:42.960383+0000","last_change":"2020-11-16T20:57:42.960770+0000","last_active":"2020-11-16T20:57:42.960383+0000","last_peered":"2020-11-16T20:57:42.960383+0000","last_clean":"2020-11-16T20:57:42.960383+0000","last_became_active":"2020-11-16T20:55:24.802649+0000","last_became_peered":"2020-11-16T20:55:24.802649+0000","last_unstale":"2020-11-16T20:57:42.960383+0000","last_undegraded":"2020-11-16T20:57:42.960383+0000","last_fullsized":"2020-11-16T20:57:42.960383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'650","last_scrub_stamp":"2020-11-16T20:56:37.941529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:56:37.941529+0000","log_size":857,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":382287145,"num_objects":130,"num_object_clones":1,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":512,"num_read_kb":224289,"num_write":653,"num_write_kb":338092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"52","length":"4"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"4.3","version":"142'480","reported_seq":"1030","reported_epoch":"142","state":"active+clean+wait","last_fresh":"2020-11-16T20:57:46.789693+0000","last_change":"2020-11-16T20:57:46.790224+0000","last_active":"2020-11-16T20:57:46.789693+0000","last_peered":"2020-11-16T20:57:46.789693+0000","last_clean":"2020-11-16T20:57:46.789693+0000","last_became_active":"2020-11-16T20:57:46.778669+0000","last_became_peered":"2020-11-16T20:57:46.778669+0000","last_unstale":"2020-11-16T20:57:46.789693+0000","last_undegraded":"2020-11-16T20:57:46.789693+0000","last_fullsized":"2020-11-16T20:57:46.789693+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'387","last_scrub_stamp":"2020-11-16T20:57:19.796359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:57:19.796359+0000","log_size":480,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":132026856,"num_objects":48,"num_object_clones":2,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":2,"num_read":192,"num_read_kb":155611,"num_write":270,"num_write_kb":51446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":356435764,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":40,"num_flush_kb":115142,"num_evict":34,"num_evict_kb":97345,"num_promote":84,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"55","length":"1"},{"start":"5b","length":"2"},{"start":"62","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":"150","reported_epoch":"141","state":"active+clean","last_fresh":"2020-11-16T20:57:45.771336+0000","last_change":"2020-11-16T20:57:15.403335+0000","last_active":"2020-11-16T20:57:45.771336+0000","last_peered":"2020-11-16T20:57:45.771336+0000","last_clean":"2020-11-16T20:57:45.771336+0000","last_became_active":"2020-11-16T20:55:50.901014+0000","last_became_peered":"2020-11-16T20:55:50.901014+0000","last_unstale":"2020-11-16T20:57:45.771336+0000","last_undegraded":"2020-11-16T20:57:45.771336+0000","last_fullsized":"2020-11-16T20:57:45.771336+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:15.403250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:15.403250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"40","reported_epoch":"141","state":"active+clean","last_fresh":"2020-11-16T20:57:45.768040+0000","last_change":"2020-11-16T20:57:32.659418+0000","last_active":"2020-11-16T20:57:45.768040+0000","last_peered":"2020-11-16T20:57:45.768040+0000","last_clean":"2020-11-16T20:57:45.768040+0000","last_became_active":"2020-11-16T20:57:18.833699+0000","last_became_peered":"2020-11-16T20:57:18.833699+0000","last_unstale":"2020-11-16T20:57:45.768040+0000","last_undegraded":"2020-11-16T20:57:45.768040+0000","last_fullsized":"2020-11-16T20:57:45.768040+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:32.659344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:32.659344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"136'488","reported_seq":"962","reported_epoch":"142","state":"active+clean","last_fresh":"2020-11-16T20:57:46.770181+0000","last_change":"2020-11-16T20:57:46.770537+0000","last_active":"2020-11-16T20:57:46.770181+0000","last_peered":"2020-11-16T20:57:46.770181+0000","last_clean":"2020-11-16T20:57:46.770181+0000","last_became_active":"2020-11-16T20:57:31.898744+0000","last_became_peered":"2020-11-16T20:57:31.898744+0000","last_unstale":"2020-11-16T20:57:46.770181+0000","last_undegraded":"2020-11-16T20:57:46.770181+0000","last_fullsized":"2020-11-16T20:57:46.770181+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'320","last_scrub_stamp":"2020-11-16T20:56:54.815437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:56:54.815437+0000","log_size":488,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":126139307,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":5,"num_read":178,"num_read_kb":138680,"num_write":227,"num_write_kb":45978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":63,"num_bytes_recovered":122901039,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":42,"num_flush_kb":118427,"num_evict":26,"num_evict_kb":72313,"num_promote":77,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"55","length":"1"},{"start":"5b","length":"2"},{"start":"62","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":"148","reported_epoch":"141","state":"active+clean","last_fresh":"2020-11-16T20:57:45.766627+0000","last_change":"2020-11-16T20:57:17.577037+0000","last_active":"2020-11-16T20:57:45.766627+0000","last_peered":"2020-11-16T20:57:45.766627+0000","last_clean":"2020-11-16T20:57:45.766627+0000","last_became_active":"2020-11-16T20:55:50.905649+0000","last_became_peered":"2020-11-16T20:55:50.905649+0000","last_unstale":"2020-11-16T20:57:45.766627+0000","last_undegraded":"2020-11-16T20:57:45.766627+0000","last_fullsized":"2020-11-16T20:57:45.766627+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:17.576958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:17.576958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"141'486","reported_seq":"1043","reported_epoch":"142","state":"active+clean","last_fresh":"2020-11-16T20:57:46.772752+0000","last_change":"2020-11-16T20:57:46.773122+0000","last_active":"2020-11-16T20:57:46.772752+0000","last_peered":"2020-11-16T20:57:46.772752+0000","last_clean":"2020-11-16T20:57:46.772752+0000","last_became_active":"2020-11-16T20:56:16.750108+0000","last_became_peered":"2020-11-16T20:56:16.750108+0000","last_unstale":"2020-11-16T20:57:46.772752+0000","last_undegraded":"2020-11-16T20:57:46.772752+0000","last_fullsized":"2020-11-16T20:57:46.772752+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'266","last_scrub_stamp":"2020-11-16T20:56:42.351294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:56:42.351294+0000","log_size":486,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":136980251,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":5,"num_read":165,"num_read_kb":122391,"num_write":255,"num_write_kb":52724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":91753326,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":45,"num_flush_kb":128376,"num_evict":26,"num_evict_kb":72364,"num_promote":81,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"55","length":"1"},{"start":"5b","length":"2"},{"start":"62","length":"1"}]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":513710922,"num_objects":193,"num_object_clones":4,"num_object_copies":579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":18,"num_read":653,"num_read_kb":482074,"num_write":982,"num_write_kb":193299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":438,"num_bytes_recovered":673086193,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":169,"num_flush_kb":467122,"num_evict":100,"num_evict_kb":273836,"num_promote":311,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1926860800,"data_stored":1934087125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1921,"ondisk_log_size":1921,"up":12,"acting":12,"num_store_stats":8},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":1355609643,"num_objects":475,"num_object_clones":10,"num_object_copies":1425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":475,"num_whiteouts":0,"num_read":1747,"num_read_kb":660670,"num_write":2350,"num_write_kb":1264109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":450,"num_bytes_recovered":596961011,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2970333184,"data_stored":2984130796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3251,"ondisk_log_size":3251,"up":12,"acting":12,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":18,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":235700,"kb_used_data":222060,"kb_used_omap":0,"kb_used_meta":13632,"kb_avail":94136140,"statfs":{"total":96636764160,"available":96395407360,"internally_reserved":0,"allocated":227389440,"data_stored":226116787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13959168},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.96699999999999997,"15min":0.96799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.90000000000000002,"15min":0.91600000000000004},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.252,"5min":1.48,"15min":1.48},"last":0.83299999999999996}]},{"osd":1,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.93999999999999995,"15min":0.94499999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.258},{"interface":"front","average":{"1min":1.03,"5min":0.997,"15min":0.99099999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.046}]},{"osd":2,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.97399999999999998,"15min":0.98899999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.97999999999999998,"15min":0.98299999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.89800000000000002}]},{"osd":3,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.1279999999999999,"15min":1.1359999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.0620000000000001,"15min":1.0549999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.1719999999999999}]},{"osd":4,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.98499999999999999,"15min":0.99299999999999999},"min":{"1min":0.63400000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.387,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.159,"15min":1.161},"min":{"1min":0.70999999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2,"5min":2,"15min":2},"last":0.71199999999999997}]},{"osd":5,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.103,"15min":1.107},"min":{"1min":0.71199999999999997,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.081,"5min":1.181,"15min":1.1970000000000001},"min":{"1min":0.74299999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.4730000000000001,"5min":1.583,"15min":1.583},"last":0.751}]},{"osd":6,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.264,"15min":1.25},"min":{"1min":0.89300000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.359,"15min":1.375},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.0669999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":796868,"kb_used_data":774460,"kb_used_omap":0,"kb_used_meta":22400,"kb_avail":93574972,"statfs":{"total":96636764160,"available":95820771328,"internally_reserved":0,"allocated":793047040,"data_stored":797376340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22937600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.94899999999999995,"15min":0.95299999999999996},"min":{"1min":0.55500000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.421,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.218},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.93300000000000005,"15min":0.93000000000000005},"min":{"1min":0.62,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.944}]},{"osd":1,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.018,"15min":1.016},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.4650000000000001,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":0.96399999999999997,"15min":0.94099999999999995},"min":{"1min":0.64900000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.054}]},{"osd":2,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.86399999999999999,"15min":0.872},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.147},{"interface":"front","average":{"1min":1.083,"5min":1.123,"15min":1.1299999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.6559999999999999,"5min":1.897,"15min":1.897},"last":1.1319999999999999}]},{"osd":3,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.089,"15min":1.103},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.369,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1259999999999999,"15min":1.123},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.4730000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.024}]},{"osd":4,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.129,"15min":1.1419999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.7390000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1759999999999999,"15min":1.1799999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.7470000000000001}]},{"osd":5,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0920000000000001,"15min":1.1020000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":1.262},{"interface":"front","average":{"1min":1.327,"5min":1.4339999999999999,"15min":1.452},"min":{"1min":1.0860000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":1.901,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.288}]},{"osd":7,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.8420000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.3009999999999999,"15min":1.3100000000000001},"min":{"1min":0.96799999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.91900000000000004}]}]},{"osd":1,"up_from":0,"seq":55834574885,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1047880,"kb_used_data":1016604,"kb_used_omap":0,"kb_used_meta":30528,"kb_avail":93323960,"statfs":{"total":96636764160,"available":95563735040,"internally_reserved":0,"allocated":1041002496,"data_stored":1047092447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31260672},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 16 20:56:55 2020","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.71999999999999997,"15min":0.73099999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0249999999999999,"5min":1.05,"15min":1.05},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.877,"15min":0.873},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.7269999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":0.93300000000000005}]},{"osd":2,"last update":"Mon Nov 16 20:56:55 2020","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.75900000000000001,"15min":0.77600000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.86799999999999999,"15min":0.877},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.68700000000000006}]},{"osd":3,"last update":"Mon Nov 16 20:56:55 2020","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.92300000000000004,"15min":0.93700000000000006},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.93700000000000006,"15min":0.95499999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.877}]},{"osd":4,"last update":"Mon Nov 16 20:56:55 2020","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.145,"15min":1.137},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":3.3100000000000001,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":1.056},{"interface":"front","average":{"1min":1.075,"5min":1.216,"15min":1.24},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.4510000000000001}]},{"osd":5,"last update":"Mon Nov 16 20:56:55 2020","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2929999999999999,"15min":1.3049999999999999},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.274},{"interface":"front","average":{"1min":1.133,"5min":1.1799999999999999,"15min":1.1879999999999999},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.1060000000000001}]},{"osd":6,"last update":"Mon Nov 16 20:56:55 2020","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.236,"15min":1.2549999999999999},"min":{"1min":0.79100000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.212},{"interface":"front","average":{"1min":1.252,"5min":1.3240000000000001,"15min":1.3360000000000001},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.5670000000000002,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":1.1879999999999999}]},{"osd":7,"last update":"Mon Nov 16 20:56:55 2020","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.3799999999999999,"15min":1.3999999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":1.327},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.365,"15min":1.3919999999999999},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.2309999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.3680000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339088,"kb_used_data":324872,"kb_used_omap":0,"kb_used_meta":14208,"kb_avail":94032752,"statfs":{"total":96636764160,"available":96289538048,"internally_reserved":0,"allocated":332668928,"data_stored":332376643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14548992},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:56:52 2020","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.72199999999999998,"15min":0.69999999999999996},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":2.4769999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.78000000000000003,"15min":0.75800000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.758,"5min":2.758,"15min":2.758},"last":1.329}]},{"osd":1,"last update":"Mon Nov 16 20:56:52 2020","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.84799999999999998,"15min":0.83399999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":3.3090000000000002,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":2.5710000000000002},{"interface":"front","average":{"1min":1.052,"5min":0.90600000000000003,"15min":0.88200000000000001},"min":{"1min":0.61799999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.3580000000000001,"5min":3.3580000000000001,"15min":3.3580000000000001},"last":1.4299999999999999}]},{"osd":3,"last update":"Mon Nov 16 20:56:53 2020","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.751,"15min":0.73699999999999999},"min":{"1min":0.53600000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.90500000000000003,"15min":0.89100000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":2.6779999999999999}]},{"osd":4,"last update":"Mon Nov 16 20:56:52 2020","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1259999999999999,"15min":1.1279999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4379999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.165,"15min":1.143},"min":{"1min":0.82299999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.286}]},{"osd":5,"last update":"Mon Nov 16 20:56:52 2020","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.157,"15min":1.145},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":2.8170000000000002},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.173,"15min":1.1699999999999999},"min":{"1min":0.77100000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.6140000000000001}]},{"osd":6,"last update":"Mon Nov 16 20:56:52 2020","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.113,"15min":1.1000000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.546},{"interface":"front","average":{"1min":1.26,"5min":1.208,"15min":1.2},"min":{"1min":0.93300000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":2.956}]},{"osd":7,"last update":"Mon Nov 16 20:56:52 2020","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2490000000000001,"15min":1.2529999999999999},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.917},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.2809999999999999,"15min":1.2789999999999999},"min":{"1min":0.91600000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.79,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.726}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":817604,"kb_used_data":795196,"kb_used_omap":0,"kb_used_meta":22400,"kb_avail":93554236,"statfs":{"total":96636764160,"available":95799537664,"internally_reserved":0,"allocated":814280704,"data_stored":820178390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22937600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:56:53 2020","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.65200000000000002,"15min":0.65400000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.67500000000000004,"15min":0.67900000000000005},"min":{"1min":0.52600000000000002,"5min":0.495,"15min":0.495},"max":{"1min":0.93200000000000005,"5min":0.996,"15min":0.996},"last":0.79000000000000004}]},{"osd":1,"last update":"Mon Nov 16 20:56:53 2020","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.79100000000000004,"15min":0.81000000000000005},"min":{"1min":0.47699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1850000000000001,"5min":2.105,"15min":2.105},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.93500000000000005,"15min":0.95699999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2450000000000001,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.872}]},{"osd":2,"last update":"Mon Nov 16 20:56:53 2020","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.93200000000000005,"15min":0.95399999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3160000000000001,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0129999999999999,"15min":1.0209999999999999},"min":{"1min":0.73299999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4379999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.0669999999999999}]},{"osd":4,"last update":"Mon Nov 16 20:56:53 2020","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.117,"15min":1.1359999999999999},"min":{"1min":0.73499999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.6779999999999999,"5min":2.923,"15min":2.923},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.165,"15min":1.173},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.016,"5min":2.968,"15min":2.968},"last":1.2669999999999999}]},{"osd":5,"last update":"Mon Nov 16 20:56:53 2020","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.2450000000000001,"15min":1.2729999999999999},"min":{"1min":0.76200000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.1789999999999998,"5min":2.8479999999999999,"15min":2.8479999999999999},"last":1.048},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.121,"15min":1.111},"min":{"1min":0.89200000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.234}]},{"osd":6,"last update":"Mon Nov 16 20:56:53 2020","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.218,"15min":1.2450000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.4430000000000001,"5min":2.859,"15min":2.859},"last":1.179},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.3899999999999999,"15min":1.4239999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.2890000000000001,"5min":3.5390000000000001,"15min":3.5390000000000001},"last":1.1619999999999999}]},{"osd":7,"last update":"Mon Nov 16 20:56:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.296,"15min":1.3129999999999999},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.512,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.2849999999999999,"15min":1.3109999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.538,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":1.373}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":852476,"kb_used_data":829504,"kb_used_omap":0,"kb_used_meta":22208,"kb_avail":93519364,"statfs":{"total":96636764160,"available":95763828736,"internally_reserved":0,"allocated":849412096,"data_stored":855668268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22740992},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.077,"15min":1.075},"min":{"1min":0.70099999999999996,"5min":0.629,"15min":0.629},"max":{"1min":1.5229999999999999,"5min":1.571,"15min":1.571},"last":1.135}]},{"osd":1,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.873,"15min":0.877},"min":{"1min":0.52700000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1879999999999999,"5min":1.196,"15min":1.196},"last":1.3839999999999999},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.871,"15min":0.86899999999999999},"min":{"1min":0.58799999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3200000000000001,"5min":1.331,"15min":1.331},"last":0.95799999999999996}]},{"osd":2,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.022,"15min":1.0269999999999999},"min":{"1min":0.70999999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2889999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.0429999999999999,"15min":1.0609999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.306,"5min":1.609,"15min":1.609},"last":1.1000000000000001}]},{"osd":3,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0209999999999999,"15min":1.024},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.444},{"interface":"front","average":{"1min":0.90600000000000003,"5min":1.135,"15min":1.173},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1619999999999999,"5min":1.528,"15min":1.528},"last":1.1850000000000001}]},{"osd":5,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.0680000000000001,"15min":1.091},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.419,"5min":1.643,"15min":1.643},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.1990000000000001,"15min":1.2050000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.6519999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.302}]},{"osd":6,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.1419999999999999,"15min":1.163},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.2889999999999999,"15min":1.304},"min":{"1min":0.93899999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.6379999999999999,"5min":1.79,"15min":1.79},"last":1.2370000000000001}]},{"osd":7,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.4059999999999999,"15min":1.421},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":1.827,"5min":2.4369999999999998,"15min":2.4369999999999998},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.383,"15min":1.4139999999999999},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.5509999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.359}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":425840,"kb_used_data":409924,"kb_used_omap":0,"kb_used_meta":15168,"kb_avail":93946000,"statfs":{"total":96636764160,"available":96200704000,"internally_reserved":0,"allocated":419762176,"data_stored":424766634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15532032},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.89500000000000002,"15min":0.89100000000000001},"min":{"1min":0.58899999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.879,"5min":0.90400000000000003,"15min":0.90800000000000003},"min":{"1min":0.505,"5min":0.497,"15min":0.497},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.68400000000000005}]},{"osd":1,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.93999999999999995,"15min":0.94999999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.087},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.95599999999999996,"15min":0.95699999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.748}]},{"osd":2,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0149999999999999,"15min":1.0189999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.2}]},{"osd":3,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.052,"15min":1.0569999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.395},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.153,"15min":1.1519999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.2370000000000001}]},{"osd":4,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0389999999999999,"15min":1.0269999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.153},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1679999999999999,"15min":1.1819999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.288}]},{"osd":6,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.2010000000000001,"15min":1.21},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.333,"15min":1.343},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.1739999999999999}]},{"osd":7,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":1.466},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.4239999999999999,"15min":1.4430000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7949999999999999,"5min":1.909,"15min":1.909},"last":1.587}]}]}]}} 2020-11-16T20:57:48.307 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:48.313+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:48.319 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:48.319 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:57:48.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:57:48.319 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:57:48.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.320 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2370 4.1 4:82bb0fe7:::smithi16641208-101:head [write 2346424~426830] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:57:48.320 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:57:48.320 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 103.26781091399999, 2020-11-16T20:57:48.320 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04706581, 2020-11-16T20:57:48.320 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:48.320 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:48.320 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:48.321 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:48.321 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:48.321 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2370 2020-11-16T20:57:48.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.321 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:48.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.321 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:48.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:57:48.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:48.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:48.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:57:48.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011081520000000001 2020-11-16T20:57:48.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:48.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055391+0000", 2020-11-16T20:57:48.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8289999999999996e-06 2020-11-16T20:57:48.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.324 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:48.324 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055397+0000", 2020-11-16T20:57:48.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7599999999999997e-06 2020-11-16T20:57:48.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.324 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:48.324 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055407+0000", 2020-11-16T20:57:48.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4180000000000002e-06 2020-11-16T20:57:48.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:48.325 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055413+0000", 2020-11-16T20:57:48.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1767000000000001e-05 2020-11-16T20:57:48.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.326 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055465+0000", 2020-11-16T20:57:48.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1916999999999998e-05 2020-11-16T20:57:48.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.326 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:48.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055517+0000", 2020-11-16T20:57:48.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027302192999999999 2020-11-16T20:57:48.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.082819+0000", 2020-11-16T20:57:48.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013272199999999999 2020-11-16T20:57:48.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:48.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.082952+0000", 2020-11-16T20:57:48.328 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000218574 2020-11-16T20:57:48.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:48.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083171+0000", 2020-11-16T20:57:48.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016037374 2020-11-16T20:57:48.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.329 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:48.329 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099208+0000", 2020-11-16T20:57:48.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001621248 2020-11-16T20:57:48.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.330 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:48.330 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100829+0000", 2020-11-16T20:57:48.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039884700000000003 2020-11-16T20:57:48.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.330 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:48.331 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101228+0000", 2020-11-16T20:57:48.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1977000000000006e-05 2020-11-16T20:57:48.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.331 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:48.331 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101300+0000", 2020-11-16T20:57:48.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9032000000000001e-05 2020-11-16T20:57:48.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.332 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:48.332 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101349+0000", 2020-11-16T20:57:48.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04706581 2020-11-16T20:57:48.332 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.332 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:48.332 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.333 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2372 4.1 4:82bb0fe7:::smithi16641208-101:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e42)", 2020-11-16T20:57:48.333 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:57:48.333 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 103.266581968, 2020-11-16T20:57:48.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046557016999999999, 2020-11-16T20:57:48.333 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:48.333 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:48.334 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:48.334 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:48.334 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:48.334 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2372 2020-11-16T20:57:48.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.334 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:48.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.335 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:48.335 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:57:48.335 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:48.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.335 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.335 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:48.335 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:57:48.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9907000000000001e-05 2020-11-16T20:57:48.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.336 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.336 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:48.336 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055532+0000", 2020-11-16T20:57:48.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0599999999999999e-06 2020-11-16T20:57:48.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:48.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055535+0000", 2020-11-16T20:57:48.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1430000000000003e-06 2020-11-16T20:57:48.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:48.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055541+0000", 2020-11-16T20:57:48.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6819999999999999e-06 2020-11-16T20:57:48.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:48.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055544+0000", 2020-11-16T20:57:48.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000102643 2020-11-16T20:57:48.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.339 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.339 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.339 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055647+0000", 2020-11-16T20:57:48.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7197000000000003e-05 2020-11-16T20:57:48.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.339 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.339 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:48.340 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055684+0000", 2020-11-16T20:57:48.340 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029347807 2020-11-16T20:57:48.340 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.340 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.340 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.340 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.085032+0000", 2020-11-16T20:57:48.340 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6130000000000005e-05 2020-11-16T20:57:48.340 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.341 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:48.341 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.085108+0000", 2020-11-16T20:57:48.341 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016542980999999998 2020-11-16T20:57:48.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.341 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101651+0000", 2020-11-16T20:57:48.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000118733 2020-11-16T20:57:48.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:48.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101769+0000", 2020-11-16T20:57:48.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029973400000000001 2020-11-16T20:57:48.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:48.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.102069+0000", 2020-11-16T20:57:48.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046557016999999999 2020-11-16T20:57:48.343 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.343 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:48.343 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.344 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.344 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2503 4.1 4:b0538c7c:::smithi16641208-136:head [write 1790337~563515] snapc f=[f,e,d,5] ondisk+write+known_if_redirected e52)", 2020-11-16T20:57:48.344 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:57:48.344 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 93.575386464999994, 2020-11-16T20:57:48.344 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089724989000000005, 2020-11-16T20:57:48.344 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:48.345 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:48.345 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:48.345 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:48.345 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:48.345 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2503 2020-11-16T20:57:48.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.345 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:48.346 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:48.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:57:48.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:48.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.346 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:48.347 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:57:48.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00060419599999999999 2020-11-16T20:57:48.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.347 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:48.347 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747312+0000", 2020-11-16T20:57:48.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.319e-06 2020-11-16T20:57:48.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.348 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:48.348 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747318+0000", 2020-11-16T20:57:48.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5100000000000004e-06 2020-11-16T20:57:48.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.348 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:48.349 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747328+0000", 2020-11-16T20:57:48.349 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6369999999999999e-06 2020-11-16T20:57:48.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.349 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:48.349 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747335+0000", 2020-11-16T20:57:48.349 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001800479 2020-11-16T20:57:48.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749136+0000", 2020-11-16T20:57:48.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7970000000000002e-05 2020-11-16T20:57:48.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:48.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749194+0000", 2020-11-16T20:57:48.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030847998000000001 2020-11-16T20:57:48.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.351 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780042+0000", 2020-11-16T20:57:48.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013142199999999999 2020-11-16T20:57:48.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:48.352 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780173+0000", 2020-11-16T20:57:48.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022398200000000001 2020-11-16T20:57:48.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:57:48.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780397+0000", 2020-11-16T20:57:48.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061389269999999998 2020-11-16T20:57:48.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:48.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786536+0000", 2020-11-16T20:57:48.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3673999999999998e-05 2020-11-16T20:57:48.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.354 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.354 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:48.354 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786630+0000", 2020-11-16T20:57:48.354 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049513384000000001 2020-11-16T20:57:48.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.354 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.355 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:48.355 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836143+0000", 2020-11-16T20:57:48.355 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4713000000000001e-05 2020-11-16T20:57:48.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.355 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:48.355 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836218+0000", 2020-11-16T20:57:48.356 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000214778 2020-11-16T20:57:48.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.356 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.356 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:48.356 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836433+0000", 2020-11-16T20:57:48.356 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089724989000000005 2020-11-16T20:57:48.356 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.356 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:48.357 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.357 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2504 4.1 4:b0538c7c:::smithi16641208-136:head [setxattr _header (58) in=7b,truncate 2991745] snapc f=[f,e,d,5] ondisk+write+known_if_redirected e52)", 2020-11-16T20:57:48.357 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:57:48.357 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 93.574712094999995, 2020-11-16T20:57:48.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089341162000000002, 2020-11-16T20:57:48.358 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:48.358 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:48.358 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:48.358 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:48.358 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:48.358 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2504 2020-11-16T20:57:48.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.359 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:48.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:48.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:57:48.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:48.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.360 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:48.360 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:57:48.360 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5520999999999999e-05 2020-11-16T20:57:48.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.360 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.360 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:48.360 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747438+0000", 2020-11-16T20:57:48.360 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2020-11-16T20:57:48.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.361 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.361 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:48.361 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747444+0000", 2020-11-16T20:57:48.361 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.661e-06 2020-11-16T20:57:48.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.361 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.362 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:48.362 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747451+0000", 2020-11-16T20:57:48.362 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6920000000000001e-06 2020-11-16T20:57:48.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.362 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:48.362 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747456+0000", 2020-11-16T20:57:48.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0017949769999999999 2020-11-16T20:57:48.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.363 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.363 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749251+0000", 2020-11-16T20:57:48.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114708 2020-11-16T20:57:48.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:48.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749366+0000", 2020-11-16T20:57:48.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032215049000000003 2020-11-16T20:57:48.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.781581+0000", 2020-11-16T20:57:48.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000181452 2020-11-16T20:57:48.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:48.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.781762+0000", 2020-11-16T20:57:48.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024118300000000001 2020-11-16T20:57:48.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.366 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:57:48.366 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782003+0000", 2020-11-16T20:57:48.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045997939999999999 2020-11-16T20:57:48.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.366 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:48.366 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786603+0000", 2020-11-16T20:57:48.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8782000000000002e-05 2020-11-16T20:57:48.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:48.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786642+0000", 2020-11-16T20:57:48.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049869098000000001 2020-11-16T20:57:48.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:48.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836511+0000", 2020-11-16T20:57:48.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4498000000000005e-05 2020-11-16T20:57:48.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:48.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836576+0000", 2020-11-16T20:57:48.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000147615 2020-11-16T20:57:48.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:48.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836723+0000", 2020-11-16T20:57:48.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089341162000000002 2020-11-16T20:57:48.370 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.370 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:48.370 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.371 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2505 4.1 4:b0538c7c:::smithi16641208-136:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e52)", 2020-11-16T20:57:48.371 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:57:48.371 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 93.574602967000004, 2020-11-16T20:57:48.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089929617000000003, 2020-11-16T20:57:48.371 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:48.371 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:48.372 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:48.372 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:48.372 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:48.372 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2505 2020-11-16T20:57:48.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.372 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:48.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:48.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:57:48.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:48.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:48.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:57:48.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1894999999999999e-05 2020-11-16T20:57:48.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:48.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747523+0000", 2020-11-16T20:57:48.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3900000000000003e-06 2020-11-16T20:57:48.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:48.375 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747527+0000", 2020-11-16T20:57:48.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8169999999999999e-06 2020-11-16T20:57:48.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:48.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747535+0000", 2020-11-16T20:57:48.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6449999999999998e-06 2020-11-16T20:57:48.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:48.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747539+0000", 2020-11-16T20:57:48.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0018868209999999999 2020-11-16T20:57:48.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749426+0000", 2020-11-16T20:57:48.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4963000000000002e-05 2020-11-16T20:57:48.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:48.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749481+0000", 2020-11-16T20:57:48.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032915959000000002 2020-11-16T20:57:48.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782397+0000", 2020-11-16T20:57:48.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018449499999999999 2020-11-16T20:57:48.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:48.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782581+0000", 2020-11-16T20:57:48.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054195457000000002 2020-11-16T20:57:48.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.380 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.380 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836777+0000", 2020-11-16T20:57:48.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000214584 2020-11-16T20:57:48.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.380 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:48.380 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836991+0000", 2020-11-16T20:57:48.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000429591 2020-11-16T20:57:48.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:48.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.837421+0000", 2020-11-16T20:57:48.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089929617000000003 2020-11-16T20:57:48.381 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.381 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:48.382 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.382 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2593 3.3 3:f5f8fa2a:::smithi16641208-144:head [copy-from ver 64] snapc 14=[12,f,5] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e57)", 2020-11-16T20:57:48.382 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:57:48.382 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 88.535454106000003, 2020-11-16T20:57:48.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064638111999999998, 2020-11-16T20:57:48.383 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:48.383 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:48.383 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:48.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.383 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:48.383 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:57:48.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:48.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:48.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:57:48.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3655999999999998e-05 2020-11-16T20:57:48.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:48.385 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786664+0000", 2020-11-16T20:57:48.385 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1850000000000003e-06 2020-11-16T20:57:48.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:48.385 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786669+0000", 2020-11-16T20:57:48.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0861e-05 2020-11-16T20:57:48.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.386 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.386 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:48.386 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786680+0000", 2020-11-16T20:57:48.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6749999999999996e-06 2020-11-16T20:57:48.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.387 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:48.387 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786686+0000", 2020-11-16T20:57:48.387 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2327000000000003e-05 2020-11-16T20:57:48.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.387 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.387 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786729+0000", 2020-11-16T20:57:48.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000156143 2020-11-16T20:57:48.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.388 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:48.388 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786885+0000", 2020-11-16T20:57:48.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024103846000000002 2020-11-16T20:57:48.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.389 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:57:48.389 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810989+0000", 2020-11-16T20:57:48.389 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018870436000000001 2020-11-16T20:57:48.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.389 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:48.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829859+0000", 2020-11-16T20:57:48.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021210896 2020-11-16T20:57:48.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.390 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:48.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851070+0000", 2020-11-16T20:57:48.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3708e-05 2020-11-16T20:57:48.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.391 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.391 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:48.391 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851084+0000", 2020-11-16T20:57:48.391 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7329e-05 2020-11-16T20:57:48.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.391 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.391 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:48.392 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851131+0000", 2020-11-16T20:57:48.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014705 2020-11-16T20:57:48.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.392 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.392 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:48.392 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851278+0000", 2020-11-16T20:57:48.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064638111999999998 2020-11-16T20:57:48.393 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.393 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:48.393 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.393 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:616 3.3 3:f5f8fa2a:::smithi16641208-144:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e57)", 2020-11-16T20:57:48.393 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:57:48.393 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 88.535363451999999, 2020-11-16T20:57:48.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064784234999999996, 2020-11-16T20:57:48.394 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:48.394 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:48.394 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:48.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.395 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:48.395 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:57:48.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:48.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.395 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:48.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:57:48.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8559999999999998e-05 2020-11-16T20:57:48.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.396 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:48.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786749+0000", 2020-11-16T20:57:48.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4549999999999997e-06 2020-11-16T20:57:48.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:48.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786754+0000", 2020-11-16T20:57:48.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4980000000000006e-06 2020-11-16T20:57:48.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:48.398 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786762+0000", 2020-11-16T20:57:48.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9790000000000004e-06 2020-11-16T20:57:48.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:48.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786766+0000", 2020-11-16T20:57:48.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029976900000000002 2020-11-16T20:57:48.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787066+0000", 2020-11-16T20:57:48.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3581999999999998e-05 2020-11-16T20:57:48.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.400 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:48.400 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787100+0000", 2020-11-16T20:57:48.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.037252078000000001 2020-11-16T20:57:48.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824352+0000", 2020-11-16T20:57:48.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000124189 2020-11-16T20:57:48.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:48.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824476+0000", 2020-11-16T20:57:48.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026883987000000002 2020-11-16T20:57:48.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851360+0000", 2020-11-16T20:57:48.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6365999999999994e-05 2020-11-16T20:57:48.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.403 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:48.403 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851426+0000", 2020-11-16T20:57:48.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8771999999999996e-05 2020-11-16T20:57:48.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.404 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:48.404 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851515+0000", 2020-11-16T20:57:48.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064784234999999996 2020-11-16T20:57:48.404 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.404 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:48.404 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.405 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:617 3.3 3:f5f8fa2a:::smithi16641208-144:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e57)", 2020-11-16T20:57:48.405 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:57:48.405 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 88.535293136999996, 2020-11-16T20:57:48.405 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.069756316999999998, 2020-11-16T20:57:48.405 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:48.406 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:48.406 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:48.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.406 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:48.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:57:48.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:48.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:48.407 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:57:48.407 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3865000000000002e-05 2020-11-16T20:57:48.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:48.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786835+0000", 2020-11-16T20:57:48.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6949999999999999e-06 2020-11-16T20:57:48.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:48.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786840+0000", 2020-11-16T20:57:48.409 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3559999999999999e-06 2020-11-16T20:57:48.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.409 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.409 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:48.409 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786849+0000", 2020-11-16T20:57:48.409 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.045e-06 2020-11-16T20:57:48.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.410 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:48.410 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786854+0000", 2020-11-16T20:57:48.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026743999999999997 2020-11-16T20:57:48.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.411 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787121+0000", 2020-11-16T20:57:48.411 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8912000000000001e-05 2020-11-16T20:57:48.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:48.411 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787180+0000", 2020-11-16T20:57:48.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.042545010000000001 2020-11-16T20:57:48.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829725+0000", 2020-11-16T20:57:48.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3979000000000003e-05 2020-11-16T20:57:48.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:48.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829819+0000", 2020-11-16T20:57:48.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021745652000000001 2020-11-16T20:57:48.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.414 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851565+0000", 2020-11-16T20:57:48.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000102064 2020-11-16T20:57:48.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.414 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:48.414 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851667+0000", 2020-11-16T20:57:48.415 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048902989999999999 2020-11-16T20:57:48.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.415 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:48.415 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856557+0000", 2020-11-16T20:57:48.415 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.069756316999999998 2020-11-16T20:57:48.415 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.416 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:48.416 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.416 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:618 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'243, mlcod=57'241)", 2020-11-16T20:57:48.416 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:57:48.416 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 88.522474012999993, 2020-11-16T20:57:48.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048895281999999998, 2020-11-16T20:57:48.417 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:48.417 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:48.417 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:48.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.417 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:48.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:57:48.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:48.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:48.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:57:48.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017163861999999998 2020-11-16T20:57:48.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.419 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:48.419 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816784+0000", 2020-11-16T20:57:48.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7071e-05 2020-11-16T20:57:48.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.420 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:48.420 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816801+0000", 2020-11-16T20:57:48.420 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6405e-05 2020-11-16T20:57:48.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.420 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:48.420 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816818+0000", 2020-11-16T20:57:48.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3030999999999999e-05 2020-11-16T20:57:48.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.421 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:48.421 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816831+0000", 2020-11-16T20:57:48.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4610000000000007e-05 2020-11-16T20:57:48.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.422 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.422 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816895+0000", 2020-11-16T20:57:48.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4202999999999998e-05 2020-11-16T20:57:48.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.422 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:48.423 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816929+0000", 2020-11-16T20:57:48.423 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.031527016999999997 2020-11-16T20:57:48.423 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.423 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:48.423 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.848456+0000", 2020-11-16T20:57:48.423 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9083000000000003e-05 2020-11-16T20:57:48.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:48.424 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.848515+0000", 2020-11-16T20:57:48.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048895281999999998 2020-11-16T20:57:48.424 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.424 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:48.425 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.425 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:618 3.3 3:d775beee:::smithi16641208-10:head [copy-from ver 12] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:57:48.425 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:57:48.425 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 88.513291944000002, 2020-11-16T20:57:48.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047870862, 2020-11-16T20:57:48.426 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:48.426 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:48.426 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:48.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:48.426 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:57:48.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:48.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.427 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:48.427 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:57:48.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0958999999999999e-05 2020-11-16T20:57:48.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.428 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:48.428 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808843+0000", 2020-11-16T20:57:48.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1294000000000001e-05 2020-11-16T20:57:48.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.428 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808854+0000", 2020-11-16T20:57:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8553999999999997e-05 2020-11-16T20:57:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808893+0000", 2020-11-16T20:57:48.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1985e-05 2020-11-16T20:57:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808905+0000", 2020-11-16T20:57:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7309000000000001e-05 2020-11-16T20:57:48.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808982+0000", 2020-11-16T20:57:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016374099999999999 2020-11-16T20:57:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809146+0000", 2020-11-16T20:57:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015955815000000002 2020-11-16T20:57:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:57:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.825102+0000", 2020-11-16T20:57:48.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048434799999999998 2020-11-16T20:57:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829945+0000", 2020-11-16T20:57:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021349677000000001 2020-11-16T20:57:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851295+0000", 2020-11-16T20:57:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052994100000000001 2020-11-16T20:57:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:48.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856594+0000", 2020-11-16T20:57:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3349000000000001e-05 2020-11-16T20:57:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856638+0000", 2020-11-16T20:57:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5289e-05 2020-11-16T20:57:48.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856673+0000", 2020-11-16T20:57:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047870862 2020-11-16T20:57:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:48.436 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.437 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:619 3.3 3:d79d68cf:::smithi16641208-37:head [copy-from ver 27] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:57:48.437 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:57:48.437 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 88.512733354000005, 2020-11-16T20:57:48.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047415915000000003, 2020-11-16T20:57:48.437 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:48.438 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:48.438 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:48.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.438 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:48.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:57:48.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:48.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.439 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:48.439 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:57:48.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3012000000000002e-05 2020-11-16T20:57:48.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:48.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809394+0000", 2020-11-16T20:57:48.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1699999999999996e-06 2020-11-16T20:57:48.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:48.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809399+0000", 2020-11-16T20:57:48.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2390000000000008e-06 2020-11-16T20:57:48.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:48.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809408+0000", 2020-11-16T20:57:48.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0259999999999998e-06 2020-11-16T20:57:48.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:48.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809413+0000", 2020-11-16T20:57:48.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0359999999999996e-05 2020-11-16T20:57:48.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809494+0000", 2020-11-16T20:57:48.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019616600000000001 2020-11-16T20:57:48.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:48.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809690+0000", 2020-11-16T20:57:48.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017673003999999999 2020-11-16T20:57:48.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:57:48.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.827363+0000", 2020-11-16T20:57:48.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006463033 2020-11-16T20:57:48.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:48.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.833826+0000", 2020-11-16T20:57:48.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017479913999999999 2020-11-16T20:57:48.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:48.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851306+0000", 2020-11-16T20:57:48.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054026500000000002 2020-11-16T20:57:48.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:48.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856708+0000", 2020-11-16T20:57:48.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8121999999999999e-05 2020-11-16T20:57:48.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:48.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856747+0000", 2020-11-16T20:57:48.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0219e-05 2020-11-16T20:57:48.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:48.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856777+0000", 2020-11-16T20:57:48.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047415915000000003 2020-11-16T20:57:48.448 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.448 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:48.448 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.449 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2994 4.1 4:81514658:::smithi16641208-76:head [rollback 25] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:48.449 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:48.838310+0000", 2020-11-16T20:57:48.449 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 59.483784161000003, 2020-11-16T20:57:48.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.058717898999999997, 2020-11-16T20:57:48.449 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:48.450 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:48.450 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:48.450 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:48.450 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:48.450 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2994 2020-11-16T20:57:48.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.450 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:48.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.451 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:48.451 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838310+0000", 2020-11-16T20:57:48.451 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:48.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.451 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:48.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838310+0000", 2020-11-16T20:57:48.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6189e-05 2020-11-16T20:57:48.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:48.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838326+0000", 2020-11-16T20:57:48.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7750000000000001e-06 2020-11-16T20:57:48.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:48.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838329+0000", 2020-11-16T20:57:48.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1170000000000003e-06 2020-11-16T20:57:48.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:48.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838334+0000", 2020-11-16T20:57:48.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5509999999999998e-06 2020-11-16T20:57:48.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:48.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838337+0000", 2020-11-16T20:57:48.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4969999999999995e-05 2020-11-16T20:57:48.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838422+0000", 2020-11-16T20:57:48.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6809999999999998e-06 2020-11-16T20:57:48.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:48.456 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838429+0000", 2020-11-16T20:57:48.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0036974120000000002 2020-11-16T20:57:48.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.842127+0000", 2020-11-16T20:57:48.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7267000000000005e-05 2020-11-16T20:57:48.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:48.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.842194+0000", 2020-11-16T20:57:48.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036580992999999999 2020-11-16T20:57:48.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.878775+0000", 2020-11-16T20:57:48.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015282199999999999 2020-11-16T20:57:48.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.459 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:48.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.878928+0000", 2020-11-16T20:57:48.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025942000000000001 2020-11-16T20:57:48.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:48.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879187+0000", 2020-11-16T20:57:48.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6735000000000003e-05 2020-11-16T20:57:48.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:48.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879264+0000", 2020-11-16T20:57:48.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0079699739999999995 2020-11-16T20:57:48.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.887234+0000", 2020-11-16T20:57:48.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011584899999999999 2020-11-16T20:57:48.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:48.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.887350+0000", 2020-11-16T20:57:48.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019960799999999999 2020-11-16T20:57:48.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:57:48.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.887549+0000", 2020-11-16T20:57:48.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059496410000000003 2020-11-16T20:57:48.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.463 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893499+0000", 2020-11-16T20:57:48.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8387999999999997e-05 2020-11-16T20:57:48.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for ondisk", 2020-11-16T20:57:48.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893557+0000", 2020-11-16T20:57:48.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1730000000000005e-05 2020-11-16T20:57:48.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:48.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893639+0000", 2020-11-16T20:57:48.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0030284309999999998 2020-11-16T20:57:48.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:48.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.896668+0000", 2020-11-16T20:57:48.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024878999999999998 2020-11-16T20:57:48.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:48.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.896916+0000", 2020-11-16T20:57:48.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6546999999999998e-05 2020-11-16T20:57:48.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:48.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.896983+0000", 2020-11-16T20:57:48.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5009000000000002e-05 2020-11-16T20:57:48.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:48.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.897028+0000", 2020-11-16T20:57:48.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.058717898999999997 2020-11-16T20:57:48.468 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.468 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:48.468 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.469 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2995 4.1 4:81514658:::smithi16641208-76:head [append 0~0] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:48.469 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:48.838353+0000", 2020-11-16T20:57:48.469 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 59.483740900999997, 2020-11-16T20:57:48.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.061235559000000002, 2020-11-16T20:57:48.469 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:48.469 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:48.469 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:48.470 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:48.470 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:48.470 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2995 2020-11-16T20:57:48.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.470 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:48.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:48.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838353+0000", 2020-11-16T20:57:48.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:48.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:48.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838353+0000", 2020-11-16T20:57:48.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5333e-05 2020-11-16T20:57:48.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.472 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.472 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:48.472 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838369+0000", 2020-11-16T20:57:48.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6699999999999998e-06 2020-11-16T20:57:48.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.473 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.473 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:48.473 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838371+0000", 2020-11-16T20:57:48.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9450000000000001e-06 2020-11-16T20:57:48.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.473 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.473 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:48.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838376+0000", 2020-11-16T20:57:48.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3810000000000002e-06 2020-11-16T20:57:48.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:48.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838379+0000", 2020-11-16T20:57:48.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6501000000000006e-05 2020-11-16T20:57:48.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.475 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.475 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838445+0000", 2020-11-16T20:57:48.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7589999999999999e-06 2020-11-16T20:57:48.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:48.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838449+0000", 2020-11-16T20:57:48.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003788249 2020-11-16T20:57:48.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.842237+0000", 2020-11-16T20:57:48.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4104999999999997e-05 2020-11-16T20:57:48.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.477 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:48.477 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.842301+0000", 2020-11-16T20:57:48.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.037139272000000001 2020-11-16T20:57:48.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.478 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.478 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879440+0000", 2020-11-16T20:57:48.478 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3401e-05 2020-11-16T20:57:48.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:48.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879484+0000", 2020-11-16T20:57:48.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014179615 2020-11-16T20:57:48.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893664+0000", 2020-11-16T20:57:48.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6710000000000002e-05 2020-11-16T20:57:48.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:48.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893750+0000", 2020-11-16T20:57:48.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015452900000000001 2020-11-16T20:57:48.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:57:48.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893905+0000", 2020-11-16T20:57:48.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0013753280000000001 2020-11-16T20:57:48.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:48.482 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.895280+0000", 2020-11-16T20:57:48.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014309889999999999 2020-11-16T20:57:48.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.482 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:48.482 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.896711+0000", 2020-11-16T20:57:48.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0027635649999999999 2020-11-16T20:57:48.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.483 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:48.483 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.899475+0000", 2020-11-16T20:57:48.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3380999999999997e-05 2020-11-16T20:57:48.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:48.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.899518+0000", 2020-11-16T20:57:48.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0826000000000003e-05 2020-11-16T20:57:48.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:48.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.899589+0000", 2020-11-16T20:57:48.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.061235559000000002 2020-11-16T20:57:48.485 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.485 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:48.485 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.485 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3414 3.3 3:cf270c70:::smithi16641208-423:head [copy-from ver 586] snapc 4f=[4f,48] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e120)", 2020-11-16T20:57:48.486 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:24.761756+0000", 2020-11-16T20:57:48.486 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.560338054999999, 2020-11-16T20:57:48.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.053488604000000002, 2020-11-16T20:57:48.486 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:48.486 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:48.486 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:48.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.487 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:48.487 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761756+0000", 2020-11-16T20:57:48.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:48.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.487 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:48.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761756+0000", 2020-11-16T20:57:48.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5970000000000006e-05 2020-11-16T20:57:48.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:48.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761832+0000", 2020-11-16T20:57:48.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4884e-05 2020-11-16T20:57:48.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:48.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761847+0000", 2020-11-16T20:57:48.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6169999999999998e-05 2020-11-16T20:57:48.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:48.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761873+0000", 2020-11-16T20:57:48.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5098e-05 2020-11-16T20:57:48.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:48.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761888+0000", 2020-11-16T20:57:48.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6729000000000003e-05 2020-11-16T20:57:48.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.491 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.491 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761965+0000", 2020-11-16T20:57:48.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0786e-05 2020-11-16T20:57:48.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.492 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.492 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2020-11-16T20:57:48.492 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761976+0000", 2020-11-16T20:57:48.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011800241 2020-11-16T20:57:48.492 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.492 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.492 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.773776+0000", 2020-11-16T20:57:48.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000228559 2020-11-16T20:57:48.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:48.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.774005+0000", 2020-11-16T20:57:48.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020761585999999999 2020-11-16T20:57:48.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:57:48.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.794766+0000", 2020-11-16T20:57:48.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013313459 2020-11-16T20:57:48.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.495 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:48.495 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.808080+0000", 2020-11-16T20:57:48.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0063703730000000004 2020-11-16T20:57:48.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.495 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:48.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.814450+0000", 2020-11-16T20:57:48.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00063777099999999998 2020-11-16T20:57:48.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.496 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:48.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.815088+0000", 2020-11-16T20:57:48.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4383999999999998e-05 2020-11-16T20:57:48.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:48.497 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.815162+0000", 2020-11-16T20:57:48.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2594000000000002e-05 2020-11-16T20:57:48.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:48.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.815245+0000", 2020-11-16T20:57:48.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.053488604000000002 2020-11-16T20:57:48.498 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.498 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:48.498 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.499 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.1.13:756 3.3 3:cf270c70:::smithi16641208-423:head [stat] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+known_if_redirected e120)", 2020-11-16T20:57:48.499 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:24.761953+0000", 2020-11-16T20:57:48.499 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.560141057999999, 2020-11-16T20:57:48.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.053471185999999997, 2020-11-16T20:57:48.499 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:48.499 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:48.500 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:48.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:48.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761953+0000", 2020-11-16T20:57:48.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:48.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:48.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761953+0000", 2020-11-16T20:57:48.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9965000000000001e-05 2020-11-16T20:57:48.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:48.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761993+0000", 2020-11-16T20:57:48.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2689999999999999e-06 2020-11-16T20:57:48.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:48.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762001+0000", 2020-11-16T20:57:48.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0395999999999999e-05 2020-11-16T20:57:48.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:48.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762022+0000", 2020-11-16T20:57:48.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0159000000000001e-05 2020-11-16T20:57:48.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:48.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762042+0000", 2020-11-16T20:57:48.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6938000000000002e-05 2020-11-16T20:57:48.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762109+0000", 2020-11-16T20:57:48.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1065e-05 2020-11-16T20:57:48.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:48.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762120+0000", 2020-11-16T20:57:48.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012140096 2020-11-16T20:57:48.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.774260+0000", 2020-11-16T20:57:48.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6675999999999997e-05 2020-11-16T20:57:48.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:48.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.774327+0000", 2020-11-16T20:57:48.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029616773999999998 2020-11-16T20:57:48.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.803943+0000", 2020-11-16T20:57:48.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9145e-05 2020-11-16T20:57:48.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.508 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:48.508 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.804043+0000", 2020-11-16T20:57:48.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011230571 2020-11-16T20:57:48.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.815273+0000", 2020-11-16T20:57:48.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7762999999999995e-05 2020-11-16T20:57:48.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:48.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.815341+0000", 2020-11-16T20:57:48.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3368999999999994e-05 2020-11-16T20:57:48.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:48.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.815424+0000", 2020-11-16T20:57:48.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.053471185999999997 2020-11-16T20:57:48.511 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.511 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:48.511 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.511 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.1.13:757 3.3 3:f6d44bd7:::smithi16641208-454:head [copy-from ver 347] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e120)", 2020-11-16T20:57:48.511 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:24.762096+0000", 2020-11-16T20:57:48.512 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 23.559998431, 2020-11-16T20:57:48.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054426929999999998, 2020-11-16T20:57:48.512 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:48.512 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:48.512 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:48.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.512 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:48.513 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762096+0000", 2020-11-16T20:57:48.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:48.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.513 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:48.513 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762096+0000", 2020-11-16T20:57:48.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1792000000000002e-05 2020-11-16T20:57:48.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.514 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:48.514 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762148+0000", 2020-11-16T20:57:48.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7875000000000001e-05 2020-11-16T20:57:48.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:48.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762165+0000", 2020-11-16T20:57:48.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8303000000000001e-05 2020-11-16T20:57:48.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:48.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762184+0000", 2020-11-16T20:57:48.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.499e-06 2020-11-16T20:57:48.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:48.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762193+0000", 2020-11-16T20:57:48.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6016999999999997e-05 2020-11-16T20:57:48.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.517 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.517 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762239+0000", 2020-11-16T20:57:48.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5139e-05 2020-11-16T20:57:48.517 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.517 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:48.518 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762254+0000", 2020-11-16T20:57:48.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01212732 2020-11-16T20:57:48.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.518 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.774382+0000", 2020-11-16T20:57:48.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000163406 2020-11-16T20:57:48.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:48.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.774545+0000", 2020-11-16T20:57:48.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.025303895 2020-11-16T20:57:48.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:57:48.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.799849+0000", 2020-11-16T20:57:48.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011849052000000001 2020-11-16T20:57:48.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:48.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.811698+0000", 2020-11-16T20:57:48.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0042176150000000001 2020-11-16T20:57:48.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:48.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.815916+0000", 2020-11-16T20:57:48.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00050456899999999996 2020-11-16T20:57:48.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.522 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:48.522 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.816420+0000", 2020-11-16T20:57:48.522 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8441000000000004e-05 2020-11-16T20:57:48.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:48.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.816489+0000", 2020-11-16T20:57:48.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4007000000000002e-05 2020-11-16T20:57:48.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:48.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.816523+0000", 2020-11-16T20:57:48.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054426929999999998 2020-11-16T20:57:48.524 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.524 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:48.524 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.524 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.524 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3532 4.1 4:b7adb356:::smithi16641208-217:head [copy-from ver 367] snapc 55=[55,54] ondisk+write+known_if_redirected e130)", 2020-11-16T20:57:48.525 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:34.748337+0000", 2020-11-16T20:57:48.525 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.573757519999999, 2020-11-16T20:57:48.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.052818308000000001, 2020-11-16T20:57:48.525 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:48.525 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:48.525 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:48.525 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:48.526 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:48.526 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3532 2020-11-16T20:57:48.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.526 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:48.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.526 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:48.526 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748337+0000", 2020-11-16T20:57:48.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:48.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:48.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748337+0000", 2020-11-16T20:57:48.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6903999999999997e-05 2020-11-16T20:57:48.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:48.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748384+0000", 2020-11-16T20:57:48.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5290000000000008e-06 2020-11-16T20:57:48.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:48.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748392+0000", 2020-11-16T20:57:48.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4324999999999999e-05 2020-11-16T20:57:48.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:48.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748406+0000", 2020-11-16T20:57:48.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0919999999999998e-06 2020-11-16T20:57:48.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.530 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:48.530 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748415+0000", 2020-11-16T20:57:48.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0488000000000001e-05 2020-11-16T20:57:48.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.531 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748475+0000", 2020-11-16T20:57:48.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1545999999999999e-05 2020-11-16T20:57:48.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2020-11-16T20:57:48.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748487+0000", 2020-11-16T20:57:48.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045843469999999999 2020-11-16T20:57:48.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.753071+0000", 2020-11-16T20:57:48.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048079260999999998 2020-11-16T20:57:48.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:48.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.801150+0000", 2020-11-16T20:57:48.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8160000000000001e-06 2020-11-16T20:57:48.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:48.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.801155+0000", 2020-11-16T20:57:48.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.052818308000000001 2020-11-16T20:57:48.534 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.534 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:48.534 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.535 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3533 4.1 4:b7adb356:::smithi16641208-217:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e130)", 2020-11-16T20:57:48.535 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:34.748456+0000", 2020-11-16T20:57:48.535 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.573637925, 2020-11-16T20:57:48.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.068028942999999995, 2020-11-16T20:57:48.535 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:48.536 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:48.536 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:48.536 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:48.536 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:48.536 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3533 2020-11-16T20:57:48.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.536 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:48.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:48.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748456+0000", 2020-11-16T20:57:48.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:48.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:48.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748456+0000", 2020-11-16T20:57:48.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3272000000000003e-05 2020-11-16T20:57:48.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.538 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:48.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748490+0000", 2020-11-16T20:57:48.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8499999999999999e-06 2020-11-16T20:57:48.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.539 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:48.539 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748495+0000", 2020-11-16T20:57:48.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.188e-05 2020-11-16T20:57:48.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:48.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748507+0000", 2020-11-16T20:57:48.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6810000000000003e-06 2020-11-16T20:57:48.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:48.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748513+0000", 2020-11-16T20:57:48.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2339999999999998e-05 2020-11-16T20:57:48.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748555+0000", 2020-11-16T20:57:48.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2700000000000004e-06 2020-11-16T20:57:48.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:48.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748564+0000", 2020-11-16T20:57:48.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004936607 2020-11-16T20:57:48.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.543 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.753500+0000", 2020-11-16T20:57:48.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5847999999999998e-05 2020-11-16T20:57:48.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.543 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:48.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.753556+0000", 2020-11-16T20:57:48.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056272167999999997 2020-11-16T20:57:48.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.809828+0000", 2020-11-16T20:57:48.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000131536 2020-11-16T20:57:48.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.545 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:48.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.809960+0000", 2020-11-16T20:57:48.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0063663030000000002 2020-11-16T20:57:48.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.816326+0000", 2020-11-16T20:57:48.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1303000000000004e-05 2020-11-16T20:57:48.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:48.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.816407+0000", 2020-11-16T20:57:48.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7885000000000004e-05 2020-11-16T20:57:48.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:48.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.816485+0000", 2020-11-16T20:57:48.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.068028942999999995 2020-11-16T20:57:48.548 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.548 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:48.548 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.548 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3535 4.1 4:b803c1f1:::smithi16641208-291:head [rollback 55] snapc 55=[55,54] ondisk+write+known_if_redirected e130)", 2020-11-16T20:57:48.548 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:34.748646+0000", 2020-11-16T20:57:48.549 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.573448368999999, 2020-11-16T20:57:48.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.052434296999999998, 2020-11-16T20:57:48.549 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:48.549 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:48.549 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:48.549 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:48.549 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:48.550 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3535 2020-11-16T20:57:48.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.550 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:48.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:48.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748646+0000", 2020-11-16T20:57:48.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:48.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:48.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748646+0000", 2020-11-16T20:57:48.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4683000000000001e-05 2020-11-16T20:57:48.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.552 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:48.552 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748670+0000", 2020-11-16T20:57:48.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7220000000000002e-06 2020-11-16T20:57:48.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:48.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748677+0000", 2020-11-16T20:57:48.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8769999999999993e-06 2020-11-16T20:57:48.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:48.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748685+0000", 2020-11-16T20:57:48.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2120000000000002e-06 2020-11-16T20:57:48.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:48.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748690+0000", 2020-11-16T20:57:48.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4085000000000003e-05 2020-11-16T20:57:48.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748724+0000", 2020-11-16T20:57:48.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3529999999999995e-06 2020-11-16T20:57:48.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:48.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748733+0000", 2020-11-16T20:57:48.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052195999999999996 2020-11-16T20:57:48.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.556 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.753952+0000", 2020-11-16T20:57:48.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9178000000000003e-05 2020-11-16T20:57:48.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:48.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.753992+0000", 2020-11-16T20:57:48.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022619554 2020-11-16T20:57:48.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.776611+0000", 2020-11-16T20:57:48.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000185613 2020-11-16T20:57:48.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:48.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.776797+0000", 2020-11-16T20:57:48.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00033552199999999999 2020-11-16T20:57:48.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:48.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.777132+0000", 2020-11-16T20:57:48.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8034000000000001e-05 2020-11-16T20:57:48.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.560 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:48.560 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.777180+0000", 2020-11-16T20:57:48.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0075869199999999996 2020-11-16T20:57:48.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.784767+0000", 2020-11-16T20:57:48.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000104366 2020-11-16T20:57:48.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:48.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.784872+0000", 2020-11-16T20:57:48.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018961 2020-11-16T20:57:48.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:57:48.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.785061+0000", 2020-11-16T20:57:48.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056996800000000004 2020-11-16T20:57:48.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.790761+0000", 2020-11-16T20:57:48.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6718999999999995e-05 2020-11-16T20:57:48.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for ondisk", 2020-11-16T20:57:48.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.790838+0000", 2020-11-16T20:57:48.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002494029 2020-11-16T20:57:48.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:48.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.793332+0000", 2020-11-16T20:57:48.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00038463800000000003 2020-11-16T20:57:48.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:48.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.793716+0000", 2020-11-16T20:57:48.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072152859999999996 2020-11-16T20:57:48.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:48.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.800931+0000", 2020-11-16T20:57:48.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4564e-05 2020-11-16T20:57:48.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:48.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.801006+0000", 2020-11-16T20:57:48.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4052000000000002e-05 2020-11-16T20:57:48.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:48.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.801080+0000", 2020-11-16T20:57:48.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.052434296999999998 2020-11-16T20:57:48.568 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.568 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:48.568 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.568 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3536 4.1 4:b803c1f1:::smithi16641208-291:head [append 0~0] snapc 55=[55,54] ondisk+write+known_if_redirected e130)", 2020-11-16T20:57:48.568 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:34.748726+0000", 2020-11-16T20:57:48.569 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.573367909, 2020-11-16T20:57:48.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.052564835999999997, 2020-11-16T20:57:48.569 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:48.569 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:48.569 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:48.569 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:48.569 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:48.570 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3536 2020-11-16T20:57:48.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.570 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:48.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:48.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748726+0000", 2020-11-16T20:57:48.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:48.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.571 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:48.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748726+0000", 2020-11-16T20:57:48.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1303999999999997e-05 2020-11-16T20:57:48.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:48.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748758+0000", 2020-11-16T20:57:48.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4749999999999998e-06 2020-11-16T20:57:48.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:48.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748764+0000", 2020-11-16T20:57:48.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1039999999999999e-05 2020-11-16T20:57:48.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:48.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748775+0000", 2020-11-16T20:57:48.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0326000000000001e-05 2020-11-16T20:57:48.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:48.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748785+0000", 2020-11-16T20:57:48.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5252000000000003e-05 2020-11-16T20:57:48.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748871+0000", 2020-11-16T20:57:48.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6369999999999999e-06 2020-11-16T20:57:48.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:48.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748878+0000", 2020-11-16T20:57:48.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.005142509 2020-11-16T20:57:48.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.754021+0000", 2020-11-16T20:57:48.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9263000000000001e-05 2020-11-16T20:57:48.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:48.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.754050+0000", 2020-11-16T20:57:48.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023184664000000001 2020-11-16T20:57:48.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.777235+0000", 2020-11-16T20:57:48.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0120999999999998e-05 2020-11-16T20:57:48.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:48.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.777265+0000", 2020-11-16T20:57:48.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013605528 2020-11-16T20:57:48.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:48.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.790870+0000", 2020-11-16T20:57:48.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000135308 2020-11-16T20:57:48.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:48.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.791006+0000", 2020-11-16T20:57:48.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00021127799999999999 2020-11-16T20:57:48.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:57:48.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.791217+0000", 2020-11-16T20:57:48.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0024643 2020-11-16T20:57:48.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:48.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.793681+0000", 2020-11-16T20:57:48.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1199000000000003e-05 2020-11-16T20:57:48.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:48.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.793722+0000", 2020-11-16T20:57:48.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074752639999999997 2020-11-16T20:57:48.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:48.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.801198+0000", 2020-11-16T20:57:48.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3113000000000004e-05 2020-11-16T20:57:48.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:48.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.801261+0000", 2020-11-16T20:57:48.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0255000000000001e-05 2020-11-16T20:57:48.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:48.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:48.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:48.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.801291+0000", 2020-11-16T20:57:48.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.052564835999999997 2020-11-16T20:57:48.584 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.585 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:48.585 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.585 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:48.585 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:48.585 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:48.587 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:48.592+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:48.587 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:57:48.687 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:48.692+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:48.725 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:48.725 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:57:48.725 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:57:48.726 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:48.735 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:57:48.779 INFO:tasks.rados.rados.0.smithi166.stdout:1171: done (3 left) 2020-11-16T20:57:48.779 INFO:tasks.rados.rados.0.smithi166.stdout:1172: read oid 127 snap -1 2020-11-16T20:57:48.779 INFO:tasks.rados.rados.0.smithi166.stdout:1172: expect (ObjNum 556 snap 16 seq_num 556) 2020-11-16T20:57:48.780 INFO:tasks.rados.rados.0.smithi166.stdout:1173: read oid 408 snap 48 2020-11-16T20:57:48.780 INFO:tasks.rados.rados.0.smithi166.stdout:1173: expect (ObjNum 407 snap 0 seq_num 407) 2020-11-16T20:57:48.780 INFO:tasks.rados.rados.0.smithi166.stdout:1174: write (excl) oid 380 current snap is 52 2020-11-16T20:57:48.780 INFO:tasks.rados.rados.0.smithi166.stdout:1174: seq_num 677 ranges {578339=498990,1833133=525896,2791719=586620} 2020-11-16T20:57:48.785 INFO:tasks.rados.rados.0.smithi166.stdout:1174: writing smithi16641208-380 from 578339 to 1077329 tid 1 2020-11-16T20:57:48.786 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2020-11-16T20:57:48.789 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:48.793+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:48.793 INFO:tasks.rados.rados.0.smithi166.stdout:1174: writing smithi16641208-380 from 1833133 to 2359029 tid 2 2020-11-16T20:57:48.799 INFO:tasks.rados.rados.0.smithi166.stdout:1174: writing smithi16641208-380 from 2791719 to 3378339 tid 3 2020-11-16T20:57:48.799 INFO:tasks.rados.rados.0.smithi166.stdout:1175: snap_remove snap 50 2020-11-16T20:57:48.879 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:48.880 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:57:48.880 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:57:48.880 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:57:48.880 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:48.889 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:57:48.889 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:48.893+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:48.990 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:57:48.994+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:57:49.065 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:49.066 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:57:49.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:57:49.066 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:57:49.066 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.066 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:538 4.3 e41/22 4:c9160c9c:::smithi16641208-411:head v 41'95, mlcod=37'93)", 2020-11-16T20:57:49.067 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:57:49.067 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 104.943259162, 2020-11-16T20:57:49.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021023377999999999, 2020-11-16T20:57:49.067 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:49.067 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:49.067 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:49.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.068 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:49.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:57:49.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:49.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.068 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:49.069 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:57:49.069 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052206140000000002 2020-11-16T20:57:49.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.069 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:49.069 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130866+0000", 2020-11-16T20:57:49.069 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0824e-05 2020-11-16T20:57:49.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.070 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.070 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:49.070 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130877+0000", 2020-11-16T20:57:49.070 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5384e-05 2020-11-16T20:57:49.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.070 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.071 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:49.071 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130893+0000", 2020-11-16T20:57:49.071 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0064999999999999e-05 2020-11-16T20:57:49.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.071 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:49.071 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130903+0000", 2020-11-16T20:57:49.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3051000000000003e-05 2020-11-16T20:57:49.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.072 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.072 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130966+0000", 2020-11-16T20:57:49.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9724e-05 2020-11-16T20:57:49.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.073 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:49.073 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130985+0000", 2020-11-16T20:57:49.073 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015638332000000001 2020-11-16T20:57:49.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.073 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:49.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.146624+0000", 2020-11-16T20:57:49.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5383999999999998e-05 2020-11-16T20:57:49.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:49.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.146669+0000", 2020-11-16T20:57:49.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021023377999999999 2020-11-16T20:57:49.075 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.075 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:49.075 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.075 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2367 4.2 e42/22 4:581c1e5b:::smithi16641208-124:head v 42'136, mlcod=42'133)", 2020-11-16T20:57:49.075 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:57:49.076 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 104.015560784, 2020-11-16T20:57:49.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021196474999999999, 2020-11-16T20:57:49.076 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:49.076 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:49.076 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:49.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.076 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:49.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:57:49.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:49.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:49.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:57:49.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070663000000000002 2020-11-16T20:57:49.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.078 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:49.078 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060411+0000", 2020-11-16T20:57:49.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0189999999999995e-06 2020-11-16T20:57:49.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:49.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060420+0000", 2020-11-16T20:57:49.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0069e-05 2020-11-16T20:57:49.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:49.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060430+0000", 2020-11-16T20:57:49.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6879999999999999e-06 2020-11-16T20:57:49.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.080 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:49.080 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060437+0000", 2020-11-16T20:57:49.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3671999999999995e-05 2020-11-16T20:57:49.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.081 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.081 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060511+0000", 2020-11-16T20:57:49.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6801999999999998e-05 2020-11-16T20:57:49.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.081 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:49.081 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060548+0000", 2020-11-16T20:57:49.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013927701000000001 2020-11-16T20:57:49.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:49.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074475+0000", 2020-11-16T20:57:49.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5223999999999998e-05 2020-11-16T20:57:49.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:49.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074541+0000", 2020-11-16T20:57:49.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021196474999999999 2020-11-16T20:57:49.083 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.083 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:49.083 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.084 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:554 3.2 e42/19 3:769099fd:::smithi16641208-247:head v 42'386, mlcod=42'384)", 2020-11-16T20:57:49.084 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:57:49.084 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 103.998641811, 2020-11-16T20:57:49.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029531213000000001, 2020-11-16T20:57:49.084 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:49.084 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:49.085 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:49.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.085 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:49.085 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:57:49.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:49.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:49.086 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:57:49.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007828448 2020-11-16T20:57:49.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:49.086 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078092+0000", 2020-11-16T20:57:49.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2031000000000001e-05 2020-11-16T20:57:49.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.087 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:49.087 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078104+0000", 2020-11-16T20:57:49.087 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3950000000000001e-06 2020-11-16T20:57:49.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:49.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078112+0000", 2020-11-16T20:57:49.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.434e-06 2020-11-16T20:57:49.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:49.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078117+0000", 2020-11-16T20:57:49.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0217999999999999e-05 2020-11-16T20:57:49.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.089 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.089 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.089 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078168+0000", 2020-11-16T20:57:49.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6242e-05 2020-11-16T20:57:49.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.089 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.090 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:49.090 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078194+0000", 2020-11-16T20:57:49.090 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021550488 2020-11-16T20:57:49.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.090 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.090 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:49.090 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099744+0000", 2020-11-16T20:57:49.091 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9957000000000003e-05 2020-11-16T20:57:49.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.091 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.091 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:49.091 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099794+0000", 2020-11-16T20:57:49.091 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029531213000000001 2020-11-16T20:57:49.091 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.092 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:49.092 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.092 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.092 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:555 3.2 e42/19 3:590e6edd:::smithi16641208-203:head v 42'387, mlcod=42'384)", 2020-11-16T20:57:49.092 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:57:49.092 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 103.990760967, 2020-11-16T20:57:49.092 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021681786000000002, 2020-11-16T20:57:49.093 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:49.093 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:49.093 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:49.093 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.093 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:49.093 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:57:49.093 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:49.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.094 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.094 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:49.094 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:57:49.094 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6817999999999998e-05 2020-11-16T20:57:49.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.094 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.095 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:49.095 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078191+0000", 2020-11-16T20:57:49.095 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7800000000000003e-06 2020-11-16T20:57:49.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.095 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.095 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:49.096 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078198+0000", 2020-11-16T20:57:49.096 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0331e-05 2020-11-16T20:57:49.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.096 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.096 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:49.096 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078208+0000", 2020-11-16T20:57:49.096 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8429999999999998e-06 2020-11-16T20:57:49.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.097 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.097 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:49.097 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078214+0000", 2020-11-16T20:57:49.097 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0025044690000000001 2020-11-16T20:57:49.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.097 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.098 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.098 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080718+0000", 2020-11-16T20:57:49.098 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027441100000000001 2020-11-16T20:57:49.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.098 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.098 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:49.098 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080993+0000", 2020-11-16T20:57:49.098 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018806976999999999 2020-11-16T20:57:49.099 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.099 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.099 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:49.099 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099800+0000", 2020-11-16T20:57:49.099 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6157e-05 2020-11-16T20:57:49.099 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.099 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.100 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:49.100 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099826+0000", 2020-11-16T20:57:49.100 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021681786000000002 2020-11-16T20:57:49.100 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.100 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:49.100 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.101 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:485 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'94, mlcod=41'92)", 2020-11-16T20:57:49.101 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:57:49.101 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 103.99019199999999, 2020-11-16T20:57:49.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021768460999999999, 2020-11-16T20:57:49.101 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:49.101 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:49.101 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:49.102 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.102 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:49.102 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:57:49.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:49.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.102 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.102 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:49.103 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:57:49.103 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001603103 2020-11-16T20:57:49.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.103 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:49.103 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080316+0000", 2020-11-16T20:57:49.103 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4956e-05 2020-11-16T20:57:49.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:49.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080331+0000", 2020-11-16T20:57:49.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6291e-05 2020-11-16T20:57:49.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:49.105 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080347+0000", 2020-11-16T20:57:49.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3090000000000001e-06 2020-11-16T20:57:49.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.105 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:49.105 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080357+0000", 2020-11-16T20:57:49.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7073000000000001e-05 2020-11-16T20:57:49.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.106 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.106 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.106 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080414+0000", 2020-11-16T20:57:49.106 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5877e-05 2020-11-16T20:57:49.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.106 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.107 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:49.107 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080440+0000", 2020-11-16T20:57:49.107 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019927006000000001 2020-11-16T20:57:49.107 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.107 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.107 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:49.107 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100367+0000", 2020-11-16T20:57:49.107 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114846 2020-11-16T20:57:49.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.108 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.108 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:49.108 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100481+0000", 2020-11-16T20:57:49.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021768460999999999 2020-11-16T20:57:49.108 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.108 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:49.109 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.109 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.109 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:663 4.3 e57/22 4:f65e82cb:::smithi16641208-219:head v 57'179, mlcod=57'176)", 2020-11-16T20:57:49.109 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:57:49.109 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 89.272076929999997, 2020-11-16T20:57:49.109 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022540092000000001, 2020-11-16T20:57:49.110 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:49.110 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:49.110 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:49.110 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.110 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:49.110 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:57:49.110 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:49.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.111 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.111 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:49.111 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:57:49.111 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013414394 2020-11-16T20:57:49.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.111 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.111 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:49.112 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810242+0000", 2020-11-16T20:57:49.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1864e-05 2020-11-16T20:57:49.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.112 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.112 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:49.112 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810254+0000", 2020-11-16T20:57:49.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3716e-05 2020-11-16T20:57:49.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:49.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810268+0000", 2020-11-16T20:57:49.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.064e-06 2020-11-16T20:57:49.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:49.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810277+0000", 2020-11-16T20:57:49.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0560999999999998e-05 2020-11-16T20:57:49.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.114 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810338+0000", 2020-11-16T20:57:49.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7523999999999999e-05 2020-11-16T20:57:49.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.115 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.115 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:49.115 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810365+0000", 2020-11-16T20:57:49.115 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089020890000000002 2020-11-16T20:57:49.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.115 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:49.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819267+0000", 2020-11-16T20:57:49.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010088 2020-11-16T20:57:49.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.116 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:49.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819368+0000", 2020-11-16T20:57:49.117 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022540092000000001 2020-11-16T20:57:49.117 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.117 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:49.117 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.117 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.117 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.117 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:618 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'243, mlcod=57'241)", 2020-11-16T20:57:49.117 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:57:49.118 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 89.268570854999993, 2020-11-16T20:57:49.118 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049183098000000001, 2020-11-16T20:57:49.118 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:49.118 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:49.118 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:49.118 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.118 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:49.119 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:57:49.119 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:49.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.119 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:49.119 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:57:49.119 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019114651 2020-11-16T20:57:49.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:49.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819449+0000", 2020-11-16T20:57:49.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.398e-05 2020-11-16T20:57:49.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:49.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819463+0000", 2020-11-16T20:57:49.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1139e-05 2020-11-16T20:57:49.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:49.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819474+0000", 2020-11-16T20:57:49.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1860000000000003e-06 2020-11-16T20:57:49.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.122 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:49.122 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819481+0000", 2020-11-16T20:57:49.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015472700000000001 2020-11-16T20:57:49.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.123 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.123 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819636+0000", 2020-11-16T20:57:49.123 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9632e-05 2020-11-16T20:57:49.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.123 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.123 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:49.123 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819665+0000", 2020-11-16T20:57:49.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029788289999999999 2020-11-16T20:57:49.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.124 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:49.124 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849454+0000", 2020-11-16T20:57:49.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3492999999999997e-05 2020-11-16T20:57:49.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:49.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849517+0000", 2020-11-16T20:57:49.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049183098000000001 2020-11-16T20:57:49.125 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.125 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:49.125 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.126 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:609 3.2 e57/19 3:5eead97c:::smithi16641208-34:head v 57'498, mlcod=57'495)", 2020-11-16T20:57:49.126 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:57:49.126 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 89.258291356000001, 2020-11-16T20:57:49.126 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039221579999999999, 2020-11-16T20:57:49.126 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:49.126 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:49.127 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:49.127 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.127 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:49.127 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:57:49.127 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:49.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.127 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.127 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:49.128 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:57:49.128 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008889859 2020-11-16T20:57:49.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.128 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.128 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:49.128 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819503+0000", 2020-11-16T20:57:49.128 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0149000000000001e-05 2020-11-16T20:57:49.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:49.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819514+0000", 2020-11-16T20:57:49.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1049999999999999e-05 2020-11-16T20:57:49.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:49.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819525+0000", 2020-11-16T20:57:49.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4829999999999999e-06 2020-11-16T20:57:49.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:49.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819533+0000", 2020-11-16T20:57:49.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031805760000000001 2020-11-16T20:57:49.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.131 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.131 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.131 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822714+0000", 2020-11-16T20:57:49.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0954000000000002e-05 2020-11-16T20:57:49.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.131 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:49.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822745+0000", 2020-11-16T20:57:49.132 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027044038999999999 2020-11-16T20:57:49.132 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:49.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849789+0000", 2020-11-16T20:57:49.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6470000000000001e-05 2020-11-16T20:57:49.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:49.133 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849835+0000", 2020-11-16T20:57:49.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039221579999999999 2020-11-16T20:57:49.133 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.133 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:49.134 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.134 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2583 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'244, mlcod=57'241)", 2020-11-16T20:57:49.134 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:57:49.134 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 89.249373821000006, 2020-11-16T20:57:49.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030101836999999999, 2020-11-16T20:57:49.135 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:49.135 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:49.135 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:49.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.135 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:49.135 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:57:49.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:49.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:49.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:57:49.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3781e-05 2020-11-16T20:57:49.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.137 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:49.137 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819575+0000", 2020-11-16T20:57:49.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3355e-05 2020-11-16T20:57:49.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.137 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.137 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:49.137 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819588+0000", 2020-11-16T20:57:49.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8198e-05 2020-11-16T20:57:49.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:49.138 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819657+0000", 2020-11-16T20:57:49.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5849999999999999e-05 2020-11-16T20:57:49.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:49.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819672+0000", 2020-11-16T20:57:49.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003042473 2020-11-16T20:57:49.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822715+0000", 2020-11-16T20:57:49.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9779999999999999e-05 2020-11-16T20:57:49.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:49.140 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822745+0000", 2020-11-16T20:57:49.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026828521000000001 2020-11-16T20:57:49.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:49.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849573+0000", 2020-11-16T20:57:49.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9879e-05 2020-11-16T20:57:49.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:49.142 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849633+0000", 2020-11-16T20:57:49.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030101836999999999 2020-11-16T20:57:49.142 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.142 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:49.142 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.142 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3495 4.2 4:7e155756:::smithi16641208-255:head [write 1744696~590883] snapc 55=[55,54,53,52] ondisk+write+known_if_redirected e128)", 2020-11-16T20:57:49.143 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:32.932748+0000", 2020-11-16T20:57:49.143 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.136156561, 2020-11-16T20:57:49.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026656984000000002, 2020-11-16T20:57:49.143 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:49.143 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:49.143 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:49.143 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:49.144 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:49.144 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3495 2020-11-16T20:57:49.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.144 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:49.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:49.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.932748+0000", 2020-11-16T20:57:49.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:49.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.145 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:49.145 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.932748+0000", 2020-11-16T20:57:49.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00053288900000000004 2020-11-16T20:57:49.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.146 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:49.146 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.933281+0000", 2020-11-16T20:57:49.146 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.14e-06 2020-11-16T20:57:49.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.146 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.146 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:49.146 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.933289+0000", 2020-11-16T20:57:49.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6081000000000001e-05 2020-11-16T20:57:49.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.147 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:49.147 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.933306+0000", 2020-11-16T20:57:49.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9020000000000005e-06 2020-11-16T20:57:49.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.148 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:49.148 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.933314+0000", 2020-11-16T20:57:49.148 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9695999999999999e-05 2020-11-16T20:57:49.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.148 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.148 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.933374+0000", 2020-11-16T20:57:49.149 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0871000000000005e-05 2020-11-16T20:57:49.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.149 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:49.149 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.933465+0000", 2020-11-16T20:57:49.149 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015534772000000001 2020-11-16T20:57:49.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.150 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.150 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.150 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.949000+0000", 2020-11-16T20:57:49.150 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00020149499999999999 2020-11-16T20:57:49.150 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.150 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.150 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:49.151 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.949201+0000", 2020-11-16T20:57:49.151 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024771899999999998 2020-11-16T20:57:49.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.151 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.151 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,4", 2020-11-16T20:57:49.151 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.949449+0000", 2020-11-16T20:57:49.151 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0035366379999999999 2020-11-16T20:57:49.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.152 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.152 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:49.152 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.952986+0000", 2020-11-16T20:57:49.152 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0026778399999999999 2020-11-16T20:57:49.152 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.152 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.152 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:49.153 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.955663+0000", 2020-11-16T20:57:49.153 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0036202550000000002 2020-11-16T20:57:49.153 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.153 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.153 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:49.153 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.959284+0000", 2020-11-16T20:57:49.153 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7249000000000006e-05 2020-11-16T20:57:49.154 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.154 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.154 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:49.154 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.959351+0000", 2020-11-16T20:57:49.154 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4437000000000001e-05 2020-11-16T20:57:49.154 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.154 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.155 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:49.155 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.959405+0000", 2020-11-16T20:57:49.155 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026656984000000002 2020-11-16T20:57:49.155 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.155 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:49.155 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.156 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3496 4.2 4:7e155756:::smithi16641208-255:head [write 2772934~134809] snapc 55=[55,54,53,52] ondisk+write+known_if_redirected e128)", 2020-11-16T20:57:49.156 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:32.935878+0000", 2020-11-16T20:57:49.156 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.13302698, 2020-11-16T20:57:49.156 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023700191999999998, 2020-11-16T20:57:49.156 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:49.156 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:49.156 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:49.157 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:49.157 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:49.157 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3496 2020-11-16T20:57:49.157 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.157 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:49.157 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.157 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:49.158 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.935878+0000", 2020-11-16T20:57:49.158 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:49.158 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.158 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.158 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:49.158 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.935878+0000", 2020-11-16T20:57:49.158 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6582000000000005e-05 2020-11-16T20:57:49.158 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.159 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.159 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:49.159 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.935975+0000", 2020-11-16T20:57:49.159 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.956e-06 2020-11-16T20:57:49.159 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.159 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.160 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:49.160 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.935982+0000", 2020-11-16T20:57:49.160 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3502999999999999e-05 2020-11-16T20:57:49.160 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.160 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.160 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:49.160 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.935995+0000", 2020-11-16T20:57:49.161 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2150000000000004e-06 2020-11-16T20:57:49.161 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.161 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.161 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:49.161 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936002+0000", 2020-11-16T20:57:49.161 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9329999999999997e-05 2020-11-16T20:57:49.161 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.162 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.162 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936052+0000", 2020-11-16T20:57:49.162 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5052000000000002e-05 2020-11-16T20:57:49.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.162 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:49.163 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936097+0000", 2020-11-16T20:57:49.163 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014771909 2020-11-16T20:57:49.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.163 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.163 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.163 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.950869+0000", 2020-11-16T20:57:49.163 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000104421 2020-11-16T20:57:49.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.164 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.164 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:49.164 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.950973+0000", 2020-11-16T20:57:49.164 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022628000000000001 2020-11-16T20:57:49.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.164 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.164 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,4", 2020-11-16T20:57:49.165 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.951199+0000", 2020-11-16T20:57:49.165 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023977569999999999 2020-11-16T20:57:49.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.165 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.165 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:49.165 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.953597+0000", 2020-11-16T20:57:49.165 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0044840269999999998 2020-11-16T20:57:49.166 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.166 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.166 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:49.166 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.958081+0000", 2020-11-16T20:57:49.166 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0013765349999999999 2020-11-16T20:57:49.166 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.166 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.167 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:49.167 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.959458+0000", 2020-11-16T20:57:49.167 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5678000000000004e-05 2020-11-16T20:57:49.167 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.167 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.167 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:49.167 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.959523+0000", 2020-11-16T20:57:49.167 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4947000000000001e-05 2020-11-16T20:57:49.168 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.168 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.168 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:49.168 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.959578+0000", 2020-11-16T20:57:49.168 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023700191999999998 2020-11-16T20:57:49.168 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.169 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:49.169 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.169 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.169 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.169 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3497 4.2 4:7e155756:::smithi16641208-255:head [setxattr _header (58) in=7b,truncate 2907743] snapc 55=[55,54,53,52] ondisk+write+known_if_redirected e128)", 2020-11-16T20:57:49.170 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:32.936049+0000", 2020-11-16T20:57:49.170 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.132856450999999, 2020-11-16T20:57:49.170 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024052206, 2020-11-16T20:57:49.170 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:49.170 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:49.170 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:49.170 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:49.171 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:49.171 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3497 2020-11-16T20:57:49.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.171 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:49.171 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.171 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:49.171 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936049+0000", 2020-11-16T20:57:49.172 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:49.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.172 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.172 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:49.172 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936049+0000", 2020-11-16T20:57:49.172 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7271e-05 2020-11-16T20:57:49.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.173 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.173 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:49.173 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936076+0000", 2020-11-16T20:57:49.173 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1779999999999996e-06 2020-11-16T20:57:49.173 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.173 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.173 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:49.173 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936080+0000", 2020-11-16T20:57:49.174 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7039999999999997e-06 2020-11-16T20:57:49.174 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.174 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.174 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:49.174 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936087+0000", 2020-11-16T20:57:49.174 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.473e-06 2020-11-16T20:57:49.174 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.175 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:49.175 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936090+0000", 2020-11-16T20:57:49.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3069999999999999e-05 2020-11-16T20:57:49.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.175 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936133+0000", 2020-11-16T20:57:49.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4410000000000001e-05 2020-11-16T20:57:49.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.176 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.176 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:49.176 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936208+0000", 2020-11-16T20:57:49.176 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015674410999999999 2020-11-16T20:57:49.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.177 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.951882+0000", 2020-11-16T20:57:49.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000167233 2020-11-16T20:57:49.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:49.178 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.952049+0000", 2020-11-16T20:57:49.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025541000000000002 2020-11-16T20:57:49.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.178 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,4", 2020-11-16T20:57:49.178 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.952305+0000", 2020-11-16T20:57:49.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0021373550000000001 2020-11-16T20:57:49.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.179 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.179 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:49.179 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.954442+0000", 2020-11-16T20:57:49.179 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0036480499999999999 2020-11-16T20:57:49.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.179 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:49.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.958090+0000", 2020-11-16T20:57:49.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0018286380000000001 2020-11-16T20:57:49.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.180 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.180 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:49.180 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.959919+0000", 2020-11-16T20:57:49.180 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7004999999999998e-05 2020-11-16T20:57:49.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.181 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.181 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:49.181 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.960006+0000", 2020-11-16T20:57:49.181 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4998000000000001e-05 2020-11-16T20:57:49.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.181 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.182 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:49.182 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.960101+0000", 2020-11-16T20:57:49.182 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024052206 2020-11-16T20:57:49.182 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.182 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:49.182 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.183 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.183 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3498 4.2 4:7e155756:::smithi16641208-255:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e128)", 2020-11-16T20:57:49.183 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:32.936126+0000", 2020-11-16T20:57:49.183 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.132778741999999, 2020-11-16T20:57:49.183 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024682154000000001, 2020-11-16T20:57:49.183 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:49.183 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:49.183 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:49.184 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:49.184 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:49.184 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3498 2020-11-16T20:57:49.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.184 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:49.184 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.184 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:49.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936126+0000", 2020-11-16T20:57:49.185 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:49.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.185 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.185 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:49.185 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936126+0000", 2020-11-16T20:57:49.185 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3691e-05 2020-11-16T20:57:49.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.186 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.186 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:49.186 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936160+0000", 2020-11-16T20:57:49.186 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2190000000000001e-06 2020-11-16T20:57:49.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.186 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.186 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:49.187 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936166+0000", 2020-11-16T20:57:49.187 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9751000000000001e-05 2020-11-16T20:57:49.187 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.187 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.187 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:49.187 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936186+0000", 2020-11-16T20:57:49.187 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8449999999999999e-06 2020-11-16T20:57:49.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:49.188 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936192+0000", 2020-11-16T20:57:49.188 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0973000000000002e-05 2020-11-16T20:57:49.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.188 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.188 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.189 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936233+0000", 2020-11-16T20:57:49.189 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4511000000000002e-05 2020-11-16T20:57:49.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.189 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.190 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:49.190 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936267+0000", 2020-11-16T20:57:49.190 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016346407 2020-11-16T20:57:49.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.190 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.190 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.191 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.952614+0000", 2020-11-16T20:57:49.191 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5446999999999998e-05 2020-11-16T20:57:49.191 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.191 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.191 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:49.192 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.952689+0000", 2020-11-16T20:57:49.192 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074636269999999996 2020-11-16T20:57:49.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.192 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.192 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.192 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.960153+0000", 2020-11-16T20:57:49.192 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026278599999999999 2020-11-16T20:57:49.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.193 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:49.193 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.960416+0000", 2020-11-16T20:57:49.193 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039289700000000002 2020-11-16T20:57:49.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.194 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:49.194 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.960808+0000", 2020-11-16T20:57:49.194 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024682154000000001 2020-11-16T20:57:49.194 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.194 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:49.194 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.195 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.195 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3512 4.2 4:6f41abc7:::smithi16641208-179:head [read 0~2991646,checksum] snapc 0=[] ondisk+read+known_if_redirected e129)", 2020-11-16T20:57:49.195 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:34.001748+0000", 2020-11-16T20:57:49.195 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.067157062, 2020-11-16T20:57:49.195 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020636748, 2020-11-16T20:57:49.195 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:49.195 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2020-11-16T20:57:49.196 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:49.196 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:49.196 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:49.196 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3512 2020-11-16T20:57:49.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.196 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:49.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.197 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:49.197 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.001748+0000", 2020-11-16T20:57:49.197 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:49.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.197 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:49.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.001748+0000", 2020-11-16T20:57:49.198 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9986e-05 2020-11-16T20:57:49.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.198 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.198 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:49.198 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.001788+0000", 2020-11-16T20:57:49.199 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5100000000000004e-06 2020-11-16T20:57:49.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.199 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.199 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:49.199 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.001794+0000", 2020-11-16T20:57:49.199 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3481e-05 2020-11-16T20:57:49.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.200 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.200 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:49.200 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.001808+0000", 2020-11-16T20:57:49.200 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7919999999999998e-06 2020-11-16T20:57:49.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.200 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:49.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.001814+0000", 2020-11-16T20:57:49.201 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011458670000000001 2020-11-16T20:57:49.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.201 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.201 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.201 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.002960+0000", 2020-11-16T20:57:49.202 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019425112000000001 2020-11-16T20:57:49.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.202 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:49.203 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.022385+0000", 2020-11-16T20:57:49.203 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020636748 2020-11-16T20:57:49.203 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.203 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:49.203 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.204 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.204 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3526 4.2 4:74e10358:::smithi16641208-98:55 [read 0~3630279,checksum] snapc 0=[] ondisk+read+known_if_redirected e129)", 2020-11-16T20:57:49.204 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:34.017588+0000", 2020-11-16T20:57:49.204 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.051316969, 2020-11-16T20:57:49.204 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021067525, 2020-11-16T20:57:49.204 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:49.204 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2020-11-16T20:57:49.205 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:49.205 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:49.205 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:49.205 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3526 2020-11-16T20:57:49.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.205 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:49.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.205 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:49.206 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.017588+0000", 2020-11-16T20:57:49.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:49.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.206 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.206 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:49.206 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.017588+0000", 2020-11-16T20:57:49.206 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3799999999999999e-05 2020-11-16T20:57:49.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.207 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:49.207 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.017612+0000", 2020-11-16T20:57:49.207 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8709999999999999e-06 2020-11-16T20:57:49.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.207 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:49.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.017616+0000", 2020-11-16T20:57:49.208 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0310000000000004e-06 2020-11-16T20:57:49.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.208 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.208 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:49.208 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.017622+0000", 2020-11-16T20:57:49.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1389999999999999e-06 2020-11-16T20:57:49.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.209 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:49.209 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.017625+0000", 2020-11-16T20:57:49.209 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000718014 2020-11-16T20:57:49.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.209 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.018343+0000", 2020-11-16T20:57:49.210 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020312670000000001 2020-11-16T20:57:49.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.210 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.210 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:49.210 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.038656+0000", 2020-11-16T20:57:49.211 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021067525 2020-11-16T20:57:49.211 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.211 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:49.211 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.211 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.211 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3539 4.2 4:47e2d3ca:::smithi16641208-384:head [read 0~2437081,checksum] snapc 0=[] ondisk+read+known_if_redirected e130)", 2020-11-16T20:57:49.212 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:34.748641+0000", 2020-11-16T20:57:49.212 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.320263862999999, 2020-11-16T20:57:49.212 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023726226, 2020-11-16T20:57:49.212 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:49.212 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2020-11-16T20:57:49.212 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:49.212 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:49.212 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:49.213 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3539 2020-11-16T20:57:49.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.213 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:49.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.213 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:49.213 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748641+0000", 2020-11-16T20:57:49.213 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:49.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.214 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:49.214 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748641+0000", 2020-11-16T20:57:49.214 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8232000000000003e-05 2020-11-16T20:57:49.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.214 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.215 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:49.215 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748679+0000", 2020-11-16T20:57:49.215 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1430000000000003e-06 2020-11-16T20:57:49.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.215 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.215 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:49.215 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748686+0000", 2020-11-16T20:57:49.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1487e-05 2020-11-16T20:57:49.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.216 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:49.216 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748697+0000", 2020-11-16T20:57:49.216 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5609999999999998e-06 2020-11-16T20:57:49.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.216 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.217 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:49.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748703+0000", 2020-11-16T20:57:49.217 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024659600000000002 2020-11-16T20:57:49.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.217 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.217 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.217 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748949+0000", 2020-11-16T20:57:49.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023418207 2020-11-16T20:57:49.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.218 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.218 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:49.218 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.772367+0000", 2020-11-16T20:57:49.218 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023726226 2020-11-16T20:57:49.218 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.219 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:49.219 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.219 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:769 4.2 4:5e002a8b:::smithi16641208-342:head [assert-version v367,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected e130)", 2020-11-16T20:57:49.219 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:34.755146+0000", 2020-11-16T20:57:49.219 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.313758789, 2020-11-16T20:57:49.219 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020866262999999999, 2020-11-16T20:57:49.220 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:49.220 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2020-11-16T20:57:49.220 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:49.220 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.220 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:49.220 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.755146+0000", 2020-11-16T20:57:49.220 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:49.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.221 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:49.221 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.755146+0000", 2020-11-16T20:57:49.221 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1903999999999997e-05 2020-11-16T20:57:49.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:49.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.755188+0000", 2020-11-16T20:57:49.222 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2490000000000004e-06 2020-11-16T20:57:49.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.222 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.222 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:49.222 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.755195+0000", 2020-11-16T20:57:49.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6143000000000001e-05 2020-11-16T20:57:49.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.223 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:49.223 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.755212+0000", 2020-11-16T20:57:49.223 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4799999999999998e-06 2020-11-16T20:57:49.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.224 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:49.224 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.755218+0000", 2020-11-16T20:57:49.224 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1761999999999996e-05 2020-11-16T20:57:49.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.224 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.224 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.224 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.755280+0000", 2020-11-16T20:57:49.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020732725 2020-11-16T20:57:49.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.225 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:49.225 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.776012+0000", 2020-11-16T20:57:49.225 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020866262999999999 2020-11-16T20:57:49.225 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.225 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:49.226 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.226 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3647 4.2 4:4f093770:::smithi16641208-180:head [append 0~0] snapc 5e=[5e,5c,5b] ondisk+write+known_if_redirected e137)", 2020-11-16T20:57:49.226 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:41.986315+0000", 2020-11-16T20:57:49.226 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 7.0825898120000002, 2020-11-16T20:57:49.226 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.034212326000000001, 2020-11-16T20:57:49.227 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:49.227 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:49.227 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:49.227 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:49.227 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:49.227 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3647 2020-11-16T20:57:49.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.228 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:49.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.228 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:49.228 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:41.986315+0000", 2020-11-16T20:57:49.228 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:49.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:49.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:41.986315+0000", 2020-11-16T20:57:49.229 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9006999999999999e-05 2020-11-16T20:57:49.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.229 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.229 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:49.229 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:41.986334+0000", 2020-11-16T20:57:49.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9699999999999996e-06 2020-11-16T20:57:49.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.230 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.230 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:49.230 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:41.986340+0000", 2020-11-16T20:57:49.230 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6699999999999994e-06 2020-11-16T20:57:49.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.231 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:49.231 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:41.986348+0000", 2020-11-16T20:57:49.231 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0709999999999999e-06 2020-11-16T20:57:49.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.231 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:49.231 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:41.986351+0000", 2020-11-16T20:57:49.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023678990000000001 2020-11-16T20:57:49.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.232 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.232 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.232 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:41.988719+0000", 2020-11-16T20:57:49.232 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4289999999999999e-05 2020-11-16T20:57:49.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:49.233 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:41.988753+0000", 2020-11-16T20:57:49.233 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.025774689 2020-11-16T20:57:49.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.233 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.233 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.234 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:42.014528+0000", 2020-11-16T20:57:49.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013804799999999999 2020-11-16T20:57:49.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.234 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.234 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:49.234 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:42.014666+0000", 2020-11-16T20:57:49.234 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000243081 2020-11-16T20:57:49.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.235 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,4", 2020-11-16T20:57:49.235 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:42.014909+0000", 2020-11-16T20:57:49.235 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00096478700000000004 2020-11-16T20:57:49.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.235 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:49.236 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:42.015874+0000", 2020-11-16T20:57:49.236 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014369059999999999 2020-11-16T20:57:49.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.236 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:49.236 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:42.017311+0000", 2020-11-16T20:57:49.236 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031052010000000001 2020-11-16T20:57:49.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:49.237 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:42.020416+0000", 2020-11-16T20:57:49.237 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5228999999999994e-05 2020-11-16T20:57:49.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.237 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:49.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:42.020491+0000", 2020-11-16T20:57:49.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6477999999999999e-05 2020-11-16T20:57:49.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.238 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.238 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:49.238 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:42.020528+0000", 2020-11-16T20:57:49.238 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.034212326000000001 2020-11-16T20:57:49.239 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.239 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:49.239 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.239 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.239 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.239 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3661 4.2 4:7c4a7ccf:::smithi16641208-27:5e [read 0~2436982,checksum] snapc 0=[] ondisk+read+known_if_redirected e139)", 2020-11-16T20:57:49.239 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:43.965978+0000", 2020-11-16T20:57:49.240 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.1029267059999999, 2020-11-16T20:57:49.240 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020534841000000002, 2020-11-16T20:57:49.240 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:49.240 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2020-11-16T20:57:49.240 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:49.240 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:49.240 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:49.241 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3661 2020-11-16T20:57:49.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.241 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:49.241 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.241 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:49.241 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.965978+0000", 2020-11-16T20:57:49.241 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:49.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.242 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:49.242 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.965978+0000", 2020-11-16T20:57:49.242 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6570999999999998e-05 2020-11-16T20:57:49.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.243 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:49.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.966025+0000", 2020-11-16T20:57:49.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0780000000000001e-06 2020-11-16T20:57:49.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.243 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.243 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:49.243 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.966031+0000", 2020-11-16T20:57:49.243 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1233000000000001e-05 2020-11-16T20:57:49.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.244 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:49.244 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.966042+0000", 2020-11-16T20:57:49.244 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.955e-06 2020-11-16T20:57:49.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.245 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:49.245 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.966047+0000", 2020-11-16T20:57:49.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7679000000000003e-05 2020-11-16T20:57:49.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.245 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.245 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.245 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.966085+0000", 2020-11-16T20:57:49.245 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0609999999999998e-06 2020-11-16T20:57:49.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.246 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:49.246 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.966092+0000", 2020-11-16T20:57:49.246 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0027655000000000002 2020-11-16T20:57:49.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.246 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.968857+0000", 2020-11-16T20:57:49.247 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017655764000000001 2020-11-16T20:57:49.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.247 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.247 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:49.247 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.986513+0000", 2020-11-16T20:57:49.248 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020534841000000002 2020-11-16T20:57:49.248 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.248 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:49.248 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.248 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.248 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3668 4.2 4:43ad827e:::smithi16641208-402:head [write 1365277~511220] snapc 5e=[5e] ondisk+write+known_if_redirected e139)", 2020-11-16T20:57:49.248 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:43.998093+0000", 2020-11-16T20:57:49.249 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.0708116009999999, 2020-11-16T20:57:49.249 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.025480011, 2020-11-16T20:57:49.249 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:49.249 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:49.249 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:49.249 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:49.249 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:49.250 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3668 2020-11-16T20:57:49.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.250 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:49.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.250 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:49.250 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.998093+0000", 2020-11-16T20:57:49.250 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:49.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:49.251 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.998093+0000", 2020-11-16T20:57:49.251 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00048407700000000002 2020-11-16T20:57:49.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.251 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.251 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:49.252 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.998577+0000", 2020-11-16T20:57:49.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8569999999999997e-06 2020-11-16T20:57:49.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.252 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.252 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:49.252 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.998584+0000", 2020-11-16T20:57:49.252 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5218999999999999e-05 2020-11-16T20:57:49.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.253 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:49.253 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.998600+0000", 2020-11-16T20:57:49.253 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1049999999999995e-06 2020-11-16T20:57:49.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.253 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:49.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.998608+0000", 2020-11-16T20:57:49.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3278000000000001e-05 2020-11-16T20:57:49.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.254 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.254 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.254 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.998651+0000", 2020-11-16T20:57:49.254 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0895000000000005e-05 2020-11-16T20:57:49.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.255 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:49.255 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.998722+0000", 2020-11-16T20:57:49.255 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015162044 2020-11-16T20:57:49.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.255 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:49.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:44.013884+0000", 2020-11-16T20:57:49.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017694 2020-11-16T20:57:49.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.256 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:49.256 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:44.014061+0000", 2020-11-16T20:57:49.256 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030028900000000002 2020-11-16T20:57:49.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.257 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.257 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,4", 2020-11-16T20:57:49.257 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:44.014361+0000", 2020-11-16T20:57:49.257 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074555899999999998 2020-11-16T20:57:49.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.257 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.258 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:49.258 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:44.021817+0000", 2020-11-16T20:57:49.258 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001490288 2020-11-16T20:57:49.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.258 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.258 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:49.258 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:44.023307+0000", 2020-11-16T20:57:49.259 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000120949 2020-11-16T20:57:49.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.259 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:49.259 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:44.023428+0000", 2020-11-16T20:57:49.259 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9171000000000005e-05 2020-11-16T20:57:49.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.259 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:49.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:44.023507+0000", 2020-11-16T20:57:49.260 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6309000000000005e-05 2020-11-16T20:57:49.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:49.260 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:49.260 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:49.260 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:44.023573+0000", 2020-11-16T20:57:49.261 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.025480011 2020-11-16T20:57:49.261 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.261 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:49.261 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.261 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:49.261 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:49.261 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:49.262 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:57:49.263 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:49.268+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:49.264 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:57:49.363 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:49.369+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:49.404 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:57:49.423 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:57:49.440 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:49.440 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:57:49.440 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:57:49.440 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:49.442 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:57:49.449 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:57:49.461 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:57:49.481 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:57:49.493 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:49.498+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:49.500 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:57:49.519 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:57:49.539 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:57:49.540 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:57:49.540 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:57:49.541 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:57:49.541 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:57:49.541 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:57:49.541 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:57:49.541 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:57:49.541 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:57:49.564 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:49.569+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:49.585 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:49.585 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:49.595 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:57:49.667 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:49.673+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:49.768 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:49.773+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:49.769 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:49.769 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:49.779 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:57:49.790 INFO:tasks.rados.rados.0.smithi166.stdout:1175: done (6 left) 2020-11-16T20:57:49.790 INFO:tasks.rados.rados.0.smithi166.stdout:1176: snap_create 2020-11-16T20:57:49.790 INFO:tasks.rados.rados.0.smithi166.stdout:1173: expect (ObjNum 407 snap 0 seq_num 407) 2020-11-16T20:57:49.792 INFO:teuthology.orchestra.run.smithi166.stderr:nodeep-scrub is unset 2020-11-16T20:57:49.869 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:49.874+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:49.880 INFO:tasks.rados.rados.0.smithi166.stdout:1174: finishing write tid 1 to smithi16641208-380 2020-11-16T20:57:49.881 INFO:tasks.rados.rados.0.smithi166.stdout:1172: expect (ObjNum 556 snap 16 seq_num 556) 2020-11-16T20:57:49.954 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:49.954 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:49.964 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:57:49.970 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:49.975+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:50.023 INFO:tasks.rados.rados.0.smithi166.stdout:1174: finishing write tid 2 to smithi16641208-380 2020-11-16T20:57:50.023 INFO:tasks.rados.rados.0.smithi166.stdout:1174: finishing write tid 3 to smithi16641208-380 2020-11-16T20:57:50.023 INFO:tasks.rados.rados.0.smithi166.stdout:1174: finishing write tid 4 to smithi16641208-380 2020-11-16T20:57:50.024 INFO:tasks.rados.rados.0.smithi166.stdout:1174: finishing write tid 5 to smithi16641208-380 2020-11-16T20:57:50.024 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 380 v 871 (ObjNum 677 snap 52 seq_num 677) dirty exists 2020-11-16T20:57:50.024 INFO:tasks.rados.rados.0.smithi166.stdout:1174: left oid 380 (ObjNum 677 snap 52 seq_num 677) 2020-11-16T20:57:50.071 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:50.076+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:50.141 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:50.141 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:50.151 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:57:50.195 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:57:50.200+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:57:50.272 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:50.278+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:50.285 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:50.286 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:50.295 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:57:50.373 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:50.377+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:50.422 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:50.422 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:50.431 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:57:50.474 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:50.479+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:50.555 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:50.556 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:50.565 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:57:50.608 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:50.614+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:50.676 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:50.681+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:50.691 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:50.691 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:50.700 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:57:50.777 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:50.782+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:50.796 INFO:tasks.rados.rados.0.smithi166.stdout:1172: done (6 left) 2020-11-16T20:57:50.796 INFO:tasks.rados.rados.0.smithi166.stdout:1173: done (5 left) 2020-11-16T20:57:50.797 INFO:tasks.rados.rados.0.smithi166.stdout:1174: done (4 left) 2020-11-16T20:57:50.797 INFO:tasks.rados.rados.0.smithi166.stdout:1176: done (3 left) 2020-11-16T20:57:50.797 INFO:tasks.rados.rados.0.smithi166.stdout:1177: copy_from oid 369 from oid 317 current snap is 53 2020-11-16T20:57:50.797 INFO:tasks.rados.rados.0.smithi166.stdout:1178: cache_try_flush oid 313 snap -1 2020-11-16T20:57:50.797 INFO:tasks.rados.rados.0.smithi166.stdout:1179: copy_from oid 487 from oid 483 current snap is 53 2020-11-16T20:57:50.797 INFO:tasks.rados.rados.0.smithi166.stdout:1180: snap_create 2020-11-16T20:57:50.817 INFO:tasks.rados.rados.0.smithi166.stdout:1177: finishing copy_from to smithi16641208-369 2020-11-16T20:57:50.817 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 369 v 436 (ObjNum 526 snap 6 seq_num 526) dirty exists 2020-11-16T20:57:50.817 INFO:tasks.rados.rados.0.smithi166.stdout:1177: finishing copy_from racing read to smithi16641208-369 2020-11-16T20:57:50.825 INFO:tasks.rados.rados.0.smithi166.stdout:1179: finishing copy_from to smithi16641208-487 2020-11-16T20:57:50.825 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 487 v 712 (ObjNum 668 snap 48 seq_num 668) dirty exists 2020-11-16T20:57:50.839 INFO:tasks.rados.rados.0.smithi166.stdout:1179: finishing copy_from racing read to smithi16641208-487 2020-11-16T20:57:50.877 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:50.882+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:50.879 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:50.879 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:50.888 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:57:50.979 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:50.984+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:51.015 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:51.016 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:51.025 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:57:51.107 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:51.113+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:51.179 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:51.185+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:51.192 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:51.193 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:51.202 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:57:51.285 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:51.291+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:51.369 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:51.369 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:51.378 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:57:51.381 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:51.386+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:51.481 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:57:51.486+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:57:51.543 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:51.543 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:51.551 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:57:51.553 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:57:51.582 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:51.587+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:51.683 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:51.689+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:51.728 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:51.728 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:51.739 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:57:51.742 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:57:51.763 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:57:51.783 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:57:51.785 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:51.790+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:51.799 INFO:tasks.rados.rados.0.smithi166.stdout:1177: done (6 left) 2020-11-16T20:57:51.799 INFO:tasks.rados.rados.0.smithi166.stdout:1179: done (5 left) 2020-11-16T20:57:51.799 INFO:tasks.rados.rados.0.smithi166.stdout:1180: done (4 left) 2020-11-16T20:57:51.799 INFO:tasks.rados.rados.0.smithi166.stdout:1181: read oid 96 snap -1 2020-11-16T20:57:51.800 INFO:tasks.rados.rados.0.smithi166.stdout:1181: expect (ObjNum 189 snap 0 seq_num 189) 2020-11-16T20:57:51.800 INFO:tasks.rados.rados.0.smithi166.stdout:1182: cache_evict oid 350 snap -1 2020-11-16T20:57:51.800 INFO:tasks.rados.rados.0.smithi166.stdout:1183: snap_remove snap 47 2020-11-16T20:57:51.803 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2020-11-16T20:57:51.806 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:57:51.827 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:57:51.848 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:57:51.869 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:57:51.878 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:51.879 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:57:51.879 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:57:51.879 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:51.887 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:51.891+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:51.889 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:57:51.890 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:57:51.891 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:57:51.892 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:57:51.892 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:57:51.892 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:57:51.892 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:57:51.892 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:57:51.892 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:57:51.892 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:57:51.987 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:51.992+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:52.024 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:52.024 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:57:52.024 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:57:52.024 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:57:52.025 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:52.034 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:57:52.088 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:52.093+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:52.165 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:52.165 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:57:52.165 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:57:52.166 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:57:52.166 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.166 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:554 3.2 3:769099fd:::smithi16641208-247:head [copy-from ver 123] snapc 1=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:57:52.166 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:57:52.166 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 107.11833882400001, 2020-11-16T20:57:52.166 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998, 2020-11-16T20:57:52.167 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:52.167 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:52.167 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:52.167 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.167 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:52.167 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:57:52.167 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:52.168 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.168 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.168 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:52.168 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:57:52.168 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6705999999999997e-05 2020-11-16T20:57:52.168 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.168 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.168 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:52.169 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050139+0000", 2020-11-16T20:57:52.169 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6199999999999998e-06 2020-11-16T20:57:52.169 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.169 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.169 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:52.169 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050144+0000", 2020-11-16T20:57:52.169 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.944e-06 2020-11-16T20:57:52.170 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.170 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.170 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:52.170 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050154+0000", 2020-11-16T20:57:52.170 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4043999999999999e-05 2020-11-16T20:57:52.170 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.170 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.171 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.171 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050178+0000", 2020-11-16T20:57:52.171 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078971409999999999 2020-11-16T20:57:52.171 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.171 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.171 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.171 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058075+0000", 2020-11-16T20:57:52.171 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012776500000000001 2020-11-16T20:57:52.172 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.172 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.172 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:52.172 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058203+0000", 2020-11-16T20:57:52.172 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011807013 2020-11-16T20:57:52.172 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.172 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.173 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:52.173 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070010+0000", 2020-11-16T20:57:52.173 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029522160000000001 2020-11-16T20:57:52.173 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.173 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.173 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:52.173 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.072962+0000", 2020-11-16T20:57:52.173 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017845006 2020-11-16T20:57:52.174 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.174 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.174 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.174 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.090807+0000", 2020-11-16T20:57:52.174 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.009301808 2020-11-16T20:57:52.174 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.174 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.175 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.175 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100109+0000", 2020-11-16T20:57:52.175 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7076999999999995e-05 2020-11-16T20:57:52.175 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.175 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.175 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:52.175 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100176+0000", 2020-11-16T20:57:52.176 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9790999999999999e-05 2020-11-16T20:57:52.176 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.176 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.176 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:52.176 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100216+0000", 2020-11-16T20:57:52.176 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998 2020-11-16T20:57:52.176 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.176 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:52.177 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.177 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.177 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.177 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2429 4.0 4:3b92f709:::smithi16641208-69:head [rollback 7] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:57:52.177 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:57:52.177 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 102.152420562, 2020-11-16T20:57:52.177 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003, 2020-11-16T20:57:52.178 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:52.178 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:52.178 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:52.178 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:52.178 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:52.178 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2429 2020-11-16T20:57:52.178 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.179 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:52.179 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.179 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:52.179 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:57:52.179 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:52.179 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.179 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.179 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:52.180 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:57:52.180 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3710000000000002e-05 2020-11-16T20:57:52.180 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.180 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.180 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:52.180 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016044+0000", 2020-11-16T20:57:52.180 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7090000000000001e-06 2020-11-16T20:57:52.181 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.181 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.181 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:52.181 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016049+0000", 2020-11-16T20:57:52.181 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8820000000000003e-06 2020-11-16T20:57:52.181 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.181 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.181 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:52.182 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016056+0000", 2020-11-16T20:57:52.182 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.27e-06 2020-11-16T20:57:52.182 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.182 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.182 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.182 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016059+0000", 2020-11-16T20:57:52.182 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.537e-05 2020-11-16T20:57:52.183 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.183 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.183 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.183 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016115+0000", 2020-11-16T20:57:52.183 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8690000000000003e-06 2020-11-16T20:57:52.183 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.183 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.184 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:52.184 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016120+0000", 2020-11-16T20:57:52.184 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021405730000000002 2020-11-16T20:57:52.184 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.184 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.184 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.184 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018260+0000", 2020-11-16T20:57:52.184 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0137999999999999e-05 2020-11-16T20:57:52.185 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.185 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.185 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:52.185 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018320+0000", 2020-11-16T20:57:52.185 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011799352000000001 2020-11-16T20:57:52.185 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.185 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.186 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.186 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030120+0000", 2020-11-16T20:57:52.186 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000163139 2020-11-16T20:57:52.186 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.186 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.186 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:52.186 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030283+0000", 2020-11-16T20:57:52.187 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029657000000000002 2020-11-16T20:57:52.187 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.187 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.187 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:52.187 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030579+0000", 2020-11-16T20:57:52.187 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3058000000000001e-05 2020-11-16T20:57:52.187 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.187 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.188 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:52.188 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030612+0000", 2020-11-16T20:57:52.188 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0075168259999999999 2020-11-16T20:57:52.188 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.188 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.188 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.188 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038129+0000", 2020-11-16T20:57:52.189 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012914299999999999 2020-11-16T20:57:52.189 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.189 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.189 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:52.189 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038258+0000", 2020-11-16T20:57:52.189 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034292799999999999 2020-11-16T20:57:52.189 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.189 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.190 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:57:52.190 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038601+0000", 2020-11-16T20:57:52.190 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0025181159999999999 2020-11-16T20:57:52.190 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.190 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.190 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.190 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041119+0000", 2020-11-16T20:57:52.191 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2331999999999997e-05 2020-11-16T20:57:52.191 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.191 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.191 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for ondisk", 2020-11-16T20:57:52.191 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041202+0000", 2020-11-16T20:57:52.191 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028481750000000001 2020-11-16T20:57:52.191 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.191 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.192 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:52.192 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044050+0000", 2020-11-16T20:57:52.192 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001269921 2020-11-16T20:57:52.192 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.192 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.192 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.192 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045320+0000", 2020-11-16T20:57:52.193 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054215490000000003 2020-11-16T20:57:52.193 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.193 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.193 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.193 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050741+0000", 2020-11-16T20:57:52.193 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6981000000000001e-05 2020-11-16T20:57:52.193 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.194 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.194 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:52.194 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050808+0000", 2020-11-16T20:57:52.194 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8841e-05 2020-11-16T20:57:52.194 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.194 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.194 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:52.194 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050877+0000", 2020-11-16T20:57:52.195 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003 2020-11-16T20:57:52.195 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.195 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:52.195 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.195 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.195 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.195 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2430 4.0 4:3b92f709:::smithi16641208-69:head [append 0~0] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:57:52.196 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:57:52.196 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 102.15236423899999, 2020-11-16T20:57:52.196 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001, 2020-11-16T20:57:52.196 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:52.196 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:52.196 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:52.196 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:52.197 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:52.197 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2430 2020-11-16T20:57:52.197 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.197 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:52.197 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.197 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:52.197 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:57:52.197 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:52.198 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.198 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.198 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:52.198 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:57:52.198 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0857e-05 2020-11-16T20:57:52.198 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.198 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.199 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:52.199 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016098+0000", 2020-11-16T20:57:52.199 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9179999999999999e-06 2020-11-16T20:57:52.199 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.199 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.199 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:52.199 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016104+0000", 2020-11-16T20:57:52.199 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8230000000000006e-06 2020-11-16T20:57:52.200 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.200 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.200 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:52.200 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016114+0000", 2020-11-16T20:57:52.200 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2180000000000001e-06 2020-11-16T20:57:52.200 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.200 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.201 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.201 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016118+0000", 2020-11-16T20:57:52.201 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3547999999999995e-05 2020-11-16T20:57:52.201 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.201 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.201 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.201 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016181+0000", 2020-11-16T20:57:52.202 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8730000000000007e-06 2020-11-16T20:57:52.202 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.202 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.202 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:52.202 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016189+0000", 2020-11-16T20:57:52.202 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021577200000000001 2020-11-16T20:57:52.202 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.203 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.203 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.203 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018347+0000", 2020-11-16T20:57:52.203 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6832000000000001e-05 2020-11-16T20:57:52.203 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.203 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.203 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:52.203 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018404+0000", 2020-11-16T20:57:52.204 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012272913999999999 2020-11-16T20:57:52.204 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.204 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.204 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.204 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030677+0000", 2020-11-16T20:57:52.204 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2555000000000002e-05 2020-11-16T20:57:52.204 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.205 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.205 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:52.205 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030719+0000", 2020-11-16T20:57:52.205 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010518684 2020-11-16T20:57:52.205 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.205 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.205 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.205 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041238+0000", 2020-11-16T20:57:52.206 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000144723 2020-11-16T20:57:52.206 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.206 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.206 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:52.206 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041383+0000", 2020-11-16T20:57:52.206 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000214575 2020-11-16T20:57:52.206 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.207 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.207 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:57:52.207 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041597+0000", 2020-11-16T20:57:52.207 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002463196 2020-11-16T20:57:52.207 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.207 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.207 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:52.208 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044060+0000", 2020-11-16T20:57:52.208 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001654066 2020-11-16T20:57:52.208 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.208 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.208 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.208 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045715+0000", 2020-11-16T20:57:52.208 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053780599999999996 2020-11-16T20:57:52.209 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.209 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.209 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.209 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051093+0000", 2020-11-16T20:57:52.209 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8189999999999996e-05 2020-11-16T20:57:52.209 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.210 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.210 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:52.210 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051161+0000", 2020-11-16T20:57:52.210 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4910000000000001e-05 2020-11-16T20:57:52.210 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.210 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.210 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:52.211 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051216+0000", 2020-11-16T20:57:52.211 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001 2020-11-16T20:57:52.211 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.211 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:52.211 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.211 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.211 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.212 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "MOSDPGPush(4.1 52/51 [PushOp(4:9ab04c4a:::smithi16641208-1:head, version: 33'3, data_included: [0~892056,1542129~156520], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:9ab04c4a:::smithi16641208-1:head@33'3, size: 2016807, copy_subset: [0~2016807], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1698649, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:a1eef07d:::smithi16641208-13:head, version: 33'9, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:a1eef07d:::smithi16641208-13:head@33'9, size: 2201684, copy_subset: [0~2201684], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:929564f0:::smithi16641208-24:head, version: 33'18, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:929564f0:::smithi16641208-24:head@33'18, size: 2386561, copy_subset: [0~2386561], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b565f7d2:::smithi16641208-35:head, version: 33'27, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b565f7d2:::smithi16641208-35:head@33'27, size: 2571438, copy_subset: [0~2571438], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b6545a47:::smithi16641208-46:head, version: 33'29, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b6545a47:::smithi16641208-46:head@33'29, size: 2756315, copy_subset: [0~2756315], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:9bd9f31d:::smithi16641208-48:head, version: 33'35, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:9bd9f31d:::smithi16641208-48:head@33'35, size: 2789929, copy_subset: [0~2789929], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:83205103:::smithi16641208-103:head, version: 34'38, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:83205103:::smithi16641208-103:head@34'38, size: 3714314, copy_subset: [0~3714314], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:86a0a5b7:::smithi16641208-108:head, version: 34'42, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:86a0a5b7:::smithi16641208-108:head@34'42, size: 3798349, copy_subset: [0~3798349], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-16T20:57:52.212 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:57:52.212 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 97.397767633000001, 2020-11-16T20:57:52.212 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032552672999999997, 2020-11-16T20:57:52.212 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:52.212 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:52.213 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:52.213 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.213 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:52.213 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:57:52.213 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:52.213 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.213 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.213 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:52.214 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:57:52.214 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017498692999999999 2020-11-16T20:57:52.214 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.214 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.214 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:52.214 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788172+0000", 2020-11-16T20:57:52.214 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4147999999999999e-05 2020-11-16T20:57:52.215 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.215 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.215 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:52.215 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788206+0000", 2020-11-16T20:57:52.215 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0016000000000002e-05 2020-11-16T20:57:52.215 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.215 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.216 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:52.216 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788276+0000", 2020-11-16T20:57:52.216 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2172000000000002e-05 2020-11-16T20:57:52.216 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.216 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.216 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.216 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788319+0000", 2020-11-16T20:57:52.216 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000154337 2020-11-16T20:57:52.217 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.217 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.217 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.217 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788473+0000", 2020-11-16T20:57:52.217 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7690000000000002e-06 2020-11-16T20:57:52.217 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.217 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.218 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:52.218 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788482+0000", 2020-11-16T20:57:52.218 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014744538 2020-11-16T20:57:52.218 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.218 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.218 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:52.218 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803226+0000", 2020-11-16T20:57:52.218 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032552672999999997 2020-11-16T20:57:52.219 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.219 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:52.219 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.219 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.219 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.219 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.0:552 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'128, mlcod=0'0)", 2020-11-16T20:57:52.219 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:57:52.220 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 97.377802215000003, 2020-11-16T20:57:52.220 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038033168999999999, 2020-11-16T20:57:52.220 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:52.220 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:52.220 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:52.220 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.220 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:52.221 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:57:52.221 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:52.221 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.221 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.221 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:52.221 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:57:52.221 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0031023880000000002 2020-11-16T20:57:52.221 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.222 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.222 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:52.222 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793741+0000", 2020-11-16T20:57:52.222 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1496e-05 2020-11-16T20:57:52.222 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.222 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.222 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:52.223 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793753+0000", 2020-11-16T20:57:52.223 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9009999999999999e-05 2020-11-16T20:57:52.223 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.223 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.223 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:52.223 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793772+0000", 2020-11-16T20:57:52.223 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3318e-05 2020-11-16T20:57:52.223 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.224 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.224 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.224 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793785+0000", 2020-11-16T20:57:52.224 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012534775 2020-11-16T20:57:52.224 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.224 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.224 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.225 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806320+0000", 2020-11-16T20:57:52.225 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8144999999999999e-05 2020-11-16T20:57:52.225 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.225 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.225 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:52.225 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806348+0000", 2020-11-16T20:57:52.225 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022285688000000001 2020-11-16T20:57:52.225 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.226 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.226 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:52.226 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828634+0000", 2020-11-16T20:57:52.226 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8349000000000002e-05 2020-11-16T20:57:52.226 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.226 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.226 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:52.227 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828672+0000", 2020-11-16T20:57:52.227 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038033168999999999 2020-11-16T20:57:52.227 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.227 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:52.227 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.227 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.227 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.228 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2503 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'129, mlcod=0'0)", 2020-11-16T20:57:52.228 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:57:52.228 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 97.374614034999993, 2020-11-16T20:57:52.228 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034870998, 2020-11-16T20:57:52.228 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:52.228 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:52.228 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:52.229 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.229 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:52.229 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:57:52.229 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:52.229 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.229 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.229 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:52.230 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:57:52.230 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00093048899999999995 2020-11-16T20:57:52.230 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.230 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.230 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:52.230 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794758+0000", 2020-11-16T20:57:52.230 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.169e-05 2020-11-16T20:57:52.231 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.231 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.231 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:52.231 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794769+0000", 2020-11-16T20:57:52.231 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3998999999999999e-05 2020-11-16T20:57:52.231 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.231 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.231 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:52.232 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794783+0000", 2020-11-16T20:57:52.232 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.481e-06 2020-11-16T20:57:52.232 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.232 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.232 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.232 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794791+0000", 2020-11-16T20:57:52.232 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.02524036 2020-11-16T20:57:52.233 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.233 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.233 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.233 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820031+0000", 2020-11-16T20:57:52.233 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.811e-05 2020-11-16T20:57:52.233 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.233 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.233 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:52.234 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820059+0000", 2020-11-16T20:57:52.234 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.008614577 2020-11-16T20:57:52.234 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.234 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.234 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:52.234 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828674+0000", 2020-11-16T20:57:52.234 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4292000000000001e-05 2020-11-16T20:57:52.235 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.235 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.235 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:52.235 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828698+0000", 2020-11-16T20:57:52.235 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034870998 2020-11-16T20:57:52.235 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.235 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:52.235 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.236 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.236 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.236 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2504 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'130, mlcod=0'0)", 2020-11-16T20:57:52.236 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:57:52.236 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 97.373608352999995, 2020-11-16T20:57:52.236 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033888776000000002, 2020-11-16T20:57:52.236 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:52.237 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:52.237 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:52.237 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.237 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:52.237 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:57:52.237 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:52.237 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.237 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.238 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:52.238 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:57:52.238 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3896999999999997e-05 2020-11-16T20:57:52.238 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.238 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.238 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:52.239 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794877+0000", 2020-11-16T20:57:52.239 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7019999999999998e-06 2020-11-16T20:57:52.239 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.239 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.239 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:52.239 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794883+0000", 2020-11-16T20:57:52.239 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.789e-06 2020-11-16T20:57:52.239 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.240 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.240 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:52.240 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794888+0000", 2020-11-16T20:57:52.240 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.852e-06 2020-11-16T20:57:52.240 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.240 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.240 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.241 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794891+0000", 2020-11-16T20:57:52.241 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026152822999999999 2020-11-16T20:57:52.241 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.241 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.241 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.241 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.821044+0000", 2020-11-16T20:57:52.241 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6900999999999999e-05 2020-11-16T20:57:52.241 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.242 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.242 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:52.242 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.821071+0000", 2020-11-16T20:57:52.242 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0076283210000000004 2020-11-16T20:57:52.242 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.243 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.243 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:52.243 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828699+0000", 2020-11-16T20:57:52.243 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2490999999999999e-05 2020-11-16T20:57:52.243 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.243 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.244 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:52.244 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828722+0000", 2020-11-16T20:57:52.244 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033888776000000002 2020-11-16T20:57:52.244 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.244 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:52.244 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.244 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.245 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.245 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.13:681 3.1 e52/19 3:afc69464:::smithi16641208-110:head v 52'546, mlcod=52'544)", 2020-11-16T20:57:52.245 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:57:52.245 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 97.370948283000004, 2020-11-16T20:57:52.245 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.03113606, 2020-11-16T20:57:52.245 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:52.245 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:52.245 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:52.246 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.246 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:52.246 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:57:52.246 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:52.246 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.246 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.246 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:52.247 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.797493+0000", 2020-11-16T20:57:52.247 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0026681809999999999 2020-11-16T20:57:52.247 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.247 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.247 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:52.247 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800161+0000", 2020-11-16T20:57:52.247 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3499000000000001e-05 2020-11-16T20:57:52.247 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.248 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.248 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:52.248 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800175+0000", 2020-11-16T20:57:52.248 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8301999999999999e-05 2020-11-16T20:57:52.248 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.248 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.248 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:52.249 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800193+0000", 2020-11-16T20:57:52.249 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0465999999999999e-05 2020-11-16T20:57:52.249 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.249 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.249 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.249 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.800203+0000", 2020-11-16T20:57:52.249 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061432479999999996 2020-11-16T20:57:52.250 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.250 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.250 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.250 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806347+0000", 2020-11-16T20:57:52.250 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.641e-05 2020-11-16T20:57:52.250 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.250 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.251 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:52.251 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806373+0000", 2020-11-16T20:57:52.251 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022190887999999999 2020-11-16T20:57:52.251 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.251 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.251 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:52.251 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828564+0000", 2020-11-16T20:57:52.252 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5066000000000003e-05 2020-11-16T20:57:52.252 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.252 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.252 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:52.252 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828629+0000", 2020-11-16T20:57:52.252 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.03113606 2020-11-16T20:57:52.252 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.253 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:52.253 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.253 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.253 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.253 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:603 3.2 3:5a2e7c26:::smithi16641208-130:head [copy-from ver 67] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:57:52.253 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:57:52.253 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 92.417200288999993, 2020-11-16T20:57:52.253 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036631116999999998, 2020-11-16T20:57:52.254 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:52.254 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:52.254 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:52.254 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.254 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:52.254 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:57:52.254 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:52.255 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.255 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.255 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:52.255 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:57:52.255 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9854000000000002e-05 2020-11-16T20:57:52.255 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.255 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.256 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:52.256 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751281+0000", 2020-11-16T20:57:52.256 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1840000000000004e-06 2020-11-16T20:57:52.256 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.256 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.256 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:52.256 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751287+0000", 2020-11-16T20:57:52.256 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0231000000000001e-05 2020-11-16T20:57:52.257 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.257 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.257 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:52.257 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751297+0000", 2020-11-16T20:57:52.257 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.639e-06 2020-11-16T20:57:52.257 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.257 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.258 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.258 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751302+0000", 2020-11-16T20:57:52.258 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030012000000000002 2020-11-16T20:57:52.258 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.258 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.258 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.258 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751602+0000", 2020-11-16T20:57:52.258 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013830200000000001 2020-11-16T20:57:52.259 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.259 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.259 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:52.259 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751740+0000", 2020-11-16T20:57:52.259 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019538969999999999 2020-11-16T20:57:52.259 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.259 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.260 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:52.260 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771279+0000", 2020-11-16T20:57:52.260 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007630403 2020-11-16T20:57:52.260 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.260 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.260 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:52.260 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.778910+0000", 2020-11-16T20:57:52.261 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0065002009999999997 2020-11-16T20:57:52.261 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.261 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.261 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.261 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.785410+0000", 2020-11-16T20:57:52.261 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0023914140000000001 2020-11-16T20:57:52.261 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.261 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.262 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.262 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787801+0000", 2020-11-16T20:57:52.262 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9629999999999998e-05 2020-11-16T20:57:52.262 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.262 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.262 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:52.262 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787841+0000", 2020-11-16T20:57:52.263 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1168999999999999e-05 2020-11-16T20:57:52.263 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.263 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.263 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:52.263 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787872+0000", 2020-11-16T20:57:52.263 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036631116999999998 2020-11-16T20:57:52.263 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.263 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:52.264 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.264 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.264 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.264 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:609 3.2 3:5eead97c:::smithi16641208-34:head [copy-from ver 27] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:57:52.264 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:57:52.264 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 92.379403159999995, 2020-11-16T20:57:52.264 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.062626424, 2020-11-16T20:57:52.265 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:52.265 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:52.265 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:52.265 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.265 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:52.265 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:57:52.265 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:52.265 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.266 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.266 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:52.266 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:57:52.266 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3596000000000001e-05 2020-11-16T20:57:52.266 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.266 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.266 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:52.267 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789082+0000", 2020-11-16T20:57:52.267 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3209999999999999e-06 2020-11-16T20:57:52.267 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.267 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.267 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:52.267 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789089+0000", 2020-11-16T20:57:52.267 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3498e-05 2020-11-16T20:57:52.268 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.268 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.268 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:52.268 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789103+0000", 2020-11-16T20:57:52.268 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3679999999999998e-06 2020-11-16T20:57:52.268 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.268 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.268 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.269 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789109+0000", 2020-11-16T20:57:52.269 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007399638 2020-11-16T20:57:52.269 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.269 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.269 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.269 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.796509+0000", 2020-11-16T20:57:52.269 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000181168 2020-11-16T20:57:52.270 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.270 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.270 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:52.270 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.796690+0000", 2020-11-16T20:57:52.270 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01336562 2020-11-16T20:57:52.270 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.270 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.270 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:52.271 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.810055+0000", 2020-11-16T20:57:52.271 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044828350000000001 2020-11-16T20:57:52.271 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.271 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.271 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:52.271 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.814538+0000", 2020-11-16T20:57:52.271 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035609628999999997 2020-11-16T20:57:52.272 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.272 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.272 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.272 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850148+0000", 2020-11-16T20:57:52.272 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0013754730000000001 2020-11-16T20:57:52.272 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.272 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.272 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.273 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851523+0000", 2020-11-16T20:57:52.273 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9935e-05 2020-11-16T20:57:52.273 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.273 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.273 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:52.273 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851603+0000", 2020-11-16T20:57:52.273 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1342999999999999e-05 2020-11-16T20:57:52.274 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.274 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.274 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:52.274 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851665+0000", 2020-11-16T20:57:52.274 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.062626424 2020-11-16T20:57:52.274 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.274 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:52.274 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.275 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.275 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.275 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2605 4.0 4:2294fced:::smithi16641208-278:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:57:52.275 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:57:52.275 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 92.251568043999995, 2020-11-16T20:57:52.275 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032301128999999998, 2020-11-16T20:57:52.275 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:52.276 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:52.276 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:52.276 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:52.276 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:52.276 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2605 2020-11-16T20:57:52.276 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.276 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:52.276 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.277 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:52.277 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:57:52.277 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:52.277 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.277 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.277 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:52.277 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:57:52.278 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.811e-05 2020-11-16T20:57:52.278 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.278 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.278 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:52.278 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916901+0000", 2020-11-16T20:57:52.278 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2939999999999996e-06 2020-11-16T20:57:52.278 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.279 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.279 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:52.279 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916907+0000", 2020-11-16T20:57:52.279 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0589e-05 2020-11-16T20:57:52.279 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.279 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.279 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:52.279 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916917+0000", 2020-11-16T20:57:52.280 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2549999999999999e-06 2020-11-16T20:57:52.280 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.280 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.280 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.280 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916921+0000", 2020-11-16T20:57:52.280 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033789099999999999 2020-11-16T20:57:52.280 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.281 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.281 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.281 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.917259+0000", 2020-11-16T20:57:52.281 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.25e-05 2020-11-16T20:57:52.281 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.281 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.281 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:52.281 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.917332+0000", 2020-11-16T20:57:52.282 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.028336376999999999 2020-11-16T20:57:52.282 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.282 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.282 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.282 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.945668+0000", 2020-11-16T20:57:52.282 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0983000000000006e-05 2020-11-16T20:57:52.282 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.283 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.283 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:52.283 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.945759+0000", 2020-11-16T20:57:52.283 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00324756 2020-11-16T20:57:52.283 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.283 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.283 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.284 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949007+0000", 2020-11-16T20:57:52.284 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0583999999999999e-05 2020-11-16T20:57:52.284 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.284 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.284 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:52.284 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949097+0000", 2020-11-16T20:57:52.284 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6985999999999998e-05 2020-11-16T20:57:52.284 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.285 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.285 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:52.285 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949174+0000", 2020-11-16T20:57:52.285 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032301128999999998 2020-11-16T20:57:52.285 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.285 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:52.285 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.286 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.286 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.286 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2874 4.0 4:055e14cb:::smithi16641208-187:head [copy-from ver 402] snapc 25=[25,23,21,f] ondisk+write+known_if_redirected e72)", 2020-11-16T20:57:52.286 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:57:52.286 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 77.423044374, 2020-11-16T20:57:52.286 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031663616999999998, 2020-11-16T20:57:52.286 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:52.286 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:52.287 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:52.287 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:52.287 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:52.287 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2874 2020-11-16T20:57:52.287 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.287 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:52.287 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.288 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:52.288 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:57:52.288 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:52.288 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.288 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.288 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:52.288 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:57:52.288 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6754000000000001e-05 2020-11-16T20:57:52.289 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.289 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.289 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:52.289 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745434+0000", 2020-11-16T20:57:52.289 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5049999999999998e-06 2020-11-16T20:57:52.289 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.289 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.290 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:52.290 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745439+0000", 2020-11-16T20:57:52.290 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0803e-05 2020-11-16T20:57:52.290 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.290 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.290 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:52.290 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745450+0000", 2020-11-16T20:57:52.291 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8810000000000004e-06 2020-11-16T20:57:52.291 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.291 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.291 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.291 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745455+0000", 2020-11-16T20:57:52.291 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022866499999999999 2020-11-16T20:57:52.291 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.291 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.292 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.292 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745684+0000", 2020-11-16T20:57:52.292 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000132714 2020-11-16T20:57:52.292 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.292 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.292 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:52.292 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745816+0000", 2020-11-16T20:57:52.292 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050117850000000004 2020-11-16T20:57:52.293 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.293 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.293 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:57:52.293 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.750828+0000", 2020-11-16T20:57:52.293 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010413489 2020-11-16T20:57:52.293 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.293 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.294 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:52.294 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.761241+0000", 2020-11-16T20:57:52.294 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028274289999999998 2020-11-16T20:57:52.294 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.294 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.294 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.294 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.764069+0000", 2020-11-16T20:57:52.295 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012880057 2020-11-16T20:57:52.295 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.295 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.295 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.295 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.776949+0000", 2020-11-16T20:57:52.295 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2536e-05 2020-11-16T20:57:52.295 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.295 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.296 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:52.296 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777002+0000", 2020-11-16T20:57:52.296 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8999000000000002e-05 2020-11-16T20:57:52.296 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.296 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.296 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:52.296 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777061+0000", 2020-11-16T20:57:52.297 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031663616999999998 2020-11-16T20:57:52.297 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.297 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:52.297 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.297 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.297 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.297 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2875 4.0 4:055e14cb:::smithi16641208-187:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-11-16T20:57:52.298 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:57:52.298 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 77.422955148, 2020-11-16T20:57:52.298 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031888061000000002, 2020-11-16T20:57:52.298 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:52.298 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:52.298 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:52.298 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:52.298 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:52.299 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2875 2020-11-16T20:57:52.299 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.299 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:52.299 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.299 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:52.299 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:57:52.299 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:52.300 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.300 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.300 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:52.300 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:57:52.300 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0239000000000001e-05 2020-11-16T20:57:52.300 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.300 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.301 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:52.301 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745506+0000", 2020-11-16T20:57:52.301 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.252e-06 2020-11-16T20:57:52.301 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.301 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.301 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:52.301 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745510+0000", 2020-11-16T20:57:52.301 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3670000000000002e-06 2020-11-16T20:57:52.302 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.302 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.302 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:52.302 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745516+0000", 2020-11-16T20:57:52.302 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1089999999999998e-06 2020-11-16T20:57:52.302 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.302 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.303 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.303 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745519+0000", 2020-11-16T20:57:52.303 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045188999999999998 2020-11-16T20:57:52.303 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.303 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.303 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.303 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745971+0000", 2020-11-16T20:57:52.303 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7822999999999998e-05 2020-11-16T20:57:52.304 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.304 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.304 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:52.304 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.746029+0000", 2020-11-16T20:57:52.304 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013333563999999999 2020-11-16T20:57:52.304 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.304 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.305 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.305 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.759362+0000", 2020-11-16T20:57:52.305 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000170896 2020-11-16T20:57:52.305 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.305 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.305 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:52.305 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.759533+0000", 2020-11-16T20:57:52.305 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017572878 2020-11-16T20:57:52.306 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.306 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.306 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.306 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777106+0000", 2020-11-16T20:57:52.306 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014436399999999999 2020-11-16T20:57:52.306 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.306 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.307 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:52.307 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777251+0000", 2020-11-16T20:57:52.307 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012367899999999999 2020-11-16T20:57:52.307 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.307 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.307 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:52.307 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777374+0000", 2020-11-16T20:57:52.308 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031888061000000002 2020-11-16T20:57:52.308 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.308 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:52.308 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.308 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.308 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.308 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3004 3.2 3:4fbd4ff5:::smithi16641208-419:head [copy-from ver 366] snapc 33=[33,25] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e87)", 2020-11-16T20:57:52.309 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.815968+0000", 2020-11-16T20:57:52.309 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 62.352473535000001, 2020-11-16T20:57:52.309 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042048220999999997, 2020-11-16T20:57:52.309 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:52.309 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:52.309 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:52.309 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.310 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:52.310 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.815968+0000", 2020-11-16T20:57:52.310 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:52.310 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.310 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.310 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:52.310 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.815968+0000", 2020-11-16T20:57:52.311 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3235000000000002e-05 2020-11-16T20:57:52.311 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.311 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.311 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:52.311 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816011+0000", 2020-11-16T20:57:52.311 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.303e-06 2020-11-16T20:57:52.311 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.311 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.312 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:52.312 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816019+0000", 2020-11-16T20:57:52.312 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9714999999999999e-05 2020-11-16T20:57:52.312 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.312 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.312 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:52.312 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816049+0000", 2020-11-16T20:57:52.312 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2960000000000001e-06 2020-11-16T20:57:52.313 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.313 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.313 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816056+0000", 2020-11-16T20:57:52.313 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000241606 2020-11-16T20:57:52.313 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.314 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.314 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816298+0000", 2020-11-16T20:57:52.314 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016421599999999999 2020-11-16T20:57:52.314 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.314 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.314 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:52.314 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816462+0000", 2020-11-16T20:57:52.315 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025803994 2020-11-16T20:57:52.315 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.315 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.315 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:52.315 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.842266+0000", 2020-11-16T20:57:52.315 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0072860549999999996 2020-11-16T20:57:52.315 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.315 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.316 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:52.316 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.849552+0000", 2020-11-16T20:57:52.316 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0077911389999999999 2020-11-16T20:57:52.316 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.316 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.316 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.316 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.857343+0000", 2020-11-16T20:57:52.316 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00049728000000000001 2020-11-16T20:57:52.317 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.317 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.317 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.317 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.857841+0000", 2020-11-16T20:57:52.317 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.1997999999999997e-05 2020-11-16T20:57:52.317 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.317 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.318 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:52.318 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.857923+0000", 2020-11-16T20:57:52.318 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3383999999999999e-05 2020-11-16T20:57:52.318 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.318 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.318 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:52.318 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858016+0000", 2020-11-16T20:57:52.318 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042048220999999997 2020-11-16T20:57:52.319 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.319 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:52.319 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.319 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.319 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.319 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:650 3.2 3:4fbd4ff5:::smithi16641208-419:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e87)", 2020-11-16T20:57:52.319 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.816105+0000", 2020-11-16T20:57:52.320 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 62.352335904999997, 2020-11-16T20:57:52.320 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042242304000000001, 2020-11-16T20:57:52.320 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:52.320 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:52.320 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:52.320 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.320 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:52.321 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816105+0000", 2020-11-16T20:57:52.321 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:52.321 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.321 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.321 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:52.321 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816105+0000", 2020-11-16T20:57:52.321 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6486999999999999e-05 2020-11-16T20:57:52.321 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.322 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.322 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:52.322 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816132+0000", 2020-11-16T20:57:52.322 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5230000000000003e-06 2020-11-16T20:57:52.322 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.322 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.322 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:52.323 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816137+0000", 2020-11-16T20:57:52.323 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1498000000000001e-05 2020-11-16T20:57:52.323 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.323 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.323 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:52.323 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816149+0000", 2020-11-16T20:57:52.323 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5789999999999997e-06 2020-11-16T20:57:52.323 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.324 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.324 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.324 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816153+0000", 2020-11-16T20:57:52.324 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00044901199999999999 2020-11-16T20:57:52.324 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.324 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.324 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.325 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816602+0000", 2020-11-16T20:57:52.325 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6134000000000002e-05 2020-11-16T20:57:52.325 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.325 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.325 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:52.325 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816649+0000", 2020-11-16T20:57:52.325 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032065206999999998 2020-11-16T20:57:52.326 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.326 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.326 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.326 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848714+0000", 2020-11-16T20:57:52.326 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000103695 2020-11-16T20:57:52.326 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.326 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.327 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:52.327 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848818+0000", 2020-11-16T20:57:52.327 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092315220000000007 2020-11-16T20:57:52.327 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.327 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.327 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.327 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858049+0000", 2020-11-16T20:57:52.328 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000104415 2020-11-16T20:57:52.328 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.328 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.328 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:52.328 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858153+0000", 2020-11-16T20:57:52.328 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019423199999999999 2020-11-16T20:57:52.328 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.328 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.329 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:52.329 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858348+0000", 2020-11-16T20:57:52.329 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042242304000000001 2020-11-16T20:57:52.329 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.329 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:52.329 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.329 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.330 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.330 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:651 3.2 3:4fbd4ff5:::smithi16641208-419:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e87)", 2020-11-16T20:57:52.330 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.816182+0000", 2020-11-16T20:57:52.330 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 62.352259410000002, 2020-11-16T20:57:52.330 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047784220000000002, 2020-11-16T20:57:52.330 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:52.330 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:52.330 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:52.331 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.331 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:52.331 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816182+0000", 2020-11-16T20:57:52.331 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:52.331 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.331 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.331 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:52.332 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816182+0000", 2020-11-16T20:57:52.332 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6310999999999998e-05 2020-11-16T20:57:52.332 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.332 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.332 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:52.332 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816218+0000", 2020-11-16T20:57:52.332 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6110000000000001e-06 2020-11-16T20:57:52.333 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.333 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.333 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:52.333 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816224+0000", 2020-11-16T20:57:52.333 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9189999999999994e-06 2020-11-16T20:57:52.333 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.333 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.333 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:52.334 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816234+0000", 2020-11-16T20:57:52.334 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3220000000000003e-06 2020-11-16T20:57:52.334 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.334 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.334 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.334 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816238+0000", 2020-11-16T20:57:52.334 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00043294900000000002 2020-11-16T20:57:52.335 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.335 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816671+0000", 2020-11-16T20:57:52.335 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3359999999999998e-05 2020-11-16T20:57:52.335 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:52.336 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816714+0000", 2020-11-16T20:57:52.336 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032137410999999998 2020-11-16T20:57:52.336 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.336 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.336 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.336 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848852+0000", 2020-11-16T20:57:52.336 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000103235 2020-11-16T20:57:52.337 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.337 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.337 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:52.337 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848955+0000", 2020-11-16T20:57:52.337 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094266409999999995 2020-11-16T20:57:52.337 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.337 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.338 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.338 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858382+0000", 2020-11-16T20:57:52.338 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7973999999999995e-05 2020-11-16T20:57:52.338 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.338 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.338 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:52.338 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858470+0000", 2020-11-16T20:57:52.339 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054964870000000004 2020-11-16T20:57:52.339 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.339 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.339 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:52.339 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.863966+0000", 2020-11-16T20:57:52.339 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047784220000000002 2020-11-16T20:57:52.339 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.339 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:52.340 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.340 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.340 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.340 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3541 4.0 4:251c4c06:::smithi16641208-378:head [write 1862271~598221] snapc 55=[55,54] ondisk+write+known_if_redirected e130)", 2020-11-16T20:57:52.340 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.764037+0000", 2020-11-16T20:57:52.340 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 17.404404751000001, 2020-11-16T20:57:52.340 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037702297000000003, 2020-11-16T20:57:52.341 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:52.341 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:52.341 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:52.341 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:52.341 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:52.341 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3541 2020-11-16T20:57:52.341 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.342 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:52.342 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.342 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:52.342 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764037+0000", 2020-11-16T20:57:52.342 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:52.342 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.342 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.342 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:52.343 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764037+0000", 2020-11-16T20:57:52.343 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018829599999999999 2020-11-16T20:57:52.343 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.343 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.343 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:52.343 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764225+0000", 2020-11-16T20:57:52.343 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7600000000000002e-06 2020-11-16T20:57:52.344 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.344 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.344 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:52.344 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764233+0000", 2020-11-16T20:57:52.344 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2991e-05 2020-11-16T20:57:52.344 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.344 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.344 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:52.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764246+0000", 2020-11-16T20:57:52.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7379999999999997e-06 2020-11-16T20:57:52.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.345 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.345 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764252+0000", 2020-11-16T20:57:52.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000195482 2020-11-16T20:57:52.346 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.346 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.346 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.346 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764448+0000", 2020-11-16T20:57:52.346 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3134999999999998e-05 2020-11-16T20:57:52.346 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.346 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.347 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:52.347 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764511+0000", 2020-11-16T20:57:52.347 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024010632000000001 2020-11-16T20:57:52.347 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.347 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.347 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.347 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788522+0000", 2020-11-16T20:57:52.347 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014091200000000001 2020-11-16T20:57:52.348 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.348 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.348 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:52.348 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788662+0000", 2020-11-16T20:57:52.348 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015662400000000001 2020-11-16T20:57:52.348 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.348 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.349 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:57:52.349 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788819+0000", 2020-11-16T20:57:52.349 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0045297089999999998 2020-11-16T20:57:52.349 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.349 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.349 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.349 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.793349+0000", 2020-11-16T20:57:52.350 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061836570000000004 2020-11-16T20:57:52.350 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.350 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:52.350 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.799532+0000", 2020-11-16T20:57:52.350 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0020861299999999998 2020-11-16T20:57:52.350 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.351 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.351 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801619+0000", 2020-11-16T20:57:52.351 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9320999999999996e-05 2020-11-16T20:57:52.351 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.351 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.351 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:52.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801688+0000", 2020-11-16T20:57:52.352 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0909999999999999e-05 2020-11-16T20:57:52.352 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.352 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:52.352 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801739+0000", 2020-11-16T20:57:52.352 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037702297000000003 2020-11-16T20:57:52.352 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.353 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:52.353 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.353 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.353 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.353 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3542 4.0 4:251c4c06:::smithi16641208-378:head [setxattr _header (58) in=7b,truncate 2974971] snapc 55=[55,54] ondisk+write+known_if_redirected e130)", 2020-11-16T20:57:52.353 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.764282+0000", 2020-11-16T20:57:52.353 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 17.404158868, 2020-11-16T20:57:52.353 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037622296999999999, 2020-11-16T20:57:52.354 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:52.354 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:52.354 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:52.354 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:52.354 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:52.354 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3542 2020-11-16T20:57:52.354 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.355 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:52.355 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.355 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:52.355 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764282+0000", 2020-11-16T20:57:52.355 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:52.355 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.355 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.356 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:52.356 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764282+0000", 2020-11-16T20:57:52.356 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0065000000000001e-05 2020-11-16T20:57:52.356 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.356 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.356 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:52.356 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764312+0000", 2020-11-16T20:57:52.356 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2180000000000002e-06 2020-11-16T20:57:52.357 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.357 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.357 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:52.357 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764320+0000", 2020-11-16T20:57:52.357 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1029000000000001e-05 2020-11-16T20:57:52.357 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.357 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.358 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:52.358 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764331+0000", 2020-11-16T20:57:52.358 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4589999999999998e-06 2020-11-16T20:57:52.358 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.358 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.358 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.358 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764334+0000", 2020-11-16T20:57:52.359 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020802799999999999 2020-11-16T20:57:52.359 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.359 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.359 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.359 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764542+0000", 2020-11-16T20:57:52.359 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7712e-05 2020-11-16T20:57:52.359 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.360 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.360 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:52.360 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764590+0000", 2020-11-16T20:57:52.360 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025536256 2020-11-16T20:57:52.360 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.360 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.360 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.361 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790126+0000", 2020-11-16T20:57:52.361 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8548000000000007e-05 2020-11-16T20:57:52.361 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.361 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.361 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:52.361 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790215+0000", 2020-11-16T20:57:52.361 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013994800000000001 2020-11-16T20:57:52.361 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.362 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.362 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:57:52.362 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790355+0000", 2020-11-16T20:57:52.362 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0032107820000000001 2020-11-16T20:57:52.362 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.362 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.362 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.363 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.793565+0000", 2020-11-16T20:57:52.363 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0059758709999999998 2020-11-16T20:57:52.363 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.363 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.363 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:52.363 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.799541+0000", 2020-11-16T20:57:52.363 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002240999 2020-11-16T20:57:52.364 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.364 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.364 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.364 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801782+0000", 2020-11-16T20:57:52.364 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9985000000000003e-05 2020-11-16T20:57:52.364 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.364 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.364 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:52.365 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801842+0000", 2020-11-16T20:57:52.365 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2397000000000006e-05 2020-11-16T20:57:52.365 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.365 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.365 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:52.365 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801905+0000", 2020-11-16T20:57:52.365 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037622296999999999 2020-11-16T20:57:52.366 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.366 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:52.366 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.366 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.366 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.366 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3543 4.0 4:251c4c06:::smithi16641208-378:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e130)", 2020-11-16T20:57:52.366 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.764352+0000", 2020-11-16T20:57:52.367 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 17.404088862999998, 2020-11-16T20:57:52.367 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038764630000000001, 2020-11-16T20:57:52.367 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:52.367 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:52.367 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:52.367 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:52.367 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:52.367 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3543 2020-11-16T20:57:52.368 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.368 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:52.368 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.368 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:52.368 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764352+0000", 2020-11-16T20:57:52.368 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:52.368 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.369 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.369 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:52.369 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764352+0000", 2020-11-16T20:57:52.369 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5197999999999999e-05 2020-11-16T20:57:52.369 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.369 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.369 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:52.369 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764368+0000", 2020-11-16T20:57:52.370 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9960000000000002e-06 2020-11-16T20:57:52.370 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.370 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.370 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:52.370 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764371+0000", 2020-11-16T20:57:52.370 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8810000000000001e-06 2020-11-16T20:57:52.370 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.371 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.371 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:52.371 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764376+0000", 2020-11-16T20:57:52.371 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3949999999999999e-06 2020-11-16T20:57:52.371 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.371 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.371 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.372 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764379+0000", 2020-11-16T20:57:52.372 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023363999999999999 2020-11-16T20:57:52.372 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.372 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.372 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.372 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764613+0000", 2020-11-16T20:57:52.372 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3958999999999997e-05 2020-11-16T20:57:52.372 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.373 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.373 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:52.373 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764656+0000", 2020-11-16T20:57:52.373 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026048794 2020-11-16T20:57:52.373 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.373 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.373 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.374 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790705+0000", 2020-11-16T20:57:52.374 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013058500000000001 2020-11-16T20:57:52.374 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.374 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.374 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:52.374 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790836+0000", 2020-11-16T20:57:52.374 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011100066 2020-11-16T20:57:52.374 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.375 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.375 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.375 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801936+0000", 2020-11-16T20:57:52.375 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3307999999999996e-05 2020-11-16T20:57:52.375 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.375 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.375 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:52.376 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.802019+0000", 2020-11-16T20:57:52.376 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001097808 2020-11-16T20:57:52.376 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.376 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.376 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:52.376 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.803117+0000", 2020-11-16T20:57:52.376 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038764630000000001 2020-11-16T20:57:52.376 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.377 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:52.377 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.377 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.377 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.377 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.5.13:51 3.2 3:4427cc2e:::smithi16641208-332:head [copy-from ver 661] snapc 4f=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e139)", 2020-11-16T20:57:52.377 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:43.986780+0000", 2020-11-16T20:57:52.377 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 8.181661343, 2020-11-16T20:57:52.378 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.040884263999999997, 2020-11-16T20:57:52.378 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:52.378 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:52.378 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:52.378 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.378 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:52.378 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.986780+0000", 2020-11-16T20:57:52.379 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:52.379 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.379 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.379 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:52.379 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.986780+0000", 2020-11-16T20:57:52.379 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0978e-05 2020-11-16T20:57:52.379 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.379 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.380 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:52.380 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.986821+0000", 2020-11-16T20:57:52.380 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6009999999999997e-06 2020-11-16T20:57:52.380 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.380 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.380 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:52.380 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.986826+0000", 2020-11-16T20:57:52.381 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0190000000000001e-05 2020-11-16T20:57:52.381 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.381 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.381 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:52.381 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.986836+0000", 2020-11-16T20:57:52.381 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7900000000000001e-06 2020-11-16T20:57:52.381 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.381 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.382 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.382 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.986839+0000", 2020-11-16T20:57:52.382 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002115179 2020-11-16T20:57:52.382 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.382 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:52.382 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.988955+0000", 2020-11-16T20:57:52.383 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5797000000000006e-05 2020-11-16T20:57:52.383 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.383 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.383 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:52.383 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.989030+0000", 2020-11-16T20:57:52.383 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016622987999999998 2020-11-16T20:57:52.383 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.383 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.384 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:52.384 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:44.005653+0000", 2020-11-16T20:57:52.384 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042403629999999996 2020-11-16T20:57:52.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.384 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:52.384 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:44.009894+0000", 2020-11-16T20:57:52.385 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014512321999999999 2020-11-16T20:57:52.385 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.385 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.385 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.385 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:44.024406+0000", 2020-11-16T20:57:52.385 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003165204 2020-11-16T20:57:52.385 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.385 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.386 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.386 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:44.027571+0000", 2020-11-16T20:57:52.386 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3579999999999999e-05 2020-11-16T20:57:52.386 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.386 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.386 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:52.386 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:44.027615+0000", 2020-11-16T20:57:52.387 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9271999999999999e-05 2020-11-16T20:57:52.387 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:52.387 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:52.387 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:52.387 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:44.027664+0000", 2020-11-16T20:57:52.387 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.040884263999999997 2020-11-16T20:57:52.387 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.388 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:52.388 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.388 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:52.388 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:52.388 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:52.389 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:57:52.390 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:52.395+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:52.490 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:52.495+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:52.538 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:52.538 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:57:52.539 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:57:52.539 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:52.548 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:57:52.590 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:52.596+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:52.691 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:52.696+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:52.725 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:52.725 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:57:52.725 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:57:52.725 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:57:52.725 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:52.734 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:57:52.806 INFO:tasks.rados.rados.0.smithi166.stdout:1183: done (6 left) 2020-11-16T20:57:52.806 INFO:tasks.rados.rados.0.smithi166.stdout:1184: write oid 366 current snap is 54 2020-11-16T20:57:52.806 INFO:tasks.rados.rados.0.smithi166.stdout:1184: seq_num 678 ranges {595146=574239,1891615=669554,3219142=176004} 2020-11-16T20:57:52.809 INFO:tasks.rados.rados.0.smithi166.stdout:1184: writing smithi16641208-366 from 595146 to 1169385 tid 1 2020-11-16T20:57:52.817 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:52.822+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:52.818 INFO:tasks.rados.rados.0.smithi166.stdout:1184: writing smithi16641208-366 from 1891615 to 2561169 tid 2 2020-11-16T20:57:52.821 INFO:teuthology.orchestra.run.smithi166.stderr:noscrub is set 2020-11-16T20:57:52.823 INFO:tasks.rados.rados.0.smithi166.stdout:1184: writing smithi16641208-366 from 3219142 to 3395146 tid 3 2020-11-16T20:57:52.823 INFO:tasks.rados.rados.0.smithi166.stdout:1185: cache_try_flush oid 310 snap -1 2020-11-16T20:57:52.823 INFO:tasks.rados.rados.0.smithi166.stdout:1182: got (2) No such file or directory 2020-11-16T20:57:52.824 INFO:tasks.rados.rados.0.smithi166.stdout:1182: done (7 left) 2020-11-16T20:57:52.824 INFO:tasks.rados.rados.0.smithi166.stdout:1186: rollback oid 107 current snap is 54 2020-11-16T20:57:52.824 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 107 to 52 2020-11-16T20:57:52.824 INFO:tasks.rados.rados.0.smithi166.stdout:1187: snap_remove snap 51 2020-11-16T20:57:52.891 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:52.897+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:52.921 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:52.922 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:57:52.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:57:52.922 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:57:52.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.922 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2370 4.1 4:82bb0fe7:::smithi16641208-101:head [write 2346424~426830] snapc 7=[7,6,5,4,3,2] ondisk+write+known_if_redirected e42)", 2020-11-16T20:57:52.922 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:57:52.923 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 107.87059898699999, 2020-11-16T20:57:52.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04706581, 2020-11-16T20:57:52.923 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:52.923 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:52.923 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:52.923 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:52.923 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:52.924 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2370 2020-11-16T20:57:52.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.924 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:52.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:52.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:57:52.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:52.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.925 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:52.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.054283+0000", 2020-11-16T20:57:52.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011081520000000001 2020-11-16T20:57:52.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:52.926 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055391+0000", 2020-11-16T20:57:52.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8289999999999996e-06 2020-11-16T20:57:52.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:52.926 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055397+0000", 2020-11-16T20:57:52.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7599999999999997e-06 2020-11-16T20:57:52.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:52.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055407+0000", 2020-11-16T20:57:52.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4180000000000002e-06 2020-11-16T20:57:52.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055413+0000", 2020-11-16T20:57:52.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1767000000000001e-05 2020-11-16T20:57:52.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:52.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055465+0000", 2020-11-16T20:57:52.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1916999999999998e-05 2020-11-16T20:57:52.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:52.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055517+0000", 2020-11-16T20:57:52.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027302192999999999 2020-11-16T20:57:52.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:52.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.082819+0000", 2020-11-16T20:57:52.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013272199999999999 2020-11-16T20:57:52.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:52.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.082952+0000", 2020-11-16T20:57:52.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000218574 2020-11-16T20:57:52.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.931 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:52.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.083171+0000", 2020-11-16T20:57:52.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016037374 2020-11-16T20:57:52.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:52.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099208+0000", 2020-11-16T20:57:52.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001621248 2020-11-16T20:57:52.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.933 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100829+0000", 2020-11-16T20:57:52.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039884700000000003 2020-11-16T20:57:52.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.933 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.933 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101228+0000", 2020-11-16T20:57:52.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1977000000000006e-05 2020-11-16T20:57:52.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:52.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101300+0000", 2020-11-16T20:57:52.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9032000000000001e-05 2020-11-16T20:57:52.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:52.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101349+0000", 2020-11-16T20:57:52.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.04706581 2020-11-16T20:57:52.935 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:52.935 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:52.935 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:52.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.936 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2372 4.1 4:82bb0fe7:::smithi16641208-101:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e42)", 2020-11-16T20:57:52.936 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:57:52.936 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 107.869370041, 2020-11-16T20:57:52.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046557016999999999, 2020-11-16T20:57:52.936 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:52.936 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:52.936 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:52.936 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:52.937 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:52.937 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2372 2020-11-16T20:57:52.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.937 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:52.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:52.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:57:52.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:52.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:52.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055512+0000", 2020-11-16T20:57:52.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9907000000000001e-05 2020-11-16T20:57:52.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:52.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055532+0000", 2020-11-16T20:57:52.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0599999999999999e-06 2020-11-16T20:57:52.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:52.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055535+0000", 2020-11-16T20:57:52.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1430000000000003e-06 2020-11-16T20:57:52.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:52.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055541+0000", 2020-11-16T20:57:52.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6819999999999999e-06 2020-11-16T20:57:52.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055544+0000", 2020-11-16T20:57:52.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000102643 2020-11-16T20:57:52.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:52.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055647+0000", 2020-11-16T20:57:52.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7197000000000003e-05 2020-11-16T20:57:52.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.942 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:52.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.055684+0000", 2020-11-16T20:57:52.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029347807 2020-11-16T20:57:52.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:52.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.085032+0000", 2020-11-16T20:57:52.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6130000000000005e-05 2020-11-16T20:57:52.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:52.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.085108+0000", 2020-11-16T20:57:52.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016542980999999998 2020-11-16T20:57:52.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.944 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:52.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101651+0000", 2020-11-16T20:57:52.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000118733 2020-11-16T20:57:52.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:52.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.101769+0000", 2020-11-16T20:57:52.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029973400000000001 2020-11-16T20:57:52.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:52.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.102069+0000", 2020-11-16T20:57:52.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.046557016999999999 2020-11-16T20:57:52.946 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:52.946 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:52.946 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:52.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.947 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2503 4.1 4:b0538c7c:::smithi16641208-136:head [write 1790337~563515] snapc f=[f,e,d,5] ondisk+write+known_if_redirected e52)", 2020-11-16T20:57:52.947 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:57:52.947 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.178174537999993, 2020-11-16T20:57:52.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089724989000000005, 2020-11-16T20:57:52.947 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:52.947 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:52.947 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:52.947 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:52.948 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:52.948 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2503 2020-11-16T20:57:52.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.948 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:52.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:52.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:57:52.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:52.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:52.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.746708+0000", 2020-11-16T20:57:52.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00060419599999999999 2020-11-16T20:57:52.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:52.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747312+0000", 2020-11-16T20:57:52.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.319e-06 2020-11-16T20:57:52.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:52.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747318+0000", 2020-11-16T20:57:52.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5100000000000004e-06 2020-11-16T20:57:52.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:52.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747328+0000", 2020-11-16T20:57:52.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6369999999999999e-06 2020-11-16T20:57:52.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.952 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.952 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747335+0000", 2020-11-16T20:57:52.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001800479 2020-11-16T20:57:52.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.952 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:52.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749136+0000", 2020-11-16T20:57:52.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7970000000000002e-05 2020-11-16T20:57:52.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.953 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.953 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:52.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749194+0000", 2020-11-16T20:57:52.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030847998000000001 2020-11-16T20:57:52.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:52.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780042+0000", 2020-11-16T20:57:52.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013142199999999999 2020-11-16T20:57:52.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:52.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780173+0000", 2020-11-16T20:57:52.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022398200000000001 2020-11-16T20:57:52.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:57:52.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.780397+0000", 2020-11-16T20:57:52.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061389269999999998 2020-11-16T20:57:52.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786536+0000", 2020-11-16T20:57:52.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3673999999999998e-05 2020-11-16T20:57:52.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:52.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786630+0000", 2020-11-16T20:57:52.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049513384000000001 2020-11-16T20:57:52.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836143+0000", 2020-11-16T20:57:52.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4713000000000001e-05 2020-11-16T20:57:52.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:52.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836218+0000", 2020-11-16T20:57:52.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000214778 2020-11-16T20:57:52.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:52.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836433+0000", 2020-11-16T20:57:52.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089724989000000005 2020-11-16T20:57:52.959 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:52.959 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:52.959 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:52.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.960 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2504 4.1 4:b0538c7c:::smithi16641208-136:head [setxattr _header (58) in=7b,truncate 2991745] snapc f=[f,e,d,5] ondisk+write+known_if_redirected e52)", 2020-11-16T20:57:52.960 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:57:52.960 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.177500167999995, 2020-11-16T20:57:52.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089341162000000002, 2020-11-16T20:57:52.960 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:52.960 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:52.961 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:52.961 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:52.961 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:52.961 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2504 2020-11-16T20:57:52.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.961 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:52.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:52.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:57:52.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:52.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:52.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747382+0000", 2020-11-16T20:57:52.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5520999999999999e-05 2020-11-16T20:57:52.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:52.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747438+0000", 2020-11-16T20:57:52.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1319999999999999e-06 2020-11-16T20:57:52.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:52.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747444+0000", 2020-11-16T20:57:52.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.661e-06 2020-11-16T20:57:52.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:52.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747451+0000", 2020-11-16T20:57:52.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6920000000000001e-06 2020-11-16T20:57:52.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747456+0000", 2020-11-16T20:57:52.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0017949769999999999 2020-11-16T20:57:52.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:52.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749251+0000", 2020-11-16T20:57:52.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114708 2020-11-16T20:57:52.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:52.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749366+0000", 2020-11-16T20:57:52.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032215049000000003 2020-11-16T20:57:52.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:52.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.781581+0000", 2020-11-16T20:57:52.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000181452 2020-11-16T20:57:52.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:52.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.781762+0000", 2020-11-16T20:57:52.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024118300000000001 2020-11-16T20:57:52.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:57:52.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782003+0000", 2020-11-16T20:57:52.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045997939999999999 2020-11-16T20:57:52.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786603+0000", 2020-11-16T20:57:52.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8782000000000002e-05 2020-11-16T20:57:52.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:52.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.786642+0000", 2020-11-16T20:57:52.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049869098000000001 2020-11-16T20:57:52.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836511+0000", 2020-11-16T20:57:52.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4498000000000005e-05 2020-11-16T20:57:52.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:52.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836576+0000", 2020-11-16T20:57:52.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000147615 2020-11-16T20:57:52.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:52.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836723+0000", 2020-11-16T20:57:52.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089341162000000002 2020-11-16T20:57:52.972 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:52.972 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:52.972 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:52.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.973 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2505 4.1 4:b0538c7c:::smithi16641208-136:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e52)", 2020-11-16T20:57:52.973 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:57:52.973 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 98.177391040000003, 2020-11-16T20:57:52.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089929617000000003, 2020-11-16T20:57:52.973 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:52.974 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:52.974 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:52.974 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:52.974 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:52.974 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2505 2020-11-16T20:57:52.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.974 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:52.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:52.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:57:52.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:52.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:52.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747491+0000", 2020-11-16T20:57:52.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1894999999999999e-05 2020-11-16T20:57:52.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.976 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:52.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747523+0000", 2020-11-16T20:57:52.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3900000000000003e-06 2020-11-16T20:57:52.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:52.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747527+0000", 2020-11-16T20:57:52.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8169999999999999e-06 2020-11-16T20:57:52.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:52.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747535+0000", 2020-11-16T20:57:52.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6449999999999998e-06 2020-11-16T20:57:52.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.747539+0000", 2020-11-16T20:57:52.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0018868209999999999 2020-11-16T20:57:52.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:52.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749426+0000", 2020-11-16T20:57:52.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4963000000000002e-05 2020-11-16T20:57:52.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:52.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.749481+0000", 2020-11-16T20:57:52.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032915959000000002 2020-11-16T20:57:52.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:52.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782397+0000", 2020-11-16T20:57:52.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018449499999999999 2020-11-16T20:57:52.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:52.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.782581+0000", 2020-11-16T20:57:52.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054195457000000002 2020-11-16T20:57:52.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:52.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836777+0000", 2020-11-16T20:57:52.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000214584 2020-11-16T20:57:52.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:52.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.836991+0000", 2020-11-16T20:57:52.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000429591 2020-11-16T20:57:52.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:52.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:14.837421+0000", 2020-11-16T20:57:52.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.089929617000000003 2020-11-16T20:57:52.983 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:52.984 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:52.984 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:52.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.984 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2593 3.3 3:f5f8fa2a:::smithi16641208-144:head [copy-from ver 64] snapc 14=[12,f,5] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e57)", 2020-11-16T20:57:52.984 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:57:52.984 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 93.138242179000002, 2020-11-16T20:57:52.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064638111999999998, 2020-11-16T20:57:52.985 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:52.985 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:52.985 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:52.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:52.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:57:52.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:52.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:52.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786640+0000", 2020-11-16T20:57:52.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3655999999999998e-05 2020-11-16T20:57:52.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:52.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786664+0000", 2020-11-16T20:57:52.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1850000000000003e-06 2020-11-16T20:57:52.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:52.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786669+0000", 2020-11-16T20:57:52.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0861e-05 2020-11-16T20:57:52.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:52.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786680+0000", 2020-11-16T20:57:52.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6749999999999996e-06 2020-11-16T20:57:52.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:52.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786686+0000", 2020-11-16T20:57:52.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2327000000000003e-05 2020-11-16T20:57:52.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:52.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786729+0000", 2020-11-16T20:57:52.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000156143 2020-11-16T20:57:52.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:52.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786885+0000", 2020-11-16T20:57:52.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024103846000000002 2020-11-16T20:57:52.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:57:52.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810989+0000", 2020-11-16T20:57:52.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018870436000000001 2020-11-16T20:57:52.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829859+0000", 2020-11-16T20:57:52.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021210896 2020-11-16T20:57:52.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:52.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851070+0000", 2020-11-16T20:57:52.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3708e-05 2020-11-16T20:57:52.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:52.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851084+0000", 2020-11-16T20:57:52.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7329e-05 2020-11-16T20:57:52.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:52.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851131+0000", 2020-11-16T20:57:52.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014705 2020-11-16T20:57:52.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:52.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851278+0000", 2020-11-16T20:57:52.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064638111999999998 2020-11-16T20:57:52.994 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:52.995 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:52.995 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:52.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.995 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:616 3.3 3:f5f8fa2a:::smithi16641208-144:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e57)", 2020-11-16T20:57:52.995 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:57:52.995 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 93.138151524999998, 2020-11-16T20:57:52.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064784234999999996, 2020-11-16T20:57:52.996 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:52.996 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:52.996 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:52.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:52.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:57:52.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:52.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:52.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786731+0000", 2020-11-16T20:57:52.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8559999999999998e-05 2020-11-16T20:57:52.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:52.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786749+0000", 2020-11-16T20:57:52.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4549999999999997e-06 2020-11-16T20:57:52.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:52.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786754+0000", 2020-11-16T20:57:52.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4980000000000006e-06 2020-11-16T20:57:52.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:52.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:52.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:52.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786762+0000", 2020-11-16T20:57:52.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9790000000000004e-06 2020-11-16T20:57:53.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786766+0000", 2020-11-16T20:57:53.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029976900000000002 2020-11-16T20:57:53.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787066+0000", 2020-11-16T20:57:53.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3581999999999998e-05 2020-11-16T20:57:53.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:53.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787100+0000", 2020-11-16T20:57:53.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.037252078000000001 2020-11-16T20:57:53.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824352+0000", 2020-11-16T20:57:53.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000124189 2020-11-16T20:57:53.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:53.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.824476+0000", 2020-11-16T20:57:53.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026883987000000002 2020-11-16T20:57:53.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851360+0000", 2020-11-16T20:57:53.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6365999999999994e-05 2020-11-16T20:57:53.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851426+0000", 2020-11-16T20:57:53.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8771999999999996e-05 2020-11-16T20:57:53.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851515+0000", 2020-11-16T20:57:53.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.064784234999999996 2020-11-16T20:57:53.005 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.005 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.005 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.006 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:617 3.3 3:f5f8fa2a:::smithi16641208-144:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e57)", 2020-11-16T20:57:53.006 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:57:53.006 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 93.138081209999996, 2020-11-16T20:57:53.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.069756316999999998, 2020-11-16T20:57:53.006 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.006 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:53.007 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:57:53.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786801+0000", 2020-11-16T20:57:53.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3865000000000002e-05 2020-11-16T20:57:53.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786835+0000", 2020-11-16T20:57:53.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6949999999999999e-06 2020-11-16T20:57:53.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786840+0000", 2020-11-16T20:57:53.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3559999999999999e-06 2020-11-16T20:57:53.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786849+0000", 2020-11-16T20:57:53.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.045e-06 2020-11-16T20:57:53.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.786854+0000", 2020-11-16T20:57:53.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026743999999999997 2020-11-16T20:57:53.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787121+0000", 2020-11-16T20:57:53.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8912000000000001e-05 2020-11-16T20:57:53.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:53.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.787180+0000", 2020-11-16T20:57:53.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.042545010000000001 2020-11-16T20:57:53.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829725+0000", 2020-11-16T20:57:53.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3979000000000003e-05 2020-11-16T20:57:53.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:53.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829819+0000", 2020-11-16T20:57:53.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021745652000000001 2020-11-16T20:57:53.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851565+0000", 2020-11-16T20:57:53.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000102064 2020-11-16T20:57:53.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851667+0000", 2020-11-16T20:57:53.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048902989999999999 2020-11-16T20:57:53.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856557+0000", 2020-11-16T20:57:53.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.069756316999999998 2020-11-16T20:57:53.015 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.016 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.016 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.016 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:618 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'243, mlcod=57'241)", 2020-11-16T20:57:53.016 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:57:53.016 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 93.125262086000006, 2020-11-16T20:57:53.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048895281999999998, 2020-11-16T20:57:53.017 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.017 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:53.017 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:57:53.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.799620+0000", 2020-11-16T20:57:53.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017163861999999998 2020-11-16T20:57:53.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816784+0000", 2020-11-16T20:57:53.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7071e-05 2020-11-16T20:57:53.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816801+0000", 2020-11-16T20:57:53.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6405e-05 2020-11-16T20:57:53.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816818+0000", 2020-11-16T20:57:53.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3030999999999999e-05 2020-11-16T20:57:53.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816831+0000", 2020-11-16T20:57:53.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4610000000000007e-05 2020-11-16T20:57:53.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816895+0000", 2020-11-16T20:57:53.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4202999999999998e-05 2020-11-16T20:57:53.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.816929+0000", 2020-11-16T20:57:53.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.031527016999999997 2020-11-16T20:57:53.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:53.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.848456+0000", 2020-11-16T20:57:53.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9083000000000003e-05 2020-11-16T20:57:53.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.848515+0000", 2020-11-16T20:57:53.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048895281999999998 2020-11-16T20:57:53.024 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.024 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.024 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.024 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:618 3.3 3:d775beee:::smithi16641208-10:head [copy-from ver 12] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:57:53.025 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:57:53.025 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 93.116080017000002, 2020-11-16T20:57:53.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047870862, 2020-11-16T20:57:53.025 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.025 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:53.025 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:57:53.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808802+0000", 2020-11-16T20:57:53.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0958999999999999e-05 2020-11-16T20:57:53.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808843+0000", 2020-11-16T20:57:53.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1294000000000001e-05 2020-11-16T20:57:53.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.028 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.028 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808854+0000", 2020-11-16T20:57:53.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8553999999999997e-05 2020-11-16T20:57:53.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.028 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.028 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808893+0000", 2020-11-16T20:57:53.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1985e-05 2020-11-16T20:57:53.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.029 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808905+0000", 2020-11-16T20:57:53.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7309000000000001e-05 2020-11-16T20:57:53.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.808982+0000", 2020-11-16T20:57:53.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016374099999999999 2020-11-16T20:57:53.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809146+0000", 2020-11-16T20:57:53.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015955815000000002 2020-11-16T20:57:53.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:57:53.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.825102+0000", 2020-11-16T20:57:53.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0048434799999999998 2020-11-16T20:57:53.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.829945+0000", 2020-11-16T20:57:53.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021349677000000001 2020-11-16T20:57:53.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:53.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851295+0000", 2020-11-16T20:57:53.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052994100000000001 2020-11-16T20:57:53.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.033 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.033 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856594+0000", 2020-11-16T20:57:53.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3349000000000001e-05 2020-11-16T20:57:53.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:53.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856638+0000", 2020-11-16T20:57:53.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5289e-05 2020-11-16T20:57:53.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856673+0000", 2020-11-16T20:57:53.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047870862 2020-11-16T20:57:53.035 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.035 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.035 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.035 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:619 3.3 3:d79d68cf:::smithi16641208-37:head [copy-from ver 27] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:57:53.036 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:57:53.036 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 93.115521427000004, 2020-11-16T20:57:53.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047415915000000003, 2020-11-16T20:57:53.036 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.036 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:53.036 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:57:53.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809361+0000", 2020-11-16T20:57:53.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3012000000000002e-05 2020-11-16T20:57:53.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.038 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.038 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809394+0000", 2020-11-16T20:57:53.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1699999999999996e-06 2020-11-16T20:57:53.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809399+0000", 2020-11-16T20:57:53.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2390000000000008e-06 2020-11-16T20:57:53.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809408+0000", 2020-11-16T20:57:53.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0259999999999998e-06 2020-11-16T20:57:53.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809413+0000", 2020-11-16T20:57:53.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0359999999999996e-05 2020-11-16T20:57:53.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809494+0000", 2020-11-16T20:57:53.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019616600000000001 2020-11-16T20:57:53.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.809690+0000", 2020-11-16T20:57:53.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017673003999999999 2020-11-16T20:57:53.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:57:53.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.827363+0000", 2020-11-16T20:57:53.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006463033 2020-11-16T20:57:53.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.833826+0000", 2020-11-16T20:57:53.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017479913999999999 2020-11-16T20:57:53.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:53.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.851306+0000", 2020-11-16T20:57:53.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054026500000000002 2020-11-16T20:57:53.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856708+0000", 2020-11-16T20:57:53.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8121999999999999e-05 2020-11-16T20:57:53.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:53.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856747+0000", 2020-11-16T20:57:53.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0219e-05 2020-11-16T20:57:53.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.856777+0000", 2020-11-16T20:57:53.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.047415915000000003 2020-11-16T20:57:53.046 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.046 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.046 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.047 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2994 4.1 4:81514658:::smithi16641208-76:head [rollback 25] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:53.047 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:48.838310+0000", 2020-11-16T20:57:53.047 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 64.086572234000002, 2020-11-16T20:57:53.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.058717898999999997, 2020-11-16T20:57:53.047 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.047 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:53.047 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:53.048 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:53.048 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:53.048 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2994 2020-11-16T20:57:53.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.048 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838310+0000", 2020-11-16T20:57:53.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.049 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838310+0000", 2020-11-16T20:57:53.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6189e-05 2020-11-16T20:57:53.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.050 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.050 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838326+0000", 2020-11-16T20:57:53.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7750000000000001e-06 2020-11-16T20:57:53.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.050 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838329+0000", 2020-11-16T20:57:53.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1170000000000003e-06 2020-11-16T20:57:53.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.051 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838334+0000", 2020-11-16T20:57:53.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5509999999999998e-06 2020-11-16T20:57:53.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.052 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838337+0000", 2020-11-16T20:57:53.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4969999999999995e-05 2020-11-16T20:57:53.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838422+0000", 2020-11-16T20:57:53.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6809999999999998e-06 2020-11-16T20:57:53.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.053 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:53.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838429+0000", 2020-11-16T20:57:53.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0036974120000000002 2020-11-16T20:57:53.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.054 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.054 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.842127+0000", 2020-11-16T20:57:53.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7267000000000005e-05 2020-11-16T20:57:53.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:53.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.842194+0000", 2020-11-16T20:57:53.055 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.036580992999999999 2020-11-16T20:57:53.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.878775+0000", 2020-11-16T20:57:53.055 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015282199999999999 2020-11-16T20:57:53.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.056 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.056 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.878928+0000", 2020-11-16T20:57:53.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025942000000000001 2020-11-16T20:57:53.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:53.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879187+0000", 2020-11-16T20:57:53.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6735000000000003e-05 2020-11-16T20:57:53.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:53.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879264+0000", 2020-11-16T20:57:53.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0079699739999999995 2020-11-16T20:57:53.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.058 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.058 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.887234+0000", 2020-11-16T20:57:53.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011584899999999999 2020-11-16T20:57:53.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.059 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.059 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.887350+0000", 2020-11-16T20:57:53.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019960799999999999 2020-11-16T20:57:53.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.059 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:57:53.059 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.887549+0000", 2020-11-16T20:57:53.060 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059496410000000003 2020-11-16T20:57:53.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.060 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.060 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.060 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893499+0000", 2020-11-16T20:57:53.060 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8387999999999997e-05 2020-11-16T20:57:53.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.060 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for ondisk", 2020-11-16T20:57:53.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893557+0000", 2020-11-16T20:57:53.061 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1730000000000005e-05 2020-11-16T20:57:53.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893639+0000", 2020-11-16T20:57:53.062 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0030284309999999998 2020-11-16T20:57:53.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.062 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.062 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:53.062 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.896668+0000", 2020-11-16T20:57:53.062 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024878999999999998 2020-11-16T20:57:53.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.062 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.063 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.896916+0000", 2020-11-16T20:57:53.063 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6546999999999998e-05 2020-11-16T20:57:53.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:53.063 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.896983+0000", 2020-11-16T20:57:53.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5009000000000002e-05 2020-11-16T20:57:53.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.064 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.064 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.897028+0000", 2020-11-16T20:57:53.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.058717898999999997 2020-11-16T20:57:53.064 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.065 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.065 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.065 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:2995 4.1 4:81514658:::smithi16641208-76:head [append 0~0] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:57:53.065 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:48.838353+0000", 2020-11-16T20:57:53.065 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 64.086528974000004, 2020-11-16T20:57:53.065 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.061235559000000002, 2020-11-16T20:57:53.066 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.066 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:53.066 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:53.066 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:53.066 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:53.066 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 2995 2020-11-16T20:57:53.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.067 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.067 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.067 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838353+0000", 2020-11-16T20:57:53.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.068 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838353+0000", 2020-11-16T20:57:53.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5333e-05 2020-11-16T20:57:53.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.068 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838369+0000", 2020-11-16T20:57:53.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6699999999999998e-06 2020-11-16T20:57:53.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.069 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.069 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838371+0000", 2020-11-16T20:57:53.069 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9450000000000001e-06 2020-11-16T20:57:53.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.070 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.070 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838376+0000", 2020-11-16T20:57:53.070 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3810000000000002e-06 2020-11-16T20:57:53.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.070 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.070 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.070 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838379+0000", 2020-11-16T20:57:53.071 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6501000000000006e-05 2020-11-16T20:57:53.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.071 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.071 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838445+0000", 2020-11-16T20:57:53.071 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7589999999999999e-06 2020-11-16T20:57:53.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.072 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:53.072 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.838449+0000", 2020-11-16T20:57:53.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003788249 2020-11-16T20:57:53.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.072 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.072 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.842237+0000", 2020-11-16T20:57:53.073 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4104999999999997e-05 2020-11-16T20:57:53.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.073 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:53.073 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.842301+0000", 2020-11-16T20:57:53.073 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.037139272000000001 2020-11-16T20:57:53.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879440+0000", 2020-11-16T20:57:53.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3401e-05 2020-11-16T20:57:53.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:53.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.879484+0000", 2020-11-16T20:57:53.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014179615 2020-11-16T20:57:53.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.075 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.075 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893664+0000", 2020-11-16T20:57:53.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6710000000000002e-05 2020-11-16T20:57:53.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.076 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.076 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893750+0000", 2020-11-16T20:57:53.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015452900000000001 2020-11-16T20:57:53.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.076 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:57:53.076 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.893905+0000", 2020-11-16T20:57:53.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0013753280000000001 2020-11-16T20:57:53.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.895280+0000", 2020-11-16T20:57:53.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014309889999999999 2020-11-16T20:57:53.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.078 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:53.078 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.896711+0000", 2020-11-16T20:57:53.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0027635649999999999 2020-11-16T20:57:53.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.078 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.899475+0000", 2020-11-16T20:57:53.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3380999999999997e-05 2020-11-16T20:57:53.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:53.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.899518+0000", 2020-11-16T20:57:53.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0826000000000003e-05 2020-11-16T20:57:53.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.080 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.080 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:48.899589+0000", 2020-11-16T20:57:53.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.061235559000000002 2020-11-16T20:57:53.080 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.080 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.080 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.081 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3414 3.3 3:cf270c70:::smithi16641208-423:head [copy-from ver 586] snapc 4f=[4f,48] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e120)", 2020-11-16T20:57:53.081 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:24.761756+0000", 2020-11-16T20:57:53.081 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.163126127999998, 2020-11-16T20:57:53.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.053488604000000002, 2020-11-16T20:57:53.081 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.082 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:53.082 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761756+0000", 2020-11-16T20:57:53.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761756+0000", 2020-11-16T20:57:53.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5970000000000006e-05 2020-11-16T20:57:53.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761832+0000", 2020-11-16T20:57:53.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4884e-05 2020-11-16T20:57:53.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761847+0000", 2020-11-16T20:57:53.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6169999999999998e-05 2020-11-16T20:57:53.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.085 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.085 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761873+0000", 2020-11-16T20:57:53.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5098e-05 2020-11-16T20:57:53.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.085 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.085 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761888+0000", 2020-11-16T20:57:53.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6729000000000003e-05 2020-11-16T20:57:53.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.086 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761965+0000", 2020-11-16T20:57:53.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0786e-05 2020-11-16T20:57:53.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.087 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2020-11-16T20:57:53.087 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761976+0000", 2020-11-16T20:57:53.087 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011800241 2020-11-16T20:57:53.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.087 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.773776+0000", 2020-11-16T20:57:53.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000228559 2020-11-16T20:57:53.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.774005+0000", 2020-11-16T20:57:53.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020761585999999999 2020-11-16T20:57:53.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.089 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.089 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:57:53.089 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.794766+0000", 2020-11-16T20:57:53.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013313459 2020-11-16T20:57:53.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.089 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.089 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.090 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.808080+0000", 2020-11-16T20:57:53.090 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0063703730000000004 2020-11-16T20:57:53.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.090 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.090 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.090 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.814450+0000", 2020-11-16T20:57:53.090 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00063777099999999998 2020-11-16T20:57:53.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.091 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.091 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:53.091 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.815088+0000", 2020-11-16T20:57:53.091 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4383999999999998e-05 2020-11-16T20:57:53.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.091 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.091 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:53.092 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.815162+0000", 2020-11-16T20:57:53.092 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2594000000000002e-05 2020-11-16T20:57:53.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.092 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.092 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.092 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.815245+0000", 2020-11-16T20:57:53.092 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.053488604000000002 2020-11-16T20:57:53.093 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.093 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.093 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.093 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.093 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.1.13:756 3.3 3:cf270c70:::smithi16641208-423:head [stat] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+known_if_redirected e120)", 2020-11-16T20:57:53.093 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:24.761953+0000", 2020-11-16T20:57:53.094 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.162929130999999, 2020-11-16T20:57:53.094 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.053471185999999997, 2020-11-16T20:57:53.094 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.094 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:53.094 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.094 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.094 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.094 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761953+0000", 2020-11-16T20:57:53.095 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.095 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.095 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.095 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761953+0000", 2020-11-16T20:57:53.095 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9965000000000001e-05 2020-11-16T20:57:53.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.096 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.096 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.096 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.761993+0000", 2020-11-16T20:57:53.096 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2689999999999999e-06 2020-11-16T20:57:53.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.096 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.096 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.097 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762001+0000", 2020-11-16T20:57:53.097 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0395999999999999e-05 2020-11-16T20:57:53.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.097 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.097 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.097 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762022+0000", 2020-11-16T20:57:53.097 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0159000000000001e-05 2020-11-16T20:57:53.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.098 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.098 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.098 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762042+0000", 2020-11-16T20:57:53.098 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6938000000000002e-05 2020-11-16T20:57:53.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.098 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.098 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.099 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762109+0000", 2020-11-16T20:57:53.099 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1065e-05 2020-11-16T20:57:53.099 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.099 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.099 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:53.099 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762120+0000", 2020-11-16T20:57:53.099 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012140096 2020-11-16T20:57:53.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.100 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.100 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.100 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.774260+0000", 2020-11-16T20:57:53.100 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6675999999999997e-05 2020-11-16T20:57:53.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.100 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.100 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:53.101 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.774327+0000", 2020-11-16T20:57:53.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029616773999999998 2020-11-16T20:57:53.101 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.101 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.101 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.803943+0000", 2020-11-16T20:57:53.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9145e-05 2020-11-16T20:57:53.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.102 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.102 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:53.102 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.804043+0000", 2020-11-16T20:57:53.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011230571 2020-11-16T20:57:53.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.102 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.103 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.103 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.815273+0000", 2020-11-16T20:57:53.103 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7762999999999995e-05 2020-11-16T20:57:53.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.103 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.103 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.815341+0000", 2020-11-16T20:57:53.103 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3368999999999994e-05 2020-11-16T20:57:53.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.815424+0000", 2020-11-16T20:57:53.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.053471185999999997 2020-11-16T20:57:53.104 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.104 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.105 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.105 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.1.13:757 3.3 3:f6d44bd7:::smithi16641208-454:head [copy-from ver 347] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e120)", 2020-11-16T20:57:53.105 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:24.762096+0000", 2020-11-16T20:57:53.105 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 28.162786504, 2020-11-16T20:57:53.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054426929999999998, 2020-11-16T20:57:53.106 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.106 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:53.106 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.106 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.106 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.106 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762096+0000", 2020-11-16T20:57:53.106 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.107 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.107 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.107 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762096+0000", 2020-11-16T20:57:53.107 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1792000000000002e-05 2020-11-16T20:57:53.107 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.107 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.107 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.108 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762148+0000", 2020-11-16T20:57:53.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7875000000000001e-05 2020-11-16T20:57:53.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.108 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.108 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.108 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762165+0000", 2020-11-16T20:57:53.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8303000000000001e-05 2020-11-16T20:57:53.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.109 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.109 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.109 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762184+0000", 2020-11-16T20:57:53.109 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.499e-06 2020-11-16T20:57:53.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.109 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.109 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.110 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762193+0000", 2020-11-16T20:57:53.110 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6016999999999997e-05 2020-11-16T20:57:53.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.110 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.110 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.110 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762239+0000", 2020-11-16T20:57:53.110 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5139e-05 2020-11-16T20:57:53.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.111 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.111 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:53.111 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.762254+0000", 2020-11-16T20:57:53.111 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01212732 2020-11-16T20:57:53.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.111 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.111 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.112 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.774382+0000", 2020-11-16T20:57:53.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000163406 2020-11-16T20:57:53.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.112 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.112 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.112 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.774545+0000", 2020-11-16T20:57:53.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.025303895 2020-11-16T20:57:53.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,6", 2020-11-16T20:57:53.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.799849+0000", 2020-11-16T20:57:53.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011849052000000001 2020-11-16T20:57:53.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.811698+0000", 2020-11-16T20:57:53.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0042176150000000001 2020-11-16T20:57:53.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.114 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:53.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.815916+0000", 2020-11-16T20:57:53.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00050456899999999996 2020-11-16T20:57:53.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.115 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.115 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.115 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.816420+0000", 2020-11-16T20:57:53.115 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8441000000000004e-05 2020-11-16T20:57:53.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.115 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:53.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.816489+0000", 2020-11-16T20:57:53.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4007000000000002e-05 2020-11-16T20:57:53.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.116 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:24.816523+0000", 2020-11-16T20:57:53.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.054426929999999998 2020-11-16T20:57:53.117 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.117 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.117 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.117 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.117 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.117 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3532 4.1 4:b7adb356:::smithi16641208-217:head [copy-from ver 367] snapc 55=[55,54] ondisk+write+known_if_redirected e130)", 2020-11-16T20:57:53.117 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:34.748337+0000", 2020-11-16T20:57:53.118 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.176545593, 2020-11-16T20:57:53.118 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.052818308000000001, 2020-11-16T20:57:53.118 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.118 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:53.118 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:53.118 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:53.118 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:53.119 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3532 2020-11-16T20:57:53.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.119 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.119 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.119 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748337+0000", 2020-11-16T20:57:53.119 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748337+0000", 2020-11-16T20:57:53.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6903999999999997e-05 2020-11-16T20:57:53.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748384+0000", 2020-11-16T20:57:53.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5290000000000008e-06 2020-11-16T20:57:53.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.121 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748392+0000", 2020-11-16T20:57:53.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4324999999999999e-05 2020-11-16T20:57:53.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.122 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.122 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748406+0000", 2020-11-16T20:57:53.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0919999999999998e-06 2020-11-16T20:57:53.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.122 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.123 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748415+0000", 2020-11-16T20:57:53.123 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0488000000000001e-05 2020-11-16T20:57:53.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.123 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.123 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.123 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748475+0000", 2020-11-16T20:57:53.123 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1545999999999999e-05 2020-11-16T20:57:53.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.124 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2020-11-16T20:57:53.124 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748487+0000", 2020-11-16T20:57:53.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045843469999999999 2020-11-16T20:57:53.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.124 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.753071+0000", 2020-11-16T20:57:53.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.048079260999999998 2020-11-16T20:57:53.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:53.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.801150+0000", 2020-11-16T20:57:53.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8160000000000001e-06 2020-11-16T20:57:53.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.126 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.126 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.801155+0000", 2020-11-16T20:57:53.126 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.052818308000000001 2020-11-16T20:57:53.126 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.126 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.127 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.127 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.127 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3533 4.1 4:b7adb356:::smithi16641208-217:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e130)", 2020-11-16T20:57:53.127 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:34.748456+0000", 2020-11-16T20:57:53.127 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.176425997999999, 2020-11-16T20:57:53.127 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.068028942999999995, 2020-11-16T20:57:53.127 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.128 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:53.128 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:53.128 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:53.128 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:53.128 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3533 2020-11-16T20:57:53.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.128 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748456+0000", 2020-11-16T20:57:53.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748456+0000", 2020-11-16T20:57:53.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3272000000000003e-05 2020-11-16T20:57:53.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748490+0000", 2020-11-16T20:57:53.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8499999999999999e-06 2020-11-16T20:57:53.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.131 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.131 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.131 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748495+0000", 2020-11-16T20:57:53.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.188e-05 2020-11-16T20:57:53.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.131 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748507+0000", 2020-11-16T20:57:53.132 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6810000000000003e-06 2020-11-16T20:57:53.132 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748513+0000", 2020-11-16T20:57:53.132 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2339999999999998e-05 2020-11-16T20:57:53.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.133 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748555+0000", 2020-11-16T20:57:53.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2700000000000004e-06 2020-11-16T20:57:53.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.134 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:53.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748564+0000", 2020-11-16T20:57:53.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004936607 2020-11-16T20:57:53.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.134 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.753500+0000", 2020-11-16T20:57:53.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5847999999999998e-05 2020-11-16T20:57:53.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.135 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:53.135 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.753556+0000", 2020-11-16T20:57:53.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.056272167999999997 2020-11-16T20:57:53.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.809828+0000", 2020-11-16T20:57:53.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000131536 2020-11-16T20:57:53.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:53.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.809960+0000", 2020-11-16T20:57:53.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0063663030000000002 2020-11-16T20:57:53.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.137 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.137 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.137 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.816326+0000", 2020-11-16T20:57:53.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1303000000000004e-05 2020-11-16T20:57:53.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.138 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.816407+0000", 2020-11-16T20:57:53.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7885000000000004e-05 2020-11-16T20:57:53.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.816485+0000", 2020-11-16T20:57:53.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.068028942999999995 2020-11-16T20:57:53.139 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.139 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.139 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.140 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3535 4.1 4:b803c1f1:::smithi16641208-291:head [rollback 55] snapc 55=[55,54] ondisk+write+known_if_redirected e130)", 2020-11-16T20:57:53.140 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:34.748646+0000", 2020-11-16T20:57:53.140 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.176236442, 2020-11-16T20:57:53.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.052434296999999998, 2020-11-16T20:57:53.140 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.140 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:53.140 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:53.140 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:53.141 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:53.141 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3535 2020-11-16T20:57:53.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.141 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748646+0000", 2020-11-16T20:57:53.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.142 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748646+0000", 2020-11-16T20:57:53.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4683000000000001e-05 2020-11-16T20:57:53.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.143 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748670+0000", 2020-11-16T20:57:53.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7220000000000002e-06 2020-11-16T20:57:53.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.143 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748677+0000", 2020-11-16T20:57:53.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8769999999999993e-06 2020-11-16T20:57:53.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748685+0000", 2020-11-16T20:57:53.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2120000000000002e-06 2020-11-16T20:57:53.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.145 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.145 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748690+0000", 2020-11-16T20:57:53.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4085000000000003e-05 2020-11-16T20:57:53.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.145 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.146 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748724+0000", 2020-11-16T20:57:53.146 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3529999999999995e-06 2020-11-16T20:57:53.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.146 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.146 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:53.146 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748733+0000", 2020-11-16T20:57:53.146 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052195999999999996 2020-11-16T20:57:53.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.147 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.147 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.753952+0000", 2020-11-16T20:57:53.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9178000000000003e-05 2020-11-16T20:57:53.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.147 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:53.148 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.753992+0000", 2020-11-16T20:57:53.148 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022619554 2020-11-16T20:57:53.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.148 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.148 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.776611+0000", 2020-11-16T20:57:53.148 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000185613 2020-11-16T20:57:53.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.149 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.149 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.776797+0000", 2020-11-16T20:57:53.149 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00033552199999999999 2020-11-16T20:57:53.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.149 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:53.150 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.777132+0000", 2020-11-16T20:57:53.150 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8034000000000001e-05 2020-11-16T20:57:53.150 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.150 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.150 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:53.150 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.777180+0000", 2020-11-16T20:57:53.150 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0075869199999999996 2020-11-16T20:57:53.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.151 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.151 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.151 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.784767+0000", 2020-11-16T20:57:53.151 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000104366 2020-11-16T20:57:53.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.151 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.152 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.152 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.784872+0000", 2020-11-16T20:57:53.152 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018961 2020-11-16T20:57:53.152 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.152 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.152 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:57:53.152 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.785061+0000", 2020-11-16T20:57:53.152 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056996800000000004 2020-11-16T20:57:53.153 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.153 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.153 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.153 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.790761+0000", 2020-11-16T20:57:53.153 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6718999999999995e-05 2020-11-16T20:57:53.153 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.153 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.154 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for ondisk", 2020-11-16T20:57:53.154 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.790838+0000", 2020-11-16T20:57:53.154 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002494029 2020-11-16T20:57:53.154 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.154 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.154 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.154 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.793332+0000", 2020-11-16T20:57:53.155 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00038463800000000003 2020-11-16T20:57:53.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.155 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:53.155 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.793716+0000", 2020-11-16T20:57:53.155 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072152859999999996 2020-11-16T20:57:53.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.156 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.156 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.800931+0000", 2020-11-16T20:57:53.156 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4564e-05 2020-11-16T20:57:53.156 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.156 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.156 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:53.156 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.801006+0000", 2020-11-16T20:57:53.157 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4052000000000002e-05 2020-11-16T20:57:53.157 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.157 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.157 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.157 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.801080+0000", 2020-11-16T20:57:53.157 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.052434296999999998 2020-11-16T20:57:53.157 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.158 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.158 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.158 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.158 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.158 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3536 4.1 4:b803c1f1:::smithi16641208-291:head [append 0~0] snapc 55=[55,54] ondisk+write+known_if_redirected e130)", 2020-11-16T20:57:53.158 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:34.748726+0000", 2020-11-16T20:57:53.158 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.176155982000001, 2020-11-16T20:57:53.158 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.052564835999999997, 2020-11-16T20:57:53.159 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.159 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:53.159 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:53.159 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:53.159 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:53.159 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3536 2020-11-16T20:57:53.159 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.160 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.160 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.160 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.160 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748726+0000", 2020-11-16T20:57:53.160 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.160 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.160 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.161 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.161 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748726+0000", 2020-11-16T20:57:53.161 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1303999999999997e-05 2020-11-16T20:57:53.161 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.161 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.161 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.161 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748758+0000", 2020-11-16T20:57:53.161 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4749999999999998e-06 2020-11-16T20:57:53.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.162 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.162 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748764+0000", 2020-11-16T20:57:53.162 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1039999999999999e-05 2020-11-16T20:57:53.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.162 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.163 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.163 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748775+0000", 2020-11-16T20:57:53.163 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0326000000000001e-05 2020-11-16T20:57:53.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.163 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.163 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.163 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748785+0000", 2020-11-16T20:57:53.164 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5252000000000003e-05 2020-11-16T20:57:53.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.164 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.164 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.164 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748871+0000", 2020-11-16T20:57:53.164 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6369999999999999e-06 2020-11-16T20:57:53.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.164 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.165 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:53.165 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748878+0000", 2020-11-16T20:57:53.165 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.005142509 2020-11-16T20:57:53.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.165 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.165 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.165 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.754021+0000", 2020-11-16T20:57:53.166 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9263000000000001e-05 2020-11-16T20:57:53.166 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.166 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.166 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:53.166 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.754050+0000", 2020-11-16T20:57:53.166 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023184664000000001 2020-11-16T20:57:53.166 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.167 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.167 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.167 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.777235+0000", 2020-11-16T20:57:53.167 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0120999999999998e-05 2020-11-16T20:57:53.167 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.167 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.167 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:53.167 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.777265+0000", 2020-11-16T20:57:53.168 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013605528 2020-11-16T20:57:53.168 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.168 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.168 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.168 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.790870+0000", 2020-11-16T20:57:53.168 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000135308 2020-11-16T20:57:53.168 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.169 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.169 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.169 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.791006+0000", 2020-11-16T20:57:53.169 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00021127799999999999 2020-11-16T20:57:53.169 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.169 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.169 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 3,6", 2020-11-16T20:57:53.169 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.791217+0000", 2020-11-16T20:57:53.170 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0024643 2020-11-16T20:57:53.170 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.170 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.170 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.170 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.793681+0000", 2020-11-16T20:57:53.170 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1199000000000003e-05 2020-11-16T20:57:53.170 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.171 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.171 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:53.171 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.793722+0000", 2020-11-16T20:57:53.171 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074752639999999997 2020-11-16T20:57:53.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.171 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.171 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.172 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.801198+0000", 2020-11-16T20:57:53.172 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3113000000000004e-05 2020-11-16T20:57:53.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.172 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.172 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:53.172 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.801261+0000", 2020-11-16T20:57:53.172 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0255000000000001e-05 2020-11-16T20:57:53.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.173 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.173 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.173 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.801291+0000", 2020-11-16T20:57:53.173 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.052564835999999997 2020-11-16T20:57:53.173 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.173 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.173 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.174 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.174 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.174 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:53.175 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:57:53.175 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:53.180+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:53.270 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7] out_osds: [1] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:57:53.271 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:57:53.271 INFO:tasks.thrashosds.thrasher:inject_pause on 5 2020-11-16T20:57:53.271 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2020-11-16T20:57:53.271 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2020-11-16T20:57:53.271 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2020-11-16T20:57:53.276 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:53.281+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:53.354 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:57:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:57:53.355 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:53.365 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:57:53.408 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:53.408 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "" 2020-11-16T20:57:53.408 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:53.408 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:53.413+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:53.477 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:53.482+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:53.500 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:53.500 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:57:53.500 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:57:53.501 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:57:53.501 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:53.510 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:57:53.578 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:57:53.582+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:57:53.646 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:53.646 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2020-11-16T20:57:53.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2020-11-16T20:57:53.646 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:57:53.647 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.647 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:538 4.3 e41/22 4:c9160c9c:::smithi16641208-411:head v 41'95, mlcod=37'93)", 2020-11-16T20:57:53.647 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:57:53.647 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 109.52445578299999, 2020-11-16T20:57:53.647 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021023377999999999, 2020-11-16T20:57:53.647 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.647 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:53.648 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.648 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.648 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.648 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:57:53.648 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.648 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.648 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.649 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.649 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.125646+0000", 2020-11-16T20:57:53.649 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052206140000000002 2020-11-16T20:57:53.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.649 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.649 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.649 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130866+0000", 2020-11-16T20:57:53.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0824e-05 2020-11-16T20:57:53.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.650 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.650 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130877+0000", 2020-11-16T20:57:53.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5384e-05 2020-11-16T20:57:53.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.651 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.651 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.651 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130893+0000", 2020-11-16T20:57:53.651 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0064999999999999e-05 2020-11-16T20:57:53.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.651 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.651 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.651 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130903+0000", 2020-11-16T20:57:53.652 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3051000000000003e-05 2020-11-16T20:57:53.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.652 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.652 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.652 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130966+0000", 2020-11-16T20:57:53.652 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9724e-05 2020-11-16T20:57:53.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.653 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.653 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.653 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.130985+0000", 2020-11-16T20:57:53.653 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015638332000000001 2020-11-16T20:57:53.653 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.653 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.653 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:53.653 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.146624+0000", 2020-11-16T20:57:53.654 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5383999999999998e-05 2020-11-16T20:57:53.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.654 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.654 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.654 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:04.146669+0000", 2020-11-16T20:57:53.654 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021023377999999999 2020-11-16T20:57:53.654 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.655 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.655 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.655 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.655 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2367 4.2 e42/22 4:581c1e5b:::smithi16641208-124:head v 42'136, mlcod=42'133)", 2020-11-16T20:57:53.655 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:57:53.655 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 108.59675740500001, 2020-11-16T20:57:53.656 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021196474999999999, 2020-11-16T20:57:53.656 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.656 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:53.656 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.656 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.656 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.656 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:57:53.656 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.657 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.657 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.657 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.053344+0000", 2020-11-16T20:57:53.657 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070663000000000002 2020-11-16T20:57:53.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.658 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.658 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.658 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060411+0000", 2020-11-16T20:57:53.658 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0189999999999995e-06 2020-11-16T20:57:53.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.658 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.658 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.659 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060420+0000", 2020-11-16T20:57:53.659 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0069e-05 2020-11-16T20:57:53.659 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.659 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.659 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.659 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060430+0000", 2020-11-16T20:57:53.660 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6879999999999999e-06 2020-11-16T20:57:53.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.660 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.660 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.660 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060437+0000", 2020-11-16T20:57:53.660 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3671999999999995e-05 2020-11-16T20:57:53.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.661 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.661 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.661 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060511+0000", 2020-11-16T20:57:53.661 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6801999999999998e-05 2020-11-16T20:57:53.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.661 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.662 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.662 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.060548+0000", 2020-11-16T20:57:53.662 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013927701000000001 2020-11-16T20:57:53.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.662 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.662 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:53.662 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074475+0000", 2020-11-16T20:57:53.663 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5223999999999998e-05 2020-11-16T20:57:53.663 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.663 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.663 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.663 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.074541+0000", 2020-11-16T20:57:53.663 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021196474999999999 2020-11-16T20:57:53.663 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.664 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.664 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.664 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.664 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:554 3.2 e42/19 3:769099fd:::smithi16641208-247:head v 42'386, mlcod=42'384)", 2020-11-16T20:57:53.664 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:57:53.664 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 108.579838432, 2020-11-16T20:57:53.665 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029531213000000001, 2020-11-16T20:57:53.665 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.665 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:53.665 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.665 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.665 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.665 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:57:53.665 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.666 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.666 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.666 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.070263+0000", 2020-11-16T20:57:53.666 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007828448 2020-11-16T20:57:53.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.666 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.667 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.667 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078092+0000", 2020-11-16T20:57:53.667 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2031000000000001e-05 2020-11-16T20:57:53.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.667 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.667 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.667 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078104+0000", 2020-11-16T20:57:53.668 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3950000000000001e-06 2020-11-16T20:57:53.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.668 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.668 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.668 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078112+0000", 2020-11-16T20:57:53.668 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.434e-06 2020-11-16T20:57:53.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.668 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.669 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.669 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078117+0000", 2020-11-16T20:57:53.669 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0217999999999999e-05 2020-11-16T20:57:53.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.669 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.669 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.669 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078168+0000", 2020-11-16T20:57:53.670 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6242e-05 2020-11-16T20:57:53.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.670 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.670 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.670 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078194+0000", 2020-11-16T20:57:53.670 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021550488 2020-11-16T20:57:53.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.671 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:53.671 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099744+0000", 2020-11-16T20:57:53.671 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9957000000000003e-05 2020-11-16T20:57:53.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.671 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.672 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099794+0000", 2020-11-16T20:57:53.672 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029531213000000001 2020-11-16T20:57:53.672 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.672 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.672 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.672 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.672 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:555 3.2 e42/19 3:590e6edd:::smithi16641208-203:head v 42'387, mlcod=42'384)", 2020-11-16T20:57:53.673 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:57:53.673 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 108.571957588, 2020-11-16T20:57:53.673 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021681786000000002, 2020-11-16T20:57:53.673 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.673 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:53.673 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.673 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.674 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.674 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:57:53.674 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.674 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.674 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.674 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078144+0000", 2020-11-16T20:57:53.674 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6817999999999998e-05 2020-11-16T20:57:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078191+0000", 2020-11-16T20:57:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7800000000000003e-06 2020-11-16T20:57:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078198+0000", 2020-11-16T20:57:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0331e-05 2020-11-16T20:57:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078208+0000", 2020-11-16T20:57:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8429999999999998e-06 2020-11-16T20:57:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078214+0000", 2020-11-16T20:57:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0025044690000000001 2020-11-16T20:57:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080718+0000", 2020-11-16T20:57:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027441100000000001 2020-11-16T20:57:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080993+0000", 2020-11-16T20:57:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018806976999999999 2020-11-16T20:57:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099800+0000", 2020-11-16T20:57:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6157e-05 2020-11-16T20:57:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.099826+0000", 2020-11-16T20:57:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021681786000000002 2020-11-16T20:57:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.4.0:485 4.1 e42/22 4:82bb0fe7:::smithi16641208-101:head v 42'94, mlcod=41'92)", 2020-11-16T20:57:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:57:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 108.571388621, 2020-11-16T20:57:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021768460999999999, 2020-11-16T20:57:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.682 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.682 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.682 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:57:53.682 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.682 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.682 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.683 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.078713+0000", 2020-11-16T20:57:53.683 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001603103 2020-11-16T20:57:53.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.683 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.683 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.683 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080316+0000", 2020-11-16T20:57:53.683 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4956e-05 2020-11-16T20:57:53.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.684 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.684 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.684 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080331+0000", 2020-11-16T20:57:53.684 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6291e-05 2020-11-16T20:57:53.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.684 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.684 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.685 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080347+0000", 2020-11-16T20:57:53.685 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3090000000000001e-06 2020-11-16T20:57:53.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.685 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.685 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.685 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080357+0000", 2020-11-16T20:57:53.685 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7073000000000001e-05 2020-11-16T20:57:53.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.686 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.686 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.686 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080414+0000", 2020-11-16T20:57:53.686 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5877e-05 2020-11-16T20:57:53.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.686 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.686 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.687 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.080440+0000", 2020-11-16T20:57:53.687 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019927006000000001 2020-11-16T20:57:53.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.687 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.687 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:53.687 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100367+0000", 2020-11-16T20:57:53.687 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114846 2020-11-16T20:57:53.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.688 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.688 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.688 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:05.100481+0000", 2020-11-16T20:57:53.688 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021768460999999999 2020-11-16T20:57:53.688 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.688 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.688 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.689 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.689 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.0.0:663 4.3 e57/22 4:f65e82cb:::smithi16641208-219:head v 57'179, mlcod=57'176)", 2020-11-16T20:57:53.689 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:57:53.689 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 93.853273551000001, 2020-11-16T20:57:53.689 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022540092000000001, 2020-11-16T20:57:53.689 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.690 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:53.690 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.690 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.690 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.690 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:57:53.690 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.690 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.691 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.691 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.691 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.796828+0000", 2020-11-16T20:57:53.691 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013414394 2020-11-16T20:57:53.691 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.691 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.691 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.691 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810242+0000", 2020-11-16T20:57:53.692 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1864e-05 2020-11-16T20:57:53.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.692 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.692 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810254+0000", 2020-11-16T20:57:53.692 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3716e-05 2020-11-16T20:57:53.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.692 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.693 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.693 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810268+0000", 2020-11-16T20:57:53.693 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.064e-06 2020-11-16T20:57:53.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.693 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.693 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810277+0000", 2020-11-16T20:57:53.694 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0560999999999998e-05 2020-11-16T20:57:53.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.694 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.694 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.694 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810338+0000", 2020-11-16T20:57:53.694 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7523999999999999e-05 2020-11-16T20:57:53.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.695 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.695 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.695 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810365+0000", 2020-11-16T20:57:53.695 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089020890000000002 2020-11-16T20:57:53.695 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.695 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.695 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:53.695 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819267+0000", 2020-11-16T20:57:53.696 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010088 2020-11-16T20:57:53.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.699 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.699 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.699 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819368+0000", 2020-11-16T20:57:53.699 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022540092000000001 2020-11-16T20:57:53.700 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.700 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.700 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.700 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.700 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.0:618 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'243, mlcod=57'241)", 2020-11-16T20:57:53.700 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:57:53.700 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 93.849767475999997, 2020-11-16T20:57:53.701 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049183098000000001, 2020-11-16T20:57:53.701 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.701 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:53.701 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.701 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.701 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.701 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:57:53.702 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.702 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.702 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.800334+0000", 2020-11-16T20:57:53.702 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019114651 2020-11-16T20:57:53.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.703 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.703 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.703 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819449+0000", 2020-11-16T20:57:53.703 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.398e-05 2020-11-16T20:57:53.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.703 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.703 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.704 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819463+0000", 2020-11-16T20:57:53.704 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1139e-05 2020-11-16T20:57:53.704 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.704 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.704 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.704 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819474+0000", 2020-11-16T20:57:53.704 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1860000000000003e-06 2020-11-16T20:57:53.704 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.705 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.705 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.705 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819481+0000", 2020-11-16T20:57:53.705 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015472700000000001 2020-11-16T20:57:53.705 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.705 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.705 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.706 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819636+0000", 2020-11-16T20:57:53.706 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9632e-05 2020-11-16T20:57:53.706 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.706 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.706 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.706 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819665+0000", 2020-11-16T20:57:53.706 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.029788289999999999 2020-11-16T20:57:53.706 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.707 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.707 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:53.707 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849454+0000", 2020-11-16T20:57:53.707 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3492999999999997e-05 2020-11-16T20:57:53.707 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.707 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.707 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.708 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849517+0000", 2020-11-16T20:57:53.708 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.049183098000000001 2020-11-16T20:57:53.708 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.708 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.708 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.708 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.708 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.708 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(osd.1.13:609 3.2 e57/19 3:5eead97c:::smithi16641208-34:head v 57'498, mlcod=57'495)", 2020-11-16T20:57:53.709 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:57:53.709 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 93.839487977000005, 2020-11-16T20:57:53.709 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039221579999999999, 2020-11-16T20:57:53.709 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.709 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:53.709 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.709 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.710 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.710 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:57:53.710 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.710 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.710 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.710 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.710 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.810614+0000", 2020-11-16T20:57:53.710 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008889859 2020-11-16T20:57:53.711 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.711 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.711 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.711 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819503+0000", 2020-11-16T20:57:53.711 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0149000000000001e-05 2020-11-16T20:57:53.711 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.711 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.712 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.712 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819514+0000", 2020-11-16T20:57:53.712 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1049999999999999e-05 2020-11-16T20:57:53.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.712 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.712 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.712 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819525+0000", 2020-11-16T20:57:53.712 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4829999999999999e-06 2020-11-16T20:57:53.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.713 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.713 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.713 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819533+0000", 2020-11-16T20:57:53.713 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031805760000000001 2020-11-16T20:57:53.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.713 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.714 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.714 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822714+0000", 2020-11-16T20:57:53.714 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0954000000000002e-05 2020-11-16T20:57:53.714 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.714 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.714 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.714 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822745+0000", 2020-11-16T20:57:53.714 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.027044038999999999 2020-11-16T20:57:53.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.715 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.715 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:53.715 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849789+0000", 2020-11-16T20:57:53.715 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6470000000000001e-05 2020-11-16T20:57:53.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.715 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.716 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.716 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849835+0000", 2020-11-16T20:57:53.716 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.039221579999999999 2020-11-16T20:57:53.716 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.716 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.716 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.717 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.717 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_repop(client.4535.0:2583 4.2 e57/22 4:75836747:::smithi16641208-340:head v 57'244, mlcod=57'241)", 2020-11-16T20:57:53.717 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:57:53.717 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 93.830570441999996, 2020-11-16T20:57:53.717 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030101836999999999, 2020-11-16T20:57:53.717 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.717 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:53.717 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.718 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.718 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.718 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:57:53.718 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.718 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.718 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.719 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819531+0000", 2020-11-16T20:57:53.719 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3781e-05 2020-11-16T20:57:53.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.719 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.719 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.719 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819575+0000", 2020-11-16T20:57:53.719 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3355e-05 2020-11-16T20:57:53.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.720 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.720 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819588+0000", 2020-11-16T20:57:53.720 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8198e-05 2020-11-16T20:57:53.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.720 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.721 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819657+0000", 2020-11-16T20:57:53.721 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5849999999999999e-05 2020-11-16T20:57:53.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.721 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.721 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.721 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.819672+0000", 2020-11-16T20:57:53.721 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003042473 2020-11-16T20:57:53.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.722 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.722 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.722 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822715+0000", 2020-11-16T20:57:53.722 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9779999999999999e-05 2020-11-16T20:57:53.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.722 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.722 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.723 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.822745+0000", 2020-11-16T20:57:53.723 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026828521000000001 2020-11-16T20:57:53.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.723 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.723 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:53.723 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849573+0000", 2020-11-16T20:57:53.723 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9879e-05 2020-11-16T20:57:53.724 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.724 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.724 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.724 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:56:19.849633+0000", 2020-11-16T20:57:53.724 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.030101836999999999 2020-11-16T20:57:53.724 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.724 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.724 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.725 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.725 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3495 4.2 4:7e155756:::smithi16641208-255:head [write 1744696~590883] snapc 55=[55,54,53,52] ondisk+write+known_if_redirected e128)", 2020-11-16T20:57:53.725 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:32.932748+0000", 2020-11-16T20:57:53.725 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.717353182, 2020-11-16T20:57:53.725 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026656984000000002, 2020-11-16T20:57:53.725 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.726 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:53.726 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:53.726 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:53.726 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:53.726 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3495 2020-11-16T20:57:53.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.726 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.727 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.727 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.932748+0000", 2020-11-16T20:57:53.727 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.727 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.727 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.932748+0000", 2020-11-16T20:57:53.728 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00053288900000000004 2020-11-16T20:57:53.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.728 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.728 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.728 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.933281+0000", 2020-11-16T20:57:53.728 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.14e-06 2020-11-16T20:57:53.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.729 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.729 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.729 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.933289+0000", 2020-11-16T20:57:53.729 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6081000000000001e-05 2020-11-16T20:57:53.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.729 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.729 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.729 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.933306+0000", 2020-11-16T20:57:53.730 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9020000000000005e-06 2020-11-16T20:57:53.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.730 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.730 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.730 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.933314+0000", 2020-11-16T20:57:53.730 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9695999999999999e-05 2020-11-16T20:57:53.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.731 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.731 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.933374+0000", 2020-11-16T20:57:53.731 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0871000000000005e-05 2020-11-16T20:57:53.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.731 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.731 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:53.732 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.933465+0000", 2020-11-16T20:57:53.732 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015534772000000001 2020-11-16T20:57:53.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.732 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.732 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.732 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.949000+0000", 2020-11-16T20:57:53.732 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00020149499999999999 2020-11-16T20:57:53.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.733 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.733 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.733 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.949201+0000", 2020-11-16T20:57:53.733 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024771899999999998 2020-11-16T20:57:53.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.733 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.733 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,4", 2020-11-16T20:57:53.734 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.949449+0000", 2020-11-16T20:57:53.734 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0035366379999999999 2020-11-16T20:57:53.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.734 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.734 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.734 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.952986+0000", 2020-11-16T20:57:53.734 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0026778399999999999 2020-11-16T20:57:53.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.735 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.735 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:53.735 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.955663+0000", 2020-11-16T20:57:53.735 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0036202550000000002 2020-11-16T20:57:53.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.735 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.735 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.736 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.959284+0000", 2020-11-16T20:57:53.736 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7249000000000006e-05 2020-11-16T20:57:53.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.736 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.736 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:53.736 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.959351+0000", 2020-11-16T20:57:53.736 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4437000000000001e-05 2020-11-16T20:57:53.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.737 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.737 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.737 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.959405+0000", 2020-11-16T20:57:53.737 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.026656984000000002 2020-11-16T20:57:53.737 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.737 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.737 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.738 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.738 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.738 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3496 4.2 4:7e155756:::smithi16641208-255:head [write 2772934~134809] snapc 55=[55,54,53,52] ondisk+write+known_if_redirected e128)", 2020-11-16T20:57:53.738 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:32.935878+0000", 2020-11-16T20:57:53.738 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.714223601, 2020-11-16T20:57:53.738 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023700191999999998, 2020-11-16T20:57:53.738 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.739 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:53.739 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:53.739 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:53.739 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:53.739 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3496 2020-11-16T20:57:53.739 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.739 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.740 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.740 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.935878+0000", 2020-11-16T20:57:53.740 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.740 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.740 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.740 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.935878+0000", 2020-11-16T20:57:53.741 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6582000000000005e-05 2020-11-16T20:57:53.741 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.741 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.741 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.741 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.935975+0000", 2020-11-16T20:57:53.741 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.956e-06 2020-11-16T20:57:53.741 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.742 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.742 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.742 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.935982+0000", 2020-11-16T20:57:53.742 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3502999999999999e-05 2020-11-16T20:57:53.742 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.742 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.742 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.742 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.935995+0000", 2020-11-16T20:57:53.743 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2150000000000004e-06 2020-11-16T20:57:53.743 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.743 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.743 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.743 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936002+0000", 2020-11-16T20:57:53.743 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9329999999999997e-05 2020-11-16T20:57:53.743 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.744 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.744 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.744 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936052+0000", 2020-11-16T20:57:53.744 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5052000000000002e-05 2020-11-16T20:57:53.744 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.744 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.745 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:53.745 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936097+0000", 2020-11-16T20:57:53.745 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014771909 2020-11-16T20:57:53.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.745 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.745 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.745 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.950869+0000", 2020-11-16T20:57:53.746 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000104421 2020-11-16T20:57:53.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.746 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.746 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.746 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.950973+0000", 2020-11-16T20:57:53.746 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022628000000000001 2020-11-16T20:57:53.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.747 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.747 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,4", 2020-11-16T20:57:53.747 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.951199+0000", 2020-11-16T20:57:53.747 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023977569999999999 2020-11-16T20:57:53.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.747 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.747 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.953597+0000", 2020-11-16T20:57:53.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0044840269999999998 2020-11-16T20:57:53.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.748 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:53.748 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.958081+0000", 2020-11-16T20:57:53.748 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0013765349999999999 2020-11-16T20:57:53.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.749 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.959458+0000", 2020-11-16T20:57:53.749 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5678000000000004e-05 2020-11-16T20:57:53.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.749 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.749 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:53.749 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.959523+0000", 2020-11-16T20:57:53.750 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4947000000000001e-05 2020-11-16T20:57:53.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.750 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.750 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.750 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.959578+0000", 2020-11-16T20:57:53.750 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023700191999999998 2020-11-16T20:57:53.750 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.751 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.751 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.751 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.751 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.751 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3497 4.2 4:7e155756:::smithi16641208-255:head [setxattr _header (58) in=7b,truncate 2907743] snapc 55=[55,54,53,52] ondisk+write+known_if_redirected e128)", 2020-11-16T20:57:53.751 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:32.936049+0000", 2020-11-16T20:57:53.751 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.714053071999999, 2020-11-16T20:57:53.752 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024052206, 2020-11-16T20:57:53.752 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.752 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:53.752 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:53.752 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:53.752 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:53.752 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3497 2020-11-16T20:57:53.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.753 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.753 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.753 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936049+0000", 2020-11-16T20:57:53.753 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.753 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.754 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.754 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936049+0000", 2020-11-16T20:57:53.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7271e-05 2020-11-16T20:57:53.754 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.754 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.754 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.754 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936076+0000", 2020-11-16T20:57:53.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1779999999999996e-06 2020-11-16T20:57:53.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.755 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.755 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936080+0000", 2020-11-16T20:57:53.755 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7039999999999997e-06 2020-11-16T20:57:53.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.756 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.756 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936087+0000", 2020-11-16T20:57:53.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.473e-06 2020-11-16T20:57:53.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.756 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.756 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.756 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936090+0000", 2020-11-16T20:57:53.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3069999999999999e-05 2020-11-16T20:57:53.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936133+0000", 2020-11-16T20:57:53.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4410000000000001e-05 2020-11-16T20:57:53.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:53.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936208+0000", 2020-11-16T20:57:53.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015674410999999999 2020-11-16T20:57:53.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.951882+0000", 2020-11-16T20:57:53.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000167233 2020-11-16T20:57:53.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.759 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.952049+0000", 2020-11-16T20:57:53.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025541000000000002 2020-11-16T20:57:53.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,4", 2020-11-16T20:57:53.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.952305+0000", 2020-11-16T20:57:53.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0021373550000000001 2020-11-16T20:57:53.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.954442+0000", 2020-11-16T20:57:53.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0036480499999999999 2020-11-16T20:57:53.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.761 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:53.761 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.958090+0000", 2020-11-16T20:57:53.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0018286380000000001 2020-11-16T20:57:53.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.959919+0000", 2020-11-16T20:57:53.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7004999999999998e-05 2020-11-16T20:57:53.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:53.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.960006+0000", 2020-11-16T20:57:53.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4998000000000001e-05 2020-11-16T20:57:53.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.960101+0000", 2020-11-16T20:57:53.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024052206 2020-11-16T20:57:53.763 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.764 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.764 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.764 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3498 4.2 4:7e155756:::smithi16641208-255:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e128)", 2020-11-16T20:57:53.764 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:32.936126+0000", 2020-11-16T20:57:53.764 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.713975362999999, 2020-11-16T20:57:53.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024682154000000001, 2020-11-16T20:57:53.765 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.765 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2020-11-16T20:57:53.765 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:53.765 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:53.765 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:53.765 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3498 2020-11-16T20:57:53.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.766 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936126+0000", 2020-11-16T20:57:53.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936126+0000", 2020-11-16T20:57:53.767 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3691e-05 2020-11-16T20:57:53.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.767 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936160+0000", 2020-11-16T20:57:53.767 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2190000000000001e-06 2020-11-16T20:57:53.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.768 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.768 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936166+0000", 2020-11-16T20:57:53.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9751000000000001e-05 2020-11-16T20:57:53.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.768 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936186+0000", 2020-11-16T20:57:53.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8449999999999999e-06 2020-11-16T20:57:53.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936192+0000", 2020-11-16T20:57:53.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0973000000000002e-05 2020-11-16T20:57:53.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.770 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.770 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936233+0000", 2020-11-16T20:57:53.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4511000000000002e-05 2020-11-16T20:57:53.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.770 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:53.771 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.936267+0000", 2020-11-16T20:57:53.771 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016346407 2020-11-16T20:57:53.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.771 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.771 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.952614+0000", 2020-11-16T20:57:53.771 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5446999999999998e-05 2020-11-16T20:57:53.772 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.772 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.772 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:53.772 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.952689+0000", 2020-11-16T20:57:53.772 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074636269999999996 2020-11-16T20:57:53.772 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.772 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.772 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.773 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.960153+0000", 2020-11-16T20:57:53.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026278599999999999 2020-11-16T20:57:53.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.773 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.773 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.960416+0000", 2020-11-16T20:57:53.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039289700000000002 2020-11-16T20:57:53.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:32.960808+0000", 2020-11-16T20:57:53.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.024682154000000001 2020-11-16T20:57:53.774 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.774 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.775 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.775 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3512 4.2 4:6f41abc7:::smithi16641208-179:head [read 0~2991646,checksum] snapc 0=[] ondisk+read+known_if_redirected e129)", 2020-11-16T20:57:53.775 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:34.001748+0000", 2020-11-16T20:57:53.775 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.648353683, 2020-11-16T20:57:53.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020636748, 2020-11-16T20:57:53.775 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.776 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2020-11-16T20:57:53.776 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:53.776 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:53.776 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:53.776 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3512 2020-11-16T20:57:53.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.776 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.001748+0000", 2020-11-16T20:57:53.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.001748+0000", 2020-11-16T20:57:53.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9986e-05 2020-11-16T20:57:53.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.001788+0000", 2020-11-16T20:57:53.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5100000000000004e-06 2020-11-16T20:57:53.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.001794+0000", 2020-11-16T20:57:53.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3481e-05 2020-11-16T20:57:53.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.001808+0000", 2020-11-16T20:57:53.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7919999999999998e-06 2020-11-16T20:57:53.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.001814+0000", 2020-11-16T20:57:53.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011458670000000001 2020-11-16T20:57:53.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.002960+0000", 2020-11-16T20:57:53.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019425112000000001 2020-11-16T20:57:53.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.022385+0000", 2020-11-16T20:57:53.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020636748 2020-11-16T20:57:53.782 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.782 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.782 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.782 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3526 4.2 4:74e10358:::smithi16641208-98:55 [read 0~3630279,checksum] snapc 0=[] ondisk+read+known_if_redirected e129)", 2020-11-16T20:57:53.783 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:34.017588+0000", 2020-11-16T20:57:53.783 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.632513589999999, 2020-11-16T20:57:53.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021067525, 2020-11-16T20:57:53.783 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.783 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2020-11-16T20:57:53.783 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:53.783 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:53.783 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:53.784 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3526 2020-11-16T20:57:53.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.784 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.017588+0000", 2020-11-16T20:57:53.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.017588+0000", 2020-11-16T20:57:53.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3799999999999999e-05 2020-11-16T20:57:53.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.786 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.017612+0000", 2020-11-16T20:57:53.786 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8709999999999999e-06 2020-11-16T20:57:53.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.786 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.786 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.017616+0000", 2020-11-16T20:57:53.786 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0310000000000004e-06 2020-11-16T20:57:53.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.787 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.787 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.017622+0000", 2020-11-16T20:57:53.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1389999999999999e-06 2020-11-16T20:57:53.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.788 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.017625+0000", 2020-11-16T20:57:53.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000718014 2020-11-16T20:57:53.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.788 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.018343+0000", 2020-11-16T20:57:53.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020312670000000001 2020-11-16T20:57:53.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.038656+0000", 2020-11-16T20:57:53.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021067525 2020-11-16T20:57:53.789 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.789 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.790 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.790 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3539 4.2 4:47e2d3ca:::smithi16641208-384:head [read 0~2437081,checksum] snapc 0=[] ondisk+read+known_if_redirected e130)", 2020-11-16T20:57:53.790 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:34.748641+0000", 2020-11-16T20:57:53.790 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.901460484000001, 2020-11-16T20:57:53.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023726226, 2020-11-16T20:57:53.791 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.791 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2020-11-16T20:57:53.791 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:53.791 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:53.791 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:53.791 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3539 2020-11-16T20:57:53.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.791 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748641+0000", 2020-11-16T20:57:53.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748641+0000", 2020-11-16T20:57:53.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8232000000000003e-05 2020-11-16T20:57:53.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748679+0000", 2020-11-16T20:57:53.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1430000000000003e-06 2020-11-16T20:57:53.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748686+0000", 2020-11-16T20:57:53.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1487e-05 2020-11-16T20:57:53.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748697+0000", 2020-11-16T20:57:53.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5609999999999998e-06 2020-11-16T20:57:53.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.795 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748703+0000", 2020-11-16T20:57:53.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024659600000000002 2020-11-16T20:57:53.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.748949+0000", 2020-11-16T20:57:53.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023418207 2020-11-16T20:57:53.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.772367+0000", 2020-11-16T20:57:53.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023726226 2020-11-16T20:57:53.797 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.797 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.797 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.798 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(osd.0.13:769 4.2 4:5e002a8b:::smithi16641208-342:head [assert-version v367,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected e130)", 2020-11-16T20:57:53.798 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:34.755146+0000", 2020-11-16T20:57:53.798 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 18.894955410000001, 2020-11-16T20:57:53.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020866262999999999, 2020-11-16T20:57:53.798 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.798 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2020-11-16T20:57:53.798 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.755146+0000", 2020-11-16T20:57:53.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.755146+0000", 2020-11-16T20:57:53.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1903999999999997e-05 2020-11-16T20:57:53.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.800 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.755188+0000", 2020-11-16T20:57:53.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2490000000000004e-06 2020-11-16T20:57:53.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.755195+0000", 2020-11-16T20:57:53.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6143000000000001e-05 2020-11-16T20:57:53.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.755212+0000", 2020-11-16T20:57:53.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4799999999999998e-06 2020-11-16T20:57:53.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.755218+0000", 2020-11-16T20:57:53.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1761999999999996e-05 2020-11-16T20:57:53.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.755280+0000", 2020-11-16T20:57:53.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020732725 2020-11-16T20:57:53.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:34.776012+0000", 2020-11-16T20:57:53.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020866262999999999 2020-11-16T20:57:53.804 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.804 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.804 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.804 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3647 4.2 4:4f093770:::smithi16641208-180:head [append 0~0] snapc 5e=[5e,5c,5b] ondisk+write+known_if_redirected e137)", 2020-11-16T20:57:53.805 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:41.986315+0000", 2020-11-16T20:57:53.805 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.663786433, 2020-11-16T20:57:53.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.034212326000000001, 2020-11-16T20:57:53.805 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.805 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:53.805 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:53.805 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:53.806 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:53.806 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3647 2020-11-16T20:57:53.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.806 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:41.986315+0000", 2020-11-16T20:57:53.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:41.986315+0000", 2020-11-16T20:57:53.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9006999999999999e-05 2020-11-16T20:57:53.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:41.986334+0000", 2020-11-16T20:57:53.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9699999999999996e-06 2020-11-16T20:57:53.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:41.986340+0000", 2020-11-16T20:57:53.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6699999999999994e-06 2020-11-16T20:57:53.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:41.986348+0000", 2020-11-16T20:57:53.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0709999999999999e-06 2020-11-16T20:57:53.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:41.986351+0000", 2020-11-16T20:57:53.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023678990000000001 2020-11-16T20:57:53.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:41.988719+0000", 2020-11-16T20:57:53.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4289999999999999e-05 2020-11-16T20:57:53.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:53.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:41.988753+0000", 2020-11-16T20:57:53.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.025774689 2020-11-16T20:57:53.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:42.014528+0000", 2020-11-16T20:57:53.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013804799999999999 2020-11-16T20:57:53.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:42.014666+0000", 2020-11-16T20:57:53.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000243081 2020-11-16T20:57:53.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,4", 2020-11-16T20:57:53.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:42.014909+0000", 2020-11-16T20:57:53.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00096478700000000004 2020-11-16T20:57:53.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:42.015874+0000", 2020-11-16T20:57:53.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014369059999999999 2020-11-16T20:57:53.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:53.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:42.017311+0000", 2020-11-16T20:57:53.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031052010000000001 2020-11-16T20:57:53.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:42.020416+0000", 2020-11-16T20:57:53.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5228999999999994e-05 2020-11-16T20:57:53.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:53.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:42.020491+0000", 2020-11-16T20:57:53.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6477999999999999e-05 2020-11-16T20:57:53.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:42.020528+0000", 2020-11-16T20:57:53.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.034212326000000001 2020-11-16T20:57:53.817 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.817 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.817 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.817 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3661 4.2 4:7c4a7ccf:::smithi16641208-27:5e [read 0~2436982,checksum] snapc 0=[] ondisk+read+known_if_redirected e139)", 2020-11-16T20:57:53.818 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:43.965978+0000", 2020-11-16T20:57:53.818 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.684123327, 2020-11-16T20:57:53.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020534841000000002, 2020-11-16T20:57:53.818 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.818 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2020-11-16T20:57:53.818 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:53.818 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:53.819 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:53.819 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3661 2020-11-16T20:57:53.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.819 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.965978+0000", 2020-11-16T20:57:53.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.820 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.965978+0000", 2020-11-16T20:57:53.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6570999999999998e-05 2020-11-16T20:57:53.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.966025+0000", 2020-11-16T20:57:53.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0780000000000001e-06 2020-11-16T20:57:53.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.966031+0000", 2020-11-16T20:57:53.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1233000000000001e-05 2020-11-16T20:57:53.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.966042+0000", 2020-11-16T20:57:53.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.955e-06 2020-11-16T20:57:53.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.966047+0000", 2020-11-16T20:57:53.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7679000000000003e-05 2020-11-16T20:57:53.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.966085+0000", 2020-11-16T20:57:53.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0609999999999998e-06 2020-11-16T20:57:53.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:53.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.966092+0000", 2020-11-16T20:57:53.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0027655000000000002 2020-11-16T20:57:53.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.968857+0000", 2020-11-16T20:57:53.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017655764000000001 2020-11-16T20:57:53.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.986513+0000", 2020-11-16T20:57:53.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020534841000000002 2020-11-16T20:57:53.826 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.826 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.826 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.826 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3668 4.2 4:43ad827e:::smithi16641208-402:head [write 1365277~511220] snapc 5e=[5e] ondisk+write+known_if_redirected e139)", 2020-11-16T20:57:53.827 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:43.998093+0000", 2020-11-16T20:57:53.827 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.6520082219999992, 2020-11-16T20:57:53.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.025480011, 2020-11-16T20:57:53.827 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:53.827 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:53.827 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:53.827 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:53.828 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:53.828 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3668 2020-11-16T20:57:53.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.828 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:53.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:53.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.998093+0000", 2020-11-16T20:57:53.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:53.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:53.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.998093+0000", 2020-11-16T20:57:53.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00048407700000000002 2020-11-16T20:57:53.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:57:53.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.998577+0000", 2020-11-16T20:57:53.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8569999999999997e-06 2020-11-16T20:57:53.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:57:53.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.998584+0000", 2020-11-16T20:57:53.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5218999999999999e-05 2020-11-16T20:57:53.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:57:53.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.998600+0000", 2020-11-16T20:57:53.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1049999999999995e-06 2020-11-16T20:57:53.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:57:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.998608+0000", 2020-11-16T20:57:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3278000000000001e-05 2020-11-16T20:57:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.998651+0000", 2020-11-16T20:57:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0895000000000005e-05 2020-11-16T20:57:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:43.998722+0000", 2020-11-16T20:57:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015162044 2020-11-16T20:57:53.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:57:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:44.013884+0000", 2020-11-16T20:57:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017694 2020-11-16T20:57:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2020-11-16T20:57:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:44.014061+0000", 2020-11-16T20:57:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030028900000000002 2020-11-16T20:57:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for subops from 0,4", 2020-11-16T20:57:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:44.014361+0000", 2020-11-16T20:57:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074555899999999998 2020-11-16T20:57:53.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:44.021817+0000", 2020-11-16T20:57:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001490288 2020-11-16T20:57:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op_commit", 2020-11-16T20:57:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:44.023307+0000", 2020-11-16T20:57:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000120949 2020-11-16T20:57:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:44.023428+0000", 2020-11-16T20:57:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9171000000000005e-05 2020-11-16T20:57:53.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2020-11-16T20:57:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:44.023507+0000", 2020-11-16T20:57:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6309000000000005e-05 2020-11-16T20:57:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2020-11-16T20:57:53.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:44.023573+0000", 2020-11-16T20:57:53.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.025480011 2020-11-16T20:57:53.839 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.839 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.839 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.839 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:57:53.839 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:57:53.840 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:53.841 INFO:tasks.rados.rados.0.smithi166.stdout:1187: done (8 left) 2020-11-16T20:57:53.841 INFO:tasks.rados.rados.0.smithi166.stdout:1188: rollback oid 405 current snap is 54 2020-11-16T20:57:53.842 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 405 to 48 2020-11-16T20:57:53.842 INFO:tasks.rados.rados.0.smithi166.stdout:1185: got (2) No such file or directory 2020-11-16T20:57:53.842 INFO:tasks.rados.rados.0.smithi166.stdout:1185: done (8 left) 2020-11-16T20:57:53.842 INFO:tasks.rados.rados.0.smithi166.stdout:1189: write oid 49 current snap is 54 2020-11-16T20:57:53.842 INFO:tasks.rados.rados.0.smithi166.stdout:1189: seq_num 679 ranges {611953=649488,1950097=529565,3246565=165388} 2020-11-16T20:57:53.842 INFO:tasks.rados.rados.0.smithi166.stdout:1189: writing smithi16641208-49 from 611953 to 1261441 tid 1 2020-11-16T20:57:53.843 INFO:tasks.rados.rados.0.smithi166.stdout:1189: writing smithi16641208-49 from 1950097 to 2479662 tid 2 2020-11-16T20:57:53.843 INFO:tasks.rados.rados.0.smithi166.stdout:1189: writing smithi16641208-49 from 3246565 to 3411953 tid 3 2020-11-16T20:57:53.843 INFO:tasks.rados.rados.0.smithi166.stdout:1190: copy_from oid 304 from oid 410 current snap is 54 2020-11-16T20:57:53.843 INFO:tasks.rados.rados.0.smithi166.stdout:1188: finishing rollback tid 0 to smithi16641208-405 2020-11-16T20:57:53.843 INFO:tasks.rados.rados.0.smithi166.stdout:1191: write oid 59 current snap is 54 2020-11-16T20:57:53.843 INFO:tasks.rados.rados.0.smithi166.stdout:1191: seq_num 680 ranges {628760=724737,1892226=673223,3157635=271125} 2020-11-16T20:57:53.843 INFO:tasks.rados.rados.0.smithi166.stdout:1191: writing smithi16641208-59 from 628760 to 1353497 tid 1 2020-11-16T20:57:53.844 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:57:53.845+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:57:53.844 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:57:53.848 INFO:tasks.rados.rados.0.smithi166.stdout:1191: writing smithi16641208-59 from 1892226 to 2565449 tid 2 2020-11-16T20:57:53.853 INFO:tasks.rados.rados.0.smithi166.stdout:1191: writing smithi16641208-59 from 3157635 to 3428760 tid 3 2020-11-16T20:57:53.853 INFO:tasks.rados.rados.0.smithi166.stdout:1192: read oid 22 snap 53 2020-11-16T20:57:53.854 INFO:tasks.rados.rados.0.smithi166.stdout:1192: expect (ObjNum 21 snap 0 seq_num 21) 2020-11-16T20:57:53.854 INFO:tasks.rados.rados.0.smithi166.stdout:1193: delete oid 298 current snap is 54 2020-11-16T20:57:53.854 INFO:tasks.rados.rados.0.smithi166.stdout:1189: finishing write tid 1 to smithi16641208-49 2020-11-16T20:57:53.854 INFO:tasks.rados.rados.0.smithi166.stdout:1189: finishing write tid 2 to smithi16641208-49 2020-11-16T20:57:53.855 INFO:tasks.rados.rados.0.smithi166.stdout:1189: finishing write tid 3 to smithi16641208-49 2020-11-16T20:57:53.857 INFO:tasks.rados.rados.0.smithi166.stdout:1190: finishing copy_from to smithi16641208-304 2020-11-16T20:57:53.858 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 304 v 304 (ObjNum 409 snap 0 seq_num 409) dirty exists 2020-11-16T20:57:53.866 INFO:tasks.rados.rados.0.smithi166.stdout:1188: finishing rollback tid 1 to smithi16641208-405 2020-11-16T20:57:53.866 INFO:tasks.rados.rados.0.smithi166.stdout:1188: finishing rollback tid 2 to smithi16641208-405 2020-11-16T20:57:53.866 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 405 v 752 (ObjNum 404 snap 0 seq_num 404) dirty exists 2020-11-16T20:57:53.867 INFO:tasks.rados.rados.0.smithi166.stdout:1189: finishing write tid 4 to smithi16641208-49 2020-11-16T20:57:53.867 INFO:tasks.rados.rados.0.smithi166.stdout:1189: finishing write tid 5 to smithi16641208-49 2020-11-16T20:57:53.867 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 49 v 753 (ObjNum 679 snap 54 seq_num 679) dirty exists 2020-11-16T20:57:53.867 INFO:tasks.rados.rados.0.smithi166.stdout:1189: left oid 49 (ObjNum 679 snap 54 seq_num 679) 2020-11-16T20:57:53.869 INFO:tasks.rados.rados.0.smithi166.stdout:1188: done (12 left) 2020-11-16T20:57:53.869 INFO:tasks.rados.rados.0.smithi166.stdout:1189: done (11 left) 2020-11-16T20:57:53.870 INFO:tasks.rados.rados.0.smithi166.stdout:1193: done (10 left) 2020-11-16T20:57:53.870 INFO:tasks.rados.rados.0.smithi166.stdout:1194: read oid 172 snap 48 2020-11-16T20:57:53.870 INFO:tasks.rados.rados.0.smithi166.stdout:1194: expect (ObjNum 171 snap 0 seq_num 171) 2020-11-16T20:57:53.870 INFO:tasks.rados.rados.0.smithi166.stdout:1195: cache_try_flush oid 428 snap 53 2020-11-16T20:57:53.870 INFO:tasks.rados.rados.0.smithi166.stdout:1196: copy_from oid 217 from oid 244 current snap is 54 2020-11-16T20:57:53.870 INFO:tasks.rados.rados.0.smithi166.stdout:1197: delete oid 87 current snap is 54 2020-11-16T20:57:53.871 INFO:tasks.rados.rados.0.smithi166.stdout:1192: expect (ObjNum 21 snap 0 seq_num 21) 2020-11-16T20:57:53.903 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:57:53.941 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:53.946+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:53.956 INFO:tasks.rados.rados.0.smithi166.stdout:1195: got (0) Success 2020-11-16T20:57:53.956 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 428 v 0 (ObjNum 48 snap 22090 seq_num 0) clean dne 2020-11-16T20:57:53.956 INFO:tasks.rados.rados.0.smithi166.stdout:1190: finishing copy_from racing read to smithi16641208-304 2020-11-16T20:57:53.956 INFO:tasks.rados.rados.0.smithi166.stdout:1194: expect (ObjNum 171 snap 0 seq_num 171) 2020-11-16T20:57:54.029 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:54.030 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:57:54.030 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:57:54.030 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:57:54.039 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:57:54.048 INFO:tasks.rados.rados.0.smithi166.stdout:1196: finishing copy_from to smithi16641208-217 2020-11-16T20:57:54.048 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 217 v 497 (ObjNum 243 snap 0 seq_num 243) dirty exists 2020-11-16T20:57:54.049 INFO:tasks.rados.rados.0.smithi166.stdout:1196: finishing copy_from racing read to smithi16641208-217 2020-11-16T20:57:54.049 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:57:54.068 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:57:54.080 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:54.085+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:54.087 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:57:54.106 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:57:54.126 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:57:54.144 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:54.149+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:54.146 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:57:54.166 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:57:54.185 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:57:54.186 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:57:54.186 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:57:54.187 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:57:54.187 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:57:54.187 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:57:54.187 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:57:54.187 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:57:54.187 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:57:54.215 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:54.215 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:54.225 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:57:54.266 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:54.271+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:54.344 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:57:54.349+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:57:54.400 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:54.400 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:54.410 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:57:54.451 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:54.456+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:54.546 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:54.551+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:54.586 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:54.586 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:54.596 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:57:54.646 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:54.651+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:54.730 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:54.731 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:54.740 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:57:54.781 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:54.786+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:54.833 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2020-11-16T20:57:54.876 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:54.882+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:54.917 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:54.917 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:54.926 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:57:54.950 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:54.954+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:55.051 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:57:55.055+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:57:55.057 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:55.058 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:55.067 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:57:55.153 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:55.157+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:55.196 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:55.196 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:55.205 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:57:55.253 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:57:55.258+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:57:55.354 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:55.359+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:55.369 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:55.369 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:55.378 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:57:55.455 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:55.460+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:55.506 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:55.507 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:55.515 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:57:55.557 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:55.562+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:55.657 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:55.662+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:55.681 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:55.682 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:55.690 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:57:55.758 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:55.763+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:55.818 INFO:teuthology.orchestra.run.smithi166.stderr:nodeep-scrub is set 2020-11-16T20:57:55.820 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:55.820 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:55.830 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:57:55.859 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:55.864+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:55.960 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:57:55.965+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:57:55.997 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:55.998 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:56.007 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:57:56.061 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:56.066+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:56.134 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:56.134 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:56.143 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:57:56.186 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:56.192+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:56.197 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:57:56.262 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:57:56.267+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:57:56.276 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:57:56.277 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:57:56.287 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:57:56.344 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:57:56.363 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:57:56.368+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:57:56.365 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:57:56.385 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:57:56.404 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:57:56.425 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:57:56.446 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:57:56.457 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:56.458 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:57:56.458 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:57:56.458 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:56.463 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:57:56.469+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:57:56.466 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:57:56.467 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:57:56.487 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:57:56.488 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:57:56.488 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:57:56.489 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:57:56.489 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:57:56.489 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:57:56.489 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:57:56.489 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:57:56.489 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:57:56.564 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:56.569+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:56.612 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:56.613 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:57:56.613 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:57:56.613 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:57:56.613 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:56.622 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:57:56.667 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:56.672+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:56.771 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:56.771+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:56.795 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:57:56.795 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:57:56.796 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:57:56.796 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:57:56.796 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.796 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:554 3.2 3:769099fd:::smithi16641208-247:head [copy-from ver 123] snapc 1=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:57:56.796 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:57:56.796 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 111.74885060699999, 2020-11-16T20:57:56.797 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998, 2020-11-16T20:57:56.797 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:56.797 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:56.797 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:56.797 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.797 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:56.797 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:57:56.798 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:56.798 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.798 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:56.798 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:57:56.798 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6705999999999997e-05 2020-11-16T20:57:56.798 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.799 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.799 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:56.799 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050139+0000", 2020-11-16T20:57:56.799 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6199999999999998e-06 2020-11-16T20:57:56.799 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.799 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.799 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:56.800 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050144+0000", 2020-11-16T20:57:56.800 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.944e-06 2020-11-16T20:57:56.800 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.800 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.800 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:56.800 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050154+0000", 2020-11-16T20:57:56.800 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4043999999999999e-05 2020-11-16T20:57:56.800 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.801 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.801 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:56.801 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050178+0000", 2020-11-16T20:57:56.801 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078971409999999999 2020-11-16T20:57:56.801 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.801 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.801 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.802 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058075+0000", 2020-11-16T20:57:56.802 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012776500000000001 2020-11-16T20:57:56.802 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.802 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.802 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:56.802 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058203+0000", 2020-11-16T20:57:56.802 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011807013 2020-11-16T20:57:56.803 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.803 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.803 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:56.803 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070010+0000", 2020-11-16T20:57:56.803 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029522160000000001 2020-11-16T20:57:56.803 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.803 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.804 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:56.804 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.072962+0000", 2020-11-16T20:57:56.804 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017845006 2020-11-16T20:57:56.804 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.804 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.804 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:56.804 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.090807+0000", 2020-11-16T20:57:56.804 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.009301808 2020-11-16T20:57:56.805 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.805 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.805 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:56.805 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100109+0000", 2020-11-16T20:57:56.805 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7076999999999995e-05 2020-11-16T20:57:56.805 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.805 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.806 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:56.806 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100176+0000", 2020-11-16T20:57:56.806 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9790999999999999e-05 2020-11-16T20:57:56.806 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.806 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.806 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:56.806 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100216+0000", 2020-11-16T20:57:56.807 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998 2020-11-16T20:57:56.807 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.807 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:56.807 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.807 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.807 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.807 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2429 4.0 4:3b92f709:::smithi16641208-69:head [rollback 7] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:57:56.808 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:57:56.808 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 106.78293234500001, 2020-11-16T20:57:56.808 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003, 2020-11-16T20:57:56.808 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:56.808 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:56.808 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:56.808 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:56.808 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:56.809 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2429 2020-11-16T20:57:56.809 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.809 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:56.809 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.809 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:56.809 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:57:56.809 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:56.810 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.810 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.810 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:56.810 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:57:56.810 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3710000000000002e-05 2020-11-16T20:57:56.810 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.810 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.811 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:56.811 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016044+0000", 2020-11-16T20:57:56.811 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7090000000000001e-06 2020-11-16T20:57:56.811 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.811 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.811 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:56.811 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016049+0000", 2020-11-16T20:57:56.812 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8820000000000003e-06 2020-11-16T20:57:56.812 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.812 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.812 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:56.812 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016056+0000", 2020-11-16T20:57:56.812 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.27e-06 2020-11-16T20:57:56.812 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.812 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.813 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:56.813 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016059+0000", 2020-11-16T20:57:56.813 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.537e-05 2020-11-16T20:57:56.813 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.813 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.813 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.813 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016115+0000", 2020-11-16T20:57:56.814 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8690000000000003e-06 2020-11-16T20:57:56.814 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.814 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.814 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:56.814 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016120+0000", 2020-11-16T20:57:56.814 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021405730000000002 2020-11-16T20:57:56.814 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.815 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.815 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.815 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018260+0000", 2020-11-16T20:57:56.815 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0137999999999999e-05 2020-11-16T20:57:56.815 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.815 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.815 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:56.815 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018320+0000", 2020-11-16T20:57:56.816 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011799352000000001 2020-11-16T20:57:56.816 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.816 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.816 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.816 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030120+0000", 2020-11-16T20:57:56.816 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000163139 2020-11-16T20:57:56.816 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.817 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.817 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:56.817 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030283+0000", 2020-11-16T20:57:56.817 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029657000000000002 2020-11-16T20:57:56.817 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.817 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.817 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:56.818 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030579+0000", 2020-11-16T20:57:56.818 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3058000000000001e-05 2020-11-16T20:57:56.818 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.818 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.818 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:56.818 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030612+0000", 2020-11-16T20:57:56.818 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0075168259999999999 2020-11-16T20:57:56.819 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.819 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.819 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.819 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038129+0000", 2020-11-16T20:57:56.819 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012914299999999999 2020-11-16T20:57:56.819 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.819 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.819 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:56.820 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038258+0000", 2020-11-16T20:57:56.820 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034292799999999999 2020-11-16T20:57:56.820 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.820 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.820 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:57:56.820 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038601+0000", 2020-11-16T20:57:56.820 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0025181159999999999 2020-11-16T20:57:56.821 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.821 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.821 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.821 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041119+0000", 2020-11-16T20:57:56.821 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2331999999999997e-05 2020-11-16T20:57:56.821 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.821 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.822 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for ondisk", 2020-11-16T20:57:56.822 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041202+0000", 2020-11-16T20:57:56.822 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028481750000000001 2020-11-16T20:57:56.822 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.822 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.822 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:56.822 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044050+0000", 2020-11-16T20:57:56.823 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001269921 2020-11-16T20:57:56.823 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.823 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.823 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:56.823 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045320+0000", 2020-11-16T20:57:56.823 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054215490000000003 2020-11-16T20:57:56.823 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.823 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.824 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:56.824 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050741+0000", 2020-11-16T20:57:56.824 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6981000000000001e-05 2020-11-16T20:57:56.824 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.824 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.824 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:56.824 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050808+0000", 2020-11-16T20:57:56.825 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8841e-05 2020-11-16T20:57:56.825 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.825 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.825 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:56.825 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050877+0000", 2020-11-16T20:57:56.825 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003 2020-11-16T20:57:56.825 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.826 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:56.826 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.826 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.826 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.826 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2430 4.0 4:3b92f709:::smithi16641208-69:head [append 0~0] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:57:56.826 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:57:56.826 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 106.782876022, 2020-11-16T20:57:56.827 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001, 2020-11-16T20:57:56.827 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:56.827 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:56.827 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:56.827 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:56.827 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:56.827 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2430 2020-11-16T20:57:56.827 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.828 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:56.828 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.828 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:56.828 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:57:56.828 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:56.828 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.828 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.829 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:56.829 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:57:56.829 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0857e-05 2020-11-16T20:57:56.829 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.829 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.829 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:56.829 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016098+0000", 2020-11-16T20:57:56.830 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9179999999999999e-06 2020-11-16T20:57:56.830 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.830 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.830 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:56.830 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016104+0000", 2020-11-16T20:57:56.830 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8230000000000006e-06 2020-11-16T20:57:56.830 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.830 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.831 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:56.831 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016114+0000", 2020-11-16T20:57:56.831 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2180000000000001e-06 2020-11-16T20:57:56.831 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.831 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.831 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:56.831 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016118+0000", 2020-11-16T20:57:56.832 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3547999999999995e-05 2020-11-16T20:57:56.832 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.832 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.832 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.832 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016181+0000", 2020-11-16T20:57:56.832 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8730000000000007e-06 2020-11-16T20:57:56.832 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.833 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.833 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:57:56.833 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016189+0000", 2020-11-16T20:57:56.833 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021577200000000001 2020-11-16T20:57:56.833 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.833 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.833 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.833 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018347+0000", 2020-11-16T20:57:56.834 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6832000000000001e-05 2020-11-16T20:57:56.834 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.834 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.834 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:56.834 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018404+0000", 2020-11-16T20:57:56.834 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012272913999999999 2020-11-16T20:57:56.834 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.835 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.835 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.835 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030677+0000", 2020-11-16T20:57:56.835 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2555000000000002e-05 2020-11-16T20:57:56.835 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.835 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.835 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:56.836 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030719+0000", 2020-11-16T20:57:56.836 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010518684 2020-11-16T20:57:56.836 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.836 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.836 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.836 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041238+0000", 2020-11-16T20:57:56.836 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000144723 2020-11-16T20:57:56.836 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.837 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.837 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:56.837 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041383+0000", 2020-11-16T20:57:56.837 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000214575 2020-11-16T20:57:56.837 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.837 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.837 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:57:56.838 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041597+0000", 2020-11-16T20:57:56.838 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002463196 2020-11-16T20:57:56.838 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.838 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.838 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:56.838 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044060+0000", 2020-11-16T20:57:56.838 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001654066 2020-11-16T20:57:56.839 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.839 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.839 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:56.839 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045715+0000", 2020-11-16T20:57:56.839 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053780599999999996 2020-11-16T20:57:56.839 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.839 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.840 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:56.840 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051093+0000", 2020-11-16T20:57:56.840 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8189999999999996e-05 2020-11-16T20:57:56.840 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.840 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.840 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:56.840 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051161+0000", 2020-11-16T20:57:56.840 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4910000000000001e-05 2020-11-16T20:57:56.841 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.841 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.841 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:56.841 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051216+0000", 2020-11-16T20:57:56.841 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001 2020-11-16T20:57:56.841 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.841 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:56.842 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.842 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.842 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.842 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "MOSDPGPush(4.1 52/51 [PushOp(4:9ab04c4a:::smithi16641208-1:head, version: 33'3, data_included: [0~892056,1542129~156520], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:9ab04c4a:::smithi16641208-1:head@33'3, size: 2016807, copy_subset: [0~2016807], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1698649, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:a1eef07d:::smithi16641208-13:head, version: 33'9, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:a1eef07d:::smithi16641208-13:head@33'9, size: 2201684, copy_subset: [0~2201684], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:929564f0:::smithi16641208-24:head, version: 33'18, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:929564f0:::smithi16641208-24:head@33'18, size: 2386561, copy_subset: [0~2386561], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b565f7d2:::smithi16641208-35:head, version: 33'27, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b565f7d2:::smithi16641208-35:head@33'27, size: 2571438, copy_subset: [0~2571438], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b6545a47:::smithi16641208-46:head, version: 33'29, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b6545a47:::smithi16641208-46:head@33'29, size: 2756315, copy_subset: [0~2756315], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:9bd9f31d:::smithi16641208-48:head, version: 33'35, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:9bd9f31d:::smithi16641208-48:head@33'35, size: 2789929, copy_subset: [0~2789929], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:83205103:::smithi16641208-103:head, version: 34'38, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:83205103:::smithi16641208-103:head@34'38, size: 3714314, copy_subset: [0~3714314], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:86a0a5b7:::smithi16641208-108:head, version: 34'42, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:86a0a5b7:::smithi16641208-108:head@34'42, size: 3798349, copy_subset: [0~3798349], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-16T20:57:56.842 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:57:56.842 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 102.028279416, 2020-11-16T20:57:56.842 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032552672999999997, 2020-11-16T20:57:56.843 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:56.843 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:56.843 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:56.843 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.843 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:56.843 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:57:56.843 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:56.844 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.844 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.844 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:56.844 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:57:56.844 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017498692999999999 2020-11-16T20:57:56.844 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.844 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.845 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:56.845 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788172+0000", 2020-11-16T20:57:56.845 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4147999999999999e-05 2020-11-16T20:57:56.845 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.845 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.845 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:56.845 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788206+0000", 2020-11-16T20:57:56.846 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0016000000000002e-05 2020-11-16T20:57:56.846 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.846 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.846 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:56.846 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788276+0000", 2020-11-16T20:57:56.846 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2172000000000002e-05 2020-11-16T20:57:56.846 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.846 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.847 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:56.847 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788319+0000", 2020-11-16T20:57:56.847 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000154337 2020-11-16T20:57:56.847 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.847 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.847 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.847 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788473+0000", 2020-11-16T20:57:56.848 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7690000000000002e-06 2020-11-16T20:57:56.848 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.848 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.848 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:56.848 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788482+0000", 2020-11-16T20:57:56.848 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014744538 2020-11-16T20:57:56.848 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.849 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.849 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:56.849 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803226+0000", 2020-11-16T20:57:56.849 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032552672999999997 2020-11-16T20:57:56.849 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.849 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:56.849 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.849 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.850 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.850 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.0:552 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'128, mlcod=0'0)", 2020-11-16T20:57:56.850 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:57:56.850 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 102.00831399800001, 2020-11-16T20:57:56.850 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038033168999999999, 2020-11-16T20:57:56.850 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:56.850 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:56.851 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:56.851 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.851 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:56.851 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:57:56.851 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:56.851 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.851 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.852 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:56.852 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:57:56.852 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0031023880000000002 2020-11-16T20:57:56.852 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.852 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.852 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:56.852 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793741+0000", 2020-11-16T20:57:56.852 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1496e-05 2020-11-16T20:57:56.853 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.853 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.853 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:56.853 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793753+0000", 2020-11-16T20:57:56.853 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9009999999999999e-05 2020-11-16T20:57:56.853 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.853 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.854 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:56.854 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793772+0000", 2020-11-16T20:57:56.854 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3318e-05 2020-11-16T20:57:56.854 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.854 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.854 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:56.854 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793785+0000", 2020-11-16T20:57:56.855 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012534775 2020-11-16T20:57:56.855 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.855 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.855 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.855 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806320+0000", 2020-11-16T20:57:56.855 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8144999999999999e-05 2020-11-16T20:57:56.855 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.856 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.856 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:56.856 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806348+0000", 2020-11-16T20:57:56.856 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022285688000000001 2020-11-16T20:57:56.856 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.856 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.856 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:56.856 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828634+0000", 2020-11-16T20:57:56.857 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8349000000000002e-05 2020-11-16T20:57:56.857 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.857 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.857 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:56.857 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828672+0000", 2020-11-16T20:57:56.857 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038033168999999999 2020-11-16T20:57:56.857 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.858 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:56.858 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.858 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.858 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.858 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2503 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'129, mlcod=0'0)", 2020-11-16T20:57:56.858 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:57:56.859 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 102.005125818, 2020-11-16T20:57:56.859 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034870998, 2020-11-16T20:57:56.859 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:56.859 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:56.859 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:56.859 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.859 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:56.860 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:57:56.860 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:56.860 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.860 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.860 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:56.860 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:57:56.860 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00093048899999999995 2020-11-16T20:57:56.861 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.861 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.861 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:56.861 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794758+0000", 2020-11-16T20:57:56.861 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.169e-05 2020-11-16T20:57:56.861 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.861 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.861 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:56.862 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794769+0000", 2020-11-16T20:57:56.862 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3998999999999999e-05 2020-11-16T20:57:56.862 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.862 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.862 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:56.862 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794783+0000", 2020-11-16T20:57:56.862 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.481e-06 2020-11-16T20:57:56.863 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.863 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.863 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:56.863 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794791+0000", 2020-11-16T20:57:56.863 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.02524036 2020-11-16T20:57:56.863 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.863 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.864 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.864 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820031+0000", 2020-11-16T20:57:56.864 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.811e-05 2020-11-16T20:57:56.864 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.864 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.864 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:56.864 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820059+0000", 2020-11-16T20:57:56.864 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.008614577 2020-11-16T20:57:56.865 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.865 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.865 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:56.865 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828674+0000", 2020-11-16T20:57:56.865 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4292000000000001e-05 2020-11-16T20:57:56.865 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.865 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.866 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:56.866 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828698+0000", 2020-11-16T20:57:56.866 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034870998 2020-11-16T20:57:56.866 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.866 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:56.866 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.866 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.867 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.867 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2504 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'130, mlcod=0'0)", 2020-11-16T20:57:56.867 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:57:56.867 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 102.004120136, 2020-11-16T20:57:56.867 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033888776000000002, 2020-11-16T20:57:56.867 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:56.867 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:56.868 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:56.868 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.868 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:56.868 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:57:56.868 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:56.868 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.868 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.868 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:56.869 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:57:56.869 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3896999999999997e-05 2020-11-16T20:57:56.869 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.869 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.869 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:56.869 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794877+0000", 2020-11-16T20:57:56.869 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7019999999999998e-06 2020-11-16T20:57:56.870 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.870 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.870 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:56.870 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794883+0000", 2020-11-16T20:57:56.870 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.789e-06 2020-11-16T20:57:56.870 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.870 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.871 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:56.871 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794888+0000", 2020-11-16T20:57:56.871 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.852e-06 2020-11-16T20:57:56.871 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.871 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.871 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:56.871 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794891+0000", 2020-11-16T20:57:56.871 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026152822999999999 2020-11-16T20:57:56.872 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.872 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.872 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.872 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.821044+0000", 2020-11-16T20:57:56.872 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6900999999999999e-05 2020-11-16T20:57:56.872 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.872 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.873 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:56.873 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.821071+0000", 2020-11-16T20:57:56.873 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0076283210000000004 2020-11-16T20:57:56.873 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.873 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.873 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:56.873 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828699+0000", 2020-11-16T20:57:56.873 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2490999999999999e-05 2020-11-16T20:57:56.874 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.874 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.874 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:56.874 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828722+0000", 2020-11-16T20:57:56.874 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033888776000000002 2020-11-16T20:57:56.874 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.874 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:56.875 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.875 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.875 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.875 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:603 3.2 3:5a2e7c26:::smithi16641208-130:head [copy-from ver 67] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:57:56.875 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:57:56.875 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 97.047712071999996, 2020-11-16T20:57:56.875 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036631116999999998, 2020-11-16T20:57:56.876 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:56.876 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:56.876 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:56.876 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.876 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:56.876 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:57:56.876 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:56.876 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.877 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.877 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:56.877 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:57:56.877 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9854000000000002e-05 2020-11-16T20:57:56.877 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.877 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.877 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:56.878 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751281+0000", 2020-11-16T20:57:56.878 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1840000000000004e-06 2020-11-16T20:57:56.878 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.878 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.878 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:56.878 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751287+0000", 2020-11-16T20:57:56.878 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0231000000000001e-05 2020-11-16T20:57:56.879 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.879 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.879 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:56.879 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751297+0000", 2020-11-16T20:57:56.879 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.639e-06 2020-11-16T20:57:56.879 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.879 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.879 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:56.880 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751302+0000", 2020-11-16T20:57:56.880 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030012000000000002 2020-11-16T20:57:56.880 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.880 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.880 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.880 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751602+0000", 2020-11-16T20:57:56.880 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013830200000000001 2020-11-16T20:57:56.881 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.881 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.881 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:56.881 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751740+0000", 2020-11-16T20:57:56.881 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019538969999999999 2020-11-16T20:57:56.881 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.881 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.881 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:56.882 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771279+0000", 2020-11-16T20:57:56.882 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007630403 2020-11-16T20:57:56.882 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.882 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.882 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:56.882 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.778910+0000", 2020-11-16T20:57:56.882 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0065002009999999997 2020-11-16T20:57:56.883 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.883 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.883 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:56.883 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.785410+0000", 2020-11-16T20:57:56.883 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0023914140000000001 2020-11-16T20:57:56.883 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.883 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.883 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:56.884 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787801+0000", 2020-11-16T20:57:56.884 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9629999999999998e-05 2020-11-16T20:57:56.884 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.884 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.884 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:56.884 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787841+0000", 2020-11-16T20:57:56.884 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1168999999999999e-05 2020-11-16T20:57:56.885 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.885 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.885 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:56.885 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787872+0000", 2020-11-16T20:57:56.885 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036631116999999998 2020-11-16T20:57:56.885 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.885 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:56.886 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.886 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.886 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.886 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:609 3.2 3:5eead97c:::smithi16641208-34:head [copy-from ver 27] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:57:56.886 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:57:56.886 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 97.009914942999998, 2020-11-16T20:57:56.886 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.062626424, 2020-11-16T20:57:56.887 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:56.887 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:56.887 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:56.887 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.887 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:56.887 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:57:56.887 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:56.887 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.888 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.888 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:56.888 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:57:56.888 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3596000000000001e-05 2020-11-16T20:57:56.888 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.888 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.888 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:56.889 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789082+0000", 2020-11-16T20:57:56.889 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3209999999999999e-06 2020-11-16T20:57:56.889 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.889 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.889 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:56.889 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789089+0000", 2020-11-16T20:57:56.889 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3498e-05 2020-11-16T20:57:56.890 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.890 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.890 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:56.890 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789103+0000", 2020-11-16T20:57:56.890 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3679999999999998e-06 2020-11-16T20:57:56.890 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.890 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.890 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:56.891 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789109+0000", 2020-11-16T20:57:56.891 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007399638 2020-11-16T20:57:56.891 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.891 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.891 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.891 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.796509+0000", 2020-11-16T20:57:56.891 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000181168 2020-11-16T20:57:56.892 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.892 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.892 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:56.892 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.796690+0000", 2020-11-16T20:57:56.892 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01336562 2020-11-16T20:57:56.892 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.892 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.892 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:56.893 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.810055+0000", 2020-11-16T20:57:56.893 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044828350000000001 2020-11-16T20:57:56.893 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.893 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.893 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:56.893 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.814538+0000", 2020-11-16T20:57:56.893 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035609628999999997 2020-11-16T20:57:56.894 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.894 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.894 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:56.894 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850148+0000", 2020-11-16T20:57:56.894 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0013754730000000001 2020-11-16T20:57:56.894 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.894 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.895 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:56.895 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851523+0000", 2020-11-16T20:57:56.895 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9935e-05 2020-11-16T20:57:56.895 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.895 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.895 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:56.895 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851603+0000", 2020-11-16T20:57:56.895 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1342999999999999e-05 2020-11-16T20:57:56.896 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.896 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.896 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:56.896 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851665+0000", 2020-11-16T20:57:56.896 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.062626424 2020-11-16T20:57:56.896 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.896 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:56.897 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.897 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.897 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.897 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2605 4.0 4:2294fced:::smithi16641208-278:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:57:56.897 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:57:56.897 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 96.882079826999998, 2020-11-16T20:57:56.897 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032301128999999998, 2020-11-16T20:57:56.897 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:56.898 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:56.898 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:56.898 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:56.898 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:56.898 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2605 2020-11-16T20:57:56.898 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.898 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:56.899 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.899 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:56.899 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:57:56.899 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:56.899 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.899 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.899 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:56.900 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:57:56.900 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.811e-05 2020-11-16T20:57:56.900 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.900 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.900 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:56.900 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916901+0000", 2020-11-16T20:57:56.900 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2939999999999996e-06 2020-11-16T20:57:56.900 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.901 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.901 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:56.901 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916907+0000", 2020-11-16T20:57:56.901 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0589e-05 2020-11-16T20:57:56.901 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.901 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.901 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:56.902 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916917+0000", 2020-11-16T20:57:56.902 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2549999999999999e-06 2020-11-16T20:57:56.902 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.902 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.902 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:56.902 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916921+0000", 2020-11-16T20:57:56.902 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033789099999999999 2020-11-16T20:57:56.903 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.903 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.903 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.903 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.917259+0000", 2020-11-16T20:57:56.903 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.25e-05 2020-11-16T20:57:56.903 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.903 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.903 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:56.904 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.917332+0000", 2020-11-16T20:57:56.904 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.028336376999999999 2020-11-16T20:57:56.904 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.904 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.904 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.904 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.945668+0000", 2020-11-16T20:57:56.904 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0983000000000006e-05 2020-11-16T20:57:56.905 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.905 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.905 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:56.905 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.945759+0000", 2020-11-16T20:57:56.905 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00324756 2020-11-16T20:57:56.905 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.905 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.906 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.906 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949007+0000", 2020-11-16T20:57:56.906 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0583999999999999e-05 2020-11-16T20:57:56.906 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.906 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.906 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:56.906 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949097+0000", 2020-11-16T20:57:56.906 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6985999999999998e-05 2020-11-16T20:57:56.907 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.907 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.907 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:56.907 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949174+0000", 2020-11-16T20:57:56.907 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032301128999999998 2020-11-16T20:57:56.907 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.907 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:56.908 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.908 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.908 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.908 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2874 4.0 4:055e14cb:::smithi16641208-187:head [copy-from ver 402] snapc 25=[25,23,21,f] ondisk+write+known_if_redirected e72)", 2020-11-16T20:57:56.908 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:57:56.908 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 82.053556157000003, 2020-11-16T20:57:56.908 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031663616999999998, 2020-11-16T20:57:56.909 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:56.909 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:56.909 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:56.909 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:56.909 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:56.909 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2874 2020-11-16T20:57:56.909 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.909 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:56.910 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.910 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:56.910 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:57:56.910 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:56.910 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.910 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.910 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:56.911 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745397+0000", 2020-11-16T20:57:56.911 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6754000000000001e-05 2020-11-16T20:57:56.911 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.911 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.911 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:56.911 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745434+0000", 2020-11-16T20:57:56.911 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5049999999999998e-06 2020-11-16T20:57:56.912 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.912 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.912 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:56.912 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745439+0000", 2020-11-16T20:57:56.912 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0803e-05 2020-11-16T20:57:56.912 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.912 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.912 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:56.913 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745450+0000", 2020-11-16T20:57:56.913 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8810000000000004e-06 2020-11-16T20:57:56.913 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.913 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.913 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:56.913 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745455+0000", 2020-11-16T20:57:56.913 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022866499999999999 2020-11-16T20:57:56.914 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.914 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.914 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.914 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745684+0000", 2020-11-16T20:57:56.914 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000132714 2020-11-16T20:57:56.914 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.915 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.915 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:56.915 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745816+0000", 2020-11-16T20:57:56.915 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0050117850000000004 2020-11-16T20:57:56.915 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.915 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.915 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:57:56.915 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.750828+0000", 2020-11-16T20:57:56.916 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010413489 2020-11-16T20:57:56.916 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.916 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.916 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:56.916 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.761241+0000", 2020-11-16T20:57:56.916 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028274289999999998 2020-11-16T20:57:56.916 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.917 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.917 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:56.917 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.764069+0000", 2020-11-16T20:57:56.917 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012880057 2020-11-16T20:57:56.917 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.917 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.917 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:56.917 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.776949+0000", 2020-11-16T20:57:56.918 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2536e-05 2020-11-16T20:57:56.918 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.918 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.918 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:56.918 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777002+0000", 2020-11-16T20:57:56.918 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8999000000000002e-05 2020-11-16T20:57:56.918 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.919 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.919 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:56.919 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777061+0000", 2020-11-16T20:57:56.919 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031663616999999998 2020-11-16T20:57:56.919 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.919 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:56.919 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.920 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.920 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.920 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2875 4.0 4:055e14cb:::smithi16641208-187:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-11-16T20:57:56.920 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:57:56.920 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 82.053466931000003, 2020-11-16T20:57:56.920 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031888061000000002, 2020-11-16T20:57:56.920 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:56.920 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:56.921 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:56.921 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:56.921 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:56.921 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2875 2020-11-16T20:57:56.921 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.921 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:56.921 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.922 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:56.922 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:57:56.922 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:56.922 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.922 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.922 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:56.922 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745486+0000", 2020-11-16T20:57:56.923 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0239000000000001e-05 2020-11-16T20:57:56.923 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.923 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.923 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:56.923 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745506+0000", 2020-11-16T20:57:56.923 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.252e-06 2020-11-16T20:57:56.923 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.923 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.924 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:56.924 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745510+0000", 2020-11-16T20:57:56.924 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3670000000000002e-06 2020-11-16T20:57:56.924 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.924 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.924 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:56.924 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745516+0000", 2020-11-16T20:57:56.925 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1089999999999998e-06 2020-11-16T20:57:56.925 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.925 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.925 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:56.925 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745519+0000", 2020-11-16T20:57:56.925 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045188999999999998 2020-11-16T20:57:56.925 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.925 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.926 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.926 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745971+0000", 2020-11-16T20:57:56.926 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7822999999999998e-05 2020-11-16T20:57:56.926 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.926 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.926 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:56.926 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.746029+0000", 2020-11-16T20:57:56.927 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013333563999999999 2020-11-16T20:57:56.927 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.927 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.927 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.927 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.759362+0000", 2020-11-16T20:57:56.927 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000170896 2020-11-16T20:57:56.927 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.928 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.928 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:56.928 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.759533+0000", 2020-11-16T20:57:56.928 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017572878 2020-11-16T20:57:56.928 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.928 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.928 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.928 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777106+0000", 2020-11-16T20:57:56.929 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014436399999999999 2020-11-16T20:57:56.929 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.929 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.929 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:56.929 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777251+0000", 2020-11-16T20:57:56.929 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012367899999999999 2020-11-16T20:57:56.929 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.930 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.930 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:56.930 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.777374+0000", 2020-11-16T20:57:56.930 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031888061000000002 2020-11-16T20:57:56.930 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.930 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:56.930 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.931 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.931 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.931 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3004 3.2 3:4fbd4ff5:::smithi16641208-419:head [copy-from ver 366] snapc 33=[33,25] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e87)", 2020-11-16T20:57:56.931 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.815968+0000", 2020-11-16T20:57:56.931 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 66.982985318000004, 2020-11-16T20:57:56.931 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042048220999999997, 2020-11-16T20:57:56.931 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:56.931 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:56.932 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:56.932 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.932 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:56.932 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.815968+0000", 2020-11-16T20:57:56.932 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:56.932 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.932 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.933 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:56.933 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.815968+0000", 2020-11-16T20:57:56.933 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3235000000000002e-05 2020-11-16T20:57:56.933 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.933 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.933 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:56.933 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816011+0000", 2020-11-16T20:57:56.933 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.303e-06 2020-11-16T20:57:56.934 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.934 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.934 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:56.934 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816019+0000", 2020-11-16T20:57:56.934 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9714999999999999e-05 2020-11-16T20:57:56.934 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.934 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.935 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:56.935 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816049+0000", 2020-11-16T20:57:56.935 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2960000000000001e-06 2020-11-16T20:57:56.935 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.935 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.935 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:56.935 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816056+0000", 2020-11-16T20:57:56.936 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000241606 2020-11-16T20:57:56.936 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.936 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.936 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.936 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816298+0000", 2020-11-16T20:57:56.936 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016421599999999999 2020-11-16T20:57:56.936 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.936 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.937 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:56.937 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816462+0000", 2020-11-16T20:57:56.937 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025803994 2020-11-16T20:57:56.937 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.937 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.937 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:56.937 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.842266+0000", 2020-11-16T20:57:56.938 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0072860549999999996 2020-11-16T20:57:56.938 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.938 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.938 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:56.938 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.849552+0000", 2020-11-16T20:57:56.938 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0077911389999999999 2020-11-16T20:57:56.938 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.939 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.939 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:56.939 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.857343+0000", 2020-11-16T20:57:56.939 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00049728000000000001 2020-11-16T20:57:56.939 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.939 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.939 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:56.940 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.857841+0000", 2020-11-16T20:57:56.940 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.1997999999999997e-05 2020-11-16T20:57:56.940 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.940 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.940 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:56.940 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.857923+0000", 2020-11-16T20:57:56.940 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3383999999999999e-05 2020-11-16T20:57:56.940 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.941 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.941 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:56.941 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858016+0000", 2020-11-16T20:57:56.941 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042048220999999997 2020-11-16T20:57:56.941 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.941 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:56.941 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.942 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.942 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.942 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:650 3.2 3:4fbd4ff5:::smithi16641208-419:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e87)", 2020-11-16T20:57:56.942 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.816105+0000", 2020-11-16T20:57:56.942 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 66.982847688000007, 2020-11-16T20:57:56.942 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042242304000000001, 2020-11-16T20:57:56.942 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:56.943 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:56.943 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:56.943 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.943 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:56.943 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816105+0000", 2020-11-16T20:57:56.943 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:56.943 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.943 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.944 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:56.944 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816105+0000", 2020-11-16T20:57:56.944 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6486999999999999e-05 2020-11-16T20:57:56.944 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.944 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.944 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:56.944 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816132+0000", 2020-11-16T20:57:56.945 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5230000000000003e-06 2020-11-16T20:57:56.945 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.945 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.945 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:56.945 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816137+0000", 2020-11-16T20:57:56.945 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1498000000000001e-05 2020-11-16T20:57:56.945 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.945 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.946 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:56.946 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816149+0000", 2020-11-16T20:57:56.946 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5789999999999997e-06 2020-11-16T20:57:56.946 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.946 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.946 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:56.946 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816153+0000", 2020-11-16T20:57:56.947 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00044901199999999999 2020-11-16T20:57:56.947 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.947 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.947 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.947 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816602+0000", 2020-11-16T20:57:56.947 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6134000000000002e-05 2020-11-16T20:57:56.947 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.948 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.948 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:56.948 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816649+0000", 2020-11-16T20:57:56.948 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032065206999999998 2020-11-16T20:57:56.948 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.948 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.948 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.948 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848714+0000", 2020-11-16T20:57:56.949 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000103695 2020-11-16T20:57:56.949 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.949 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.949 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:56.949 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848818+0000", 2020-11-16T20:57:56.949 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092315220000000007 2020-11-16T20:57:56.949 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.950 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.950 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.950 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858049+0000", 2020-11-16T20:57:56.950 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000104415 2020-11-16T20:57:56.950 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.950 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.950 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:56.951 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858153+0000", 2020-11-16T20:57:56.951 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019423199999999999 2020-11-16T20:57:56.951 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.951 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.951 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:56.951 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858348+0000", 2020-11-16T20:57:56.951 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042242304000000001 2020-11-16T20:57:56.951 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.952 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:56.952 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.952 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.952 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.952 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:651 3.2 3:4fbd4ff5:::smithi16641208-419:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e87)", 2020-11-16T20:57:56.952 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.816182+0000", 2020-11-16T20:57:56.952 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 66.982771193000005, 2020-11-16T20:57:56.953 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047784220000000002, 2020-11-16T20:57:56.953 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:56.953 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:56.953 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:56.953 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.953 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:56.953 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816182+0000", 2020-11-16T20:57:56.954 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:56.954 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.954 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.954 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:56.954 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816182+0000", 2020-11-16T20:57:56.954 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6310999999999998e-05 2020-11-16T20:57:56.954 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.954 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.955 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:56.955 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816218+0000", 2020-11-16T20:57:56.955 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6110000000000001e-06 2020-11-16T20:57:56.955 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.955 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.955 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:56.955 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816224+0000", 2020-11-16T20:57:56.956 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9189999999999994e-06 2020-11-16T20:57:56.956 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.956 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.956 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:56.956 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816234+0000", 2020-11-16T20:57:56.956 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3220000000000003e-06 2020-11-16T20:57:56.956 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.956 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.957 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:56.957 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816238+0000", 2020-11-16T20:57:56.957 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00043294900000000002 2020-11-16T20:57:56.957 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.957 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.957 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.957 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816671+0000", 2020-11-16T20:57:56.958 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3359999999999998e-05 2020-11-16T20:57:56.958 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.958 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.958 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:56.958 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816714+0000", 2020-11-16T20:57:56.958 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032137410999999998 2020-11-16T20:57:56.958 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.959 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.959 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.959 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848852+0000", 2020-11-16T20:57:56.959 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000103235 2020-11-16T20:57:56.959 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.959 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.959 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:56.959 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848955+0000", 2020-11-16T20:57:56.960 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094266409999999995 2020-11-16T20:57:56.960 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.960 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.960 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.960 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858382+0000", 2020-11-16T20:57:56.960 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7973999999999995e-05 2020-11-16T20:57:56.960 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.961 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.961 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:56.961 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858470+0000", 2020-11-16T20:57:56.961 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054964870000000004 2020-11-16T20:57:56.961 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.961 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.961 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:56.961 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.863966+0000", 2020-11-16T20:57:56.962 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047784220000000002 2020-11-16T20:57:56.962 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.962 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:56.962 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.962 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.962 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.962 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3541 4.0 4:251c4c06:::smithi16641208-378:head [write 1862271~598221] snapc 55=[55,54] ondisk+write+known_if_redirected e130)", 2020-11-16T20:57:56.963 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.764037+0000", 2020-11-16T20:57:56.963 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 22.034916534000001, 2020-11-16T20:57:56.963 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037702297000000003, 2020-11-16T20:57:56.963 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:56.963 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:56.963 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:56.964 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:56.964 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:56.964 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3541 2020-11-16T20:57:56.964 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.964 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:56.964 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.964 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:56.964 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764037+0000", 2020-11-16T20:57:56.965 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:56.965 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.965 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.965 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:56.965 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764037+0000", 2020-11-16T20:57:56.965 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018829599999999999 2020-11-16T20:57:56.965 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.966 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.966 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:56.966 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764225+0000", 2020-11-16T20:57:56.966 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7600000000000002e-06 2020-11-16T20:57:56.966 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.966 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.966 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:56.967 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764233+0000", 2020-11-16T20:57:56.967 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2991e-05 2020-11-16T20:57:56.967 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.967 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.967 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:56.967 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764246+0000", 2020-11-16T20:57:56.967 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7379999999999997e-06 2020-11-16T20:57:56.967 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.968 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.968 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:56.968 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764252+0000", 2020-11-16T20:57:56.968 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000195482 2020-11-16T20:57:56.968 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.968 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.968 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.969 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764448+0000", 2020-11-16T20:57:56.969 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3134999999999998e-05 2020-11-16T20:57:56.969 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.969 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.969 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:56.969 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764511+0000", 2020-11-16T20:57:56.969 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024010632000000001 2020-11-16T20:57:56.969 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.970 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.970 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.970 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788522+0000", 2020-11-16T20:57:56.970 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014091200000000001 2020-11-16T20:57:56.970 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.970 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.970 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:56.971 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788662+0000", 2020-11-16T20:57:56.971 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015662400000000001 2020-11-16T20:57:56.971 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.971 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.971 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:57:56.971 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788819+0000", 2020-11-16T20:57:56.971 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0045297089999999998 2020-11-16T20:57:56.972 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.972 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.972 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:56.972 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.793349+0000", 2020-11-16T20:57:56.972 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061836570000000004 2020-11-16T20:57:56.972 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.972 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.972 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:56.973 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.799532+0000", 2020-11-16T20:57:56.973 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0020861299999999998 2020-11-16T20:57:56.973 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.973 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.973 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:56.973 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801619+0000", 2020-11-16T20:57:56.973 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9320999999999996e-05 2020-11-16T20:57:56.974 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.974 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.974 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:56.974 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801688+0000", 2020-11-16T20:57:56.974 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0909999999999999e-05 2020-11-16T20:57:56.974 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.974 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.975 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:56.975 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801739+0000", 2020-11-16T20:57:56.975 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037702297000000003 2020-11-16T20:57:56.975 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.975 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:56.975 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.975 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.975 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.976 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3542 4.0 4:251c4c06:::smithi16641208-378:head [setxattr _header (58) in=7b,truncate 2974971] snapc 55=[55,54] ondisk+write+known_if_redirected e130)", 2020-11-16T20:57:56.976 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.764282+0000", 2020-11-16T20:57:56.976 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 22.034670650999999, 2020-11-16T20:57:56.976 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037622296999999999, 2020-11-16T20:57:56.976 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:56.976 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:56.976 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:56.977 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:56.977 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:56.977 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3542 2020-11-16T20:57:56.977 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.977 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:56.977 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.977 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:56.977 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764282+0000", 2020-11-16T20:57:56.978 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:56.978 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.978 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.978 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:56.978 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764282+0000", 2020-11-16T20:57:56.978 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0065000000000001e-05 2020-11-16T20:57:56.978 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.979 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.979 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:56.979 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764312+0000", 2020-11-16T20:57:56.979 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2180000000000002e-06 2020-11-16T20:57:56.979 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.979 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.979 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:56.980 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764320+0000", 2020-11-16T20:57:56.980 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1029000000000001e-05 2020-11-16T20:57:56.980 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.980 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.980 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:56.980 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764331+0000", 2020-11-16T20:57:56.980 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4589999999999998e-06 2020-11-16T20:57:56.980 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.981 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.981 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:56.981 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764334+0000", 2020-11-16T20:57:56.981 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020802799999999999 2020-11-16T20:57:56.981 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.981 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.981 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.982 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764542+0000", 2020-11-16T20:57:56.982 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7712e-05 2020-11-16T20:57:56.982 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.982 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.982 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:56.982 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764590+0000", 2020-11-16T20:57:56.982 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025536256 2020-11-16T20:57:56.983 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.983 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.983 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.983 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790126+0000", 2020-11-16T20:57:56.983 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8548000000000007e-05 2020-11-16T20:57:56.983 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.983 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.983 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:56.984 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790215+0000", 2020-11-16T20:57:56.984 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013994800000000001 2020-11-16T20:57:56.984 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.984 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.984 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:57:56.984 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790355+0000", 2020-11-16T20:57:56.984 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0032107820000000001 2020-11-16T20:57:56.985 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.985 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.985 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:56.985 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.793565+0000", 2020-11-16T20:57:56.985 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0059758709999999998 2020-11-16T20:57:56.985 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.985 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.985 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:56.986 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.799541+0000", 2020-11-16T20:57:56.986 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002240999 2020-11-16T20:57:56.986 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.986 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.986 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:56.986 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801782+0000", 2020-11-16T20:57:56.986 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9985000000000003e-05 2020-11-16T20:57:56.987 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.987 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.987 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:56.987 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801842+0000", 2020-11-16T20:57:56.987 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2397000000000006e-05 2020-11-16T20:57:56.987 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.987 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.987 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:56.988 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801905+0000", 2020-11-16T20:57:56.988 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037622296999999999 2020-11-16T20:57:56.988 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.988 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:56.988 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.988 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.988 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.989 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3543 4.0 4:251c4c06:::smithi16641208-378:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e130)", 2020-11-16T20:57:56.989 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.764352+0000", 2020-11-16T20:57:56.989 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 22.034600646000001, 2020-11-16T20:57:56.989 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038764630000000001, 2020-11-16T20:57:56.989 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:56.989 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:57:56.989 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:57:56.990 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:57:56.990 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:56.990 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3543 2020-11-16T20:57:56.990 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.990 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:56.990 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.990 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:56.991 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764352+0000", 2020-11-16T20:57:56.991 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:56.991 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.991 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.991 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:56.991 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764352+0000", 2020-11-16T20:57:56.991 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5197999999999999e-05 2020-11-16T20:57:56.991 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.992 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.992 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:56.992 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764368+0000", 2020-11-16T20:57:56.992 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9960000000000002e-06 2020-11-16T20:57:56.992 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.992 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.992 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:56.993 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764371+0000", 2020-11-16T20:57:56.993 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8810000000000001e-06 2020-11-16T20:57:56.993 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.993 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.993 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:56.993 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764376+0000", 2020-11-16T20:57:56.993 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3949999999999999e-06 2020-11-16T20:57:56.993 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.994 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.994 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:56.994 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764379+0000", 2020-11-16T20:57:56.994 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023363999999999999 2020-11-16T20:57:56.994 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.994 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.994 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.995 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764613+0000", 2020-11-16T20:57:56.995 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3958999999999997e-05 2020-11-16T20:57:56.995 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.995 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.995 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:57:56.995 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764656+0000", 2020-11-16T20:57:56.995 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026048794 2020-11-16T20:57:56.996 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.996 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.996 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.996 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790705+0000", 2020-11-16T20:57:56.996 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013058500000000001 2020-11-16T20:57:56.996 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.996 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.996 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:57:56.997 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790836+0000", 2020-11-16T20:57:56.997 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011100066 2020-11-16T20:57:56.997 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.997 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.997 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:56.997 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801936+0000", 2020-11-16T20:57:56.997 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3307999999999996e-05 2020-11-16T20:57:56.998 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.998 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.998 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:56.998 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.802019+0000", 2020-11-16T20:57:56.998 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001097808 2020-11-16T20:57:56.998 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.998 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:56.999 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:56.999 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.803117+0000", 2020-11-16T20:57:56.999 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038764630000000001 2020-11-16T20:57:56.999 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.999 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:56.999 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:56.999 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:56.999 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.000 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.5.13:51 3.2 3:4427cc2e:::smithi16641208-332:head [copy-from ver 661] snapc 4f=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e139)", 2020-11-16T20:57:57.000 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:43.986780+0000", 2020-11-16T20:57:57.000 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 12.812173125999999, 2020-11-16T20:57:57.000 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.040884263999999997, 2020-11-16T20:57:57.000 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:57.000 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:57.000 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:57.001 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.001 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:57.001 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.986780+0000", 2020-11-16T20:57:57.001 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:57.001 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.001 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.001 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:57.001 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.986780+0000", 2020-11-16T20:57:57.002 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0978e-05 2020-11-16T20:57:57.002 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.002 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.002 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:57.002 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.986821+0000", 2020-11-16T20:57:57.002 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6009999999999997e-06 2020-11-16T20:57:57.002 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.003 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.003 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:57.003 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.986826+0000", 2020-11-16T20:57:57.003 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0190000000000001e-05 2020-11-16T20:57:57.003 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.003 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.003 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:57.004 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.986836+0000", 2020-11-16T20:57:57.004 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7900000000000001e-06 2020-11-16T20:57:57.004 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.004 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.004 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:57.004 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.986839+0000", 2020-11-16T20:57:57.004 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002115179 2020-11-16T20:57:57.004 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.005 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.005 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:57.005 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.988955+0000", 2020-11-16T20:57:57.005 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5797000000000006e-05 2020-11-16T20:57:57.005 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.005 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.005 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:57.006 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.989030+0000", 2020-11-16T20:57:57.006 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016622987999999998 2020-11-16T20:57:57.006 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.006 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.006 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:57.006 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:44.005653+0000", 2020-11-16T20:57:57.006 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042403629999999996 2020-11-16T20:57:57.007 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.007 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.007 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:57.007 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:44.009894+0000", 2020-11-16T20:57:57.007 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014512321999999999 2020-11-16T20:57:57.007 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.007 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.007 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:57.008 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:44.024406+0000", 2020-11-16T20:57:57.008 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003165204 2020-11-16T20:57:57.008 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.008 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.008 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:57.008 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:44.027571+0000", 2020-11-16T20:57:57.008 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3579999999999999e-05 2020-11-16T20:57:57.009 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.009 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.009 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:57.009 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:44.027615+0000", 2020-11-16T20:57:57.009 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9271999999999999e-05 2020-11-16T20:57:57.009 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.009 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.009 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:57.010 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:44.027664+0000", 2020-11-16T20:57:57.010 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.040884263999999997 2020-11-16T20:57:57.010 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:57.010 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:57.010 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:57.010 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.010 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.011 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.5.13:92 3.2 3:59b0df7a:::smithi16641208-125:head [copy-from ver 703] snapc 5c=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e149)", 2020-11-16T20:57:57.011 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:53.868435+0000", 2020-11-16T20:57:57.011 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 2.9305182869999999, 2020-11-16T20:57:57.011 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037890923999999999, 2020-11-16T20:57:57.011 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:57:57.011 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:57:57.011 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:57:57.012 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.012 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:57:57.012 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.868435+0000", 2020-11-16T20:57:57.012 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:57:57.012 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.012 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.012 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:57:57.012 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.868435+0000", 2020-11-16T20:57:57.013 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2453999999999994e-05 2020-11-16T20:57:57.013 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.013 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.013 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:57:57.013 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.868507+0000", 2020-11-16T20:57:57.013 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8260000000000003e-06 2020-11-16T20:57:57.013 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.014 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.014 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:57:57.014 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.868511+0000", 2020-11-16T20:57:57.014 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.789e-06 2020-11-16T20:57:57.014 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.014 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.014 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:57:57.015 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.868520+0000", 2020-11-16T20:57:57.015 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2806000000000002e-05 2020-11-16T20:57:57.015 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.015 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.015 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:57:57.015 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.868543+0000", 2020-11-16T20:57:57.015 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021295070000000001 2020-11-16T20:57:57.015 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.016 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:57:57.016 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.870672+0000", 2020-11-16T20:57:57.016 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3769000000000005e-05 2020-11-16T20:57:57.016 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.016 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:57:57.017 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.870746+0000", 2020-11-16T20:57:57.017 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014716440000000001 2020-11-16T20:57:57.017 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.017 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.017 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:57:57.017 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.885462+0000", 2020-11-16T20:57:57.017 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042843550000000001 2020-11-16T20:57:57.017 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.018 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.018 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:57:57.018 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.889747+0000", 2020-11-16T20:57:57.018 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0059100150000000002 2020-11-16T20:57:57.018 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.018 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.018 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:57.019 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.895657+0000", 2020-11-16T20:57:57.019 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010580081999999999 2020-11-16T20:57:57.019 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.019 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.019 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:57:57.019 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.906237+0000", 2020-11-16T20:57:57.019 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7259999999999998e-05 2020-11-16T20:57:57.020 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.020 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.020 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:57:57.020 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.906284+0000", 2020-11-16T20:57:57.020 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1621e-05 2020-11-16T20:57:57.020 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:57:57.020 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:57:57.020 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:57:57.021 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.906326+0000", 2020-11-16T20:57:57.021 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037890923999999999 2020-11-16T20:57:57.021 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:57.021 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:57.021 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:57.021 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:57:57.021 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:57:57.022 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:57:57.023 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:57:57.024 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:57:57.028+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:57:57.124 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:57:57.129+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:57:57.174 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:57:57.174 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2020-11-16T20:57:57.175 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:57.175 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3794 4.3 4:e08caef7:::smithi16641208-59:head [write 628760~724737 in=724737b] snapc 68=[68,67,61] ondisk+write+known_if_redirected e149)", 2020-11-16T20:57:57.175 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:53.846789+0000", 2020-11-16T20:57:57.175 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.3319104670000002, 2020-11-16T20:57:57.175 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3319346849999998, 2020-11-16T20:57:57.175 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:57:57.176 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "delayed", 2020-11-16T20:57:57.176 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:57:57.176 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:57:57.176 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:57:57.176 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3794 2020-11-16T20:57:57.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:57.176 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:57:57.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:57.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:57:57.177 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.846789+0000", 2020-11-16T20:57:57.177 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:57:57.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:57:57.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:57:57.177 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:57:57.177 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.846789+0000", 2020-11-16T20:57:57.178 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00077547499999999997 2020-11-16T20:57:57.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:58:01.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.847564+0000", 2020-11-16T20:58:01.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7159999999999992e-06 2020-11-16T20:58:01.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:58:01.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.847573+0000", 2020-11-16T20:58:01.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.219e-05 2020-11-16T20:58:01.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.548 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:58:01.548 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.847585+0000", 2020-11-16T20:58:01.548 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6869999999999997e-06 2020-11-16T20:58:01.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.548 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:58:01.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.847592+0000", 2020-11-16T20:58:01.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3329999999999999e-05 2020-11-16T20:58:01.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.549 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:58:01.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.847645+0000", 2020-11-16T20:58:01.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6588000000000002e-05 2020-11-16T20:58:01.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for readable", 2020-11-16T20:58:01.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.847691+0000", 2020-11-16T20:58:01.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00090298600000000004 2020-11-16T20:58:01.550 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.550 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:58:01.551 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.551 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3795 4.3 4:e08caef7:::smithi16641208-59:head [write 1892226~673223 in=673223b] snapc 68=[68,67,61] ondisk+write+known_if_redirected e149)", 2020-11-16T20:58:01.551 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:53.854547+0000", 2020-11-16T20:58:01.551 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.3241520480000002, 2020-11-16T20:58:01.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3242269119999999, 2020-11-16T20:58:01.552 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:58:01.552 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "delayed", 2020-11-16T20:58:01.552 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:58:01.552 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:58:01.552 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:01.552 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3795 2020-11-16T20:58:01.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.553 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:58:01.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:58:01.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.854547+0000", 2020-11-16T20:58:01.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:58:01.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:58:01.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.854547+0000", 2020-11-16T20:58:01.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00065052299999999996 2020-11-16T20:58:01.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:58:01.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.855197+0000", 2020-11-16T20:58:01.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3999999999999992e-06 2020-11-16T20:58:01.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:58:01.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.855206+0000", 2020-11-16T20:58:01.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4019000000000001e-05 2020-11-16T20:58:01.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.556 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:58:01.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.855220+0000", 2020-11-16T20:58:01.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.905e-06 2020-11-16T20:58:01.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.556 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:58:01.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.855227+0000", 2020-11-16T20:58:01.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6070999999999999e-05 2020-11-16T20:58:01.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:58:01.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.855283+0000", 2020-11-16T20:58:01.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2038000000000005e-05 2020-11-16T20:58:01.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for readable", 2020-11-16T20:58:01.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.855345+0000", 2020-11-16T20:58:01.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00079795599999999995 2020-11-16T20:58:01.558 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.558 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:58:01.558 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.559 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3774 4.3 4:dbc441be:::smithi16641208-366:head [write 595146~574239 in=574239b] snapc 68=[68,67,65,61] ondisk+write+known_if_redirected e148)", 2020-11-16T20:58:01.559 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:52.818209+0000", 2020-11-16T20:58:01.559 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.3604902000000001, 2020-11-16T20:58:01.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3606137289999998, 2020-11-16T20:58:01.559 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:58:01.559 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "delayed", 2020-11-16T20:58:01.560 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:58:01.560 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:58:01.560 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:01.560 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3774 2020-11-16T20:58:01.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.560 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:58:01.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:58:01.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.818209+0000", 2020-11-16T20:58:01.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:58:01.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:58:01.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.818209+0000", 2020-11-16T20:58:01.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00044111999999999998 2020-11-16T20:58:01.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:58:01.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.818650+0000", 2020-11-16T20:58:01.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1860000000000003e-06 2020-11-16T20:58:01.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:58:01.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.818657+0000", 2020-11-16T20:58:01.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3730000000000001e-05 2020-11-16T20:58:01.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:58:01.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.818671+0000", 2020-11-16T20:58:01.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0870000000000001e-06 2020-11-16T20:58:01.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:58:01.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.818678+0000", 2020-11-16T20:58:01.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2920000000000002e-05 2020-11-16T20:58:01.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:58:01.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.818731+0000", 2020-11-16T20:58:01.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4979000000000003e-05 2020-11-16T20:58:01.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for readable", 2020-11-16T20:58:01.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.818786+0000", 2020-11-16T20:58:01.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00057702199999999995 2020-11-16T20:58:01.566 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.566 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:58:01.566 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.567 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3796 4.3 4:e08caef7:::smithi16641208-59:head [write 3157635~271125 in=271125b] snapc 68=[68,67,61] ondisk+write+known_if_redirected e149)", 2020-11-16T20:58:01.567 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:53.859314+0000", 2020-11-16T20:58:01.567 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.3193853130000002, 2020-11-16T20:58:01.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3195488800000001, 2020-11-16T20:58:01.567 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:58:01.567 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "delayed", 2020-11-16T20:58:01.567 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:58:01.567 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:58:01.568 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:01.568 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3796 2020-11-16T20:58:01.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.568 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:58:01.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:58:01.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.859314+0000", 2020-11-16T20:58:01.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:58:01.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:58:01.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.859314+0000", 2020-11-16T20:58:01.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025105700000000001 2020-11-16T20:58:01.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:58:01.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.859565+0000", 2020-11-16T20:58:01.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8400000000000001e-06 2020-11-16T20:58:01.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:58:01.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.859574+0000", 2020-11-16T20:58:01.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3694e-05 2020-11-16T20:58:01.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.571 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:58:01.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.859587+0000", 2020-11-16T20:58:01.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7610000000000002e-06 2020-11-16T20:58:01.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:58:01.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.859594+0000", 2020-11-16T20:58:01.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9392000000000003e-05 2020-11-16T20:58:01.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:58:01.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.859653+0000", 2020-11-16T20:58:01.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7089999999999998e-05 2020-11-16T20:58:01.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for readable", 2020-11-16T20:58:01.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.859700+0000", 2020-11-16T20:58:01.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00038683400000000002 2020-11-16T20:58:01.574 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.574 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:58:01.574 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.574 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3797 4.3 4:e08caef7:::smithi16641208-59:head [setxattr _header (57) in=64b,truncate 3428760] snapc 68=[68,67,61] ondisk+write+known_if_redirected e149)", 2020-11-16T20:58:01.574 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:53.859640+0000", 2020-11-16T20:58:01.575 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.3190586710000001, 2020-11-16T20:58:01.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3192648459999998, 2020-11-16T20:58:01.575 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:58:01.575 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "delayed", 2020-11-16T20:58:01.575 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:58:01.575 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:58:01.575 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:01.575 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3797 2020-11-16T20:58:01.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.576 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:58:01.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:58:01.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.859640+0000", 2020-11-16T20:58:01.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:58:01.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:58:01.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.859640+0000", 2020-11-16T20:58:01.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5321000000000002e-05 2020-11-16T20:58:01.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:58:01.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.859686+0000", 2020-11-16T20:58:01.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1059999999999996e-06 2020-11-16T20:58:01.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:58:01.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.859692+0000", 2020-11-16T20:58:01.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0735e-05 2020-11-16T20:58:01.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:58:01.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.859702+0000", 2020-11-16T20:58:01.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6460000000000001e-06 2020-11-16T20:58:01.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:58:01.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.859707+0000", 2020-11-16T20:58:01.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6485000000000001e-05 2020-11-16T20:58:01.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:58:01.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.859744+0000", 2020-11-16T20:58:01.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7966999999999998e-05 2020-11-16T20:58:01.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for readable", 2020-11-16T20:58:01.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.859772+0000", 2020-11-16T20:58:01.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013125999999999999 2020-11-16T20:58:01.581 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.581 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:58:01.581 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.582 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3798 4.3 4:e08caef7:::smithi16641208-59:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e149)", 2020-11-16T20:58:01.582 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:53.859746+0000", 2020-11-16T20:58:01.582 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.3189531130000001, 2020-11-16T20:58:01.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3191994230000001, 2020-11-16T20:58:01.582 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:58:01.583 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "delayed", 2020-11-16T20:58:01.583 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:58:01.583 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:58:01.583 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:01.583 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3798 2020-11-16T20:58:01.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.583 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:58:01.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:58:01.584 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.859746+0000", 2020-11-16T20:58:01.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:58:01.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:58:01.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.859746+0000", 2020-11-16T20:58:01.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2382000000000003e-05 2020-11-16T20:58:01.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:58:01.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.859778+0000", 2020-11-16T20:58:01.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0132999999999999e-05 2020-11-16T20:58:01.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:58:01.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.859788+0000", 2020-11-16T20:58:01.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1289e-05 2020-11-16T20:58:01.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:58:01.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.859800+0000", 2020-11-16T20:58:01.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.78e-06 2020-11-16T20:58:01.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:58:01.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.859804+0000", 2020-11-16T20:58:01.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1335999999999999e-05 2020-11-16T20:58:01.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:58:01.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.859846+0000", 2020-11-16T20:58:01.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1822e-05 2020-11-16T20:58:01.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.588 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for readable", 2020-11-16T20:58:01.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.859888+0000", 2020-11-16T20:58:01.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014174200000000001 2020-11-16T20:58:01.589 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.589 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:58:01.589 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.590 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3775 4.3 4:dbc441be:::smithi16641208-366:head [write 1891615~669554 in=669554b] snapc 68=[68,67,65,61] ondisk+write+known_if_redirected e148)", 2020-11-16T20:58:01.590 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:52.824216+0000", 2020-11-16T20:58:01.590 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.3544829539999999, 2020-11-16T20:58:01.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3547697239999996, 2020-11-16T20:58:01.590 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:58:01.590 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "delayed", 2020-11-16T20:58:01.590 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:58:01.590 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:58:01.591 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:01.591 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3775 2020-11-16T20:58:01.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.591 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:58:01.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:58:01.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.824216+0000", 2020-11-16T20:58:01.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:58:01.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:58:01.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.824216+0000", 2020-11-16T20:58:01.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00060592899999999995 2020-11-16T20:58:01.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:58:01.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.824822+0000", 2020-11-16T20:58:01.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1880000000000002e-06 2020-11-16T20:58:01.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:58:01.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.824830+0000", 2020-11-16T20:58:01.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3565e-05 2020-11-16T20:58:01.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:58:01.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.824844+0000", 2020-11-16T20:58:01.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2700000000000001e-06 2020-11-16T20:58:01.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:58:01.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.824850+0000", 2020-11-16T20:58:01.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011084 2020-11-16T20:58:01.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:58:01.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.824961+0000", 2020-11-16T20:58:01.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5014e-05 2020-11-16T20:58:01.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for readable", 2020-11-16T20:58:01.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.825006+0000", 2020-11-16T20:58:01.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00078980599999999999 2020-11-16T20:58:01.597 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.597 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:58:01.597 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.597 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3776 4.3 4:dbc441be:::smithi16641208-366:head [write 3219142~176004 in=176004b] snapc 68=[68,67,65,61] ondisk+write+known_if_redirected e148)", 2020-11-16T20:58:01.597 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:52.829052+0000", 2020-11-16T20:58:01.597 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.349646656, 2020-11-16T20:58:01.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3499743630000003, 2020-11-16T20:58:01.598 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:58:01.598 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "delayed", 2020-11-16T20:58:01.598 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:58:01.598 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:58:01.598 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:01.598 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3776 2020-11-16T20:58:01.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.599 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:58:01.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:58:01.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829052+0000", 2020-11-16T20:58:01.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:58:01.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:58:01.600 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829052+0000", 2020-11-16T20:58:01.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014426900000000001 2020-11-16T20:58:01.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.600 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:58:01.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829197+0000", 2020-11-16T20:58:01.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0500000000000003e-06 2020-11-16T20:58:01.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:58:01.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829204+0000", 2020-11-16T20:58:01.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7659999999999998e-06 2020-11-16T20:58:01.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:58:01.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829211+0000", 2020-11-16T20:58:01.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.391e-06 2020-11-16T20:58:01.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:58:01.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829216+0000", 2020-11-16T20:58:01.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5052000000000002e-05 2020-11-16T20:58:01.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:58:01.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829261+0000", 2020-11-16T20:58:01.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7715000000000001e-05 2020-11-16T20:58:01.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for readable", 2020-11-16T20:58:01.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829289+0000", 2020-11-16T20:58:01.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023624299999999999 2020-11-16T20:58:01.604 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.604 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:58:01.604 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.605 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3777 4.3 4:dbc441be:::smithi16641208-366:head [setxattr _header (58) in=65b,truncate 3395146] snapc 68=[68,67,65,61] ondisk+write+known_if_redirected e148)", 2020-11-16T20:58:01.605 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:52.829250+0000", 2020-11-16T20:58:01.605 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.3494489610000002, 2020-11-16T20:58:01.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3498171040000004, 2020-11-16T20:58:01.605 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:58:01.606 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "delayed", 2020-11-16T20:58:01.606 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:58:01.606 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:58:01.606 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:01.606 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3777 2020-11-16T20:58:01.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.606 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:58:01.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:58:01.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829250+0000", 2020-11-16T20:58:01.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:58:01.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:58:01.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829250+0000", 2020-11-16T20:58:01.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4453999999999998e-05 2020-11-16T20:58:01.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:58:01.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829294+0000", 2020-11-16T20:58:01.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9479999999999996e-06 2020-11-16T20:58:01.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:58:01.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829300+0000", 2020-11-16T20:58:01.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0818e-05 2020-11-16T20:58:01.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:58:01.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829311+0000", 2020-11-16T20:58:01.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5079999999999996e-06 2020-11-16T20:58:01.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:58:01.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829317+0000", 2020-11-16T20:58:01.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4471e-05 2020-11-16T20:58:01.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:58:01.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829341+0000", 2020-11-16T20:58:01.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2490999999999999e-05 2020-11-16T20:58:01.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for readable", 2020-11-16T20:58:01.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829364+0000", 2020-11-16T20:58:01.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011369 2020-11-16T20:58:01.612 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.612 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:58:01.612 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.613 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3809 4.3 4:c2ff196f:::smithi16641208-87:head [stat,delete] snapc 68=[68,67,61] ondisk+write+known_if_redirected e149)", 2020-11-16T20:58:01.613 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:53.875593+0000", 2020-11-16T20:58:01.613 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.3031055149999999, 2020-11-16T20:58:01.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3035131930000001, 2020-11-16T20:58:01.613 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:58:01.613 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "delayed", 2020-11-16T20:58:01.613 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:58:01.613 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:58:01.614 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:01.614 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3809 2020-11-16T20:58:01.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.614 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:58:01.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:58:01.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.875593+0000", 2020-11-16T20:58:01.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:58:01.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:58:01.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.875593+0000", 2020-11-16T20:58:01.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9067999999999999e-05 2020-11-16T20:58:01.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:58:01.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.875633+0000", 2020-11-16T20:58:01.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1589999999999998e-06 2020-11-16T20:58:01.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:58:01.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.875639+0000", 2020-11-16T20:58:01.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6399999999999992e-06 2020-11-16T20:58:01.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:58:01.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.875648+0000", 2020-11-16T20:58:01.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7840000000000003e-06 2020-11-16T20:58:01.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:58:01.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.875653+0000", 2020-11-16T20:58:01.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7873000000000001e-05 2020-11-16T20:58:01.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:58:01.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.875691+0000", 2020-11-16T20:58:01.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7637e-05 2020-11-16T20:58:01.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for readable", 2020-11-16T20:58:01.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:53.875719+0000", 2020-11-16T20:58:01.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012516099999999999 2020-11-16T20:58:01.619 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.620 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:58:01.620 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.620 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3778 4.3 4:dbc441be:::smithi16641208-366:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e148)", 2020-11-16T20:58:01.620 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:52.829353+0000", 2020-11-16T20:58:01.620 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.3493463620000004, 2020-11-16T20:58:01.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3497930189999998, 2020-11-16T20:58:01.621 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:58:01.621 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "delayed", 2020-11-16T20:58:01.621 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:58:01.621 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:58:01.621 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:01.621 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3778 2020-11-16T20:58:01.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.622 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:58:01.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.622 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:58:01.622 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829353+0000", 2020-11-16T20:58:01.622 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:58:01.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.622 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:58:01.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829353+0000", 2020-11-16T20:58:01.623 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0540999999999997e-05 2020-11-16T20:58:01.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.623 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.623 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:58:01.623 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829393+0000", 2020-11-16T20:58:01.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1510000000000001e-06 2020-11-16T20:58:01.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.624 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.624 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:58:01.624 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829399+0000", 2020-11-16T20:58:01.624 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5125e-05 2020-11-16T20:58:01.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.625 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:58:01.625 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829414+0000", 2020-11-16T20:58:01.625 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4809999999999997e-06 2020-11-16T20:58:01.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.625 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.625 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:58:01.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829420+0000", 2020-11-16T20:58:01.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9583999999999999e-05 2020-11-16T20:58:01.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.626 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.626 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:58:01.626 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829459+0000", 2020-11-16T20:58:01.626 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6226999999999997e-05 2020-11-16T20:58:01.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.627 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.627 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for readable", 2020-11-16T20:58:01.627 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829496+0000", 2020-11-16T20:58:01.627 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014310899999999999 2020-11-16T20:58:01.627 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.627 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:58:01.627 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.628 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.628 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3780 4.3 4:c7332a33:::smithi16641208-107:head [append 0~0] snapc 68=[68,67,65,61] ondisk+write+known_if_redirected e148)", 2020-11-16T20:58:01.628 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:52.829457+0000", 2020-11-16T20:58:01.628 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.3492416130000002, 2020-11-16T20:58:01.628 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3497275860000002, 2020-11-16T20:58:01.628 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:58:01.629 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "delayed", 2020-11-16T20:58:01.629 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:58:01.629 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:58:01.629 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:01.629 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3780 2020-11-16T20:58:01.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.629 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:58:01.629 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:58:01.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829457+0000", 2020-11-16T20:58:01.630 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:58:01.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.630 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:58:01.630 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829457+0000", 2020-11-16T20:58:01.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5477999999999999e-05 2020-11-16T20:58:01.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.631 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.631 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:58:01.631 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829483+0000", 2020-11-16T20:58:01.631 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7890000000000001e-06 2020-11-16T20:58:01.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.632 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.632 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:58:01.632 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829487+0000", 2020-11-16T20:58:01.632 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6039999999999998e-06 2020-11-16T20:58:01.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.632 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.632 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:58:01.632 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829493+0000", 2020-11-16T20:58:01.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4520000000000002e-06 2020-11-16T20:58:01.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.633 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.633 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:58:01.633 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829497+0000", 2020-11-16T20:58:01.633 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3745999999999998e-05 2020-11-16T20:58:01.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.634 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:58:01.634 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829530+0000", 2020-11-16T20:58:01.634 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.595e-05 2020-11-16T20:58:01.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.634 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.634 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for readable", 2020-11-16T20:58:01.634 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829566+0000", 2020-11-16T20:58:01.635 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010901899999999999 2020-11-16T20:58:01.635 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.635 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:58:01.635 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.635 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3781 4.3 4:c7332a33:::smithi16641208-107:head [rollback 67] snapc 68=[68,67,65,61] ondisk+write+known_if_redirected e148)", 2020-11-16T20:58:01.636 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:52.829528+0000", 2020-11-16T20:58:01.636 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.3491710469999996, 2020-11-16T20:58:01.636 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3496968740000002, 2020-11-16T20:58:01.636 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:58:01.636 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "delayed", 2020-11-16T20:58:01.636 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:58:01.636 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:58:01.637 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:01.637 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3781 2020-11-16T20:58:01.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.637 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:58:01.637 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.637 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:58:01.637 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829528+0000", 2020-11-16T20:58:01.637 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:58:01.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.638 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:58:01.638 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829528+0000", 2020-11-16T20:58:01.638 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5355000000000001e-05 2020-11-16T20:58:01.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.638 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:58:01.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829543+0000", 2020-11-16T20:58:01.639 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.039e-06 2020-11-16T20:58:01.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.639 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.639 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:58:01.639 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829546+0000", 2020-11-16T20:58:01.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7080000000000002e-06 2020-11-16T20:58:01.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.640 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:58:01.640 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829552+0000", 2020-11-16T20:58:01.640 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.773e-06 2020-11-16T20:58:01.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.640 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:58:01.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829555+0000", 2020-11-16T20:58:01.641 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1585999999999998e-05 2020-11-16T20:58:01.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.641 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:58:01.641 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829596+0000", 2020-11-16T20:58:01.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2518999999999997e-05 2020-11-16T20:58:01.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.642 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.642 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for readable", 2020-11-16T20:58:01.642 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829639+0000", 2020-11-16T20:58:01.642 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011098 2020-11-16T20:58:01.642 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.643 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:58:01.643 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.643 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.643 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4535.0:3782 4.3 4:c7332a33:::smithi16641208-107:head [append 0~0] snapc 68=[68,67,65,61] ondisk+write+known_if_redirected e148)", 2020-11-16T20:58:01.643 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2020-11-16T20:57:52.829589+0000", 2020-11-16T20:58:01.643 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.3491101150000002, 2020-11-16T20:58:01.643 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3496753290000001, 2020-11-16T20:58:01.644 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2020-11-16T20:58:01.644 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "delayed", 2020-11-16T20:58:01.644 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2020-11-16T20:58:01.644 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4535", 2020-11-16T20:58:01.644 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:01.644 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 3782 2020-11-16T20:58:01.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.645 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2020-11-16T20:58:01.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.645 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2020-11-16T20:58:01.645 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829589+0000", 2020-11-16T20:58:01.645 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2020-11-16T20:58:01.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.645 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.646 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2020-11-16T20:58:01.646 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829589+0000", 2020-11-16T20:58:01.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0258999999999999e-05 2020-11-16T20:58:01.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.646 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.646 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2020-11-16T20:58:01.646 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829619+0000", 2020-11-16T20:58:01.646 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4e-06 2020-11-16T20:58:01.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.647 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.647 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2020-11-16T20:58:01.647 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829625+0000", 2020-11-16T20:58:01.647 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0658e-05 2020-11-16T20:58:01.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.647 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.648 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2020-11-16T20:58:01.648 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829635+0000", 2020-11-16T20:58:01.648 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7539999999999997e-06 2020-11-16T20:58:01.648 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.648 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.648 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2020-11-16T20:58:01.648 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829640+0000", 2020-11-16T20:58:01.649 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8180999999999999e-05 2020-11-16T20:58:01.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.649 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.649 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2020-11-16T20:58:01.649 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829678+0000", 2020-11-16T20:58:01.649 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5245e-05 2020-11-16T20:58:01.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2020-11-16T20:58:01.649 INFO:teuthology.orchestra.run.smithi059.stdout: { 2020-11-16T20:58:01.650 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for readable", 2020-11-16T20:58:01.650 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2020-11-16T20:57:52.829703+0000", 2020-11-16T20:58:01.650 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114497 2020-11-16T20:58:01.650 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.650 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2020-11-16T20:58:01.650 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.650 INFO:teuthology.orchestra.run.smithi059.stdout: } 2020-11-16T20:58:01.651 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2020-11-16T20:58:01.651 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 14 2020-11-16T20:58:01.651 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:58:01.651 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2020-11-16T20:58:01.652 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7] out_osds: [1] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:58:01.652 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:58:01.653 INFO:tasks.thrashosds.thrasher:Growing pool device_health_metrics 2020-11-16T20:58:01.653 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-16T20:58:01.653 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:58:01.656 INFO:tasks.rados.rados.0.smithi166.stdout:1163: finishing rollback tid 0 to smithi16641208-85 2020-11-16T20:58:01.657 INFO:tasks.rados.rados.0.smithi166.stdout:1163: finishing rollback tid 1 to smithi16641208-85 2020-11-16T20:58:01.657 INFO:tasks.rados.rados.0.smithi166.stdout:1163: finishing rollback tid 2 to smithi16641208-85 2020-11-16T20:58:01.657 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 85 v 810 (ObjNum 84 snap 0 seq_num 84) dirty exists 2020-11-16T20:58:01.657 INFO:tasks.rados.rados.0.smithi166.stdout:1168: finishing write tid 1 to smithi16641208-242 2020-11-16T20:58:01.657 INFO:tasks.rados.rados.0.smithi166.stdout:1168: finishing write tid 2 to smithi16641208-242 2020-11-16T20:58:01.657 INFO:tasks.rados.rados.0.smithi166.stdout:1169: got (2) No such file or directory 2020-11-16T20:58:01.658 INFO:tasks.rados.rados.0.smithi166.stdout:1178: got (2) No such file or directory 2020-11-16T20:58:01.658 INFO:tasks.rados.rados.0.smithi166.stdout:1168: finishing write tid 3 to smithi16641208-242 2020-11-16T20:58:01.658 INFO:tasks.rados.rados.0.smithi166.stdout:1168: finishing write tid 4 to smithi16641208-242 2020-11-16T20:58:01.658 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 242 v 813 (ObjNum 676 snap 50 seq_num 676) dirty exists 2020-11-16T20:58:01.658 INFO:tasks.rados.rados.0.smithi166.stdout:1168: left oid 242 (ObjNum 676 snap 50 seq_num 676) 2020-11-16T20:58:01.658 INFO:tasks.rados.rados.0.smithi166.stdout:1181: expect (ObjNum 189 snap 0 seq_num 189) 2020-11-16T20:58:01.659 INFO:tasks.rados.rados.0.smithi166.stdout:1184: finishing write tid 1 to smithi16641208-366 2020-11-16T20:58:01.659 INFO:tasks.rados.rados.0.smithi166.stdout:1184: finishing write tid 2 to smithi16641208-366 2020-11-16T20:58:01.659 INFO:tasks.rados.rados.0.smithi166.stdout:1184: finishing write tid 3 to smithi16641208-366 2020-11-16T20:58:01.659 INFO:tasks.rados.rados.0.smithi166.stdout:1184: finishing write tid 4 to smithi16641208-366 2020-11-16T20:58:01.659 INFO:tasks.rados.rados.0.smithi166.stdout:1184: finishing write tid 5 to smithi16641208-366 2020-11-16T20:58:01.659 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 366 v 817 (ObjNum 678 snap 54 seq_num 678) dirty exists 2020-11-16T20:58:01.659 INFO:tasks.rados.rados.0.smithi166.stdout:1184: left oid 366 (ObjNum 678 snap 54 seq_num 678) 2020-11-16T20:58:01.659 INFO:tasks.rados.rados.0.smithi166.stdout:1186: finishing rollback tid 0 to smithi16641208-107 2020-11-16T20:58:01.660 INFO:tasks.rados.rados.0.smithi166.stdout:1186: finishing rollback tid 1 to smithi16641208-107 2020-11-16T20:58:01.660 INFO:tasks.rados.rados.0.smithi166.stdout:1163: done (13 left) 2020-11-16T20:58:01.660 INFO:tasks.rados.rados.0.smithi166.stdout:1168: done (12 left) 2020-11-16T20:58:01.660 INFO:tasks.rados.rados.0.smithi166.stdout:1169: done (11 left) 2020-11-16T20:58:01.660 INFO:tasks.rados.rados.0.smithi166.stdout:1178: done (10 left) 2020-11-16T20:58:01.660 INFO:tasks.rados.rados.0.smithi166.stdout:1181: done (9 left) 2020-11-16T20:58:01.660 INFO:tasks.rados.rados.0.smithi166.stdout:1184: done (8 left) 2020-11-16T20:58:01.661 INFO:tasks.rados.rados.0.smithi166.stdout:1190: done (7 left) 2020-11-16T20:58:01.661 INFO:tasks.rados.rados.0.smithi166.stdout:1192: done (6 left) 2020-11-16T20:58:01.661 INFO:tasks.rados.rados.0.smithi166.stdout:1194: done (5 left) 2020-11-16T20:58:01.661 INFO:tasks.rados.rados.0.smithi166.stdout:1195: done (4 left) 2020-11-16T20:58:01.661 INFO:tasks.rados.rados.0.smithi166.stdout:1196: done (3 left) 2020-11-16T20:58:01.661 INFO:tasks.rados.rados.0.smithi166.stdout:1197: done (2 left) 2020-11-16T20:58:01.661 INFO:tasks.rados.rados.0.smithi166.stdout:1198: read oid 375 snap -1 2020-11-16T20:58:01.661 INFO:tasks.rados.rados.0.smithi166.stdout:1198: expect (ObjNum 579 snap 24 seq_num 579) 2020-11-16T20:58:01.662 INFO:tasks.rados.rados.0.smithi166.stdout:1199: write (excl) oid 494 current snap is 54 2020-11-16T20:58:01.662 INFO:tasks.rados.rados.0.smithi166.stdout:1186: finishing rollback tid 2 to smithi16641208-107 2020-11-16T20:58:01.662 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 107 v 820 (ObjNum 561 snap 19 seq_num 561) dirty exists 2020-11-16T20:58:01.662 INFO:tasks.rados.rados.0.smithi166.stdout:1191: finishing write tid 1 to smithi16641208-59 2020-11-16T20:58:01.662 INFO:tasks.rados.rados.0.smithi166.stdout:1199: seq_num 683 ranges {679181=550484,1667672=536903,2839904=435373} 2020-11-16T20:58:01.662 INFO:tasks.rados.rados.0.smithi166.stdout:1199: writing smithi16641208-494 from 679181 to 1229665 tid 1 2020-11-16T20:58:01.662 INFO:tasks.rados.rados.0.smithi166.stdout:1199: writing smithi16641208-494 from 1667672 to 2204575 tid 2 2020-11-16T20:58:01.663 INFO:tasks.rados.rados.0.smithi166.stdout:1199: writing smithi16641208-494 from 2839904 to 3275277 tid 3 2020-11-16T20:58:01.663 INFO:tasks.rados.rados.0.smithi166.stdout:1186: done (3 left) 2020-11-16T20:58:01.663 INFO:tasks.rados.rados.0.smithi166.stdout:1200: cache_try_flush oid 98 snap -1 2020-11-16T20:58:01.663 INFO:tasks.rados.rados.0.smithi166.stdout:1191: finishing write tid 2 to smithi16641208-59 2020-11-16T20:58:01.663 INFO:tasks.rados.rados.0.smithi166.stdout:1201: read oid 31 snap -1 2020-11-16T20:58:01.663 INFO:tasks.rados.rados.0.smithi166.stdout:1201: expect (ObjNum 30 snap 0 seq_num 30) 2020-11-16T20:58:01.663 INFO:tasks.rados.rados.0.smithi166.stdout:1202: rollback oid 55 current snap is 54 2020-11-16T20:58:01.664 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 55 to 53 2020-11-16T20:58:01.664 INFO:tasks.rados.rados.0.smithi166.stdout:1191: finishing write tid 3 to smithi16641208-59 2020-11-16T20:58:01.664 INFO:tasks.rados.rados.0.smithi166.stdout:1191: finishing write tid 4 to smithi16641208-59 2020-11-16T20:58:01.664 INFO:tasks.rados.rados.0.smithi166.stdout:1191: finishing write tid 5 to smithi16641208-59 2020-11-16T20:58:01.664 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 59 v 828 (ObjNum 680 snap 54 seq_num 680) dirty exists 2020-11-16T20:58:01.664 INFO:tasks.rados.rados.0.smithi166.stdout:1191: left oid 59 (ObjNum 680 snap 54 seq_num 680) 2020-11-16T20:58:01.664 INFO:tasks.rados.rados.0.smithi166.stdout:1191: done (5 left) 2020-11-16T20:58:01.664 INFO:tasks.rados.rados.0.smithi166.stdout:1203: cache_flush oid 287 snap 48 2020-11-16T20:58:01.665 INFO:tasks.rados.rados.0.smithi166.stdout:1199: finishing write tid 1 to smithi16641208-494 2020-11-16T20:58:01.665 INFO:tasks.rados.rados.0.smithi166.stdout:1204: snap_remove snap 52 2020-11-16T20:58:01.665 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:01.657+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:01.666 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:58:01.752 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:01.757+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:01.832 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:58:01.840 INFO:tasks.rados.rados.0.smithi166.stdout:1204: done (6 left) 2020-11-16T20:58:01.840 INFO:tasks.rados.rados.0.smithi166.stdout:1205: rollback oid 385 current snap is 54 2020-11-16T20:58:01.840 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 385 to 48 2020-11-16T20:58:01.841 INFO:tasks.rados.rados.0.smithi166.stdout:1198: expect (ObjNum 579 snap 24 seq_num 579) 2020-11-16T20:58:01.855 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:01.858+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:01.855 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:58:01.855 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:58:01.856 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2020-11-16T20:58:01.856 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2020-11-16T20:58:01.856 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:58:01.867 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:58:01.869 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:58:01.895 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:58:01.915 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:58:01.937 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:58:01.954 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:58:01.959+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:58:01.957 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:58:01.991 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:58:02.012 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:58:02.013 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:58:02.014 INFO:teuthology.orchestra.run.smithi166.stderr:dumped all 2020-11-16T20:58:02.014 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:58:02.015 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:58:02.015 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:58:02.015 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:58:02.015 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:58:02.015 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:58:02.015 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:58:02.015 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:58:02.025 INFO:teuthology.orchestra.run.smithi166.stdout:{"pg_ready":true,"pg_map":{"version":240,"stamp":"2020-11-16T20:58:01.840211+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1862316006,"num_objects":669,"num_object_clones":15,"num_object_copies":2007,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":570,"num_whiteouts":20,"num_read":2473,"num_read_kb":1215445,"num_write":3393,"num_write_kb":1492036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":888,"num_bytes_recovered":1270047204,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":180,"num_flush_kb":495491,"num_evict":112,"num_evict_kb":310428,"num_promote":322,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5315,"ondisk_log_size":5315,"up":81,"acting":81,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":4212524,"kb_used_data":4054064,"kb_used_omap":0,"kb_used_meta":142912,"kb_avail":656390356,"statfs":{"total":676457349120,"available":672143724544,"internally_reserved":0,"allocated":4151361536,"data_stored":4169865177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":146341888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,14],"upper_bound":8192},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3146695,"num_objects":-1,"num_object_clones":0,"num_object_copies":-3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":1,"num_read":25,"num_read_kb":27832,"num_write":20,"num_write_kb":17683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":4,"num_flush_kb":11525,"num_evict":4,"num_evict_kb":12246,"num_promote":4,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.732206"},"pg_stats":[{"pgid":"2.11","version":"0'0","reported_seq":"110","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:55.387841+0000","last_change":"2020-11-16T20:57:28.881806+0000","last_active":"2020-11-16T20:57:55.387841+0000","last_peered":"2020-11-16T20:57:55.387841+0000","last_clean":"2020-11-16T20:57:55.387841+0000","last_became_active":"2020-11-16T20:57:28.881277+0000","last_became_peered":"2020-11-16T20:57:28.881277+0000","last_unstale":"2020-11-16T20:57:55.387841+0000","last_undegraded":"2020-11-16T20:57:55.387841+0000","last_fullsized":"2020-11-16T20:57:55.387841+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:56:30.376014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:56:30.376014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,2],"acting":[4,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"139","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:55.470272+0000","last_change":"2020-11-16T20:57:48.581060+0000","last_active":"2020-11-16T20:57:55.470272+0000","last_peered":"2020-11-16T20:57:55.470272+0000","last_clean":"2020-11-16T20:57:55.470272+0000","last_became_active":"2020-11-16T20:57:28.881184+0000","last_became_peered":"2020-11-16T20:57:28.881184+0000","last_unstale":"2020-11-16T20:57:55.470272+0000","last_undegraded":"2020-11-16T20:57:55.470272+0000","last_fullsized":"2020-11-16T20:57:55.470272+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:48.580998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:48.580998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":"130","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:55.388109+0000","last_change":"2020-11-16T20:57:28.424551+0000","last_active":"2020-11-16T20:57:55.388109+0000","last_peered":"2020-11-16T20:57:55.388109+0000","last_clean":"2020-11-16T20:57:55.388109+0000","last_became_active":"2020-11-16T20:55:52.922023+0000","last_became_peered":"2020-11-16T20:55:52.922023+0000","last_unstale":"2020-11-16T20:57:55.388109+0000","last_undegraded":"2020-11-16T20:57:55.388109+0000","last_fullsized":"2020-11-16T20:57:55.388109+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:28.424444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:28.424444+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":"61","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:55.470230+0000","last_change":"2020-11-16T20:57:13.756286+0000","last_active":"2020-11-16T20:57:55.470230+0000","last_peered":"2020-11-16T20:57:55.470230+0000","last_clean":"2020-11-16T20:57:55.470230+0000","last_became_active":"2020-11-16T20:57:06.893046+0000","last_became_peered":"2020-11-16T20:57:06.893046+0000","last_unstale":"2020-11-16T20:57:55.470230+0000","last_undegraded":"2020-11-16T20:57:55.470230+0000","last_fullsized":"2020-11-16T20:57:55.470230+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:13.756223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:13.756223+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"67","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:55.387851+0000","last_change":"2020-11-16T20:57:35.451852+0000","last_active":"2020-11-16T20:57:55.387851+0000","last_peered":"2020-11-16T20:57:55.387851+0000","last_clean":"2020-11-16T20:57:55.387851+0000","last_became_active":"2020-11-16T20:57:28.882773+0000","last_became_peered":"2020-11-16T20:57:28.882773+0000","last_unstale":"2020-11-16T20:57:55.387851+0000","last_undegraded":"2020-11-16T20:57:55.387851+0000","last_fullsized":"2020-11-16T20:57:55.387851+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:35.451773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:35.451773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"46","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:55.387868+0000","last_change":"2020-11-16T20:57:31.452433+0000","last_active":"2020-11-16T20:57:55.387868+0000","last_peered":"2020-11-16T20:57:55.387868+0000","last_clean":"2020-11-16T20:57:55.387868+0000","last_became_active":"2020-11-16T20:57:22.852259+0000","last_became_peered":"2020-11-16T20:57:22.852259+0000","last_unstale":"2020-11-16T20:57:55.387868+0000","last_undegraded":"2020-11-16T20:57:55.387868+0000","last_fullsized":"2020-11-16T20:57:55.387868+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:31.452379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:31.452379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"158","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:54.750522+0000","last_change":"2020-11-16T20:57:36.432291+0000","last_active":"2020-11-16T20:57:54.750522+0000","last_peered":"2020-11-16T20:57:54.750522+0000","last_clean":"2020-11-16T20:57:54.750522+0000","last_became_active":"2020-11-16T20:55:52.917496+0000","last_became_peered":"2020-11-16T20:55:52.917496+0000","last_unstale":"2020-11-16T20:57:54.750522+0000","last_undegraded":"2020-11-16T20:57:54.750522+0000","last_fullsized":"2020-11-16T20:57:54.750522+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:36.432209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:56:02.565607+0000","last_clean_scrub_stamp":"2020-11-16T20:57:36.432209+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"69","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:54.951897+0000","last_change":"2020-11-16T20:57:36.832058+0000","last_active":"2020-11-16T20:57:54.951897+0000","last_peered":"2020-11-16T20:57:54.951897+0000","last_clean":"2020-11-16T20:57:54.951897+0000","last_became_active":"2020-11-16T20:57:28.881825+0000","last_became_peered":"2020-11-16T20:57:28.881825+0000","last_unstale":"2020-11-16T20:57:54.951897+0000","last_undegraded":"2020-11-16T20:57:54.951897+0000","last_fullsized":"2020-11-16T20:57:54.951897+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:36.831977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:36.831977+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,5],"acting":[3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"73","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:55.387697+0000","last_change":"2020-11-16T20:57:28.884517+0000","last_active":"2020-11-16T20:57:55.387697+0000","last_peered":"2020-11-16T20:57:55.387697+0000","last_clean":"2020-11-16T20:57:55.387697+0000","last_became_active":"2020-11-16T20:57:28.884038+0000","last_became_peered":"2020-11-16T20:57:28.884038+0000","last_unstale":"2020-11-16T20:57:55.387697+0000","last_undegraded":"2020-11-16T20:57:55.387697+0000","last_fullsized":"2020-11-16T20:57:55.387697+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:20.810314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:20.810314+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"176","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:54.750431+0000","last_change":"2020-11-16T20:57:28.882165+0000","last_active":"2020-11-16T20:57:54.750431+0000","last_peered":"2020-11-16T20:57:54.750431+0000","last_clean":"2020-11-16T20:57:54.750431+0000","last_became_active":"2020-11-16T20:57:28.881606+0000","last_became_peered":"2020-11-16T20:57:28.881606+0000","last_unstale":"2020-11-16T20:57:54.750431+0000","last_undegraded":"2020-11-16T20:57:54.750431+0000","last_fullsized":"2020-11-16T20:57:54.750431+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:11.459190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:11.459190+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"67","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:54.753864+0000","last_change":"2020-11-16T20:57:31.684983+0000","last_active":"2020-11-16T20:57:54.753864+0000","last_peered":"2020-11-16T20:57:54.753864+0000","last_clean":"2020-11-16T20:57:54.753864+0000","last_became_active":"2020-11-16T20:57:28.882557+0000","last_became_peered":"2020-11-16T20:57:28.882557+0000","last_unstale":"2020-11-16T20:57:54.753864+0000","last_undegraded":"2020-11-16T20:57:54.753864+0000","last_fullsized":"2020-11-16T20:57:54.753864+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:31.684928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:31.684928+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"149'529","reported_seq":"1163","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:55.475493+0000","last_change":"2020-11-16T20:57:53.821835+0000","last_active":"2020-11-16T20:57:55.475493+0000","last_peered":"2020-11-16T20:57:55.475493+0000","last_clean":"2020-11-16T20:57:55.475493+0000","last_became_active":"2020-11-16T20:57:31.898488+0000","last_became_peered":"2020-11-16T20:57:31.898488+0000","last_unstale":"2020-11-16T20:57:55.475493+0000","last_undegraded":"2020-11-16T20:57:55.475493+0000","last_fullsized":"2020-11-16T20:57:55.475493+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'382","last_scrub_stamp":"2020-11-16T20:57:18.780374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:57:18.780374+0000","log_size":529,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115499183,"num_objects":48,"num_object_clones":3,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":6,"num_read":154,"num_read_kb":111427,"num_write":263,"num_write_kb":51876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":77,"num_bytes_recovered":101996064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":53,"num_flush_kb":133546,"num_evict":22,"num_evict_kb":57472,"num_promote":78,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"5e","length":"1"},{"start":"65","length":"1"}]},{"pgid":"2.2","version":"0'0","reported_seq":"176","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:55.475570+0000","last_change":"2020-11-16T20:57:28.883622+0000","last_active":"2020-11-16T20:57:55.475570+0000","last_peered":"2020-11-16T20:57:55.475570+0000","last_clean":"2020-11-16T20:57:55.475570+0000","last_became_active":"2020-11-16T20:57:28.882817+0000","last_became_peered":"2020-11-16T20:57:28.882817+0000","last_unstale":"2020-11-16T20:57:55.475570+0000","last_undegraded":"2020-11-16T20:57:55.475570+0000","last_fullsized":"2020-11-16T20:57:55.475570+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:27.458903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:27.458903+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"148'820","reported_seq":"1370","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:55.388037+0000","last_change":"2020-11-16T20:57:53.831618+0000","last_active":"2020-11-16T20:57:55.388037+0000","last_peered":"2020-11-16T20:57:55.388037+0000","last_clean":"2020-11-16T20:57:55.388037+0000","last_became_active":"2020-11-16T20:55:25.103851+0000","last_became_peered":"2020-11-16T20:55:25.103851+0000","last_unstale":"2020-11-16T20:57:55.388037+0000","last_undegraded":"2020-11-16T20:57:55.388037+0000","last_fullsized":"2020-11-16T20:57:55.388037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'686","last_scrub_stamp":"2020-11-16T20:56:54.448375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:56:54.448375+0000","log_size":820,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":349122859,"num_objects":120,"num_object_clones":1,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":0,"num_read":427,"num_read_kb":125237,"num_write":587,"num_write_kb":323415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"5e","length":"1"},{"start":"65","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":"156","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:55.470391+0000","last_change":"2020-11-16T20:57:18.747236+0000","last_active":"2020-11-16T20:57:55.470391+0000","last_peered":"2020-11-16T20:57:55.470391+0000","last_clean":"2020-11-16T20:57:55.470391+0000","last_became_active":"2020-11-16T20:55:50.905925+0000","last_became_peered":"2020-11-16T20:55:50.905925+0000","last_unstale":"2020-11-16T20:57:55.470391+0000","last_undegraded":"2020-11-16T20:57:55.470391+0000","last_fullsized":"2020-11-16T20:57:55.470391+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:18.747156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:18.747156+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"149'854","reported_seq":"2344","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:55.470438+0000","last_change":"2020-11-16T20:57:53.821805+0000","last_active":"2020-11-16T20:57:55.470438+0000","last_peered":"2020-11-16T20:57:55.470438+0000","last_clean":"2020-11-16T20:57:55.470438+0000","last_became_active":"2020-11-16T20:57:32.907464+0000","last_became_peered":"2020-11-16T20:57:32.907464+0000","last_unstale":"2020-11-16T20:57:55.470438+0000","last_undegraded":"2020-11-16T20:57:55.470438+0000","last_fullsized":"2020-11-16T20:57:55.470438+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'822","last_scrub_stamp":"2020-11-16T20:57:35.157265+0000","last_deep_scrub":"130'822","last_deep_scrub_stamp":"2020-11-16T20:57:35.157265+0000","last_clean_scrub_stamp":"2020-11-16T20:57:35.157265+0000","log_size":854,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":316163984,"num_objects":111,"num_object_clones":1,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":382,"num_read_kb":122618,"num_write":562,"num_write_kb":308071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":450,"num_bytes_recovered":596961011,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"5e","length":"1"},{"start":"65","length":"1"}]},{"pgid":"2.3","version":"0'0","reported_seq":"158","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:55.475446+0000","last_change":"2020-11-16T20:57:12.498318+0000","last_active":"2020-11-16T20:57:55.475446+0000","last_peered":"2020-11-16T20:57:55.475446+0000","last_clean":"2020-11-16T20:57:55.475446+0000","last_became_active":"2020-11-16T20:55:50.903578+0000","last_became_peered":"2020-11-16T20:55:50.903578+0000","last_unstale":"2020-11-16T20:57:55.475446+0000","last_undegraded":"2020-11-16T20:57:55.475446+0000","last_fullsized":"2020-11-16T20:57:55.475446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:12.498241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:12.498241+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"154","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:54.750548+0000","last_change":"2020-11-16T20:57:28.434051+0000","last_active":"2020-11-16T20:57:54.750548+0000","last_peered":"2020-11-16T20:57:54.750548+0000","last_clean":"2020-11-16T20:57:54.750548+0000","last_became_active":"2020-11-16T20:54:53.112038+0000","last_became_peered":"2020-11-16T20:54:53.112038+0000","last_unstale":"2020-11-16T20:57:54.750548+0000","last_undegraded":"2020-11-16T20:57:54.750548+0000","last_fullsized":"2020-11-16T20:57:54.750548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'2","last_scrub_stamp":"2020-11-16T20:57:28.433971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:50.068882+0000","last_clean_scrub_stamp":"2020-11-16T20:57:28.433971+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"149'754","reported_seq":"1311","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:54.951853+0000","last_change":"2020-11-16T20:57:53.818909+0000","last_active":"2020-11-16T20:57:54.951853+0000","last_peered":"2020-11-16T20:57:54.951853+0000","last_clean":"2020-11-16T20:57:54.951853+0000","last_became_active":"2020-11-16T20:55:25.106302+0000","last_became_peered":"2020-11-16T20:55:25.106302+0000","last_unstale":"2020-11-16T20:57:54.951853+0000","last_undegraded":"2020-11-16T20:57:54.951853+0000","last_fullsized":"2020-11-16T20:57:54.951853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'734","last_scrub_stamp":"2020-11-16T20:57:46.845273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:57:46.845273+0000","log_size":754,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":307851695,"num_objects":112,"num_object_clones":5,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":429,"num_read_kb":188526,"num_write":557,"num_write_kb":309843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"5e","length":"1"},{"start":"65","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":"168","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:54.750632+0000","last_change":"2020-11-16T20:57:28.882353+0000","last_active":"2020-11-16T20:57:54.750632+0000","last_peered":"2020-11-16T20:57:54.750632+0000","last_clean":"2020-11-16T20:57:54.750632+0000","last_became_active":"2020-11-16T20:57:28.881823+0000","last_became_peered":"2020-11-16T20:57:28.881823+0000","last_unstale":"2020-11-16T20:57:54.750632+0000","last_undegraded":"2020-11-16T20:57:54.750632+0000","last_fullsized":"2020-11-16T20:57:54.750632+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:19.447373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:19.447373+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,3],"acting":[7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"149'879","reported_seq":"1470","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:54.754094+0000","last_change":"2020-11-16T20:57:53.816963+0000","last_active":"2020-11-16T20:57:54.754094+0000","last_peered":"2020-11-16T20:57:54.754094+0000","last_clean":"2020-11-16T20:57:54.754094+0000","last_became_active":"2020-11-16T20:55:24.802649+0000","last_became_peered":"2020-11-16T20:55:24.802649+0000","last_unstale":"2020-11-16T20:57:54.754094+0000","last_undegraded":"2020-11-16T20:57:54.754094+0000","last_fullsized":"2020-11-16T20:57:54.754094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'650","last_scrub_stamp":"2020-11-16T20:56:37.941529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:23.782254+0000","last_clean_scrub_stamp":"2020-11-16T20:56:37.941529+0000","log_size":879,"ondisk_log_size":879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":384538738,"num_objects":132,"num_object_clones":3,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":2,"num_read":532,"num_read_kb":236915,"num_write":660,"num_write_kb":345062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"5e","length":"1"},{"start":"65","length":"1"}]},{"pgid":"4.3","version":"148'484","reported_seq":"1055","reported_epoch":"150","state":"active+clean+wait","last_fresh":"2020-11-16T20:57:55.388267+0000","last_change":"2020-11-16T20:57:53.832162+0000","last_active":"2020-11-16T20:57:55.388267+0000","last_peered":"2020-11-16T20:57:55.388267+0000","last_clean":"2020-11-16T20:57:55.388267+0000","last_became_active":"2020-11-16T20:57:46.778669+0000","last_became_peered":"2020-11-16T20:57:46.778669+0000","last_unstale":"2020-11-16T20:57:55.388267+0000","last_undegraded":"2020-11-16T20:57:55.388267+0000","last_fullsized":"2020-11-16T20:57:55.388267+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'387","last_scrub_stamp":"2020-11-16T20:57:19.796359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:57:19.796359+0000","log_size":484,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127416969,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":2,"num_read":192,"num_read_kb":155611,"num_write":270,"num_write_kb":51446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":356435764,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":40,"num_flush_kb":115142,"num_evict":34,"num_evict_kb":97345,"num_promote":84,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"5e","length":"1"},{"start":"65","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":"159","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:54.750562+0000","last_change":"2020-11-16T20:57:15.403335+0000","last_active":"2020-11-16T20:57:54.750562+0000","last_peered":"2020-11-16T20:57:54.750562+0000","last_clean":"2020-11-16T20:57:54.750562+0000","last_became_active":"2020-11-16T20:55:50.901014+0000","last_became_peered":"2020-11-16T20:55:50.901014+0000","last_unstale":"2020-11-16T20:57:54.750562+0000","last_undegraded":"2020-11-16T20:57:54.750562+0000","last_fullsized":"2020-11-16T20:57:54.750562+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:15.403250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:15.403250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"49","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:55.470549+0000","last_change":"2020-11-16T20:57:32.659418+0000","last_active":"2020-11-16T20:57:55.470549+0000","last_peered":"2020-11-16T20:57:55.470549+0000","last_clean":"2020-11-16T20:57:55.470549+0000","last_became_active":"2020-11-16T20:57:18.833699+0000","last_became_peered":"2020-11-16T20:57:18.833699+0000","last_unstale":"2020-11-16T20:57:55.470549+0000","last_undegraded":"2020-11-16T20:57:55.470549+0000","last_fullsized":"2020-11-16T20:57:55.470549+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:32.659344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:32.659344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"146'489","reported_seq":"990","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:54.951760+0000","last_change":"2020-11-16T20:57:53.816939+0000","last_active":"2020-11-16T20:57:54.951760+0000","last_peered":"2020-11-16T20:57:54.951760+0000","last_clean":"2020-11-16T20:57:54.951760+0000","last_became_active":"2020-11-16T20:57:31.898744+0000","last_became_peered":"2020-11-16T20:57:31.898744+0000","last_unstale":"2020-11-16T20:57:54.951760+0000","last_undegraded":"2020-11-16T20:57:54.951760+0000","last_fullsized":"2020-11-16T20:57:54.951760+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'320","last_scrub_stamp":"2020-11-16T20:56:54.815437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:56:54.815437+0000","log_size":489,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":129366383,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":5,"num_read":188,"num_read_kb":152719,"num_write":227,"num_write_kb":45978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":63,"num_bytes_recovered":122901039,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":42,"num_flush_kb":118427,"num_evict":26,"num_evict_kb":72313,"num_promote":78,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"5e","length":"1"},{"start":"65","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":"156","reported_epoch":"149","state":"active+clean","last_fresh":"2020-11-16T20:57:53.820893+0000","last_change":"2020-11-16T20:57:17.577037+0000","last_active":"2020-11-16T20:57:53.820893+0000","last_peered":"2020-11-16T20:57:53.820893+0000","last_clean":"2020-11-16T20:57:53.820893+0000","last_became_active":"2020-11-16T20:55:50.905649+0000","last_became_peered":"2020-11-16T20:55:50.905649+0000","last_unstale":"2020-11-16T20:57:53.820893+0000","last_undegraded":"2020-11-16T20:57:53.820893+0000","last_fullsized":"2020-11-16T20:57:53.820893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T20:57:17.576958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:54:54.096603+0000","last_clean_scrub_stamp":"2020-11-16T20:57:17.576958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"149'504","reported_seq":"1088","reported_epoch":"150","state":"active+clean","last_fresh":"2020-11-16T20:57:55.388001+0000","last_change":"2020-11-16T20:57:53.836308+0000","last_active":"2020-11-16T20:57:55.388001+0000","last_peered":"2020-11-16T20:57:55.388001+0000","last_clean":"2020-11-16T20:57:55.388001+0000","last_became_active":"2020-11-16T20:56:16.750108+0000","last_became_peered":"2020-11-16T20:56:16.750108+0000","last_unstale":"2020-11-16T20:57:55.388001+0000","last_undegraded":"2020-11-16T20:57:55.388001+0000","last_fullsized":"2020-11-16T20:57:55.388001+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"141'486","last_scrub_stamp":"2020-11-16T20:57:47.430811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T20:55:29.809179+0000","last_clean_scrub_stamp":"2020-11-16T20:57:47.430811+0000","log_size":504,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":132356195,"num_objects":49,"num_object_clones":2,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":5,"num_read":169,"num_read_kb":122392,"num_write":265,"num_write_kb":56335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":91753326,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":45,"num_flush_kb":128376,"num_evict":30,"num_evict_kb":83298,"num_promote":82,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"5e","length":"1"},{"start":"65","length":"1"}]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":504638730,"num_objects":192,"num_object_clones":5,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":18,"num_read":703,"num_read_kb":542149,"num_write":1025,"num_write_kb":205635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":438,"num_bytes_recovered":673086193,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":180,"num_flush_kb":495491,"num_evict":112,"num_evict_kb":310428,"num_promote":322,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1679101952,"data_stored":1697457897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2006,"ondisk_log_size":2006,"up":12,"acting":12,"num_store_stats":8},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":1357677276,"num_objects":475,"num_object_clones":10,"num_object_copies":1425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":475,"num_whiteouts":2,"num_read":1770,"num_read_kb":673296,"num_write":2366,"num_write_kb":1286391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":450,"num_bytes_recovered":596961011,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3006738432,"data_stored":3010939688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3307,"ondisk_log_size":3307,"up":12,"acting":12,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":18,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127456,"kb_used_data":113688,"kb_used_omap":0,"kb_used_meta":13760,"kb_avail":94244384,"statfs":{"total":96636764160,"available":96506249216,"internally_reserved":0,"allocated":116416512,"data_stored":115391515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14090240},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.96699999999999997,"15min":0.96799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.90000000000000002,"15min":0.91600000000000004},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.252,"5min":1.48,"15min":1.48},"last":0.67500000000000004}]},{"osd":1,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.93999999999999995,"15min":0.94499999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.03,"5min":0.997,"15min":0.99099999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.125}]},{"osd":2,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.97399999999999998,"15min":0.98899999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.236},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.97999999999999998,"15min":0.98299999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.90900000000000003}]},{"osd":3,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.1279999999999999,"15min":1.1359999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.25},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.0620000000000001,"15min":1.0549999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.1619999999999999}]},{"osd":4,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.98499999999999999,"15min":0.99299999999999999},"min":{"1min":0.63400000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.387,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.159,"15min":1.161},"min":{"1min":0.70999999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2,"5min":2,"15min":2},"last":1.391}]},{"osd":5,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.103,"15min":1.107},"min":{"1min":0.71199999999999997,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.47},{"interface":"front","average":{"1min":1.081,"5min":1.181,"15min":1.1970000000000001},"min":{"1min":0.74299999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.4730000000000001,"5min":1.583,"15min":1.583},"last":1.0880000000000001}]},{"osd":6,"last update":"Mon Nov 16 20:57:00 2020","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.264,"15min":1.25},"min":{"1min":0.89300000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.359,"15min":1.375},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.5680000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":798308,"kb_used_data":775644,"kb_used_omap":0,"kb_used_meta":22656,"kb_avail":93573532,"statfs":{"total":96636764160,"available":95819296768,"internally_reserved":0,"allocated":794259456,"data_stored":797249498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23199744},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.94899999999999995,"15min":0.95299999999999996},"min":{"1min":0.55500000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.421,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.627},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.93300000000000005,"15min":0.93000000000000005},"min":{"1min":0.62,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.1679999999999999}]},{"osd":1,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.018,"15min":1.016},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.4650000000000001,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":0.96399999999999997,"15min":0.94099999999999995},"min":{"1min":0.64900000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.83599999999999997}]},{"osd":2,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.86399999999999999,"15min":0.872},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.083,"5min":1.123,"15min":1.1299999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.6559999999999999,"5min":1.897,"15min":1.897},"last":1.123}]},{"osd":3,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.089,"15min":1.103},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.369,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1259999999999999,"15min":1.123},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.4730000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.2030000000000001}]},{"osd":4,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.129,"15min":1.1419999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.7390000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1759999999999999,"15min":1.1799999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.403}]},{"osd":5,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0920000000000001,"15min":1.1020000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.327,"5min":1.4339999999999999,"15min":1.452},"min":{"1min":1.0860000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":1.901,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.2809999999999999}]},{"osd":7,"last update":"Mon Nov 16 20:56:56 2020","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.6899999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.3009999999999999,"15min":1.3100000000000001},"min":{"1min":0.96799999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.3500000000000001}]}]},{"osd":1,"up_from":0,"seq":55834574887,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":946180,"kb_used_data":914940,"kb_used_omap":0,"kb_used_meta":31232,"kb_avail":93425660,"statfs":{"total":96636764160,"available":95667875840,"internally_reserved":0,"allocated":936898560,"data_stored":938908817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31981568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 16 20:57:56 2020","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":0.72799999999999998},"min":{"1min":0.53200000000000003,"5min":0.443,"15min":0.443},"max":{"1min":0.85999999999999999,"5min":1.05,"15min":1.05},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.86599999999999999,"15min":0.86899999999999999},"min":{"1min":0.62,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.002,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":0.628}]},{"osd":2,"last update":"Mon Nov 16 20:57:56 2020","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.73699999999999999,"15min":0.76900000000000002},"min":{"1min":0.51200000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88500000000000001,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.83799999999999997,"15min":0.86699999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.98099999999999998,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.95599999999999996}]},{"osd":3,"last update":"Mon Nov 16 20:57:56 2020","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.90900000000000003,"15min":0.93300000000000005},"min":{"1min":0.48199999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.351,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.91100000000000003,"15min":0.94699999999999995},"min":{"1min":0.63300000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.04,"5min":1.833,"15min":1.833},"last":0.875}]},{"osd":4,"last update":"Mon Nov 16 20:57:56 2020","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1439999999999999,"15min":1.137},"min":{"1min":0.73699999999999999,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.7390000000000001,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.2110000000000001,"15min":1.238},"min":{"1min":0.79600000000000004,"5min":0.62,"15min":0.62},"max":{"1min":1.5820000000000001,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.552}]},{"osd":5,"last update":"Mon Nov 16 20:57:56 2020","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2949999999999999,"15min":1.3049999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.829,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.829},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1779999999999999,"15min":1.1870000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.6479999999999999,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.6479999999999999}]},{"osd":6,"last update":"Mon Nov 16 20:57:56 2020","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2250000000000001,"15min":1.2509999999999999},"min":{"1min":0.91800000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.421,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.421},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.302,"15min":1.329},"min":{"1min":0.92100000000000004,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.4650000000000001,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":1.407}]},{"osd":7,"last update":"Mon Nov 16 20:57:56 2020","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.3520000000000001,"15min":1.3899999999999999},"min":{"1min":0.97699999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.5980000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":1.345},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3480000000000001,"15min":1.3859999999999999},"min":{"1min":0.96999999999999997,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.6830000000000001,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.6759999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":337548,"kb_used_data":323204,"kb_used_omap":0,"kb_used_meta":14336,"kb_avail":94034292,"statfs":{"total":96636764160,"available":96291115008,"internally_reserved":0,"allocated":330960896,"data_stored":329177888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14680064},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:57:56 2020","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73099999999999998,"15min":0.70299999999999996},"min":{"1min":0.45300000000000001,"5min":0.437,"15min":0.437},"max":{"1min":2.4769999999999999,"5min":2.532,"15min":2.532},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77300000000000002,"15min":0.75600000000000001},"min":{"1min":0.57999999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.329,"5min":2.758,"15min":2.758},"last":0.65100000000000002}]},{"osd":1,"last update":"Mon Nov 16 20:57:56 2020","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.85399999999999998,"15min":0.83599999999999997},"min":{"1min":0.57099999999999995,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.5710000000000002,"5min":3.3090000000000002,"15min":3.3090000000000002},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.874,"5min":0.90700000000000003,"15min":0.88200000000000001},"min":{"1min":0.64600000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.4299999999999999,"5min":3.3580000000000001,"15min":3.3580000000000001},"last":0.80500000000000005}]},{"osd":3,"last update":"Mon Nov 16 20:57:56 2020","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.745,"15min":0.73499999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96999999999999997,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.499},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.91300000000000003,"15min":0.89400000000000002},"min":{"1min":0.68700000000000006,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.84999999999999998}]},{"osd":4,"last update":"Mon Nov 16 20:57:56 2020","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.1100000000000001,"15min":1.1220000000000001},"min":{"1min":0.76000000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3280000000000001,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.163,"15min":1.1419999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.323,"5min":1.881,"15min":1.881},"last":1.252}]},{"osd":5,"last update":"Mon Nov 16 20:57:56 2020","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.1679999999999999,"15min":1.149},"min":{"1min":0.78700000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1559999999999999,"15min":1.1639999999999999},"min":{"1min":0.72099999999999997,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.6140000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.0820000000000001}]},{"osd":6,"last update":"Mon Nov 16 20:57:56 2020","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.1080000000000001,"15min":1.0980000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.546,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.125},{"interface":"front","average":{"1min":1.236,"5min":1.216,"15min":1.202},"min":{"1min":0.873,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.956,"5min":2.956,"15min":2.956},"last":1.109}]},{"osd":7,"last update":"Mon Nov 16 20:57:56 2020","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.232,"15min":1.248},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.917,"5min":1.927,"15min":1.927},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.198,"5min":1.2649999999999999,"15min":1.2729999999999999},"min":{"1min":0.97499999999999998,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.726,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.421}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":821780,"kb_used_data":799116,"kb_used_omap":0,"kb_used_meta":22656,"kb_avail":93550060,"statfs":{"total":96636764160,"available":95795261440,"internally_reserved":0,"allocated":818294784,"data_stored":821516337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23199744},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:57:56 2020","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.66900000000000004,"15min":0.65900000000000003},"min":{"1min":0.45800000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.497},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.69599999999999995,"15min":0.68600000000000005},"min":{"1min":0.55200000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.58099999999999996}]},{"osd":1,"last update":"Mon Nov 16 20:57:56 2020","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.80100000000000005,"15min":0.81299999999999994},"min":{"1min":0.497,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.4449999999999998,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.873,"5min":0.91600000000000004,"15min":0.95099999999999996},"min":{"1min":0.61499999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.579,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.61499999999999999}]},{"osd":2,"last update":"Mon Nov 16 20:57:56 2020","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92400000000000004,"15min":0.95099999999999996},"min":{"1min":0.60499999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.5509999999999999,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.03,"5min":1.014,"15min":1.0209999999999999},"min":{"1min":0.68600000000000005,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.8029999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.71199999999999997}]},{"osd":4,"last update":"Mon Nov 16 20:57:56 2020","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.121,"15min":1.137},"min":{"1min":0.79200000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.464,"5min":2.923,"15min":2.923},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.228,"5min":1.175,"15min":1.177},"min":{"1min":0.70799999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.0249999999999999,"5min":2.968,"15min":2.968},"last":1.381}]},{"osd":5,"last update":"Mon Nov 16 20:57:56 2020","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.236,"15min":1.27},"min":{"1min":0.77100000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.7729999999999999,"5min":2.8479999999999999,"15min":2.8479999999999999},"last":1.458},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.153,"15min":1.121},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":0.98799999999999999}]},{"osd":6,"last update":"Mon Nov 16 20:57:56 2020","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.2250000000000001,"15min":1.2470000000000001},"min":{"1min":0.875,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.9490000000000001,"5min":2.859,"15min":2.859},"last":1.032},{"interface":"front","average":{"1min":1.331,"5min":1.3680000000000001,"15min":1.417},"min":{"1min":0.84699999999999998,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.679,"5min":3.5390000000000001,"15min":3.5390000000000001},"last":1.5940000000000001}]},{"osd":7,"last update":"Mon Nov 16 20:57:56 2020","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.2929999999999999,"15min":1.3120000000000001},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":2.0779999999999998,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.298,"15min":1.3160000000000001},"min":{"1min":0.98899999999999999,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.8720000000000001,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":1.5149999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":840372,"kb_used_data":817836,"kb_used_omap":0,"kb_used_meta":22528,"kb_avail":93531468,"statfs":{"total":96636764160,"available":95776223232,"internally_reserved":0,"allocated":837464064,"data_stored":841398377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23068672},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,14],"upper_bound":8192},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.752},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.077,"15min":1.075},"min":{"1min":0.70099999999999996,"5min":0.629,"15min":0.629},"max":{"1min":1.5229999999999999,"5min":1.571,"15min":1.571},"last":1.081}]},{"osd":1,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.873,"15min":0.877},"min":{"1min":0.52700000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1879999999999999,"5min":1.196,"15min":1.196},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.871,"15min":0.86899999999999999},"min":{"1min":0.58799999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3200000000000001,"5min":1.331,"15min":1.331},"last":0.55900000000000005}]},{"osd":2,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.022,"15min":1.0269999999999999},"min":{"1min":0.70999999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2889999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.0429999999999999,"15min":1.0609999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.306,"5min":1.609,"15min":1.609},"last":1.0409999999999999}]},{"osd":3,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0209999999999999,"15min":1.024},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.90600000000000003,"5min":1.135,"15min":1.173},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1619999999999999,"5min":1.528,"15min":1.528},"last":1.232}]},{"osd":5,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.0680000000000001,"15min":1.091},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.419,"5min":1.643,"15min":1.643},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.163,"5min":1.1990000000000001,"15min":1.2050000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.6519999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.2050000000000001}]},{"osd":6,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.1419999999999999,"15min":1.163},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.2889999999999999,"15min":1.304},"min":{"1min":0.93899999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.6379999999999999,"5min":1.79,"15min":1.79},"last":1.161}]},{"osd":7,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.4059999999999999,"15min":1.421},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":1.827,"5min":2.4369999999999998,"15min":2.4369999999999998},"last":1.29},{"interface":"front","average":{"1min":1.198,"5min":1.383,"15min":1.4139999999999999},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.5509999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.3240000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":340880,"kb_used_data":309636,"kb_used_omap":0,"kb_used_meta":15744,"kb_avail":94030960,"statfs":{"total":96636764160,"available":96287703040,"internally_reserved":0,"allocated":317067264,"data_stored":326222745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16121856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.89500000000000002,"15min":0.89100000000000001},"min":{"1min":0.58899999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.879,"5min":0.90400000000000003,"15min":0.90800000000000003},"min":{"1min":0.505,"5min":0.497,"15min":0.497},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.81100000000000005}]},{"osd":1,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.93999999999999995,"15min":0.94999999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.95599999999999996,"15min":0.95699999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.73799999999999999}]},{"osd":2,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0149999999999999,"15min":1.0189999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.83699999999999997}]},{"osd":3,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.052,"15min":1.0569999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.153,"15min":1.1519999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.0589999999999999}]},{"osd":4,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0389999999999999,"15min":1.0269999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1679999999999999,"15min":1.1819999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.081}]},{"osd":6,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.2010000000000001,"15min":1.21},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.333,"15min":1.343},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.90800000000000003}]},{"osd":7,"last update":"Mon Nov 16 20:56:57 2020","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.4239999999999999,"15min":1.4430000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7949999999999999,"5min":1.909,"15min":1.909},"last":1.153}]}]}]}} 2020-11-16T20:58:02.029 INFO:tasks.ceph.ceph_manager.ceph:increase pool size by 10 2020-11-16T20:58:02.029 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set device_health_metrics pg_num 11 2020-11-16T20:58:02.031 INFO:tasks.rados.rados.0.smithi166.stdout:1200: got (2) No such file or directory 2020-11-16T20:58:02.031 INFO:tasks.rados.rados.0.smithi166.stdout:1202: finishing rollback tid 0 to smithi16641208-55 2020-11-16T20:58:02.031 INFO:tasks.rados.rados.0.smithi166.stdout:1198: done (6 left) 2020-11-16T20:58:02.032 INFO:tasks.rados.rados.0.smithi166.stdout:1200: done (5 left) 2020-11-16T20:58:02.032 INFO:tasks.rados.rados.0.smithi166.stdout:1206: delete oid 5 current snap is 54 2020-11-16T20:58:02.032 INFO:tasks.rados.rados.0.smithi166.stdout:1201: expect (ObjNum 30 snap 0 seq_num 30) 2020-11-16T20:58:02.046 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:02.046 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:02.056 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:58:02.056 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:02.060+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:02.113 INFO:tasks.rados.rados.0.smithi166.stdout:1199: finishing write tid 2 to smithi16641208-494 2020-11-16T20:58:02.114 INFO:tasks.rados.rados.0.smithi166.stdout:1199: finishing write tid 3 to smithi16641208-494 2020-11-16T20:58:02.114 INFO:tasks.rados.rados.0.smithi166.stdout:1199: finishing write tid 4 to smithi16641208-494 2020-11-16T20:58:02.114 INFO:tasks.rados.rados.0.smithi166.stdout:1199: finishing write tid 5 to smithi16641208-494 2020-11-16T20:58:02.114 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 494 v 759 (ObjNum 683 snap 54 seq_num 683) dirty exists 2020-11-16T20:58:02.114 INFO:tasks.rados.rados.0.smithi166.stdout:1199: left oid 494 (ObjNum 683 snap 54 seq_num 683) 2020-11-16T20:58:02.114 INFO:tasks.rados.rados.0.smithi166.stdout:1203: got (0) Success 2020-11-16T20:58:02.115 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 287 v 0 (ObjNum 286 snap 0 seq_num 286) dirty exists 2020-11-16T20:58:02.115 INFO:tasks.rados.rados.0.smithi166.stdout:1202: finishing rollback tid 1 to smithi16641208-55 2020-11-16T20:58:02.115 INFO:tasks.rados.rados.0.smithi166.stdout:1202: finishing rollback tid 2 to smithi16641208-55 2020-11-16T20:58:02.115 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 55 v 858 (ObjNum 54 snap 0 seq_num 54) dirty exists 2020-11-16T20:58:02.115 INFO:tasks.rados.rados.0.smithi166.stdout:1205: finishing rollback tid 0 to smithi16641208-385 2020-11-16T20:58:02.115 INFO:tasks.rados.rados.0.smithi166.stdout:1205: finishing rollback tid 1 to smithi16641208-385 2020-11-16T20:58:02.115 INFO:tasks.rados.rados.0.smithi166.stdout:1205: finishing rollback tid 2 to smithi16641208-385 2020-11-16T20:58:02.116 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 385 v 874 (ObjNum 640 snap 40 seq_num 640) dirty exists 2020-11-16T20:58:02.116 INFO:tasks.rados.rados.0.smithi166.stdout:1199: done (5 left) 2020-11-16T20:58:02.116 INFO:tasks.rados.rados.0.smithi166.stdout:1201: done (4 left) 2020-11-16T20:58:02.116 INFO:tasks.rados.rados.0.smithi166.stdout:1202: done (3 left) 2020-11-16T20:58:02.116 INFO:tasks.rados.rados.0.smithi166.stdout:1203: done (2 left) 2020-11-16T20:58:02.116 INFO:tasks.rados.rados.0.smithi166.stdout:1205: done (1 left) 2020-11-16T20:58:02.116 INFO:tasks.rados.rados.0.smithi166.stdout:1206: done (0 left) 2020-11-16T20:58:02.116 INFO:tasks.rados.rados.0.smithi166.stdout:1207: cache_flush oid 11 snap 48 2020-11-16T20:58:02.117 INFO:tasks.rados.rados.0.smithi166.stdout:1208: snap_remove snap 53 2020-11-16T20:58:02.156 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:02.160+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:02.233 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:02.234 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:02.243 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:58:02.257 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:02.261+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:02.358 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:02.363+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:02.377 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:02.377 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:02.386 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:58:02.458 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:02.462+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:02.559 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:02.563+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:02.561 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:02.561 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:02.570 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:58:02.660 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:02.664+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:02.706 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:02.707 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:02.716 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:58:02.799 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:02.804+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:02.842 INFO:tasks.rados.rados.0.smithi166.stdout:1208: done (1 left) 2020-11-16T20:58:02.842 INFO:tasks.rados.rados.0.smithi166.stdout:1209: cache_flush oid 117 snap 48 2020-11-16T20:58:02.842 INFO:tasks.rados.rados.0.smithi166.stdout:1210: read oid 195 snap 48 2020-11-16T20:58:02.842 INFO:tasks.rados.rados.0.smithi166.stdout:1210: expect (ObjNum 194 snap 0 seq_num 194) 2020-11-16T20:58:02.843 INFO:tasks.rados.rados.0.smithi166.stdout:1211: cache_evict oid 238 snap -1 2020-11-16T20:58:02.843 INFO:tasks.rados.rados.0.smithi166.stdout:1212: read oid 363 snap -1 2020-11-16T20:58:02.843 INFO:tasks.rados.rados.0.smithi166.stdout:1212: expect (ObjNum 362 snap 0 seq_num 362) 2020-11-16T20:58:02.843 INFO:tasks.rados.rados.0.smithi166.stdout:1213: cache_flush oid 194 snap -1 2020-11-16T20:58:02.843 INFO:tasks.rados.rados.0.smithi166.stdout:1207: got (0) Success 2020-11-16T20:58:02.843 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 11 v 0 (ObjNum 666 snap 48 seq_num 666) dirty exists 2020-11-16T20:58:02.844 INFO:tasks.rados.rados.0.smithi166.stdout:1207: done (5 left) 2020-11-16T20:58:02.844 INFO:tasks.rados.rados.0.smithi166.stdout:1214: read oid 387 snap -1 2020-11-16T20:58:02.844 INFO:tasks.rados.rados.0.smithi166.stdout:1214: expect (ObjNum 671 snap 48 seq_num 671) 2020-11-16T20:58:02.844 INFO:tasks.rados.rados.0.smithi166.stdout:1215: read oid 302 snap -1 2020-11-16T20:58:02.844 INFO:tasks.rados.rados.0.smithi166.stdout:1215: expect (ObjNum 301 snap 0 seq_num 301) 2020-11-16T20:58:02.844 INFO:tasks.rados.rados.0.smithi166.stdout:1216: cache_evict oid 90 snap -1 2020-11-16T20:58:02.844 INFO:tasks.rados.rados.0.smithi166.stdout:1217: read oid 108 snap -1 2020-11-16T20:58:02.844 INFO:tasks.rados.rados.0.smithi166.stdout:1217: expect (ObjNum 107 snap 0 seq_num 107) 2020-11-16T20:58:02.845 INFO:tasks.rados.rados.0.smithi166.stdout:1218: rollback oid 165 current snap is 54 2020-11-16T20:58:02.845 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 165 to 48 2020-11-16T20:58:02.845 INFO:tasks.rados.rados.0.smithi166.stdout:1219: delete oid 176 current snap is 54 2020-11-16T20:58:02.846 INFO:tasks.rados.rados.0.smithi166.stdout:1213: got (0) Success 2020-11-16T20:58:02.846 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 194 v 0 (ObjNum 193 snap 0 seq_num 193) dirty exists 2020-11-16T20:58:02.846 INFO:tasks.rados.rados.0.smithi166.stdout:1211: got (2) No such file or directory 2020-11-16T20:58:02.847 INFO:tasks.rados.rados.0.smithi166.stdout:1216: got (2) No such file or directory 2020-11-16T20:58:02.852 INFO:teuthology.orchestra.run.smithi166.stderr:noscrub is unset 2020-11-16T20:58:02.861 INFO:teuthology.orchestra.run.smithi166.stderr:set pool 1 pg_num to 11 2020-11-16T20:58:02.861 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:02.866+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:02.865 INFO:tasks.rados.rados.0.smithi166.stdout:1214: expect (ObjNum 671 snap 48 seq_num 671) 2020-11-16T20:58:02.913 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:02.914 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:02.924 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:58:02.964 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:02.969+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:03.019 INFO:tasks.rados.rados.0.smithi166.stdout:1218: finishing rollback tid 0 to smithi16641208-165 2020-11-16T20:58:03.019 INFO:tasks.rados.rados.0.smithi166.stdout:1217: expect (ObjNum 107 snap 0 seq_num 107) 2020-11-16T20:58:03.063 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:03.067+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:03.099 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:03.100 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:03.109 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:58:03.140 INFO:tasks.rados.rados.0.smithi166.stdout:1210: expect (ObjNum 194 snap 0 seq_num 194) 2020-11-16T20:58:03.164 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:03.168+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:03.242 INFO:tasks.rados.rados.0.smithi166.stdout:1209: got (0) Success 2020-11-16T20:58:03.242 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 117 v 0 (ObjNum 116 snap 0 seq_num 116) dirty exists 2020-11-16T20:58:03.242 INFO:tasks.rados.rados.0.smithi166.stdout:1212: expect (ObjNum 362 snap 0 seq_num 362) 2020-11-16T20:58:03.245 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:03.245 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:03.254 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:58:03.297 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:03.302+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:03.308 INFO:tasks.rados.rados.0.smithi166.stdout:1218: finishing rollback tid 1 to smithi16641208-165 2020-11-16T20:58:03.308 INFO:tasks.rados.rados.0.smithi166.stdout:1218: finishing rollback tid 2 to smithi16641208-165 2020-11-16T20:58:03.308 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 165 v 866 (ObjNum 164 snap 0 seq_num 164) dirty exists 2020-11-16T20:58:03.308 INFO:tasks.rados.rados.0.smithi166.stdout:1215: expect (ObjNum 301 snap 0 seq_num 301) 2020-11-16T20:58:03.366 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:03.371+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:03.389 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:03.390 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:03.399 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:58:03.405 INFO:tasks.rados.rados.0.smithi166.stdout:1209: done (10 left) 2020-11-16T20:58:03.405 INFO:tasks.rados.rados.0.smithi166.stdout:1210: done (9 left) 2020-11-16T20:58:03.405 INFO:tasks.rados.rados.0.smithi166.stdout:1211: done (8 left) 2020-11-16T20:58:03.406 INFO:tasks.rados.rados.0.smithi166.stdout:1212: done (7 left) 2020-11-16T20:58:03.406 INFO:tasks.rados.rados.0.smithi166.stdout:1213: done (6 left) 2020-11-16T20:58:03.406 INFO:tasks.rados.rados.0.smithi166.stdout:1214: done (5 left) 2020-11-16T20:58:03.406 INFO:tasks.rados.rados.0.smithi166.stdout:1215: done (4 left) 2020-11-16T20:58:03.406 INFO:tasks.rados.rados.0.smithi166.stdout:1216: done (3 left) 2020-11-16T20:58:03.406 INFO:tasks.rados.rados.0.smithi166.stdout:1217: done (2 left) 2020-11-16T20:58:03.406 INFO:tasks.rados.rados.0.smithi166.stdout:1218: done (1 left) 2020-11-16T20:58:03.407 INFO:tasks.rados.rados.0.smithi166.stdout:1219: done (0 left) 2020-11-16T20:58:03.407 INFO:tasks.rados.rados.0.smithi166.stdout:1220: rollback oid 84 current snap is 54 2020-11-16T20:58:03.407 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 84 to 48 2020-11-16T20:58:03.407 INFO:tasks.rados.rados.0.smithi166.stdout:1221: write oid 442 current snap is 54 2020-11-16T20:58:03.407 INFO:tasks.rados.rados.0.smithi166.stdout:1221: seq_num 686 ranges {729602=492584,1843118=684230,3322173=207429} 2020-11-16T20:58:03.412 INFO:tasks.rados.rados.0.smithi166.stdout:1221: writing smithi16641208-442 from 729602 to 1222186 tid 1 2020-11-16T20:58:03.420 INFO:tasks.rados.rados.0.smithi166.stdout:1221: writing smithi16641208-442 from 1843118 to 2527348 tid 2 2020-11-16T20:58:03.426 INFO:tasks.rados.rados.0.smithi166.stdout:1221: writing smithi16641208-442 from 3322173 to 3529602 tid 3 2020-11-16T20:58:03.426 INFO:tasks.rados.rados.0.smithi166.stdout:1222: write (excl) oid 37 current snap is 54 2020-11-16T20:58:03.426 INFO:tasks.rados.rados.0.smithi166.stdout:1220: finishing rollback tid 0 to smithi16641208-84 2020-11-16T20:58:03.426 INFO:tasks.rados.rados.0.smithi166.stdout:1222: seq_num 687 ranges {746409=567833,1901600=544241,3065949=480460} 2020-11-16T20:58:03.434 INFO:tasks.rados.rados.0.smithi166.stdout:1222: writing smithi16641208-37 from 746409 to 1314242 tid 1 2020-11-16T20:58:03.441 INFO:tasks.rados.rados.0.smithi166.stdout:1222: writing smithi16641208-37 from 1901600 to 2445841 tid 2 2020-11-16T20:58:03.447 INFO:tasks.rados.rados.0.smithi166.stdout:1222: writing smithi16641208-37 from 3065949 to 3546409 tid 3 2020-11-16T20:58:03.448 INFO:tasks.rados.rados.0.smithi166.stdout:1223: delete oid 46 current snap is 54 2020-11-16T20:58:03.448 INFO:tasks.rados.rados.0.smithi166.stdout:1221: finishing write tid 1 to smithi16641208-442 2020-11-16T20:58:03.448 INFO:tasks.rados.rados.0.smithi166.stdout:1221: finishing write tid 2 to smithi16641208-442 2020-11-16T20:58:03.448 INFO:tasks.rados.rados.0.smithi166.stdout:1221: finishing write tid 3 to smithi16641208-442 2020-11-16T20:58:03.448 INFO:tasks.rados.rados.0.smithi166.stdout:1222: finishing write tid 1 to smithi16641208-37 2020-11-16T20:58:03.448 INFO:tasks.rados.rados.0.smithi166.stdout:1220: finishing rollback tid 1 to smithi16641208-84 2020-11-16T20:58:03.448 INFO:tasks.rados.rados.0.smithi166.stdout:1220: finishing rollback tid 2 to smithi16641208-84 2020-11-16T20:58:03.449 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 84 v 899 (ObjNum 83 snap 0 seq_num 83) dirty exists 2020-11-16T20:58:03.449 INFO:tasks.rados.rados.0.smithi166.stdout:1221: finishing write tid 4 to smithi16641208-442 2020-11-16T20:58:03.449 INFO:tasks.rados.rados.0.smithi166.stdout:1221: finishing write tid 5 to smithi16641208-442 2020-11-16T20:58:03.449 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 442 v 900 (ObjNum 686 snap 54 seq_num 686) dirty exists 2020-11-16T20:58:03.449 INFO:tasks.rados.rados.0.smithi166.stdout:1221: left oid 442 (ObjNum 686 snap 54 seq_num 686) 2020-11-16T20:58:03.452 INFO:tasks.rados.rados.0.smithi166.stdout:1220: done (3 left) 2020-11-16T20:58:03.453 INFO:tasks.rados.rados.0.smithi166.stdout:1221: done (2 left) 2020-11-16T20:58:03.453 INFO:tasks.rados.rados.0.smithi166.stdout:1223: done (1 left) 2020-11-16T20:58:03.453 INFO:tasks.rados.rados.0.smithi166.stdout:1224: read oid 90 snap 48 2020-11-16T20:58:03.453 INFO:tasks.rados.rados.0.smithi166.stdout:1224: expect (ObjNum 89 snap 0 seq_num 89) 2020-11-16T20:58:03.453 INFO:tasks.rados.rados.0.smithi166.stdout:1225: cache_flush oid 183 snap -1 2020-11-16T20:58:03.453 INFO:tasks.rados.rados.0.smithi166.stdout:1226: write oid 421 current snap is 54 2020-11-16T20:58:03.454 INFO:tasks.rados.rados.0.smithi166.stdout:1226: seq_num 689 ranges {780023=718331,1902211=547910,3004442=575581} 2020-11-16T20:58:03.462 INFO:tasks.rados.rados.0.smithi166.stdout:1226: writing smithi16641208-421 from 780023 to 1498354 tid 1 2020-11-16T20:58:03.467 INFO:tasks.rados.rados.0.smithi166.stdout:1226: writing smithi16641208-421 from 1902211 to 2450121 tid 2 2020-11-16T20:58:03.475 INFO:tasks.rados.rados.0.smithi166.stdout:1226: writing smithi16641208-421 from 3004442 to 3580023 tid 3 2020-11-16T20:58:03.475 INFO:tasks.rados.rados.0.smithi166.stdout:1227: cache_evict oid 42 snap -1 2020-11-16T20:58:03.475 INFO:tasks.rados.rados.0.smithi166.stdout:1225: got (2) No such file or directory 2020-11-16T20:58:03.475 INFO:tasks.rados.rados.0.smithi166.stdout:1225: done (4 left) 2020-11-16T20:58:03.475 INFO:tasks.rados.rados.0.smithi166.stdout:1228: cache_evict oid 278 snap -1 2020-11-16T20:58:03.475 INFO:tasks.rados.rados.0.smithi166.stdout:1222: finishing write tid 2 to smithi16641208-37 2020-11-16T20:58:03.476 INFO:tasks.rados.rados.0.smithi166.stdout:1222: finishing write tid 3 to smithi16641208-37 2020-11-16T20:58:03.476 INFO:tasks.rados.rados.0.smithi166.stdout:1222: finishing write tid 4 to smithi16641208-37 2020-11-16T20:58:03.476 INFO:tasks.rados.rados.0.smithi166.stdout:1222: finishing write tid 5 to smithi16641208-37 2020-11-16T20:58:03.476 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 37 v 856 (ObjNum 687 snap 54 seq_num 687) dirty exists 2020-11-16T20:58:03.476 INFO:tasks.rados.rados.0.smithi166.stdout:1222: left oid 37 (ObjNum 687 snap 54 seq_num 687) 2020-11-16T20:58:03.476 INFO:tasks.rados.rados.0.smithi166.stdout:1222: done (4 left) 2020-11-16T20:58:03.476 INFO:tasks.rados.rados.0.smithi166.stdout:1229: write (excl) oid 127 current snap is 54 2020-11-16T20:58:03.477 INFO:tasks.rados.rados.0.smithi166.stdout:1224: expect (ObjNum 89 snap 0 seq_num 89) 2020-11-16T20:58:03.484 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:03.489+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:03.568 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:58:03.572+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:58:03.591 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:03.592 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:03.593 INFO:tasks.rados.rados.0.smithi166.stdout:1227: got (2) No such file or directory 2020-11-16T20:58:03.593 INFO:tasks.rados.rados.0.smithi166.stdout:1226: finishing write tid 1 to smithi16641208-421 2020-11-16T20:58:03.593 INFO:tasks.rados.rados.0.smithi166.stdout:1228: got (2) No such file or directory 2020-11-16T20:58:03.593 INFO:tasks.rados.rados.0.smithi166.stdout:1226: finishing write tid 2 to smithi16641208-421 2020-11-16T20:58:03.593 INFO:tasks.rados.rados.0.smithi166.stdout:1226: finishing write tid 3 to smithi16641208-421 2020-11-16T20:58:03.594 INFO:tasks.rados.rados.0.smithi166.stdout:1226: finishing write tid 4 to smithi16641208-421 2020-11-16T20:58:03.594 INFO:tasks.rados.rados.0.smithi166.stdout:1226: finishing write tid 5 to smithi16641208-421 2020-11-16T20:58:03.594 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 421 v 869 (ObjNum 689 snap 54 seq_num 689) dirty exists 2020-11-16T20:58:03.594 INFO:tasks.rados.rados.0.smithi166.stdout:1226: left oid 421 (ObjNum 689 snap 54 seq_num 689) 2020-11-16T20:58:03.594 INFO:tasks.rados.rados.0.smithi166.stdout:1229: seq_num 690 ranges {796830=793580,2360693=691568} 2020-11-16T20:58:03.601 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:58:03.602 INFO:tasks.rados.rados.0.smithi166.stdout:1229: writing smithi16641208-127 from 796830 to 1590410 tid 1 2020-11-16T20:58:03.610 INFO:tasks.rados.rados.0.smithi166.stdout:1229: writing smithi16641208-127 from 2360693 to 3052261 tid 2 2020-11-16T20:58:03.610 INFO:tasks.rados.rados.0.smithi166.stdout:1224: done (4 left) 2020-11-16T20:58:03.610 INFO:tasks.rados.rados.0.smithi166.stdout:1226: done (3 left) 2020-11-16T20:58:03.610 INFO:tasks.rados.rados.0.smithi166.stdout:1227: done (2 left) 2020-11-16T20:58:03.611 INFO:tasks.rados.rados.0.smithi166.stdout:1228: done (1 left) 2020-11-16T20:58:03.611 INFO:tasks.rados.rados.0.smithi166.stdout:1230: cache_try_flush oid 391 snap -1 2020-11-16T20:58:03.611 INFO:tasks.rados.rados.0.smithi166.stdout:1229: finishing write tid 1 to smithi16641208-127 2020-11-16T20:58:03.611 INFO:tasks.rados.rados.0.smithi166.stdout:1231: cache_try_flush oid 204 snap -1 2020-11-16T20:58:03.611 INFO:tasks.rados.rados.0.smithi166.stdout:1232: copy_from oid 207 from oid 234 current snap is 54 2020-11-16T20:58:03.611 INFO:tasks.rados.rados.0.smithi166.stdout:1233: delete oid 95 current snap is 54 2020-11-16T20:58:03.611 INFO:tasks.rados.rados.0.smithi166.stdout:1231: got (2) No such file or directory 2020-11-16T20:58:03.612 INFO:tasks.rados.rados.0.smithi166.stdout:1230: got (2) No such file or directory 2020-11-16T20:58:03.615 INFO:tasks.rados.rados.0.smithi166.stdout:1229: finishing write tid 2 to smithi16641208-127 2020-11-16T20:58:03.615 INFO:tasks.rados.rados.0.smithi166.stdout:1229: finishing write tid 3 to smithi16641208-127 2020-11-16T20:58:03.616 INFO:tasks.rados.rados.0.smithi166.stdout:1229: finishing write tid 4 to smithi16641208-127 2020-11-16T20:58:03.616 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 127 v 762 (ObjNum 690 snap 54 seq_num 690) dirty exists 2020-11-16T20:58:03.616 INFO:tasks.rados.rados.0.smithi166.stdout:1229: left oid 127 (ObjNum 690 snap 54 seq_num 690) 2020-11-16T20:58:03.618 INFO:tasks.rados.rados.0.smithi166.stdout:1229: done (4 left) 2020-11-16T20:58:03.618 INFO:tasks.rados.rados.0.smithi166.stdout:1230: done (3 left) 2020-11-16T20:58:03.618 INFO:tasks.rados.rados.0.smithi166.stdout:1231: done (2 left) 2020-11-16T20:58:03.618 INFO:tasks.rados.rados.0.smithi166.stdout:1233: done (1 left) 2020-11-16T20:58:03.619 INFO:tasks.rados.rados.0.smithi166.stdout:1234: cache_evict oid 387 snap 48 2020-11-16T20:58:03.619 INFO:tasks.rados.rados.0.smithi166.stdout:1235: read oid 431 snap 48 2020-11-16T20:58:03.619 INFO:tasks.rados.rados.0.smithi166.stdout:1235: expect (ObjNum 430 snap 0 seq_num 430) 2020-11-16T20:58:03.619 INFO:tasks.rados.rados.0.smithi166.stdout:1236: cache_try_flush oid 214 snap -1 2020-11-16T20:58:03.619 INFO:tasks.rados.rados.0.smithi166.stdout:1237: cache_evict oid 65 snap -1 2020-11-16T20:58:03.619 INFO:tasks.rados.rados.0.smithi166.stdout:1238: cache_evict oid 232 snap 48 2020-11-16T20:58:03.619 INFO:tasks.rados.rados.0.smithi166.stdout:1239: copy_from oid 362 from oid 294 current snap is 54 2020-11-16T20:58:03.620 INFO:tasks.rados.rados.0.smithi166.stdout:1240: cache_try_flush oid 11 snap -1 2020-11-16T20:58:03.620 INFO:tasks.rados.rados.0.smithi166.stdout:1241: rollback oid 405 current snap is 54 2020-11-16T20:58:03.620 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 405 to 48 2020-11-16T20:58:03.620 INFO:tasks.rados.rados.0.smithi166.stdout:1242: write oid 462 current snap is 54 2020-11-16T20:58:03.620 INFO:tasks.rados.rados.0.smithi166.stdout:1242: seq_num 692 ranges {430444=660431,1677657=695237,2970358=569527} 2020-11-16T20:58:03.624 INFO:tasks.rados.rados.0.smithi166.stdout:1242: writing smithi16641208-462 from 430444 to 1090875 tid 1 2020-11-16T20:58:03.632 INFO:tasks.rados.rados.0.smithi166.stdout:1242: writing smithi16641208-462 from 1677657 to 2372894 tid 2 2020-11-16T20:58:03.639 INFO:tasks.rados.rados.0.smithi166.stdout:1242: writing smithi16641208-462 from 2970358 to 3539885 tid 3 2020-11-16T20:58:03.639 INFO:tasks.rados.rados.0.smithi166.stdout:1234: got (16) Device or resource busy 2020-11-16T20:58:03.639 INFO:tasks.rados.rados.0.smithi166.stdout:1238: got (16) Device or resource busy 2020-11-16T20:58:03.640 INFO:tasks.rados.rados.0.smithi166.stdout:1236: got (2) No such file or directory 2020-11-16T20:58:03.640 INFO:tasks.rados.rados.0.smithi166.stdout:1240: got (0) Success 2020-11-16T20:58:03.640 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 11 v 0 (ObjNum 666 snap 48 seq_num 666) dirty exists 2020-11-16T20:58:03.640 INFO:tasks.rados.rados.0.smithi166.stdout:1241: finishing rollback tid 0 to smithi16641208-405 2020-11-16T20:58:03.640 INFO:tasks.rados.rados.0.smithi166.stdout:1241: finishing rollback tid 1 to smithi16641208-405 2020-11-16T20:58:03.641 INFO:tasks.rados.rados.0.smithi166.stdout:1241: finishing rollback tid 2 to smithi16641208-405 2020-11-16T20:58:03.641 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 405 v 765 (ObjNum 404 snap 0 seq_num 404) dirty exists 2020-11-16T20:58:03.641 INFO:tasks.rados.rados.0.smithi166.stdout:1237: got (0) Success 2020-11-16T20:58:03.641 INFO:tasks.rados.rados.0.smithi166.stdout:1235: expect (ObjNum 430 snap 0 seq_num 430) 2020-11-16T20:58:03.668 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:58:03.672+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:58:03.746 INFO:tasks.rados.rados.0.smithi166.stdout:1242: finishing write tid 1 to smithi16641208-462 2020-11-16T20:58:03.746 INFO:tasks.rados.rados.0.smithi166.stdout:1232: finishing copy_from to smithi16641208-207 2020-11-16T20:58:03.747 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 207 v 698 (ObjNum 608 snap 30 seq_num 608) dirty exists 2020-11-16T20:58:03.747 INFO:tasks.rados.rados.0.smithi166.stdout:1234: done (9 left) 2020-11-16T20:58:03.747 INFO:tasks.rados.rados.0.smithi166.stdout:1235: done (8 left) 2020-11-16T20:58:03.747 INFO:tasks.rados.rados.0.smithi166.stdout:1236: done (7 left) 2020-11-16T20:58:03.747 INFO:tasks.rados.rados.0.smithi166.stdout:1237: done (6 left) 2020-11-16T20:58:03.747 INFO:tasks.rados.rados.0.smithi166.stdout:1238: done (5 left) 2020-11-16T20:58:03.748 INFO:tasks.rados.rados.0.smithi166.stdout:1240: done (4 left) 2020-11-16T20:58:03.748 INFO:tasks.rados.rados.0.smithi166.stdout:1241: done (3 left) 2020-11-16T20:58:03.748 INFO:tasks.rados.rados.0.smithi166.stdout:1243: cache_evict oid 71 snap -1 2020-11-16T20:58:03.748 INFO:tasks.rados.rados.0.smithi166.stdout:1242: finishing write tid 2 to smithi16641208-462 2020-11-16T20:58:03.748 INFO:tasks.rados.rados.0.smithi166.stdout:1242: finishing write tid 3 to smithi16641208-462 2020-11-16T20:58:03.748 INFO:tasks.rados.rados.0.smithi166.stdout:1232: finishing copy_from racing read to smithi16641208-207 2020-11-16T20:58:03.748 INFO:tasks.rados.rados.0.smithi166.stdout:1242: finishing write tid 4 to smithi16641208-462 2020-11-16T20:58:03.748 INFO:tasks.rados.rados.0.smithi166.stdout:1239: finishing copy_from to smithi16641208-362 2020-11-16T20:58:03.749 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 362 v 160 (ObjNum 293 snap 0 seq_num 293) dirty exists 2020-11-16T20:58:03.749 INFO:tasks.rados.rados.0.smithi166.stdout:1242: finishing write tid 5 to smithi16641208-462 2020-11-16T20:58:03.749 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 462 v 872 (ObjNum 692 snap 54 seq_num 692) dirty exists 2020-11-16T20:58:03.749 INFO:tasks.rados.rados.0.smithi166.stdout:1242: left oid 462 (ObjNum 692 snap 54 seq_num 692) 2020-11-16T20:58:03.749 INFO:tasks.rados.rados.0.smithi166.stdout:1239: finishing copy_from racing read to smithi16641208-362 2020-11-16T20:58:03.749 INFO:tasks.rados.rados.0.smithi166.stdout:1232: done (3 left) 2020-11-16T20:58:03.749 INFO:tasks.rados.rados.0.smithi166.stdout:1239: done (2 left) 2020-11-16T20:58:03.750 INFO:tasks.rados.rados.0.smithi166.stdout:1242: done (1 left) 2020-11-16T20:58:03.750 INFO:tasks.rados.rados.0.smithi166.stdout:1244: rollback oid 312 current snap is 54 2020-11-16T20:58:03.750 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 312 to 48 2020-11-16T20:58:03.750 INFO:tasks.rados.rados.0.smithi166.stdout:1245: read oid 104 snap -1 2020-11-16T20:58:03.750 INFO:tasks.rados.rados.0.smithi166.stdout:1245: expect (ObjNum 103 snap 0 seq_num 103) 2020-11-16T20:58:03.750 INFO:tasks.rados.rados.0.smithi166.stdout:1246: cache_flush oid 221 snap 48 2020-11-16T20:58:03.750 INFO:tasks.rados.rados.0.smithi166.stdout:1247: write (excl) oid 456 current snap is 54 2020-11-16T20:58:03.751 INFO:tasks.rados.rados.0.smithi166.stdout:1247: seq_num 693 ranges {447251=735680,1736139=438895,2597781=780799} 2020-11-16T20:58:03.752 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:03.752 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:03.753 INFO:tasks.rados.rados.0.smithi166.stdout:1247: writing smithi16641208-456 from 447251 to 1182931 tid 1 2020-11-16T20:58:03.759 INFO:tasks.rados.rados.0.smithi166.stdout:1247: writing smithi16641208-456 from 1736139 to 2175034 tid 2 2020-11-16T20:58:03.765 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:58:03.767 INFO:tasks.rados.rados.0.smithi166.stdout:1247: writing smithi16641208-456 from 2597781 to 3378580 tid 3 2020-11-16T20:58:03.767 INFO:tasks.rados.rados.0.smithi166.stdout:1248: read oid 124 snap -1 2020-11-16T20:58:03.767 INFO:tasks.rados.rados.0.smithi166.stdout:1248: expect (ObjNum 538 snap 11 seq_num 538) 2020-11-16T20:58:03.767 INFO:tasks.rados.rados.0.smithi166.stdout:1249: delete oid 335 current snap is 54 2020-11-16T20:58:03.767 INFO:tasks.rados.rados.0.smithi166.stdout:1246: got (2) No such file or directory 2020-11-16T20:58:03.768 INFO:tasks.rados.rados.0.smithi166.stdout:1243: got (0) Success 2020-11-16T20:58:03.768 INFO:tasks.rados.rados.0.smithi166.stdout:1245: expect (ObjNum 103 snap 0 seq_num 103) 2020-11-16T20:58:03.771 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:03.776+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:03.871 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:03.876+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:03.896 INFO:tasks.rados.rados.0.smithi166.stdout:1244: finishing rollback tid 0 to smithi16641208-312 2020-11-16T20:58:03.896 INFO:tasks.rados.rados.0.smithi166.stdout:1247: finishing write tid 1 to smithi16641208-456 2020-11-16T20:58:03.896 INFO:tasks.rados.rados.0.smithi166.stdout:1247: finishing write tid 2 to smithi16641208-456 2020-11-16T20:58:03.897 INFO:tasks.rados.rados.0.smithi166.stdout:1247: finishing write tid 3 to smithi16641208-456 2020-11-16T20:58:03.897 INFO:tasks.rados.rados.0.smithi166.stdout:1247: finishing write tid 4 to smithi16641208-456 2020-11-16T20:58:03.897 INFO:tasks.rados.rados.0.smithi166.stdout:1247: finishing write tid 5 to smithi16641208-456 2020-11-16T20:58:03.897 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 456 v 860 (ObjNum 693 snap 54 seq_num 693) dirty exists 2020-11-16T20:58:03.897 INFO:tasks.rados.rados.0.smithi166.stdout:1247: left oid 456 (ObjNum 693 snap 54 seq_num 693) 2020-11-16T20:58:03.897 INFO:tasks.rados.rados.0.smithi166.stdout:1243: done (6 left) 2020-11-16T20:58:03.897 INFO:tasks.rados.rados.0.smithi166.stdout:1245: done (5 left) 2020-11-16T20:58:03.898 INFO:tasks.rados.rados.0.smithi166.stdout:1246: done (4 left) 2020-11-16T20:58:03.898 INFO:tasks.rados.rados.0.smithi166.stdout:1247: done (3 left) 2020-11-16T20:58:03.898 INFO:tasks.rados.rados.0.smithi166.stdout:1249: done (2 left) 2020-11-16T20:58:03.898 INFO:tasks.rados.rados.0.smithi166.stdout:1250: read oid 137 snap -1 2020-11-16T20:58:03.898 INFO:tasks.rados.rados.0.smithi166.stdout:1250: expect (ObjNum 136 snap 0 seq_num 136) 2020-11-16T20:58:03.898 INFO:tasks.rados.rados.0.smithi166.stdout:1251: cache_flush oid 97 snap 48 2020-11-16T20:58:03.898 INFO:tasks.rados.rados.0.smithi166.stdout:1248: expect (ObjNum 538 snap 11 seq_num 538) 2020-11-16T20:58:03.902 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:03.903 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:03.914 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:58:03.972 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:58:03.977+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:58:04.021 INFO:tasks.rados.rados.0.smithi166.stdout:1244: finishing rollback tid 1 to smithi16641208-312 2020-11-16T20:58:04.021 INFO:tasks.rados.rados.0.smithi166.stdout:1244: finishing rollback tid 2 to smithi16641208-312 2020-11-16T20:58:04.021 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 312 v 776 (ObjNum 311 snap 0 seq_num 311) dirty exists 2020-11-16T20:58:04.022 INFO:tasks.rados.rados.0.smithi166.stdout:1244: done (3 left) 2020-11-16T20:58:04.022 INFO:tasks.rados.rados.0.smithi166.stdout:1248: done (2 left) 2020-11-16T20:58:04.022 INFO:tasks.rados.rados.0.smithi166.stdout:1252: read oid 346 snap -1 2020-11-16T20:58:04.022 INFO:tasks.rados.rados.0.smithi166.stdout:1252: expect (ObjNum 345 snap 0 seq_num 345) 2020-11-16T20:58:04.022 INFO:tasks.rados.rados.0.smithi166.stdout:1253: snap_create 2020-11-16T20:58:04.022 INFO:tasks.rados.rados.0.smithi166.stdout:1251: got (2) No such file or directory 2020-11-16T20:58:04.023 INFO:tasks.rados.rados.0.smithi166.stdout:1250: expect (ObjNum 136 snap 0 seq_num 136) 2020-11-16T20:58:04.031 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:58:04.047 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:04.047 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:04.057 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:58:04.073 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:04.078+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:04.100 INFO:tasks.rados.rados.0.smithi166.stdout:1252: expect (ObjNum 345 snap 0 seq_num 345) 2020-11-16T20:58:04.173 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:04.178+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:04.216 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:58:04.237 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:58:04.256 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:58:04.257 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:04.257 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:58:04.257 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:58:04.257 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:04.267 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:58:04.274 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:04.279+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:04.276 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:58:04.297 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:58:04.318 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:58:04.338 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:58:04.358 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:58:04.359 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:58:04.359 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:58:04.359 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:58:04.359 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:58:04.360 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:58:04.360 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:58:04.360 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:58:04.405 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:04.406 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:58:04.406 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:58:04.406 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:58:04.406 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:04.406 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:04.410+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:04.415 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:58:04.476 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:04.481+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:04.576 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:04.581+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:04.582 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:04.582 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:58:04.582 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:58:04.582 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:58:04.583 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.583 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2583 4.2 4:75836747:::smithi16641208-340:head [setxattr _header (58) in=7b,truncate 3159815] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:58:04.583 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.770345+0000", 2020-11-16T20:58:04.583 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 104.815644304, 2020-11-16T20:58:04.583 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.079764311000000004, 2020-11-16T20:58:04.583 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:04.583 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:04.584 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:04.584 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:04.584 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:04.584 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2583 2020-11-16T20:58:04.584 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.584 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:04.584 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.585 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:04.585 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770345+0000", 2020-11-16T20:58:04.585 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:04.585 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.585 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.585 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:04.585 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770345+0000", 2020-11-16T20:58:04.586 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9728999999999999e-05 2020-11-16T20:58:04.586 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.586 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.586 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:04.586 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770384+0000", 2020-11-16T20:58:04.586 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3849999999999999e-06 2020-11-16T20:58:04.586 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.587 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.587 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:04.587 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770391+0000", 2020-11-16T20:58:04.587 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0865e-05 2020-11-16T20:58:04.587 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.587 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.587 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:04.587 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770401+0000", 2020-11-16T20:58:04.588 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7599999999999999e-06 2020-11-16T20:58:04.588 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.588 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.588 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:04.588 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770407+0000", 2020-11-16T20:58:04.588 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00082697999999999995 2020-11-16T20:58:04.588 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.589 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.589 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.589 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771234+0000", 2020-11-16T20:58:04.589 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8841000000000001e-05 2020-11-16T20:58:04.589 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.589 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.589 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:04.590 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771293+0000", 2020-11-16T20:58:04.590 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.028773502999999999 2020-11-16T20:58:04.590 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.590 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.590 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.590 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800067+0000", 2020-11-16T20:58:04.590 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011809199999999999 2020-11-16T20:58:04.591 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.591 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.591 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:04.591 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800185+0000", 2020-11-16T20:58:04.591 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00041150300000000002 2020-11-16T20:58:04.591 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.591 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.591 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:58:04.592 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800596+0000", 2020-11-16T20:58:04.592 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078037820000000004 2020-11-16T20:58:04.592 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.592 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.592 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:04.592 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808400+0000", 2020-11-16T20:58:04.592 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.040583162999999998 2020-11-16T20:58:04.593 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.593 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.593 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:04.593 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.848983+0000", 2020-11-16T20:58:04.593 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00096703299999999996 2020-11-16T20:58:04.593 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.593 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.594 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:04.594 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.849950+0000", 2020-11-16T20:58:04.594 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6266999999999994e-05 2020-11-16T20:58:04.594 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.594 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.594 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:04.594 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850016+0000", 2020-11-16T20:58:04.595 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2408e-05 2020-11-16T20:58:04.595 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.595 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.595 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:04.595 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850109+0000", 2020-11-16T20:58:04.595 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.079764311000000004 2020-11-16T20:58:04.595 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.595 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:04.596 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.596 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.596 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.596 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2584 4.2 4:75836747:::smithi16641208-340:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:58:04.596 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.771084+0000", 2020-11-16T20:58:04.596 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 104.814904891, 2020-11-16T20:58:04.596 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.079415345999999998, 2020-11-16T20:58:04.597 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:04.597 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:04.597 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:04.597 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:04.597 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:04.597 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2584 2020-11-16T20:58:04.597 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.598 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:04.598 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.598 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:04.598 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771084+0000", 2020-11-16T20:58:04.598 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:04.598 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.598 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.599 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:04.599 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771084+0000", 2020-11-16T20:58:04.599 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3832999999999999e-05 2020-11-16T20:58:04.599 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.599 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.599 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:04.599 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771118+0000", 2020-11-16T20:58:04.599 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2299999999999996e-06 2020-11-16T20:58:04.600 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.600 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.600 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:04.600 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771124+0000", 2020-11-16T20:58:04.600 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1649e-05 2020-11-16T20:58:04.600 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.600 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.601 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:04.601 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771136+0000", 2020-11-16T20:58:04.601 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7389999999999996e-06 2020-11-16T20:58:04.601 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.601 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.601 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:04.601 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771141+0000", 2020-11-16T20:58:04.602 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000251332 2020-11-16T20:58:04.602 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.602 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.602 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.602 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771393+0000", 2020-11-16T20:58:04.602 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0130999999999997e-05 2020-11-16T20:58:04.602 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.602 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.603 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:04.603 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771453+0000", 2020-11-16T20:58:04.603 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036790163000000001 2020-11-16T20:58:04.603 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.603 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.603 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.603 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808243+0000", 2020-11-16T20:58:04.604 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000122781 2020-11-16T20:58:04.604 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.604 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.604 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:04.604 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808366+0000", 2020-11-16T20:58:04.604 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041793941000000001 2020-11-16T20:58:04.604 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.605 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.605 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.605 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850160+0000", 2020-11-16T20:58:04.605 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8177000000000005e-05 2020-11-16T20:58:04.605 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.605 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.605 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:04.605 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850258+0000", 2020-11-16T20:58:04.606 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024137 2020-11-16T20:58:04.606 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.606 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.606 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:04.606 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850499+0000", 2020-11-16T20:58:04.606 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.079415345999999998 2020-11-16T20:58:04.606 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.607 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:04.607 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.607 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.607 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.607 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:14 3.0 3:3b92f709:::smithi16641208-69:head [copy-from ver 517] snapc 2b=[f] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e97)", 2020-11-16T20:58:04.607 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.813636+0000", 2020-11-16T20:58:04.607 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 62.772352361000003, 2020-11-16T20:58:04.608 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.068038797999999998, 2020-11-16T20:58:04.608 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:04.608 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:04.608 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:04.608 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.608 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:04.608 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813636+0000", 2020-11-16T20:58:04.609 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:04.609 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.609 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.609 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:04.609 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813636+0000", 2020-11-16T20:58:04.609 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4759000000000001e-05 2020-11-16T20:58:04.609 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.610 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.610 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:04.610 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813661+0000", 2020-11-16T20:58:04.610 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4690000000000002e-06 2020-11-16T20:58:04.610 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.610 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.610 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:04.611 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813665+0000", 2020-11-16T20:58:04.611 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0939999999999996e-06 2020-11-16T20:58:04.611 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.611 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.611 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:04.611 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813671+0000", 2020-11-16T20:58:04.611 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9490000000000001e-06 2020-11-16T20:58:04.611 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.612 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.612 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:04.612 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813674+0000", 2020-11-16T20:58:04.612 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035912158999999999 2020-11-16T20:58:04.612 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.612 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.612 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.613 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849586+0000", 2020-11-16T20:58:04.613 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000105225 2020-11-16T20:58:04.613 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.613 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.613 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:04.613 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849691+0000", 2020-11-16T20:58:04.613 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094697400000000008 2020-11-16T20:58:04.614 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.614 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.614 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,2", 2020-11-16T20:58:04.614 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.859161+0000", 2020-11-16T20:58:04.614 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022310784 2020-11-16T20:58:04.614 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.614 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.614 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:04.615 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881472+0000", 2020-11-16T20:58:04.615 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7089000000000003e-05 2020-11-16T20:58:04.615 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.615 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.615 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:04.615 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881519+0000", 2020-11-16T20:58:04.615 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9331000000000004e-05 2020-11-16T20:58:04.616 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.616 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.616 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:04.616 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881588+0000", 2020-11-16T20:58:04.616 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9375000000000001e-05 2020-11-16T20:58:04.616 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.616 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.617 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:04.617 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881637+0000", 2020-11-16T20:58:04.617 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7824000000000002e-05 2020-11-16T20:58:04.617 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.617 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.617 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:04.617 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881675+0000", 2020-11-16T20:58:04.617 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.068038797999999998 2020-11-16T20:58:04.618 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.618 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:04.618 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.618 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.618 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.618 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3084 3.0 3:0eeb4688:::smithi16641208-459:head [copy-from ver 165] snapc 38=[38] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e97)", 2020-11-16T20:58:04.618 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.814118+0000", 2020-11-16T20:58:04.619 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 62.771870603000004, 2020-11-16T20:58:04.619 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.078238367000000003, 2020-11-16T20:58:04.619 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:04.619 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:04.619 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:04.619 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.619 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:04.620 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814118+0000", 2020-11-16T20:58:04.620 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:04.620 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.620 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.620 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:04.620 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814118+0000", 2020-11-16T20:58:04.620 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.262e-05 2020-11-16T20:58:04.620 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.621 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.621 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:04.621 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814141+0000", 2020-11-16T20:58:04.621 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.169e-05 2020-11-16T20:58:04.621 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.621 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.621 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:04.622 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814153+0000", 2020-11-16T20:58:04.622 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5350000000000004e-06 2020-11-16T20:58:04.622 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.622 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.622 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:04.622 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814161+0000", 2020-11-16T20:58:04.622 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1760000000000003e-06 2020-11-16T20:58:04.623 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.623 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.623 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:04.623 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814165+0000", 2020-11-16T20:58:04.623 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035740382000000001 2020-11-16T20:58:04.623 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.623 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.623 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.624 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849906+0000", 2020-11-16T20:58:04.624 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2356999999999999e-05 2020-11-16T20:58:04.624 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.624 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.624 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:04.624 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849978+0000", 2020-11-16T20:58:04.624 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016929244999999999 2020-11-16T20:58:04.625 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.625 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.625 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,2", 2020-11-16T20:58:04.625 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.866907+0000", 2020-11-16T20:58:04.625 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024555357 2020-11-16T20:58:04.625 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.625 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.626 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:04.626 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.891463+0000", 2020-11-16T20:58:04.626 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00067812000000000005 2020-11-16T20:58:04.626 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.626 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.626 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:04.626 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892141+0000", 2020-11-16T20:58:04.626 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3387999999999997e-05 2020-11-16T20:58:04.627 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.627 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.627 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:04.627 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892204+0000", 2020-11-16T20:58:04.627 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4189999999999994e-05 2020-11-16T20:58:04.627 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.627 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.628 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:04.628 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892268+0000", 2020-11-16T20:58:04.628 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8306999999999993e-05 2020-11-16T20:58:04.628 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.628 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.628 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:04.628 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892357+0000", 2020-11-16T20:58:04.629 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.078238367000000003 2020-11-16T20:58:04.629 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.629 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:04.629 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.629 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.629 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.629 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:16 3.0 3:0eeb4688:::smithi16641208-459:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e97)", 2020-11-16T20:58:04.629 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.814220+0000", 2020-11-16T20:58:04.630 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 62.771768672999997, 2020-11-16T20:58:04.630 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.078457661999999997, 2020-11-16T20:58:04.630 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:04.630 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:04.630 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:04.630 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.630 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:04.631 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814220+0000", 2020-11-16T20:58:04.631 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:04.631 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.631 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.631 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:04.631 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814220+0000", 2020-11-16T20:58:04.631 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6680999999999998e-05 2020-11-16T20:58:04.632 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.632 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.632 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:04.632 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814237+0000", 2020-11-16T20:58:04.632 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4029999999999999e-06 2020-11-16T20:58:04.632 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.632 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.633 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:04.633 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814240+0000", 2020-11-16T20:58:04.633 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5980000000000002e-06 2020-11-16T20:58:04.633 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.633 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.633 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:04.633 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814247+0000", 2020-11-16T20:58:04.633 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1489999999999998e-06 2020-11-16T20:58:04.634 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.634 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.634 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:04.634 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814250+0000", 2020-11-16T20:58:04.634 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035894660000000002 2020-11-16T20:58:04.634 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.634 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.635 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.635 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850145+0000", 2020-11-16T20:58:04.635 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2685000000000001e-05 2020-11-16T20:58:04.635 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.635 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.635 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:04.635 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850197+0000", 2020-11-16T20:58:04.636 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030551076999999999 2020-11-16T20:58:04.636 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.636 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.636 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.636 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.880748+0000", 2020-11-16T20:58:04.636 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011375900000000001 2020-11-16T20:58:04.636 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.637 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.637 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:04.637 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.880862+0000", 2020-11-16T20:58:04.637 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011676122000000001 2020-11-16T20:58:04.637 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.637 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.637 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.638 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892538+0000", 2020-11-16T20:58:04.638 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7021999999999997e-05 2020-11-16T20:58:04.638 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.638 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.638 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:04.638 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892595+0000", 2020-11-16T20:58:04.638 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2505999999999999e-05 2020-11-16T20:58:04.638 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.639 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.639 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:04.639 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892678+0000", 2020-11-16T20:58:04.639 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.078457661999999997 2020-11-16T20:58:04.639 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.639 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:04.639 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.640 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.640 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.640 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:17 3.0 3:0eeb4688:::smithi16641208-459:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e97)", 2020-11-16T20:58:04.640 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.814270+0000", 2020-11-16T20:58:04.640 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 62.771719304000001, 2020-11-16T20:58:04.640 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.082632504999999995, 2020-11-16T20:58:04.640 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:04.641 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:04.641 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:04.641 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.641 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:04.641 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814270+0000", 2020-11-16T20:58:04.641 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:04.641 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.641 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.642 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:04.642 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814270+0000", 2020-11-16T20:58:04.642 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3700999999999999e-05 2020-11-16T20:58:04.642 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.642 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.642 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:04.642 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814293+0000", 2020-11-16T20:58:04.643 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7879999999999998e-06 2020-11-16T20:58:04.643 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.643 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.643 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:04.643 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814296+0000", 2020-11-16T20:58:04.643 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6509999999999998e-06 2020-11-16T20:58:04.643 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.644 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.644 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:04.644 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814302+0000", 2020-11-16T20:58:04.644 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1039999999999996e-06 2020-11-16T20:58:04.644 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.644 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.644 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:04.645 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814311+0000", 2020-11-16T20:58:04.645 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035912305999999998 2020-11-16T20:58:04.645 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.645 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.645 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.645 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850223+0000", 2020-11-16T20:58:04.645 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5476000000000003e-05 2020-11-16T20:58:04.645 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.646 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.646 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:04.646 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850269+0000", 2020-11-16T20:58:04.646 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030645256999999999 2020-11-16T20:58:04.646 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.646 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.646 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.647 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.880914+0000", 2020-11-16T20:58:04.647 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3608000000000004e-05 2020-11-16T20:58:04.647 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.647 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.647 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:04.647 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.880987+0000", 2020-11-16T20:58:04.647 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011720252 2020-11-16T20:58:04.648 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.648 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.648 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.648 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892708+0000", 2020-11-16T20:58:04.648 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4710000000000003e-05 2020-11-16T20:58:04.654 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.654 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.654 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:04.654 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892762+0000", 2020-11-16T20:58:04.654 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041396519999999997 2020-11-16T20:58:04.655 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.655 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.655 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:04.655 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.896902+0000", 2020-11-16T20:58:04.655 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.082632504999999995 2020-11-16T20:58:04.655 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.655 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:04.655 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.656 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.656 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.656 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:19 3.0 3:1e015f5d:::smithi16641208-120:head [copy-from ver 447] snapc e=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e97)", 2020-11-16T20:58:04.656 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.814940+0000", 2020-11-16T20:58:04.656 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 62.771048761999999, 2020-11-16T20:58:04.656 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.077559996000000006, 2020-11-16T20:58:04.656 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:04.657 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:04.657 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:04.657 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.657 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:04.657 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814940+0000", 2020-11-16T20:58:04.657 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:04.657 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.658 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.658 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:04.658 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814940+0000", 2020-11-16T20:58:04.658 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0903000000000003e-05 2020-11-16T20:58:04.658 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.658 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.658 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:04.659 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815001+0000", 2020-11-16T20:58:04.659 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1119999999999998e-06 2020-11-16T20:58:04.659 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.659 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.659 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:04.659 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815008+0000", 2020-11-16T20:58:04.659 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1421e-05 2020-11-16T20:58:04.659 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.660 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.660 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:04.660 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815019+0000", 2020-11-16T20:58:04.660 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6509999999999998e-06 2020-11-16T20:58:04.660 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.660 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.660 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:04.661 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815025+0000", 2020-11-16T20:58:04.661 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036337921000000002 2020-11-16T20:58:04.661 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.661 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.661 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.661 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851363+0000", 2020-11-16T20:58:04.661 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012654300000000001 2020-11-16T20:58:04.662 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.662 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.662 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:04.662 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851490+0000", 2020-11-16T20:58:04.662 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025530690000000002 2020-11-16T20:58:04.662 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.662 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.662 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,2", 2020-11-16T20:58:04.663 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.877020+0000", 2020-11-16T20:58:04.663 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01516898 2020-11-16T20:58:04.663 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.663 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.663 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:04.663 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892189+0000", 2020-11-16T20:58:04.663 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017819600000000001 2020-11-16T20:58:04.664 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.664 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.664 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:04.664 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892367+0000", 2020-11-16T20:58:04.664 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6916999999999999e-05 2020-11-16T20:58:04.664 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.664 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.664 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:04.665 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892404+0000", 2020-11-16T20:58:04.665 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1143999999999998e-05 2020-11-16T20:58:04.665 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.665 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.665 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:04.665 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892446+0000", 2020-11-16T20:58:04.665 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4518000000000002e-05 2020-11-16T20:58:04.666 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.666 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.666 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:04.666 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892500+0000", 2020-11-16T20:58:04.666 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.077559996000000006 2020-11-16T20:58:04.666 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.666 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:04.667 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.667 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.667 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.667 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3105 3.0 3:1ccd20f3:::smithi16641208-424:head [stat,delete] snapc 38=[38] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e97)", 2020-11-16T20:58:04.667 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.815082+0000", 2020-11-16T20:58:04.667 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 62.770907096999998, 2020-11-16T20:58:04.667 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066146218000000007, 2020-11-16T20:58:04.668 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:04.668 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:04.668 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:04.668 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.668 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:04.668 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815082+0000", 2020-11-16T20:58:04.668 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:04.668 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.669 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.669 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:04.669 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815082+0000", 2020-11-16T20:58:04.669 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0209000000000002e-05 2020-11-16T20:58:04.669 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.669 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.669 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:04.670 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815112+0000", 2020-11-16T20:58:04.670 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7830000000000004e-06 2020-11-16T20:58:04.670 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.670 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.670 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:04.670 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815118+0000", 2020-11-16T20:58:04.670 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0927000000000001e-05 2020-11-16T20:58:04.671 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.671 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.671 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:04.671 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815129+0000", 2020-11-16T20:58:04.671 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3059999999999997e-06 2020-11-16T20:58:04.671 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.671 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.671 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:04.672 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815134+0000", 2020-11-16T20:58:04.672 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036502199999999999 2020-11-16T20:58:04.672 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.672 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.672 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.672 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851636+0000", 2020-11-16T20:58:04.672 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016290900000000001 2020-11-16T20:58:04.673 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.673 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.673 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:04.673 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851799+0000", 2020-11-16T20:58:04.673 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00028645999999999999 2020-11-16T20:58:04.673 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.673 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.674 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,2", 2020-11-16T20:58:04.674 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852086+0000", 2020-11-16T20:58:04.674 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003854007 2020-11-16T20:58:04.674 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.674 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.674 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:04.674 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.855940+0000", 2020-11-16T20:58:04.674 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0019815750000000002 2020-11-16T20:58:04.675 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.675 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.675 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:04.675 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.857921+0000", 2020-11-16T20:58:04.675 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023126626000000001 2020-11-16T20:58:04.675 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.675 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.676 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:04.676 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881048+0000", 2020-11-16T20:58:04.676 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.0409999999999998e-05 2020-11-16T20:58:04.676 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.676 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.676 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:04.676 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881128+0000", 2020-11-16T20:58:04.677 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9806e-05 2020-11-16T20:58:04.677 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.677 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.677 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:04.677 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881228+0000", 2020-11-16T20:58:04.677 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066146218000000007 2020-11-16T20:58:04.677 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.677 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:04.678 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.678 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.678 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.678 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:21 3.0 3:1ccd20f3:::smithi16641208-424:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e97)", 2020-11-16T20:58:04.678 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.815178+0000", 2020-11-16T20:58:04.678 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 62.770810760000003, 2020-11-16T20:58:04.678 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066300320999999995, 2020-11-16T20:58:04.679 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:04.679 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:04.679 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:04.679 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.679 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:04.679 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815178+0000", 2020-11-16T20:58:04.679 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:04.680 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.680 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.680 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:04.680 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815178+0000", 2020-11-16T20:58:04.680 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8203000000000001e-05 2020-11-16T20:58:04.680 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.680 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.680 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:04.681 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815206+0000", 2020-11-16T20:58:04.681 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7729999999999996e-06 2020-11-16T20:58:04.681 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.681 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.681 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:04.681 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815212+0000", 2020-11-16T20:58:04.681 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.149e-05 2020-11-16T20:58:04.682 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.682 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.682 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:04.682 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815224+0000", 2020-11-16T20:58:04.682 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3900000000000001e-06 2020-11-16T20:58:04.682 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.682 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.683 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:04.683 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815229+0000", 2020-11-16T20:58:04.683 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039388232000000002 2020-11-16T20:58:04.683 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.683 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.683 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.683 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.854617+0000", 2020-11-16T20:58:04.683 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012693099999999999 2020-11-16T20:58:04.684 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.684 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.684 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:04.684 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.854744+0000", 2020-11-16T20:58:04.684 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026509525999999999 2020-11-16T20:58:04.684 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.684 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.685 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.685 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881254+0000", 2020-11-16T20:58:04.685 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2397000000000005e-05 2020-11-16T20:58:04.685 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.685 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.685 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:04.685 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881326+0000", 2020-11-16T20:58:04.686 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015237900000000001 2020-11-16T20:58:04.686 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.686 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.686 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:04.686 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881478+0000", 2020-11-16T20:58:04.686 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066300320999999995 2020-11-16T20:58:04.686 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.687 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:04.687 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.687 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.687 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.687 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:22 3.0 3:1ccd20f3:::smithi16641208-424:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e97)", 2020-11-16T20:58:04.687 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.815264+0000", 2020-11-16T20:58:04.687 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 62.770724319999999, 2020-11-16T20:58:04.687 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066644708999999996, 2020-11-16T20:58:04.688 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:04.688 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:04.688 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:04.688 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.688 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:04.688 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815264+0000", 2020-11-16T20:58:04.688 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:04.689 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.689 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.689 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:04.689 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815264+0000", 2020-11-16T20:58:04.689 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5266999999999999e-05 2020-11-16T20:58:04.689 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.689 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.689 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:04.690 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815310+0000", 2020-11-16T20:58:04.690 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3989999999999998e-06 2020-11-16T20:58:04.690 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.690 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.690 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:04.690 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815317+0000", 2020-11-16T20:58:04.690 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.082e-05 2020-11-16T20:58:04.691 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.691 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.691 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:04.691 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815328+0000", 2020-11-16T20:58:04.691 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0220000000000004e-06 2020-11-16T20:58:04.691 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.691 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.692 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:04.692 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815333+0000", 2020-11-16T20:58:04.692 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039899660000000003 2020-11-16T20:58:04.692 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.692 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.692 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.692 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.855233+0000", 2020-11-16T20:58:04.693 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2051000000000004e-05 2020-11-16T20:58:04.693 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.693 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.693 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:04.693 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.855315+0000", 2020-11-16T20:58:04.693 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026394424 2020-11-16T20:58:04.693 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.693 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.694 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.694 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881709+0000", 2020-11-16T20:58:04.694 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020006599999999999 2020-11-16T20:58:04.694 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.694 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.694 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:04.694 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881909+0000", 2020-11-16T20:58:04.695 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066644708999999996 2020-11-16T20:58:04.695 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.695 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:04.695 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.695 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.695 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.695 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:68 3.0 3:266da985:::smithi16641208-406:head [copy-get max 8388608] snapc 0=[] RETRY=2 ondisk+retry+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:58:04.696 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.832133+0000", 2020-11-16T20:58:04.696 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 44.753855321000003, 2020-11-16T20:58:04.696 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054097583999999997, 2020-11-16T20:58:04.696 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:04.696 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:04.696 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:04.696 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.697 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:04.697 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832133+0000", 2020-11-16T20:58:04.697 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:04.697 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.697 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.697 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:04.697 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832133+0000", 2020-11-16T20:58:04.697 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1003e-05 2020-11-16T20:58:04.698 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.698 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.698 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:04.698 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832175+0000", 2020-11-16T20:58:04.698 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7960000000000001e-06 2020-11-16T20:58:04.698 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.698 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.699 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:04.699 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832180+0000", 2020-11-16T20:58:04.699 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0349e-05 2020-11-16T20:58:04.699 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.699 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.699 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:04.699 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832191+0000", 2020-11-16T20:58:04.700 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3000000000000001e-06 2020-11-16T20:58:04.700 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.700 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.700 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:04.700 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832196+0000", 2020-11-16T20:58:04.700 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6594000000000001e-05 2020-11-16T20:58:04.700 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.701 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.701 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.701 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832243+0000", 2020-11-16T20:58:04.701 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2993000000000001e-05 2020-11-16T20:58:04.701 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.701 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.701 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:04.701 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832256+0000", 2020-11-16T20:58:04.702 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.045506131999999998 2020-11-16T20:58:04.702 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.702 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.702 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.702 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.877762+0000", 2020-11-16T20:58:04.702 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010955600000000001 2020-11-16T20:58:04.702 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.703 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.703 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:04.703 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.877871+0000", 2020-11-16T20:58:04.703 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042134119999999997 2020-11-16T20:58:04.703 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.703 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.703 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.704 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.882085+0000", 2020-11-16T20:58:04.704 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014105699999999999 2020-11-16T20:58:04.704 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.704 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.704 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:04.704 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.882226+0000", 2020-11-16T20:58:04.704 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004005392 2020-11-16T20:58:04.704 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.705 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.705 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:04.705 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886231+0000", 2020-11-16T20:58:04.705 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054097583999999997 2020-11-16T20:58:04.705 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.705 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:04.705 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.706 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.706 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.706 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3327 3.0 3:2949283c:::smithi16641208-44:head [write 537989~722069,stat] snapc 49=[49,48,44,41] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e115)", 2020-11-16T20:58:04.706 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.832232+0000", 2020-11-16T20:58:04.706 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 44.753756840000001, 2020-11-16T20:58:04.706 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054524729000000001, 2020-11-16T20:58:04.706 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:04.707 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:04.707 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:04.707 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.707 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:04.707 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832232+0000", 2020-11-16T20:58:04.707 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:04.707 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.707 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.708 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:04.708 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832232+0000", 2020-11-16T20:58:04.708 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00040025400000000001 2020-11-16T20:58:04.708 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.708 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.708 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:04.708 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832632+0000", 2020-11-16T20:58:04.709 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5050000000000004e-06 2020-11-16T20:58:04.709 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.709 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.709 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:04.709 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832639+0000", 2020-11-16T20:58:04.709 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1299e-05 2020-11-16T20:58:04.709 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.710 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.710 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:04.710 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832650+0000", 2020-11-16T20:58:04.710 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8030000000000002e-06 2020-11-16T20:58:04.710 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.710 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.710 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:04.710 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832656+0000", 2020-11-16T20:58:04.711 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8779000000000003e-05 2020-11-16T20:58:04.711 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.711 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.711 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.711 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832695+0000", 2020-11-16T20:58:04.711 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9789999999999993e-06 2020-11-16T20:58:04.711 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.712 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.712 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:04.712 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832703+0000", 2020-11-16T20:58:04.712 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.045361931000000001 2020-11-16T20:58:04.712 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.712 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.712 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.713 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.878065+0000", 2020-11-16T20:58:04.713 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000221418 2020-11-16T20:58:04.713 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.713 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.713 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:04.713 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.878286+0000", 2020-11-16T20:58:04.713 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023917099999999999 2020-11-16T20:58:04.713 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.714 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.714 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 2,6", 2020-11-16T20:58:04.714 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.878525+0000", 2020-11-16T20:58:04.714 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003510988 2020-11-16T20:58:04.714 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.714 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.714 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:04.715 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.882036+0000", 2020-11-16T20:58:04.715 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044535720000000003 2020-11-16T20:58:04.715 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.715 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.715 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:04.715 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886490+0000", 2020-11-16T20:58:04.715 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0692999999999996e-05 2020-11-16T20:58:04.716 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.716 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.716 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:04.716 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886560+0000", 2020-11-16T20:58:04.716 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5710000000000001e-05 2020-11-16T20:58:04.716 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.716 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.716 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:04.717 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886606+0000", 2020-11-16T20:58:04.717 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015062699999999999 2020-11-16T20:58:04.717 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.717 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.717 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:04.717 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886757+0000", 2020-11-16T20:58:04.717 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054524729000000001 2020-11-16T20:58:04.718 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.718 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:04.718 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.718 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.718 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.718 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:70 3.0 3:2949283c:::smithi16641208-44:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:58:04.718 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.832688+0000", 2020-11-16T20:58:04.719 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 44.753300420999999, 2020-11-16T20:58:04.719 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054473900999999998, 2020-11-16T20:58:04.719 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:04.719 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:04.719 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:04.719 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.719 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:04.720 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832688+0000", 2020-11-16T20:58:04.720 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:04.720 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.720 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.720 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:04.720 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832688+0000", 2020-11-16T20:58:04.720 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5730999999999999e-05 2020-11-16T20:58:04.720 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.721 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.721 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:04.721 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832704+0000", 2020-11-16T20:58:04.721 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0690000000000002e-06 2020-11-16T20:58:04.721 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.721 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.721 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:04.722 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832707+0000", 2020-11-16T20:58:04.722 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9719999999999997e-06 2020-11-16T20:58:04.722 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.722 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.722 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:04.722 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832713+0000", 2020-11-16T20:58:04.722 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8650000000000001e-06 2020-11-16T20:58:04.723 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.723 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.723 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:04.723 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832716+0000", 2020-11-16T20:58:04.723 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8541999999999998e-05 2020-11-16T20:58:04.723 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.723 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.723 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.724 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832755+0000", 2020-11-16T20:58:04.724 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.153e-05 2020-11-16T20:58:04.724 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.724 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.724 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:04.724 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832766+0000", 2020-11-16T20:58:04.724 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047763647999999999 2020-11-16T20:58:04.725 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.725 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.725 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.725 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.880530+0000", 2020-11-16T20:58:04.725 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016090599999999999 2020-11-16T20:58:04.725 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.725 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.726 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:04.726 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.880691+0000", 2020-11-16T20:58:04.726 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061198809999999998 2020-11-16T20:58:04.726 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.726 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.726 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.726 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886811+0000", 2020-11-16T20:58:04.727 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012478200000000001 2020-11-16T20:58:04.727 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.727 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.727 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:04.727 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886935+0000", 2020-11-16T20:58:04.727 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000226975 2020-11-16T20:58:04.727 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.727 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.728 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:04.728 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.887162+0000", 2020-11-16T20:58:04.728 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054473900999999998 2020-11-16T20:58:04.728 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.728 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:04.728 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.728 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.729 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.729 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:71 3.0 3:2949283c:::smithi16641208-44:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:58:04.729 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.832747+0000", 2020-11-16T20:58:04.729 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 44.753241572999997, 2020-11-16T20:58:04.729 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.057126753000000002, 2020-11-16T20:58:04.729 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:04.729 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:04.729 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:04.730 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.730 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:04.730 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832747+0000", 2020-11-16T20:58:04.730 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:04.730 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.730 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.730 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:04.731 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832747+0000", 2020-11-16T20:58:04.731 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3911000000000001e-05 2020-11-16T20:58:04.731 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.731 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.731 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:04.731 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832781+0000", 2020-11-16T20:58:04.731 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2480000000000001e-06 2020-11-16T20:58:04.732 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.732 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.732 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:04.732 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832784+0000", 2020-11-16T20:58:04.732 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2040000000000002e-06 2020-11-16T20:58:04.732 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.732 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.733 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:04.733 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832791+0000", 2020-11-16T20:58:04.733 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2399999999999999e-06 2020-11-16T20:58:04.733 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.733 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.733 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:04.733 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832794+0000", 2020-11-16T20:58:04.733 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2548000000000002e-05 2020-11-16T20:58:04.734 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.734 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.734 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.734 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832816+0000", 2020-11-16T20:58:04.734 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4160000000000003e-06 2020-11-16T20:58:04.734 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.734 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.735 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:04.735 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832822+0000", 2020-11-16T20:58:04.735 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.053459245000000002 2020-11-16T20:58:04.735 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.735 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.735 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.735 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886281+0000", 2020-11-16T20:58:04.736 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018665399999999999 2020-11-16T20:58:04.736 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.736 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.736 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:04.736 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886468+0000", 2020-11-16T20:58:04.736 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00075232499999999998 2020-11-16T20:58:04.736 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.737 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.737 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.737 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.887220+0000", 2020-11-16T20:58:04.737 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000152974 2020-11-16T20:58:04.737 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.737 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.737 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:04.737 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.887373+0000", 2020-11-16T20:58:04.738 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002500988 2020-11-16T20:58:04.738 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.738 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.738 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:04.738 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.889874+0000", 2020-11-16T20:58:04.738 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.057126753000000002 2020-11-16T20:58:04.738 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.739 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:04.739 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.739 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.739 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.739 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3346 3.0 3:1e5364a0:::smithi16641208-320:head [write 588410~547816,stat] snapc 4a=[4a,49,48,44,41] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e115)", 2020-11-16T20:58:04.739 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.839179+0000", 2020-11-16T20:58:04.739 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 44.746809818999999, 2020-11-16T20:58:04.740 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.084752201999999999, 2020-11-16T20:58:04.740 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:04.740 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:04.740 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:04.740 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.740 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:04.740 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839179+0000", 2020-11-16T20:58:04.740 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:04.741 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.741 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.741 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:04.741 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839179+0000", 2020-11-16T20:58:04.741 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000250175 2020-11-16T20:58:04.741 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.741 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.742 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:04.742 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839429+0000", 2020-11-16T20:58:04.742 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.22e-06 2020-11-16T20:58:04.742 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.742 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.742 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:04.742 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839434+0000", 2020-11-16T20:58:04.743 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0258000000000001e-05 2020-11-16T20:58:04.743 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.743 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.743 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:04.743 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839445+0000", 2020-11-16T20:58:04.743 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8019999999999999e-06 2020-11-16T20:58:04.743 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.744 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.744 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:04.744 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839449+0000", 2020-11-16T20:58:04.744 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1084999999999997e-05 2020-11-16T20:58:04.744 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.744 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.744 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.744 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839491+0000", 2020-11-16T20:58:04.745 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4239999999999993e-06 2020-11-16T20:58:04.745 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.745 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.745 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:04.745 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839499+0000", 2020-11-16T20:58:04.745 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050428550000000003 2020-11-16T20:58:04.745 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.746 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.746 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.746 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.889928+0000", 2020-11-16T20:58:04.746 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030713000000000002 2020-11-16T20:58:04.746 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.746 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.746 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:04.747 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.890235+0000", 2020-11-16T20:58:04.747 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00047229800000000001 2020-11-16T20:58:04.747 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.747 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.747 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 2,6", 2020-11-16T20:58:04.747 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.890707+0000", 2020-11-16T20:58:04.747 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0046488600000000003 2020-11-16T20:58:04.747 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.748 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.748 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:04.748 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895356+0000", 2020-11-16T20:58:04.748 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.028228664000000001 2020-11-16T20:58:04.748 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.748 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.748 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:04.749 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.923584+0000", 2020-11-16T20:58:04.749 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3496e-05 2020-11-16T20:58:04.749 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.749 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.749 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:04.749 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.923608+0000", 2020-11-16T20:58:04.749 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0390999999999997e-05 2020-11-16T20:58:04.749 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.750 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.750 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:04.750 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.923678+0000", 2020-11-16T20:58:04.750 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00025284899999999998 2020-11-16T20:58:04.750 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.750 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.750 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:04.751 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.923931+0000", 2020-11-16T20:58:04.751 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.084752201999999999 2020-11-16T20:58:04.751 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.751 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:04.751 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.751 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.751 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.752 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:73 3.0 3:1e5364a0:::smithi16641208-320:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:58:04.752 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.839479+0000", 2020-11-16T20:58:04.752 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 44.746509588000002, 2020-11-16T20:58:04.752 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.089078473000000005, 2020-11-16T20:58:04.752 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:04.752 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:04.752 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:04.752 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.753 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:04.753 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839479+0000", 2020-11-16T20:58:04.753 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:04.753 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.753 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.753 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:04.753 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839479+0000", 2020-11-16T20:58:04.754 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8124000000000001e-05 2020-11-16T20:58:04.754 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.754 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.754 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:04.754 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839497+0000", 2020-11-16T20:58:04.754 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1580000000000001e-06 2020-11-16T20:58:04.755 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.755 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.755 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:04.755 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839501+0000", 2020-11-16T20:58:04.755 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6579999999999996e-06 2020-11-16T20:58:04.755 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.755 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.756 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:04.756 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839507+0000", 2020-11-16T20:58:04.756 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9720000000000001e-06 2020-11-16T20:58:04.756 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.756 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.756 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:04.756 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839510+0000", 2020-11-16T20:58:04.756 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1950000000000003e-05 2020-11-16T20:58:04.757 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.757 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.757 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.757 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839552+0000", 2020-11-16T20:58:04.757 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2225999999999999e-05 2020-11-16T20:58:04.757 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.757 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.758 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:04.758 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839564+0000", 2020-11-16T20:58:04.758 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.055483693000000001 2020-11-16T20:58:04.758 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.758 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.758 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.758 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895048+0000", 2020-11-16T20:58:04.759 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022632500000000001 2020-11-16T20:58:04.759 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.759 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.759 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:04.759 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895274+0000", 2020-11-16T20:58:04.759 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032777323999999997 2020-11-16T20:58:04.759 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.759 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.760 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.760 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928052+0000", 2020-11-16T20:58:04.760 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000150321 2020-11-16T20:58:04.760 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.760 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.760 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:04.760 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928202+0000", 2020-11-16T20:58:04.761 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00035572199999999999 2020-11-16T20:58:04.761 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.761 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.761 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:04.761 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928558+0000", 2020-11-16T20:58:04.761 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.089078473000000005 2020-11-16T20:58:04.761 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.762 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:04.762 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.762 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.762 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.762 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:74 3.0 3:1e5364a0:::smithi16641208-320:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:58:04.762 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.839542+0000", 2020-11-16T20:58:04.762 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 44.746446958999996, 2020-11-16T20:58:04.763 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.093226218, 2020-11-16T20:58:04.763 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:04.763 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:04.763 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:04.763 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.763 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:04.763 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839542+0000", 2020-11-16T20:58:04.763 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:04.764 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.764 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.764 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:04.764 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839542+0000", 2020-11-16T20:58:04.764 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6640000000000002e-05 2020-11-16T20:58:04.764 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.764 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.765 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:04.765 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839578+0000", 2020-11-16T20:58:04.765 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.416e-06 2020-11-16T20:58:04.765 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.765 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.765 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:04.765 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839582+0000", 2020-11-16T20:58:04.765 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9070000000000001e-06 2020-11-16T20:58:04.766 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.766 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.766 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:04.766 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839589+0000", 2020-11-16T20:58:04.766 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.994e-06 2020-11-16T20:58:04.766 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.766 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.767 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:04.767 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839592+0000", 2020-11-16T20:58:04.767 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4881000000000001e-05 2020-11-16T20:58:04.767 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.767 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.767 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.767 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839617+0000", 2020-11-16T20:58:04.768 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4330000000000003e-06 2020-11-16T20:58:04.768 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.768 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.768 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:04.768 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839622+0000", 2020-11-16T20:58:04.768 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.055765016000000001 2020-11-16T20:58:04.768 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.768 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.769 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.769 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895387+0000", 2020-11-16T20:58:04.769 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000145926 2020-11-16T20:58:04.769 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.769 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.769 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:04.769 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895533+0000", 2020-11-16T20:58:04.770 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033078547999999999 2020-11-16T20:58:04.770 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.770 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.770 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.770 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928612+0000", 2020-11-16T20:58:04.770 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114621 2020-11-16T20:58:04.770 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.771 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.771 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:04.771 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928726+0000", 2020-11-16T20:58:04.771 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004041836 2020-11-16T20:58:04.771 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.771 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.771 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:04.772 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.932768+0000", 2020-11-16T20:58:04.772 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.093226218 2020-11-16T20:58:04.772 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.772 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:04.772 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.772 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.772 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.772 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3414 4.3 4:cf270c70:::smithi16641208-423:head [copy-from ver 586] snapc 4f=[4f,48] ondisk+write+known_if_redirected e120)", 2020-11-16T20:58:04.773 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:24.750833+0000", 2020-11-16T20:58:04.773 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 39.835155722000003, 2020-11-16T20:58:04.773 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.064670209000000006, 2020-11-16T20:58:04.773 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:04.773 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:04.773 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:04.773 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:04.774 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:04.774 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3414 2020-11-16T20:58:04.774 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.774 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:04.774 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.774 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:04.774 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750833+0000", 2020-11-16T20:58:04.775 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:04.775 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.775 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.775 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:04.775 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750833+0000", 2020-11-16T20:58:04.775 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4888e-05 2020-11-16T20:58:04.775 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.775 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.776 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:04.776 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750858+0000", 2020-11-16T20:58:04.776 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6359999999999997e-06 2020-11-16T20:58:04.776 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.776 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.776 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:04.776 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750865+0000", 2020-11-16T20:58:04.777 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4072e-05 2020-11-16T20:58:04.777 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.777 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.777 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:04.777 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750879+0000", 2020-11-16T20:58:04.777 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1409999999999994e-06 2020-11-16T20:58:04.777 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.777 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.778 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:04.778 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750888+0000", 2020-11-16T20:58:04.778 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000413664 2020-11-16T20:58:04.778 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.778 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.778 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.778 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751301+0000", 2020-11-16T20:58:04.779 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1214e-05 2020-11-16T20:58:04.779 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.779 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.779 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op must wait for map", 2020-11-16T20:58:04.779 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751313+0000", 2020-11-16T20:58:04.779 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078009489999999997 2020-11-16T20:58:04.779 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.780 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.780 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.780 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.759114+0000", 2020-11-16T20:58:04.780 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.056386372999999997 2020-11-16T20:58:04.780 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.780 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.780 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:04.780 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.815500+0000", 2020-11-16T20:58:04.781 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2720000000000002e-06 2020-11-16T20:58:04.781 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.781 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.781 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:04.781 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.815503+0000", 2020-11-16T20:58:04.781 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.064670209000000006 2020-11-16T20:58:04.781 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.782 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:04.782 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.782 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.782 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.782 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3415 4.3 4:cf270c70:::smithi16641208-423:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e120)", 2020-11-16T20:58:04.782 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:24.750930+0000", 2020-11-16T20:58:04.782 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 39.835059244, 2020-11-16T20:58:04.783 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.064785488000000002, 2020-11-16T20:58:04.783 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:04.783 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:04.783 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:04.783 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:04.783 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:04.783 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3415 2020-11-16T20:58:04.783 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.784 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:04.784 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.784 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:04.784 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750930+0000", 2020-11-16T20:58:04.784 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:04.784 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.784 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.785 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:04.785 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750930+0000", 2020-11-16T20:58:04.785 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7016e-05 2020-11-16T20:58:04.785 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.785 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.785 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:04.785 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750957+0000", 2020-11-16T20:58:04.786 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7379999999999999e-06 2020-11-16T20:58:04.786 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.786 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.786 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:04.786 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750962+0000", 2020-11-16T20:58:04.786 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0684e-05 2020-11-16T20:58:04.786 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.787 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.787 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:04.787 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750973+0000", 2020-11-16T20:58:04.787 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2089999999999996e-06 2020-11-16T20:58:04.787 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.787 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.787 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:04.787 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750978+0000", 2020-11-16T20:58:04.788 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00039269899999999999 2020-11-16T20:58:04.788 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.788 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.788 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.788 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751371+0000", 2020-11-16T20:58:04.788 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7460000000000003e-06 2020-11-16T20:58:04.788 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.789 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.789 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:58:04.789 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751378+0000", 2020-11-16T20:58:04.789 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092297239999999999 2020-11-16T20:58:04.789 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.789 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.789 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.789 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.760607+0000", 2020-11-16T20:58:04.790 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.055107672000000003 2020-11-16T20:58:04.790 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.790 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.790 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:04.790 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.815715+0000", 2020-11-16T20:58:04.790 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.064785488000000002 2020-11-16T20:58:04.790 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.791 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:04.791 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.791 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.791 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.791 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3416 4.3 4:f6d44bd7:::smithi16641208-454:48 [cache-flush] snapc 0=[] ondisk+read+ignore_cache+known_if_redirected e120)", 2020-11-16T20:58:04.791 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:24.751009+0000", 2020-11-16T20:58:04.791 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 39.834979455000003, 2020-11-16T20:58:04.792 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066511669999999995, 2020-11-16T20:58:04.792 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:04.792 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:04.792 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:04.792 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:04.792 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:04.792 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3416 2020-11-16T20:58:04.792 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.793 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:04.793 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.793 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:04.793 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751009+0000", 2020-11-16T20:58:04.793 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:04.793 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.793 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.794 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:04.794 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751009+0000", 2020-11-16T20:58:04.794 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2008999999999999e-05 2020-11-16T20:58:04.794 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.794 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.794 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:04.794 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751031+0000", 2020-11-16T20:58:04.795 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1550000000000004e-06 2020-11-16T20:58:04.795 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.795 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.795 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:04.795 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751038+0000", 2020-11-16T20:58:04.795 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1149999999999996e-06 2020-11-16T20:58:04.795 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.796 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.796 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:04.796 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751045+0000", 2020-11-16T20:58:04.796 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8959999999999996e-06 2020-11-16T20:58:04.796 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.796 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.796 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:04.796 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751049+0000", 2020-11-16T20:58:04.797 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000347373 2020-11-16T20:58:04.797 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.797 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.797 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.797 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751396+0000", 2020-11-16T20:58:04.797 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1729999999999997e-06 2020-11-16T20:58:04.797 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.798 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:58:04.798 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751400+0000", 2020-11-16T20:58:04.798 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094156940000000005 2020-11-16T20:58:04.798 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.798 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.799 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.760816+0000", 2020-11-16T20:58:04.799 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000195842 2020-11-16T20:58:04.799 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.799 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.799 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:04.799 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.761012+0000", 2020-11-16T20:58:04.799 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.056247153000000001 2020-11-16T20:58:04.799 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.800 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.800 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:04.800 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.817259+0000", 2020-11-16T20:58:04.800 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000154034 2020-11-16T20:58:04.800 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.800 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.800 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:04.801 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.817413+0000", 2020-11-16T20:58:04.801 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000108226 2020-11-16T20:58:04.801 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:04.801 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:04.801 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:04.801 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.817521+0000", 2020-11-16T20:58:04.801 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066511669999999995 2020-11-16T20:58:04.801 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.802 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:04.802 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.802 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:04.802 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:04.802 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:04.804 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:58:04.804 INFO:tasks.rados.rados.0.smithi166.stdout:1250: done (3 left) 2020-11-16T20:58:04.804 INFO:tasks.rados.rados.0.smithi166.stdout:1251: done (2 left) 2020-11-16T20:58:04.804 INFO:tasks.rados.rados.0.smithi166.stdout:1252: done (1 left) 2020-11-16T20:58:04.805 INFO:tasks.rados.rados.0.smithi166.stdout:1253: done (0 left) 2020-11-16T20:58:04.805 INFO:tasks.rados.rados.0.smithi166.stdout:1254: snap_remove snap 54 2020-11-16T20:58:04.805 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:04.808+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:04.881 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2020-11-16T20:58:04.928 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:58:04.933+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:58:04.977 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:04.977 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:58:04.977 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:58:04.977 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:04.986 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:58:05.006 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:05.010+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:05.106 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:05.111+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:05.155 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:05.156 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:58:05.156 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:58:05.156 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:58:05.156 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:05.165 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:58:05.208 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:05.213+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:05.293 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:05.293 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:58:05.293 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:58:05.293 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:58:05.294 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.294 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2979 4.0 4:1852173c:::smithi16641208-329:head [write 581674~637746,stat] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:05.294 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:58:05.294 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.493118245999995, 2020-11-16T20:58:05.294 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.009457398, 2020-11-16T20:58:05.294 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:05.294 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:05.295 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:05.295 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:05.295 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:05.295 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2979 2020-11-16T20:58:05.295 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.295 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:05.295 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.296 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:05.296 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:58:05.296 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:05.296 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.296 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.296 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:05.296 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:58:05.296 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030732300000000003 2020-11-16T20:58:05.297 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.297 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.297 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:05.297 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803965+0000", 2020-11-16T20:58:05.297 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0319999999999992e-06 2020-11-16T20:58:05.297 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.297 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.298 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:05.298 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803974+0000", 2020-11-16T20:58:05.298 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5930000000000002e-05 2020-11-16T20:58:05.298 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.298 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.298 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:05.298 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803990+0000", 2020-11-16T20:58:05.299 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1910000000000006e-06 2020-11-16T20:58:05.299 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.299 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.299 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:05.299 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803999+0000", 2020-11-16T20:58:05.299 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5637000000000003e-05 2020-11-16T20:58:05.299 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.300 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.300 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.300 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.804055+0000", 2020-11-16T20:58:05.300 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3769000000000001e-05 2020-11-16T20:58:05.300 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.300 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.300 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:05.300 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.804088+0000", 2020-11-16T20:58:05.301 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.995239140000001 2020-11-16T20:58:05.301 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.301 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.301 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.301 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799328+0000", 2020-11-16T20:58:05.301 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0137818 2020-11-16T20:58:05.301 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.302 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.302 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:05.302 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813109+0000", 2020-11-16T20:58:05.302 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5759999999999996e-06 2020-11-16T20:58:05.302 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.302 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.302 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:05.303 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813115+0000", 2020-11-16T20:58:05.303 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.009457398 2020-11-16T20:58:05.303 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.303 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:05.303 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.303 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.303 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.303 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2980 4.0 4:1852173c:::smithi16641208-329:head [write 1840873~558854] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:05.304 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:58:05.304 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.486852514000006, 2020-11-16T20:58:05.304 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.039347508000001, 2020-11-16T20:58:05.304 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:05.304 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:05.304 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:05.304 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:05.305 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:05.305 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2980 2020-11-16T20:58:05.305 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.305 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:05.305 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.305 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:05.305 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:58:05.306 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:05.306 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.306 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.306 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:05.306 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:58:05.306 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024810899999999999 2020-11-16T20:58:05.306 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.306 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.307 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:05.307 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810171+0000", 2020-11-16T20:58:05.307 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5610000000000001e-06 2020-11-16T20:58:05.307 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.307 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.307 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:05.307 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810179+0000", 2020-11-16T20:58:05.308 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7418000000000002e-05 2020-11-16T20:58:05.308 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.308 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.308 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:05.308 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810196+0000", 2020-11-16T20:58:05.308 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0079999999999996e-06 2020-11-16T20:58:05.308 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.309 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.309 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:05.309 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810203+0000", 2020-11-16T20:58:05.309 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3705000000000002e-05 2020-11-16T20:58:05.309 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.309 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.309 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.309 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810257+0000", 2020-11-16T20:58:05.310 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3656999999999998e-05 2020-11-16T20:58:05.310 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.310 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.310 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:05.310 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810311+0000", 2020-11-16T20:58:05.310 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.989427508 2020-11-16T20:58:05.310 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.311 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.311 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.311 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799738+0000", 2020-11-16T20:58:05.311 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2526000000000003e-05 2020-11-16T20:58:05.311 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.311 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.311 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:05.312 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799811+0000", 2020-11-16T20:58:05.312 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027934184000000001 2020-11-16T20:58:05.312 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.312 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.312 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.312 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827745+0000", 2020-11-16T20:58:05.312 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015776700000000001 2020-11-16T20:58:05.312 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.313 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:05.313 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827903+0000", 2020-11-16T20:58:05.313 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000185539 2020-11-16T20:58:05.313 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.313 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:05.314 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.828088+0000", 2020-11-16T20:58:05.314 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018143857999999999 2020-11-16T20:58:05.314 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.314 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.314 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:05.314 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846232+0000", 2020-11-16T20:58:05.314 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00074682199999999996 2020-11-16T20:58:05.315 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.315 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.315 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:05.315 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846979+0000", 2020-11-16T20:58:05.315 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021617530000000002 2020-11-16T20:58:05.315 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.315 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.315 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:05.316 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849141+0000", 2020-11-16T20:58:05.316 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4513999999999998e-05 2020-11-16T20:58:05.316 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.316 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.316 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:05.316 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849215+0000", 2020-11-16T20:58:05.316 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5578999999999998e-05 2020-11-16T20:58:05.317 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.317 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.317 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:05.317 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849271+0000", 2020-11-16T20:58:05.317 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.039347508000001 2020-11-16T20:58:05.317 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.317 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:05.317 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.318 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.318 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.318 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2981 4.0 4:1852173c:::smithi16641208-329:head [write 3066417~537135] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:05.318 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:58:05.318 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.479936217000002, 2020-11-16T20:58:05.318 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.032910677, 2020-11-16T20:58:05.318 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:05.319 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:05.319 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:05.319 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:05.319 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:05.319 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2981 2020-11-16T20:58:05.319 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.319 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:05.320 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.320 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:05.320 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:58:05.320 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:05.320 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.320 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.320 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:05.320 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:58:05.321 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024974099999999999 2020-11-16T20:58:05.321 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.321 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.321 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:05.321 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817089+0000", 2020-11-16T20:58:05.321 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3829999999999992e-06 2020-11-16T20:58:05.321 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.322 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.322 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:05.322 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817098+0000", 2020-11-16T20:58:05.322 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2118e-05 2020-11-16T20:58:05.322 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.322 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.322 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:05.323 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817110+0000", 2020-11-16T20:58:05.323 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6050000000000004e-06 2020-11-16T20:58:05.323 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.323 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.323 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:05.323 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817119+0000", 2020-11-16T20:58:05.323 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7204000000000003e-05 2020-11-16T20:58:05.324 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.324 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.324 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.324 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817177+0000", 2020-11-16T20:58:05.324 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9932999999999998e-05 2020-11-16T20:58:05.324 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.324 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.324 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:05.325 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817227+0000", 2020-11-16T20:58:05.325 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.98265286 2020-11-16T20:58:05.325 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.325 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.325 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.325 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799879+0000", 2020-11-16T20:58:05.325 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.737e-05 2020-11-16T20:58:05.326 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.326 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.326 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:05.326 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799947+0000", 2020-11-16T20:58:05.326 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029940584999999999 2020-11-16T20:58:05.327 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.327 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.327 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.327 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.829887+0000", 2020-11-16T20:58:05.327 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000217505 2020-11-16T20:58:05.327 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.328 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.328 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:05.328 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.830105+0000", 2020-11-16T20:58:05.328 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029022100000000001 2020-11-16T20:58:05.328 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.328 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.328 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:05.329 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.830395+0000", 2020-11-16T20:58:05.329 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015847953000000001 2020-11-16T20:58:05.329 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.329 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.329 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:05.329 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846243+0000", 2020-11-16T20:58:05.329 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0011558250000000001 2020-11-16T20:58:05.329 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.330 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.330 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:05.330 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847399+0000", 2020-11-16T20:58:05.330 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021524500000000002 2020-11-16T20:58:05.330 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.330 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.330 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:05.331 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849551+0000", 2020-11-16T20:58:05.331 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000138787 2020-11-16T20:58:05.331 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.331 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.331 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:05.331 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849690+0000", 2020-11-16T20:58:05.331 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0136999999999997e-05 2020-11-16T20:58:05.332 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.332 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.332 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:05.332 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849750+0000", 2020-11-16T20:58:05.332 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.032910677 2020-11-16T20:58:05.332 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.332 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:05.333 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.333 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.333 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.333 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2982 4.0 4:1852173c:::smithi16641208-329:head [setxattr _header (58) in=7b,truncate 3781674] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:05.333 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:58:05.333 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.479617902000001, 2020-11-16T20:58:05.333 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.035208633, 2020-11-16T20:58:05.333 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:05.334 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:05.334 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:05.334 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:05.334 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:05.334 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2982 2020-11-16T20:58:05.334 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.334 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:05.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:05.335 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:58:05.335 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:05.335 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:05.336 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:58:05.336 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8856000000000002e-05 2020-11-16T20:58:05.336 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.336 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.336 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:05.336 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817197+0000", 2020-11-16T20:58:05.336 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.93e-06 2020-11-16T20:58:05.336 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.337 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.337 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:05.337 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817203+0000", 2020-11-16T20:58:05.337 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0932e-05 2020-11-16T20:58:05.337 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.337 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.337 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:05.338 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817214+0000", 2020-11-16T20:58:05.338 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3470000000000001e-06 2020-11-16T20:58:05.338 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.338 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.338 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:05.338 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817218+0000", 2020-11-16T20:58:05.338 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4603e-05 2020-11-16T20:58:05.339 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.339 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.339 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.339 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817263+0000", 2020-11-16T20:58:05.339 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6387000000000002e-05 2020-11-16T20:58:05.339 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.339 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.339 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:05.340 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817309+0000", 2020-11-16T20:58:05.340 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.982698653 2020-11-16T20:58:05.340 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.340 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.340 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.340 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800008+0000", 2020-11-16T20:58:05.340 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5400000000000004e-05 2020-11-16T20:58:05.341 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.341 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.341 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:05.341 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800073+0000", 2020-11-16T20:58:05.341 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.044932818999999999 2020-11-16T20:58:05.341 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.341 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.341 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.342 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845006+0000", 2020-11-16T20:58:05.342 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017285099999999999 2020-11-16T20:58:05.342 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.342 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.342 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:05.342 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845179+0000", 2020-11-16T20:58:05.342 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023420900000000001 2020-11-16T20:58:05.343 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.343 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.343 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:05.343 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845413+0000", 2020-11-16T20:58:05.343 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0020276000000000001 2020-11-16T20:58:05.343 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.343 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.344 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:05.344 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847441+0000", 2020-11-16T20:58:05.344 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00050358800000000002 2020-11-16T20:58:05.344 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.344 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.344 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:05.344 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847944+0000", 2020-11-16T20:58:05.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042758900000000001 2020-11-16T20:58:05.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.345 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.345 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:05.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852220+0000", 2020-11-16T20:58:05.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9648999999999997e-05 2020-11-16T20:58:05.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.345 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.346 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:05.346 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852290+0000", 2020-11-16T20:58:05.346 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6919e-05 2020-11-16T20:58:05.346 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.346 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.346 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:05.346 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852367+0000", 2020-11-16T20:58:05.347 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.035208633 2020-11-16T20:58:05.347 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.347 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:05.347 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.347 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.347 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.347 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2983 4.0 4:1852173c:::smithi16641208-329:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e86)", 2020-11-16T20:58:05.348 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:58:05.348 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.479527434999994, 2020-11-16T20:58:05.348 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.037016812999999, 2020-11-16T20:58:05.348 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:05.348 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:05.348 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:05.348 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:05.348 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:05.349 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2983 2020-11-16T20:58:05.349 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.349 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:05.349 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.349 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:05.349 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:58:05.349 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:05.350 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.350 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:05.350 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:58:05.350 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7317999999999999e-05 2020-11-16T20:58:05.350 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.351 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:05.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817266+0000", 2020-11-16T20:58:05.351 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3519999999999998e-06 2020-11-16T20:58:05.351 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.351 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.351 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:05.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817269+0000", 2020-11-16T20:58:05.351 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7859999999999999e-06 2020-11-16T20:58:05.352 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.352 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:05.352 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817276+0000", 2020-11-16T20:58:05.352 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5620000000000002e-06 2020-11-16T20:58:05.352 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.353 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.353 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:05.353 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817278+0000", 2020-11-16T20:58:05.353 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3251999999999996e-05 2020-11-16T20:58:05.353 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.353 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.353 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.354 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817352+0000", 2020-11-16T20:58:05.354 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7966000000000001e-05 2020-11-16T20:58:05.354 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.354 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.354 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:05.354 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817400+0000", 2020-11-16T20:58:05.354 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.982734203 2020-11-16T20:58:05.355 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.355 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.355 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.355 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800134+0000", 2020-11-16T20:58:05.355 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9765999999999997e-05 2020-11-16T20:58:05.355 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.355 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.356 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:05.356 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800194+0000", 2020-11-16T20:58:05.356 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.046087276000000003 2020-11-16T20:58:05.356 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.356 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.356 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.357 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846281+0000", 2020-11-16T20:58:05.357 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000115396 2020-11-16T20:58:05.357 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.357 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.357 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:05.357 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846396+0000", 2020-11-16T20:58:05.357 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006004573 2020-11-16T20:58:05.357 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.358 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.358 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.358 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852401+0000", 2020-11-16T20:58:05.358 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013211599999999999 2020-11-16T20:58:05.358 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.358 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.359 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:05.359 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852533+0000", 2020-11-16T20:58:05.359 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0017322469999999999 2020-11-16T20:58:05.359 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.359 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.359 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:05.359 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.854265+0000", 2020-11-16T20:58:05.359 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.037016812999999 2020-11-16T20:58:05.360 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.360 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:05.360 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.360 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.360 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.360 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2984 4.0 4:033219d6:::smithi16641208-386:head [write 598481~712995,stat] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:05.360 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:58:05.361 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.472467593000005, 2020-11-16T20:58:05.361 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.003104742, 2020-11-16T20:58:05.361 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:05.361 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:05.361 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:05.361 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:05.361 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:05.362 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2984 2020-11-16T20:58:05.362 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.362 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:05.362 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.362 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:05.362 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:58:05.362 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:05.363 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.363 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.363 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:05.363 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:58:05.363 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00037173000000000002 2020-11-16T20:58:05.363 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.363 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.363 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:05.364 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824680+0000", 2020-11-16T20:58:05.364 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.146e-05 2020-11-16T20:58:05.364 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.364 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.364 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:05.364 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824691+0000", 2020-11-16T20:58:05.364 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6951000000000001e-05 2020-11-16T20:58:05.365 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.365 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.365 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:05.365 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824708+0000", 2020-11-16T20:58:05.365 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2082000000000001e-05 2020-11-16T20:58:05.365 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.365 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.365 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:05.366 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824720+0000", 2020-11-16T20:58:05.366 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0284000000000002e-05 2020-11-16T20:58:05.366 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.366 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.366 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.366 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824771+0000", 2020-11-16T20:58:05.366 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1241000000000001e-05 2020-11-16T20:58:05.367 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.367 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.367 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:05.367 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824802+0000", 2020-11-16T20:58:05.367 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.975455838 2020-11-16T20:58:05.367 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.367 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.367 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.368 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800258+0000", 2020-11-16T20:58:05.368 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027151194999999999 2020-11-16T20:58:05.368 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.368 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.368 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:05.368 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827409+0000", 2020-11-16T20:58:05.368 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9609999999999999e-06 2020-11-16T20:58:05.369 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.369 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.369 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:05.369 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827413+0000", 2020-11-16T20:58:05.369 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.003104742 2020-11-16T20:58:05.369 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.369 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:05.369 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.370 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.370 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.370 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2985 4.0 4:033219d6:::smithi16641208-386:head [write 1899355~418865] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:05.370 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:58:05.370 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.466856311000001, 2020-11-16T20:58:05.370 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.021091737000001, 2020-11-16T20:58:05.370 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:05.371 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:05.371 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:05.371 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:05.371 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:05.371 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2985 2020-11-16T20:58:05.371 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.371 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:05.372 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.372 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:05.372 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:58:05.372 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:05.372 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.372 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.372 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:05.373 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:58:05.373 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023221799999999999 2020-11-16T20:58:05.373 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.373 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.373 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:05.373 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830152+0000", 2020-11-16T20:58:05.373 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9769999999999995e-06 2020-11-16T20:58:05.373 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.374 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.374 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:05.374 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830162+0000", 2020-11-16T20:58:05.374 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5545000000000001e-05 2020-11-16T20:58:05.374 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.374 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.374 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:05.375 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830177+0000", 2020-11-16T20:58:05.375 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0334e-05 2020-11-16T20:58:05.375 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.375 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.375 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:05.375 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830188+0000", 2020-11-16T20:58:05.375 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3430999999999996e-05 2020-11-16T20:58:05.376 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.376 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.376 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.376 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830251+0000", 2020-11-16T20:58:05.376 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2651999999999997e-05 2020-11-16T20:58:05.376 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.376 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.376 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:05.377 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830304+0000", 2020-11-16T20:58:05.377 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.970289857999999 2020-11-16T20:58:05.377 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.377 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.377 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.377 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800594+0000", 2020-11-16T20:58:05.377 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8948999999999993e-05 2020-11-16T20:58:05.378 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.378 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.378 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:05.378 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800663+0000", 2020-11-16T20:58:05.378 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036018513000000002 2020-11-16T20:58:05.378 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.378 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.378 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.379 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836681+0000", 2020-11-16T20:58:05.379 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013201099999999999 2020-11-16T20:58:05.379 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.379 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.379 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:05.379 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836813+0000", 2020-11-16T20:58:05.379 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000126635 2020-11-16T20:58:05.380 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.380 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.380 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:05.380 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836940+0000", 2020-11-16T20:58:05.380 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010477907 2020-11-16T20:58:05.380 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.380 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.380 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:05.381 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847418+0000", 2020-11-16T20:58:05.381 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000158796 2020-11-16T20:58:05.381 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.381 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.381 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:05.381 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847576+0000", 2020-11-16T20:58:05.381 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033023729999999999 2020-11-16T20:58:05.382 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.382 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:05.382 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850879+0000", 2020-11-16T20:58:05.382 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6360999999999996e-05 2020-11-16T20:58:05.382 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.383 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:05.383 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850955+0000", 2020-11-16T20:58:05.383 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6177000000000001e-05 2020-11-16T20:58:05.383 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.383 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.383 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:05.383 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851011+0000", 2020-11-16T20:58:05.383 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.021091737000001 2020-11-16T20:58:05.384 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.384 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:05.384 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.384 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2986 4.0 4:033219d6:::smithi16641208-386:head [write 3093840~704641] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:05.384 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:58:05.385 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.458630608999997, 2020-11-16T20:58:05.385 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013155362999999, 2020-11-16T20:58:05.385 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:05.385 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:05.385 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:05.385 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:05.385 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:05.385 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2986 2020-11-16T20:58:05.386 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.386 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:05.386 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.386 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:05.386 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:58:05.386 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:05.386 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.387 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.387 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:05.387 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:58:05.387 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00038247200000000002 2020-11-16T20:58:05.387 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.387 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.387 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:05.387 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838528+0000", 2020-11-16T20:58:05.388 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3299999999999999e-06 2020-11-16T20:58:05.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.388 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.388 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:05.388 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838536+0000", 2020-11-16T20:58:05.388 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3438000000000001e-05 2020-11-16T20:58:05.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.389 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:05.389 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838549+0000", 2020-11-16T20:58:05.389 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0213e-05 2020-11-16T20:58:05.389 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.389 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:05.389 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838560+0000", 2020-11-16T20:58:05.390 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1894999999999997e-05 2020-11-16T20:58:05.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.390 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.390 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.390 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838612+0000", 2020-11-16T20:58:05.390 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8209e-05 2020-11-16T20:58:05.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.391 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:05.391 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838650+0000", 2020-11-16T20:58:05.391 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962061715000001 2020-11-16T20:58:05.391 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.391 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.392 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800712+0000", 2020-11-16T20:58:05.392 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6964e-05 2020-11-16T20:58:05.392 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.392 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.392 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:05.392 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800748+0000", 2020-11-16T20:58:05.392 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037209265999999998 2020-11-16T20:58:05.392 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.393 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.393 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.393 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.837958+0000", 2020-11-16T20:58:05.393 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000160304 2020-11-16T20:58:05.393 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.393 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.393 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:05.394 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.838118+0000", 2020-11-16T20:58:05.394 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022362799999999999 2020-11-16T20:58:05.394 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.394 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.394 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:05.394 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.838342+0000", 2020-11-16T20:58:05.394 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0090844710000000002 2020-11-16T20:58:05.394 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.395 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.395 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:05.395 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847426+0000", 2020-11-16T20:58:05.395 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000219199 2020-11-16T20:58:05.395 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.395 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.396 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:05.396 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847645+0000", 2020-11-16T20:58:05.396 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003411603 2020-11-16T20:58:05.396 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.396 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.396 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:05.396 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851057+0000", 2020-11-16T20:58:05.397 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014736799999999999 2020-11-16T20:58:05.397 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.397 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.397 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:05.397 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851204+0000", 2020-11-16T20:58:05.397 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6287999999999997e-05 2020-11-16T20:58:05.397 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.397 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.398 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:05.398 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851301+0000", 2020-11-16T20:58:05.398 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013155362999999 2020-11-16T20:58:05.398 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.398 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:05.398 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.398 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.399 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.399 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2987 4.0 4:033219d6:::smithi16641208-386:head [setxattr _header (58) in=7b,truncate 3798481] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:05.399 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:58:05.399 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.458171969999995, 2020-11-16T20:58:05.399 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.012971041, 2020-11-16T20:58:05.399 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:05.399 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:05.400 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:05.400 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:05.400 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:05.400 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2987 2020-11-16T20:58:05.400 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.400 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:05.400 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.401 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:05.401 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:58:05.401 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:05.401 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.401 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.401 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:05.401 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:58:05.401 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4530000000000002e-05 2020-11-16T20:58:05.402 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.402 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.402 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:05.402 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838648+0000", 2020-11-16T20:58:05.402 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8390000000000001e-06 2020-11-16T20:58:05.402 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.402 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.403 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:05.403 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838655+0000", 2020-11-16T20:58:05.403 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0341e-05 2020-11-16T20:58:05.403 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.403 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.403 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:05.403 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838666+0000", 2020-11-16T20:58:05.403 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0929999999999999e-06 2020-11-16T20:58:05.404 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.404 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.404 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:05.404 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838672+0000", 2020-11-16T20:58:05.404 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8074999999999997e-05 2020-11-16T20:58:05.404 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.404 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.405 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.405 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838710+0000", 2020-11-16T20:58:05.405 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1121000000000002e-05 2020-11-16T20:58:05.405 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.405 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.405 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:05.405 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838751+0000", 2020-11-16T20:58:05.405 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962044797000001 2020-11-16T20:58:05.406 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.406 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.406 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.406 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800796+0000", 2020-11-16T20:58:05.406 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6808999999999998e-05 2020-11-16T20:58:05.406 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.406 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.407 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:05.407 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800852+0000", 2020-11-16T20:58:05.407 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042964599999999999 2020-11-16T20:58:05.407 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.407 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.407 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.407 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843817+0000", 2020-11-16T20:58:05.408 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017807899999999999 2020-11-16T20:58:05.408 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.408 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.408 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:05.408 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843995+0000", 2020-11-16T20:58:05.408 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023680500000000001 2020-11-16T20:58:05.408 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.408 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.409 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:05.409 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844232+0000", 2020-11-16T20:58:05.409 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00320163 2020-11-16T20:58:05.409 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.409 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.409 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:05.409 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847434+0000", 2020-11-16T20:58:05.410 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00042527899999999998 2020-11-16T20:58:05.410 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.410 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.410 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:05.410 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847859+0000", 2020-11-16T20:58:05.410 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0034987920000000001 2020-11-16T20:58:05.410 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.410 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.411 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:05.411 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851358+0000", 2020-11-16T20:58:05.411 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014067300000000001 2020-11-16T20:58:05.411 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.411 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.411 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:05.411 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851498+0000", 2020-11-16T20:58:05.412 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6577999999999998e-05 2020-11-16T20:58:05.412 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.412 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.412 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:05.412 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851575+0000", 2020-11-16T20:58:05.412 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.012971041 2020-11-16T20:58:05.412 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.412 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:05.413 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.413 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.413 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.413 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2988 4.0 4:033219d6:::smithi16641208-386:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e86)", 2020-11-16T20:58:05.413 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:58:05.413 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.458069471000002, 2020-11-16T20:58:05.413 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013229791000001, 2020-11-16T20:58:05.414 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:05.414 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:05.414 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:05.414 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:05.414 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:05.414 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2988 2020-11-16T20:58:05.414 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.415 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:05.415 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.415 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:05.415 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:58:05.415 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:05.415 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.415 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.415 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:05.416 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:58:05.416 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9252999999999999e-05 2020-11-16T20:58:05.416 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.416 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.416 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:05.416 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838736+0000", 2020-11-16T20:58:05.416 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3980000000000004e-06 2020-11-16T20:58:05.417 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.417 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.417 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:05.417 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838742+0000", 2020-11-16T20:58:05.417 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1144999999999999e-05 2020-11-16T20:58:05.417 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.417 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.417 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:05.418 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838753+0000", 2020-11-16T20:58:05.418 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6229999999999996e-06 2020-11-16T20:58:05.418 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.418 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.418 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:05.418 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838758+0000", 2020-11-16T20:58:05.418 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5130000000000003e-05 2020-11-16T20:58:05.419 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.419 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.419 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.419 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838803+0000", 2020-11-16T20:58:05.419 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0132000000000001e-05 2020-11-16T20:58:05.419 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.419 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.419 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:05.420 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838843+0000", 2020-11-16T20:58:05.420 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962066786999999 2020-11-16T20:58:05.420 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.420 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.420 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.420 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800910+0000", 2020-11-16T20:58:05.420 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6925999999999997e-05 2020-11-16T20:58:05.421 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.421 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.421 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:05.421 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800967+0000", 2020-11-16T20:58:05.421 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.043837752000000001 2020-11-16T20:58:05.421 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.421 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.422 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.422 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844805+0000", 2020-11-16T20:58:05.422 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012337000000000001 2020-11-16T20:58:05.422 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.422 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.422 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:05.422 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844928+0000", 2020-11-16T20:58:05.422 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0066885149999999999 2020-11-16T20:58:05.423 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.423 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.423 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.423 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851616+0000", 2020-11-16T20:58:05.423 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5716000000000005e-05 2020-11-16T20:58:05.423 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.423 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.424 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:05.424 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851692+0000", 2020-11-16T20:58:05.424 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024404400000000001 2020-11-16T20:58:05.424 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.424 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.424 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:05.424 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851936+0000", 2020-11-16T20:58:05.425 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013229791000001 2020-11-16T20:58:05.425 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.425 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:05.425 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.425 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.425 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.425 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2992 4.0 4:0f4a2e46:::smithi16641208-399:head [cache-evict] snapc 0=[] ondisk+read+ignore_cache+known_if_redirected e86)", 2020-11-16T20:58:05.425 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:58:05.426 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.457983134000003, 2020-11-16T20:58:05.426 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962433468, 2020-11-16T20:58:05.426 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:05.426 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:05.426 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:05.426 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:05.426 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:05.427 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2992 2020-11-16T20:58:05.427 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.427 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:05.427 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.427 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:05.427 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:58:05.427 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:05.427 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.428 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.428 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:05.428 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:58:05.428 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7780000000000002e-05 2020-11-16T20:58:05.428 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.428 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.428 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:05.429 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838820+0000", 2020-11-16T20:58:05.429 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1200000000000001e-06 2020-11-16T20:58:05.429 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.429 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.429 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:05.429 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838826+0000", 2020-11-16T20:58:05.429 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0008e-05 2020-11-16T20:58:05.429 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.430 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.430 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:05.430 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838836+0000", 2020-11-16T20:58:05.430 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3749999999999996e-06 2020-11-16T20:58:05.430 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.430 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.430 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:05.431 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838840+0000", 2020-11-16T20:58:05.431 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0889000000000002e-05 2020-11-16T20:58:05.431 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.431 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.431 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.431 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838871+0000", 2020-11-16T20:58:05.431 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6891000000000003e-05 2020-11-16T20:58:05.432 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.432 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.432 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:05.432 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838908+0000", 2020-11-16T20:58:05.432 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962115045999999 2020-11-16T20:58:05.432 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.432 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.432 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.433 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801023+0000", 2020-11-16T20:58:05.433 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020335899999999999 2020-11-16T20:58:05.433 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.433 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.433 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:05.433 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801226+0000", 2020-11-16T20:58:05.433 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962433468 2020-11-16T20:58:05.434 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.434 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:05.434 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.434 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.434 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.434 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3051 4.0 4:2ceac9f9:::smithi16641208-61:head [write 699323~480842] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:58:05.434 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:58:05.435 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 71.455862827000004, 2020-11-16T20:58:05.435 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9728349610000002, 2020-11-16T20:58:05.435 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:05.435 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:05.435 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:05.435 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:05.435 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:05.435 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3051 2020-11-16T20:58:05.436 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.436 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:05.436 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.436 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:05.436 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:58:05.436 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:05.436 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.437 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.437 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:05.437 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:58:05.437 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032526199999999999 2020-11-16T20:58:05.437 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.437 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.437 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:05.438 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841238+0000", 2020-11-16T20:58:05.438 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9822000000000001e-05 2020-11-16T20:58:05.438 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.438 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.438 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:05.438 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841258+0000", 2020-11-16T20:58:05.438 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.507e-05 2020-11-16T20:58:05.438 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.439 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.439 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:05.439 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841273+0000", 2020-11-16T20:58:05.439 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8900000000000007e-06 2020-11-16T20:58:05.439 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.439 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.439 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:05.440 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841281+0000", 2020-11-16T20:58:05.440 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4356000000000003e-05 2020-11-16T20:58:05.440 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.440 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.440 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.440 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841365+0000", 2020-11-16T20:58:05.440 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0232000000000002e-05 2020-11-16T20:58:05.440 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.441 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.441 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:05.441 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841426+0000", 2020-11-16T20:58:05.441 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9604309439999996 2020-11-16T20:58:05.441 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.441 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.441 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.442 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801857+0000", 2020-11-16T20:58:05.442 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000164897 2020-11-16T20:58:05.442 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.442 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.442 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:05.442 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.802021+0000", 2020-11-16T20:58:05.442 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020576500000000001 2020-11-16T20:58:05.442 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.443 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.443 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:05.443 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.802227+0000", 2020-11-16T20:58:05.443 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0066237170000000003 2020-11-16T20:58:05.443 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.443 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.443 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:05.444 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808851+0000", 2020-11-16T20:58:05.444 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037712430000000001 2020-11-16T20:58:05.444 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.444 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.444 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:05.444 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812622+0000", 2020-11-16T20:58:05.444 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00099110800000000009 2020-11-16T20:58:05.444 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.445 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.445 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:05.445 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813613+0000", 2020-11-16T20:58:05.445 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1646e-05 2020-11-16T20:58:05.445 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.445 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.445 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:05.446 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813665+0000", 2020-11-16T20:58:05.446 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3009000000000004e-05 2020-11-16T20:58:05.446 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.446 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.446 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:05.446 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813748+0000", 2020-11-16T20:58:05.446 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9728349610000002 2020-11-16T20:58:05.446 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.447 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:05.447 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.447 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.447 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.447 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3052 4.0 4:2ceac9f9:::smithi16641208-61:head [write 1850247~429872] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:58:05.447 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:58:05.447 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 71.447671787999994, 2020-11-16T20:58:05.448 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9911138360000002, 2020-11-16T20:58:05.448 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:05.448 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:05.448 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:05.448 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:05.448 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:05.448 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3052 2020-11-16T20:58:05.449 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.449 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:05.449 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.449 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:05.449 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:58:05.449 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:05.449 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.449 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.450 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:05.450 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:58:05.450 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000296166 2020-11-16T20:58:05.450 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.450 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.450 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:05.450 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849400+0000", 2020-11-16T20:58:05.451 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0699999999999996e-06 2020-11-16T20:58:05.451 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.451 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.451 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:05.451 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849409+0000", 2020-11-16T20:58:05.451 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3725e-05 2020-11-16T20:58:05.451 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.452 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.452 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:05.452 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849423+0000", 2020-11-16T20:58:05.452 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9929999999999998e-06 2020-11-16T20:58:05.452 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.452 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.452 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:05.452 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849430+0000", 2020-11-16T20:58:05.453 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9708000000000002e-05 2020-11-16T20:58:05.453 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.453 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.453 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.453 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849520+0000", 2020-11-16T20:58:05.453 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2088000000000002e-05 2020-11-16T20:58:05.453 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.454 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.454 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:05.454 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849552+0000", 2020-11-16T20:58:05.454 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.954526692 2020-11-16T20:58:05.454 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.455 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.455 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.455 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804079+0000", 2020-11-16T20:58:05.455 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015456899999999999 2020-11-16T20:58:05.455 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.455 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.455 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:05.456 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804233+0000", 2020-11-16T20:58:05.456 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019627800000000001 2020-11-16T20:58:05.456 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.456 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.456 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:05.456 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804429+0000", 2020-11-16T20:58:05.457 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006762316 2020-11-16T20:58:05.457 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.457 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.457 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:05.457 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811192+0000", 2020-11-16T20:58:05.457 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002630467 2020-11-16T20:58:05.457 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.458 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.458 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:05.458 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813822+0000", 2020-11-16T20:58:05.458 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026302065999999999 2020-11-16T20:58:05.458 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.458 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.459 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:05.459 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840124+0000", 2020-11-16T20:58:05.459 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.274e-05 2020-11-16T20:58:05.459 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.459 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.459 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:05.459 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840177+0000", 2020-11-16T20:58:05.460 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0958000000000003e-05 2020-11-16T20:58:05.460 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.460 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.460 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:05.460 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840218+0000", 2020-11-16T20:58:05.460 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9911138360000002 2020-11-16T20:58:05.460 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.460 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:05.461 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.461 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.461 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.461 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3053 4.0 4:2ceac9f9:::smithi16641208-61:head [write 2858378~532392] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:58:05.461 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:58:05.461 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 71.439214457000006, 2020-11-16T20:58:05.461 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9828430529999999, 2020-11-16T20:58:05.462 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:05.462 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:05.462 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:05.462 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:05.462 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:05.462 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3053 2020-11-16T20:58:05.462 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.463 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:05.463 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.463 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:05.463 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:58:05.463 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:05.463 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.463 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.463 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:05.464 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:58:05.464 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000647082 2020-11-16T20:58:05.464 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.464 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.464 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:05.464 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858208+0000", 2020-11-16T20:58:05.464 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.269e-05 2020-11-16T20:58:05.465 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.465 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.465 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:05.465 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858221+0000", 2020-11-16T20:58:05.465 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0361e-05 2020-11-16T20:58:05.465 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.465 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.465 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:05.466 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858242+0000", 2020-11-16T20:58:05.466 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1184e-05 2020-11-16T20:58:05.466 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.466 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.466 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:05.466 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858253+0000", 2020-11-16T20:58:05.466 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7032000000000004e-05 2020-11-16T20:58:05.467 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.467 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.467 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.467 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858330+0000", 2020-11-16T20:58:05.467 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4135999999999998e-05 2020-11-16T20:58:05.467 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.467 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.468 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:05.468 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858384+0000", 2020-11-16T20:58:05.468 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9487614310000003 2020-11-16T20:58:05.468 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.468 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.468 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.468 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807145+0000", 2020-11-16T20:58:05.468 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9426000000000007e-05 2020-11-16T20:58:05.469 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.469 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.469 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:05.469 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807245+0000", 2020-11-16T20:58:05.469 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018410799999999999 2020-11-16T20:58:05.469 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.469 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.470 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:05.470 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807429+0000", 2020-11-16T20:58:05.470 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0064067339999999999 2020-11-16T20:58:05.470 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.470 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.470 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:05.470 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813836+0000", 2020-11-16T20:58:05.470 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001513267 2020-11-16T20:58:05.471 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.471 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.471 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:05.471 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815349+0000", 2020-11-16T20:58:05.471 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024962895999999998 2020-11-16T20:58:05.471 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.471 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.472 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:05.472 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840312+0000", 2020-11-16T20:58:05.472 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7781999999999997e-05 2020-11-16T20:58:05.472 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.472 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.472 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:05.472 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840370+0000", 2020-11-16T20:58:05.473 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4924e-05 2020-11-16T20:58:05.473 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.473 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.473 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:05.474 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840404+0000", 2020-11-16T20:58:05.474 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9828430529999999 2020-11-16T20:58:05.474 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.474 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:05.474 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.474 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.475 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.475 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3054 4.0 4:2ceac9f9:::smithi16641208-61:head [setxattr _header (57) in=7b,truncate 3899323] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:58:05.475 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:58:05.475 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 71.438461950000004, 2020-11-16T20:58:05.475 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9822430049999999, 2020-11-16T20:58:05.475 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:05.475 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:05.476 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:05.476 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:05.476 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:05.476 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3054 2020-11-16T20:58:05.476 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.476 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:05.476 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.477 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:05.477 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:58:05.477 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:05.477 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.477 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.477 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:05.477 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:58:05.478 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8208999999999999e-05 2020-11-16T20:58:05.478 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.478 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.478 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:05.478 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858362+0000", 2020-11-16T20:58:05.478 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5539999999999998e-06 2020-11-16T20:58:05.478 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.479 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.479 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:05.479 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858371+0000", 2020-11-16T20:58:05.479 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.005e-05 2020-11-16T20:58:05.479 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.479 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.479 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:05.479 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858381+0000", 2020-11-16T20:58:05.480 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8099999999999997e-06 2020-11-16T20:58:05.480 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.480 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.480 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:05.480 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858386+0000", 2020-11-16T20:58:05.480 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6168000000000005e-05 2020-11-16T20:58:05.480 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.481 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.481 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.481 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858482+0000", 2020-11-16T20:58:05.481 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7954999999999999e-05 2020-11-16T20:58:05.481 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.481 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.481 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:05.482 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858510+0000", 2020-11-16T20:58:05.482 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9498925639999998 2020-11-16T20:58:05.482 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.482 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.482 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.482 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808402+0000", 2020-11-16T20:58:05.482 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3084000000000005e-05 2020-11-16T20:58:05.483 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.483 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.483 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:05.483 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808495+0000", 2020-11-16T20:58:05.483 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114826 2020-11-16T20:58:05.483 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.483 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.483 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:05.484 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808610+0000", 2020-11-16T20:58:05.484 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052363219999999999 2020-11-16T20:58:05.484 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.484 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.484 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:05.484 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813846+0000", 2020-11-16T20:58:05.484 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0015700709999999999 2020-11-16T20:58:05.485 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.485 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.485 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:05.485 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815417+0000", 2020-11-16T20:58:05.485 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025048682999999999 2020-11-16T20:58:05.485 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.485 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.485 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:05.486 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840465+0000", 2020-11-16T20:58:05.486 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5473000000000003e-05 2020-11-16T20:58:05.486 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.486 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.486 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:05.486 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840511+0000", 2020-11-16T20:58:05.486 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6236000000000003e-05 2020-11-16T20:58:05.487 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.487 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.487 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:05.487 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840557+0000", 2020-11-16T20:58:05.487 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9822430049999999 2020-11-16T20:58:05.487 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.487 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:05.488 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.488 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.488 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.488 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3055 4.0 4:2ceac9f9:::smithi16641208-61:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e91)", 2020-11-16T20:58:05.488 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:58:05.488 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 71.438286754000003, 2020-11-16T20:58:05.488 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9852841799999998, 2020-11-16T20:58:05.488 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:05.489 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:05.489 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:05.489 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:05.489 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:05.489 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3055 2020-11-16T20:58:05.489 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.489 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:05.490 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.490 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:05.490 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:58:05.490 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:05.490 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.490 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.490 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:05.491 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:58:05.491 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4403000000000002e-05 2020-11-16T20:58:05.491 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.491 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.491 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:05.491 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858523+0000", 2020-11-16T20:58:05.491 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4670000000000001e-06 2020-11-16T20:58:05.491 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.492 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.492 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:05.492 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858530+0000", 2020-11-16T20:58:05.492 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2469999999999999e-05 2020-11-16T20:58:05.492 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.492 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.492 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:05.493 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858542+0000", 2020-11-16T20:58:05.493 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2449999999999998e-06 2020-11-16T20:58:05.493 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.493 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.493 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:05.493 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858548+0000", 2020-11-16T20:58:05.493 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9604000000000002e-05 2020-11-16T20:58:05.493 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.494 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.494 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.494 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858587+0000", 2020-11-16T20:58:05.494 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4863000000000001e-05 2020-11-16T20:58:05.494 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.494 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.494 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:05.495 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858632+0000", 2020-11-16T20:58:05.495 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9521692039999996 2020-11-16T20:58:05.495 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.495 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.495 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.495 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.810801+0000", 2020-11-16T20:58:05.495 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014886700000000001 2020-11-16T20:58:05.496 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.496 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.496 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:05.496 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.810950+0000", 2020-11-16T20:58:05.496 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029669781999999999 2020-11-16T20:58:05.496 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.496 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.496 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.497 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840620+0000", 2020-11-16T20:58:05.497 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010005699999999999 2020-11-16T20:58:05.497 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.497 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.497 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:05.497 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840720+0000", 2020-11-16T20:58:05.497 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030532179999999999 2020-11-16T20:58:05.498 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.498 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.498 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:05.498 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843773+0000", 2020-11-16T20:58:05.498 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9852841799999998 2020-11-16T20:58:05.498 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.498 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:05.498 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.499 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.499 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.499 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3065 4.0 4:2f657946:::smithi16641208-73:head [read 0~3210104,checksum] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:58:05.499 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:58:05.499 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 71.330011730999999, 2020-11-16T20:58:05.499 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8738324339999997, 2020-11-16T20:58:05.499 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:05.500 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:05.500 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:05.500 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:05.500 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:05.500 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3065 2020-11-16T20:58:05.500 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.500 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:05.500 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.501 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:05.501 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:58:05.501 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:05.501 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.501 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.501 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:05.501 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:58:05.502 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3065999999999999e-05 2020-11-16T20:58:05.502 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.502 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.502 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:05.502 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966787+0000", 2020-11-16T20:58:05.502 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8329999999999998e-06 2020-11-16T20:58:05.502 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.503 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.503 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:05.503 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966790+0000", 2020-11-16T20:58:05.503 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1780000000000002e-06 2020-11-16T20:58:05.503 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.503 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.503 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:05.503 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966795+0000", 2020-11-16T20:58:05.504 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3460000000000001e-06 2020-11-16T20:58:05.504 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.504 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.504 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:05.504 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966798+0000", 2020-11-16T20:58:05.504 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6675000000000003e-05 2020-11-16T20:58:05.504 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.505 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.505 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.505 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966844+0000", 2020-11-16T20:58:05.505 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5497999999999999e-05 2020-11-16T20:58:05.505 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.505 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.505 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:05.506 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966870+0000", 2020-11-16T20:58:05.506 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8445859479999998 2020-11-16T20:58:05.506 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.506 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.506 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.506 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811456+0000", 2020-11-16T20:58:05.506 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029140889999999999 2020-11-16T20:58:05.506 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.507 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.507 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:05.507 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840597+0000", 2020-11-16T20:58:05.507 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8738324339999997 2020-11-16T20:58:05.511 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.512 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:05.512 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.512 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.512 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.512 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3066 4.0 4:356864c0:::smithi16641208-150:head [read 0~2504243,checksum,omap-get-vals-by-keys,omap-get-keys,omap-get-vals,omap-get-header,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:58:05.512 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:58:05.512 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 71.329960506000006, 2020-11-16T20:58:05.513 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8778990499999999, 2020-11-16T20:58:05.513 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:05.513 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:05.513 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:05.513 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:05.513 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:05.513 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3066 2020-11-16T20:58:05.514 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.514 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:05.514 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.514 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:05.514 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:58:05.514 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:05.514 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.515 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.515 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:05.515 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:58:05.515 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1704000000000001e-05 2020-11-16T20:58:05.515 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.515 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.515 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:05.515 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966837+0000", 2020-11-16T20:58:05.516 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6850000000000001e-06 2020-11-16T20:58:05.516 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.516 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.516 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:05.516 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966840+0000", 2020-11-16T20:58:05.516 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7479999999999999e-06 2020-11-16T20:58:05.516 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.517 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.517 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:05.517 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966845+0000", 2020-11-16T20:58:05.517 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5059999999999998e-06 2020-11-16T20:58:05.517 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.517 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.517 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:05.518 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966848+0000", 2020-11-16T20:58:05.518 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4314000000000002e-05 2020-11-16T20:58:05.518 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.518 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.518 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.518 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966902+0000", 2020-11-16T20:58:05.518 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.561e-05 2020-11-16T20:58:05.518 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.519 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.519 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:05.519 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:58:05.519 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8448102110000004 2020-11-16T20:58:05.519 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.519 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.519 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.520 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811738+0000", 2020-11-16T20:58:05.520 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032976272000000001 2020-11-16T20:58:05.520 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.520 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.520 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:05.520 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844714+0000", 2020-11-16T20:58:05.520 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8778990499999999 2020-11-16T20:58:05.520 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.521 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:05.521 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.521 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.521 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.521 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3067 4.0 4:356864c0:::smithi16641208-150:head [sparse-read 0~2504243] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:58:05.521 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:58:05.521 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 71.329909048999994, 2020-11-16T20:58:05.522 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8780898150000001, 2020-11-16T20:58:05.522 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:05.522 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:05.522 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:05.522 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:05.522 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:05.522 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3067 2020-11-16T20:58:05.523 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.523 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:05.523 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.523 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:05.523 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:58:05.523 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:05.523 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.523 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.524 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:05.524 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:58:05.524 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2826e-05 2020-11-16T20:58:05.524 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.524 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.524 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:05.524 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966900+0000", 2020-11-16T20:58:05.525 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.694e-06 2020-11-16T20:58:05.525 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.525 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.525 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:05.525 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966902+0000", 2020-11-16T20:58:05.525 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0889999999999999e-06 2020-11-16T20:58:05.525 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.525 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.526 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:05.526 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966907+0000", 2020-11-16T20:58:05.526 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3910000000000001e-06 2020-11-16T20:58:05.526 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.526 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.526 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:05.526 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966910+0000", 2020-11-16T20:58:05.527 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2771000000000002e-05 2020-11-16T20:58:05.527 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.527 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.527 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.527 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966943+0000", 2020-11-16T20:58:05.527 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5301000000000001e-05 2020-11-16T20:58:05.527 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.528 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.528 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:05.528 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966968+0000", 2020-11-16T20:58:05.528 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.845055017 2020-11-16T20:58:05.528 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.528 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.528 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.528 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812023+0000", 2020-11-16T20:58:05.529 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032933726000000003 2020-11-16T20:58:05.529 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.529 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.529 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:05.529 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844957+0000", 2020-11-16T20:58:05.529 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8780898150000001 2020-11-16T20:58:05.529 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.530 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:05.530 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.530 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.530 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.530 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3068 4.0 4:356864c0:::smithi16641208-150:head [read 0~2504243,checksum] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:58:05.530 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:58:05.530 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 71.329847710999999, 2020-11-16T20:58:05.530 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8828719500000002, 2020-11-16T20:58:05.531 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:05.531 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:05.531 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:05.531 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:05.531 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:05.531 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3068 2020-11-16T20:58:05.531 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.532 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:05.532 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.532 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:05.532 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:58:05.532 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:05.532 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.532 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.532 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:05.533 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:58:05.533 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0942999999999999e-05 2020-11-16T20:58:05.533 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.533 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.533 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:05.533 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966949+0000", 2020-11-16T20:58:05.533 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.712e-06 2020-11-16T20:58:05.534 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.534 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.534 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:05.534 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966952+0000", 2020-11-16T20:58:05.534 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8479999999999997e-06 2020-11-16T20:58:05.534 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.534 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.535 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:05.535 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966958+0000", 2020-11-16T20:58:05.535 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9170000000000002e-06 2020-11-16T20:58:05.535 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.535 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.535 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:05.535 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966961+0000", 2020-11-16T20:58:05.536 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4105999999999999e-05 2020-11-16T20:58:05.536 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.536 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.536 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.536 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966985+0000", 2020-11-16T20:58:05.536 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2056e-05 2020-11-16T20:58:05.536 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.536 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.537 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:05.537 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.967007+0000", 2020-11-16T20:58:05.537 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8456606430000004 2020-11-16T20:58:05.537 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.537 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.537 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:05.537 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812667+0000", 2020-11-16T20:58:05.538 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037132724999999998 2020-11-16T20:58:05.538 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:05.538 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:05.538 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:05.538 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849800+0000", 2020-11-16T20:58:05.538 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8828719500000002 2020-11-16T20:58:05.538 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.538 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:05.539 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.539 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:05.539 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:05.539 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:05.540 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:58:05.541 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:58:05.545+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:58:05.640 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:58:05.645+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:58:05.712 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:05.712 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:58:05.712 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:58:05.712 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:05.721 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:58:05.762 INFO:tasks.rados.rados.0.smithi166.stdout:1254: done (0 left) 2020-11-16T20:58:05.762 INFO:tasks.rados.rados.0.smithi166.stdout:1255: cache_flush oid 194 snap -1 2020-11-16T20:58:05.762 INFO:tasks.rados.rados.0.smithi166.stdout:1256: copy_from oid 451 from oid 464 current snap is 55 2020-11-16T20:58:05.762 INFO:tasks.rados.rados.0.smithi166.stdout:1257: rollback oid 437 current snap is 55 2020-11-16T20:58:05.762 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 437 to 48 2020-11-16T20:58:05.763 INFO:tasks.rados.rados.0.smithi166.stdout:1258: cache_try_flush oid 258 snap -1 2020-11-16T20:58:05.763 INFO:tasks.rados.rados.0.smithi166.stdout:1259: rollback oid 374 current snap is 55 2020-11-16T20:58:05.763 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 374 to 48 2020-11-16T20:58:05.763 INFO:tasks.rados.rados.0.smithi166.stdout:1260: write (excl) oid 246 current snap is 55 2020-11-16T20:58:05.763 INFO:tasks.rados.rados.0.smithi166.stdout:1260: seq_num 695 ranges {480865=486178,1453103=442564,2652627=519696} 2020-11-16T20:58:05.764 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:05.766+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:05.769 INFO:tasks.rados.rados.0.smithi166.stdout:1260: writing smithi16641208-246 from 480865 to 967043 tid 1 2020-11-16T20:58:05.772 INFO:teuthology.orchestra.run.smithi166.stderr:nodeep-scrub is unset 2020-11-16T20:58:05.775 INFO:tasks.rados.rados.0.smithi166.stdout:1260: writing smithi16641208-246 from 1453103 to 1895667 tid 2 2020-11-16T20:58:05.782 INFO:tasks.rados.rados.0.smithi166.stdout:1260: writing smithi16641208-246 from 2652627 to 3172323 tid 3 2020-11-16T20:58:05.783 INFO:tasks.rados.rados.0.smithi166.stdout:1261: read oid 382 snap -1 2020-11-16T20:58:05.783 INFO:tasks.rados.rados.0.smithi166.stdout:1261: expect (ObjNum 381 snap 0 seq_num 381) 2020-11-16T20:58:05.783 INFO:tasks.rados.rados.0.smithi166.stdout:1262: snap_create 2020-11-16T20:58:05.784 INFO:tasks.rados.rados.0.smithi166.stdout:1258: got (2) No such file or directory 2020-11-16T20:58:05.784 INFO:tasks.rados.rados.0.smithi166.stdout:1255: got (0) Success 2020-11-16T20:58:05.785 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 194 v 0 (ObjNum 193 snap 0 seq_num 193) dirty exists 2020-11-16T20:58:05.785 INFO:tasks.rados.rados.0.smithi166.stdout:1256: finishing copy_from to smithi16641208-451 2020-11-16T20:58:05.785 INFO:tasks.rados.rados.0.smithi166.stdout:1256: got expected ENOENT (src dne) 2020-11-16T20:58:05.785 INFO:tasks.rados.rados.0.smithi166.stdout:1256: finishing copy_from racing read to smithi16641208-451 2020-11-16T20:58:05.785 INFO:tasks.rados.rados.0.smithi166.stdout:1259: finishing rollback tid 0 to smithi16641208-374 2020-11-16T20:58:05.787 INFO:tasks.rados.rados.0.smithi166.stdout:1257: finishing rollback tid 0 to smithi16641208-437 2020-11-16T20:58:05.788 INFO:tasks.rados.rados.0.smithi166.stdout:1257: finishing rollback tid 1 to smithi16641208-437 2020-11-16T20:58:05.789 INFO:tasks.rados.rados.0.smithi166.stdout:1257: finishing rollback tid 2 to smithi16641208-437 2020-11-16T20:58:05.789 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 437 v 875 (ObjNum 573 snap 23 seq_num 573) dirty exists 2020-11-16T20:58:05.794 INFO:tasks.rados.rados.0.smithi166.stdout:1260: finishing write tid 1 to smithi16641208-246 2020-11-16T20:58:05.795 INFO:tasks.rados.rados.0.smithi166.stdout:1261: expect (ObjNum 381 snap 0 seq_num 381) 2020-11-16T20:58:05.842 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:05.847+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:05.882 INFO:tasks.rados.rados.0.smithi166.stdout:1260: finishing write tid 2 to smithi16641208-246 2020-11-16T20:58:05.882 INFO:tasks.rados.rados.0.smithi166.stdout:1260: finishing write tid 3 to smithi16641208-246 2020-11-16T20:58:05.882 INFO:tasks.rados.rados.0.smithi166.stdout:1260: finishing write tid 4 to smithi16641208-246 2020-11-16T20:58:05.882 INFO:tasks.rados.rados.0.smithi166.stdout:1260: finishing write tid 5 to smithi16641208-246 2020-11-16T20:58:05.882 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 246 v 865 (ObjNum 695 snap 55 seq_num 695) dirty exists 2020-11-16T20:58:05.883 INFO:tasks.rados.rados.0.smithi166.stdout:1260: left oid 246 (ObjNum 695 snap 55 seq_num 695) 2020-11-16T20:58:05.883 INFO:tasks.rados.rados.0.smithi166.stdout:1259: finishing rollback tid 1 to smithi16641208-374 2020-11-16T20:58:05.883 INFO:tasks.rados.rados.0.smithi166.stdout:1259: finishing rollback tid 2 to smithi16641208-374 2020-11-16T20:58:05.883 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 374 v 778 (ObjNum 373 snap 0 seq_num 373) dirty exists 2020-11-16T20:58:05.920 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:05.920 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:58:05.921 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:58:05.921 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:58:05.921 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:05.929 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:58:05.970 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:58:05.975+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:58:06.042 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:06.047+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:06.097 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:06.097 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:58:06.097 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:58:06.097 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:58:06.097 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.098 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:554 3.2 3:769099fd:::smithi16641208-247:head [copy-from ver 123] snapc 1=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e42)", 2020-11-16T20:58:06.098 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:58:06.098 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 121.050515992, 2020-11-16T20:58:06.098 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998, 2020-11-16T20:58:06.098 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:06.098 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:06.098 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:06.099 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.099 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:06.099 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:58:06.099 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:06.099 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.099 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.099 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:06.100 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050102+0000", 2020-11-16T20:58:06.100 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6705999999999997e-05 2020-11-16T20:58:06.100 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.100 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.100 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:06.100 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050139+0000", 2020-11-16T20:58:06.100 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6199999999999998e-06 2020-11-16T20:58:06.101 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.101 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.101 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:06.101 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050144+0000", 2020-11-16T20:58:06.101 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.944e-06 2020-11-16T20:58:06.101 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.101 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.102 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:06.102 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050154+0000", 2020-11-16T20:58:06.102 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4043999999999999e-05 2020-11-16T20:58:06.102 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.102 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.102 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:06.102 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.050178+0000", 2020-11-16T20:58:06.103 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078971409999999999 2020-11-16T20:58:06.103 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.103 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.103 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.103 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058075+0000", 2020-11-16T20:58:06.103 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012776500000000001 2020-11-16T20:58:06.103 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.103 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.104 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:06.104 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.058203+0000", 2020-11-16T20:58:06.104 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011807013 2020-11-16T20:58:06.104 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.104 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.104 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:58:06.104 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.070010+0000", 2020-11-16T20:58:06.105 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029522160000000001 2020-11-16T20:58:06.105 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.105 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.105 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:06.105 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.072962+0000", 2020-11-16T20:58:06.105 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017845006 2020-11-16T20:58:06.105 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.106 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.106 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:06.106 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.090807+0000", 2020-11-16T20:58:06.106 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.009301808 2020-11-16T20:58:06.106 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.106 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.106 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:06.107 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100109+0000", 2020-11-16T20:58:06.107 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7076999999999995e-05 2020-11-16T20:58:06.107 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.107 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.107 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:06.107 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100176+0000", 2020-11-16T20:58:06.107 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9790999999999999e-05 2020-11-16T20:58:06.107 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.108 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.108 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:06.108 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:05.100216+0000", 2020-11-16T20:58:06.108 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050113130999999998 2020-11-16T20:58:06.108 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.108 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:06.108 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.109 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.109 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.109 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2429 4.0 4:3b92f709:::smithi16641208-69:head [rollback 7] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:58:06.109 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:58:06.109 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 116.08459773, 2020-11-16T20:58:06.109 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003, 2020-11-16T20:58:06.109 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:06.110 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:06.110 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:06.110 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:06.110 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:06.110 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2429 2020-11-16T20:58:06.110 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.110 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:06.110 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.111 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:06.111 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:58:06.111 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:06.111 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.111 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.111 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:06.111 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016021+0000", 2020-11-16T20:58:06.112 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3710000000000002e-05 2020-11-16T20:58:06.112 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.112 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.112 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:06.112 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016044+0000", 2020-11-16T20:58:06.112 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7090000000000001e-06 2020-11-16T20:58:06.112 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.113 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:06.113 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016049+0000", 2020-11-16T20:58:06.113 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8820000000000003e-06 2020-11-16T20:58:06.113 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.113 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:06.113 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016056+0000", 2020-11-16T20:58:06.114 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.27e-06 2020-11-16T20:58:06.114 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.114 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.114 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:06.114 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016059+0000", 2020-11-16T20:58:06.114 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.537e-05 2020-11-16T20:58:06.114 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.115 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.115 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.115 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016115+0000", 2020-11-16T20:58:06.115 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8690000000000003e-06 2020-11-16T20:58:06.115 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.115 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.115 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:58:06.116 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016120+0000", 2020-11-16T20:58:06.116 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021405730000000002 2020-11-16T20:58:06.116 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.116 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.116 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.116 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018260+0000", 2020-11-16T20:58:06.116 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0137999999999999e-05 2020-11-16T20:58:06.117 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.117 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.117 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:06.117 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018320+0000", 2020-11-16T20:58:06.117 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011799352000000001 2020-11-16T20:58:06.117 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.117 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.118 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.118 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030120+0000", 2020-11-16T20:58:06.118 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000163139 2020-11-16T20:58:06.118 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.118 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.118 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:06.118 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030283+0000", 2020-11-16T20:58:06.118 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029657000000000002 2020-11-16T20:58:06.119 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.119 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.119 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:06.119 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030579+0000", 2020-11-16T20:58:06.119 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3058000000000001e-05 2020-11-16T20:58:06.119 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.119 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.120 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:06.120 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030612+0000", 2020-11-16T20:58:06.120 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0075168259999999999 2020-11-16T20:58:06.120 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.120 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.120 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.120 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038129+0000", 2020-11-16T20:58:06.121 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012914299999999999 2020-11-16T20:58:06.121 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.121 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.121 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:06.121 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038258+0000", 2020-11-16T20:58:06.121 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034292799999999999 2020-11-16T20:58:06.121 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.121 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.122 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:58:06.122 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.038601+0000", 2020-11-16T20:58:06.122 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0025181159999999999 2020-11-16T20:58:06.122 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.122 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.122 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.122 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041119+0000", 2020-11-16T20:58:06.123 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2331999999999997e-05 2020-11-16T20:58:06.123 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.123 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.123 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for ondisk", 2020-11-16T20:58:06.123 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041202+0000", 2020-11-16T20:58:06.123 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028481750000000001 2020-11-16T20:58:06.123 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.124 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.124 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:06.124 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044050+0000", 2020-11-16T20:58:06.124 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001269921 2020-11-16T20:58:06.124 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.124 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.124 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:06.125 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045320+0000", 2020-11-16T20:58:06.125 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054215490000000003 2020-11-16T20:58:06.125 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.125 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.125 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:06.125 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050741+0000", 2020-11-16T20:58:06.125 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6981000000000001e-05 2020-11-16T20:58:06.125 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.126 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.126 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:06.126 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050808+0000", 2020-11-16T20:58:06.126 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8841e-05 2020-11-16T20:58:06.126 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.126 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.126 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:06.127 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.050877+0000", 2020-11-16T20:58:06.127 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034856452000000003 2020-11-16T20:58:06.127 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.127 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:06.127 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.127 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.127 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.128 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2430 4.0 4:3b92f709:::smithi16641208-69:head [append 0~0] snapc c=[c,7,5] ondisk+write+known_if_redirected e47)", 2020-11-16T20:58:06.128 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:58:06.128 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 116.084541407, 2020-11-16T20:58:06.128 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001, 2020-11-16T20:58:06.128 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:06.128 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:06.128 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:06.128 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:06.129 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:06.129 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2430 2020-11-16T20:58:06.129 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.129 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:06.129 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.129 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:06.129 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:58:06.130 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:06.130 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.130 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.130 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:06.130 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016077+0000", 2020-11-16T20:58:06.130 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0857e-05 2020-11-16T20:58:06.130 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.131 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.131 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:06.131 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016098+0000", 2020-11-16T20:58:06.131 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9179999999999999e-06 2020-11-16T20:58:06.131 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.131 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.131 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:06.131 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016104+0000", 2020-11-16T20:58:06.132 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8230000000000006e-06 2020-11-16T20:58:06.132 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.132 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.132 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:06.132 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016114+0000", 2020-11-16T20:58:06.132 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2180000000000001e-06 2020-11-16T20:58:06.132 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.133 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.133 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:06.133 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016118+0000", 2020-11-16T20:58:06.133 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3547999999999995e-05 2020-11-16T20:58:06.133 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.133 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.133 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.133 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016181+0000", 2020-11-16T20:58:06.134 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8730000000000007e-06 2020-11-16T20:58:06.134 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.134 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.134 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:58:06.134 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.016189+0000", 2020-11-16T20:58:06.134 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021577200000000001 2020-11-16T20:58:06.134 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.135 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.135 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.135 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018347+0000", 2020-11-16T20:58:06.135 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6832000000000001e-05 2020-11-16T20:58:06.135 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.135 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.135 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:06.136 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.018404+0000", 2020-11-16T20:58:06.136 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012272913999999999 2020-11-16T20:58:06.136 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.136 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.136 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.136 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030677+0000", 2020-11-16T20:58:06.136 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2555000000000002e-05 2020-11-16T20:58:06.136 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.137 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.137 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:06.137 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.030719+0000", 2020-11-16T20:58:06.137 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010518684 2020-11-16T20:58:06.137 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.137 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.137 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.138 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041238+0000", 2020-11-16T20:58:06.138 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000144723 2020-11-16T20:58:06.138 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.138 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.138 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:06.138 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041383+0000", 2020-11-16T20:58:06.138 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000214575 2020-11-16T20:58:06.139 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.139 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.139 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:58:06.139 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.041597+0000", 2020-11-16T20:58:06.139 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002463196 2020-11-16T20:58:06.139 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.139 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.139 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:06.140 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.044060+0000", 2020-11-16T20:58:06.140 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001654066 2020-11-16T20:58:06.140 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.140 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.140 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:06.140 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.045715+0000", 2020-11-16T20:58:06.140 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0053780599999999996 2020-11-16T20:58:06.141 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.141 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.141 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:06.141 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051093+0000", 2020-11-16T20:58:06.141 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8189999999999996e-05 2020-11-16T20:58:06.141 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.141 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.141 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:06.142 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051161+0000", 2020-11-16T20:58:06.142 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4910000000000001e-05 2020-11-16T20:58:06.142 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.142 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.142 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:06.142 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:10.051216+0000", 2020-11-16T20:58:06.142 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035138662000000001 2020-11-16T20:58:06.143 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.143 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:06.143 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.143 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.143 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.143 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "MOSDPGPush(4.1 52/51 [PushOp(4:9ab04c4a:::smithi16641208-1:head, version: 33'3, data_included: [0~892056,1542129~156520], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:9ab04c4a:::smithi16641208-1:head@33'3, size: 2016807, copy_subset: [0~2016807], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1698649, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:a1eef07d:::smithi16641208-13:head, version: 33'9, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:a1eef07d:::smithi16641208-13:head@33'9, size: 2201684, copy_subset: [0~2201684], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:929564f0:::smithi16641208-24:head, version: 33'18, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:929564f0:::smithi16641208-24:head@33'18, size: 2386561, copy_subset: [0~2386561], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b565f7d2:::smithi16641208-35:head, version: 33'27, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b565f7d2:::smithi16641208-35:head@33'27, size: 2571438, copy_subset: [0~2571438], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:b6545a47:::smithi16641208-46:head, version: 33'29, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:b6545a47:::smithi16641208-46:head@33'29, size: 2756315, copy_subset: [0~2756315], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:9bd9f31d:::smithi16641208-48:head, version: 33'35, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:9bd9f31d:::smithi16641208-48:head@33'35, size: 2789929, copy_subset: [0~2789929], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:83205103:::smithi16641208-103:head, version: 34'38, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:83205103:::smithi16641208-103:head@34'38, size: 3714314, copy_subset: [0~3714314], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false)),PushOp(4:86a0a5b7:::smithi16641208-108:head, version: 34'42, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(4:86a0a5b7:::smithi16641208-108:head@34'42, size: 3798349, copy_subset: [0~3798349], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-16T20:58:06.143 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:58:06.144 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 111.329944801, 2020-11-16T20:58:06.146 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032552672999999997, 2020-11-16T20:58:06.146 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:06.146 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:06.146 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:06.146 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.146 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:06.147 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:58:06.147 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:06.147 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.147 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.147 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:06.147 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.770674+0000", 2020-11-16T20:58:06.147 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017498692999999999 2020-11-16T20:58:06.148 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.148 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.148 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:06.148 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788172+0000", 2020-11-16T20:58:06.148 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4147999999999999e-05 2020-11-16T20:58:06.148 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.148 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.149 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:06.149 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788206+0000", 2020-11-16T20:58:06.149 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0016000000000002e-05 2020-11-16T20:58:06.149 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.149 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.149 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:06.149 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788276+0000", 2020-11-16T20:58:06.149 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2172000000000002e-05 2020-11-16T20:58:06.150 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.150 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.150 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:06.150 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788319+0000", 2020-11-16T20:58:06.150 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000154337 2020-11-16T20:58:06.150 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.150 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.151 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.151 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788473+0000", 2020-11-16T20:58:06.151 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7690000000000002e-06 2020-11-16T20:58:06.151 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.151 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.151 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:06.151 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.788482+0000", 2020-11-16T20:58:06.152 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014744538 2020-11-16T20:58:06.152 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.152 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.152 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:06.152 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.803226+0000", 2020-11-16T20:58:06.152 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032552672999999997 2020-11-16T20:58:06.152 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.152 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:06.153 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.153 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.153 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.153 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(osd.4.0:552 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'128, mlcod=0'0)", 2020-11-16T20:58:06.153 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:58:06.153 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 111.309979383, 2020-11-16T20:58:06.153 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038033168999999999, 2020-11-16T20:58:06.154 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:06.154 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:06.154 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:06.154 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.154 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:06.154 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:58:06.154 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:06.155 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.155 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.155 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:06.155 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.790639+0000", 2020-11-16T20:58:06.155 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0031023880000000002 2020-11-16T20:58:06.155 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.155 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.155 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:06.156 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793741+0000", 2020-11-16T20:58:06.156 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1496e-05 2020-11-16T20:58:06.156 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.156 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.156 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:06.156 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793753+0000", 2020-11-16T20:58:06.156 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9009999999999999e-05 2020-11-16T20:58:06.157 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.157 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.157 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:06.157 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793772+0000", 2020-11-16T20:58:06.157 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3318e-05 2020-11-16T20:58:06.157 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.157 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.157 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:06.158 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793785+0000", 2020-11-16T20:58:06.158 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012534775 2020-11-16T20:58:06.158 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.158 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.158 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.158 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806320+0000", 2020-11-16T20:58:06.158 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8144999999999999e-05 2020-11-16T20:58:06.159 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.159 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.159 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:06.159 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.806348+0000", 2020-11-16T20:58:06.159 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022285688000000001 2020-11-16T20:58:06.159 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.159 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.160 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:06.160 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828634+0000", 2020-11-16T20:58:06.160 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8349000000000002e-05 2020-11-16T20:58:06.160 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.160 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.160 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:06.160 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828672+0000", 2020-11-16T20:58:06.160 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038033168999999999 2020-11-16T20:58:06.161 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.161 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:06.161 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.161 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.161 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.161 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2503 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'129, mlcod=0'0)", 2020-11-16T20:58:06.161 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:58:06.162 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 111.306791203, 2020-11-16T20:58:06.162 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034870998, 2020-11-16T20:58:06.162 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:06.162 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:06.162 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:06.162 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.162 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:06.163 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:58:06.163 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:06.163 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.163 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.163 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:06.163 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.793827+0000", 2020-11-16T20:58:06.163 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00093048899999999995 2020-11-16T20:58:06.164 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.164 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.164 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:06.164 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794758+0000", 2020-11-16T20:58:06.164 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.169e-05 2020-11-16T20:58:06.164 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.164 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.164 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:06.165 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794769+0000", 2020-11-16T20:58:06.165 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3998999999999999e-05 2020-11-16T20:58:06.165 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.165 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.165 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:06.165 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794783+0000", 2020-11-16T20:58:06.165 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.481e-06 2020-11-16T20:58:06.166 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.166 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.166 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:06.166 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794791+0000", 2020-11-16T20:58:06.166 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.02524036 2020-11-16T20:58:06.166 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.166 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.167 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.167 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820031+0000", 2020-11-16T20:58:06.167 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.811e-05 2020-11-16T20:58:06.167 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.167 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.167 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:06.167 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.820059+0000", 2020-11-16T20:58:06.167 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.008614577 2020-11-16T20:58:06.168 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.168 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.168 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:06.168 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828674+0000", 2020-11-16T20:58:06.168 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4292000000000001e-05 2020-11-16T20:58:06.168 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.168 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.169 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:06.169 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828698+0000", 2020-11-16T20:58:06.169 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034870998 2020-11-16T20:58:06.169 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.169 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:06.169 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.169 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.169 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.170 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_repop(client.4535.0:2504 4.1 e52/51 4:b0538c7c:::smithi16641208-136:head v 52'130, mlcod=0'0)", 2020-11-16T20:58:06.170 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:58:06.170 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 111.305785521, 2020-11-16T20:58:06.170 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033888776000000002, 2020-11-16T20:58:06.170 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:06.170 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:06.170 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:06.171 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.171 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:06.171 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:58:06.171 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:06.171 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.171 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.171 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:06.172 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794833+0000", 2020-11-16T20:58:06.172 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3896999999999997e-05 2020-11-16T20:58:06.172 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.172 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.172 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:06.172 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794877+0000", 2020-11-16T20:58:06.172 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7019999999999998e-06 2020-11-16T20:58:06.173 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.173 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.173 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:06.173 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794883+0000", 2020-11-16T20:58:06.173 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.789e-06 2020-11-16T20:58:06.173 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.173 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.173 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:06.174 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794888+0000", 2020-11-16T20:58:06.174 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.852e-06 2020-11-16T20:58:06.174 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.174 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.174 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:06.174 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.794891+0000", 2020-11-16T20:58:06.174 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026152822999999999 2020-11-16T20:58:06.175 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.175 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.175 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.175 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.821044+0000", 2020-11-16T20:58:06.175 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6900999999999999e-05 2020-11-16T20:58:06.175 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.175 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.175 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:06.176 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.821071+0000", 2020-11-16T20:58:06.176 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0076283210000000004 2020-11-16T20:58:06.176 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.176 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.176 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:06.176 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828699+0000", 2020-11-16T20:58:06.176 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2490999999999999e-05 2020-11-16T20:58:06.177 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.177 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.177 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:06.177 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828722+0000", 2020-11-16T20:58:06.177 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033888776000000002 2020-11-16T20:58:06.177 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.177 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:06.178 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.178 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.178 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.178 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:603 3.2 3:5a2e7c26:::smithi16641208-130:head [copy-from ver 67] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:58:06.178 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:58:06.178 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 106.349377457, 2020-11-16T20:58:06.178 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036631116999999998, 2020-11-16T20:58:06.178 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:06.179 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:06.179 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:06.179 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.179 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:06.179 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:58:06.179 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:06.179 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.180 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.180 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:06.180 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751241+0000", 2020-11-16T20:58:06.180 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9854000000000002e-05 2020-11-16T20:58:06.180 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.180 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.180 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:06.181 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751281+0000", 2020-11-16T20:58:06.181 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1840000000000004e-06 2020-11-16T20:58:06.181 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.181 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.181 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:06.181 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751287+0000", 2020-11-16T20:58:06.181 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0231000000000001e-05 2020-11-16T20:58:06.181 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.182 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.182 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:06.182 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751297+0000", 2020-11-16T20:58:06.182 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.639e-06 2020-11-16T20:58:06.182 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.182 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.182 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:06.183 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751302+0000", 2020-11-16T20:58:06.183 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030012000000000002 2020-11-16T20:58:06.183 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.183 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.183 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.183 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751602+0000", 2020-11-16T20:58:06.183 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013830200000000001 2020-11-16T20:58:06.184 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.184 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.184 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:06.184 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.751740+0000", 2020-11-16T20:58:06.184 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019538969999999999 2020-11-16T20:58:06.184 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.184 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.184 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:58:06.185 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771279+0000", 2020-11-16T20:58:06.185 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007630403 2020-11-16T20:58:06.185 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.185 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.185 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:06.185 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.778910+0000", 2020-11-16T20:58:06.185 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0065002009999999997 2020-11-16T20:58:06.186 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.186 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.186 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:06.186 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.785410+0000", 2020-11-16T20:58:06.186 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0023914140000000001 2020-11-16T20:58:06.186 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.186 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.187 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:06.187 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787801+0000", 2020-11-16T20:58:06.187 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9629999999999998e-05 2020-11-16T20:58:06.187 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.187 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.187 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:06.187 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787841+0000", 2020-11-16T20:58:06.187 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1168999999999999e-05 2020-11-16T20:58:06.188 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.188 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.188 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:06.188 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.787872+0000", 2020-11-16T20:58:06.188 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036631116999999998 2020-11-16T20:58:06.188 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.188 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:06.189 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.189 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.189 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.189 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:609 3.2 3:5eead97c:::smithi16641208-34:head [copy-from ver 27] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e57)", 2020-11-16T20:58:06.189 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:58:06.189 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 106.31158032800001, 2020-11-16T20:58:06.189 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.062626424, 2020-11-16T20:58:06.190 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:06.190 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:06.190 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:06.190 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.190 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:06.190 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:58:06.190 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:06.190 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.191 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.191 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:06.191 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789038+0000", 2020-11-16T20:58:06.191 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3596000000000001e-05 2020-11-16T20:58:06.191 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.191 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.191 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:06.192 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789082+0000", 2020-11-16T20:58:06.192 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3209999999999999e-06 2020-11-16T20:58:06.192 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.192 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.192 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:06.192 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789089+0000", 2020-11-16T20:58:06.192 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3498e-05 2020-11-16T20:58:06.193 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.193 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.193 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:06.193 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789103+0000", 2020-11-16T20:58:06.193 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3679999999999998e-06 2020-11-16T20:58:06.193 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.193 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.193 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:06.194 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.789109+0000", 2020-11-16T20:58:06.194 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007399638 2020-11-16T20:58:06.194 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.194 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.194 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.194 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.796509+0000", 2020-11-16T20:58:06.194 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000181168 2020-11-16T20:58:06.195 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.195 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.195 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:06.195 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.796690+0000", 2020-11-16T20:58:06.195 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01336562 2020-11-16T20:58:06.195 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.195 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.196 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:58:06.196 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.810055+0000", 2020-11-16T20:58:06.196 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044828350000000001 2020-11-16T20:58:06.196 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.196 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.196 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:06.196 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.814538+0000", 2020-11-16T20:58:06.196 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035609628999999997 2020-11-16T20:58:06.197 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.197 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.197 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:06.197 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850148+0000", 2020-11-16T20:58:06.197 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0013754730000000001 2020-11-16T20:58:06.197 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.197 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.198 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:06.198 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851523+0000", 2020-11-16T20:58:06.198 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9935e-05 2020-11-16T20:58:06.198 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.198 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.198 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:06.198 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851603+0000", 2020-11-16T20:58:06.198 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1342999999999999e-05 2020-11-16T20:58:06.199 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.199 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.199 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:06.199 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851665+0000", 2020-11-16T20:58:06.199 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.062626424 2020-11-16T20:58:06.199 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.199 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:06.200 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.200 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.200 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.200 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2605 4.0 4:2294fced:::smithi16641208-278:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:58:06.200 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:58:06.200 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 106.18374521200001, 2020-11-16T20:58:06.200 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032301128999999998, 2020-11-16T20:58:06.201 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:06.201 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:06.201 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:06.201 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:06.201 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:06.201 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2605 2020-11-16T20:58:06.201 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.201 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:06.202 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.202 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:06.202 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:58:06.202 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:06.202 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.202 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.202 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:06.203 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916873+0000", 2020-11-16T20:58:06.203 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.811e-05 2020-11-16T20:58:06.203 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.203 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.203 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:06.203 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916901+0000", 2020-11-16T20:58:06.203 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2939999999999996e-06 2020-11-16T20:58:06.204 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.204 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.204 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:06.204 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916907+0000", 2020-11-16T20:58:06.204 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0589e-05 2020-11-16T20:58:06.204 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.204 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.204 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:06.205 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916917+0000", 2020-11-16T20:58:06.205 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2549999999999999e-06 2020-11-16T20:58:06.205 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.205 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.205 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:06.205 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.916921+0000", 2020-11-16T20:58:06.205 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033789099999999999 2020-11-16T20:58:06.206 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.206 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.206 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.206 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.917259+0000", 2020-11-16T20:58:06.206 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.25e-05 2020-11-16T20:58:06.206 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.206 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.207 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:06.207 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.917332+0000", 2020-11-16T20:58:06.207 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.028336376999999999 2020-11-16T20:58:06.207 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.207 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.207 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.207 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.945668+0000", 2020-11-16T20:58:06.207 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0983000000000006e-05 2020-11-16T20:58:06.208 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.208 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.208 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:06.208 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.945759+0000", 2020-11-16T20:58:06.208 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00324756 2020-11-16T20:58:06.208 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.208 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.209 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.209 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949007+0000", 2020-11-16T20:58:06.209 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0583999999999999e-05 2020-11-16T20:58:06.209 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.209 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.209 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:06.209 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949097+0000", 2020-11-16T20:58:06.209 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6985999999999998e-05 2020-11-16T20:58:06.210 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.210 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.210 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:06.210 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.949174+0000", 2020-11-16T20:58:06.210 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032301128999999998 2020-11-16T20:58:06.210 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.210 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:06.211 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.211 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.211 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.211 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3004 3.2 3:4fbd4ff5:::smithi16641208-419:head [copy-from ver 366] snapc 33=[33,25] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e87)", 2020-11-16T20:58:06.211 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.815968+0000", 2020-11-16T20:58:06.211 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.284650702999997, 2020-11-16T20:58:06.211 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042048220999999997, 2020-11-16T20:58:06.212 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:06.212 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:06.212 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:06.212 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.212 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:06.212 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.815968+0000", 2020-11-16T20:58:06.212 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:06.212 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.213 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.213 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:06.213 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.815968+0000", 2020-11-16T20:58:06.213 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3235000000000002e-05 2020-11-16T20:58:06.213 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.213 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.213 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:06.214 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816011+0000", 2020-11-16T20:58:06.214 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.303e-06 2020-11-16T20:58:06.214 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.214 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.214 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:06.214 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816019+0000", 2020-11-16T20:58:06.214 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9714999999999999e-05 2020-11-16T20:58:06.215 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.215 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.215 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:06.215 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816049+0000", 2020-11-16T20:58:06.215 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2960000000000001e-06 2020-11-16T20:58:06.215 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.215 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.215 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:06.216 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816056+0000", 2020-11-16T20:58:06.216 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000241606 2020-11-16T20:58:06.216 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.216 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.216 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.216 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816298+0000", 2020-11-16T20:58:06.216 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016421599999999999 2020-11-16T20:58:06.217 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.217 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.217 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:06.217 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816462+0000", 2020-11-16T20:58:06.217 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025803994 2020-11-16T20:58:06.217 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.217 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.218 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:58:06.218 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.842266+0000", 2020-11-16T20:58:06.218 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0072860549999999996 2020-11-16T20:58:06.218 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.218 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.218 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:06.218 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.849552+0000", 2020-11-16T20:58:06.218 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0077911389999999999 2020-11-16T20:58:06.219 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.219 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.219 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:06.219 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.857343+0000", 2020-11-16T20:58:06.219 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00049728000000000001 2020-11-16T20:58:06.219 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.219 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.220 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:06.220 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.857841+0000", 2020-11-16T20:58:06.220 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.1997999999999997e-05 2020-11-16T20:58:06.220 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.220 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.220 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:06.220 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.857923+0000", 2020-11-16T20:58:06.220 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3383999999999999e-05 2020-11-16T20:58:06.221 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.221 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.221 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:06.221 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858016+0000", 2020-11-16T20:58:06.221 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042048220999999997 2020-11-16T20:58:06.221 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.221 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:06.222 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.222 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.222 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.222 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:650 3.2 3:4fbd4ff5:::smithi16641208-419:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e87)", 2020-11-16T20:58:06.222 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.816105+0000", 2020-11-16T20:58:06.222 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.284513072999999, 2020-11-16T20:58:06.222 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042242304000000001, 2020-11-16T20:58:06.223 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:06.223 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:06.223 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:06.223 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.223 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:06.223 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816105+0000", 2020-11-16T20:58:06.223 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:06.223 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.224 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.224 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:06.224 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816105+0000", 2020-11-16T20:58:06.224 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6486999999999999e-05 2020-11-16T20:58:06.224 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.224 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.224 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:06.225 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816132+0000", 2020-11-16T20:58:06.225 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5230000000000003e-06 2020-11-16T20:58:06.225 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.225 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.225 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:06.225 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816137+0000", 2020-11-16T20:58:06.225 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1498000000000001e-05 2020-11-16T20:58:06.225 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.226 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.226 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:06.226 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816149+0000", 2020-11-16T20:58:06.226 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5789999999999997e-06 2020-11-16T20:58:06.226 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.226 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.226 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:06.227 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816153+0000", 2020-11-16T20:58:06.227 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00044901199999999999 2020-11-16T20:58:06.227 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.227 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.227 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.227 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816602+0000", 2020-11-16T20:58:06.227 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6134000000000002e-05 2020-11-16T20:58:06.228 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.228 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.228 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:06.228 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816649+0000", 2020-11-16T20:58:06.228 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032065206999999998 2020-11-16T20:58:06.228 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.228 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.228 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.229 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848714+0000", 2020-11-16T20:58:06.229 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000103695 2020-11-16T20:58:06.229 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.229 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.229 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:06.229 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848818+0000", 2020-11-16T20:58:06.229 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092315220000000007 2020-11-16T20:58:06.230 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.230 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.230 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.230 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858049+0000", 2020-11-16T20:58:06.230 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000104415 2020-11-16T20:58:06.230 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.230 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.231 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:06.231 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858153+0000", 2020-11-16T20:58:06.231 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019423199999999999 2020-11-16T20:58:06.231 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.231 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.231 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:06.231 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858348+0000", 2020-11-16T20:58:06.231 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042242304000000001 2020-11-16T20:58:06.232 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.232 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:06.232 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.232 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.232 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.232 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.1.13:651 3.2 3:4fbd4ff5:::smithi16641208-419:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e87)", 2020-11-16T20:58:06.232 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:49.816182+0000", 2020-11-16T20:58:06.233 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.284436577999998, 2020-11-16T20:58:06.233 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047784220000000002, 2020-11-16T20:58:06.233 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:06.233 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:06.233 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:06.233 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.233 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:06.233 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816182+0000", 2020-11-16T20:58:06.234 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:06.234 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.234 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.234 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:06.234 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816182+0000", 2020-11-16T20:58:06.234 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6310999999999998e-05 2020-11-16T20:58:06.234 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.235 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.235 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:06.235 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816218+0000", 2020-11-16T20:58:06.235 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6110000000000001e-06 2020-11-16T20:58:06.235 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.235 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.235 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:06.236 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816224+0000", 2020-11-16T20:58:06.236 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9189999999999994e-06 2020-11-16T20:58:06.236 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.236 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.236 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:06.236 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816234+0000", 2020-11-16T20:58:06.236 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3220000000000003e-06 2020-11-16T20:58:06.236 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.237 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.237 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:06.237 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816238+0000", 2020-11-16T20:58:06.237 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00043294900000000002 2020-11-16T20:58:06.237 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.237 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.237 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.238 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816671+0000", 2020-11-16T20:58:06.238 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3359999999999998e-05 2020-11-16T20:58:06.238 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.238 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.238 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:06.238 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.816714+0000", 2020-11-16T20:58:06.238 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032137410999999998 2020-11-16T20:58:06.239 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.239 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.239 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.239 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848852+0000", 2020-11-16T20:58:06.239 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000103235 2020-11-16T20:58:06.239 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.239 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.239 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:06.240 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.848955+0000", 2020-11-16T20:58:06.240 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094266409999999995 2020-11-16T20:58:06.240 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.240 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.240 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.240 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858382+0000", 2020-11-16T20:58:06.240 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7973999999999995e-05 2020-11-16T20:58:06.241 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.241 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.241 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:06.241 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.858470+0000", 2020-11-16T20:58:06.241 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0054964870000000004 2020-11-16T20:58:06.241 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.241 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.242 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:06.242 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:49.863966+0000", 2020-11-16T20:58:06.242 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047784220000000002 2020-11-16T20:58:06.242 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.242 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:06.242 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.242 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.243 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.243 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3541 4.0 4:251c4c06:::smithi16641208-378:head [write 1862271~598221] snapc 55=[55,54] ondisk+write+known_if_redirected e130)", 2020-11-16T20:58:06.243 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.764037+0000", 2020-11-16T20:58:06.243 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 31.336581919, 2020-11-16T20:58:06.243 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037702297000000003, 2020-11-16T20:58:06.243 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:06.243 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:06.243 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:06.244 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:06.244 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:06.244 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3541 2020-11-16T20:58:06.244 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.244 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:06.244 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.244 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:06.245 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764037+0000", 2020-11-16T20:58:06.245 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:06.245 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.245 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.245 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:06.245 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764037+0000", 2020-11-16T20:58:06.245 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018829599999999999 2020-11-16T20:58:06.246 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.246 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.246 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:06.246 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764225+0000", 2020-11-16T20:58:06.246 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7600000000000002e-06 2020-11-16T20:58:06.246 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.246 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.246 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:06.247 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764233+0000", 2020-11-16T20:58:06.247 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2991e-05 2020-11-16T20:58:06.247 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.247 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.247 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:06.247 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764246+0000", 2020-11-16T20:58:06.247 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7379999999999997e-06 2020-11-16T20:58:06.248 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.248 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.248 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:06.248 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764252+0000", 2020-11-16T20:58:06.248 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000195482 2020-11-16T20:58:06.248 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.248 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.248 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.249 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764448+0000", 2020-11-16T20:58:06.249 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3134999999999998e-05 2020-11-16T20:58:06.249 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.249 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.249 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:06.249 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764511+0000", 2020-11-16T20:58:06.249 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024010632000000001 2020-11-16T20:58:06.250 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.250 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.250 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.250 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788522+0000", 2020-11-16T20:58:06.250 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014091200000000001 2020-11-16T20:58:06.250 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.250 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.251 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:06.251 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788662+0000", 2020-11-16T20:58:06.251 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015662400000000001 2020-11-16T20:58:06.251 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.251 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.251 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:58:06.251 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788819+0000", 2020-11-16T20:58:06.252 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0045297089999999998 2020-11-16T20:58:06.252 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.252 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.252 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:06.252 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.793349+0000", 2020-11-16T20:58:06.252 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061836570000000004 2020-11-16T20:58:06.252 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.252 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.253 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:06.253 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.799532+0000", 2020-11-16T20:58:06.253 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0020861299999999998 2020-11-16T20:58:06.253 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.253 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.253 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:06.253 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801619+0000", 2020-11-16T20:58:06.254 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9320999999999996e-05 2020-11-16T20:58:06.254 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.254 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.254 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:06.254 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801688+0000", 2020-11-16T20:58:06.254 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0909999999999999e-05 2020-11-16T20:58:06.254 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.254 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.255 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:06.255 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801739+0000", 2020-11-16T20:58:06.255 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037702297000000003 2020-11-16T20:58:06.255 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.255 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:06.255 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.255 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.256 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.256 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3542 4.0 4:251c4c06:::smithi16641208-378:head [setxattr _header (58) in=7b,truncate 2974971] snapc 55=[55,54] ondisk+write+known_if_redirected e130)", 2020-11-16T20:58:06.256 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.764282+0000", 2020-11-16T20:58:06.256 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 31.336336035999999, 2020-11-16T20:58:06.256 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037622296999999999, 2020-11-16T20:58:06.256 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:06.256 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:06.257 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:06.257 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:06.257 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:06.257 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3542 2020-11-16T20:58:06.257 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.257 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:06.257 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.257 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:06.258 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764282+0000", 2020-11-16T20:58:06.258 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:06.258 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.258 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.258 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:06.258 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764282+0000", 2020-11-16T20:58:06.258 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0065000000000001e-05 2020-11-16T20:58:06.259 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.259 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.259 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:06.259 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764312+0000", 2020-11-16T20:58:06.259 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2180000000000002e-06 2020-11-16T20:58:06.259 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.259 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.260 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:06.260 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764320+0000", 2020-11-16T20:58:06.260 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1029000000000001e-05 2020-11-16T20:58:06.260 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.260 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.260 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:06.260 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764331+0000", 2020-11-16T20:58:06.260 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4589999999999998e-06 2020-11-16T20:58:06.261 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.261 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.261 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:06.261 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764334+0000", 2020-11-16T20:58:06.261 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020802799999999999 2020-11-16T20:58:06.261 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.261 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.262 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.262 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764542+0000", 2020-11-16T20:58:06.262 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7712e-05 2020-11-16T20:58:06.262 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.262 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.262 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:06.262 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764590+0000", 2020-11-16T20:58:06.262 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025536256 2020-11-16T20:58:06.263 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.263 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.263 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.263 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790126+0000", 2020-11-16T20:58:06.263 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8548000000000007e-05 2020-11-16T20:58:06.263 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.263 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.264 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:06.264 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790215+0000", 2020-11-16T20:58:06.264 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013994800000000001 2020-11-16T20:58:06.264 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.264 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.264 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:58:06.264 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790355+0000", 2020-11-16T20:58:06.265 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0032107820000000001 2020-11-16T20:58:06.265 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.265 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.265 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:06.265 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.793565+0000", 2020-11-16T20:58:06.265 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0059758709999999998 2020-11-16T20:58:06.265 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.265 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.266 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:06.266 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.799541+0000", 2020-11-16T20:58:06.266 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002240999 2020-11-16T20:58:06.266 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.266 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.266 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:06.266 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801782+0000", 2020-11-16T20:58:06.267 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9985000000000003e-05 2020-11-16T20:58:06.267 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.267 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.267 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:06.267 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801842+0000", 2020-11-16T20:58:06.267 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2397000000000006e-05 2020-11-16T20:58:06.267 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.268 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.268 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:06.268 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801905+0000", 2020-11-16T20:58:06.268 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037622296999999999 2020-11-16T20:58:06.268 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.268 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:06.268 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.268 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.269 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.269 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3543 4.0 4:251c4c06:::smithi16641208-378:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e130)", 2020-11-16T20:58:06.269 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.764352+0000", 2020-11-16T20:58:06.269 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 31.336266031000001, 2020-11-16T20:58:06.269 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038764630000000001, 2020-11-16T20:58:06.269 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:06.269 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:06.270 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:06.270 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:06.270 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:06.270 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3543 2020-11-16T20:58:06.270 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.270 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:06.270 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.271 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:06.271 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764352+0000", 2020-11-16T20:58:06.271 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:06.271 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.271 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.271 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:06.271 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764352+0000", 2020-11-16T20:58:06.272 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5197999999999999e-05 2020-11-16T20:58:06.272 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.272 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.272 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:06.272 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764368+0000", 2020-11-16T20:58:06.272 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9960000000000002e-06 2020-11-16T20:58:06.272 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.272 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.273 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:06.273 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764371+0000", 2020-11-16T20:58:06.273 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8810000000000001e-06 2020-11-16T20:58:06.273 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.273 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.273 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:06.273 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764376+0000", 2020-11-16T20:58:06.274 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3949999999999999e-06 2020-11-16T20:58:06.274 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.274 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.274 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:06.274 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764379+0000", 2020-11-16T20:58:06.274 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023363999999999999 2020-11-16T20:58:06.274 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.275 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.275 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.275 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764613+0000", 2020-11-16T20:58:06.275 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3958999999999997e-05 2020-11-16T20:58:06.275 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.275 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.275 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:06.276 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.764656+0000", 2020-11-16T20:58:06.276 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026048794 2020-11-16T20:58:06.276 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.276 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.276 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.276 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790705+0000", 2020-11-16T20:58:06.276 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013058500000000001 2020-11-16T20:58:06.276 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.277 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.277 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:06.277 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.790836+0000", 2020-11-16T20:58:06.277 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011100066 2020-11-16T20:58:06.277 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.277 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.277 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.278 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801936+0000", 2020-11-16T20:58:06.278 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3307999999999996e-05 2020-11-16T20:58:06.278 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.278 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.278 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:06.278 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.802019+0000", 2020-11-16T20:58:06.278 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001097808 2020-11-16T20:58:06.279 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.279 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.279 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:06.279 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.803117+0000", 2020-11-16T20:58:06.279 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038764630000000001 2020-11-16T20:58:06.279 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.279 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:06.279 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.280 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.280 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.280 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.5.13:51 3.2 3:4427cc2e:::smithi16641208-332:head [copy-from ver 661] snapc 4f=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e139)", 2020-11-16T20:58:06.280 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:43.986780+0000", 2020-11-16T20:58:06.280 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 22.113838511000001, 2020-11-16T20:58:06.280 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.040884263999999997, 2020-11-16T20:58:06.280 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:06.281 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:06.281 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:06.281 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.281 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:06.281 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.986780+0000", 2020-11-16T20:58:06.281 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:06.281 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.282 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.282 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:06.282 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.986780+0000", 2020-11-16T20:58:06.282 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0978e-05 2020-11-16T20:58:06.282 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.282 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.282 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:06.282 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.986821+0000", 2020-11-16T20:58:06.283 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6009999999999997e-06 2020-11-16T20:58:06.283 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.283 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.283 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:06.283 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.986826+0000", 2020-11-16T20:58:06.283 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0190000000000001e-05 2020-11-16T20:58:06.283 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.284 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.284 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:06.284 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.986836+0000", 2020-11-16T20:58:06.284 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7900000000000001e-06 2020-11-16T20:58:06.284 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.284 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.284 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:06.285 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.986839+0000", 2020-11-16T20:58:06.285 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002115179 2020-11-16T20:58:06.285 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.285 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.285 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.285 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.988955+0000", 2020-11-16T20:58:06.285 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5797000000000006e-05 2020-11-16T20:58:06.285 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.286 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.286 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:06.286 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:43.989030+0000", 2020-11-16T20:58:06.286 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016622987999999998 2020-11-16T20:58:06.286 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.286 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.286 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:58:06.287 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:44.005653+0000", 2020-11-16T20:58:06.287 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042403629999999996 2020-11-16T20:58:06.287 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.287 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.287 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:06.287 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:44.009894+0000", 2020-11-16T20:58:06.287 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014512321999999999 2020-11-16T20:58:06.287 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.288 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.288 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:06.288 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:44.024406+0000", 2020-11-16T20:58:06.288 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003165204 2020-11-16T20:58:06.288 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.288 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.288 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:06.289 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:44.027571+0000", 2020-11-16T20:58:06.289 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3579999999999999e-05 2020-11-16T20:58:06.289 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.289 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.289 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:06.289 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:44.027615+0000", 2020-11-16T20:58:06.289 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9271999999999999e-05 2020-11-16T20:58:06.290 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.290 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.290 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:06.290 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:44.027664+0000", 2020-11-16T20:58:06.290 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.040884263999999997 2020-11-16T20:58:06.290 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.290 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:06.290 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.291 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.291 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.291 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.5.13:92 3.2 3:59b0df7a:::smithi16641208-125:head [copy-from ver 703] snapc 5c=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e149)", 2020-11-16T20:58:06.291 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:53.868435+0000", 2020-11-16T20:58:06.291 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 12.232183672, 2020-11-16T20:58:06.291 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037890923999999999, 2020-11-16T20:58:06.291 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:06.292 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:06.292 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:06.292 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.292 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:06.292 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.868435+0000", 2020-11-16T20:58:06.292 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:06.292 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.293 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.293 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:06.293 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.868435+0000", 2020-11-16T20:58:06.293 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2453999999999994e-05 2020-11-16T20:58:06.293 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.293 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.293 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:06.294 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.868507+0000", 2020-11-16T20:58:06.294 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8260000000000003e-06 2020-11-16T20:58:06.294 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.294 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.294 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:06.294 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.868511+0000", 2020-11-16T20:58:06.294 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.789e-06 2020-11-16T20:58:06.294 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.295 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.295 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:06.295 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.868520+0000", 2020-11-16T20:58:06.295 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2806000000000002e-05 2020-11-16T20:58:06.295 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.295 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.295 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:06.296 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.868543+0000", 2020-11-16T20:58:06.296 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021295070000000001 2020-11-16T20:58:06.296 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.296 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.296 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.296 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.870672+0000", 2020-11-16T20:58:06.296 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3769000000000005e-05 2020-11-16T20:58:06.297 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.297 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.297 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:06.297 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.870746+0000", 2020-11-16T20:58:06.297 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014716440000000001 2020-11-16T20:58:06.297 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.297 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.297 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,6", 2020-11-16T20:58:06.298 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.885462+0000", 2020-11-16T20:58:06.298 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042843550000000001 2020-11-16T20:58:06.298 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.298 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.298 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:06.298 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.889747+0000", 2020-11-16T20:58:06.298 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0059100150000000002 2020-11-16T20:58:06.299 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.299 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.299 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:06.299 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.895657+0000", 2020-11-16T20:58:06.299 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010580081999999999 2020-11-16T20:58:06.299 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.299 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.300 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:06.300 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.906237+0000", 2020-11-16T20:58:06.300 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7259999999999998e-05 2020-11-16T20:58:06.300 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.300 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.300 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:06.300 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.906284+0000", 2020-11-16T20:58:06.300 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1621e-05 2020-11-16T20:58:06.301 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.301 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.301 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:06.301 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:53.906326+0000", 2020-11-16T20:58:06.301 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037890923999999999 2020-11-16T20:58:06.301 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.301 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:06.302 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.302 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.302 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.302 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3823 4.0 4:1571ec80:::smithi16641208-55:head [rollback 68] snapc 68=[68,67,61] ondisk+write+known_if_redirected e152)", 2020-11-16T20:58:06.302 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:00.974580+0000", 2020-11-16T20:58:06.302 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.1260383999999997, 2020-11-16T20:58:06.302 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034054907000000002, 2020-11-16T20:58:06.303 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:06.303 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:06.303 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:06.303 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:06.303 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:06.303 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3823 2020-11-16T20:58:06.303 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.303 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:06.304 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.304 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:06.304 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:00.974580+0000", 2020-11-16T20:58:06.304 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:06.304 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.304 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.304 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:06.305 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:00.974580+0000", 2020-11-16T20:58:06.305 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5849e-05 2020-11-16T20:58:06.305 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.305 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.305 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:06.305 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:00.974596+0000", 2020-11-16T20:58:06.305 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9029999999999997e-06 2020-11-16T20:58:06.306 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.306 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.306 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:06.306 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:00.974600+0000", 2020-11-16T20:58:06.306 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.708e-06 2020-11-16T20:58:06.306 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.306 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.307 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:06.307 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:00.974606+0000", 2020-11-16T20:58:06.307 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5969999999999999e-06 2020-11-16T20:58:06.307 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.307 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.307 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:06.307 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:00.974609+0000", 2020-11-16T20:58:06.307 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030554900000000001 2020-11-16T20:58:06.308 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.308 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.308 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.308 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:00.974915+0000", 2020-11-16T20:58:06.308 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3647999999999998e-05 2020-11-16T20:58:06.308 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.308 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.309 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:06.309 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:00.974978+0000", 2020-11-16T20:58:06.309 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0097876170000000002 2020-11-16T20:58:06.309 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.309 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.309 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.309 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:00.984766+0000", 2020-11-16T20:58:06.310 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017974199999999999 2020-11-16T20:58:06.310 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.310 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.310 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:06.310 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:00.984946+0000", 2020-11-16T20:58:06.310 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032001700000000002 2020-11-16T20:58:06.310 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.310 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.311 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:06.311 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:00.985266+0000", 2020-11-16T20:58:06.311 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6279999999999999e-05 2020-11-16T20:58:06.311 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.311 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.311 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:06.311 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:00.985292+0000", 2020-11-16T20:58:06.312 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016059068999999999 2020-11-16T20:58:06.312 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.312 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.312 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.312 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:01.001351+0000", 2020-11-16T20:58:06.312 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000131989 2020-11-16T20:58:06.312 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.313 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:06.313 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:01.001483+0000", 2020-11-16T20:58:06.313 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00027410999999999999 2020-11-16T20:58:06.313 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.313 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:58:06.313 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:01.001757+0000", 2020-11-16T20:58:06.314 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0020403130000000002 2020-11-16T20:58:06.314 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.314 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.314 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.314 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:01.003797+0000", 2020-11-16T20:58:06.314 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7865999999999998e-05 2020-11-16T20:58:06.314 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.315 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.315 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for ondisk", 2020-11-16T20:58:06.315 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:01.003855+0000", 2020-11-16T20:58:06.315 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0010553170000000001 2020-11-16T20:58:06.315 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.315 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.315 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:06.316 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:01.004911+0000", 2020-11-16T20:58:06.316 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001526718 2020-11-16T20:58:06.316 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.316 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.316 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:06.316 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:01.006437+0000", 2020-11-16T20:58:06.316 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0020614309999999999 2020-11-16T20:58:06.316 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.317 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.317 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:06.317 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:01.008499+0000", 2020-11-16T20:58:06.317 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5189000000000002e-05 2020-11-16T20:58:06.317 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.317 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.317 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:06.318 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:01.008564+0000", 2020-11-16T20:58:06.318 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0994999999999994e-05 2020-11-16T20:58:06.318 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.318 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.318 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:06.318 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:01.008635+0000", 2020-11-16T20:58:06.318 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034054907000000002 2020-11-16T20:58:06.319 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.319 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:06.319 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.319 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.319 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.319 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3824 4.0 4:1571ec80:::smithi16641208-55:head [append 0~0] snapc 68=[68,67,61] ondisk+write+known_if_redirected e152)", 2020-11-16T20:58:06.319 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:00.974628+0000", 2020-11-16T20:58:06.319 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.1259904919999997, 2020-11-16T20:58:06.320 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034160561999999998, 2020-11-16T20:58:06.320 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:06.320 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:06.320 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:06.320 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:06.320 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:06.320 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3824 2020-11-16T20:58:06.321 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.321 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:06.321 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.321 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:06.321 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:00.974628+0000", 2020-11-16T20:58:06.321 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:06.321 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.321 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.322 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:06.322 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:00.974628+0000", 2020-11-16T20:58:06.322 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5081e-05 2020-11-16T20:58:06.322 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.322 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.322 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:06.322 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:00.974643+0000", 2020-11-16T20:58:06.323 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.802e-06 2020-11-16T20:58:06.323 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.323 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.323 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:06.323 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:00.974646+0000", 2020-11-16T20:58:06.323 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6960000000000002e-06 2020-11-16T20:58:06.323 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.324 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.324 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:06.324 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:00.974652+0000", 2020-11-16T20:58:06.324 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2320000000000001e-06 2020-11-16T20:58:06.324 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.324 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.324 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:06.325 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:00.974655+0000", 2020-11-16T20:58:06.325 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00036378199999999999 2020-11-16T20:58:06.325 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.325 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.325 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.325 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:00.975019+0000", 2020-11-16T20:58:06.325 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4357999999999996e-05 2020-11-16T20:58:06.325 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.326 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.326 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:06.326 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:00.975083+0000", 2020-11-16T20:58:06.326 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010264551 2020-11-16T20:58:06.326 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.326 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.326 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.327 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:00.985347+0000", 2020-11-16T20:58:06.327 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8588999999999999e-05 2020-11-16T20:58:06.327 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.327 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.327 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:06.327 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:00.985386+0000", 2020-11-16T20:58:06.327 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018953121999999999 2020-11-16T20:58:06.327 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.328 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.328 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:06.328 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:01.004339+0000", 2020-11-16T20:58:06.328 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6825999999999999e-05 2020-11-16T20:58:06.328 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.328 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.328 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:06.329 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:01.004416+0000", 2020-11-16T20:58:06.329 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000120042 2020-11-16T20:58:06.329 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.329 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.329 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,7", 2020-11-16T20:58:06.329 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:01.004536+0000", 2020-11-16T20:58:06.329 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00083914600000000003 2020-11-16T20:58:06.329 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.330 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.330 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:06.330 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:01.005375+0000", 2020-11-16T20:58:06.330 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003269325 2020-11-16T20:58:06.330 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.330 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.330 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:06.331 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:01.008644+0000", 2020-11-16T20:58:06.331 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6690999999999997e-05 2020-11-16T20:58:06.331 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.331 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.331 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:06.331 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:01.008691+0000", 2020-11-16T20:58:06.331 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8649000000000002e-05 2020-11-16T20:58:06.332 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.332 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.332 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:06.332 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:01.008730+0000", 2020-11-16T20:58:06.332 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8669999999999999e-05 2020-11-16T20:58:06.332 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:06.332 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:06.332 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:06.333 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:01.008789+0000", 2020-11-16T20:58:06.333 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.034160561999999998 2020-11-16T20:58:06.333 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.333 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:06.333 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.333 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:06.333 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:06.334 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:06.335 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:58:06.335 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:06.339+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:06.370 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:58:06.436 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:06.441+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:06.483 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2020-11-16T20:58:06.484 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2020-11-16T20:58:06.484 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2020-11-16T20:58:06.484 INFO:teuthology.orchestra.run.smithi059.stdout:} 2020-11-16T20:58:06.493 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:58:06.516 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:58:06.535 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:58:06.538 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:06.542+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:06.555 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:58:06.574 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:58:06.594 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:58:06.615 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:58:06.634 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:58:06.638 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:06.643+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:06.653 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:58:06.654 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:58:06.655 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:58:06.655 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:58:06.655 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:58:06.655 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:58:06.655 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:58:06.655 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:58:06.656 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:58:06.670 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:06.670 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:06.679 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:58:06.739 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:06.744+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:06.762 INFO:tasks.rados.rados.0.smithi166.stdout:1255: done (7 left) 2020-11-16T20:58:06.762 INFO:tasks.rados.rados.0.smithi166.stdout:1256: done (6 left) 2020-11-16T20:58:06.763 INFO:tasks.rados.rados.0.smithi166.stdout:1257: done (5 left) 2020-11-16T20:58:06.763 INFO:tasks.rados.rados.0.smithi166.stdout:1258: done (4 left) 2020-11-16T20:58:06.763 INFO:tasks.rados.rados.0.smithi166.stdout:1259: done (3 left) 2020-11-16T20:58:06.763 INFO:tasks.rados.rados.0.smithi166.stdout:1260: done (2 left) 2020-11-16T20:58:06.763 INFO:tasks.rados.rados.0.smithi166.stdout:1261: done (1 left) 2020-11-16T20:58:06.763 INFO:tasks.rados.rados.0.smithi166.stdout:1262: done (0 left) 2020-11-16T20:58:06.763 INFO:tasks.rados.rados.0.smithi166.stdout:1263: snap_remove snap 55 2020-11-16T20:58:06.840 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:58:06.845+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:58:06.865 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:06.865 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:06.875 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:58:06.940 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:06.945+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:07.041 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:58:07.046+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:58:07.051 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:07.051 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:07.061 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:58:07.142 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:07.146+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:07.236 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:07.236 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:07.242 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:58:07.247+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:58:07.245 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:58:07.343 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:07.348+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:07.380 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:07.381 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:07.390 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:58:07.476 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:07.480+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:07.544 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:07.549+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:07.566 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:07.566 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:07.576 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:58:07.645 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:07.649+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:07.746 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:58:07.750+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:58:07.751 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:07.751 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:07.761 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:58:07.762 INFO:tasks.rados.rados.0.smithi166.stdout:1263: done (0 left) 2020-11-16T20:58:07.763 INFO:tasks.rados.rados.0.smithi166.stdout:1264: snap_create 2020-11-16T20:58:07.793 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2020-11-16T20:58:07.847 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:07.851+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:07.895 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7] out_osds: [1] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:58:07.896 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:58:07.897 INFO:tasks.thrashosds.thrasher:Adding osd 1 2020-11-16T20:58:07.897 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 1 2020-11-16T20:58:07.899 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:07.900 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:07.908 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:58:07.948 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:07.953+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:08.049 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:08.053+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:08.083 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:08.083 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:08.092 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:58:08.149 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:58:08.154+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:58:08.213 INFO:tasks.ceph.mon.b.smithi059.stderr:2020-11-16T20:58:08.218+0000 7fe2b1942700 -1 mon.b@0(leader).osd e159 definitely_dead 0 2020-11-16T20:58:08.251 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:08.256+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:08.270 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:08.270 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:08.279 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:58:08.351 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:58:08.356+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:58:08.452 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:08.457+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:08.453 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:08.454 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:08.463 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:58:08.553 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:58:08.558+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:58:08.590 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:08.591 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:08.599 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:58:08.666 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:58:08.683 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:08.687+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:08.755 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:08.760+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:08.769 INFO:tasks.rados.rados.0.smithi166.stdout:1264: done (0 left) 2020-11-16T20:58:08.770 INFO:tasks.rados.rados.0.smithi166.stdout:1265: write oid 272 current snap is 57 2020-11-16T20:58:08.770 INFO:tasks.rados.rados.0.smithi166.stdout:1265: seq_num 696 ranges {497672=561427,1795232=702575,2963697=730968} 2020-11-16T20:58:08.777 INFO:teuthology.orchestra.run.smithi166.stderr:noscrub is set 2020-11-16T20:58:08.777 INFO:tasks.rados.rados.0.smithi166.stdout:1265: writing smithi16641208-272 from 497672 to 1059099 tid 1 2020-11-16T20:58:08.778 INFO:teuthology.orchestra.run.smithi166.stderr:marked in osd.1. 2020-11-16T20:58:08.779 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:08.779 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:08.786 INFO:tasks.rados.rados.0.smithi166.stdout:1265: writing smithi16641208-272 from 1795232 to 2497807 tid 2 2020-11-16T20:58:08.794 INFO:tasks.rados.rados.0.smithi166.stdout:1265: writing smithi16641208-272 from 2963697 to 3694665 tid 3 2020-11-16T20:58:08.794 INFO:tasks.rados.rados.0.smithi166.stdout:1266: rollback oid 171 current snap is 57 2020-11-16T20:58:08.794 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 171 to 48 2020-11-16T20:58:08.795 INFO:tasks.rados.rados.0.smithi166.stdout:1265: finishing write tid 1 to smithi16641208-272 2020-11-16T20:58:08.795 INFO:tasks.rados.rados.0.smithi166.stdout:1267: cache_try_flush oid 265 snap -1 2020-11-16T20:58:08.795 INFO:tasks.rados.rados.0.smithi166.stdout:1268: snap_remove snap 56 2020-11-16T20:58:08.796 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:58:08.797 INFO:tasks.thrashosds.thrasher:Added osd 1 2020-11-16T20:58:08.854 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:58:08.856 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:08.860+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:08.875 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:58:08.894 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:58:08.915 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:58:08.935 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:58:08.956 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:08.961+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:08.957 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:58:08.974 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:08.974 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:58:08.974 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:58:08.974 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:58:08.974 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.975 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2424 4.3 4:c5716d1e:::smithi16641208-111:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e46)", 2020-11-16T20:58:08.975 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.026685+0000", 2020-11-16T20:58:08.975 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 119.949660006, 2020-11-16T20:58:08.975 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065304164999999997, 2020-11-16T20:58:08.975 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:08.975 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:08.975 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:08.976 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:08.976 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:08.976 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2424 2020-11-16T20:58:08.976 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.976 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:08.976 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.976 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:08.977 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026685+0000", 2020-11-16T20:58:08.977 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:08.977 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.977 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.977 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:08.977 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026685+0000", 2020-11-16T20:58:08.977 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4087000000000001e-05 2020-11-16T20:58:08.978 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.978 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.978 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:08.978 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026719+0000", 2020-11-16T20:58:08.978 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2298e-05 2020-11-16T20:58:08.978 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.978 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.979 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:08.979 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026731+0000", 2020-11-16T20:58:08.979 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1001e-05 2020-11-16T20:58:08.979 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.979 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.979 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:08.979 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026742+0000", 2020-11-16T20:58:08.979 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6129999999999997e-06 2020-11-16T20:58:08.980 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.980 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.980 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:08.980 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026747+0000", 2020-11-16T20:58:08.980 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00047150600000000001 2020-11-16T20:58:08.980 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.980 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.981 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:08.981 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.027219+0000", 2020-11-16T20:58:08.981 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5602999999999998e-05 2020-11-16T20:58:08.981 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.981 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.981 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:08.981 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.027254+0000", 2020-11-16T20:58:08.982 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050318838999999997 2020-11-16T20:58:08.982 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.982 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.982 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:08.982 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.077573+0000", 2020-11-16T20:58:08.982 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6290000000000001e-05 2020-11-16T20:58:08.982 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.983 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.983 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:08.983 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.077669+0000", 2020-11-16T20:58:08.983 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014149599000000001 2020-11-16T20:58:08.983 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.983 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.983 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:08.983 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.091819+0000", 2020-11-16T20:58:08.984 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6891000000000005e-05 2020-11-16T20:58:08.984 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.984 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.984 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:08.984 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.091906+0000", 2020-11-16T20:58:08.984 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3437999999999996e-05 2020-11-16T20:58:08.984 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.985 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.985 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:08.985 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.091989+0000", 2020-11-16T20:58:08.985 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065304164999999997 2020-11-16T20:58:08.985 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:08.985 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:08.985 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:08.986 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.986 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.986 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.4.13:681 3.1 3:afc69464:::smithi16641208-110:head [copy-from ver 103] snapc 4=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e52)", 2020-11-16T20:58:08.986 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.786343+0000", 2020-11-16T20:58:08.986 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 114.190002365, 2020-11-16T20:58:08.986 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042629590000000002, 2020-11-16T20:58:08.986 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:08.986 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:08.987 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:08.987 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.987 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:08.987 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786343+0000", 2020-11-16T20:58:08.987 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:08.987 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.987 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.988 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:08.988 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786343+0000", 2020-11-16T20:58:08.988 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6380000000000002e-05 2020-11-16T20:58:08.988 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.988 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.988 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:08.988 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786369+0000", 2020-11-16T20:58:08.989 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8649999999999998e-06 2020-11-16T20:58:08.989 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.989 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.989 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:08.989 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786375+0000", 2020-11-16T20:58:08.989 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2170999999999999e-05 2020-11-16T20:58:08.989 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.989 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.990 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:08.990 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786387+0000", 2020-11-16T20:58:08.990 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8500000000000002e-06 2020-11-16T20:58:08.990 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.990 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.991 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:08.991 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786392+0000", 2020-11-16T20:58:08.991 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001049119 2020-11-16T20:58:08.991 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.991 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.991 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:08.991 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.787441+0000", 2020-11-16T20:58:08.991 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6489000000000006e-05 2020-11-16T20:58:08.992 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.992 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.992 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:08.992 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.787518+0000", 2020-11-16T20:58:08.992 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0097007229999999996 2020-11-16T20:58:08.992 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.992 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.993 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 3,4", 2020-11-16T20:58:08.993 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.797218+0000", 2020-11-16T20:58:08.993 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.012009956 2020-11-16T20:58:08.993 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.993 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.993 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:08.993 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.809228+0000", 2020-11-16T20:58:08.994 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019396673 2020-11-16T20:58:08.994 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.994 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.994 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:08.994 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828625+0000", 2020-11-16T20:58:08.994 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023723099999999999 2020-11-16T20:58:08.994 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.995 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.995 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:08.995 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828862+0000", 2020-11-16T20:58:08.995 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2475000000000002e-05 2020-11-16T20:58:08.995 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.995 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.995 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:08.995 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828915+0000", 2020-11-16T20:58:08.996 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7658000000000003e-05 2020-11-16T20:58:08.996 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.996 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.996 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:08.996 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.828972+0000", 2020-11-16T20:58:08.996 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042629590000000002 2020-11-16T20:58:08.996 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:08.997 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:08.997 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:08.997 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.997 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.997 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.4.13:682 3.1 3:b3ae2c4d:::smithi16641208-463:head [copy-from ver 402] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e52)", 2020-11-16T20:58:08.997 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:14.786452+0000", 2020-11-16T20:58:08.997 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 114.18989318, 2020-11-16T20:58:08.997 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042767143000000001, 2020-11-16T20:58:08.998 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:08.998 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:08.998 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:08.998 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.998 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:08.998 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786452+0000", 2020-11-16T20:58:08.998 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:08.999 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.999 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:08.999 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:08.999 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786452+0000", 2020-11-16T20:58:08.999 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.025e-05 2020-11-16T20:58:08.999 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:08.999 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.000 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.000 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786482+0000", 2020-11-16T20:58:09.000 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5779999999999999e-06 2020-11-16T20:58:09.000 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.000 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.000 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.000 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786486+0000", 2020-11-16T20:58:09.001 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0480000000000004e-06 2020-11-16T20:58:09.001 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.001 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.001 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.001 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786492+0000", 2020-11-16T20:58:09.001 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.101e-06 2020-11-16T20:58:09.001 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.001 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.002 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.002 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.786495+0000", 2020-11-16T20:58:09.002 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001206213 2020-11-16T20:58:09.002 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.002 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.002 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.002 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.787701+0000", 2020-11-16T20:58:09.003 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0668999999999998e-05 2020-11-16T20:58:09.003 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.003 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.003 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.003 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.787762+0000", 2020-11-16T20:58:09.003 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014276095000000001 2020-11-16T20:58:09.003 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.004 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.004 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 3,4", 2020-11-16T20:58:09.004 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.802038+0000", 2020-11-16T20:58:09.004 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0099596760000000006 2020-11-16T20:58:09.004 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.004 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.004 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.005 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.811997+0000", 2020-11-16T20:58:09.005 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017095757999999999 2020-11-16T20:58:09.005 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.005 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.005 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.005 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.829093+0000", 2020-11-16T20:58:09.005 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4833999999999998e-05 2020-11-16T20:58:09.005 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.006 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.006 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:09.006 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.829138+0000", 2020-11-16T20:58:09.006 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4724000000000001e-05 2020-11-16T20:58:09.006 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.006 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.006 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:09.007 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.829183+0000", 2020-11-16T20:58:09.007 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6196999999999999e-05 2020-11-16T20:58:09.007 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.007 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.007 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.007 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:14.829219+0000", 2020-11-16T20:58:09.007 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042767143000000001 2020-11-16T20:58:09.008 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.008 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.008 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.008 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.008 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.008 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2589 4.3 4:f65e82cb:::smithi16641208-219:head [write 1800933~725518] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:58:09.008 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.782219+0000", 2020-11-16T20:58:09.008 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 109.19412620999999, 2020-11-16T20:58:09.009 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.069486665000000003, 2020-11-16T20:58:09.009 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.009 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:09.009 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:09.009 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:09.009 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:09.009 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2589 2020-11-16T20:58:09.010 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.010 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.010 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.010 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.010 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782219+0000", 2020-11-16T20:58:09.010 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.010 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.011 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.011 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.011 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782219+0000", 2020-11-16T20:58:09.011 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00038710600000000002 2020-11-16T20:58:09.011 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.011 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.011 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.011 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782606+0000", 2020-11-16T20:58:09.012 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.628e-06 2020-11-16T20:58:09.012 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.012 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.012 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.012 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782616+0000", 2020-11-16T20:58:09.012 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5631999999999999e-05 2020-11-16T20:58:09.012 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.013 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.013 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.013 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782631+0000", 2020-11-16T20:58:09.013 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6249999999999998e-06 2020-11-16T20:58:09.013 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.013 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.013 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.013 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782639+0000", 2020-11-16T20:58:09.014 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3213999999999997e-05 2020-11-16T20:58:09.014 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.014 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.014 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.014 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782672+0000", 2020-11-16T20:58:09.014 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9141000000000003e-05 2020-11-16T20:58:09.014 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.015 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.015 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:09.015 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782721+0000", 2020-11-16T20:58:09.015 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017807030000000001 2020-11-16T20:58:09.015 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.015 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.015 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.016 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800528+0000", 2020-11-16T20:58:09.016 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016577399999999999 2020-11-16T20:58:09.016 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.016 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.016 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800694+0000", 2020-11-16T20:58:09.016 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00026135900000000002 2020-11-16T20:58:09.016 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.017 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.017 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:58:09.017 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800955+0000", 2020-11-16T20:58:09.017 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0074407529999999996 2020-11-16T20:58:09.017 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.017 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.017 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:09.018 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808396+0000", 2020-11-16T20:58:09.018 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011788041000000001 2020-11-16T20:58:09.018 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.018 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.018 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.018 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.820184+0000", 2020-11-16T20:58:09.018 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031417394000000001 2020-11-16T20:58:09.019 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.019 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.019 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.019 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851602+0000", 2020-11-16T20:58:09.019 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0005e-05 2020-11-16T20:58:09.019 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.019 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.019 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:09.020 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851652+0000", 2020-11-16T20:58:09.020 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3962999999999998e-05 2020-11-16T20:58:09.020 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.020 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.020 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.020 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851705+0000", 2020-11-16T20:58:09.020 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.069486665000000003 2020-11-16T20:58:09.021 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.021 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.021 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.021 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.021 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.021 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2590 4.3 4:f65e82cb:::smithi16641208-219:head [write 2944601~232021] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:58:09.021 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.785957+0000", 2020-11-16T20:58:09.021 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 109.19038852, 2020-11-16T20:58:09.022 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065959045999999993, 2020-11-16T20:58:09.022 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.022 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:09.022 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:09.022 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:09.022 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:09.022 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2590 2020-11-16T20:58:09.023 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.023 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.023 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.023 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.023 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.785957+0000", 2020-11-16T20:58:09.023 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.023 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.024 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.024 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.024 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.785957+0000", 2020-11-16T20:58:09.024 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6058999999999998e-05 2020-11-16T20:58:09.024 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.024 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.024 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.024 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786033+0000", 2020-11-16T20:58:09.025 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1582999999999999e-05 2020-11-16T20:58:09.025 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.025 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.025 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.025 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786064+0000", 2020-11-16T20:58:09.025 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8099999999999992e-06 2020-11-16T20:58:09.025 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.026 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.026 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.026 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786074+0000", 2020-11-16T20:58:09.026 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.198e-06 2020-11-16T20:58:09.026 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.026 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.026 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.027 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786079+0000", 2020-11-16T20:58:09.027 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0587999999999997e-05 2020-11-16T20:58:09.027 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.027 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.027 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.027 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786130+0000", 2020-11-16T20:58:09.027 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5791000000000007e-05 2020-11-16T20:58:09.027 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.028 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.028 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:09.028 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786206+0000", 2020-11-16T20:58:09.028 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016623412000000001 2020-11-16T20:58:09.028 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.028 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.028 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.029 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.802829+0000", 2020-11-16T20:58:09.029 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012361699999999999 2020-11-16T20:58:09.029 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.029 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.029 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.029 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.802953+0000", 2020-11-16T20:58:09.029 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000161807 2020-11-16T20:58:09.030 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.030 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.030 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:58:09.030 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.803114+0000", 2020-11-16T20:58:09.030 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.005291535 2020-11-16T20:58:09.030 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.030 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.030 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:09.031 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808406+0000", 2020-11-16T20:58:09.031 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011819998999999999 2020-11-16T20:58:09.031 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.031 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.031 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.031 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.820226+0000", 2020-11-16T20:58:09.031 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031546375000000001 2020-11-16T20:58:09.032 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.032 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.032 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.032 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851772+0000", 2020-11-16T20:58:09.032 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9140000000000005e-05 2020-11-16T20:58:09.032 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.032 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.032 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:09.033 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851851+0000", 2020-11-16T20:58:09.033 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4132000000000002e-05 2020-11-16T20:58:09.033 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.033 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.033 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.033 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851916+0000", 2020-11-16T20:58:09.033 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065959045999999993 2020-11-16T20:58:09.034 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.034 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.034 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.034 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.034 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.034 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2591 4.3 4:f65e82cb:::smithi16641208-219:head [setxattr _header (58) in=7b,truncate 3176622] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:58:09.034 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.786110+0000", 2020-11-16T20:58:09.035 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 109.190234987, 2020-11-16T20:58:09.035 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066016654999999994, 2020-11-16T20:58:09.035 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.035 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:09.035 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:09.035 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:09.035 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:09.036 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2591 2020-11-16T20:58:09.036 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.036 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.036 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.036 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.036 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786110+0000", 2020-11-16T20:58:09.036 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.036 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.037 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.037 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.037 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786110+0000", 2020-11-16T20:58:09.037 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5616e-05 2020-11-16T20:58:09.037 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.037 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.037 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.038 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786136+0000", 2020-11-16T20:58:09.038 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5329999999999999e-06 2020-11-16T20:58:09.038 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.038 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.038 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.038 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786139+0000", 2020-11-16T20:58:09.038 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7440000000000004e-06 2020-11-16T20:58:09.038 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.039 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.039 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.039 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786145+0000", 2020-11-16T20:58:09.039 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0120000000000001e-06 2020-11-16T20:58:09.039 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.039 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.039 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.040 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786148+0000", 2020-11-16T20:58:09.040 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5617000000000004e-05 2020-11-16T20:58:09.040 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.040 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.040 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.040 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786234+0000", 2020-11-16T20:58:09.040 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0964000000000001e-05 2020-11-16T20:58:09.041 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.041 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.041 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:09.041 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786295+0000", 2020-11-16T20:58:09.041 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017673271000000001 2020-11-16T20:58:09.041 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.041 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.041 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.042 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.803968+0000", 2020-11-16T20:58:09.042 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000155272 2020-11-16T20:58:09.042 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.042 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.042 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.042 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.804123+0000", 2020-11-16T20:58:09.042 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00027357299999999999 2020-11-16T20:58:09.043 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.043 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.043 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:58:09.043 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.804397+0000", 2020-11-16T20:58:09.043 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040142659999999998 2020-11-16T20:58:09.043 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.043 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.044 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:09.044 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808411+0000", 2020-11-16T20:58:09.044 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011837194000000001 2020-11-16T20:58:09.044 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.044 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.044 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.044 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.820248+0000", 2020-11-16T20:58:09.044 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031735780999999998 2020-11-16T20:58:09.045 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.045 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.045 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.045 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851984+0000", 2020-11-16T20:58:09.045 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0603000000000001e-05 2020-11-16T20:58:09.045 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.045 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.046 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:09.046 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852054+0000", 2020-11-16T20:58:09.046 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2208999999999999e-05 2020-11-16T20:58:09.046 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.046 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.046 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.046 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852127+0000", 2020-11-16T20:58:09.046 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066016654999999994 2020-11-16T20:58:09.047 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.047 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.047 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.047 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.047 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.047 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2592 4.3 4:f65e82cb:::smithi16641208-219:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:58:09.047 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.786176+0000", 2020-11-16T20:58:09.048 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 109.190169504, 2020-11-16T20:58:09.048 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066389967999999994, 2020-11-16T20:58:09.048 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.048 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:09.048 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:09.048 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:09.048 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:09.048 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2592 2020-11-16T20:58:09.049 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.049 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.049 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.049 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.049 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786176+0000", 2020-11-16T20:58:09.049 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.049 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.050 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.050 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.050 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786176+0000", 2020-11-16T20:58:09.050 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1280999999999998e-05 2020-11-16T20:58:09.050 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.050 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.050 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.051 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786197+0000", 2020-11-16T20:58:09.051 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.349e-06 2020-11-16T20:58:09.051 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.051 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.051 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.051 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786200+0000", 2020-11-16T20:58:09.051 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4840000000000001e-06 2020-11-16T20:58:09.051 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.052 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.052 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.052 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786207+0000", 2020-11-16T20:58:09.052 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3390000000000001e-06 2020-11-16T20:58:09.052 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.052 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.052 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.053 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786210+0000", 2020-11-16T20:58:09.053 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000115748 2020-11-16T20:58:09.053 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.053 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.053 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.053 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786326+0000", 2020-11-16T20:58:09.053 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6062e-05 2020-11-16T20:58:09.054 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.054 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.054 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:09.054 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786372+0000", 2020-11-16T20:58:09.054 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021773975000000001 2020-11-16T20:58:09.054 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.054 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.054 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.055 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808146+0000", 2020-11-16T20:58:09.055 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014829900000000001 2020-11-16T20:58:09.055 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.055 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.055 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:09.055 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808294+0000", 2020-11-16T20:58:09.055 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.043877869999999999 2020-11-16T20:58:09.056 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.056 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.056 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.056 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852172+0000", 2020-11-16T20:58:09.056 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000145322 2020-11-16T20:58:09.056 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.056 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.057 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.057 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852317+0000", 2020-11-16T20:58:09.057 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024823899999999998 2020-11-16T20:58:09.057 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.057 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.057 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.057 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852565+0000", 2020-11-16T20:58:09.057 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066389967999999994 2020-11-16T20:58:09.058 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.058 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.058 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.058 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.058 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.058 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2593 4.3 4:f5f8fa2a:::smithi16641208-144:head [copy-from ver 64] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:58:09.058 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.786250+0000", 2020-11-16T20:58:09.059 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 109.19009472499999, 2020-11-16T20:58:09.059 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065186216000000005, 2020-11-16T20:58:09.059 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.059 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:09.059 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:09.059 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:09.059 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:09.060 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2593 2020-11-16T20:58:09.060 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.060 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.060 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.060 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.060 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786250+0000", 2020-11-16T20:58:09.060 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.060 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.061 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.061 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.061 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786250+0000", 2020-11-16T20:58:09.061 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2438999999999998e-05 2020-11-16T20:58:09.061 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.061 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.061 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.062 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786293+0000", 2020-11-16T20:58:09.062 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6840000000000001e-06 2020-11-16T20:58:09.062 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.062 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.062 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.062 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786298+0000", 2020-11-16T20:58:09.062 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4331999999999999e-05 2020-11-16T20:58:09.062 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.063 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.063 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.063 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786313+0000", 2020-11-16T20:58:09.063 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6460000000000001e-06 2020-11-16T20:58:09.063 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.063 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.063 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.064 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786317+0000", 2020-11-16T20:58:09.064 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5451999999999995e-05 2020-11-16T20:58:09.064 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.064 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.064 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.064 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786393+0000", 2020-11-16T20:58:09.064 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065041011999999995 2020-11-16T20:58:09.065 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:09.065 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851434+0000", 2020-11-16T20:58:09.065 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6510000000000001e-06 2020-11-16T20:58:09.065 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851437+0000", 2020-11-16T20:58:09.066 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065186216000000005 2020-11-16T20:58:09.066 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.066 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.066 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.066 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.066 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.067 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2594 4.3 4:f5f8fa2a:::smithi16641208-144:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:58:09.067 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.786352+0000", 2020-11-16T20:58:09.067 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 109.18999343199999, 2020-11-16T20:58:09.067 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.089305972999999997, 2020-11-16T20:58:09.067 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.067 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:09.067 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:09.068 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:09.068 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:09.068 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2594 2020-11-16T20:58:09.068 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.068 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.068 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.068 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.068 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786352+0000", 2020-11-16T20:58:09.069 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.069 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.069 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.069 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.069 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786352+0000", 2020-11-16T20:58:09.069 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5896000000000001e-05 2020-11-16T20:58:09.069 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.070 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.070 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.070 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786377+0000", 2020-11-16T20:58:09.070 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7700000000000004e-06 2020-11-16T20:58:09.070 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.070 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.070 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.070 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786384+0000", 2020-11-16T20:58:09.071 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.049e-05 2020-11-16T20:58:09.071 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.071 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.071 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.071 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786395+0000", 2020-11-16T20:58:09.071 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0440000000000003e-06 2020-11-16T20:58:09.071 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.072 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.072 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.072 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786400+0000", 2020-11-16T20:58:09.072 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000366771 2020-11-16T20:58:09.072 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.072 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.072 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.072 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786767+0000", 2020-11-16T20:58:09.073 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1366999999999998e-05 2020-11-16T20:58:09.073 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.073 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.073 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:09.073 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786818+0000", 2020-11-16T20:58:09.073 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.077259257999999997 2020-11-16T20:58:09.073 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.074 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.074 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.074 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.864077+0000", 2020-11-16T20:58:09.074 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018375499999999999 2020-11-16T20:58:09.074 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.074 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.074 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:09.075 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.864261+0000", 2020-11-16T20:58:09.075 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011122837 2020-11-16T20:58:09.075 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.075 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.075 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.075 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.875384+0000", 2020-11-16T20:58:09.075 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000135752 2020-11-16T20:58:09.075 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.076 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.076 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.076 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.875520+0000", 2020-11-16T20:58:09.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000138033 2020-11-16T20:58:09.076 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.076 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.076 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.077 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.875658+0000", 2020-11-16T20:58:09.077 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.089305972999999997 2020-11-16T20:58:09.077 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.077 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.077 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.077 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.077 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.077 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2872 4.3 4:d9c18080:::smithi16641208-173:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-11-16T20:58:09.078 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:34.745479+0000", 2020-11-16T20:58:09.078 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 94.230866168000006, 2020-11-16T20:58:09.078 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.059388271999999999, 2020-11-16T20:58:09.078 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.078 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:09.078 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:09.078 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:09.079 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:09.079 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2872 2020-11-16T20:58:09.079 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.079 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.079 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.079 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.079 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745479+0000", 2020-11-16T20:58:09.080 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.080 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.080 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.080 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.080 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745479+0000", 2020-11-16T20:58:09.080 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0491e-05 2020-11-16T20:58:09.080 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.081 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.081 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.081 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745509+0000", 2020-11-16T20:58:09.081 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9170000000000003e-06 2020-11-16T20:58:09.081 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.081 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.081 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.081 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745515+0000", 2020-11-16T20:58:09.082 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1267000000000001e-05 2020-11-16T20:58:09.082 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.082 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.082 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.082 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745527+0000", 2020-11-16T20:58:09.082 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.04e-06 2020-11-16T20:58:09.082 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.083 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.083 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.083 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745532+0000", 2020-11-16T20:58:09.083 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034800500000000003 2020-11-16T20:58:09.083 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.083 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.083 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.083 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745880+0000", 2020-11-16T20:58:09.084 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6010000000000003e-05 2020-11-16T20:58:09.084 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.084 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.084 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:09.084 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745916+0000", 2020-11-16T20:58:09.084 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042557927000000002 2020-11-16T20:58:09.084 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.085 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.085 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.085 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.788474+0000", 2020-11-16T20:58:09.085 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000160614 2020-11-16T20:58:09.085 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.085 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.085 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:09.085 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.788634+0000", 2020-11-16T20:58:09.086 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016066745 2020-11-16T20:58:09.086 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.086 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.086 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.086 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.804701+0000", 2020-11-16T20:58:09.086 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3805000000000001e-05 2020-11-16T20:58:09.086 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.087 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.087 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.087 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.804785+0000", 2020-11-16T20:58:09.087 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2451000000000001e-05 2020-11-16T20:58:09.087 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.087 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.087 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.088 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.804867+0000", 2020-11-16T20:58:09.088 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.059388271999999999 2020-11-16T20:58:09.088 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.088 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.088 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.088 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.088 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.088 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2962 4.3 4:c925a80f:::smithi16641208-375:head [write 1381780~411527] snapc 2d=[2d,25] ondisk+write+known_if_redirected e82)", 2020-11-16T20:58:09.089 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.749629+0000", 2020-11-16T20:58:09.089 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 84.226716409999995, 2020-11-16T20:58:09.089 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.052987905000000002, 2020-11-16T20:58:09.089 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.089 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:09.089 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:09.089 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:09.090 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:09.090 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2962 2020-11-16T20:58:09.090 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.090 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.090 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.090 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.090 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.749629+0000", 2020-11-16T20:58:09.091 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.091 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.091 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.091 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.091 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.749629+0000", 2020-11-16T20:58:09.091 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00039027700000000002 2020-11-16T20:58:09.091 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.091 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.092 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.092 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750019+0000", 2020-11-16T20:58:09.092 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0961000000000001e-05 2020-11-16T20:58:09.092 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.092 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.092 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.092 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750030+0000", 2020-11-16T20:58:09.093 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7931000000000002e-05 2020-11-16T20:58:09.093 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.093 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.093 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.093 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750048+0000", 2020-11-16T20:58:09.093 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3030000000000005e-06 2020-11-16T20:58:09.093 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.094 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.094 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.094 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750057+0000", 2020-11-16T20:58:09.094 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8351999999999999e-05 2020-11-16T20:58:09.094 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.094 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.094 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.094 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750125+0000", 2020-11-16T20:58:09.095 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010314000000000001 2020-11-16T20:58:09.095 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.095 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.095 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:09.095 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750229+0000", 2020-11-16T20:58:09.095 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039625369000000001 2020-11-16T20:58:09.095 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.096 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.096 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.096 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.789854+0000", 2020-11-16T20:58:09.096 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000153096 2020-11-16T20:58:09.096 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.096 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.096 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.096 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790007+0000", 2020-11-16T20:58:09.097 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022176699999999999 2020-11-16T20:58:09.097 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.097 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.097 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:58:09.097 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790229+0000", 2020-11-16T20:58:09.097 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0059379410000000004 2020-11-16T20:58:09.097 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.098 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.098 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:09.098 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.796167+0000", 2020-11-16T20:58:09.098 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0013346230000000001 2020-11-16T20:58:09.098 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.098 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.098 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.099 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.797501+0000", 2020-11-16T20:58:09.099 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0049809470000000003 2020-11-16T20:58:09.099 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.099 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.099 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.099 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802482+0000", 2020-11-16T20:58:09.099 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1831999999999998e-05 2020-11-16T20:58:09.099 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.100 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.100 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:09.100 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802574+0000", 2020-11-16T20:58:09.100 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2366000000000001e-05 2020-11-16T20:58:09.100 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.100 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.100 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.101 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802617+0000", 2020-11-16T20:58:09.101 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.052987905000000002 2020-11-16T20:58:09.101 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.101 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.101 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.101 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.101 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.102 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2963 4.3 4:c925a80f:::smithi16641208-375:head [write 2300501~586966] snapc 2d=[2d,25] ondisk+write+known_if_redirected e82)", 2020-11-16T20:58:09.102 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.756229+0000", 2020-11-16T20:58:09.102 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 84.220116106000006, 2020-11-16T20:58:09.102 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.046550438999999999, 2020-11-16T20:58:09.102 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.102 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:09.102 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:09.102 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:09.103 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:09.103 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2963 2020-11-16T20:58:09.103 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.103 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.103 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.103 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.103 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.756229+0000", 2020-11-16T20:58:09.104 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.104 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.104 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.104 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.104 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.756229+0000", 2020-11-16T20:58:09.104 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00042272700000000002 2020-11-16T20:58:09.104 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.105 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.105 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.105 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.756652+0000", 2020-11-16T20:58:09.105 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.7900000000000005e-06 2020-11-16T20:58:09.105 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.105 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.105 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.105 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.756660+0000", 2020-11-16T20:58:09.106 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8972000000000001e-05 2020-11-16T20:58:09.106 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.106 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.106 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.106 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.756679+0000", 2020-11-16T20:58:09.106 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.4299999999999995e-06 2020-11-16T20:58:09.106 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.107 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.107 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.107 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.756689+0000", 2020-11-16T20:58:09.107 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002317586 2020-11-16T20:58:09.107 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.107 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.107 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.107 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759006+0000", 2020-11-16T20:58:09.108 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2758999999999997e-05 2020-11-16T20:58:09.108 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.108 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.108 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:09.108 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.759099+0000", 2020-11-16T20:58:09.108 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032185841 2020-11-16T20:58:09.108 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.109 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.109 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.109 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.791285+0000", 2020-11-16T20:58:09.109 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018714299999999999 2020-11-16T20:58:09.109 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.109 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.109 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.109 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.791472+0000", 2020-11-16T20:58:09.110 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00025010899999999999 2020-11-16T20:58:09.110 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.110 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.110 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:58:09.110 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.791722+0000", 2020-11-16T20:58:09.110 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044518370000000002 2020-11-16T20:58:09.110 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.111 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.111 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:09.111 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.796174+0000", 2020-11-16T20:58:09.111 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0015727860000000001 2020-11-16T20:58:09.111 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.111 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.111 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.112 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.797747+0000", 2020-11-16T20:58:09.112 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0049201610000000002 2020-11-16T20:58:09.112 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.112 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.112 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.112 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802667+0000", 2020-11-16T20:58:09.112 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3230000000000003e-05 2020-11-16T20:58:09.112 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.113 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:09.113 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802730+0000", 2020-11-16T20:58:09.113 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9067999999999998e-05 2020-11-16T20:58:09.113 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.113 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.114 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802779+0000", 2020-11-16T20:58:09.114 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.046550438999999999 2020-11-16T20:58:09.114 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.114 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.114 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.114 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.114 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.114 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2997 4.3 4:f5e68fa8:::smithi16641208-361:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e86)", 2020-11-16T20:58:09.115 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838418+0000", 2020-11-16T20:58:09.115 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 80.137926699000005, 2020-11-16T20:58:09.115 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.056590020999999997, 2020-11-16T20:58:09.115 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.115 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:09.115 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:09.115 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:09.116 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:09.116 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2997 2020-11-16T20:58:09.116 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.116 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.116 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.116 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.116 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838418+0000", 2020-11-16T20:58:09.117 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.117 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.117 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.117 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.117 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838418+0000", 2020-11-16T20:58:09.117 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9998999999999999e-05 2020-11-16T20:58:09.117 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.117 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.118 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.118 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838448+0000", 2020-11-16T20:58:09.118 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3640000000000004e-06 2020-11-16T20:58:09.118 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.118 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.118 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.118 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838455+0000", 2020-11-16T20:58:09.119 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1902999999999999e-05 2020-11-16T20:58:09.119 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.119 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.119 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.119 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838467+0000", 2020-11-16T20:58:09.119 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1699999999999996e-06 2020-11-16T20:58:09.119 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.119 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.120 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.120 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838472+0000", 2020-11-16T20:58:09.120 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00047208200000000002 2020-11-16T20:58:09.120 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.120 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.120 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.120 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838944+0000", 2020-11-16T20:58:09.121 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6712000000000002e-05 2020-11-16T20:58:09.121 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.121 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.121 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:09.121 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.839001+0000", 2020-11-16T20:58:09.121 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038817664000000002 2020-11-16T20:58:09.121 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.122 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.122 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.122 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.877818+0000", 2020-11-16T20:58:09.122 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000119492 2020-11-16T20:58:09.122 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.122 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.122 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:09.122 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.877938+0000", 2020-11-16T20:58:09.123 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016797409999999999 2020-11-16T20:58:09.123 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.123 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.123 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.123 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.894735+0000", 2020-11-16T20:58:09.123 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015645500000000001 2020-11-16T20:58:09.123 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.124 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.124 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.124 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.894892+0000", 2020-11-16T20:58:09.124 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011677 2020-11-16T20:58:09.124 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.124 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.124 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.124 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.895008+0000", 2020-11-16T20:58:09.125 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.056590020999999997 2020-11-16T20:58:09.125 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.125 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.125 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.125 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.125 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.125 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3520 4.3 4:f686f74f:::smithi16641208-134:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e129)", 2020-11-16T20:58:09.126 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.027796+0000", 2020-11-16T20:58:09.126 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 34.948549038000003, 2020-11-16T20:58:09.126 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.051377742999999997, 2020-11-16T20:58:09.126 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.126 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:09.126 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:09.126 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:09.127 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:09.127 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3520 2020-11-16T20:58:09.127 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.127 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.127 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.127 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.127 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.027796+0000", 2020-11-16T20:58:09.127 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.128 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.128 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.128 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.128 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.027796+0000", 2020-11-16T20:58:09.128 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5429000000000001e-05 2020-11-16T20:58:09.128 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.128 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.129 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.129 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.027811+0000", 2020-11-16T20:58:09.129 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2150000000000001e-06 2020-11-16T20:58:09.129 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.129 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.129 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.129 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.027815+0000", 2020-11-16T20:58:09.129 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4620000000000001e-06 2020-11-16T20:58:09.130 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.130 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.130 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.130 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.027821+0000", 2020-11-16T20:58:09.130 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.602e-06 2020-11-16T20:58:09.130 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.130 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.131 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.131 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.027825+0000", 2020-11-16T20:58:09.131 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030451419999999998 2020-11-16T20:58:09.131 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.131 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.131 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.131 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.030870+0000", 2020-11-16T20:58:09.132 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8892000000000003e-05 2020-11-16T20:58:09.132 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.132 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.132 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:09.132 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.030949+0000", 2020-11-16T20:58:09.132 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036413867000000003 2020-11-16T20:58:09.132 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.132 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.133 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.133 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.067363+0000", 2020-11-16T20:58:09.133 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000102604 2020-11-16T20:58:09.133 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.133 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.133 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:09.133 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.067465+0000", 2020-11-16T20:58:09.134 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011558476999999999 2020-11-16T20:58:09.134 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.134 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.134 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.134 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.079024+0000", 2020-11-16T20:58:09.134 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5964999999999995e-05 2020-11-16T20:58:09.134 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.135 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.135 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.135 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.079100+0000", 2020-11-16T20:58:09.135 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4087999999999999e-05 2020-11-16T20:58:09.135 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.135 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.135 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.135 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.079174+0000", 2020-11-16T20:58:09.136 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.051377742999999997 2020-11-16T20:58:09.136 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.136 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.136 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.136 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.136 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.136 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3532 3.1 3:b7adb356:::smithi16641208-217:head [copy-from ver 367] snapc 55=[55,54] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e130)", 2020-11-16T20:58:09.137 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.753942+0000", 2020-11-16T20:58:09.137 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 34.222403288000002, 2020-11-16T20:58:09.137 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047131423999999998, 2020-11-16T20:58:09.137 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.137 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:09.137 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.137 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.137 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.138 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.753942+0000", 2020-11-16T20:58:09.138 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.138 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.138 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.138 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.138 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.753942+0000", 2020-11-16T20:58:09.138 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5958999999999999e-05 2020-11-16T20:58:09.139 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.139 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.139 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.139 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.753978+0000", 2020-11-16T20:58:09.139 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.4690000000000003e-06 2020-11-16T20:58:09.139 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.139 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.140 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.140 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.753987+0000", 2020-11-16T20:58:09.140 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9670000000000001e-06 2020-11-16T20:58:09.140 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.140 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.140 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.140 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.753995+0000", 2020-11-16T20:58:09.140 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2239999999999997e-06 2020-11-16T20:58:09.141 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.141 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.141 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.141 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.753999+0000", 2020-11-16T20:58:09.141 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4675999999999998e-05 2020-11-16T20:58:09.141 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.141 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.142 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.142 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754034+0000", 2020-11-16T20:58:09.142 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000128904 2020-11-16T20:58:09.142 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.142 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.142 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.142 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754163+0000", 2020-11-16T20:58:09.142 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027384763999999999 2020-11-16T20:58:09.143 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.143 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.143 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 3,4", 2020-11-16T20:58:09.143 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.781548+0000", 2020-11-16T20:58:09.143 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013643198 2020-11-16T20:58:09.143 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.143 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.144 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.144 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.795191+0000", 2020-11-16T20:58:09.144 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039137180000000001 2020-11-16T20:58:09.144 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.144 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.144 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:09.144 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.799105+0000", 2020-11-16T20:58:09.145 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0018368010000000001 2020-11-16T20:58:09.145 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.145 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.145 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.145 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.800941+0000", 2020-11-16T20:58:09.145 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4453999999999997e-05 2020-11-16T20:58:09.145 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.145 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.146 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:09.146 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.800996+0000", 2020-11-16T20:58:09.146 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.729e-05 2020-11-16T20:58:09.146 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.146 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.146 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.146 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801073+0000", 2020-11-16T20:58:09.147 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047131423999999998 2020-11-16T20:58:09.147 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.147 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.147 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.147 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.147 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.147 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.4.13:907 3.1 3:b7adb356:::smithi16641208-217:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e130)", 2020-11-16T20:58:09.148 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.754031+0000", 2020-11-16T20:58:09.148 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 34.222313583999998, 2020-11-16T20:58:09.148 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047316312999999999, 2020-11-16T20:58:09.148 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.148 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:09.148 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.148 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.148 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.149 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754031+0000", 2020-11-16T20:58:09.149 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.149 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.149 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.149 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.149 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754031+0000", 2020-11-16T20:58:09.149 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5764999999999999e-05 2020-11-16T20:58:09.150 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.150 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.150 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.150 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754047+0000", 2020-11-16T20:58:09.150 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8829999999999997e-06 2020-11-16T20:58:09.150 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.150 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.151 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.151 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754052+0000", 2020-11-16T20:58:09.151 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6109999999999994e-06 2020-11-16T20:58:09.151 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.151 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.151 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.151 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754061+0000", 2020-11-16T20:58:09.151 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9720000000000001e-06 2020-11-16T20:58:09.152 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.152 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.152 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.152 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754064+0000", 2020-11-16T20:58:09.152 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030018699999999999 2020-11-16T20:58:09.152 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.152 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.153 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.153 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754364+0000", 2020-11-16T20:58:09.153 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7373000000000001e-05 2020-11-16T20:58:09.153 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.153 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.153 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:09.153 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754421+0000", 2020-11-16T20:58:09.153 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033699264999999999 2020-11-16T20:58:09.154 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.154 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.154 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.154 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788120+0000", 2020-11-16T20:58:09.154 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000115717 2020-11-16T20:58:09.154 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.154 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.155 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:09.155 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788236+0000", 2020-11-16T20:58:09.155 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0128638 2020-11-16T20:58:09.155 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.155 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.155 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.155 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801100+0000", 2020-11-16T20:58:09.156 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000112217 2020-11-16T20:58:09.156 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.156 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.156 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.156 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801212+0000", 2020-11-16T20:58:09.156 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000135523 2020-11-16T20:58:09.156 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.157 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.157 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.157 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801348+0000", 2020-11-16T20:58:09.157 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047316312999999999 2020-11-16T20:58:09.157 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.157 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.157 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.157 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.158 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.158 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.4.13:908 3.1 3:b7adb356:::smithi16641208-217:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e130)", 2020-11-16T20:58:09.158 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.754089+0000", 2020-11-16T20:58:09.158 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 34.222255666000002, 2020-11-16T20:58:09.158 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050485306000000001, 2020-11-16T20:58:09.158 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.158 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:09.159 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.159 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.159 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.159 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754089+0000", 2020-11-16T20:58:09.159 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.159 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.159 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.160 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.160 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754089+0000", 2020-11-16T20:58:09.160 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1849e-05 2020-11-16T20:58:09.160 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.160 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.160 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.160 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754111+0000", 2020-11-16T20:58:09.160 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.309e-06 2020-11-16T20:58:09.161 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.161 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.161 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.161 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754115+0000", 2020-11-16T20:58:09.161 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.784e-06 2020-11-16T20:58:09.161 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.161 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.162 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.162 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754120+0000", 2020-11-16T20:58:09.162 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4829999999999999e-06 2020-11-16T20:58:09.162 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.162 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.162 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.162 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754124+0000", 2020-11-16T20:58:09.163 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033225300000000002 2020-11-16T20:58:09.163 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.163 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.163 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.163 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754456+0000", 2020-11-16T20:58:09.163 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1177000000000001e-05 2020-11-16T20:58:09.163 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.163 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.164 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:09.164 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754507+0000", 2020-11-16T20:58:09.164 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033760357999999997 2020-11-16T20:58:09.164 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.164 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.164 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.164 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788268+0000", 2020-11-16T20:58:09.165 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0700999999999998e-05 2020-11-16T20:58:09.165 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.165 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.165 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:09.165 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788358+0000", 2020-11-16T20:58:09.165 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013027209999999999 2020-11-16T20:58:09.165 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.165 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.166 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.166 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801385+0000", 2020-11-16T20:58:09.166 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010369099999999999 2020-11-16T20:58:09.166 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.166 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.166 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.166 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801489+0000", 2020-11-16T20:58:09.167 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030854910000000001 2020-11-16T20:58:09.167 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.167 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.167 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.167 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.804575+0000", 2020-11-16T20:58:09.167 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050485306000000001 2020-11-16T20:58:09.167 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.168 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.168 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.168 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.168 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.168 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3631 4.3 4:e109c45f:::smithi16641208-11:head [write 2106184~763893] snapc 5e=[5e,5c,5b] ondisk+write+known_if_redirected e137)", 2020-11-16T20:58:09.168 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:41.964001+0000", 2020-11-16T20:58:09.168 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 27.012344121000002, 2020-11-16T20:58:09.168 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.044691831000000001, 2020-11-16T20:58:09.169 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.169 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:09.169 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:09.169 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:09.169 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:09.169 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3631 2020-11-16T20:58:09.169 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.170 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.170 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.170 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.170 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.964001+0000", 2020-11-16T20:58:09.170 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.170 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.170 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.171 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.171 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.964001+0000", 2020-11-16T20:58:09.171 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00035847199999999998 2020-11-16T20:58:09.171 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.171 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.171 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.171 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.964359+0000", 2020-11-16T20:58:09.172 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.96e-06 2020-11-16T20:58:09.172 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.172 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.172 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.172 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.964367+0000", 2020-11-16T20:58:09.172 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.764e-06 2020-11-16T20:58:09.172 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.172 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.173 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.173 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.964377+0000", 2020-11-16T20:58:09.173 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8159999999999999e-06 2020-11-16T20:58:09.173 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.173 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.173 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.173 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.964383+0000", 2020-11-16T20:58:09.174 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3074000000000001e-05 2020-11-16T20:58:09.174 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.174 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.174 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.174 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.964426+0000", 2020-11-16T20:58:09.174 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1558999999999999e-05 2020-11-16T20:58:09.174 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.175 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.175 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:09.175 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.964478+0000", 2020-11-16T20:58:09.175 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021995357 2020-11-16T20:58:09.175 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.175 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.175 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.175 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.986473+0000", 2020-11-16T20:58:09.176 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010155 2020-11-16T20:58:09.176 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.176 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.176 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.176 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.986574+0000", 2020-11-16T20:58:09.176 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015197299999999999 2020-11-16T20:58:09.176 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.177 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.177 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:58:09.177 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.986726+0000", 2020-11-16T20:58:09.177 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040906049999999998 2020-11-16T20:58:09.177 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.177 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.177 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:09.177 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.990817+0000", 2020-11-16T20:58:09.178 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006250706 2020-11-16T20:58:09.178 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.178 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.178 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.178 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.997068+0000", 2020-11-16T20:58:09.178 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011535702 2020-11-16T20:58:09.178 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.179 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.179 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.179 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:42.008603+0000", 2020-11-16T20:58:09.179 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5884000000000002e-05 2020-11-16T20:58:09.179 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.179 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.179 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:09.179 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:42.008659+0000", 2020-11-16T20:58:09.180 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3408999999999998e-05 2020-11-16T20:58:09.180 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.180 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.180 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.180 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:42.008693+0000", 2020-11-16T20:58:09.180 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.044691831000000001 2020-11-16T20:58:09.180 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.181 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.181 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.181 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.181 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.181 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3632 4.3 4:e109c45f:::smithi16641208-11:head [setxattr _header (57) in=7b,truncate 3193462] snapc 5e=[5e,5c,5b] ondisk+write+known_if_redirected e137)", 2020-11-16T20:58:09.181 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:41.964418+0000", 2020-11-16T20:58:09.181 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 27.011927497999999, 2020-11-16T20:58:09.182 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.044455040000000001, 2020-11-16T20:58:09.182 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.182 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:09.182 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:09.182 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:09.182 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:09.182 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3632 2020-11-16T20:58:09.183 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.183 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.183 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.183 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.183 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.964418+0000", 2020-11-16T20:58:09.183 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.183 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.183 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.184 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.184 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.964418+0000", 2020-11-16T20:58:09.184 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6418000000000002e-05 2020-11-16T20:58:09.184 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.184 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.184 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.184 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.964464+0000", 2020-11-16T20:58:09.185 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7490000000000004e-06 2020-11-16T20:58:09.185 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.185 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.185 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.185 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.964470+0000", 2020-11-16T20:58:09.185 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.255e-06 2020-11-16T20:58:09.185 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.185 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.186 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.186 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.964477+0000", 2020-11-16T20:58:09.186 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1309999999999999e-06 2020-11-16T20:58:09.186 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.186 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.186 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.186 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.964481+0000", 2020-11-16T20:58:09.187 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2932999999999997e-05 2020-11-16T20:58:09.187 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.187 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.187 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.187 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.964524+0000", 2020-11-16T20:58:09.187 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4022999999999993e-05 2020-11-16T20:58:09.187 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.188 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.188 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:09.188 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.964588+0000", 2020-11-16T20:58:09.188 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024021687 2020-11-16T20:58:09.188 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.188 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.188 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.188 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.988610+0000", 2020-11-16T20:58:09.189 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8374000000000006e-05 2020-11-16T20:58:09.189 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.189 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.189 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.189 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.988688+0000", 2020-11-16T20:58:09.189 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000118626 2020-11-16T20:58:09.189 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.190 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.190 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:58:09.190 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.988807+0000", 2020-11-16T20:58:09.190 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00217074 2020-11-16T20:58:09.190 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.190 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.190 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:09.191 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.990977+0000", 2020-11-16T20:58:09.191 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0062660019999999997 2020-11-16T20:58:09.191 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.191 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.191 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.191 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.997243+0000", 2020-11-16T20:58:09.191 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011544130999999999 2020-11-16T20:58:09.191 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.192 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.192 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.192 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:42.008788+0000", 2020-11-16T20:58:09.192 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2840000000000003e-05 2020-11-16T20:58:09.192 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.192 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.192 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:09.193 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:42.008830+0000", 2020-11-16T20:58:09.193 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2131e-05 2020-11-16T20:58:09.193 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.193 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.193 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.193 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:42.008873+0000", 2020-11-16T20:58:09.193 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.044455040000000001 2020-11-16T20:58:09.194 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.194 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.194 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.194 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.194 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.194 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3633 4.3 4:e109c45f:::smithi16641208-11:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e137)", 2020-11-16T20:58:09.194 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:41.964520+0000", 2020-11-16T20:58:09.194 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 27.011824960999999, 2020-11-16T20:58:09.195 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.044730544999999997, 2020-11-16T20:58:09.195 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.195 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:09.195 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:09.195 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:09.195 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:09.195 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3633 2020-11-16T20:58:09.196 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.196 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.196 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.196 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.196 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.964520+0000", 2020-11-16T20:58:09.196 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.196 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.196 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.197 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.197 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.964520+0000", 2020-11-16T20:58:09.197 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7291e-05 2020-11-16T20:58:09.197 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.197 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.197 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.197 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.964547+0000", 2020-11-16T20:58:09.198 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4740000000000001e-06 2020-11-16T20:58:09.198 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.198 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.198 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.198 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.964551+0000", 2020-11-16T20:58:09.198 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4849999999999997e-06 2020-11-16T20:58:09.198 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.199 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.199 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.199 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.964557+0000", 2020-11-16T20:58:09.199 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0709999999999999e-06 2020-11-16T20:58:09.199 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.199 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.199 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.199 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.964560+0000", 2020-11-16T20:58:09.200 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7511e-05 2020-11-16T20:58:09.200 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.200 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.200 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.200 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.964608+0000", 2020-11-16T20:58:09.200 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9838000000000001e-05 2020-11-16T20:58:09.200 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.201 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.201 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:09.201 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.964638+0000", 2020-11-16T20:58:09.201 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024488481999999999 2020-11-16T20:58:09.201 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.201 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.201 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.201 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.989126+0000", 2020-11-16T20:58:09.202 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2306999999999996e-05 2020-11-16T20:58:09.202 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.202 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.202 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:09.202 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:41.989219+0000", 2020-11-16T20:58:09.202 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01968137 2020-11-16T20:58:09.202 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.203 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.203 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.203 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:42.008900+0000", 2020-11-16T20:58:09.203 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.4022000000000002e-05 2020-11-16T20:58:09.203 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.203 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.203 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.204 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:42.008994+0000", 2020-11-16T20:58:09.204 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00025669400000000002 2020-11-16T20:58:09.204 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.204 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.204 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.204 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:42.009251+0000", 2020-11-16T20:58:09.204 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.044730544999999997 2020-11-16T20:58:09.204 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.205 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.205 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.205 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.205 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.205 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:09.207 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:58:09.207 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:58:09.207 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:58:09.208 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:58:09.208 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:58:09.208 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:58:09.208 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:58:09.209 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:58:09.209 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:58:09.209 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:58:09.209 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:58:09.209 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:09.212+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:09.306 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:58:09.311+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:58:09.373 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:09.374 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:58:09.374 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:58:09.374 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:09.383 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:58:09.407 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:09.412+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:09.508 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:09.513+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:09.548 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:09.548 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:58:09.548 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:58:09.548 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:58:09.549 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:09.557 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:58:09.609 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:09.615+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:09.685 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:09.685 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:58:09.685 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:58:09.685 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:58:09.686 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.686 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2583 4.2 4:75836747:::smithi16641208-340:head [setxattr _header (58) in=7b,truncate 3159815] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:58:09.686 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.770345+0000", 2020-11-16T20:58:09.686 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 109.918500235, 2020-11-16T20:58:09.686 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.079764311000000004, 2020-11-16T20:58:09.686 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.687 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:09.687 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:09.687 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:09.687 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:09.687 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2583 2020-11-16T20:58:09.687 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.687 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.688 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.688 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.688 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770345+0000", 2020-11-16T20:58:09.688 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.688 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.688 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.688 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.688 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770345+0000", 2020-11-16T20:58:09.689 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9728999999999999e-05 2020-11-16T20:58:09.689 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.689 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.689 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.689 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770384+0000", 2020-11-16T20:58:09.689 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3849999999999999e-06 2020-11-16T20:58:09.689 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.690 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.690 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.690 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770391+0000", 2020-11-16T20:58:09.690 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0865e-05 2020-11-16T20:58:09.690 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.690 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.690 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.691 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770401+0000", 2020-11-16T20:58:09.691 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7599999999999999e-06 2020-11-16T20:58:09.691 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.691 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.691 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.691 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770407+0000", 2020-11-16T20:58:09.691 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00082697999999999995 2020-11-16T20:58:09.692 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.692 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.692 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.692 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771234+0000", 2020-11-16T20:58:09.692 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8841000000000001e-05 2020-11-16T20:58:09.692 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.692 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.693 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:09.693 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771293+0000", 2020-11-16T20:58:09.693 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.028773502999999999 2020-11-16T20:58:09.693 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.693 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.693 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.693 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800067+0000", 2020-11-16T20:58:09.694 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011809199999999999 2020-11-16T20:58:09.694 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.694 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.694 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.694 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800185+0000", 2020-11-16T20:58:09.694 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00041150300000000002 2020-11-16T20:58:09.694 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.695 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.695 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:58:09.695 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800596+0000", 2020-11-16T20:58:09.695 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078037820000000004 2020-11-16T20:58:09.695 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.695 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.695 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:09.695 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808400+0000", 2020-11-16T20:58:09.696 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.040583162999999998 2020-11-16T20:58:09.696 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.696 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.696 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.696 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.848983+0000", 2020-11-16T20:58:09.696 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00096703299999999996 2020-11-16T20:58:09.696 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.697 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.697 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.697 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.849950+0000", 2020-11-16T20:58:09.697 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6266999999999994e-05 2020-11-16T20:58:09.697 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.697 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.697 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:09.698 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850016+0000", 2020-11-16T20:58:09.698 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2408e-05 2020-11-16T20:58:09.698 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.698 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.698 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.698 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850109+0000", 2020-11-16T20:58:09.698 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.079764311000000004 2020-11-16T20:58:09.698 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.699 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.699 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.699 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.699 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.699 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2584 4.2 4:75836747:::smithi16641208-340:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:58:09.699 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.771084+0000", 2020-11-16T20:58:09.700 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 109.91776082200001, 2020-11-16T20:58:09.700 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.079415345999999998, 2020-11-16T20:58:09.700 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.700 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:09.700 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:09.700 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:09.700 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:09.701 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2584 2020-11-16T20:58:09.701 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.701 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.701 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.701 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.701 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771084+0000", 2020-11-16T20:58:09.701 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.702 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.702 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.702 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.702 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771084+0000", 2020-11-16T20:58:09.702 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3832999999999999e-05 2020-11-16T20:58:09.702 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.702 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.702 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.703 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771118+0000", 2020-11-16T20:58:09.703 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2299999999999996e-06 2020-11-16T20:58:09.703 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.703 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.703 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.703 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771124+0000", 2020-11-16T20:58:09.703 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1649e-05 2020-11-16T20:58:09.704 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.704 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.704 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.704 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771136+0000", 2020-11-16T20:58:09.704 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7389999999999996e-06 2020-11-16T20:58:09.704 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.704 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.705 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.705 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771141+0000", 2020-11-16T20:58:09.705 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000251332 2020-11-16T20:58:09.705 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.705 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.705 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.705 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771393+0000", 2020-11-16T20:58:09.705 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0130999999999997e-05 2020-11-16T20:58:09.706 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.706 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.706 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:09.706 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771453+0000", 2020-11-16T20:58:09.706 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036790163000000001 2020-11-16T20:58:09.706 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.706 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.707 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.707 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808243+0000", 2020-11-16T20:58:09.707 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000122781 2020-11-16T20:58:09.707 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.707 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.707 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:09.707 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808366+0000", 2020-11-16T20:58:09.708 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041793941000000001 2020-11-16T20:58:09.708 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.708 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.708 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.708 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850160+0000", 2020-11-16T20:58:09.708 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8177000000000005e-05 2020-11-16T20:58:09.708 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.708 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.709 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.709 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850258+0000", 2020-11-16T20:58:09.709 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024137 2020-11-16T20:58:09.709 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.709 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.709 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.709 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850499+0000", 2020-11-16T20:58:09.710 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.079415345999999998 2020-11-16T20:58:09.710 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.710 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.710 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.710 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.710 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.710 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:14 3.0 3:3b92f709:::smithi16641208-69:head [copy-from ver 517] snapc 2b=[f] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e97)", 2020-11-16T20:58:09.711 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.813636+0000", 2020-11-16T20:58:09.711 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 67.875208291999996, 2020-11-16T20:58:09.711 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.068038797999999998, 2020-11-16T20:58:09.711 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.711 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:09.711 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.711 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.711 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.712 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813636+0000", 2020-11-16T20:58:09.712 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.712 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.712 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.712 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.712 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813636+0000", 2020-11-16T20:58:09.712 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4759000000000001e-05 2020-11-16T20:58:09.713 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.713 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.713 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.713 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813661+0000", 2020-11-16T20:58:09.713 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4690000000000002e-06 2020-11-16T20:58:09.713 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.713 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.714 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.714 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813665+0000", 2020-11-16T20:58:09.714 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0939999999999996e-06 2020-11-16T20:58:09.714 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.714 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.714 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.714 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813671+0000", 2020-11-16T20:58:09.715 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9490000000000001e-06 2020-11-16T20:58:09.715 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.715 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.715 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.715 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813674+0000", 2020-11-16T20:58:09.715 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035912158999999999 2020-11-16T20:58:09.715 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.715 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.716 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.716 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849586+0000", 2020-11-16T20:58:09.716 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000105225 2020-11-16T20:58:09.716 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.716 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.716 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.716 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849691+0000", 2020-11-16T20:58:09.717 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094697400000000008 2020-11-16T20:58:09.717 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.717 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.717 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,2", 2020-11-16T20:58:09.717 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.859161+0000", 2020-11-16T20:58:09.717 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022310784 2020-11-16T20:58:09.717 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.717 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.718 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:09.718 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881472+0000", 2020-11-16T20:58:09.718 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7089000000000003e-05 2020-11-16T20:58:09.718 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.718 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.718 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.718 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881519+0000", 2020-11-16T20:58:09.719 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9331000000000004e-05 2020-11-16T20:58:09.719 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.719 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.719 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.719 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881588+0000", 2020-11-16T20:58:09.719 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9375000000000001e-05 2020-11-16T20:58:09.719 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.720 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.720 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:09.720 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881637+0000", 2020-11-16T20:58:09.720 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7824000000000002e-05 2020-11-16T20:58:09.720 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.720 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.720 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.720 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881675+0000", 2020-11-16T20:58:09.721 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.068038797999999998 2020-11-16T20:58:09.721 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.721 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.721 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.721 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.721 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.721 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3084 3.0 3:0eeb4688:::smithi16641208-459:head [copy-from ver 165] snapc 38=[38] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e97)", 2020-11-16T20:58:09.722 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.814118+0000", 2020-11-16T20:58:09.722 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 67.874726534000004, 2020-11-16T20:58:09.722 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.078238367000000003, 2020-11-16T20:58:09.722 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.722 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:09.722 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.722 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.722 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.723 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814118+0000", 2020-11-16T20:58:09.723 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.723 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.723 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.723 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.723 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814118+0000", 2020-11-16T20:58:09.723 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.262e-05 2020-11-16T20:58:09.724 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.724 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.724 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.724 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814141+0000", 2020-11-16T20:58:09.724 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.169e-05 2020-11-16T20:58:09.724 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.724 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.725 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.725 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814153+0000", 2020-11-16T20:58:09.725 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5350000000000004e-06 2020-11-16T20:58:09.725 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.725 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.725 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.725 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814161+0000", 2020-11-16T20:58:09.725 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1760000000000003e-06 2020-11-16T20:58:09.726 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.726 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.726 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.726 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814165+0000", 2020-11-16T20:58:09.726 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035740382000000001 2020-11-16T20:58:09.726 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.726 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.727 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.727 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849906+0000", 2020-11-16T20:58:09.727 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2356999999999999e-05 2020-11-16T20:58:09.727 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.727 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.727 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.727 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849978+0000", 2020-11-16T20:58:09.727 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016929244999999999 2020-11-16T20:58:09.728 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.728 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.728 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,2", 2020-11-16T20:58:09.728 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.866907+0000", 2020-11-16T20:58:09.728 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024555357 2020-11-16T20:58:09.728 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.728 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.729 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.729 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.891463+0000", 2020-11-16T20:58:09.729 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00067812000000000005 2020-11-16T20:58:09.729 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.729 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.729 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.729 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892141+0000", 2020-11-16T20:58:09.729 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3387999999999997e-05 2020-11-16T20:58:09.730 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.730 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.730 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:09.730 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892204+0000", 2020-11-16T20:58:09.730 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4189999999999994e-05 2020-11-16T20:58:09.730 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.730 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.731 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:09.731 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892268+0000", 2020-11-16T20:58:09.731 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8306999999999993e-05 2020-11-16T20:58:09.731 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.731 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.731 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.731 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892357+0000", 2020-11-16T20:58:09.732 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.078238367000000003 2020-11-16T20:58:09.732 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.732 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.732 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.732 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.732 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.732 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:16 3.0 3:0eeb4688:::smithi16641208-459:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e97)", 2020-11-16T20:58:09.732 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.814220+0000", 2020-11-16T20:58:09.733 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 67.874624604000005, 2020-11-16T20:58:09.733 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.078457661999999997, 2020-11-16T20:58:09.733 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.733 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:09.733 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.733 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.733 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.734 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814220+0000", 2020-11-16T20:58:09.734 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.734 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.734 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.734 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.734 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814220+0000", 2020-11-16T20:58:09.734 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6680999999999998e-05 2020-11-16T20:58:09.735 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.735 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.735 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.735 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814237+0000", 2020-11-16T20:58:09.735 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4029999999999999e-06 2020-11-16T20:58:09.735 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.735 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.735 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.736 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814240+0000", 2020-11-16T20:58:09.736 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5980000000000002e-06 2020-11-16T20:58:09.736 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.736 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.736 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.736 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814247+0000", 2020-11-16T20:58:09.736 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1489999999999998e-06 2020-11-16T20:58:09.737 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.737 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.737 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.737 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814250+0000", 2020-11-16T20:58:09.737 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035894660000000002 2020-11-16T20:58:09.737 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.737 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.738 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.738 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850145+0000", 2020-11-16T20:58:09.738 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2685000000000001e-05 2020-11-16T20:58:09.738 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.738 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.738 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:09.738 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850197+0000", 2020-11-16T20:58:09.738 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030551076999999999 2020-11-16T20:58:09.739 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.739 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.739 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.739 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.880748+0000", 2020-11-16T20:58:09.739 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011375900000000001 2020-11-16T20:58:09.739 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.740 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.740 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:09.740 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.880862+0000", 2020-11-16T20:58:09.740 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011676122000000001 2020-11-16T20:58:09.740 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.740 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.740 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.741 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892538+0000", 2020-11-16T20:58:09.741 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7021999999999997e-05 2020-11-16T20:58:09.741 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.741 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.741 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.741 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892595+0000", 2020-11-16T20:58:09.741 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2505999999999999e-05 2020-11-16T20:58:09.741 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.742 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.742 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.742 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892678+0000", 2020-11-16T20:58:09.742 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.078457661999999997 2020-11-16T20:58:09.742 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.742 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.742 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.743 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.743 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.743 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:17 3.0 3:0eeb4688:::smithi16641208-459:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e97)", 2020-11-16T20:58:09.743 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.814270+0000", 2020-11-16T20:58:09.743 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 67.874575234999995, 2020-11-16T20:58:09.743 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.082632504999999995, 2020-11-16T20:58:09.743 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.743 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:09.744 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.744 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.744 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.744 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814270+0000", 2020-11-16T20:58:09.744 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.744 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.744 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.745 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.745 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814270+0000", 2020-11-16T20:58:09.745 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3700999999999999e-05 2020-11-16T20:58:09.745 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.745 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.745 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.745 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814293+0000", 2020-11-16T20:58:09.746 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7879999999999998e-06 2020-11-16T20:58:09.746 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.746 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.746 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.746 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814296+0000", 2020-11-16T20:58:09.746 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6509999999999998e-06 2020-11-16T20:58:09.746 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.746 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.747 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.747 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814302+0000", 2020-11-16T20:58:09.747 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1039999999999996e-06 2020-11-16T20:58:09.747 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.747 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.747 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.747 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814311+0000", 2020-11-16T20:58:09.748 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035912305999999998 2020-11-16T20:58:09.748 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.748 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.748 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.748 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850223+0000", 2020-11-16T20:58:09.748 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5476000000000003e-05 2020-11-16T20:58:09.748 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.748 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.749 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:09.749 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850269+0000", 2020-11-16T20:58:09.749 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030645256999999999 2020-11-16T20:58:09.749 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.749 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.749 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.749 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.880914+0000", 2020-11-16T20:58:09.750 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3608000000000004e-05 2020-11-16T20:58:09.750 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.750 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.750 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:09.750 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.880987+0000", 2020-11-16T20:58:09.750 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011720252 2020-11-16T20:58:09.750 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.750 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.751 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.751 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892708+0000", 2020-11-16T20:58:09.751 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4710000000000003e-05 2020-11-16T20:58:09.751 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.751 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.751 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.751 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892762+0000", 2020-11-16T20:58:09.752 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041396519999999997 2020-11-16T20:58:09.752 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.752 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.752 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.752 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.896902+0000", 2020-11-16T20:58:09.752 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.082632504999999995 2020-11-16T20:58:09.752 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.753 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.753 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.753 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.753 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.753 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:19 3.0 3:1e015f5d:::smithi16641208-120:head [copy-from ver 447] snapc e=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e97)", 2020-11-16T20:58:09.753 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.814940+0000", 2020-11-16T20:58:09.753 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 67.873904693, 2020-11-16T20:58:09.753 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.077559996000000006, 2020-11-16T20:58:09.754 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.754 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:09.754 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.754 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.754 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.754 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814940+0000", 2020-11-16T20:58:09.754 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.755 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.755 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.755 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.755 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814940+0000", 2020-11-16T20:58:09.755 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0903000000000003e-05 2020-11-16T20:58:09.755 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.755 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.756 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.756 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815001+0000", 2020-11-16T20:58:09.756 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1119999999999998e-06 2020-11-16T20:58:09.756 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.756 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.756 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.756 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815008+0000", 2020-11-16T20:58:09.756 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1421e-05 2020-11-16T20:58:09.757 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.757 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.757 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.757 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815019+0000", 2020-11-16T20:58:09.757 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6509999999999998e-06 2020-11-16T20:58:09.757 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.757 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.758 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.758 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815025+0000", 2020-11-16T20:58:09.758 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036337921000000002 2020-11-16T20:58:09.758 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.758 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.758 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.758 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851363+0000", 2020-11-16T20:58:09.759 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012654300000000001 2020-11-16T20:58:09.759 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.759 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.759 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.759 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851490+0000", 2020-11-16T20:58:09.759 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025530690000000002 2020-11-16T20:58:09.759 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.759 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.760 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,2", 2020-11-16T20:58:09.760 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.877020+0000", 2020-11-16T20:58:09.760 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01516898 2020-11-16T20:58:09.760 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.760 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.760 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.760 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892189+0000", 2020-11-16T20:58:09.761 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017819600000000001 2020-11-16T20:58:09.761 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.761 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.761 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:09.761 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892367+0000", 2020-11-16T20:58:09.761 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6916999999999999e-05 2020-11-16T20:58:09.761 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.761 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.762 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.762 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892404+0000", 2020-11-16T20:58:09.762 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1143999999999998e-05 2020-11-16T20:58:09.762 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.762 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.762 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:09.762 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892446+0000", 2020-11-16T20:58:09.763 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4518000000000002e-05 2020-11-16T20:58:09.763 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.763 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.763 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.763 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892500+0000", 2020-11-16T20:58:09.763 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.077559996000000006 2020-11-16T20:58:09.763 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.764 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.764 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.764 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.764 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.764 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3105 3.0 3:1ccd20f3:::smithi16641208-424:head [stat,delete] snapc 38=[38] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e97)", 2020-11-16T20:58:09.764 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.815082+0000", 2020-11-16T20:58:09.764 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 67.873763027999999, 2020-11-16T20:58:09.765 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066146218000000007, 2020-11-16T20:58:09.765 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.765 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:09.765 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.765 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.765 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.765 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815082+0000", 2020-11-16T20:58:09.765 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.766 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.766 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.766 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.766 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815082+0000", 2020-11-16T20:58:09.766 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0209000000000002e-05 2020-11-16T20:58:09.766 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.766 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.767 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.767 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815112+0000", 2020-11-16T20:58:09.767 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7830000000000004e-06 2020-11-16T20:58:09.767 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.767 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.767 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.767 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815118+0000", 2020-11-16T20:58:09.768 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0927000000000001e-05 2020-11-16T20:58:09.768 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.768 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.768 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.768 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815129+0000", 2020-11-16T20:58:09.768 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3059999999999997e-06 2020-11-16T20:58:09.768 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.768 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.769 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.769 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815134+0000", 2020-11-16T20:58:09.769 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036502199999999999 2020-11-16T20:58:09.769 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.769 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.769 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.769 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851636+0000", 2020-11-16T20:58:09.770 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016290900000000001 2020-11-16T20:58:09.770 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.770 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.770 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.770 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851799+0000", 2020-11-16T20:58:09.770 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00028645999999999999 2020-11-16T20:58:09.770 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.771 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.771 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,2", 2020-11-16T20:58:09.771 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852086+0000", 2020-11-16T20:58:09.771 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003854007 2020-11-16T20:58:09.771 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.771 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.771 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:09.771 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.855940+0000", 2020-11-16T20:58:09.772 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0019815750000000002 2020-11-16T20:58:09.772 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.772 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.772 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.772 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.857921+0000", 2020-11-16T20:58:09.772 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023126626000000001 2020-11-16T20:58:09.772 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.773 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.773 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.773 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881048+0000", 2020-11-16T20:58:09.773 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.0409999999999998e-05 2020-11-16T20:58:09.773 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.773 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.773 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:09.773 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881128+0000", 2020-11-16T20:58:09.774 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9806e-05 2020-11-16T20:58:09.774 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.774 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.774 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.774 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881228+0000", 2020-11-16T20:58:09.774 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066146218000000007 2020-11-16T20:58:09.774 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.775 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.775 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.775 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.775 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.775 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:21 3.0 3:1ccd20f3:::smithi16641208-424:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e97)", 2020-11-16T20:58:09.775 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.815178+0000", 2020-11-16T20:58:09.775 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 67.873666690999997, 2020-11-16T20:58:09.776 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066300320999999995, 2020-11-16T20:58:09.776 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.776 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:09.776 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.776 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.776 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.776 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815178+0000", 2020-11-16T20:58:09.777 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.777 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.777 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.777 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.778 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815178+0000", 2020-11-16T20:58:09.778 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8203000000000001e-05 2020-11-16T20:58:09.778 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.778 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.778 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.778 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815206+0000", 2020-11-16T20:58:09.778 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7729999999999996e-06 2020-11-16T20:58:09.779 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.779 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.779 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.779 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815212+0000", 2020-11-16T20:58:09.779 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.149e-05 2020-11-16T20:58:09.779 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.779 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.780 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.780 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815224+0000", 2020-11-16T20:58:09.780 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3900000000000001e-06 2020-11-16T20:58:09.780 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.780 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.780 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.780 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815229+0000", 2020-11-16T20:58:09.781 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039388232000000002 2020-11-16T20:58:09.781 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.781 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.781 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.781 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.854617+0000", 2020-11-16T20:58:09.781 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012693099999999999 2020-11-16T20:58:09.781 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.782 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.782 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:09.782 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.854744+0000", 2020-11-16T20:58:09.782 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026509525999999999 2020-11-16T20:58:09.782 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.782 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.782 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.783 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881254+0000", 2020-11-16T20:58:09.783 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2397000000000005e-05 2020-11-16T20:58:09.783 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.783 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.783 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.783 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881326+0000", 2020-11-16T20:58:09.783 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015237900000000001 2020-11-16T20:58:09.784 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.784 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.784 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.784 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881478+0000", 2020-11-16T20:58:09.784 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066300320999999995 2020-11-16T20:58:09.784 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.784 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.785 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.785 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.785 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.785 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:22 3.0 3:1ccd20f3:::smithi16641208-424:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e97)", 2020-11-16T20:58:09.785 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.815264+0000", 2020-11-16T20:58:09.785 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 67.873580251000007, 2020-11-16T20:58:09.785 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066644708999999996, 2020-11-16T20:58:09.786 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.786 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:09.786 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.786 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.786 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.786 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815264+0000", 2020-11-16T20:58:09.786 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.786 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.787 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.787 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.787 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815264+0000", 2020-11-16T20:58:09.787 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5266999999999999e-05 2020-11-16T20:58:09.787 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.787 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.787 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.788 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815310+0000", 2020-11-16T20:58:09.788 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3989999999999998e-06 2020-11-16T20:58:09.788 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.788 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.788 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.788 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815317+0000", 2020-11-16T20:58:09.788 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.082e-05 2020-11-16T20:58:09.788 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.789 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.789 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.789 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815328+0000", 2020-11-16T20:58:09.789 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0220000000000004e-06 2020-11-16T20:58:09.789 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.789 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.789 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.790 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815333+0000", 2020-11-16T20:58:09.790 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039899660000000003 2020-11-16T20:58:09.790 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.790 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.790 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.790 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.855233+0000", 2020-11-16T20:58:09.790 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2051000000000004e-05 2020-11-16T20:58:09.791 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.791 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.791 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:09.791 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.855315+0000", 2020-11-16T20:58:09.791 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026394424 2020-11-16T20:58:09.791 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.791 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.792 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.792 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881709+0000", 2020-11-16T20:58:09.792 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020006599999999999 2020-11-16T20:58:09.792 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.792 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.792 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.792 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881909+0000", 2020-11-16T20:58:09.792 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066644708999999996 2020-11-16T20:58:09.793 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.793 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.793 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.793 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.793 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.793 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:68 3.0 3:266da985:::smithi16641208-406:head [copy-get max 8388608] snapc 0=[] RETRY=2 ondisk+retry+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:58:09.793 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.832133+0000", 2020-11-16T20:58:09.794 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 49.856711251999997, 2020-11-16T20:58:09.794 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054097583999999997, 2020-11-16T20:58:09.794 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.794 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:09.794 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.794 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.794 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.794 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832133+0000", 2020-11-16T20:58:09.795 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.795 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.795 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.795 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.795 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832133+0000", 2020-11-16T20:58:09.795 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1003e-05 2020-11-16T20:58:09.795 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.796 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.796 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.796 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832175+0000", 2020-11-16T20:58:09.796 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7960000000000001e-06 2020-11-16T20:58:09.796 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.796 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.796 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.796 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832180+0000", 2020-11-16T20:58:09.797 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0349e-05 2020-11-16T20:58:09.797 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.797 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.797 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.797 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832191+0000", 2020-11-16T20:58:09.797 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3000000000000001e-06 2020-11-16T20:58:09.797 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.798 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.798 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832196+0000", 2020-11-16T20:58:09.798 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6594000000000001e-05 2020-11-16T20:58:09.798 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.798 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.799 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832243+0000", 2020-11-16T20:58:09.799 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2993000000000001e-05 2020-11-16T20:58:09.799 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.799 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.799 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:09.799 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832256+0000", 2020-11-16T20:58:09.799 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.045506131999999998 2020-11-16T20:58:09.799 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.800 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.800 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.800 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.877762+0000", 2020-11-16T20:58:09.800 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010955600000000001 2020-11-16T20:58:09.800 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.800 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.800 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:09.801 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.877871+0000", 2020-11-16T20:58:09.801 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042134119999999997 2020-11-16T20:58:09.801 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.801 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.801 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.801 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.882085+0000", 2020-11-16T20:58:09.801 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014105699999999999 2020-11-16T20:58:09.801 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.802 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.802 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.802 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.882226+0000", 2020-11-16T20:58:09.802 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004005392 2020-11-16T20:58:09.802 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.802 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.802 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.803 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886231+0000", 2020-11-16T20:58:09.803 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054097583999999997 2020-11-16T20:58:09.803 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.803 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.803 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.803 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.803 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.803 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3327 3.0 3:2949283c:::smithi16641208-44:head [write 537989~722069,stat] snapc 49=[49,48,44,41] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e115)", 2020-11-16T20:58:09.804 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.832232+0000", 2020-11-16T20:58:09.804 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 49.856612771000002, 2020-11-16T20:58:09.804 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054524729000000001, 2020-11-16T20:58:09.804 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.804 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:09.804 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.804 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.805 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.805 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832232+0000", 2020-11-16T20:58:09.805 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.805 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.805 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.805 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.805 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832232+0000", 2020-11-16T20:58:09.805 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00040025400000000001 2020-11-16T20:58:09.806 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.806 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.806 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.806 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832632+0000", 2020-11-16T20:58:09.806 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5050000000000004e-06 2020-11-16T20:58:09.806 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.806 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.807 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.807 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832639+0000", 2020-11-16T20:58:09.807 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1299e-05 2020-11-16T20:58:09.807 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.807 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.807 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.807 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832650+0000", 2020-11-16T20:58:09.808 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8030000000000002e-06 2020-11-16T20:58:09.808 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.808 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.808 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.808 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832656+0000", 2020-11-16T20:58:09.808 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8779000000000003e-05 2020-11-16T20:58:09.808 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.808 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.809 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.809 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832695+0000", 2020-11-16T20:58:09.809 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9789999999999993e-06 2020-11-16T20:58:09.809 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.809 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.809 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:09.809 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832703+0000", 2020-11-16T20:58:09.810 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.045361931000000001 2020-11-16T20:58:09.810 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.810 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.810 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.810 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.878065+0000", 2020-11-16T20:58:09.810 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000221418 2020-11-16T20:58:09.810 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.810 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.811 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.811 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.878286+0000", 2020-11-16T20:58:09.811 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023917099999999999 2020-11-16T20:58:09.811 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.811 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.811 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 2,6", 2020-11-16T20:58:09.811 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.878525+0000", 2020-11-16T20:58:09.812 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003510988 2020-11-16T20:58:09.812 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.812 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.812 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.812 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.882036+0000", 2020-11-16T20:58:09.812 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044535720000000003 2020-11-16T20:58:09.812 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.812 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.813 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:09.813 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886490+0000", 2020-11-16T20:58:09.813 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0692999999999996e-05 2020-11-16T20:58:09.813 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.813 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.813 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.813 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886560+0000", 2020-11-16T20:58:09.814 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5710000000000001e-05 2020-11-16T20:58:09.814 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.814 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.814 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:09.814 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886606+0000", 2020-11-16T20:58:09.814 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015062699999999999 2020-11-16T20:58:09.814 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.815 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.815 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.815 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886757+0000", 2020-11-16T20:58:09.815 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054524729000000001 2020-11-16T20:58:09.815 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.815 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.815 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.815 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.816 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.816 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:70 3.0 3:2949283c:::smithi16641208-44:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:58:09.816 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.832688+0000", 2020-11-16T20:58:09.816 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 49.856156351999999, 2020-11-16T20:58:09.816 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054473900999999998, 2020-11-16T20:58:09.816 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.816 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:09.817 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.817 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.817 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.817 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832688+0000", 2020-11-16T20:58:09.817 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.817 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.817 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.818 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.818 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832688+0000", 2020-11-16T20:58:09.818 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5730999999999999e-05 2020-11-16T20:58:09.818 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.818 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.818 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.818 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832704+0000", 2020-11-16T20:58:09.818 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0690000000000002e-06 2020-11-16T20:58:09.819 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.819 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.819 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.819 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832707+0000", 2020-11-16T20:58:09.819 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9719999999999997e-06 2020-11-16T20:58:09.819 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.819 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.820 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.820 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832713+0000", 2020-11-16T20:58:09.820 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8650000000000001e-06 2020-11-16T20:58:09.820 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.820 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.820 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.820 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832716+0000", 2020-11-16T20:58:09.820 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8541999999999998e-05 2020-11-16T20:58:09.821 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.821 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.821 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.821 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832755+0000", 2020-11-16T20:58:09.821 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.153e-05 2020-11-16T20:58:09.821 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.821 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.822 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:09.822 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832766+0000", 2020-11-16T20:58:09.822 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047763647999999999 2020-11-16T20:58:09.822 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.822 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.822 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.822 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.880530+0000", 2020-11-16T20:58:09.823 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016090599999999999 2020-11-16T20:58:09.823 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.823 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.823 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:09.823 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.880691+0000", 2020-11-16T20:58:09.823 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061198809999999998 2020-11-16T20:58:09.823 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.823 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.824 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.824 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886811+0000", 2020-11-16T20:58:09.824 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012478200000000001 2020-11-16T20:58:09.824 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.824 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.824 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.824 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886935+0000", 2020-11-16T20:58:09.825 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000226975 2020-11-16T20:58:09.825 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.825 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.825 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.825 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.887162+0000", 2020-11-16T20:58:09.825 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054473900999999998 2020-11-16T20:58:09.825 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.825 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.826 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.826 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.826 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.826 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:71 3.0 3:2949283c:::smithi16641208-44:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:58:09.826 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.832747+0000", 2020-11-16T20:58:09.827 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 49.856097503999997, 2020-11-16T20:58:09.827 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.057126753000000002, 2020-11-16T20:58:09.827 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.827 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:09.827 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.827 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.827 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.827 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832747+0000", 2020-11-16T20:58:09.828 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.828 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.828 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.828 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.828 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832747+0000", 2020-11-16T20:58:09.828 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3911000000000001e-05 2020-11-16T20:58:09.828 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.829 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.829 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.829 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832781+0000", 2020-11-16T20:58:09.829 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2480000000000001e-06 2020-11-16T20:58:09.829 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.829 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.829 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.829 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832784+0000", 2020-11-16T20:58:09.830 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2040000000000002e-06 2020-11-16T20:58:09.830 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.830 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.830 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.830 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832791+0000", 2020-11-16T20:58:09.830 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2399999999999999e-06 2020-11-16T20:58:09.830 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.831 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.831 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.831 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832794+0000", 2020-11-16T20:58:09.831 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2548000000000002e-05 2020-11-16T20:58:09.831 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.831 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.831 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.831 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832816+0000", 2020-11-16T20:58:09.832 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4160000000000003e-06 2020-11-16T20:58:09.832 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.832 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.832 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:09.832 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832822+0000", 2020-11-16T20:58:09.832 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.053459245000000002 2020-11-16T20:58:09.832 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.833 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.833 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.833 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886281+0000", 2020-11-16T20:58:09.833 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018665399999999999 2020-11-16T20:58:09.833 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.833 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.833 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:09.833 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886468+0000", 2020-11-16T20:58:09.834 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00075232499999999998 2020-11-16T20:58:09.834 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.834 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.834 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.834 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.887220+0000", 2020-11-16T20:58:09.834 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000152974 2020-11-16T20:58:09.834 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.835 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.835 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.835 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.887373+0000", 2020-11-16T20:58:09.835 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002500988 2020-11-16T20:58:09.835 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.835 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.835 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.835 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.889874+0000", 2020-11-16T20:58:09.836 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.057126753000000002 2020-11-16T20:58:09.836 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.836 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.836 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.836 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.836 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.836 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3346 3.0 3:1e5364a0:::smithi16641208-320:head [write 588410~547816,stat] snapc 4a=[4a,49,48,44,41] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e115)", 2020-11-16T20:58:09.837 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.839179+0000", 2020-11-16T20:58:09.837 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 49.84966575, 2020-11-16T20:58:09.837 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.084752201999999999, 2020-11-16T20:58:09.837 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.837 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:09.837 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.837 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.837 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.838 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839179+0000", 2020-11-16T20:58:09.838 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.838 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.838 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.838 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.838 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839179+0000", 2020-11-16T20:58:09.838 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000250175 2020-11-16T20:58:09.839 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.839 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.839 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.839 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839429+0000", 2020-11-16T20:58:09.839 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.22e-06 2020-11-16T20:58:09.839 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.839 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.840 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.840 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839434+0000", 2020-11-16T20:58:09.840 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0258000000000001e-05 2020-11-16T20:58:09.840 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.840 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.840 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.840 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839445+0000", 2020-11-16T20:58:09.840 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8019999999999999e-06 2020-11-16T20:58:09.841 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.841 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.841 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.841 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839449+0000", 2020-11-16T20:58:09.841 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1084999999999997e-05 2020-11-16T20:58:09.841 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.841 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.842 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.842 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839491+0000", 2020-11-16T20:58:09.842 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4239999999999993e-06 2020-11-16T20:58:09.842 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.842 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.842 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:09.842 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839499+0000", 2020-11-16T20:58:09.843 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050428550000000003 2020-11-16T20:58:09.843 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.843 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.843 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.843 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.889928+0000", 2020-11-16T20:58:09.843 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030713000000000002 2020-11-16T20:58:09.843 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.843 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.844 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.844 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.890235+0000", 2020-11-16T20:58:09.844 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00047229800000000001 2020-11-16T20:58:09.844 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.844 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.844 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 2,6", 2020-11-16T20:58:09.844 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.890707+0000", 2020-11-16T20:58:09.845 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0046488600000000003 2020-11-16T20:58:09.845 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.845 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.845 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.845 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895356+0000", 2020-11-16T20:58:09.845 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.028228664000000001 2020-11-16T20:58:09.845 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.845 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.846 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:09.846 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.923584+0000", 2020-11-16T20:58:09.846 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3496e-05 2020-11-16T20:58:09.846 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.846 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.846 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:09.846 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.923608+0000", 2020-11-16T20:58:09.847 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0390999999999997e-05 2020-11-16T20:58:09.847 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.847 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.847 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:09.847 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.923678+0000", 2020-11-16T20:58:09.847 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00025284899999999998 2020-11-16T20:58:09.847 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.848 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.848 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.848 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.923931+0000", 2020-11-16T20:58:09.848 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.084752201999999999 2020-11-16T20:58:09.848 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.848 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.848 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.848 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.849 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.849 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:73 3.0 3:1e5364a0:::smithi16641208-320:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:58:09.849 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.839479+0000", 2020-11-16T20:58:09.849 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 49.849365519000003, 2020-11-16T20:58:09.849 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.089078473000000005, 2020-11-16T20:58:09.849 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.849 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:09.850 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.850 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.850 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.850 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839479+0000", 2020-11-16T20:58:09.850 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.850 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.850 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.850 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.851 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839479+0000", 2020-11-16T20:58:09.851 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8124000000000001e-05 2020-11-16T20:58:09.851 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.851 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.851 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.852 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839497+0000", 2020-11-16T20:58:09.852 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1580000000000001e-06 2020-11-16T20:58:09.852 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.852 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.852 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.852 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839501+0000", 2020-11-16T20:58:09.852 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6579999999999996e-06 2020-11-16T20:58:09.852 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.853 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.853 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.853 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839507+0000", 2020-11-16T20:58:09.853 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9720000000000001e-06 2020-11-16T20:58:09.853 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.853 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.853 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.854 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839510+0000", 2020-11-16T20:58:09.854 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1950000000000003e-05 2020-11-16T20:58:09.854 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.854 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.854 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.854 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839552+0000", 2020-11-16T20:58:09.855 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2225999999999999e-05 2020-11-16T20:58:09.855 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.855 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.855 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:09.856 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839564+0000", 2020-11-16T20:58:09.856 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.055483693000000001 2020-11-16T20:58:09.856 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.856 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.857 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.857 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895048+0000", 2020-11-16T20:58:09.857 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022632500000000001 2020-11-16T20:58:09.857 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.857 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.857 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:09.857 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895274+0000", 2020-11-16T20:58:09.858 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032777323999999997 2020-11-16T20:58:09.858 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.858 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.858 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.858 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928052+0000", 2020-11-16T20:58:09.858 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000150321 2020-11-16T20:58:09.858 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.859 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.859 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.859 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928202+0000", 2020-11-16T20:58:09.859 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00035572199999999999 2020-11-16T20:58:09.859 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.859 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.859 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.860 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928558+0000", 2020-11-16T20:58:09.860 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.089078473000000005 2020-11-16T20:58:09.860 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.860 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.860 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.860 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.860 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.860 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:74 3.0 3:1e5364a0:::smithi16641208-320:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:58:09.861 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.839542+0000", 2020-11-16T20:58:09.861 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 49.849302889999997, 2020-11-16T20:58:09.861 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.093226218, 2020-11-16T20:58:09.861 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.861 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:09.861 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.861 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.862 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.862 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839542+0000", 2020-11-16T20:58:09.862 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.862 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.862 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.862 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.862 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839542+0000", 2020-11-16T20:58:09.863 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6640000000000002e-05 2020-11-16T20:58:09.863 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.863 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.863 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.863 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839578+0000", 2020-11-16T20:58:09.863 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.416e-06 2020-11-16T20:58:09.863 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.863 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.864 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.864 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839582+0000", 2020-11-16T20:58:09.864 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9070000000000001e-06 2020-11-16T20:58:09.864 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.864 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.864 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.865 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839589+0000", 2020-11-16T20:58:09.865 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.994e-06 2020-11-16T20:58:09.865 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.865 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.865 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.865 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839592+0000", 2020-11-16T20:58:09.865 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4881000000000001e-05 2020-11-16T20:58:09.866 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.866 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.866 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.866 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839617+0000", 2020-11-16T20:58:09.866 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4330000000000003e-06 2020-11-16T20:58:09.866 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.866 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.866 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:09.867 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839622+0000", 2020-11-16T20:58:09.867 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.055765016000000001 2020-11-16T20:58:09.867 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.867 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.867 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.867 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895387+0000", 2020-11-16T20:58:09.867 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000145926 2020-11-16T20:58:09.868 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.868 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.868 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:09.868 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895533+0000", 2020-11-16T20:58:09.868 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033078547999999999 2020-11-16T20:58:09.868 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.868 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.869 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.869 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928612+0000", 2020-11-16T20:58:09.869 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114621 2020-11-16T20:58:09.869 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.869 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.869 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.869 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928726+0000", 2020-11-16T20:58:09.870 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004041836 2020-11-16T20:58:09.870 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.870 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.870 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.870 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.932768+0000", 2020-11-16T20:58:09.870 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.093226218 2020-11-16T20:58:09.871 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.871 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.871 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.871 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.871 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.871 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3414 4.3 4:cf270c70:::smithi16641208-423:head [copy-from ver 586] snapc 4f=[4f,48] ondisk+write+known_if_redirected e120)", 2020-11-16T20:58:09.871 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:24.750833+0000", 2020-11-16T20:58:09.872 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 44.938011652999997, 2020-11-16T20:58:09.872 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.064670209000000006, 2020-11-16T20:58:09.872 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.872 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:09.872 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:09.872 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:09.872 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:09.873 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3414 2020-11-16T20:58:09.873 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.873 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.873 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.873 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.873 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750833+0000", 2020-11-16T20:58:09.873 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.874 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.874 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.874 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.874 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750833+0000", 2020-11-16T20:58:09.874 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4888e-05 2020-11-16T20:58:09.874 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.874 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.875 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.875 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750858+0000", 2020-11-16T20:58:09.875 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6359999999999997e-06 2020-11-16T20:58:09.875 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.875 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.875 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.875 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750865+0000", 2020-11-16T20:58:09.875 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4072e-05 2020-11-16T20:58:09.876 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.876 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.876 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.876 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750879+0000", 2020-11-16T20:58:09.876 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1409999999999994e-06 2020-11-16T20:58:09.876 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.876 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.877 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.877 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750888+0000", 2020-11-16T20:58:09.877 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000413664 2020-11-16T20:58:09.877 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.877 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.877 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.877 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751301+0000", 2020-11-16T20:58:09.877 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1214e-05 2020-11-16T20:58:09.878 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.878 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.878 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op must wait for map", 2020-11-16T20:58:09.878 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751313+0000", 2020-11-16T20:58:09.878 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078009489999999997 2020-11-16T20:58:09.878 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.878 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.879 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.879 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.759114+0000", 2020-11-16T20:58:09.879 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.056386372999999997 2020-11-16T20:58:09.879 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.879 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.879 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:09.879 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.815500+0000", 2020-11-16T20:58:09.880 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2720000000000002e-06 2020-11-16T20:58:09.880 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.880 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.880 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.880 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.815503+0000", 2020-11-16T20:58:09.880 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.064670209000000006 2020-11-16T20:58:09.880 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.880 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.881 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.881 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.881 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.881 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3415 4.3 4:cf270c70:::smithi16641208-423:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e120)", 2020-11-16T20:58:09.881 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:24.750930+0000", 2020-11-16T20:58:09.881 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 44.937915175000001, 2020-11-16T20:58:09.881 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.064785488000000002, 2020-11-16T20:58:09.882 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.882 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:09.882 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:09.882 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:09.882 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:09.882 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3415 2020-11-16T20:58:09.882 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.883 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.883 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.883 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.883 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750930+0000", 2020-11-16T20:58:09.883 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.883 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.883 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.883 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.884 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750930+0000", 2020-11-16T20:58:09.884 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7016e-05 2020-11-16T20:58:09.884 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.884 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.884 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.884 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750957+0000", 2020-11-16T20:58:09.884 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7379999999999999e-06 2020-11-16T20:58:09.885 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.885 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.885 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.885 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750962+0000", 2020-11-16T20:58:09.885 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0684e-05 2020-11-16T20:58:09.885 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.885 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.886 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.886 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750973+0000", 2020-11-16T20:58:09.886 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2089999999999996e-06 2020-11-16T20:58:09.886 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.886 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.886 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.886 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750978+0000", 2020-11-16T20:58:09.886 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00039269899999999999 2020-11-16T20:58:09.887 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.887 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.887 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.887 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751371+0000", 2020-11-16T20:58:09.887 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7460000000000003e-06 2020-11-16T20:58:09.887 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.887 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.888 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:58:09.888 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751378+0000", 2020-11-16T20:58:09.888 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092297239999999999 2020-11-16T20:58:09.888 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.888 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.888 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.888 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.760607+0000", 2020-11-16T20:58:09.888 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.055107672000000003 2020-11-16T20:58:09.889 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.889 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.889 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.889 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.815715+0000", 2020-11-16T20:58:09.889 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.064785488000000002 2020-11-16T20:58:09.889 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.889 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.890 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.890 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.890 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.890 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3416 4.3 4:f6d44bd7:::smithi16641208-454:48 [cache-flush] snapc 0=[] ondisk+read+ignore_cache+known_if_redirected e120)", 2020-11-16T20:58:09.890 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:24.751009+0000", 2020-11-16T20:58:09.890 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 44.937835386000003, 2020-11-16T20:58:09.890 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066511669999999995, 2020-11-16T20:58:09.890 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:09.891 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:09.891 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:09.891 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:09.891 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:09.891 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3416 2020-11-16T20:58:09.891 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.891 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:09.892 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.892 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:09.892 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751009+0000", 2020-11-16T20:58:09.892 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:09.892 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.892 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.892 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:09.893 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751009+0000", 2020-11-16T20:58:09.893 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2008999999999999e-05 2020-11-16T20:58:09.893 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.893 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.893 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:09.893 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751031+0000", 2020-11-16T20:58:09.893 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1550000000000004e-06 2020-11-16T20:58:09.893 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.894 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.894 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:09.894 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751038+0000", 2020-11-16T20:58:09.894 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1149999999999996e-06 2020-11-16T20:58:09.894 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.894 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.894 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:09.895 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751045+0000", 2020-11-16T20:58:09.895 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8959999999999996e-06 2020-11-16T20:58:09.895 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.895 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.895 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:09.895 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751049+0000", 2020-11-16T20:58:09.895 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000347373 2020-11-16T20:58:09.896 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.896 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.896 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.896 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751396+0000", 2020-11-16T20:58:09.896 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1729999999999997e-06 2020-11-16T20:58:09.896 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.896 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.896 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:58:09.897 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751400+0000", 2020-11-16T20:58:09.897 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094156940000000005 2020-11-16T20:58:09.897 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.897 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.897 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.897 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.760816+0000", 2020-11-16T20:58:09.897 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000195842 2020-11-16T20:58:09.898 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.898 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.898 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.898 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.761012+0000", 2020-11-16T20:58:09.898 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.056247153000000001 2020-11-16T20:58:09.898 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.898 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.898 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:09.899 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.817259+0000", 2020-11-16T20:58:09.899 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000154034 2020-11-16T20:58:09.899 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.899 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.899 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:09.899 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.817413+0000", 2020-11-16T20:58:09.899 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000108226 2020-11-16T20:58:09.900 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:09.900 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:09.900 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:09.900 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.817521+0000", 2020-11-16T20:58:09.900 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066511669999999995 2020-11-16T20:58:09.900 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.900 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.900 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.901 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:09.901 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:09.901 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:09.902 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:58:09.903 INFO:tasks.rados.rados.0.smithi166.stdout:1268: done (3 left) 2020-11-16T20:58:09.903 INFO:tasks.rados.rados.0.smithi166.stdout:1269: delete oid 415 current snap is 57 2020-11-16T20:58:09.903 INFO:tasks.rados.rados.0.smithi166.stdout:1265: finishing write tid 2 to smithi16641208-272 2020-11-16T20:58:09.903 INFO:tasks.rados.rados.0.smithi166.stdout:1265: finishing write tid 3 to smithi16641208-272 2020-11-16T20:58:09.904 INFO:tasks.rados.rados.0.smithi166.stdout:1265: finishing write tid 4 to smithi16641208-272 2020-11-16T20:58:09.904 INFO:tasks.rados.rados.0.smithi166.stdout:1265: finishing write tid 5 to smithi16641208-272 2020-11-16T20:58:09.904 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 272 v 868 (ObjNum 696 snap 57 seq_num 696) dirty exists 2020-11-16T20:58:09.904 INFO:tasks.rados.rados.0.smithi166.stdout:1265: left oid 272 (ObjNum 696 snap 57 seq_num 696) 2020-11-16T20:58:09.904 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:09.906+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:10.003 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:10.007+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:10.070 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:10.070 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:58:10.070 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:58:10.070 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:10.079 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:58:10.104 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:10.108+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:10.205 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:10.210+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:10.244 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:10.245 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:58:10.245 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:58:10.245 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:58:10.245 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:10.254 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:58:10.306 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:10.311+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:10.382 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:10.382 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:58:10.382 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:58:10.382 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:58:10.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.383 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2979 4.0 4:1852173c:::smithi16641208-329:head [write 581674~637746,stat] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:10.383 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:58:10.383 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 81.582024989999994, 2020-11-16T20:58:10.383 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.009457398, 2020-11-16T20:58:10.383 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:10.383 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:10.384 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:10.384 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:10.384 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:10.384 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2979 2020-11-16T20:58:10.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.384 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:10.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.385 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:10.385 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:58:10.385 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:10.385 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.385 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.385 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:10.385 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:58:10.386 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030732300000000003 2020-11-16T20:58:10.386 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.386 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.386 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:10.386 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803965+0000", 2020-11-16T20:58:10.386 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0319999999999992e-06 2020-11-16T20:58:10.386 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.387 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.387 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:10.387 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803974+0000", 2020-11-16T20:58:10.387 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5930000000000002e-05 2020-11-16T20:58:10.387 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.387 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.387 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:10.388 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803990+0000", 2020-11-16T20:58:10.388 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1910000000000006e-06 2020-11-16T20:58:10.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.388 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.388 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:10.388 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803999+0000", 2020-11-16T20:58:10.388 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5637000000000003e-05 2020-11-16T20:58:10.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.389 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.389 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.804055+0000", 2020-11-16T20:58:10.389 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3769000000000001e-05 2020-11-16T20:58:10.389 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.389 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:10.390 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.804088+0000", 2020-11-16T20:58:10.390 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.995239140000001 2020-11-16T20:58:10.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.390 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.390 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.391 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799328+0000", 2020-11-16T20:58:10.391 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0137818 2020-11-16T20:58:10.391 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.391 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:10.391 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813109+0000", 2020-11-16T20:58:10.392 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5759999999999996e-06 2020-11-16T20:58:10.392 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.392 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.392 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:10.392 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813115+0000", 2020-11-16T20:58:10.392 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.009457398 2020-11-16T20:58:10.392 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.393 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:10.393 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.393 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.393 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.393 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2980 4.0 4:1852173c:::smithi16641208-329:head [write 1840873~558854] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:10.393 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:58:10.393 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 81.575759258000005, 2020-11-16T20:58:10.394 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.039347508000001, 2020-11-16T20:58:10.394 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:10.394 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:10.394 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:10.394 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:10.394 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:10.394 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2980 2020-11-16T20:58:10.395 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.395 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:10.395 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.395 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:10.395 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:58:10.395 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:10.395 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.396 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.396 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:10.396 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:58:10.396 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024810899999999999 2020-11-16T20:58:10.396 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.396 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.396 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:10.397 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810171+0000", 2020-11-16T20:58:10.397 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5610000000000001e-06 2020-11-16T20:58:10.397 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.397 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.397 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:10.397 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810179+0000", 2020-11-16T20:58:10.397 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7418000000000002e-05 2020-11-16T20:58:10.398 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.398 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.398 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:10.398 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810196+0000", 2020-11-16T20:58:10.398 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0079999999999996e-06 2020-11-16T20:58:10.398 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.399 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.399 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:10.399 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810203+0000", 2020-11-16T20:58:10.399 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3705000000000002e-05 2020-11-16T20:58:10.399 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.399 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.399 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.399 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810257+0000", 2020-11-16T20:58:10.400 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3656999999999998e-05 2020-11-16T20:58:10.400 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.400 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.400 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:10.400 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810311+0000", 2020-11-16T20:58:10.400 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.989427508 2020-11-16T20:58:10.400 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.401 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.401 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.401 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799738+0000", 2020-11-16T20:58:10.401 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2526000000000003e-05 2020-11-16T20:58:10.401 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.401 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.401 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:10.402 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799811+0000", 2020-11-16T20:58:10.402 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027934184000000001 2020-11-16T20:58:10.402 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.402 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.402 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.402 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827745+0000", 2020-11-16T20:58:10.402 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015776700000000001 2020-11-16T20:58:10.403 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.403 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.403 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:10.403 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827903+0000", 2020-11-16T20:58:10.403 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000185539 2020-11-16T20:58:10.403 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.403 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.404 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:10.404 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.828088+0000", 2020-11-16T20:58:10.404 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018143857999999999 2020-11-16T20:58:10.404 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.404 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.404 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:10.404 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846232+0000", 2020-11-16T20:58:10.404 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00074682199999999996 2020-11-16T20:58:10.405 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.405 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.405 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:10.405 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846979+0000", 2020-11-16T20:58:10.405 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021617530000000002 2020-11-16T20:58:10.405 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.405 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.406 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:10.406 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849141+0000", 2020-11-16T20:58:10.406 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4513999999999998e-05 2020-11-16T20:58:10.406 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.406 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.406 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:10.407 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849215+0000", 2020-11-16T20:58:10.407 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5578999999999998e-05 2020-11-16T20:58:10.407 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.407 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.407 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:10.407 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849271+0000", 2020-11-16T20:58:10.407 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.039347508000001 2020-11-16T20:58:10.408 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.408 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:10.408 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.408 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.408 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.408 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2981 4.0 4:1852173c:::smithi16641208-329:head [write 3066417~537135] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:10.408 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:58:10.409 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 81.568842961000001, 2020-11-16T20:58:10.409 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.032910677, 2020-11-16T20:58:10.409 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:10.409 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:10.409 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:10.409 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:10.409 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:10.410 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2981 2020-11-16T20:58:10.410 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.410 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:10.410 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.410 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:10.410 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:58:10.410 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:10.411 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.411 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.411 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:10.411 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:58:10.411 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024974099999999999 2020-11-16T20:58:10.411 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.411 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.412 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:10.412 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817089+0000", 2020-11-16T20:58:10.412 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3829999999999992e-06 2020-11-16T20:58:10.412 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.412 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.412 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:10.412 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817098+0000", 2020-11-16T20:58:10.413 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2118e-05 2020-11-16T20:58:10.413 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.413 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.413 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:10.413 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817110+0000", 2020-11-16T20:58:10.413 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6050000000000004e-06 2020-11-16T20:58:10.413 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.413 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.414 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:10.414 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817119+0000", 2020-11-16T20:58:10.414 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7204000000000003e-05 2020-11-16T20:58:10.414 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.414 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.414 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.414 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817177+0000", 2020-11-16T20:58:10.415 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9932999999999998e-05 2020-11-16T20:58:10.415 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.415 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.415 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:10.415 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817227+0000", 2020-11-16T20:58:10.415 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.98265286 2020-11-16T20:58:10.415 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.416 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.416 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.416 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799879+0000", 2020-11-16T20:58:10.416 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.737e-05 2020-11-16T20:58:10.416 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.416 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.416 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:10.416 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799947+0000", 2020-11-16T20:58:10.417 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029940584999999999 2020-11-16T20:58:10.417 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.417 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.417 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.417 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.829887+0000", 2020-11-16T20:58:10.417 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000217505 2020-11-16T20:58:10.417 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.418 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.418 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:10.418 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.830105+0000", 2020-11-16T20:58:10.418 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029022100000000001 2020-11-16T20:58:10.418 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.418 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.418 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:10.419 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.830395+0000", 2020-11-16T20:58:10.419 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015847953000000001 2020-11-16T20:58:10.419 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.419 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.419 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:10.419 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846243+0000", 2020-11-16T20:58:10.419 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0011558250000000001 2020-11-16T20:58:10.420 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.420 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.420 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:10.420 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847399+0000", 2020-11-16T20:58:10.420 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021524500000000002 2020-11-16T20:58:10.420 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.420 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.421 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:10.421 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849551+0000", 2020-11-16T20:58:10.421 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000138787 2020-11-16T20:58:10.421 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.421 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.421 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:10.421 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849690+0000", 2020-11-16T20:58:10.421 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0136999999999997e-05 2020-11-16T20:58:10.422 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.422 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.422 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:10.422 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849750+0000", 2020-11-16T20:58:10.422 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.032910677 2020-11-16T20:58:10.422 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.422 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:10.423 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.423 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.423 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.423 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2982 4.0 4:1852173c:::smithi16641208-329:head [setxattr _header (58) in=7b,truncate 3781674] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:10.423 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:58:10.423 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 81.568524646, 2020-11-16T20:58:10.423 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.035208633, 2020-11-16T20:58:10.424 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:10.424 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:10.424 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:10.424 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:10.424 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:10.424 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2982 2020-11-16T20:58:10.424 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.424 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:10.425 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.425 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:10.425 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:58:10.425 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:10.425 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.425 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.425 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:10.426 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:58:10.426 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8856000000000002e-05 2020-11-16T20:58:10.426 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.426 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.426 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:10.426 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817197+0000", 2020-11-16T20:58:10.426 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.93e-06 2020-11-16T20:58:10.427 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.427 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.427 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:10.427 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817203+0000", 2020-11-16T20:58:10.427 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0932e-05 2020-11-16T20:58:10.427 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.427 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.428 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:10.428 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817214+0000", 2020-11-16T20:58:10.428 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3470000000000001e-06 2020-11-16T20:58:10.428 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.428 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.428 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:10.428 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817218+0000", 2020-11-16T20:58:10.428 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4603e-05 2020-11-16T20:58:10.429 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.429 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.429 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.429 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817263+0000", 2020-11-16T20:58:10.429 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6387000000000002e-05 2020-11-16T20:58:10.429 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.429 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.430 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:10.430 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817309+0000", 2020-11-16T20:58:10.430 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.982698653 2020-11-16T20:58:10.430 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.430 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.430 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.430 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800008+0000", 2020-11-16T20:58:10.431 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5400000000000004e-05 2020-11-16T20:58:10.431 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.431 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.431 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:10.431 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800073+0000", 2020-11-16T20:58:10.431 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.044932818999999999 2020-11-16T20:58:10.431 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.431 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.432 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.432 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845006+0000", 2020-11-16T20:58:10.432 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017285099999999999 2020-11-16T20:58:10.432 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.432 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.432 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:10.432 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845179+0000", 2020-11-16T20:58:10.433 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023420900000000001 2020-11-16T20:58:10.433 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.433 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.433 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:10.433 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845413+0000", 2020-11-16T20:58:10.433 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0020276000000000001 2020-11-16T20:58:10.433 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.433 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.434 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:10.434 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847441+0000", 2020-11-16T20:58:10.434 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00050358800000000002 2020-11-16T20:58:10.434 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.434 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.434 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:10.434 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847944+0000", 2020-11-16T20:58:10.435 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042758900000000001 2020-11-16T20:58:10.435 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.435 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.435 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:10.435 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852220+0000", 2020-11-16T20:58:10.435 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9648999999999997e-05 2020-11-16T20:58:10.435 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.435 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.436 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:10.436 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852290+0000", 2020-11-16T20:58:10.436 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6919e-05 2020-11-16T20:58:10.436 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.436 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.436 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:10.436 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852367+0000", 2020-11-16T20:58:10.437 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.035208633 2020-11-16T20:58:10.437 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.437 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:10.437 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.437 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.437 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.437 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2983 4.0 4:1852173c:::smithi16641208-329:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e86)", 2020-11-16T20:58:10.438 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:58:10.438 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 81.568434178999993, 2020-11-16T20:58:10.438 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.037016812999999, 2020-11-16T20:58:10.438 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:10.438 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:10.438 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:10.438 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:10.438 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:10.439 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2983 2020-11-16T20:58:10.439 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.439 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:10.439 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.439 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:10.439 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:58:10.439 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:10.440 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.440 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.440 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:10.440 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:58:10.440 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7317999999999999e-05 2020-11-16T20:58:10.440 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.440 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.440 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:10.441 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817266+0000", 2020-11-16T20:58:10.441 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3519999999999998e-06 2020-11-16T20:58:10.441 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.441 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.441 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:10.441 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817269+0000", 2020-11-16T20:58:10.441 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7859999999999999e-06 2020-11-16T20:58:10.442 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.442 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.442 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:10.442 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817276+0000", 2020-11-16T20:58:10.442 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5620000000000002e-06 2020-11-16T20:58:10.442 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.442 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.443 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:10.443 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817278+0000", 2020-11-16T20:58:10.443 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3251999999999996e-05 2020-11-16T20:58:10.443 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.443 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.443 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.443 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817352+0000", 2020-11-16T20:58:10.444 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7966000000000001e-05 2020-11-16T20:58:10.444 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.444 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.444 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:10.444 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817400+0000", 2020-11-16T20:58:10.444 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.982734203 2020-11-16T20:58:10.444 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.445 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.445 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.445 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800134+0000", 2020-11-16T20:58:10.445 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9765999999999997e-05 2020-11-16T20:58:10.445 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.445 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.445 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:10.445 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800194+0000", 2020-11-16T20:58:10.446 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.046087276000000003 2020-11-16T20:58:10.446 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.446 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.446 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.446 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846281+0000", 2020-11-16T20:58:10.446 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000115396 2020-11-16T20:58:10.446 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.447 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.447 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:10.447 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846396+0000", 2020-11-16T20:58:10.447 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006004573 2020-11-16T20:58:10.447 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.447 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.447 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.447 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852401+0000", 2020-11-16T20:58:10.448 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013211599999999999 2020-11-16T20:58:10.448 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.448 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.448 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:10.448 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852533+0000", 2020-11-16T20:58:10.448 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0017322469999999999 2020-11-16T20:58:10.448 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.449 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.449 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:10.449 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.854265+0000", 2020-11-16T20:58:10.449 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.037016812999999 2020-11-16T20:58:10.449 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.449 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:10.449 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.449 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.450 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.450 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2984 4.0 4:033219d6:::smithi16641208-386:head [write 598481~712995,stat] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:10.450 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:58:10.450 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 81.561374337000004, 2020-11-16T20:58:10.450 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.003104742, 2020-11-16T20:58:10.450 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:10.450 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:10.451 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:10.451 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:10.451 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:10.451 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2984 2020-11-16T20:58:10.451 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.451 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:10.451 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.452 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:10.452 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:58:10.452 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:10.452 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.452 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.452 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:10.452 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:58:10.452 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00037173000000000002 2020-11-16T20:58:10.453 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.453 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.453 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:10.453 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824680+0000", 2020-11-16T20:58:10.453 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.146e-05 2020-11-16T20:58:10.453 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.453 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.454 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:10.454 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824691+0000", 2020-11-16T20:58:10.454 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6951000000000001e-05 2020-11-16T20:58:10.454 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.454 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.454 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:10.454 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824708+0000", 2020-11-16T20:58:10.455 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2082000000000001e-05 2020-11-16T20:58:10.455 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.455 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.455 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:10.455 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824720+0000", 2020-11-16T20:58:10.455 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0284000000000002e-05 2020-11-16T20:58:10.455 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.455 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.456 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.456 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824771+0000", 2020-11-16T20:58:10.456 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1241000000000001e-05 2020-11-16T20:58:10.456 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.456 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.456 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:10.456 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824802+0000", 2020-11-16T20:58:10.457 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.975455838 2020-11-16T20:58:10.457 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.457 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.457 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.457 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800258+0000", 2020-11-16T20:58:10.457 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027151194999999999 2020-11-16T20:58:10.457 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.457 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.458 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:10.458 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827409+0000", 2020-11-16T20:58:10.458 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9609999999999999e-06 2020-11-16T20:58:10.458 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.458 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.458 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:10.458 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827413+0000", 2020-11-16T20:58:10.459 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.003104742 2020-11-16T20:58:10.459 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.459 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:10.459 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.459 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.460 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.460 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2985 4.0 4:033219d6:::smithi16641208-386:head [write 1899355~418865] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:10.460 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:58:10.460 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 81.555763055, 2020-11-16T20:58:10.460 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.021091737000001, 2020-11-16T20:58:10.461 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:10.461 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:10.461 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:10.461 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:10.461 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:10.461 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2985 2020-11-16T20:58:10.462 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.462 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:10.462 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.462 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:10.462 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:58:10.462 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:10.462 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.463 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.463 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:10.463 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:58:10.463 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023221799999999999 2020-11-16T20:58:10.463 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.463 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.463 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:10.464 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830152+0000", 2020-11-16T20:58:10.464 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9769999999999995e-06 2020-11-16T20:58:10.464 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.464 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.464 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:10.464 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830162+0000", 2020-11-16T20:58:10.464 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5545000000000001e-05 2020-11-16T20:58:10.465 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.465 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.465 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:10.465 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830177+0000", 2020-11-16T20:58:10.465 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0334e-05 2020-11-16T20:58:10.465 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.465 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.466 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:10.466 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830188+0000", 2020-11-16T20:58:10.466 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3430999999999996e-05 2020-11-16T20:58:10.466 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.466 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.466 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.466 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830251+0000", 2020-11-16T20:58:10.467 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2651999999999997e-05 2020-11-16T20:58:10.467 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.467 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.467 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:10.467 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830304+0000", 2020-11-16T20:58:10.467 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.970289857999999 2020-11-16T20:58:10.467 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.468 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.468 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.468 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800594+0000", 2020-11-16T20:58:10.468 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8948999999999993e-05 2020-11-16T20:58:10.468 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.468 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.468 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:10.468 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800663+0000", 2020-11-16T20:58:10.469 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036018513000000002 2020-11-16T20:58:10.469 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.469 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.469 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.469 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836681+0000", 2020-11-16T20:58:10.469 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013201099999999999 2020-11-16T20:58:10.469 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.470 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.470 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:10.470 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836813+0000", 2020-11-16T20:58:10.470 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000126635 2020-11-16T20:58:10.470 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.470 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.470 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:10.471 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836940+0000", 2020-11-16T20:58:10.471 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010477907 2020-11-16T20:58:10.471 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.471 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.471 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:10.471 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847418+0000", 2020-11-16T20:58:10.471 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000158796 2020-11-16T20:58:10.471 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.472 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.472 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:10.472 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847576+0000", 2020-11-16T20:58:10.472 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033023729999999999 2020-11-16T20:58:10.472 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.472 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.472 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:10.473 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850879+0000", 2020-11-16T20:58:10.473 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6360999999999996e-05 2020-11-16T20:58:10.473 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.473 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.473 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:10.473 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850955+0000", 2020-11-16T20:58:10.473 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6177000000000001e-05 2020-11-16T20:58:10.473 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.474 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.474 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:10.474 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851011+0000", 2020-11-16T20:58:10.474 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.021091737000001 2020-11-16T20:58:10.474 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.474 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:10.474 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.475 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.475 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.475 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2986 4.0 4:033219d6:::smithi16641208-386:head [write 3093840~704641] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:10.475 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:58:10.475 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 81.547537352999996, 2020-11-16T20:58:10.475 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013155362999999, 2020-11-16T20:58:10.475 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:10.476 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:10.476 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:10.476 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:10.476 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:10.476 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2986 2020-11-16T20:58:10.476 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.476 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:10.476 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.477 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:10.477 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:58:10.477 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:10.477 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.477 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.477 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:10.477 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:58:10.478 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00038247200000000002 2020-11-16T20:58:10.478 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.478 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.478 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:10.478 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838528+0000", 2020-11-16T20:58:10.478 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3299999999999999e-06 2020-11-16T20:58:10.478 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.479 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.479 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:10.479 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838536+0000", 2020-11-16T20:58:10.479 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3438000000000001e-05 2020-11-16T20:58:10.479 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.479 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.479 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:10.479 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838549+0000", 2020-11-16T20:58:10.480 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0213e-05 2020-11-16T20:58:10.480 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.480 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.480 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:10.480 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838560+0000", 2020-11-16T20:58:10.480 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1894999999999997e-05 2020-11-16T20:58:10.480 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.481 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.481 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.481 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838612+0000", 2020-11-16T20:58:10.481 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8209e-05 2020-11-16T20:58:10.481 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.481 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.481 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:10.481 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838650+0000", 2020-11-16T20:58:10.482 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962061715000001 2020-11-16T20:58:10.482 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.482 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.482 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.482 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800712+0000", 2020-11-16T20:58:10.482 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6964e-05 2020-11-16T20:58:10.482 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.483 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.483 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:10.483 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800748+0000", 2020-11-16T20:58:10.483 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037209265999999998 2020-11-16T20:58:10.483 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.483 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.483 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.484 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.837958+0000", 2020-11-16T20:58:10.484 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000160304 2020-11-16T20:58:10.484 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.484 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.484 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:10.484 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.838118+0000", 2020-11-16T20:58:10.484 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022362799999999999 2020-11-16T20:58:10.484 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.485 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.485 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:10.485 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.838342+0000", 2020-11-16T20:58:10.485 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0090844710000000002 2020-11-16T20:58:10.485 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.485 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.485 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:10.486 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847426+0000", 2020-11-16T20:58:10.486 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000219199 2020-11-16T20:58:10.486 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.486 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.486 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:10.486 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847645+0000", 2020-11-16T20:58:10.486 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003411603 2020-11-16T20:58:10.487 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.487 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.487 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:10.487 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851057+0000", 2020-11-16T20:58:10.487 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014736799999999999 2020-11-16T20:58:10.487 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.487 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.487 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:10.488 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851204+0000", 2020-11-16T20:58:10.488 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6287999999999997e-05 2020-11-16T20:58:10.488 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.488 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.488 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:10.488 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851301+0000", 2020-11-16T20:58:10.488 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013155362999999 2020-11-16T20:58:10.489 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.489 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:10.489 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.489 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.489 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.489 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2987 4.0 4:033219d6:::smithi16641208-386:head [setxattr _header (58) in=7b,truncate 3798481] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:10.489 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:58:10.489 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 81.547078713999994, 2020-11-16T20:58:10.490 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.012971041, 2020-11-16T20:58:10.490 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:10.490 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:10.490 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:10.490 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:10.490 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:10.491 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2987 2020-11-16T20:58:10.491 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.491 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:10.491 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.491 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:10.491 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:58:10.491 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:10.492 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.492 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.492 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:10.492 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:58:10.492 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4530000000000002e-05 2020-11-16T20:58:10.492 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.492 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.493 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:10.493 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838648+0000", 2020-11-16T20:58:10.493 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8390000000000001e-06 2020-11-16T20:58:10.493 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.493 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.493 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:10.493 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838655+0000", 2020-11-16T20:58:10.494 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0341e-05 2020-11-16T20:58:10.494 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.494 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.494 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:10.494 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838666+0000", 2020-11-16T20:58:10.494 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0929999999999999e-06 2020-11-16T20:58:10.494 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.495 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.495 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:10.495 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838672+0000", 2020-11-16T20:58:10.495 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8074999999999997e-05 2020-11-16T20:58:10.495 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.495 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.495 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.495 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838710+0000", 2020-11-16T20:58:10.496 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1121000000000002e-05 2020-11-16T20:58:10.496 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.496 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.496 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:10.496 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838751+0000", 2020-11-16T20:58:10.496 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962044797000001 2020-11-16T20:58:10.496 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.497 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.497 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.497 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800796+0000", 2020-11-16T20:58:10.497 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6808999999999998e-05 2020-11-16T20:58:10.497 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.497 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.497 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:10.497 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800852+0000", 2020-11-16T20:58:10.498 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042964599999999999 2020-11-16T20:58:10.498 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.498 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.498 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.498 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843817+0000", 2020-11-16T20:58:10.498 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017807899999999999 2020-11-16T20:58:10.499 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.499 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.499 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:10.499 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843995+0000", 2020-11-16T20:58:10.499 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023680500000000001 2020-11-16T20:58:10.499 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.499 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.500 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:10.500 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844232+0000", 2020-11-16T20:58:10.500 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00320163 2020-11-16T20:58:10.500 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.500 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.500 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:10.500 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847434+0000", 2020-11-16T20:58:10.501 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00042527899999999998 2020-11-16T20:58:10.501 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.501 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.501 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:10.501 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847859+0000", 2020-11-16T20:58:10.501 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0034987920000000001 2020-11-16T20:58:10.501 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.502 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.502 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:10.502 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851358+0000", 2020-11-16T20:58:10.502 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014067300000000001 2020-11-16T20:58:10.502 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.502 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.502 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:10.503 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851498+0000", 2020-11-16T20:58:10.503 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6577999999999998e-05 2020-11-16T20:58:10.503 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.503 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.503 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:10.503 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851575+0000", 2020-11-16T20:58:10.503 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.012971041 2020-11-16T20:58:10.503 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.504 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:10.504 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.504 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.504 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.504 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2988 4.0 4:033219d6:::smithi16641208-386:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e86)", 2020-11-16T20:58:10.504 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:58:10.504 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 81.546976215000001, 2020-11-16T20:58:10.505 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013229791000001, 2020-11-16T20:58:10.505 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:10.505 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:10.505 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:10.505 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:10.505 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:10.505 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2988 2020-11-16T20:58:10.506 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.506 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:10.506 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.506 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:10.506 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:58:10.506 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:10.506 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.507 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.507 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:10.507 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:58:10.507 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9252999999999999e-05 2020-11-16T20:58:10.507 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.507 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.508 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:10.508 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838736+0000", 2020-11-16T20:58:10.508 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3980000000000004e-06 2020-11-16T20:58:10.508 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.508 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.508 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:10.508 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838742+0000", 2020-11-16T20:58:10.509 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1144999999999999e-05 2020-11-16T20:58:10.509 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.509 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.509 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:10.509 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838753+0000", 2020-11-16T20:58:10.509 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6229999999999996e-06 2020-11-16T20:58:10.509 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.509 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.510 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:10.510 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838758+0000", 2020-11-16T20:58:10.510 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5130000000000003e-05 2020-11-16T20:58:10.510 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.510 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.510 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.511 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838803+0000", 2020-11-16T20:58:10.511 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0132000000000001e-05 2020-11-16T20:58:10.511 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.511 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.511 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:10.511 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838843+0000", 2020-11-16T20:58:10.511 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962066786999999 2020-11-16T20:58:10.512 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.512 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.512 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.512 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800910+0000", 2020-11-16T20:58:10.513 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6925999999999997e-05 2020-11-16T20:58:10.513 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.513 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.513 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:10.513 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800967+0000", 2020-11-16T20:58:10.513 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.043837752000000001 2020-11-16T20:58:10.513 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.514 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.514 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.514 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844805+0000", 2020-11-16T20:58:10.514 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012337000000000001 2020-11-16T20:58:10.514 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.514 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.514 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:10.514 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844928+0000", 2020-11-16T20:58:10.515 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0066885149999999999 2020-11-16T20:58:10.515 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.515 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.515 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.515 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851616+0000", 2020-11-16T20:58:10.515 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5716000000000005e-05 2020-11-16T20:58:10.515 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.516 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.516 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:10.516 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851692+0000", 2020-11-16T20:58:10.516 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024404400000000001 2020-11-16T20:58:10.516 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.516 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.516 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:10.517 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851936+0000", 2020-11-16T20:58:10.517 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013229791000001 2020-11-16T20:58:10.517 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.517 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:10.517 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.517 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.517 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.517 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2992 4.0 4:0f4a2e46:::smithi16641208-399:head [cache-evict] snapc 0=[] ondisk+read+ignore_cache+known_if_redirected e86)", 2020-11-16T20:58:10.518 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:58:10.518 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 81.546889878000002, 2020-11-16T20:58:10.518 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962433468, 2020-11-16T20:58:10.518 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:10.518 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:10.518 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:10.518 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:10.519 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:10.519 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2992 2020-11-16T20:58:10.519 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.519 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:10.519 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.519 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:10.519 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:58:10.520 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:10.520 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.520 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.520 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:10.520 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:58:10.520 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7780000000000002e-05 2020-11-16T20:58:10.520 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.520 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.521 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:10.521 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838820+0000", 2020-11-16T20:58:10.521 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1200000000000001e-06 2020-11-16T20:58:10.521 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.521 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.521 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:10.521 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838826+0000", 2020-11-16T20:58:10.522 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0008e-05 2020-11-16T20:58:10.522 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.522 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.522 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:10.522 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838836+0000", 2020-11-16T20:58:10.522 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3749999999999996e-06 2020-11-16T20:58:10.522 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.523 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.523 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:10.523 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838840+0000", 2020-11-16T20:58:10.523 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0889000000000002e-05 2020-11-16T20:58:10.523 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.523 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.523 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.523 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838871+0000", 2020-11-16T20:58:10.524 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6891000000000003e-05 2020-11-16T20:58:10.524 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.524 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.524 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:10.524 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838908+0000", 2020-11-16T20:58:10.524 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962115045999999 2020-11-16T20:58:10.524 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.525 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.525 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.525 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801023+0000", 2020-11-16T20:58:10.525 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020335899999999999 2020-11-16T20:58:10.525 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.525 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.525 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:10.525 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801226+0000", 2020-11-16T20:58:10.526 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962433468 2020-11-16T20:58:10.526 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.526 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:10.526 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.526 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.526 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.526 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3051 4.0 4:2ceac9f9:::smithi16641208-61:head [write 699323~480842] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:58:10.527 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:58:10.527 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.544769571000003, 2020-11-16T20:58:10.527 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9728349610000002, 2020-11-16T20:58:10.527 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:10.527 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:10.527 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:10.527 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:10.528 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:10.528 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3051 2020-11-16T20:58:10.528 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.528 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:10.528 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.528 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:10.528 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:58:10.529 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:10.529 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.529 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.529 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:10.529 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:58:10.529 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032526199999999999 2020-11-16T20:58:10.529 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.529 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.530 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:10.530 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841238+0000", 2020-11-16T20:58:10.530 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9822000000000001e-05 2020-11-16T20:58:10.530 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.530 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.530 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:10.530 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841258+0000", 2020-11-16T20:58:10.531 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.507e-05 2020-11-16T20:58:10.531 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.531 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.531 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:10.531 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841273+0000", 2020-11-16T20:58:10.531 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8900000000000007e-06 2020-11-16T20:58:10.531 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.531 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.532 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:10.532 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841281+0000", 2020-11-16T20:58:10.532 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4356000000000003e-05 2020-11-16T20:58:10.532 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.532 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.532 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.532 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841365+0000", 2020-11-16T20:58:10.533 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0232000000000002e-05 2020-11-16T20:58:10.533 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.533 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.533 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:10.533 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841426+0000", 2020-11-16T20:58:10.533 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9604309439999996 2020-11-16T20:58:10.533 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.533 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.534 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.534 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801857+0000", 2020-11-16T20:58:10.534 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000164897 2020-11-16T20:58:10.534 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.534 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.534 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:10.534 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.802021+0000", 2020-11-16T20:58:10.535 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020576500000000001 2020-11-16T20:58:10.535 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.535 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.535 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:10.535 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.802227+0000", 2020-11-16T20:58:10.535 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0066237170000000003 2020-11-16T20:58:10.535 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.536 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.536 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:10.536 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808851+0000", 2020-11-16T20:58:10.536 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037712430000000001 2020-11-16T20:58:10.536 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.536 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.536 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:10.536 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812622+0000", 2020-11-16T20:58:10.537 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00099110800000000009 2020-11-16T20:58:10.537 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.537 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.537 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:10.537 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813613+0000", 2020-11-16T20:58:10.537 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1646e-05 2020-11-16T20:58:10.537 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.538 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.538 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:10.538 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813665+0000", 2020-11-16T20:58:10.538 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3009000000000004e-05 2020-11-16T20:58:10.538 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.538 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.538 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:10.538 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813748+0000", 2020-11-16T20:58:10.539 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9728349610000002 2020-11-16T20:58:10.539 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.539 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:10.539 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.539 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.539 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.539 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3052 4.0 4:2ceac9f9:::smithi16641208-61:head [write 1850247~429872] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:58:10.540 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:58:10.540 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.536578531999993, 2020-11-16T20:58:10.540 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9911138360000002, 2020-11-16T20:58:10.540 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:10.540 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:10.540 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:10.540 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:10.540 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:10.541 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3052 2020-11-16T20:58:10.541 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.541 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:10.541 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.541 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:10.541 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:58:10.541 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:10.542 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.542 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.542 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:10.542 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:58:10.542 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000296166 2020-11-16T20:58:10.542 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.542 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.543 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:10.543 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849400+0000", 2020-11-16T20:58:10.543 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0699999999999996e-06 2020-11-16T20:58:10.543 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.543 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.543 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:10.543 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849409+0000", 2020-11-16T20:58:10.544 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3725e-05 2020-11-16T20:58:10.544 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.544 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.544 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:10.544 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849423+0000", 2020-11-16T20:58:10.544 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9929999999999998e-06 2020-11-16T20:58:10.544 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.544 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.545 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:10.545 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849430+0000", 2020-11-16T20:58:10.545 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9708000000000002e-05 2020-11-16T20:58:10.545 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.545 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.545 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.545 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849520+0000", 2020-11-16T20:58:10.546 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2088000000000002e-05 2020-11-16T20:58:10.546 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.546 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.546 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:10.546 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849552+0000", 2020-11-16T20:58:10.546 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.954526692 2020-11-16T20:58:10.546 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.547 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.547 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.547 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804079+0000", 2020-11-16T20:58:10.547 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015456899999999999 2020-11-16T20:58:10.547 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.547 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.547 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:10.547 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804233+0000", 2020-11-16T20:58:10.548 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019627800000000001 2020-11-16T20:58:10.548 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.548 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.548 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:10.548 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804429+0000", 2020-11-16T20:58:10.548 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006762316 2020-11-16T20:58:10.548 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.549 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.549 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:10.549 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811192+0000", 2020-11-16T20:58:10.549 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002630467 2020-11-16T20:58:10.549 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.549 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.549 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:10.549 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813822+0000", 2020-11-16T20:58:10.550 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026302065999999999 2020-11-16T20:58:10.550 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.550 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.550 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:10.550 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840124+0000", 2020-11-16T20:58:10.550 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.274e-05 2020-11-16T20:58:10.550 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.551 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.551 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:10.551 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840177+0000", 2020-11-16T20:58:10.551 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0958000000000003e-05 2020-11-16T20:58:10.551 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.551 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.551 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:10.552 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840218+0000", 2020-11-16T20:58:10.552 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9911138360000002 2020-11-16T20:58:10.552 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.552 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:10.552 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.552 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.552 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.552 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3053 4.0 4:2ceac9f9:::smithi16641208-61:head [write 2858378~532392] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:58:10.553 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:58:10.553 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.528121201000005, 2020-11-16T20:58:10.553 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9828430529999999, 2020-11-16T20:58:10.553 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:10.553 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:10.553 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:10.553 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:10.554 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:10.554 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3053 2020-11-16T20:58:10.554 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.554 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:10.554 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.554 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:10.555 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:58:10.555 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:10.555 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.555 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.555 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:10.555 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:58:10.555 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000647082 2020-11-16T20:58:10.556 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.556 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.556 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:10.556 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858208+0000", 2020-11-16T20:58:10.556 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.269e-05 2020-11-16T20:58:10.556 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.556 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.556 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:10.557 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858221+0000", 2020-11-16T20:58:10.557 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0361e-05 2020-11-16T20:58:10.557 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.557 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.557 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:10.557 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858242+0000", 2020-11-16T20:58:10.557 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1184e-05 2020-11-16T20:58:10.558 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.558 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.558 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:10.558 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858253+0000", 2020-11-16T20:58:10.558 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7032000000000004e-05 2020-11-16T20:58:10.558 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.558 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.559 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.559 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858330+0000", 2020-11-16T20:58:10.559 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4135999999999998e-05 2020-11-16T20:58:10.559 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.559 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.559 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:10.559 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858384+0000", 2020-11-16T20:58:10.560 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9487614310000003 2020-11-16T20:58:10.560 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.560 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.560 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.560 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807145+0000", 2020-11-16T20:58:10.560 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9426000000000007e-05 2020-11-16T20:58:10.560 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.561 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.561 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:10.561 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807245+0000", 2020-11-16T20:58:10.561 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018410799999999999 2020-11-16T20:58:10.561 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.561 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.562 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:10.562 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807429+0000", 2020-11-16T20:58:10.562 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0064067339999999999 2020-11-16T20:58:10.562 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.562 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.562 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:10.562 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813836+0000", 2020-11-16T20:58:10.563 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001513267 2020-11-16T20:58:10.563 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.563 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.563 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:10.563 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815349+0000", 2020-11-16T20:58:10.563 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024962895999999998 2020-11-16T20:58:10.563 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.563 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.564 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:10.564 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840312+0000", 2020-11-16T20:58:10.564 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7781999999999997e-05 2020-11-16T20:58:10.564 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.564 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.564 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:10.564 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840370+0000", 2020-11-16T20:58:10.565 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4924e-05 2020-11-16T20:58:10.565 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.565 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.565 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:10.565 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840404+0000", 2020-11-16T20:58:10.565 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9828430529999999 2020-11-16T20:58:10.565 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.566 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:10.566 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.566 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.566 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.566 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3054 4.0 4:2ceac9f9:::smithi16641208-61:head [setxattr _header (57) in=7b,truncate 3899323] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:58:10.566 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:58:10.566 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.527368694000003, 2020-11-16T20:58:10.567 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9822430049999999, 2020-11-16T20:58:10.567 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:10.567 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:10.567 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:10.567 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:10.567 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:10.567 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3054 2020-11-16T20:58:10.567 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.568 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:10.568 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.568 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:10.568 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:58:10.568 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:10.568 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.568 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.569 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:10.569 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:58:10.569 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8208999999999999e-05 2020-11-16T20:58:10.569 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.569 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.569 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:10.569 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858362+0000", 2020-11-16T20:58:10.570 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5539999999999998e-06 2020-11-16T20:58:10.570 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.570 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.570 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:10.570 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858371+0000", 2020-11-16T20:58:10.570 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.005e-05 2020-11-16T20:58:10.570 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.570 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.571 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:10.571 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858381+0000", 2020-11-16T20:58:10.571 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8099999999999997e-06 2020-11-16T20:58:10.571 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.571 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.571 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:10.571 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858386+0000", 2020-11-16T20:58:10.572 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6168000000000005e-05 2020-11-16T20:58:10.572 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.572 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.572 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.572 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858482+0000", 2020-11-16T20:58:10.572 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7954999999999999e-05 2020-11-16T20:58:10.572 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.572 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.573 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:10.573 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858510+0000", 2020-11-16T20:58:10.573 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9498925639999998 2020-11-16T20:58:10.573 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.573 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.573 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.573 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808402+0000", 2020-11-16T20:58:10.574 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3084000000000005e-05 2020-11-16T20:58:10.574 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.574 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.574 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:10.574 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808495+0000", 2020-11-16T20:58:10.574 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114826 2020-11-16T20:58:10.574 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.575 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.575 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:10.575 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808610+0000", 2020-11-16T20:58:10.575 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052363219999999999 2020-11-16T20:58:10.575 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.575 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.575 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:10.575 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813846+0000", 2020-11-16T20:58:10.576 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0015700709999999999 2020-11-16T20:58:10.576 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.576 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.576 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:10.576 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815417+0000", 2020-11-16T20:58:10.576 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025048682999999999 2020-11-16T20:58:10.576 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.577 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.577 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:10.577 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840465+0000", 2020-11-16T20:58:10.577 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5473000000000003e-05 2020-11-16T20:58:10.577 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.577 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.577 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:10.577 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840511+0000", 2020-11-16T20:58:10.578 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6236000000000003e-05 2020-11-16T20:58:10.578 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.578 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.578 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:10.578 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840557+0000", 2020-11-16T20:58:10.578 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9822430049999999 2020-11-16T20:58:10.578 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.579 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:10.579 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.579 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.579 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.579 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3055 4.0 4:2ceac9f9:::smithi16641208-61:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e91)", 2020-11-16T20:58:10.579 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:58:10.579 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.527193498000003, 2020-11-16T20:58:10.579 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9852841799999998, 2020-11-16T20:58:10.580 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:10.580 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:10.580 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:10.580 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:10.580 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:10.580 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3055 2020-11-16T20:58:10.580 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.581 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:10.581 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.581 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:10.581 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:58:10.581 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:10.581 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.581 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.581 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:10.582 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:58:10.582 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4403000000000002e-05 2020-11-16T20:58:10.582 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.582 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.582 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:10.582 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858523+0000", 2020-11-16T20:58:10.582 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4670000000000001e-06 2020-11-16T20:58:10.583 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.583 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.583 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:10.583 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858530+0000", 2020-11-16T20:58:10.583 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2469999999999999e-05 2020-11-16T20:58:10.583 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.583 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.584 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:10.584 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858542+0000", 2020-11-16T20:58:10.584 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2449999999999998e-06 2020-11-16T20:58:10.584 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.584 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.584 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:10.584 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858548+0000", 2020-11-16T20:58:10.585 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9604000000000002e-05 2020-11-16T20:58:10.585 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.585 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.585 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.585 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858587+0000", 2020-11-16T20:58:10.585 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4863000000000001e-05 2020-11-16T20:58:10.585 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.585 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.586 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:10.586 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858632+0000", 2020-11-16T20:58:10.586 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9521692039999996 2020-11-16T20:58:10.586 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.586 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.586 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.586 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.810801+0000", 2020-11-16T20:58:10.587 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014886700000000001 2020-11-16T20:58:10.587 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.587 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.587 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:10.587 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.810950+0000", 2020-11-16T20:58:10.587 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029669781999999999 2020-11-16T20:58:10.587 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.588 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.588 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.588 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840620+0000", 2020-11-16T20:58:10.588 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010005699999999999 2020-11-16T20:58:10.588 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.588 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.588 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:10.588 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840720+0000", 2020-11-16T20:58:10.589 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030532179999999999 2020-11-16T20:58:10.589 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.589 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.589 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:10.589 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843773+0000", 2020-11-16T20:58:10.589 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9852841799999998 2020-11-16T20:58:10.589 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.590 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:10.590 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.590 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.590 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.590 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3065 4.0 4:2f657946:::smithi16641208-73:head [read 0~3210104,checksum] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:58:10.590 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:58:10.590 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.418918474999998, 2020-11-16T20:58:10.591 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8738324339999997, 2020-11-16T20:58:10.591 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:10.591 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:10.591 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:10.591 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:10.591 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:10.591 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3065 2020-11-16T20:58:10.592 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.592 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:10.592 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.592 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:10.592 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:58:10.592 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:10.593 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.593 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.593 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:10.593 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:58:10.593 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3065999999999999e-05 2020-11-16T20:58:10.593 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.593 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.594 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:10.594 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966787+0000", 2020-11-16T20:58:10.594 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8329999999999998e-06 2020-11-16T20:58:10.594 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.594 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.594 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:10.594 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966790+0000", 2020-11-16T20:58:10.595 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1780000000000002e-06 2020-11-16T20:58:10.595 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.595 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.595 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:10.595 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966795+0000", 2020-11-16T20:58:10.595 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3460000000000001e-06 2020-11-16T20:58:10.595 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.596 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.596 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:10.596 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966798+0000", 2020-11-16T20:58:10.596 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6675000000000003e-05 2020-11-16T20:58:10.596 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.596 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.596 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.597 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966844+0000", 2020-11-16T20:58:10.597 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5497999999999999e-05 2020-11-16T20:58:10.597 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.597 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.597 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:10.597 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966870+0000", 2020-11-16T20:58:10.597 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8445859479999998 2020-11-16T20:58:10.597 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.598 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.598 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:10.598 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811456+0000", 2020-11-16T20:58:10.598 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029140889999999999 2020-11-16T20:58:10.598 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.598 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.599 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:10.599 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840597+0000", 2020-11-16T20:58:10.599 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8738324339999997 2020-11-16T20:58:10.599 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.599 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:10.599 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:10.599 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.600 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.600 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3066 4.0 4:356864c0:::smithi16641208-150:head [read 0~2504243,checksum,omap-get-vals-by-keys,omap-get-keys,omap-get-vals,omap-get-header,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:58:10.600 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:58:10.600 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.418867250000005, 2020-11-16T20:58:10.600 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8778990499999999, 2020-11-16T20:58:10.600 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:10.600 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:10.601 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:10.601 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:10.601 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:10.601 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3066 2020-11-16T20:58:10.601 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.601 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:10.601 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.602 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:10.602 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:58:10.602 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:10.602 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.602 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.602 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:10.602 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:58:10.602 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1704000000000001e-05 2020-11-16T20:58:10.603 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:10.603 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:10.603 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:10.603 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966837+0000", 2020-11-16T20:58:14.834 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6850000000000001e-06 2020-11-16T20:58:14.834 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.834 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.835 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:14.835 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966840+0000", 2020-11-16T20:58:14.835 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7479999999999999e-06 2020-11-16T20:58:14.835 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.835 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.835 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:14.835 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966845+0000", 2020-11-16T20:58:14.836 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5059999999999998e-06 2020-11-16T20:58:14.836 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.836 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.836 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:14.836 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966848+0000", 2020-11-16T20:58:14.836 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4314000000000002e-05 2020-11-16T20:58:14.836 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.837 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.837 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:14.837 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966902+0000", 2020-11-16T20:58:14.837 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.561e-05 2020-11-16T20:58:14.837 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.837 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.837 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:14.838 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:58:14.838 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8448102110000004 2020-11-16T20:58:14.838 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.838 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.838 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:14.838 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811738+0000", 2020-11-16T20:58:14.839 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032976272000000001 2020-11-16T20:58:14.839 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.839 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.839 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:14.839 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844714+0000", 2020-11-16T20:58:14.839 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8778990499999999 2020-11-16T20:58:14.839 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:14.840 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:14.840 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:14.840 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.840 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.840 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3067 4.0 4:356864c0:::smithi16641208-150:head [sparse-read 0~2504243] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:58:14.840 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:58:14.840 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.418815792999993, 2020-11-16T20:58:14.841 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8780898150000001, 2020-11-16T20:58:14.841 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:14.841 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:14.841 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:14.841 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:14.841 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:14.841 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3067 2020-11-16T20:58:14.842 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.842 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:14.842 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.842 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:14.842 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:58:14.842 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:14.842 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.843 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.843 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:14.843 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:58:14.843 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2826e-05 2020-11-16T20:58:14.843 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.843 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.843 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:14.844 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966900+0000", 2020-11-16T20:58:14.844 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.694e-06 2020-11-16T20:58:14.844 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.844 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.844 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:14.844 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966902+0000", 2020-11-16T20:58:14.845 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0889999999999999e-06 2020-11-16T20:58:14.845 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.845 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.845 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:14.845 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966907+0000", 2020-11-16T20:58:14.845 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3910000000000001e-06 2020-11-16T20:58:14.845 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.846 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.846 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:14.846 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966910+0000", 2020-11-16T20:58:14.846 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2771000000000002e-05 2020-11-16T20:58:14.846 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.846 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.846 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:14.847 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966943+0000", 2020-11-16T20:58:14.847 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5301000000000001e-05 2020-11-16T20:58:14.847 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.847 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.847 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:14.847 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966968+0000", 2020-11-16T20:58:14.847 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.845055017 2020-11-16T20:58:14.848 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.848 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.848 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:14.848 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812023+0000", 2020-11-16T20:58:14.848 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032933726000000003 2020-11-16T20:58:14.848 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.848 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.849 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:14.849 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844957+0000", 2020-11-16T20:58:14.849 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8780898150000001 2020-11-16T20:58:14.849 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:14.849 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:14.849 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:14.849 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.850 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.850 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3068 4.0 4:356864c0:::smithi16641208-150:head [read 0~2504243,checksum] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:58:14.850 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:58:14.850 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.418754454999998, 2020-11-16T20:58:14.850 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8828719500000002, 2020-11-16T20:58:14.850 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:14.850 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:14.851 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:14.851 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:14.851 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:14.851 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3068 2020-11-16T20:58:14.851 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.851 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:14.851 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.852 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:14.852 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:58:14.852 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:14.852 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.852 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.852 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:14.852 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:58:14.852 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0942999999999999e-05 2020-11-16T20:58:14.853 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.853 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.853 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:14.853 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966949+0000", 2020-11-16T20:58:14.853 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.712e-06 2020-11-16T20:58:14.853 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.854 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.854 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:14.854 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966952+0000", 2020-11-16T20:58:14.854 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8479999999999997e-06 2020-11-16T20:58:14.854 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.854 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.854 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:14.855 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966958+0000", 2020-11-16T20:58:14.855 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9170000000000002e-06 2020-11-16T20:58:14.855 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.855 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.855 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:14.855 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966961+0000", 2020-11-16T20:58:14.855 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4105999999999999e-05 2020-11-16T20:58:14.856 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.856 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.856 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:14.856 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966985+0000", 2020-11-16T20:58:14.856 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2056e-05 2020-11-16T20:58:14.856 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.856 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.856 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:14.857 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.967007+0000", 2020-11-16T20:58:14.857 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8456606430000004 2020-11-16T20:58:14.857 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.857 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.857 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:14.857 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812667+0000", 2020-11-16T20:58:14.857 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037132724999999998 2020-11-16T20:58:14.858 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:14.858 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:14.858 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:14.858 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849800+0000", 2020-11-16T20:58:14.858 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8828719500000002 2020-11-16T20:58:14.858 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:14.858 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:14.859 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:14.859 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:14.859 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:14.859 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:14.860 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2020-11-16T20:58:14.860 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:58:14.861 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7, 1] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:58:14.861 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:58:14.861 INFO:tasks.thrashosds.thrasher:Setting osd 4 primary_affinity to 0.000000 2020-11-16T20:58:14.861 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 0 2020-11-16T20:58:14.867 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:58:14.867 INFO:tasks.rados.rados.0.smithi166.stdout:1266: finishing rollback tid 0 to smithi16641208-171 2020-11-16T20:58:14.868 INFO:tasks.rados.rados.0.smithi166.stdout:1266: finishing rollback tid 1 to smithi16641208-171 2020-11-16T20:58:14.868 INFO:tasks.rados.rados.0.smithi166.stdout:1267: got (0) Success 2020-11-16T20:58:14.868 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 265 v 0 (ObjNum 618 snap 32 seq_num 618) dirty exists 2020-11-16T20:58:14.868 INFO:tasks.rados.rados.0.smithi166.stdout:1266: finishing rollback tid 2 to smithi16641208-171 2020-11-16T20:58:14.868 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 171 v 780 (ObjNum 95 snap 0 seq_num 95) dirty exists 2020-11-16T20:58:14.868 INFO:tasks.rados.rados.0.smithi166.stdout:1265: done (3 left) 2020-11-16T20:58:14.868 INFO:tasks.rados.rados.0.smithi166.stdout:1266: done (2 left) 2020-11-16T20:58:14.869 INFO:tasks.rados.rados.0.smithi166.stdout:1267: done (1 left) 2020-11-16T20:58:14.869 INFO:tasks.rados.rados.0.smithi166.stdout:1269: done (0 left) 2020-11-16T20:58:14.869 INFO:tasks.rados.rados.0.smithi166.stdout:1270: read oid 484 snap -1 2020-11-16T20:58:14.869 INFO:tasks.rados.rados.0.smithi166.stdout:1270: expect (ObjNum 483 snap 0 seq_num 483) 2020-11-16T20:58:14.869 INFO:tasks.rados.rados.0.smithi166.stdout:1271: snap_create 2020-11-16T20:58:14.869 INFO:tasks.rados.rados.0.smithi166.stdout:1270: expect (ObjNum 483 snap 0 seq_num 483) 2020-11-16T20:58:14.869 INFO:tasks.rados.rados.0.smithi166.stdout:1270: done (1 left) 2020-11-16T20:58:14.870 INFO:tasks.rados.rados.0.smithi166.stdout:1271: done (0 left) 2020-11-16T20:58:14.870 INFO:tasks.rados.rados.0.smithi166.stdout:1272: cache_evict oid 185 snap -1 2020-11-16T20:58:14.870 INFO:tasks.rados.rados.0.smithi166.stdout:1273: rollback oid 375 current snap is 58 2020-11-16T20:58:14.870 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 375 to 48 2020-11-16T20:58:14.870 INFO:tasks.rados.rados.0.smithi166.stdout:1274: cache_evict oid 423 snap -1 2020-11-16T20:58:14.870 INFO:tasks.rados.rados.0.smithi166.stdout:1275: cache_evict oid 112 snap -1 2020-11-16T20:58:14.870 INFO:tasks.rados.rados.0.smithi166.stdout:1276: read oid 234 snap -1 2020-11-16T20:58:14.871 INFO:tasks.rados.rados.0.smithi166.stdout:1276: expect (ObjNum 608 snap 30 seq_num 608) 2020-11-16T20:58:14.871 INFO:tasks.rados.rados.0.smithi166.stdout:1277: delete oid 309 current snap is 58 2020-11-16T20:58:14.871 INFO:tasks.rados.rados.0.smithi166.stdout:1272: got (0) Success 2020-11-16T20:58:14.871 INFO:tasks.rados.rados.0.smithi166.stdout:1274: got (2) No such file or directory 2020-11-16T20:58:14.871 INFO:tasks.rados.rados.0.smithi166.stdout:1276: expect (ObjNum 608 snap 30 seq_num 608) 2020-11-16T20:58:14.871 INFO:tasks.rados.rados.0.smithi166.stdout:1272: done (5 left) 2020-11-16T20:58:14.871 INFO:tasks.rados.rados.0.smithi166.stdout:1274: done (4 left) 2020-11-16T20:58:14.872 INFO:tasks.rados.rados.0.smithi166.stdout:1276: done (3 left) 2020-11-16T20:58:14.872 INFO:tasks.rados.rados.0.smithi166.stdout:1277: done (2 left) 2020-11-16T20:58:14.872 INFO:tasks.rados.rados.0.smithi166.stdout:1278: read oid 63 snap 57 2020-11-16T20:58:14.872 INFO:tasks.rados.rados.0.smithi166.stdout:1278: expect (ObjNum 62 snap 0 seq_num 62) 2020-11-16T20:58:14.872 INFO:tasks.rados.rados.0.smithi166.stdout:1279: read oid 188 snap -1 2020-11-16T20:58:14.872 INFO:tasks.rados.rados.0.smithi166.stdout:1279: expect deleted 2020-11-16T20:58:14.872 INFO:tasks.rados.rados.0.smithi166.stdout:1280: cache_try_flush oid 388 snap 57 2020-11-16T20:58:14.872 INFO:tasks.rados.rados.0.smithi166.stdout:1273: finishing rollback tid 0 to smithi16641208-375 2020-11-16T20:58:14.873 INFO:tasks.rados.rados.0.smithi166.stdout:1273: finishing rollback tid 1 to smithi16641208-375 2020-11-16T20:58:14.873 INFO:tasks.rados.rados.0.smithi166.stdout:1273: finishing rollback tid 2 to smithi16641208-375 2020-11-16T20:58:14.873 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 375 v 875 (ObjNum 579 snap 24 seq_num 579) dirty exists 2020-11-16T20:58:14.873 INFO:tasks.rados.rados.0.smithi166.stdout:1273: done (4 left) 2020-11-16T20:58:14.873 INFO:tasks.rados.rados.0.smithi166.stdout:1281: rollback oid 252 current snap is 58 2020-11-16T20:58:14.873 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 252 to 48 2020-11-16T20:58:14.873 INFO:tasks.rados.rados.0.smithi166.stdout:1282: snap_create 2020-11-16T20:58:14.874 INFO:tasks.rados.rados.0.smithi166.stdout:1281: finishing rollback tid 0 to smithi16641208-252 2020-11-16T20:58:14.874 INFO:tasks.rados.rados.0.smithi166.stdout:1278: expect (ObjNum 62 snap 0 seq_num 62) 2020-11-16T20:58:14.874 INFO:tasks.rados.rados.0.smithi166.stdout:1281: finishing rollback tid 1 to smithi16641208-252 2020-11-16T20:58:14.874 INFO:tasks.rados.rados.0.smithi166.stdout:1281: finishing rollback tid 2 to smithi16641208-252 2020-11-16T20:58:14.874 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 252 v 905 (ObjNum 293 snap 0 seq_num 293) dirty exists 2020-11-16T20:58:14.874 INFO:tasks.rados.rados.0.smithi166.stdout:1280: got (0) Success 2020-11-16T20:58:14.874 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 388 v 0 (ObjNum 662 snap 46 seq_num 662) dirty exists 2020-11-16T20:58:14.875 INFO:tasks.rados.rados.0.smithi166.stdout:1278: done (5 left) 2020-11-16T20:58:14.875 INFO:tasks.rados.rados.0.smithi166.stdout:1279: done (4 left) 2020-11-16T20:58:14.875 INFO:tasks.rados.rados.0.smithi166.stdout:1280: done (3 left) 2020-11-16T20:58:14.875 INFO:tasks.rados.rados.0.smithi166.stdout:1281: done (2 left) 2020-11-16T20:58:14.875 INFO:tasks.rados.rados.0.smithi166.stdout:1282: done (1 left) 2020-11-16T20:58:14.875 INFO:tasks.rados.rados.0.smithi166.stdout:1283: read oid 350 snap -1 2020-11-16T20:58:14.875 INFO:tasks.rados.rados.0.smithi166.stdout:1283: expect (ObjNum 349 snap 0 seq_num 349) 2020-11-16T20:58:14.875 INFO:tasks.rados.rados.0.smithi166.stdout:1284: write (excl) oid 345 current snap is 59 2020-11-16T20:58:14.876 INFO:tasks.rados.rados.0.smithi166.stdout:1284: seq_num 699 ranges {548093=787174,1970678=449902,3045966=681137} 2020-11-16T20:58:14.876 INFO:tasks.rados.rados.0.smithi166.stdout:1284: writing smithi16641208-345 from 548093 to 1335267 tid 1 2020-11-16T20:58:14.876 INFO:tasks.rados.rados.0.smithi166.stdout:1284: writing smithi16641208-345 from 1970678 to 2420580 tid 2 2020-11-16T20:58:14.876 INFO:tasks.rados.rados.0.smithi166.stdout:1284: writing smithi16641208-345 from 3045966 to 3727103 tid 3 2020-11-16T20:58:14.876 INFO:tasks.rados.rados.0.smithi166.stdout:1285: read oid 19 snap 48 2020-11-16T20:58:14.876 INFO:tasks.rados.rados.0.smithi166.stdout:1285: expect (ObjNum 18 snap 0 seq_num 18) 2020-11-16T20:58:14.876 INFO:tasks.rados.rados.0.smithi166.stdout:1286: write oid 294 current snap is 59 2020-11-16T20:58:14.877 INFO:tasks.rados.rados.0.smithi166.stdout:1286: seq_num 700 ranges {564900=578776,1629160=709913,3073389=492409} 2020-11-16T20:58:14.877 INFO:tasks.rados.rados.0.smithi166.stdout:1286: writing smithi16641208-294 from 564900 to 1143676 tid 1 2020-11-16T20:58:14.877 INFO:tasks.rados.rados.0.smithi166.stdout:1286: writing smithi16641208-294 from 1629160 to 2339073 tid 2 2020-11-16T20:58:14.877 INFO:tasks.rados.rados.0.smithi166.stdout:1286: writing smithi16641208-294 from 3073389 to 3565798 tid 3 2020-11-16T20:58:14.877 INFO:tasks.rados.rados.0.smithi166.stdout:1287: rollback oid 340 current snap is 59 2020-11-16T20:58:14.877 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 340 to 57 2020-11-16T20:58:14.877 INFO:tasks.rados.rados.0.smithi166.stdout:1284: finishing write tid 1 to smithi16641208-345 2020-11-16T20:58:14.878 INFO:tasks.rados.rados.0.smithi166.stdout:1288: write (excl) oid 387 current snap is 59 2020-11-16T20:58:14.878 INFO:tasks.rados.rados.0.smithi166.stdout:1284: finishing write tid 2 to smithi16641208-345 2020-11-16T20:58:14.878 INFO:tasks.rados.rados.0.smithi166.stdout:1288: seq_num 701 ranges {581707=654025,1687642=453571,2700812=703681} 2020-11-16T20:58:14.878 INFO:tasks.rados.rados.0.smithi166.stdout:1288: writing smithi16641208-387 from 581707 to 1235732 tid 1 2020-11-16T20:58:14.878 INFO:tasks.rados.rados.0.smithi166.stdout:1288: writing smithi16641208-387 from 1687642 to 2141213 tid 2 2020-11-16T20:58:14.878 INFO:tasks.rados.rados.0.smithi166.stdout:1288: writing smithi16641208-387 from 2700812 to 3404493 tid 3 2020-11-16T20:58:14.878 INFO:tasks.rados.rados.0.smithi166.stdout:1289: write (excl) oid 410 current snap is 59 2020-11-16T20:58:14.879 INFO:tasks.rados.rados.0.smithi166.stdout:1284: finishing write tid 3 to smithi16641208-345 2020-11-16T20:58:14.879 INFO:tasks.rados.rados.0.smithi166.stdout:1289: seq_num 702 ranges {598514=729274,1746124=597229,3128235=514953} 2020-11-16T20:58:14.879 INFO:tasks.rados.rados.0.smithi166.stdout:1289: writing smithi16641208-410 from 598514 to 1327788 tid 1 2020-11-16T20:58:14.879 INFO:tasks.rados.rados.0.smithi166.stdout:1289: writing smithi16641208-410 from 1746124 to 2343353 tid 2 2020-11-16T20:58:14.879 INFO:tasks.rados.rados.0.smithi166.stdout:1289: writing smithi16641208-410 from 3128235 to 3643188 tid 3 2020-11-16T20:58:14.879 INFO:tasks.rados.rados.0.smithi166.stdout:1290: snap_create 2020-11-16T20:58:14.879 INFO:tasks.rados.rados.0.smithi166.stdout:1284: finishing write tid 4 to smithi16641208-345 2020-11-16T20:58:14.880 INFO:tasks.rados.rados.0.smithi166.stdout:1284: finishing write tid 5 to smithi16641208-345 2020-11-16T20:58:14.880 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 345 v 908 (ObjNum 699 snap 59 seq_num 699) dirty exists 2020-11-16T20:58:14.880 INFO:tasks.rados.rados.0.smithi166.stdout:1284: left oid 345 (ObjNum 699 snap 59 seq_num 699) 2020-11-16T20:58:14.880 INFO:tasks.rados.rados.0.smithi166.stdout:1288: finishing write tid 1 to smithi16641208-387 2020-11-16T20:58:14.880 INFO:tasks.rados.rados.0.smithi166.stdout:1288: finishing write tid 2 to smithi16641208-387 2020-11-16T20:58:14.880 INFO:tasks.rados.rados.0.smithi166.stdout:1288: finishing write tid 3 to smithi16641208-387 2020-11-16T20:58:14.880 INFO:tasks.rados.rados.0.smithi166.stdout:1288: finishing write tid 4 to smithi16641208-387 2020-11-16T20:58:14.880 INFO:tasks.rados.rados.0.smithi166.stdout:1288: finishing write tid 5 to smithi16641208-387 2020-11-16T20:58:14.881 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 387 v 912 (ObjNum 701 snap 59 seq_num 701) dirty exists 2020-11-16T20:58:14.881 INFO:tasks.rados.rados.0.smithi166.stdout:1288: left oid 387 (ObjNum 701 snap 59 seq_num 701) 2020-11-16T20:58:14.881 INFO:tasks.rados.rados.0.smithi166.stdout:1284: done (8 left) 2020-11-16T20:58:14.881 INFO:tasks.rados.rados.0.smithi166.stdout:1288: done (7 left) 2020-11-16T20:58:14.881 INFO:tasks.rados.rados.0.smithi166.stdout:1290: done (6 left) 2020-11-16T20:58:14.881 INFO:tasks.rados.rados.0.smithi166.stdout:1291: write oid 150 current snap is 60 2020-11-16T20:58:14.881 INFO:tasks.rados.rados.0.smithi166.stdout:1291: seq_num 703 ranges {615321=404523,1804606=457240,2755658=726225} 2020-11-16T20:58:14.882 INFO:tasks.rados.rados.0.smithi166.stdout:1291: writing smithi16641208-150 from 615321 to 1019844 tid 1 2020-11-16T20:58:14.882 INFO:tasks.rados.rados.0.smithi166.stdout:1291: writing smithi16641208-150 from 1804606 to 2261846 tid 2 2020-11-16T20:58:14.882 INFO:tasks.rados.rados.0.smithi166.stdout:1291: writing smithi16641208-150 from 2755658 to 3481883 tid 3 2020-11-16T20:58:14.882 INFO:tasks.rados.rados.0.smithi166.stdout:1292: write (excl) oid 58 current snap is 60 2020-11-16T20:58:14.882 INFO:tasks.rados.rados.0.smithi166.stdout:1292: seq_num 704 ranges {632128=479772,1746735=600898,3066728=653850} 2020-11-16T20:58:14.882 INFO:tasks.rados.rados.0.smithi166.stdout:1292: writing smithi16641208-58 from 632128 to 1111900 tid 1 2020-11-16T20:58:14.882 INFO:tasks.rados.rados.0.smithi166.stdout:1292: writing smithi16641208-58 from 1746735 to 2347633 tid 2 2020-11-16T20:58:14.883 INFO:tasks.rados.rados.0.smithi166.stdout:1292: writing smithi16641208-58 from 3066728 to 3720578 tid 3 2020-11-16T20:58:14.883 INFO:tasks.rados.rados.0.smithi166.stdout:1293: snap_remove snap 59 2020-11-16T20:58:14.883 INFO:tasks.rados.rados.0.smithi166.stdout:1293: done (8 left) 2020-11-16T20:58:14.883 INFO:tasks.rados.rados.0.smithi166.stdout:1294: snap_remove snap 58 2020-11-16T20:58:14.884 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:58:14.866+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:58:14.961 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:14.966+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:15.052 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:15.053 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:58:15.053 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:58:15.053 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:15.062 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:58:15.067+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:58:15.067 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:58:15.076 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:58:15.101 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:58:15.122 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:58:15.141 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:58:15.162 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:58:15.163 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:15.167+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:15.183 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:58:15.204 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:58:15.214 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:15.214 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:15.224 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:58:15.225 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:58:15.227 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:58:15.227 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:58:15.227 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:58:15.227 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:58:15.227 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:58:15.227 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:58:15.228 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:58:15.228 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:58:15.264 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:58:15.268+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:58:15.363 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:15.363 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:15.365 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:15.370+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:15.373 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:58:15.467 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:58:15.471+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:58:15.522 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:15.522 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:15.532 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:58:15.576 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:58:15.580+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:58:15.668 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:15.668 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:15.669 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:15.673+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:15.677 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:58:15.763 INFO:tasks.rados.rados.0.smithi166.stdout:1294: done (8 left) 2020-11-16T20:58:15.763 INFO:tasks.rados.rados.0.smithi166.stdout:1295: write oid 254 current snap is 60 2020-11-16T20:58:15.764 INFO:tasks.rados.rados.0.smithi166.stdout:1295: seq_num 705 ranges {648935=555021,1805217=460909,2694151=465122,3817442=31493} 2020-11-16T20:58:15.768 INFO:teuthology.orchestra.run.smithi166.stderr:set osd.4 primary-affinity to 0 (802) 2020-11-16T20:58:15.768 INFO:teuthology.orchestra.run.smithi166.stderr:nodeep-scrub is set 2020-11-16T20:58:15.770 INFO:tasks.rados.rados.0.smithi166.stdout:1295: writing smithi16641208-254 from 648935 to 1203956 tid 1 2020-11-16T20:58:15.774 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:58:15.773+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:58:15.776 INFO:tasks.rados.rados.0.smithi166.stdout:1295: writing smithi16641208-254 from 1805217 to 2266126 tid 2 2020-11-16T20:58:15.781 INFO:tasks.rados.rados.0.smithi166.stdout:1295: writing smithi16641208-254 from 2694151 to 3159273 tid 3 2020-11-16T20:58:15.786 INFO:tasks.rados.rados.0.smithi166.stdout:1295: writing smithi16641208-254 from 3817442 to 3848935 tid 4 2020-11-16T20:58:15.786 INFO:tasks.rados.rados.0.smithi166.stdout:1296: cache_evict oid 465 snap 48 2020-11-16T20:58:15.786 INFO:tasks.rados.rados.0.smithi166.stdout:1292: finishing write tid 1 to smithi16641208-58 2020-11-16T20:58:15.786 INFO:tasks.rados.rados.0.smithi166.stdout:1297: rollback oid 440 current snap is 60 2020-11-16T20:58:15.786 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 440 to 48 2020-11-16T20:58:15.787 INFO:tasks.rados.rados.0.smithi166.stdout:1292: finishing write tid 2 to smithi16641208-58 2020-11-16T20:58:15.787 INFO:tasks.rados.rados.0.smithi166.stdout:1292: finishing write tid 3 to smithi16641208-58 2020-11-16T20:58:15.787 INFO:tasks.rados.rados.0.smithi166.stdout:1292: finishing write tid 4 to smithi16641208-58 2020-11-16T20:58:15.787 INFO:tasks.rados.rados.0.smithi166.stdout:1292: finishing write tid 5 to smithi16641208-58 2020-11-16T20:58:15.787 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 58 v 880 (ObjNum 704 snap 60 seq_num 704) dirty exists 2020-11-16T20:58:15.787 INFO:tasks.rados.rados.0.smithi166.stdout:1292: left oid 58 (ObjNum 704 snap 60 seq_num 704) 2020-11-16T20:58:15.787 INFO:tasks.rados.rados.0.smithi166.stdout:1292: done (10 left) 2020-11-16T20:58:15.788 INFO:tasks.rados.rados.0.smithi166.stdout:1298: copy_from oid 57 from oid 253 current snap is 60 2020-11-16T20:58:15.788 INFO:tasks.rados.rados.0.smithi166.stdout:1299: read oid 199 snap -1 2020-11-16T20:58:15.788 INFO:tasks.rados.rados.0.smithi166.stdout:1299: expect (ObjNum 261 snap 0 seq_num 261) 2020-11-16T20:58:15.788 INFO:tasks.rados.rados.0.smithi166.stdout:1300: delete oid 386 current snap is 60 2020-11-16T20:58:15.856 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:15.857 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:15.866 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:58:15.909 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:15.913+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:15.971 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:15.975+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:16.002 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:16.002 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:16.011 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:58:16.072 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:16.077+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:16.173 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:16.177+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:16.186 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:16.186 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:16.196 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:58:16.274 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:58:16.278+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:58:16.371 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:16.371 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:16.375 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:16.380+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:16.381 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:58:16.475 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:58:16.479+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:58:16.516 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:16.516 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:16.526 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:58:16.576 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:58:16.580+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:58:16.676 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:58:16.681+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:58:16.702 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:16.702 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:16.711 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:58:16.777 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:16.781+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:16.781 INFO:tasks.rados.rados.0.smithi166.stdout:1295: finishing write tid 1 to smithi16641208-254 2020-11-16T20:58:16.781 INFO:tasks.rados.rados.0.smithi166.stdout:1297: finishing rollback tid 0 to smithi16641208-440 2020-11-16T20:58:16.809 INFO:tasks.rados.rados.0.smithi166.stdout:1295: finishing write tid 2 to smithi16641208-254 2020-11-16T20:58:16.823 INFO:tasks.rados.rados.0.smithi166.stdout:1295: finishing write tid 3 to smithi16641208-254 2020-11-16T20:58:16.823 INFO:tasks.rados.rados.0.smithi166.stdout:1295: finishing write tid 4 to smithi16641208-254 2020-11-16T20:58:16.823 INFO:tasks.rados.rados.0.smithi166.stdout:1295: finishing write tid 5 to smithi16641208-254 2020-11-16T20:58:16.824 INFO:tasks.rados.rados.0.smithi166.stdout:1295: finishing write tid 6 to smithi16641208-254 2020-11-16T20:58:16.824 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 254 v 918 (ObjNum 705 snap 60 seq_num 705) dirty exists 2020-11-16T20:58:16.824 INFO:tasks.rados.rados.0.smithi166.stdout:1295: left oid 254 (ObjNum 705 snap 60 seq_num 705) 2020-11-16T20:58:16.824 INFO:tasks.rados.rados.0.smithi166.stdout:1297: finishing rollback tid 1 to smithi16641208-440 2020-11-16T20:58:16.825 INFO:tasks.rados.rados.0.smithi166.stdout:1297: finishing rollback tid 2 to smithi16641208-440 2020-11-16T20:58:16.825 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 440 v 883 (ObjNum 439 snap 0 seq_num 439) dirty exists 2020-11-16T20:58:16.876 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:16.876 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:16.878 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:16.882+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:16.886 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:58:16.979 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:16.983+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:17.061 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:17.062 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:17.071 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:58:17.079 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:58:17.083+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:58:17.180 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:58:17.185+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:58:17.239 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:58:17.245 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:17.245 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:17.255 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:58:17.282 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:58:17.287+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:58:17.382 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:17.386+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:17.382 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:58:17.390 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:17.390 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:17.400 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:58:17.401 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:58:17.482 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:58:17.487+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:58:17.526 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:17.526 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:58:17.526 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:58:17.526 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:17.535 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:58:17.618 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:17.623+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:17.623 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:58:17.642 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:58:17.663 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:58:17.683 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:58:17.684 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:17.688+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:17.703 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:58:17.705 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:17.705 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:58:17.705 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:58:17.705 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:58:17.706 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:17.715 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:58:17.724 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:58:17.725 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:58:17.725 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:58:17.725 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:58:17.726 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:58:17.726 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:58:17.726 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:58:17.726 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:58:17.726 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:58:17.785 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2020-11-16T20:58:17.786 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:58:17.789+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:58:17.857 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:17.857 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:58:17.857 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:58:17.858 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:58:17.858 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.858 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2424 4.3 4:c5716d1e:::smithi16641208-111:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e46)", 2020-11-16T20:58:17.858 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.026685+0000", 2020-11-16T20:58:17.858 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 128.83420288299999, 2020-11-16T20:58:17.858 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065304164999999997, 2020-11-16T20:58:17.859 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:17.859 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:17.859 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:17.859 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:17.859 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:17.859 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2424 2020-11-16T20:58:17.859 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.860 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:17.860 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.860 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:17.860 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026685+0000", 2020-11-16T20:58:17.860 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:17.860 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.860 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.861 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:17.861 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026685+0000", 2020-11-16T20:58:17.861 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4087000000000001e-05 2020-11-16T20:58:17.861 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.861 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.861 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:17.861 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026719+0000", 2020-11-16T20:58:17.862 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2298e-05 2020-11-16T20:58:17.862 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.862 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.862 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:17.862 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026731+0000", 2020-11-16T20:58:17.862 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1001e-05 2020-11-16T20:58:17.862 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.863 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.863 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:17.863 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026742+0000", 2020-11-16T20:58:17.863 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6129999999999997e-06 2020-11-16T20:58:17.863 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.863 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.863 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:17.863 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026747+0000", 2020-11-16T20:58:17.864 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00047150600000000001 2020-11-16T20:58:17.864 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.864 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.864 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.864 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.027219+0000", 2020-11-16T20:58:17.864 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5602999999999998e-05 2020-11-16T20:58:17.864 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.865 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.865 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:17.865 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.027254+0000", 2020-11-16T20:58:17.865 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050318838999999997 2020-11-16T20:58:17.865 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.865 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.865 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.866 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.077573+0000", 2020-11-16T20:58:17.866 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6290000000000001e-05 2020-11-16T20:58:17.866 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.866 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.866 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:17.866 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.077669+0000", 2020-11-16T20:58:17.866 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014149599000000001 2020-11-16T20:58:17.866 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.867 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.867 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.867 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.091819+0000", 2020-11-16T20:58:17.867 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6891000000000005e-05 2020-11-16T20:58:17.867 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.867 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.867 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:17.868 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.091906+0000", 2020-11-16T20:58:17.868 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3437999999999996e-05 2020-11-16T20:58:17.868 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.868 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.868 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:17.868 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.091989+0000", 2020-11-16T20:58:17.868 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065304164999999997 2020-11-16T20:58:17.869 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:17.869 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:17.869 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:17.869 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.869 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.869 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2589 4.3 4:f65e82cb:::smithi16641208-219:head [write 1800933~725518] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:58:17.869 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.782219+0000", 2020-11-16T20:58:17.869 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 118.07866908699999, 2020-11-16T20:58:17.870 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.069486665000000003, 2020-11-16T20:58:17.870 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:17.870 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:17.870 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:17.870 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:17.870 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:17.870 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2589 2020-11-16T20:58:17.871 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.871 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:17.871 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.871 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:17.871 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782219+0000", 2020-11-16T20:58:17.871 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:17.871 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.872 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.872 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:17.872 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782219+0000", 2020-11-16T20:58:17.872 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00038710600000000002 2020-11-16T20:58:17.872 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.872 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.872 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:17.873 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782606+0000", 2020-11-16T20:58:17.873 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.628e-06 2020-11-16T20:58:17.873 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.873 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.873 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:17.873 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782616+0000", 2020-11-16T20:58:17.873 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5631999999999999e-05 2020-11-16T20:58:17.874 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.874 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.874 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:17.874 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782631+0000", 2020-11-16T20:58:17.874 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6249999999999998e-06 2020-11-16T20:58:17.874 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.874 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.875 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:17.875 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782639+0000", 2020-11-16T20:58:17.875 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3213999999999997e-05 2020-11-16T20:58:17.875 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.875 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.875 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.875 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782672+0000", 2020-11-16T20:58:17.875 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9141000000000003e-05 2020-11-16T20:58:17.876 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.876 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.876 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:17.876 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782721+0000", 2020-11-16T20:58:17.876 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017807030000000001 2020-11-16T20:58:17.876 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.876 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.877 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.877 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800528+0000", 2020-11-16T20:58:17.877 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016577399999999999 2020-11-16T20:58:17.877 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.877 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.877 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:17.877 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800694+0000", 2020-11-16T20:58:17.878 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00026135900000000002 2020-11-16T20:58:17.878 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.878 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.878 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:58:17.878 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800955+0000", 2020-11-16T20:58:17.878 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0074407529999999996 2020-11-16T20:58:17.878 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.879 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.879 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:17.879 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808396+0000", 2020-11-16T20:58:17.879 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011788041000000001 2020-11-16T20:58:17.879 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.879 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.879 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:17.879 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.820184+0000", 2020-11-16T20:58:17.880 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031417394000000001 2020-11-16T20:58:17.880 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.880 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.880 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:17.880 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851602+0000", 2020-11-16T20:58:17.880 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0005e-05 2020-11-16T20:58:17.880 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.881 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.881 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:17.881 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851652+0000", 2020-11-16T20:58:17.881 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3962999999999998e-05 2020-11-16T20:58:17.881 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.881 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.881 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:17.882 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851705+0000", 2020-11-16T20:58:17.882 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.069486665000000003 2020-11-16T20:58:17.882 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:17.882 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:17.882 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:17.882 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.882 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.883 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2590 4.3 4:f65e82cb:::smithi16641208-219:head [write 2944601~232021] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:58:17.883 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.785957+0000", 2020-11-16T20:58:17.883 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 118.074931397, 2020-11-16T20:58:17.883 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065959045999999993, 2020-11-16T20:58:17.883 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:17.883 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:17.883 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:17.883 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:17.884 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:17.884 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2590 2020-11-16T20:58:17.884 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.884 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:17.884 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.884 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:17.884 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.785957+0000", 2020-11-16T20:58:17.885 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:17.885 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.885 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.885 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:17.885 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.785957+0000", 2020-11-16T20:58:17.885 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6058999999999998e-05 2020-11-16T20:58:17.885 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.886 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.886 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:17.886 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786033+0000", 2020-11-16T20:58:17.886 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1582999999999999e-05 2020-11-16T20:58:17.886 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.886 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.886 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:17.887 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786064+0000", 2020-11-16T20:58:17.887 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8099999999999992e-06 2020-11-16T20:58:17.887 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.887 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.887 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:17.887 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786074+0000", 2020-11-16T20:58:17.887 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.198e-06 2020-11-16T20:58:17.888 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.888 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.888 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:17.888 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786079+0000", 2020-11-16T20:58:17.888 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0587999999999997e-05 2020-11-16T20:58:17.888 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.888 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.888 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.889 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786130+0000", 2020-11-16T20:58:17.889 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5791000000000007e-05 2020-11-16T20:58:17.889 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.889 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.889 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:17.889 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786206+0000", 2020-11-16T20:58:17.889 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016623412000000001 2020-11-16T20:58:17.890 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.890 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.890 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.890 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.802829+0000", 2020-11-16T20:58:17.890 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012361699999999999 2020-11-16T20:58:17.890 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.890 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.891 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:17.891 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.802953+0000", 2020-11-16T20:58:17.891 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000161807 2020-11-16T20:58:17.891 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.891 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.891 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:58:17.891 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.803114+0000", 2020-11-16T20:58:17.891 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.005291535 2020-11-16T20:58:17.892 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.892 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.892 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:17.892 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808406+0000", 2020-11-16T20:58:17.892 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011819998999999999 2020-11-16T20:58:17.892 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.892 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.893 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:17.893 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.820226+0000", 2020-11-16T20:58:17.893 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031546375000000001 2020-11-16T20:58:17.893 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.893 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.893 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:17.893 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851772+0000", 2020-11-16T20:58:17.894 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9140000000000005e-05 2020-11-16T20:58:17.894 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.894 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.894 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:17.894 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851851+0000", 2020-11-16T20:58:17.894 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4132000000000002e-05 2020-11-16T20:58:17.894 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.894 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.895 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:17.895 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851916+0000", 2020-11-16T20:58:17.895 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065959045999999993 2020-11-16T20:58:17.895 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:17.895 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:17.895 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:17.895 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.896 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.896 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2591 4.3 4:f65e82cb:::smithi16641208-219:head [setxattr _header (58) in=7b,truncate 3176622] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:58:17.896 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.786110+0000", 2020-11-16T20:58:17.896 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 118.074777864, 2020-11-16T20:58:17.896 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066016654999999994, 2020-11-16T20:58:17.896 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:17.896 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:17.897 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:17.897 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:17.897 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:17.897 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2591 2020-11-16T20:58:17.897 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.897 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:17.897 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.898 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:17.898 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786110+0000", 2020-11-16T20:58:17.898 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:17.898 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.898 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.898 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:17.898 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786110+0000", 2020-11-16T20:58:17.898 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5616e-05 2020-11-16T20:58:17.899 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.899 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.899 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:17.899 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786136+0000", 2020-11-16T20:58:17.899 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5329999999999999e-06 2020-11-16T20:58:17.899 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.899 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.900 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:17.900 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786139+0000", 2020-11-16T20:58:17.900 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7440000000000004e-06 2020-11-16T20:58:17.900 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.900 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.900 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:17.900 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786145+0000", 2020-11-16T20:58:17.901 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0120000000000001e-06 2020-11-16T20:58:17.901 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.901 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.901 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:17.901 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786148+0000", 2020-11-16T20:58:17.901 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5617000000000004e-05 2020-11-16T20:58:17.901 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.901 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.902 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.902 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786234+0000", 2020-11-16T20:58:17.902 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0964000000000001e-05 2020-11-16T20:58:17.902 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.902 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.902 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:17.902 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786295+0000", 2020-11-16T20:58:17.903 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017673271000000001 2020-11-16T20:58:17.903 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.903 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.903 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.903 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.803968+0000", 2020-11-16T20:58:17.903 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000155272 2020-11-16T20:58:17.903 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.904 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.904 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:17.904 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.804123+0000", 2020-11-16T20:58:17.904 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00027357299999999999 2020-11-16T20:58:17.904 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.904 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.904 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:58:17.904 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.804397+0000", 2020-11-16T20:58:17.905 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040142659999999998 2020-11-16T20:58:17.905 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.905 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.905 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:17.905 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808411+0000", 2020-11-16T20:58:17.905 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011837194000000001 2020-11-16T20:58:17.905 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.906 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.906 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:17.906 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.820248+0000", 2020-11-16T20:58:17.906 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031735780999999998 2020-11-16T20:58:17.906 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.906 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.906 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:17.907 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851984+0000", 2020-11-16T20:58:17.907 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0603000000000001e-05 2020-11-16T20:58:17.907 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.907 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.907 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:17.907 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852054+0000", 2020-11-16T20:58:17.907 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2208999999999999e-05 2020-11-16T20:58:17.907 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.908 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.908 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:17.908 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852127+0000", 2020-11-16T20:58:17.908 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066016654999999994 2020-11-16T20:58:17.908 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:17.908 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:17.908 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:17.909 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.909 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.909 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2592 4.3 4:f65e82cb:::smithi16641208-219:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:58:17.909 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.786176+0000", 2020-11-16T20:58:17.909 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 118.074712381, 2020-11-16T20:58:17.909 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066389967999999994, 2020-11-16T20:58:17.909 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:17.910 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:17.910 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:17.910 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:17.910 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:17.910 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2592 2020-11-16T20:58:17.910 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.910 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:17.911 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.911 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:17.911 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786176+0000", 2020-11-16T20:58:17.911 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:17.911 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.911 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.911 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:17.912 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786176+0000", 2020-11-16T20:58:17.912 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1280999999999998e-05 2020-11-16T20:58:17.912 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.912 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.912 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:17.912 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786197+0000", 2020-11-16T20:58:17.912 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.349e-06 2020-11-16T20:58:17.913 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.913 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.913 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:17.913 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786200+0000", 2020-11-16T20:58:17.913 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4840000000000001e-06 2020-11-16T20:58:17.913 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.913 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.913 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:17.914 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786207+0000", 2020-11-16T20:58:17.914 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3390000000000001e-06 2020-11-16T20:58:17.914 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.914 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.914 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:17.914 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786210+0000", 2020-11-16T20:58:17.914 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000115748 2020-11-16T20:58:17.915 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.915 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.915 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.915 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786326+0000", 2020-11-16T20:58:17.915 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6062e-05 2020-11-16T20:58:17.915 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.915 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.916 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:17.916 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786372+0000", 2020-11-16T20:58:17.916 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021773975000000001 2020-11-16T20:58:17.916 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.916 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.916 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.916 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808146+0000", 2020-11-16T20:58:17.916 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014829900000000001 2020-11-16T20:58:17.917 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.917 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.917 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:17.917 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808294+0000", 2020-11-16T20:58:17.917 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.043877869999999999 2020-11-16T20:58:17.917 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.917 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.918 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.918 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852172+0000", 2020-11-16T20:58:17.918 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000145322 2020-11-16T20:58:17.918 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.918 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.918 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:17.918 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852317+0000", 2020-11-16T20:58:17.919 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024823899999999998 2020-11-16T20:58:17.919 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.919 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.919 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:17.919 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852565+0000", 2020-11-16T20:58:17.919 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066389967999999994 2020-11-16T20:58:17.919 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:17.919 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:17.920 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:17.920 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.920 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.920 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2593 4.3 4:f5f8fa2a:::smithi16641208-144:head [copy-from ver 64] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:58:17.920 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.786250+0000", 2020-11-16T20:58:17.920 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 118.074637602, 2020-11-16T20:58:17.920 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065186216000000005, 2020-11-16T20:58:17.921 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:17.921 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:17.921 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:17.921 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:17.921 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:17.921 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2593 2020-11-16T20:58:17.921 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.922 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:17.922 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.922 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:17.922 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786250+0000", 2020-11-16T20:58:17.922 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:17.922 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.922 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.923 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:17.923 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786250+0000", 2020-11-16T20:58:17.923 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2438999999999998e-05 2020-11-16T20:58:17.923 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.923 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.923 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:17.923 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786293+0000", 2020-11-16T20:58:17.923 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6840000000000001e-06 2020-11-16T20:58:17.924 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.924 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.924 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:17.924 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786298+0000", 2020-11-16T20:58:17.924 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4331999999999999e-05 2020-11-16T20:58:17.924 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.924 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.925 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:17.925 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786313+0000", 2020-11-16T20:58:17.925 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6460000000000001e-06 2020-11-16T20:58:17.925 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.925 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.925 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:17.925 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786317+0000", 2020-11-16T20:58:17.926 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5451999999999995e-05 2020-11-16T20:58:17.926 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.926 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.926 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.926 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786393+0000", 2020-11-16T20:58:17.926 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065041011999999995 2020-11-16T20:58:17.926 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.926 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.927 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:17.927 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851434+0000", 2020-11-16T20:58:17.927 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6510000000000001e-06 2020-11-16T20:58:17.927 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.927 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.927 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:17.927 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851437+0000", 2020-11-16T20:58:17.928 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065186216000000005 2020-11-16T20:58:17.928 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:17.928 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:17.928 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:17.928 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.928 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.928 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2594 4.3 4:f5f8fa2a:::smithi16641208-144:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:58:17.929 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.786352+0000", 2020-11-16T20:58:17.929 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 118.074536309, 2020-11-16T20:58:17.929 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.089305972999999997, 2020-11-16T20:58:17.929 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:17.929 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:17.929 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:17.929 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:17.929 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:17.930 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2594 2020-11-16T20:58:17.930 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.930 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:17.930 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.930 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:17.930 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786352+0000", 2020-11-16T20:58:17.930 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:17.931 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.931 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.931 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:17.931 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786352+0000", 2020-11-16T20:58:17.931 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5896000000000001e-05 2020-11-16T20:58:17.931 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.931 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.932 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:17.932 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786377+0000", 2020-11-16T20:58:17.932 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7700000000000004e-06 2020-11-16T20:58:17.932 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.932 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.932 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:17.932 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786384+0000", 2020-11-16T20:58:17.933 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.049e-05 2020-11-16T20:58:17.933 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.933 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.933 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:17.933 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786395+0000", 2020-11-16T20:58:17.933 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0440000000000003e-06 2020-11-16T20:58:17.933 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.933 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.934 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:17.934 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786400+0000", 2020-11-16T20:58:17.934 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000366771 2020-11-16T20:58:17.934 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.934 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.934 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.934 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786767+0000", 2020-11-16T20:58:17.935 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1366999999999998e-05 2020-11-16T20:58:17.935 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.935 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.935 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:17.935 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786818+0000", 2020-11-16T20:58:17.935 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.077259257999999997 2020-11-16T20:58:17.935 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.936 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.936 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.936 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.864077+0000", 2020-11-16T20:58:17.936 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018375499999999999 2020-11-16T20:58:17.936 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.936 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.936 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:17.936 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.864261+0000", 2020-11-16T20:58:17.937 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011122837 2020-11-16T20:58:17.937 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.937 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.937 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.937 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.875384+0000", 2020-11-16T20:58:17.937 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000135752 2020-11-16T20:58:17.937 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.938 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.938 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:17.938 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.875520+0000", 2020-11-16T20:58:17.938 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000138033 2020-11-16T20:58:17.938 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.938 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.938 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:17.939 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.875658+0000", 2020-11-16T20:58:17.939 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.089305972999999997 2020-11-16T20:58:17.939 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:17.939 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:17.939 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:17.939 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.939 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.940 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2872 4.3 4:d9c18080:::smithi16641208-173:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-11-16T20:58:17.940 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:34.745479+0000", 2020-11-16T20:58:17.940 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 103.11540904500001, 2020-11-16T20:58:17.940 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.059388271999999999, 2020-11-16T20:58:17.940 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:17.940 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:17.940 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:17.940 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:17.941 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:17.941 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2872 2020-11-16T20:58:17.941 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.941 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:17.941 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.941 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:17.941 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745479+0000", 2020-11-16T20:58:17.942 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:17.942 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.942 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.942 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:17.942 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745479+0000", 2020-11-16T20:58:17.942 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0491e-05 2020-11-16T20:58:17.942 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.943 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.943 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:17.943 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745509+0000", 2020-11-16T20:58:17.943 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9170000000000003e-06 2020-11-16T20:58:17.943 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.943 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.943 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:17.944 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745515+0000", 2020-11-16T20:58:17.944 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1267000000000001e-05 2020-11-16T20:58:17.944 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.944 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.944 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:17.944 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745527+0000", 2020-11-16T20:58:17.944 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.04e-06 2020-11-16T20:58:17.944 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.945 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.945 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:17.945 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745532+0000", 2020-11-16T20:58:17.945 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034800500000000003 2020-11-16T20:58:17.945 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.945 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.945 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.946 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745880+0000", 2020-11-16T20:58:17.946 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6010000000000003e-05 2020-11-16T20:58:17.946 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.946 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.946 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:17.946 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745916+0000", 2020-11-16T20:58:17.946 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042557927000000002 2020-11-16T20:58:17.947 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.947 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.947 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.947 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.788474+0000", 2020-11-16T20:58:17.947 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000160614 2020-11-16T20:58:17.947 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.947 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.948 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:17.948 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.788634+0000", 2020-11-16T20:58:17.948 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016066745 2020-11-16T20:58:17.948 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.948 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.948 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.948 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.804701+0000", 2020-11-16T20:58:17.948 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3805000000000001e-05 2020-11-16T20:58:17.949 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.949 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.949 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:17.949 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.804785+0000", 2020-11-16T20:58:17.949 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2451000000000001e-05 2020-11-16T20:58:17.949 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.949 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.950 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:17.950 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.804867+0000", 2020-11-16T20:58:17.950 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.059388271999999999 2020-11-16T20:58:17.950 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:17.950 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:17.950 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:17.950 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.951 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.951 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2962 4.3 4:c925a80f:::smithi16641208-375:head [write 1381780~411527] snapc 2d=[2d,25] ondisk+write+known_if_redirected e82)", 2020-11-16T20:58:17.951 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.749629+0000", 2020-11-16T20:58:17.951 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 93.111259286999996, 2020-11-16T20:58:17.951 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.052987905000000002, 2020-11-16T20:58:17.951 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:17.951 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:17.951 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:17.952 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:17.952 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:17.952 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2962 2020-11-16T20:58:17.952 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.952 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:17.952 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.952 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:17.953 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.749629+0000", 2020-11-16T20:58:17.953 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:17.953 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.953 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.953 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:17.953 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.749629+0000", 2020-11-16T20:58:17.953 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00039027700000000002 2020-11-16T20:58:17.954 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.954 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.954 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:17.954 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750019+0000", 2020-11-16T20:58:17.954 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0961000000000001e-05 2020-11-16T20:58:17.954 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.954 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.954 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:17.955 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750030+0000", 2020-11-16T20:58:17.955 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7931000000000002e-05 2020-11-16T20:58:17.955 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.955 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.955 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:17.955 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750048+0000", 2020-11-16T20:58:17.955 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3030000000000005e-06 2020-11-16T20:58:17.956 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.956 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.956 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:17.956 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750057+0000", 2020-11-16T20:58:17.956 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8351999999999999e-05 2020-11-16T20:58:17.956 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.956 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.957 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.957 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750125+0000", 2020-11-16T20:58:17.957 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010314000000000001 2020-11-16T20:58:17.957 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.957 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.957 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:17.957 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750229+0000", 2020-11-16T20:58:17.957 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039625369000000001 2020-11-16T20:58:17.958 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.958 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.958 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.958 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.789854+0000", 2020-11-16T20:58:17.958 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000153096 2020-11-16T20:58:17.958 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.958 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.959 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:17.959 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790007+0000", 2020-11-16T20:58:17.959 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022176699999999999 2020-11-16T20:58:17.959 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.959 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.959 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:58:17.959 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790229+0000", 2020-11-16T20:58:17.960 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0059379410000000004 2020-11-16T20:58:17.960 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.960 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.960 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:17.960 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.796167+0000", 2020-11-16T20:58:17.960 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0013346230000000001 2020-11-16T20:58:17.960 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.960 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.961 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:17.961 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.797501+0000", 2020-11-16T20:58:17.961 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0049809470000000003 2020-11-16T20:58:17.961 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.961 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.961 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:17.961 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802482+0000", 2020-11-16T20:58:17.962 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1831999999999998e-05 2020-11-16T20:58:17.962 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.962 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.962 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:17.962 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802574+0000", 2020-11-16T20:58:17.962 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2366000000000001e-05 2020-11-16T20:58:17.962 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.963 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.963 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:17.963 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802617+0000", 2020-11-16T20:58:17.963 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.052987905000000002 2020-11-16T20:58:17.963 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:17.963 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:17.963 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:17.964 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.964 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.964 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2997 4.3 4:f5e68fa8:::smithi16641208-361:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e86)", 2020-11-16T20:58:17.964 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838418+0000", 2020-11-16T20:58:17.964 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 89.022469576000006, 2020-11-16T20:58:17.964 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.056590020999999997, 2020-11-16T20:58:17.964 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:17.964 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:17.965 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:17.965 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:17.965 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:17.965 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2997 2020-11-16T20:58:17.965 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.965 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:17.965 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.966 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:17.966 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838418+0000", 2020-11-16T20:58:17.966 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:17.966 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.966 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.966 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:17.966 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838418+0000", 2020-11-16T20:58:17.967 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9998999999999999e-05 2020-11-16T20:58:17.967 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.967 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.967 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:17.967 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838448+0000", 2020-11-16T20:58:17.967 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3640000000000004e-06 2020-11-16T20:58:17.967 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.967 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.968 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:17.968 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838455+0000", 2020-11-16T20:58:17.968 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1902999999999999e-05 2020-11-16T20:58:17.968 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.968 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.968 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:17.968 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838467+0000", 2020-11-16T20:58:17.969 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1699999999999996e-06 2020-11-16T20:58:17.969 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.969 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.969 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:17.969 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838472+0000", 2020-11-16T20:58:17.969 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00047208200000000002 2020-11-16T20:58:17.969 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.970 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.970 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.970 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838944+0000", 2020-11-16T20:58:17.970 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6712000000000002e-05 2020-11-16T20:58:17.970 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.970 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.970 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:17.971 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.839001+0000", 2020-11-16T20:58:17.971 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038817664000000002 2020-11-16T20:58:17.971 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.971 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.971 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.971 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.877818+0000", 2020-11-16T20:58:17.971 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000119492 2020-11-16T20:58:17.971 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.972 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.972 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:17.972 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.877938+0000", 2020-11-16T20:58:17.972 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016797409999999999 2020-11-16T20:58:17.972 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.972 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.972 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.973 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.894735+0000", 2020-11-16T20:58:17.973 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015645500000000001 2020-11-16T20:58:17.973 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.973 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.973 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:17.973 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.894892+0000", 2020-11-16T20:58:17.973 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011677 2020-11-16T20:58:17.973 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.974 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.974 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:17.974 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.895008+0000", 2020-11-16T20:58:17.974 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.056590020999999997 2020-11-16T20:58:17.974 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:17.974 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:17.974 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:17.975 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.975 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.975 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3520 4.3 4:f686f74f:::smithi16641208-134:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e129)", 2020-11-16T20:58:17.975 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.027796+0000", 2020-11-16T20:58:17.975 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 43.833091914999997, 2020-11-16T20:58:17.975 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.051377742999999997, 2020-11-16T20:58:17.975 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:17.976 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:17.976 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:17.976 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:17.976 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:17.976 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3520 2020-11-16T20:58:17.976 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.976 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:17.977 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.977 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:17.977 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.027796+0000", 2020-11-16T20:58:17.977 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:17.977 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.977 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.977 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:17.977 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.027796+0000", 2020-11-16T20:58:17.978 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5429000000000001e-05 2020-11-16T20:58:17.978 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.978 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.978 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:17.978 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.027811+0000", 2020-11-16T20:58:17.978 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2150000000000001e-06 2020-11-16T20:58:17.978 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.979 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.979 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:17.979 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.027815+0000", 2020-11-16T20:58:17.979 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4620000000000001e-06 2020-11-16T20:58:17.979 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.979 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.979 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:17.980 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.027821+0000", 2020-11-16T20:58:17.980 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.602e-06 2020-11-16T20:58:17.980 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.980 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.980 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:17.980 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.027825+0000", 2020-11-16T20:58:17.980 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030451419999999998 2020-11-16T20:58:17.980 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.981 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.981 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.981 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.030870+0000", 2020-11-16T20:58:17.981 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8892000000000003e-05 2020-11-16T20:58:17.981 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.981 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.981 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:17.982 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.030949+0000", 2020-11-16T20:58:17.982 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036413867000000003 2020-11-16T20:58:17.982 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.982 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.982 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.982 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.067363+0000", 2020-11-16T20:58:17.982 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000102604 2020-11-16T20:58:17.983 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.983 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.983 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:17.983 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.067465+0000", 2020-11-16T20:58:17.983 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011558476999999999 2020-11-16T20:58:17.983 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.983 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.983 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.984 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.079024+0000", 2020-11-16T20:58:17.984 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5964999999999995e-05 2020-11-16T20:58:17.984 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.984 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.984 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:17.984 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.079100+0000", 2020-11-16T20:58:17.984 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4087999999999999e-05 2020-11-16T20:58:17.985 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.985 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.985 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:17.985 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.079174+0000", 2020-11-16T20:58:17.985 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.051377742999999997 2020-11-16T20:58:17.985 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:17.985 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:17.986 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:17.986 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.986 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.986 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.4.13:908 3.1 3:b7adb356:::smithi16641208-217:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e130)", 2020-11-16T20:58:17.986 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.754089+0000", 2020-11-16T20:58:17.986 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 43.106798542999996, 2020-11-16T20:58:17.986 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050485306000000001, 2020-11-16T20:58:17.986 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:17.987 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:17.987 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:17.987 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.987 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:17.987 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754089+0000", 2020-11-16T20:58:17.987 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:17.987 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.988 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.988 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:17.988 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754089+0000", 2020-11-16T20:58:17.988 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1849e-05 2020-11-16T20:58:17.988 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.988 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.988 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:17.989 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754111+0000", 2020-11-16T20:58:17.989 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.309e-06 2020-11-16T20:58:17.989 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.989 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.989 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:17.989 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754115+0000", 2020-11-16T20:58:17.989 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.784e-06 2020-11-16T20:58:17.989 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.990 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.990 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:17.990 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754120+0000", 2020-11-16T20:58:17.990 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4829999999999999e-06 2020-11-16T20:58:17.990 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.990 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.990 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:17.991 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754124+0000", 2020-11-16T20:58:17.991 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033225300000000002 2020-11-16T20:58:17.991 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.991 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.991 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.991 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754456+0000", 2020-11-16T20:58:17.991 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1177000000000001e-05 2020-11-16T20:58:17.992 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.992 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.992 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:17.992 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754507+0000", 2020-11-16T20:58:17.992 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033760357999999997 2020-11-16T20:58:17.992 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.992 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.992 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.993 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788268+0000", 2020-11-16T20:58:17.993 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0700999999999998e-05 2020-11-16T20:58:17.993 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.993 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.993 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:17.993 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788358+0000", 2020-11-16T20:58:17.993 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013027209999999999 2020-11-16T20:58:17.994 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.994 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.994 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:17.994 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801385+0000", 2020-11-16T20:58:17.994 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010369099999999999 2020-11-16T20:58:17.994 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.994 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.995 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:17.995 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801489+0000", 2020-11-16T20:58:17.995 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030854910000000001 2020-11-16T20:58:17.995 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.995 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.995 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:17.995 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.804575+0000", 2020-11-16T20:58:17.995 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050485306000000001 2020-11-16T20:58:17.996 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:17.996 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:17.996 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:17.996 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.996 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.996 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3960 4.2 4:792a5aa2:::smithi16641208-171:head [append 0~0] snapc 71=[71,61] RETRY=2 ondisk+retry+write+known_if_redirected e161)", 2020-11-16T20:58:17.996 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:10.766719+0000", 2020-11-16T20:58:17.997 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 7.0941690619999997, 2020-11-16T20:58:17.997 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.294536568, 2020-11-16T20:58:17.997 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:17.997 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:17.997 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:17.997 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:17.997 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:17.998 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3960 2020-11-16T20:58:17.998 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.998 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:17.998 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.998 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:17.998 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766719+0000", 2020-11-16T20:58:17.998 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:17.998 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.999 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.999 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:17.999 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766719+0000", 2020-11-16T20:58:17.999 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1884000000000002e-05 2020-11-16T20:58:17.999 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:17.999 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:17.999 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.000 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766751+0000", 2020-11-16T20:58:18.000 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5009999999999998e-06 2020-11-16T20:58:18.000 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.000 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.000 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.000 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766758+0000", 2020-11-16T20:58:18.000 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3645999999999999e-05 2020-11-16T20:58:18.001 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.001 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.001 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.001 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766772+0000", 2020-11-16T20:58:18.001 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6020000000000002e-06 2020-11-16T20:58:18.001 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.001 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.001 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.002 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766779+0000", 2020-11-16T20:58:18.002 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016390299999999999 2020-11-16T20:58:18.002 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.002 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.002 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.002 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766943+0000", 2020-11-16T20:58:18.002 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0708e-05 2020-11-16T20:58:18.003 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.003 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.003 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:18.003 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766954+0000", 2020-11-16T20:58:18.003 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.280180449 2020-11-16T20:58:18.003 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.003 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.003 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.004 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.047135+0000", 2020-11-16T20:58:18.004 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023914300000000001 2020-11-16T20:58:18.004 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.004 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.004 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for missing object", 2020-11-16T20:58:18.004 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.047374+0000", 2020-11-16T20:58:18.004 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0022773590000000001 2020-11-16T20:58:18.005 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.005 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.005 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.005 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.049651+0000", 2020-11-16T20:58:18.005 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011596629000000001 2020-11-16T20:58:18.005 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.005 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.006 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:18.006 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.061248+0000", 2020-11-16T20:58:18.006 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7440000000000007e-06 2020-11-16T20:58:18.006 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.006 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.006 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.006 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.061255+0000", 2020-11-16T20:58:18.006 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.294536568 2020-11-16T20:58:18.007 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.007 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.007 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.007 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.007 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.007 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3961 4.2 4:792a5aa2:::smithi16641208-171:head [rollback 61] snapc 71=[71,61] RETRY=2 ondisk+retry+write+known_if_redirected e161)", 2020-11-16T20:58:18.007 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:10.766814+0000", 2020-11-16T20:58:18.008 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 7.0940735100000003, 2020-11-16T20:58:18.008 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.33204910999999998, 2020-11-16T20:58:18.008 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.008 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:18.008 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:18.008 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:18.008 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:18.009 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3961 2020-11-16T20:58:18.009 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.009 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.009 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.009 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.009 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766814+0000", 2020-11-16T20:58:18.009 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.010 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.010 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.010 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.010 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766814+0000", 2020-11-16T20:58:18.010 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2356e-05 2020-11-16T20:58:18.010 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.010 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.010 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.011 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766847+0000", 2020-11-16T20:58:18.011 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7649999999999999e-06 2020-11-16T20:58:18.011 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.011 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.011 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.011 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766853+0000", 2020-11-16T20:58:18.011 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0635000000000001e-05 2020-11-16T20:58:18.012 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.012 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.012 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.012 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766863+0000", 2020-11-16T20:58:18.012 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7139999999999998e-06 2020-11-16T20:58:18.012 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.012 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.013 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.013 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766869+0000", 2020-11-16T20:58:18.013 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000113033 2020-11-16T20:58:18.013 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.013 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.013 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.013 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766982+0000", 2020-11-16T20:58:18.013 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4500000000000001e-06 2020-11-16T20:58:18.014 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.014 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.014 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:18.014 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766988+0000", 2020-11-16T20:58:18.014 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.28083836499999998 2020-11-16T20:58:18.014 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.014 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.015 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.015 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.047827+0000", 2020-11-16T20:58:18.015 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6771000000000001e-05 2020-11-16T20:58:18.015 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.015 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.015 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for missing object", 2020-11-16T20:58:18.015 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.047903+0000", 2020-11-16T20:58:18.016 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00228181 2020-11-16T20:58:18.016 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.016 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.016 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.050185+0000", 2020-11-16T20:58:18.016 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4109999999999994e-05 2020-11-16T20:58:18.016 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.017 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:18.017 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.050249+0000", 2020-11-16T20:58:18.017 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019491345 2020-11-16T20:58:18.017 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.017 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.017 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.017 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.069741+0000", 2020-11-16T20:58:18.018 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00021984000000000001 2020-11-16T20:58:18.018 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.018 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.018 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:18.018 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.069961+0000", 2020-11-16T20:58:18.018 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00028599400000000003 2020-11-16T20:58:18.018 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.019 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.019 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:18.019 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.070247+0000", 2020-11-16T20:58:18.019 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.826e-05 2020-11-16T20:58:18.019 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.019 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.019 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:18.019 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.070315+0000", 2020-11-16T20:58:18.020 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078169539999999992 2020-11-16T20:58:18.020 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.020 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.020 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.020 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.078132+0000", 2020-11-16T20:58:18.020 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000190836 2020-11-16T20:58:18.020 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.021 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.021 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:18.021 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.078323+0000", 2020-11-16T20:58:18.021 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00043319700000000002 2020-11-16T20:58:18.021 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.021 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.021 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 1,4,5", 2020-11-16T20:58:18.022 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.078756+0000", 2020-11-16T20:58:18.022 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0060120390000000003 2020-11-16T20:58:18.022 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.022 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.022 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.022 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.084768+0000", 2020-11-16T20:58:18.022 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7736000000000002e-05 2020-11-16T20:58:18.022 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.023 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.023 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for ondisk", 2020-11-16T20:58:18.023 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.084846+0000", 2020-11-16T20:58:18.023 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0074966049999999999 2020-11-16T20:58:18.023 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.023 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.023 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:18.024 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.092342+0000", 2020-11-16T20:58:18.024 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0058494810000000001 2020-11-16T20:58:18.024 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.024 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.024 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:18.024 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.098192+0000", 2020-11-16T20:58:18.024 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6997999999999995e-05 2020-11-16T20:58:18.025 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.025 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.025 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:18.025 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.098289+0000", 2020-11-16T20:58:18.025 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032133900000000002 2020-11-16T20:58:18.025 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.025 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.025 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:18.026 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.098610+0000", 2020-11-16T20:58:18.026 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8751999999999993e-05 2020-11-16T20:58:18.026 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.026 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.026 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:18.026 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.098699+0000", 2020-11-16T20:58:18.026 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016472500000000001 2020-11-16T20:58:18.027 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.027 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.027 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.027 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.098863+0000", 2020-11-16T20:58:18.027 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.33204910999999998 2020-11-16T20:58:18.027 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.027 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.028 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.028 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.028 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.028 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3962 4.2 4:792a5aa2:::smithi16641208-171:head [append 0~0] snapc 71=[71,61] RETRY=2 ondisk+retry+write+known_if_redirected e161)", 2020-11-16T20:58:18.028 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:10.766901+0000", 2020-11-16T20:58:18.028 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 7.0939870599999999, 2020-11-16T20:58:18.028 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.35350222399999998, 2020-11-16T20:58:18.028 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.029 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:18.029 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:18.029 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:18.029 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:18.029 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3962 2020-11-16T20:58:18.029 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.029 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.030 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.030 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.030 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766901+0000", 2020-11-16T20:58:18.030 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.030 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.030 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.030 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.031 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766901+0000", 2020-11-16T20:58:18.031 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8690000000000001e-05 2020-11-16T20:58:18.031 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.031 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.031 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.031 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766930+0000", 2020-11-16T20:58:18.031 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6980000000000003e-06 2020-11-16T20:58:18.032 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.032 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.032 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.032 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766935+0000", 2020-11-16T20:58:18.032 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.908e-06 2020-11-16T20:58:18.032 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.032 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.032 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.033 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766941+0000", 2020-11-16T20:58:18.033 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7480000000000002e-06 2020-11-16T20:58:18.033 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.033 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.033 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.033 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766944+0000", 2020-11-16T20:58:18.033 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2626999999999995e-05 2020-11-16T20:58:18.034 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.034 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.034 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.034 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.767007+0000", 2020-11-16T20:58:18.034 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0340000000000002e-06 2020-11-16T20:58:18.034 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.034 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.035 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:18.035 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.767016+0000", 2020-11-16T20:58:18.035 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.28093276700000003 2020-11-16T20:58:18.035 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.035 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.035 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.035 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.047948+0000", 2020-11-16T20:58:18.035 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0480000000000003e-05 2020-11-16T20:58:18.036 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.036 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.036 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for missing object", 2020-11-16T20:58:18.036 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.048019+0000", 2020-11-16T20:58:18.036 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0022703580000000001 2020-11-16T20:58:18.036 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.036 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.037 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.037 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.050289+0000", 2020-11-16T20:58:18.037 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2658999999999997e-05 2020-11-16T20:58:18.037 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.037 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.037 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:18.037 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.050362+0000", 2020-11-16T20:58:18.038 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020014204000000001 2020-11-16T20:58:18.038 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.038 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.038 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.038 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.070376+0000", 2020-11-16T20:58:18.038 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2409999999999994e-05 2020-11-16T20:58:18.038 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.038 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.039 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:18.039 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.070438+0000", 2020-11-16T20:58:18.039 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014435586 2020-11-16T20:58:18.039 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.039 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.039 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.039 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.084874+0000", 2020-11-16T20:58:18.040 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000132924 2020-11-16T20:58:18.040 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.040 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.040 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:18.040 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.085007+0000", 2020-11-16T20:58:18.040 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019703200000000001 2020-11-16T20:58:18.040 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.041 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.041 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 1,4,5", 2020-11-16T20:58:18.041 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.085204+0000", 2020-11-16T20:58:18.041 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007388515 2020-11-16T20:58:18.041 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.041 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.041 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:18.042 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.092592+0000", 2020-11-16T20:58:18.042 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0056161220000000003 2020-11-16T20:58:18.042 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.042 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.042 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:18.042 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.098209+0000", 2020-11-16T20:58:18.042 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000711507 2020-11-16T20:58:18.042 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.043 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.043 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:18.043 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.098920+0000", 2020-11-16T20:58:18.043 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021120463999999999 2020-11-16T20:58:18.043 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.043 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.043 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:18.044 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.120041+0000", 2020-11-16T20:58:18.044 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000118075 2020-11-16T20:58:18.044 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.044 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.044 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:18.044 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.120159+0000", 2020-11-16T20:58:18.044 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024441600000000001 2020-11-16T20:58:18.045 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.045 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.045 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.045 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.120403+0000", 2020-11-16T20:58:18.045 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.35350222399999998 2020-11-16T20:58:18.045 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.045 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.045 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.046 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.046 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.046 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3963 4.0 4:3a07a2f4:::smithi16641208-265:head [cache-try-flush] snapc 0=[] RETRY=2 ondisk+retry+read+skiprwlocks+known_if_redirected e162)", 2020-11-16T20:58:18.046 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:10.773500+0000", 2020-11-16T20:58:18.046 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 7.0873874749999999, 2020-11-16T20:58:18.046 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.33046096899999999, 2020-11-16T20:58:18.046 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.047 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:18.047 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:18.047 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:18.047 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:18.047 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3963 2020-11-16T20:58:18.047 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.047 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.048 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.048 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.048 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773500+0000", 2020-11-16T20:58:18.048 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.048 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.048 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.048 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.048 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773500+0000", 2020-11-16T20:58:18.049 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3399000000000001e-05 2020-11-16T20:58:18.049 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.049 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.049 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.049 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773524+0000", 2020-11-16T20:58:18.049 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4179999999999996e-06 2020-11-16T20:58:18.049 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.050 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.050 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.050 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773529+0000", 2020-11-16T20:58:18.050 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6570000000000003e-06 2020-11-16T20:58:18.050 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.050 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.050 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.051 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773538+0000", 2020-11-16T20:58:18.051 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3510000000000001e-06 2020-11-16T20:58:18.051 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.051 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.051 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.051 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773543+0000", 2020-11-16T20:58:18.051 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045181399999999998 2020-11-16T20:58:18.052 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.052 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.052 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.052 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773995+0000", 2020-11-16T20:58:18.052 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8842e-05 2020-11-16T20:58:18.052 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.052 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.052 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:18.053 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.774014+0000", 2020-11-16T20:58:18.053 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.28760152999999999 2020-11-16T20:58:18.053 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.053 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.053 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.053 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.061615+0000", 2020-11-16T20:58:18.053 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00090118499999999999 2020-11-16T20:58:18.054 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.054 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.054 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for degraded object", 2020-11-16T20:58:18.054 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.062517+0000", 2020-11-16T20:58:18.054 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.040906721 2020-11-16T20:58:18.054 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.054 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.055 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.055 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.103423+0000", 2020-11-16T20:58:18.055 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024524799999999999 2020-11-16T20:58:18.055 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.055 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.055 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:18.055 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.103669+0000", 2020-11-16T20:58:18.055 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029280400000000002 2020-11-16T20:58:18.056 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.056 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.056 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.056 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.103961+0000", 2020-11-16T20:58:18.056 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.33046096899999999 2020-11-16T20:58:18.056 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.056 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.057 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.057 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.057 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.057 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3965 4.0 4:3c624f0a:::smithi16641208-415:head [stat,delete] snapc 71=[61] RETRY=1 ondisk+retry+write+known_if_redirected e162)", 2020-11-16T20:58:18.057 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:10.773566+0000", 2020-11-16T20:58:18.057 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 7.0873215409999997, 2020-11-16T20:58:18.057 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.34725477199999999, 2020-11-16T20:58:18.057 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.058 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:18.058 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:18.058 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:18.058 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:18.058 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3965 2020-11-16T20:58:18.058 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.058 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.059 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.059 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.059 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773566+0000", 2020-11-16T20:58:18.059 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.059 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.059 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.059 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.060 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773566+0000", 2020-11-16T20:58:18.060 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1405000000000002e-05 2020-11-16T20:58:18.060 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.060 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.060 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.060 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773598+0000", 2020-11-16T20:58:18.060 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6130000000000003e-06 2020-11-16T20:58:18.061 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.061 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.061 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.061 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773603+0000", 2020-11-16T20:58:18.061 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.163e-05 2020-11-16T20:58:18.061 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.061 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.061 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.062 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773615+0000", 2020-11-16T20:58:18.062 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.271e-06 2020-11-16T20:58:18.062 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.062 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.062 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.062 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773620+0000", 2020-11-16T20:58:18.062 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00051486000000000001 2020-11-16T20:58:18.063 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.063 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.063 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.063 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.774135+0000", 2020-11-16T20:58:18.063 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2503999999999999e-05 2020-11-16T20:58:18.063 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.063 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.064 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:18.064 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.774148+0000", 2020-11-16T20:58:18.064 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.29208424700000002 2020-11-16T20:58:18.064 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.064 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.064 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.064 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.066232+0000", 2020-11-16T20:58:18.064 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028906180000000002 2020-11-16T20:58:18.065 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for degraded object", 2020-11-16T20:58:18.065 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.069123+0000", 2020-11-16T20:58:18.065 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.046887930000000001 2020-11-16T20:58:18.065 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.066 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.116010+0000", 2020-11-16T20:58:18.066 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012060100000000001 2020-11-16T20:58:18.066 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.066 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.066 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:18.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.116131+0000", 2020-11-16T20:58:18.067 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000244694 2020-11-16T20:58:18.067 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.067 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.067 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 1,2", 2020-11-16T20:58:18.067 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.116376+0000", 2020-11-16T20:58:18.067 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029448370000000001 2020-11-16T20:58:18.067 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.067 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.068 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:18.068 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.119321+0000", 2020-11-16T20:58:18.068 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000901792 2020-11-16T20:58:18.068 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.068 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.068 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:18.068 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.120222+0000", 2020-11-16T20:58:18.069 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024859600000000002 2020-11-16T20:58:18.069 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.069 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.069 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:18.069 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.120471+0000", 2020-11-16T20:58:18.069 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3827999999999997e-05 2020-11-16T20:58:18.069 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.070 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.070 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:18.070 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.120565+0000", 2020-11-16T20:58:18.070 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00025634600000000002 2020-11-16T20:58:18.070 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.070 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.070 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.071 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.120821+0000", 2020-11-16T20:58:18.071 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.34725477199999999 2020-11-16T20:58:18.071 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.071 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.071 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.071 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.071 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.071 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "MOSDPGPushReply(4.0 163/161 [PushReplyOp(4:04ed47ba:::smithi16641208-462:head)])", 2020-11-16T20:58:18.072 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.008764+0000", 2020-11-16T20:58:18.072 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.8521240580000002, 2020-11-16T20:58:18.072 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050833534999999999, 2020-11-16T20:58:18.072 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.072 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:18.072 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.072 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.073 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.073 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.008764+0000", 2020-11-16T20:58:18.073 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.073 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.073 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.073 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.073 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.008764+0000", 2020-11-16T20:58:18.074 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0648999999999997e-05 2020-11-16T20:58:18.074 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.074 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.074 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.074 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.008794+0000", 2020-11-16T20:58:18.074 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1911e-05 2020-11-16T20:58:18.074 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.075 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.075 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.075 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.008806+0000", 2020-11-16T20:58:18.075 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1381e-05 2020-11-16T20:58:18.075 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.075 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.075 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.075 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.008818+0000", 2020-11-16T20:58:18.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9460000000000003e-06 2020-11-16T20:58:18.076 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.076 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.076 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.076 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.008824+0000", 2020-11-16T20:58:18.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.048239439000000002 2020-11-16T20:58:18.076 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.077 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.077 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.077 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.057063+0000", 2020-11-16T20:58:18.077 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0025342089999999999 2020-11-16T20:58:18.077 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.077 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.077 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.078 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.059597+0000", 2020-11-16T20:58:18.078 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050833534999999999 2020-11-16T20:58:18.078 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.078 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.078 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.078 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.078 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.078 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "MOSDPGPushReply(4.0 163/161 [PushReplyOp(4:1e6cac27:::smithi16641208-165:head)])", 2020-11-16T20:58:18.079 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.011973+0000", 2020-11-16T20:58:18.079 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.8489148120000003, 2020-11-16T20:58:18.079 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.055325996000000002, 2020-11-16T20:58:18.079 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.079 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:18.079 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.079 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.080 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.080 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.011973+0000", 2020-11-16T20:58:18.080 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.080 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.080 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.080 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.080 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.011973+0000", 2020-11-16T20:58:18.081 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8260999999999999e-05 2020-11-16T20:58:18.081 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.081 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.081 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.081 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.012001+0000", 2020-11-16T20:58:18.081 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9039999999999992e-06 2020-11-16T20:58:18.081 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.081 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.082 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.082 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.012009+0000", 2020-11-16T20:58:18.082 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2295e-05 2020-11-16T20:58:18.082 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.082 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.082 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.082 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.012022+0000", 2020-11-16T20:58:18.083 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0759999999999999e-06 2020-11-16T20:58:18.083 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.083 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.083 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.083 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.012028+0000", 2020-11-16T20:58:18.083 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.051366063000000003 2020-11-16T20:58:18.083 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.084 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.084 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.084 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.063394+0000", 2020-11-16T20:58:18.084 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039053970000000001 2020-11-16T20:58:18.084 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.084 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.084 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.085 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.067299+0000", 2020-11-16T20:58:18.085 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.055325996000000002 2020-11-16T20:58:18.085 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.085 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.085 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.085 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.085 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.085 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "MOSDPGPushReply(3.0 163/161 [PushReplyOp(3:2644dcd6:::smithi16641208-437:head)])", 2020-11-16T20:58:18.086 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.020962+0000", 2020-11-16T20:58:18.086 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.8399259380000004, 2020-11-16T20:58:18.086 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.051574284999999997, 2020-11-16T20:58:18.086 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.086 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:18.086 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.086 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.087 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.087 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.020962+0000", 2020-11-16T20:58:18.087 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.087 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.087 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.087 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.087 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.020962+0000", 2020-11-16T20:58:18.088 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0400999999999999e-05 2020-11-16T20:58:18.088 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.088 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.088 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.088 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.020992+0000", 2020-11-16T20:58:18.088 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8589999999999999e-06 2020-11-16T20:58:18.088 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.088 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.089 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.089 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.020999+0000", 2020-11-16T20:58:18.089 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2777e-05 2020-11-16T20:58:18.089 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.089 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.089 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.089 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.021012+0000", 2020-11-16T20:58:18.090 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7560000000000002e-06 2020-11-16T20:58:18.090 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.090 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.090 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.090 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.021019+0000", 2020-11-16T20:58:18.090 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050137168000000003 2020-11-16T20:58:18.090 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.091 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.091 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.091 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.071156+0000", 2020-11-16T20:58:18.091 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001380324 2020-11-16T20:58:18.091 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.091 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.091 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.092 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.072536+0000", 2020-11-16T20:58:18.092 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.051574284999999997 2020-11-16T20:58:18.092 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.092 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.092 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.092 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.092 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.092 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:18.094 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:58:18.094 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:58:18.098+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:58:18.195 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:18.199+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:18.261 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:18.261 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:58:18.261 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.261 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3975 4.2 4:64b35751:::smithi16641208-112:head [cache-evict] snapc 0=[] RETRY=1 ondisk+retry+read+ignore_cache+known_if_redirected e164)", 2020-11-16T20:58:18.261 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.897176+0000", 2020-11-16T20:58:18.261 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.3685929510000001, 2020-11-16T20:58:18.262 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3686172880000003, 2020-11-16T20:58:18.262 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.262 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:18.262 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:18.262 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:18.262 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:18.263 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3975 2020-11-16T20:58:18.263 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.263 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.263 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.263 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.263 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.897176+0000", 2020-11-16T20:58:18.263 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.263 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.264 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.264 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.264 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.897176+0000", 2020-11-16T20:58:18.264 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1625999999999999e-05 2020-11-16T20:58:18.264 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.264 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.264 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.265 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.897197+0000", 2020-11-16T20:58:18.265 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0810000000000001e-06 2020-11-16T20:58:18.265 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.265 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.265 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.265 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.897202+0000", 2020-11-16T20:58:18.265 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.5729999999999997e-06 2020-11-16T20:58:18.266 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.266 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.266 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.266 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.897212+0000", 2020-11-16T20:58:18.266 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5879999999999997e-06 2020-11-16T20:58:18.266 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.266 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.267 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.267 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.897217+0000", 2020-11-16T20:58:18.267 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1517e-05 2020-11-16T20:58:18.267 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.267 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.267 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.267 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.897289+0000", 2020-11-16T20:58:18.267 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7859999999999997e-06 2020-11-16T20:58:18.268 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.268 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.268 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:18.268 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.897297+0000", 2020-11-16T20:58:18.268 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0066684240000000001 2020-11-16T20:58:18.268 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.268 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.269 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.269 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.903965+0000", 2020-11-16T20:58:18.269 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5735999999999995e-05 2020-11-16T20:58:18.269 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.269 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.269 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:18.269 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.904041+0000", 2020-11-16T20:58:18.269 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0068653309999999997 2020-11-16T20:58:18.270 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.270 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.270 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.270 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.270 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.270 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3999 4.2 4:745e23d0:::smithi16641208-19:61 [sparse-read 0~2302526,omap-get-vals-by-keys in=4b,omap-get-keys in=12b,omap-get-vals in=16b,omap-get-header,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e164)", 2020-11-16T20:58:18.270 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.917926+0000", 2020-11-16T20:58:18.271 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.3478426079999997, 2020-11-16T20:58:18.271 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3479229740000003, 2020-11-16T20:58:18.271 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.271 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:18.271 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:18.271 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:18.271 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:18.272 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3999 2020-11-16T20:58:18.272 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.272 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.272 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.272 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.272 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.917926+0000", 2020-11-16T20:58:18.272 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.273 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.273 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.273 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.273 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.917926+0000", 2020-11-16T20:58:18.273 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6408000000000001e-05 2020-11-16T20:58:18.273 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.273 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.273 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.274 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.917962+0000", 2020-11-16T20:58:18.274 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8800000000000002e-06 2020-11-16T20:58:18.274 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.274 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.274 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.274 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.917969+0000", 2020-11-16T20:58:18.274 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0138e-05 2020-11-16T20:58:18.275 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.275 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.275 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.275 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.917979+0000", 2020-11-16T20:58:18.275 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.559e-06 2020-11-16T20:58:18.275 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.275 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.276 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.276 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.917987+0000", 2020-11-16T20:58:18.276 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9042999999999995e-05 2020-11-16T20:58:18.276 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.276 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.276 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.276 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918066+0000", 2020-11-16T20:58:18.276 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6357000000000003e-05 2020-11-16T20:58:18.277 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.277 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.277 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:18.277 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918122+0000", 2020-11-16T20:58:18.277 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019638500000000001 2020-11-16T20:58:18.277 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.277 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.278 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.278 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.278 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.278 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4000 4.2 4:745e23d0:::smithi16641208-19:61 [read 0~2302526,checksum in=4b] snapc 0=[] ondisk+read+known_if_redirected e164)", 2020-11-16T20:58:18.278 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.918023+0000", 2020-11-16T20:58:18.278 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.3477455640000002, 2020-11-16T20:58:18.278 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3478643750000003, 2020-11-16T20:58:18.279 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.279 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:18.279 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:18.279 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:18.279 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:18.279 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4000 2020-11-16T20:58:18.279 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.279 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.280 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.280 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.280 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918023+0000", 2020-11-16T20:58:18.280 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.280 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.280 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.280 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.281 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918023+0000", 2020-11-16T20:58:18.281 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0352999999999999e-05 2020-11-16T20:58:18.281 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.281 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.281 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.281 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918053+0000", 2020-11-16T20:58:18.281 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8310000000000003e-06 2020-11-16T20:58:18.282 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.282 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.282 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.282 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918057+0000", 2020-11-16T20:58:18.282 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8970000000000002e-06 2020-11-16T20:58:18.282 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.282 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.282 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.283 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918064+0000", 2020-11-16T20:58:18.283 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1930000000000002e-06 2020-11-16T20:58:18.283 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.283 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.283 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.283 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918067+0000", 2020-11-16T20:58:18.283 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2993999999999998e-05 2020-11-16T20:58:18.284 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.284 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.284 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.284 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918160+0000", 2020-11-16T20:58:18.284 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9496999999999999e-05 2020-11-16T20:58:18.284 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.284 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.284 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:18.285 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918190+0000", 2020-11-16T20:58:18.285 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016676500000000001 2020-11-16T20:58:18.285 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.285 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.285 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.285 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.285 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.286 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4001 4.2 4:745e23d0:::smithi16641208-19:61 [sparse-read 0~2302526] snapc 0=[] ondisk+read+known_if_redirected e164)", 2020-11-16T20:58:18.286 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.918095+0000", 2020-11-16T20:58:18.286 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.3476732809999996, 2020-11-16T20:58:18.286 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3478290409999998, 2020-11-16T20:58:18.286 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.286 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:18.286 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:18.287 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:18.287 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:18.287 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4001 2020-11-16T20:58:18.287 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.287 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.287 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.287 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.288 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918095+0000", 2020-11-16T20:58:18.288 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.288 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.288 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.288 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.288 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918095+0000", 2020-11-16T20:58:18.288 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5238000000000001e-05 2020-11-16T20:58:18.288 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.289 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.289 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.289 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918120+0000", 2020-11-16T20:58:18.289 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9260000000000002e-06 2020-11-16T20:58:18.289 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.289 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.289 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.290 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918124+0000", 2020-11-16T20:58:18.290 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.0320000000000003e-06 2020-11-16T20:58:18.290 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.290 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.290 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.290 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918132+0000", 2020-11-16T20:58:18.290 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3240000000000002e-06 2020-11-16T20:58:18.291 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.291 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.291 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.291 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918138+0000", 2020-11-16T20:58:18.291 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5117000000000005e-05 2020-11-16T20:58:18.291 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.291 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.291 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.292 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918223+0000", 2020-11-16T20:58:18.292 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8767000000000002e-05 2020-11-16T20:58:18.292 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.292 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.292 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:18.292 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918282+0000", 2020-11-16T20:58:18.292 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018640400000000001 2020-11-16T20:58:18.293 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.293 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.293 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.293 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.293 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.293 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4002 4.2 4:49e2d88b:::smithi16641208-294:head [write 564900~578776 in=578776b] snapc 74=[74,73,61] ondisk+write+known_if_redirected e164)", 2020-11-16T20:58:18.293 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.925477+0000", 2020-11-16T20:58:18.293 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.3402912630000001, 2020-11-16T20:58:18.294 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3404854019999997, 2020-11-16T20:58:18.294 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.294 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:18.294 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:18.294 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:18.294 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:18.294 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4002 2020-11-16T20:58:18.295 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.295 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.295 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.295 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.295 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.925477+0000", 2020-11-16T20:58:18.295 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.295 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.296 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.296 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.296 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.925477+0000", 2020-11-16T20:58:18.296 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00036541600000000003 2020-11-16T20:58:18.296 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.296 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.296 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.296 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.925843+0000", 2020-11-16T20:58:18.297 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0791000000000001e-05 2020-11-16T20:58:18.297 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.297 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.297 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.297 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.925853+0000", 2020-11-16T20:58:18.297 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7586999999999999e-05 2020-11-16T20:58:18.297 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.298 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.298 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.298 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.925871+0000", 2020-11-16T20:58:18.298 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8099999999999992e-06 2020-11-16T20:58:18.298 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.298 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.298 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.298 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.925881+0000", 2020-11-16T20:58:18.299 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2830000000000006e-05 2020-11-16T20:58:18.299 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.299 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.299 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.299 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.925954+0000", 2020-11-16T20:58:18.299 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8269999999999997e-05 2020-11-16T20:58:18.299 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.300 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.300 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:18.300 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.926002+0000", 2020-11-16T20:58:18.300 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00052470399999999997 2020-11-16T20:58:18.300 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.300 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.300 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.300 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.301 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.301 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4003 4.2 4:49e2d88b:::smithi16641208-294:head [write 1629160~709913 in=709913b] snapc 74=[74,73,61] ondisk+write+known_if_redirected e164)", 2020-11-16T20:58:18.301 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.933381+0000", 2020-11-16T20:58:18.301 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.3323874529999999, 2020-11-16T20:58:18.301 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3326190870000003, 2020-11-16T20:58:18.301 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.301 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:18.302 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:18.302 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:18.302 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:18.302 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4003 2020-11-16T20:58:18.302 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.302 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.302 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.303 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.303 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.933381+0000", 2020-11-16T20:58:18.303 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.303 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.303 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.303 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.303 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.933381+0000", 2020-11-16T20:58:18.303 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000205455 2020-11-16T20:58:18.304 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.304 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.304 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.304 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.933586+0000", 2020-11-16T20:58:18.304 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8999999999999995e-06 2020-11-16T20:58:18.304 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.304 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.305 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.305 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.933595+0000", 2020-11-16T20:58:18.305 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6484999999999999e-05 2020-11-16T20:58:18.305 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.305 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.305 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.305 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.933612+0000", 2020-11-16T20:58:18.305 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.5149999999999995e-06 2020-11-16T20:58:18.306 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.306 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.306 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.306 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.933621+0000", 2020-11-16T20:58:18.306 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2448999999999999e-05 2020-11-16T20:58:18.306 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.306 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.307 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.307 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.933674+0000", 2020-11-16T20:58:18.307 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4453999999999999e-05 2020-11-16T20:58:18.307 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.307 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.307 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:18.307 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.933708+0000", 2020-11-16T20:58:18.308 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032725799999999998 2020-11-16T20:58:18.308 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.308 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.308 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.308 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.308 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.308 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4004 4.2 4:49e2d88b:::smithi16641208-294:head [write 3073389~492409 in=492409b] snapc 74=[74,73,61] ondisk+write+known_if_redirected e164)", 2020-11-16T20:58:18.308 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.940933+0000", 2020-11-16T20:58:18.309 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.3248351019999998, 2020-11-16T20:58:18.309 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3251037759999997, 2020-11-16T20:58:18.309 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.309 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:18.309 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:18.309 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:18.309 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:18.310 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4004 2020-11-16T20:58:18.310 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.310 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.310 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.310 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.310 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.940933+0000", 2020-11-16T20:58:18.310 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.311 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.311 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.311 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.311 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.940933+0000", 2020-11-16T20:58:18.311 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029702599999999998 2020-11-16T20:58:18.311 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.311 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.311 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.312 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941230+0000", 2020-11-16T20:58:18.312 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0472000000000001e-05 2020-11-16T20:58:18.312 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.312 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.312 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.312 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941241+0000", 2020-11-16T20:58:18.312 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7234000000000001e-05 2020-11-16T20:58:18.313 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.313 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.313 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941258+0000", 2020-11-16T20:58:18.313 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.4110000000000002e-06 2020-11-16T20:58:18.313 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.313 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.314 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941268+0000", 2020-11-16T20:58:18.314 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2966000000000001e-05 2020-11-16T20:58:18.314 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.314 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.314 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.314 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941320+0000", 2020-11-16T20:58:18.314 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1665999999999998e-05 2020-11-16T20:58:18.315 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.315 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.315 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:18.315 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941352+0000", 2020-11-16T20:58:18.315 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00041877499999999997 2020-11-16T20:58:18.315 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.315 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.316 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.316 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.316 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.316 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4005 4.2 4:49e2d88b:::smithi16641208-294:head [setxattr _header (58) in=65b,truncate 3764900] snapc 74=[74,73,61] ondisk+write+known_if_redirected e164)", 2020-11-16T20:58:18.316 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.941320+0000", 2020-11-16T20:58:18.316 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.3244483799999998, 2020-11-16T20:58:18.316 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3247575600000001, 2020-11-16T20:58:18.316 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.317 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:18.317 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:18.317 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:18.317 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:18.317 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4005 2020-11-16T20:58:18.317 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.317 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.318 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.318 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.318 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941320+0000", 2020-11-16T20:58:18.318 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.318 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.318 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.318 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.319 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941320+0000", 2020-11-16T20:58:18.319 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8509e-05 2020-11-16T20:58:18.319 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.319 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.319 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.319 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941359+0000", 2020-11-16T20:58:18.319 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5609999999999998e-06 2020-11-16T20:58:18.319 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.320 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.320 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.320 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941364+0000", 2020-11-16T20:58:18.320 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2717999999999999e-05 2020-11-16T20:58:18.320 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.320 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.320 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.321 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941377+0000", 2020-11-16T20:58:18.321 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9110000000000001e-06 2020-11-16T20:58:18.321 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.321 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.321 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.321 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941382+0000", 2020-11-16T20:58:18.321 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7580999999999997e-05 2020-11-16T20:58:18.321 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.322 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.322 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.322 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941429+0000", 2020-11-16T20:58:18.322 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7358999999999998e-05 2020-11-16T20:58:18.322 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.322 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.322 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:18.323 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941477+0000", 2020-11-16T20:58:18.323 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000156639 2020-11-16T20:58:18.323 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.323 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.323 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.323 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.323 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.323 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4006 4.2 4:49e2d88b:::smithi16641208-294:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e164)", 2020-11-16T20:58:18.324 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.941414+0000", 2020-11-16T20:58:18.324 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.3243544529999998, 2020-11-16T20:58:18.324 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3247011439999996, 2020-11-16T20:58:18.324 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.324 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:18.324 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:18.324 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:18.325 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:18.325 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4006 2020-11-16T20:58:18.325 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.325 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.325 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.325 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.325 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941414+0000", 2020-11-16T20:58:18.325 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.326 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.326 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.326 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.326 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941414+0000", 2020-11-16T20:58:18.326 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6101999999999998e-05 2020-11-16T20:58:18.326 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.326 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.327 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.327 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941440+0000", 2020-11-16T20:58:18.327 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6380000000000003e-06 2020-11-16T20:58:18.327 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.327 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.327 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.327 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941445+0000", 2020-11-16T20:58:18.328 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2040000000000003e-06 2020-11-16T20:58:18.328 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.328 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.328 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.328 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941454+0000", 2020-11-16T20:58:18.328 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.805e-06 2020-11-16T20:58:18.328 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.328 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.329 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.329 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941458+0000", 2020-11-16T20:58:18.329 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5073e-05 2020-11-16T20:58:18.329 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.329 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.329 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.329 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941503+0000", 2020-11-16T20:58:18.330 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5981e-05 2020-11-16T20:58:18.330 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.330 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.330 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:18.330 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941539+0000", 2020-11-16T20:58:18.330 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012480299999999999 2020-11-16T20:58:18.330 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.331 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.331 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.331 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.331 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.331 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4007 4.2 4:75836747:::smithi16641208-340:head [append 0~0] snapc 74=[74,73,61] ondisk+write+known_if_redirected e164)", 2020-11-16T20:58:18.331 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.941488+0000", 2020-11-16T20:58:18.331 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.3242803590000003, 2020-11-16T20:58:18.331 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3246642529999999, 2020-11-16T20:58:18.332 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.332 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:18.332 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:18.332 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:18.332 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:18.332 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4007 2020-11-16T20:58:18.332 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.333 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.333 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.333 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.333 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941488+0000", 2020-11-16T20:58:18.333 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.333 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.333 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.333 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.334 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941488+0000", 2020-11-16T20:58:18.334 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6095e-05 2020-11-16T20:58:18.334 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.334 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.334 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.334 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941514+0000", 2020-11-16T20:58:18.334 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6500000000000004e-06 2020-11-16T20:58:18.335 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.335 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941519+0000", 2020-11-16T20:58:18.335 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4619999999999996e-06 2020-11-16T20:58:18.335 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.336 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941527+0000", 2020-11-16T20:58:18.336 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3100000000000002e-06 2020-11-16T20:58:18.336 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.336 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.336 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.336 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941532+0000", 2020-11-16T20:58:18.336 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4950999999999998e-05 2020-11-16T20:58:18.337 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.337 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.337 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.337 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941567+0000", 2020-11-16T20:58:18.337 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7274999999999998e-05 2020-11-16T20:58:18.337 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.337 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.338 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:18.338 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941604+0000", 2020-11-16T20:58:18.338 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011574300000000001 2020-11-16T20:58:18.338 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.338 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.338 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.338 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.338 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.339 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4008 4.2 4:75836747:::smithi16641208-340:head [rollback 73] snapc 74=[74,73,61] ondisk+write+known_if_redirected e164)", 2020-11-16T20:58:18.339 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.941561+0000", 2020-11-16T20:58:18.339 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.3242078020000001, 2020-11-16T20:58:18.339 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3246286400000002, 2020-11-16T20:58:18.339 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.339 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:18.339 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:18.340 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:18.340 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:18.340 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4008 2020-11-16T20:58:18.340 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.340 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.340 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.340 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.341 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941561+0000", 2020-11-16T20:58:18.341 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.341 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.341 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.341 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.341 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941561+0000", 2020-11-16T20:58:18.341 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5449999999999999e-05 2020-11-16T20:58:18.341 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.342 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.342 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.342 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941586+0000", 2020-11-16T20:58:18.342 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4750000000000004e-06 2020-11-16T20:58:18.342 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.342 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.342 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.343 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941591+0000", 2020-11-16T20:58:18.343 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2190000000000004e-06 2020-11-16T20:58:18.343 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.343 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.343 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.343 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941599+0000", 2020-11-16T20:58:18.343 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.647e-06 2020-11-16T20:58:18.343 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.344 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.344 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.344 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941602+0000", 2020-11-16T20:58:18.344 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6807000000000002e-05 2020-11-16T20:58:18.344 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.344 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.344 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941639+0000", 2020-11-16T20:58:18.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4644999999999998e-05 2020-11-16T20:58:18.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.345 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.345 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:18.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941674+0000", 2020-11-16T20:58:18.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000113243 2020-11-16T20:58:18.346 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.346 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.346 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.346 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.346 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.346 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4009 4.2 4:75836747:::smithi16641208-340:head [append 0~0] snapc 74=[74,73,61] ondisk+write+known_if_redirected e164)", 2020-11-16T20:58:18.346 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.941638+0000", 2020-11-16T20:58:18.346 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.3241301270000001, 2020-11-16T20:58:18.347 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3245881759999998, 2020-11-16T20:58:18.347 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.347 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:18.347 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:18.347 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:18.347 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:18.347 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4009 2020-11-16T20:58:18.348 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.348 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.348 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.348 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.348 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941638+0000", 2020-11-16T20:58:18.348 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.348 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.348 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.349 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.349 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941638+0000", 2020-11-16T20:58:18.349 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5511e-05 2020-11-16T20:58:18.349 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.349 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.349 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.349 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941664+0000", 2020-11-16T20:58:18.350 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4610000000000001e-06 2020-11-16T20:58:18.350 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.350 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.350 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941668+0000", 2020-11-16T20:58:18.350 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2810000000000008e-06 2020-11-16T20:58:18.350 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.351 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.351 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941677+0000", 2020-11-16T20:58:18.351 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4800000000000001e-06 2020-11-16T20:58:18.351 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.351 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.351 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941680+0000", 2020-11-16T20:58:18.352 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4869000000000001e-05 2020-11-16T20:58:18.352 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.352 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.352 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941715+0000", 2020-11-16T20:58:18.352 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1737999999999999e-05 2020-11-16T20:58:18.352 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.353 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:18.353 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941757+0000", 2020-11-16T20:58:18.353 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011834 2020-11-16T20:58:18.353 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.353 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.353 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.353 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.354 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:58:18.354 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 12 2020-11-16T20:58:18.354 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:18.355 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:58:18.356 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:18.360+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:18.456 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:18.460+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:18.520 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:18.520 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:58:18.520 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:58:18.520 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:58:18.521 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:18.530 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:58:18.573 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:18.578+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:18.656 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:18.660+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:18.658 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:18.658 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:58:18.658 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:58:18.659 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:58:18.659 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.659 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2583 4.2 4:75836747:::smithi16641208-340:head [setxattr _header (58) in=7b,truncate 3159815] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:58:18.659 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.770345+0000", 2020-11-16T20:58:18.659 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 118.89195541700001, 2020-11-16T20:58:18.659 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.079764311000000004, 2020-11-16T20:58:18.659 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.660 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:18.660 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:18.660 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:18.660 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:18.660 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2583 2020-11-16T20:58:18.660 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.660 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.661 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.661 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.661 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770345+0000", 2020-11-16T20:58:18.661 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.661 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.661 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.661 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.662 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770345+0000", 2020-11-16T20:58:18.662 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9728999999999999e-05 2020-11-16T20:58:18.662 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.662 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.662 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.662 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770384+0000", 2020-11-16T20:58:18.662 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3849999999999999e-06 2020-11-16T20:58:18.663 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.663 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.663 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.663 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770391+0000", 2020-11-16T20:58:18.663 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0865e-05 2020-11-16T20:58:18.663 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.663 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.663 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.664 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770401+0000", 2020-11-16T20:58:18.664 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7599999999999999e-06 2020-11-16T20:58:18.664 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.664 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.664 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.664 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770407+0000", 2020-11-16T20:58:18.664 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00082697999999999995 2020-11-16T20:58:18.665 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.665 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.665 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.665 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771234+0000", 2020-11-16T20:58:18.665 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8841000000000001e-05 2020-11-16T20:58:18.665 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.665 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.666 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:18.666 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771293+0000", 2020-11-16T20:58:18.666 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.028773502999999999 2020-11-16T20:58:18.666 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.666 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.666 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.666 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800067+0000", 2020-11-16T20:58:18.666 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011809199999999999 2020-11-16T20:58:18.667 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.667 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.667 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:18.667 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800185+0000", 2020-11-16T20:58:18.667 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00041150300000000002 2020-11-16T20:58:18.667 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.667 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.668 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:58:18.668 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800596+0000", 2020-11-16T20:58:18.668 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078037820000000004 2020-11-16T20:58:18.668 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.668 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.668 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:18.668 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808400+0000", 2020-11-16T20:58:18.669 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.040583162999999998 2020-11-16T20:58:18.669 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.669 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.669 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:18.669 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.848983+0000", 2020-11-16T20:58:18.669 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00096703299999999996 2020-11-16T20:58:18.669 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.669 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.670 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:18.670 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.849950+0000", 2020-11-16T20:58:18.670 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6266999999999994e-05 2020-11-16T20:58:18.670 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.670 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.670 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:18.670 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850016+0000", 2020-11-16T20:58:18.671 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2408e-05 2020-11-16T20:58:18.671 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.671 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.671 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.671 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850109+0000", 2020-11-16T20:58:18.671 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.079764311000000004 2020-11-16T20:58:18.671 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.671 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.672 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.672 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.672 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.672 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2584 4.2 4:75836747:::smithi16641208-340:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:58:18.672 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.771084+0000", 2020-11-16T20:58:18.672 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 118.891216004, 2020-11-16T20:58:18.672 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.079415345999999998, 2020-11-16T20:58:18.673 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.673 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:18.673 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:18.673 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:18.673 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:18.673 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2584 2020-11-16T20:58:18.673 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.674 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.674 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.674 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.674 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771084+0000", 2020-11-16T20:58:18.674 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.674 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.674 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.674 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.675 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771084+0000", 2020-11-16T20:58:18.675 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3832999999999999e-05 2020-11-16T20:58:18.675 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.675 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.675 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.675 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771118+0000", 2020-11-16T20:58:18.675 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2299999999999996e-06 2020-11-16T20:58:18.676 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.676 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.676 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.676 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771124+0000", 2020-11-16T20:58:18.676 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1649e-05 2020-11-16T20:58:18.676 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.676 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.676 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.677 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771136+0000", 2020-11-16T20:58:18.677 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7389999999999996e-06 2020-11-16T20:58:18.677 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.677 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.677 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.677 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771141+0000", 2020-11-16T20:58:18.677 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000251332 2020-11-16T20:58:18.678 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.678 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.678 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.678 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771393+0000", 2020-11-16T20:58:18.678 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0130999999999997e-05 2020-11-16T20:58:18.678 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.678 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.678 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:18.679 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771453+0000", 2020-11-16T20:58:18.679 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036790163000000001 2020-11-16T20:58:18.679 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.679 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.679 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.679 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808243+0000", 2020-11-16T20:58:18.679 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000122781 2020-11-16T20:58:18.680 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.680 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.680 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:18.680 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808366+0000", 2020-11-16T20:58:18.680 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041793941000000001 2020-11-16T20:58:18.680 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.680 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.681 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.681 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850160+0000", 2020-11-16T20:58:18.681 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8177000000000005e-05 2020-11-16T20:58:18.681 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.681 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.681 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:18.681 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850258+0000", 2020-11-16T20:58:18.681 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024137 2020-11-16T20:58:18.682 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.682 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.682 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.682 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850499+0000", 2020-11-16T20:58:18.682 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.079415345999999998 2020-11-16T20:58:18.682 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.682 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.683 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.683 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.683 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.683 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:14 3.0 3:3b92f709:::smithi16641208-69:head [copy-from ver 517] snapc 2b=[f] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e97)", 2020-11-16T20:58:18.683 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.813636+0000", 2020-11-16T20:58:18.683 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.848663474000006, 2020-11-16T20:58:18.683 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.068038797999999998, 2020-11-16T20:58:18.684 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.684 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:18.684 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.684 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.684 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.684 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813636+0000", 2020-11-16T20:58:18.684 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.684 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.685 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.685 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.685 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813636+0000", 2020-11-16T20:58:18.685 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4759000000000001e-05 2020-11-16T20:58:18.685 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.685 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.685 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.686 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813661+0000", 2020-11-16T20:58:18.686 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4690000000000002e-06 2020-11-16T20:58:18.686 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.686 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.686 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.686 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813665+0000", 2020-11-16T20:58:18.686 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0939999999999996e-06 2020-11-16T20:58:18.687 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.687 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.687 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.687 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813671+0000", 2020-11-16T20:58:18.687 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9490000000000001e-06 2020-11-16T20:58:18.687 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.687 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.687 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.688 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813674+0000", 2020-11-16T20:58:18.688 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035912158999999999 2020-11-16T20:58:18.688 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.688 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.688 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.688 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849586+0000", 2020-11-16T20:58:18.688 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000105225 2020-11-16T20:58:18.689 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.689 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.689 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:18.689 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849691+0000", 2020-11-16T20:58:18.689 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094697400000000008 2020-11-16T20:58:18.689 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.689 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.689 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,2", 2020-11-16T20:58:18.690 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.859161+0000", 2020-11-16T20:58:18.690 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022310784 2020-11-16T20:58:18.690 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.690 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.690 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:18.690 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881472+0000", 2020-11-16T20:58:18.690 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7089000000000003e-05 2020-11-16T20:58:18.691 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.691 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.691 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:18.691 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881519+0000", 2020-11-16T20:58:18.691 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9331000000000004e-05 2020-11-16T20:58:18.691 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.691 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.691 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:18.692 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881588+0000", 2020-11-16T20:58:18.692 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9375000000000001e-05 2020-11-16T20:58:18.692 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.692 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.692 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:18.692 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881637+0000", 2020-11-16T20:58:18.692 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7824000000000002e-05 2020-11-16T20:58:18.693 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.693 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.693 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.693 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881675+0000", 2020-11-16T20:58:18.693 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.068038797999999998 2020-11-16T20:58:18.693 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.693 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.693 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.694 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.694 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.694 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3084 3.0 3:0eeb4688:::smithi16641208-459:head [copy-from ver 165] snapc 38=[38] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e97)", 2020-11-16T20:58:18.694 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.814118+0000", 2020-11-16T20:58:18.694 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.848181715999999, 2020-11-16T20:58:18.694 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.078238367000000003, 2020-11-16T20:58:18.694 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.695 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:18.695 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.695 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.695 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.695 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814118+0000", 2020-11-16T20:58:18.695 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.695 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.696 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.696 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.696 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814118+0000", 2020-11-16T20:58:18.696 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.262e-05 2020-11-16T20:58:18.696 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.696 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.696 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.696 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814141+0000", 2020-11-16T20:58:18.697 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.169e-05 2020-11-16T20:58:18.697 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.697 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.697 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.697 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814153+0000", 2020-11-16T20:58:18.697 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5350000000000004e-06 2020-11-16T20:58:18.697 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.698 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.698 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.698 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814161+0000", 2020-11-16T20:58:18.698 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1760000000000003e-06 2020-11-16T20:58:18.698 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.698 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.698 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.698 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814165+0000", 2020-11-16T20:58:18.699 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035740382000000001 2020-11-16T20:58:18.699 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.699 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.699 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.699 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849906+0000", 2020-11-16T20:58:18.699 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2356999999999999e-05 2020-11-16T20:58:18.699 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.700 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.700 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:18.700 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849978+0000", 2020-11-16T20:58:18.700 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016929244999999999 2020-11-16T20:58:18.700 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.700 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.700 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,2", 2020-11-16T20:58:18.700 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.866907+0000", 2020-11-16T20:58:18.701 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024555357 2020-11-16T20:58:18.701 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.701 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.701 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:18.701 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.891463+0000", 2020-11-16T20:58:18.701 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00067812000000000005 2020-11-16T20:58:18.701 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.702 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.702 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:18.702 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892141+0000", 2020-11-16T20:58:18.702 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3387999999999997e-05 2020-11-16T20:58:18.702 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.702 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.702 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:18.703 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892204+0000", 2020-11-16T20:58:18.703 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4189999999999994e-05 2020-11-16T20:58:18.703 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.703 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.703 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:18.703 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892268+0000", 2020-11-16T20:58:18.703 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8306999999999993e-05 2020-11-16T20:58:18.703 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.704 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.704 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.704 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892357+0000", 2020-11-16T20:58:18.704 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.078238367000000003 2020-11-16T20:58:18.704 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.704 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.704 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.705 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.705 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.705 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:16 3.0 3:0eeb4688:::smithi16641208-459:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e97)", 2020-11-16T20:58:18.705 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.814220+0000", 2020-11-16T20:58:18.705 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.848079786, 2020-11-16T20:58:18.705 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.078457661999999997, 2020-11-16T20:58:18.705 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.705 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:18.706 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.706 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.706 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.706 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814220+0000", 2020-11-16T20:58:18.706 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.706 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.706 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.707 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.707 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814220+0000", 2020-11-16T20:58:18.707 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6680999999999998e-05 2020-11-16T20:58:18.707 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.707 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.707 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.707 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814237+0000", 2020-11-16T20:58:18.707 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4029999999999999e-06 2020-11-16T20:58:18.708 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.708 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.708 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.708 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814240+0000", 2020-11-16T20:58:18.708 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5980000000000002e-06 2020-11-16T20:58:18.708 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.708 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.709 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.709 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814247+0000", 2020-11-16T20:58:18.709 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1489999999999998e-06 2020-11-16T20:58:18.709 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.709 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.709 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.709 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814250+0000", 2020-11-16T20:58:18.710 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035894660000000002 2020-11-16T20:58:18.710 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.710 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.710 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.710 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850145+0000", 2020-11-16T20:58:18.710 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2685000000000001e-05 2020-11-16T20:58:18.710 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.710 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.711 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:18.711 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850197+0000", 2020-11-16T20:58:18.711 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030551076999999999 2020-11-16T20:58:18.711 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.711 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.711 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.711 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.880748+0000", 2020-11-16T20:58:18.712 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011375900000000001 2020-11-16T20:58:18.712 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.712 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.712 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:18.712 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.880862+0000", 2020-11-16T20:58:18.712 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011676122000000001 2020-11-16T20:58:18.712 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.712 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.713 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.713 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892538+0000", 2020-11-16T20:58:18.713 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7021999999999997e-05 2020-11-16T20:58:18.713 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.713 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.713 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:18.713 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892595+0000", 2020-11-16T20:58:18.714 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2505999999999999e-05 2020-11-16T20:58:18.714 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.714 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.714 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.714 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892678+0000", 2020-11-16T20:58:18.714 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.078457661999999997 2020-11-16T20:58:18.714 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.715 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.715 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.715 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.715 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.715 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:17 3.0 3:0eeb4688:::smithi16641208-459:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e97)", 2020-11-16T20:58:18.715 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.814270+0000", 2020-11-16T20:58:18.715 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.848030417000004, 2020-11-16T20:58:18.715 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.082632504999999995, 2020-11-16T20:58:18.716 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.716 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:18.716 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.716 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.716 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.716 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814270+0000", 2020-11-16T20:58:18.716 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.717 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.717 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.717 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.717 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814270+0000", 2020-11-16T20:58:18.717 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3700999999999999e-05 2020-11-16T20:58:18.717 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.717 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.717 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.718 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814293+0000", 2020-11-16T20:58:18.718 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7879999999999998e-06 2020-11-16T20:58:18.718 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.718 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.718 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.718 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814296+0000", 2020-11-16T20:58:18.718 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6509999999999998e-06 2020-11-16T20:58:18.719 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.719 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.719 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.719 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814302+0000", 2020-11-16T20:58:18.719 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1039999999999996e-06 2020-11-16T20:58:18.719 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.719 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.720 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.720 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814311+0000", 2020-11-16T20:58:18.720 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035912305999999998 2020-11-16T20:58:18.720 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.720 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.720 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.720 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850223+0000", 2020-11-16T20:58:18.720 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5476000000000003e-05 2020-11-16T20:58:18.721 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.721 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.721 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:18.721 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850269+0000", 2020-11-16T20:58:18.721 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030645256999999999 2020-11-16T20:58:18.721 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.721 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.722 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.722 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.880914+0000", 2020-11-16T20:58:18.722 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3608000000000004e-05 2020-11-16T20:58:18.722 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.722 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.722 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:18.722 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.880987+0000", 2020-11-16T20:58:18.722 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011720252 2020-11-16T20:58:18.723 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.723 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.723 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.723 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892708+0000", 2020-11-16T20:58:18.723 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4710000000000003e-05 2020-11-16T20:58:18.723 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.723 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.724 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:18.724 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892762+0000", 2020-11-16T20:58:18.724 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041396519999999997 2020-11-16T20:58:18.724 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.724 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.724 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.724 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.896902+0000", 2020-11-16T20:58:18.724 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.082632504999999995 2020-11-16T20:58:18.725 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.725 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.725 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.725 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.725 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.725 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:19 3.0 3:1e015f5d:::smithi16641208-120:head [copy-from ver 447] snapc e=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e97)", 2020-11-16T20:58:18.725 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.814940+0000", 2020-11-16T20:58:18.726 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.847359874999995, 2020-11-16T20:58:18.726 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.077559996000000006, 2020-11-16T20:58:18.726 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.726 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:18.726 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.726 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.726 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.727 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814940+0000", 2020-11-16T20:58:18.727 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.727 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.727 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.727 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.727 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814940+0000", 2020-11-16T20:58:18.727 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0903000000000003e-05 2020-11-16T20:58:18.727 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.728 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.728 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.728 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815001+0000", 2020-11-16T20:58:18.728 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1119999999999998e-06 2020-11-16T20:58:18.728 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.728 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.728 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.729 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815008+0000", 2020-11-16T20:58:18.729 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1421e-05 2020-11-16T20:58:18.729 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.729 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.729 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.729 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815019+0000", 2020-11-16T20:58:18.729 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6509999999999998e-06 2020-11-16T20:58:18.729 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.730 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.730 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.730 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815025+0000", 2020-11-16T20:58:18.730 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036337921000000002 2020-11-16T20:58:18.730 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.730 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.730 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.731 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851363+0000", 2020-11-16T20:58:18.731 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012654300000000001 2020-11-16T20:58:18.731 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.731 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.731 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:18.731 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851490+0000", 2020-11-16T20:58:18.731 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025530690000000002 2020-11-16T20:58:18.732 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.732 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.732 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,2", 2020-11-16T20:58:18.732 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.877020+0000", 2020-11-16T20:58:18.732 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01516898 2020-11-16T20:58:18.732 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.732 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.732 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:18.733 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892189+0000", 2020-11-16T20:58:18.733 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017819600000000001 2020-11-16T20:58:18.733 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.733 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.733 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:18.733 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892367+0000", 2020-11-16T20:58:18.733 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6916999999999999e-05 2020-11-16T20:58:18.734 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.734 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.734 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:18.734 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892404+0000", 2020-11-16T20:58:18.734 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1143999999999998e-05 2020-11-16T20:58:18.734 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.734 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.734 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:18.735 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892446+0000", 2020-11-16T20:58:18.735 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4518000000000002e-05 2020-11-16T20:58:18.735 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.735 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.735 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.735 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892500+0000", 2020-11-16T20:58:18.735 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.077559996000000006 2020-11-16T20:58:18.736 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.736 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.736 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.736 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.736 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.736 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3105 3.0 3:1ccd20f3:::smithi16641208-424:head [stat,delete] snapc 38=[38] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e97)", 2020-11-16T20:58:18.736 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.815082+0000", 2020-11-16T20:58:18.736 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.847218209999994, 2020-11-16T20:58:18.737 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066146218000000007, 2020-11-16T20:58:18.737 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.737 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:18.737 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.737 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.737 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.737 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815082+0000", 2020-11-16T20:58:18.738 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.738 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.738 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.738 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.738 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815082+0000", 2020-11-16T20:58:18.738 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0209000000000002e-05 2020-11-16T20:58:18.738 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.739 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.739 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.739 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815112+0000", 2020-11-16T20:58:18.739 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7830000000000004e-06 2020-11-16T20:58:18.739 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.739 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.739 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.739 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815118+0000", 2020-11-16T20:58:18.740 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0927000000000001e-05 2020-11-16T20:58:18.740 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.740 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.740 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.740 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815129+0000", 2020-11-16T20:58:18.740 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3059999999999997e-06 2020-11-16T20:58:18.740 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.741 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.741 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.741 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815134+0000", 2020-11-16T20:58:18.741 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036502199999999999 2020-11-16T20:58:18.741 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.741 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.741 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.741 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851636+0000", 2020-11-16T20:58:18.742 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016290900000000001 2020-11-16T20:58:18.742 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.742 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.742 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:18.742 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851799+0000", 2020-11-16T20:58:18.742 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00028645999999999999 2020-11-16T20:58:18.742 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.743 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.743 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,2", 2020-11-16T20:58:18.743 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852086+0000", 2020-11-16T20:58:18.743 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003854007 2020-11-16T20:58:18.743 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.743 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.743 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:18.743 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.855940+0000", 2020-11-16T20:58:18.744 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0019815750000000002 2020-11-16T20:58:18.744 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.744 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.744 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:18.744 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.857921+0000", 2020-11-16T20:58:18.744 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023126626000000001 2020-11-16T20:58:18.744 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.745 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.745 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:18.745 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881048+0000", 2020-11-16T20:58:18.745 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.0409999999999998e-05 2020-11-16T20:58:18.745 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.745 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.745 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:18.745 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881128+0000", 2020-11-16T20:58:18.746 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9806e-05 2020-11-16T20:58:18.746 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.746 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.746 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.746 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881228+0000", 2020-11-16T20:58:18.746 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066146218000000007 2020-11-16T20:58:18.746 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.747 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.747 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.747 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.747 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.747 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:21 3.0 3:1ccd20f3:::smithi16641208-424:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e97)", 2020-11-16T20:58:18.747 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.815178+0000", 2020-11-16T20:58:18.747 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.847121873000006, 2020-11-16T20:58:18.747 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066300320999999995, 2020-11-16T20:58:18.748 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.748 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:18.748 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.748 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.748 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.748 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815178+0000", 2020-11-16T20:58:18.748 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.749 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.749 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.749 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.749 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815178+0000", 2020-11-16T20:58:18.749 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8203000000000001e-05 2020-11-16T20:58:18.749 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.749 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.749 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.750 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815206+0000", 2020-11-16T20:58:18.750 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7729999999999996e-06 2020-11-16T20:58:18.750 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.750 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.750 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.750 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815212+0000", 2020-11-16T20:58:18.750 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.149e-05 2020-11-16T20:58:18.751 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.751 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.751 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.751 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815224+0000", 2020-11-16T20:58:18.751 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3900000000000001e-06 2020-11-16T20:58:18.751 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.751 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.751 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.752 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815229+0000", 2020-11-16T20:58:18.752 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039388232000000002 2020-11-16T20:58:18.752 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.752 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.752 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.752 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.854617+0000", 2020-11-16T20:58:18.752 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012693099999999999 2020-11-16T20:58:18.753 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.753 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.753 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:18.753 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.854744+0000", 2020-11-16T20:58:18.753 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026509525999999999 2020-11-16T20:58:18.753 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.753 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.753 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.754 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881254+0000", 2020-11-16T20:58:18.754 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2397000000000005e-05 2020-11-16T20:58:18.754 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.754 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.754 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:18.754 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881326+0000", 2020-11-16T20:58:18.754 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015237900000000001 2020-11-16T20:58:18.755 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.755 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.755 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.755 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881478+0000", 2020-11-16T20:58:18.755 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066300320999999995 2020-11-16T20:58:18.755 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.755 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.755 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.756 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.756 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.756 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:22 3.0 3:1ccd20f3:::smithi16641208-424:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e97)", 2020-11-16T20:58:18.756 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.815264+0000", 2020-11-16T20:58:18.756 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 76.847035433000002, 2020-11-16T20:58:18.756 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066644708999999996, 2020-11-16T20:58:18.756 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.757 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:18.757 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.757 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.757 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.757 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815264+0000", 2020-11-16T20:58:18.757 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.757 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.758 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.758 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.758 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815264+0000", 2020-11-16T20:58:18.758 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5266999999999999e-05 2020-11-16T20:58:18.758 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.758 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.758 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.759 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815310+0000", 2020-11-16T20:58:18.759 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3989999999999998e-06 2020-11-16T20:58:18.759 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.759 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.759 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.759 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815317+0000", 2020-11-16T20:58:18.759 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.082e-05 2020-11-16T20:58:18.759 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.760 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.760 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.760 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815328+0000", 2020-11-16T20:58:18.760 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0220000000000004e-06 2020-11-16T20:58:18.760 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.760 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.760 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.761 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815333+0000", 2020-11-16T20:58:18.761 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039899660000000003 2020-11-16T20:58:18.761 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.761 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.761 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.761 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.855233+0000", 2020-11-16T20:58:18.761 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2051000000000004e-05 2020-11-16T20:58:18.761 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.762 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.762 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:18.762 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.855315+0000", 2020-11-16T20:58:18.762 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026394424 2020-11-16T20:58:18.762 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.762 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.762 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.763 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881709+0000", 2020-11-16T20:58:18.763 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020006599999999999 2020-11-16T20:58:18.763 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.763 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.763 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.763 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881909+0000", 2020-11-16T20:58:18.763 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066644708999999996 2020-11-16T20:58:18.764 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.764 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.764 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.764 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.764 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.764 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:68 3.0 3:266da985:::smithi16641208-406:head [copy-get max 8388608] snapc 0=[] RETRY=2 ondisk+retry+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:58:18.764 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.832133+0000", 2020-11-16T20:58:18.764 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 58.830166433999999, 2020-11-16T20:58:18.765 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054097583999999997, 2020-11-16T20:58:18.765 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.765 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:18.765 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.765 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.765 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.765 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832133+0000", 2020-11-16T20:58:18.766 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.766 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.766 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.766 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.766 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832133+0000", 2020-11-16T20:58:18.766 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1003e-05 2020-11-16T20:58:18.766 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.766 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.767 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.767 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832175+0000", 2020-11-16T20:58:18.767 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7960000000000001e-06 2020-11-16T20:58:18.767 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.767 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.767 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.767 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832180+0000", 2020-11-16T20:58:18.768 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0349e-05 2020-11-16T20:58:18.768 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.768 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.768 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.768 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832191+0000", 2020-11-16T20:58:18.768 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3000000000000001e-06 2020-11-16T20:58:18.768 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.768 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.769 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.769 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832196+0000", 2020-11-16T20:58:18.769 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6594000000000001e-05 2020-11-16T20:58:18.769 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.769 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.769 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.769 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832243+0000", 2020-11-16T20:58:18.769 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2993000000000001e-05 2020-11-16T20:58:18.770 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.770 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.770 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:18.770 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832256+0000", 2020-11-16T20:58:18.770 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.045506131999999998 2020-11-16T20:58:18.770 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.770 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.771 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.771 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.877762+0000", 2020-11-16T20:58:18.771 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010955600000000001 2020-11-16T20:58:18.771 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.771 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.771 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:18.771 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.877871+0000", 2020-11-16T20:58:18.772 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042134119999999997 2020-11-16T20:58:18.772 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.772 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.772 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.772 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.882085+0000", 2020-11-16T20:58:18.772 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014105699999999999 2020-11-16T20:58:18.772 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.772 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.773 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:18.773 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.882226+0000", 2020-11-16T20:58:18.773 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004005392 2020-11-16T20:58:18.773 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.773 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.773 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.773 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886231+0000", 2020-11-16T20:58:18.773 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054097583999999997 2020-11-16T20:58:18.774 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.774 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.774 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.774 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.774 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.774 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3327 3.0 3:2949283c:::smithi16641208-44:head [write 537989~722069,stat] snapc 49=[49,48,44,41] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e115)", 2020-11-16T20:58:18.774 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.832232+0000", 2020-11-16T20:58:18.775 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 58.830067952999997, 2020-11-16T20:58:18.775 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054524729000000001, 2020-11-16T20:58:18.775 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.775 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:18.775 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.775 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.775 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.776 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832232+0000", 2020-11-16T20:58:18.776 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.776 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.776 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.776 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.776 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832232+0000", 2020-11-16T20:58:18.776 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00040025400000000001 2020-11-16T20:58:18.776 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.777 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.777 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.777 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832632+0000", 2020-11-16T20:58:18.777 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5050000000000004e-06 2020-11-16T20:58:18.777 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.777 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.777 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.778 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832639+0000", 2020-11-16T20:58:18.778 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1299e-05 2020-11-16T20:58:18.778 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.778 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.778 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.778 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832650+0000", 2020-11-16T20:58:18.778 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8030000000000002e-06 2020-11-16T20:58:18.778 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.779 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.779 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.779 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832656+0000", 2020-11-16T20:58:18.779 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8779000000000003e-05 2020-11-16T20:58:18.779 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.779 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.779 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.780 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832695+0000", 2020-11-16T20:58:18.780 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9789999999999993e-06 2020-11-16T20:58:18.780 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.780 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.780 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:18.780 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832703+0000", 2020-11-16T20:58:18.780 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.045361931000000001 2020-11-16T20:58:18.780 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.781 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.781 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.781 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.878065+0000", 2020-11-16T20:58:18.781 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000221418 2020-11-16T20:58:18.781 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.781 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.781 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:18.782 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.878286+0000", 2020-11-16T20:58:18.782 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023917099999999999 2020-11-16T20:58:18.782 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.782 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.782 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 2,6", 2020-11-16T20:58:18.782 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.878525+0000", 2020-11-16T20:58:18.782 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003510988 2020-11-16T20:58:18.782 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.783 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.783 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:18.783 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.882036+0000", 2020-11-16T20:58:18.783 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044535720000000003 2020-11-16T20:58:18.783 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.783 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.783 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:18.784 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886490+0000", 2020-11-16T20:58:18.784 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0692999999999996e-05 2020-11-16T20:58:18.784 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.784 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.784 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:18.784 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886560+0000", 2020-11-16T20:58:18.784 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5710000000000001e-05 2020-11-16T20:58:18.784 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.785 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.785 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:18.785 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886606+0000", 2020-11-16T20:58:18.785 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015062699999999999 2020-11-16T20:58:18.785 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.785 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.785 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.786 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886757+0000", 2020-11-16T20:58:18.786 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054524729000000001 2020-11-16T20:58:18.786 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.786 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.786 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.786 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.786 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.787 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:70 3.0 3:2949283c:::smithi16641208-44:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:58:18.787 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.832688+0000", 2020-11-16T20:58:18.787 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 58.829611534000001, 2020-11-16T20:58:18.787 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054473900999999998, 2020-11-16T20:58:18.787 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.787 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:18.787 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.788 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.788 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.788 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832688+0000", 2020-11-16T20:58:18.788 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.788 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.788 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.788 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.788 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832688+0000", 2020-11-16T20:58:18.789 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5730999999999999e-05 2020-11-16T20:58:18.789 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.789 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.789 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.789 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832704+0000", 2020-11-16T20:58:18.789 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0690000000000002e-06 2020-11-16T20:58:18.789 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.789 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.790 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.790 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832707+0000", 2020-11-16T20:58:18.790 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9719999999999997e-06 2020-11-16T20:58:18.790 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.790 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.790 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.790 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832713+0000", 2020-11-16T20:58:18.791 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8650000000000001e-06 2020-11-16T20:58:18.791 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.791 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.791 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.791 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832716+0000", 2020-11-16T20:58:18.791 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8541999999999998e-05 2020-11-16T20:58:18.791 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.792 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.792 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.792 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832755+0000", 2020-11-16T20:58:18.792 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.153e-05 2020-11-16T20:58:18.792 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.792 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.792 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:18.792 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832766+0000", 2020-11-16T20:58:18.793 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047763647999999999 2020-11-16T20:58:18.793 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.793 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.793 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.793 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.880530+0000", 2020-11-16T20:58:18.793 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016090599999999999 2020-11-16T20:58:18.793 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.794 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.794 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:18.794 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.880691+0000", 2020-11-16T20:58:18.794 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061198809999999998 2020-11-16T20:58:18.794 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.794 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.794 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.794 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886811+0000", 2020-11-16T20:58:18.795 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012478200000000001 2020-11-16T20:58:18.795 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.795 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.795 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:18.795 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886935+0000", 2020-11-16T20:58:18.795 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000226975 2020-11-16T20:58:18.795 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.796 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.796 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.796 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.887162+0000", 2020-11-16T20:58:18.796 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054473900999999998 2020-11-16T20:58:18.796 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.796 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.796 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.796 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.797 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.797 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:71 3.0 3:2949283c:::smithi16641208-44:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:58:18.797 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.832747+0000", 2020-11-16T20:58:18.797 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 58.829552686, 2020-11-16T20:58:18.797 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.057126753000000002, 2020-11-16T20:58:18.797 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.797 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:18.798 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.798 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.798 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832747+0000", 2020-11-16T20:58:18.798 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.798 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.798 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.799 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.799 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832747+0000", 2020-11-16T20:58:18.799 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3911000000000001e-05 2020-11-16T20:58:18.799 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.799 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.799 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.799 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832781+0000", 2020-11-16T20:58:18.799 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2480000000000001e-06 2020-11-16T20:58:18.800 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.800 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.800 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.800 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832784+0000", 2020-11-16T20:58:18.800 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2040000000000002e-06 2020-11-16T20:58:18.800 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.800 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.801 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.801 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832791+0000", 2020-11-16T20:58:18.801 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2399999999999999e-06 2020-11-16T20:58:18.801 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.801 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.801 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.801 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832794+0000", 2020-11-16T20:58:18.801 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2548000000000002e-05 2020-11-16T20:58:18.802 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.802 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.802 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.802 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832816+0000", 2020-11-16T20:58:18.802 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4160000000000003e-06 2020-11-16T20:58:18.802 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.802 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.803 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:18.803 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832822+0000", 2020-11-16T20:58:18.803 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.053459245000000002 2020-11-16T20:58:18.803 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.803 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.803 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.803 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886281+0000", 2020-11-16T20:58:18.803 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018665399999999999 2020-11-16T20:58:18.804 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.804 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.804 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:18.804 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886468+0000", 2020-11-16T20:58:18.804 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00075232499999999998 2020-11-16T20:58:18.804 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.804 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.805 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.805 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.887220+0000", 2020-11-16T20:58:18.805 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000152974 2020-11-16T20:58:18.805 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.805 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.805 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:18.805 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.887373+0000", 2020-11-16T20:58:18.805 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002500988 2020-11-16T20:58:18.806 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.806 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.806 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.806 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.889874+0000", 2020-11-16T20:58:18.806 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.057126753000000002 2020-11-16T20:58:18.806 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.806 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.807 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.807 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.807 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.807 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3346 3.0 3:1e5364a0:::smithi16641208-320:head [write 588410~547816,stat] snapc 4a=[4a,49,48,44,41] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e115)", 2020-11-16T20:58:18.807 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.839179+0000", 2020-11-16T20:58:18.807 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 58.823120932000002, 2020-11-16T20:58:18.807 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.084752201999999999, 2020-11-16T20:58:18.807 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.808 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:18.808 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.808 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.808 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.808 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839179+0000", 2020-11-16T20:58:18.808 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.808 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.809 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.809 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.809 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839179+0000", 2020-11-16T20:58:18.809 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000250175 2020-11-16T20:58:18.809 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.809 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.809 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.809 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839429+0000", 2020-11-16T20:58:18.810 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.22e-06 2020-11-16T20:58:18.810 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.810 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.810 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.810 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839434+0000", 2020-11-16T20:58:18.810 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0258000000000001e-05 2020-11-16T20:58:18.810 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.811 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.811 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.811 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839445+0000", 2020-11-16T20:58:18.811 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8019999999999999e-06 2020-11-16T20:58:18.811 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.811 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.811 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.812 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839449+0000", 2020-11-16T20:58:18.812 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1084999999999997e-05 2020-11-16T20:58:18.812 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.812 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.812 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.812 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839491+0000", 2020-11-16T20:58:18.812 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4239999999999993e-06 2020-11-16T20:58:18.812 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.813 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.813 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:18.813 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839499+0000", 2020-11-16T20:58:18.813 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050428550000000003 2020-11-16T20:58:18.813 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.813 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.813 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.814 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.889928+0000", 2020-11-16T20:58:18.814 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030713000000000002 2020-11-16T20:58:18.815 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.815 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.815 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:18.815 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.890235+0000", 2020-11-16T20:58:18.815 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00047229800000000001 2020-11-16T20:58:18.815 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.815 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.816 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 2,6", 2020-11-16T20:58:18.816 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.890707+0000", 2020-11-16T20:58:18.816 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0046488600000000003 2020-11-16T20:58:18.816 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.816 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.816 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:18.816 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895356+0000", 2020-11-16T20:58:18.816 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.028228664000000001 2020-11-16T20:58:18.817 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.817 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.817 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:18.817 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.923584+0000", 2020-11-16T20:58:18.817 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3496e-05 2020-11-16T20:58:18.817 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.817 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.818 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:18.818 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.923608+0000", 2020-11-16T20:58:18.818 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0390999999999997e-05 2020-11-16T20:58:18.818 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.818 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.818 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:18.818 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.923678+0000", 2020-11-16T20:58:18.819 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00025284899999999998 2020-11-16T20:58:18.819 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.819 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.819 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.819 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.923931+0000", 2020-11-16T20:58:18.819 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.084752201999999999 2020-11-16T20:58:18.819 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.819 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.820 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.820 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.820 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.820 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:73 3.0 3:1e5364a0:::smithi16641208-320:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:58:18.820 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.839479+0000", 2020-11-16T20:58:18.820 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 58.822820700999998, 2020-11-16T20:58:18.820 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.089078473000000005, 2020-11-16T20:58:18.821 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.821 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:18.821 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.821 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.821 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.821 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839479+0000", 2020-11-16T20:58:18.821 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.822 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.822 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.822 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.822 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839479+0000", 2020-11-16T20:58:18.822 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8124000000000001e-05 2020-11-16T20:58:18.822 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.822 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.822 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.823 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839497+0000", 2020-11-16T20:58:18.823 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1580000000000001e-06 2020-11-16T20:58:18.823 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.823 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.823 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.823 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839501+0000", 2020-11-16T20:58:18.823 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6579999999999996e-06 2020-11-16T20:58:18.824 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.824 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.824 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.824 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839507+0000", 2020-11-16T20:58:18.824 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9720000000000001e-06 2020-11-16T20:58:18.824 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.824 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.824 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.825 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839510+0000", 2020-11-16T20:58:18.825 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1950000000000003e-05 2020-11-16T20:58:18.825 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.825 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.825 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.825 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839552+0000", 2020-11-16T20:58:18.825 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2225999999999999e-05 2020-11-16T20:58:18.826 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.826 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.826 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:18.826 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839564+0000", 2020-11-16T20:58:18.826 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.055483693000000001 2020-11-16T20:58:18.826 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.826 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.827 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.827 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895048+0000", 2020-11-16T20:58:18.827 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022632500000000001 2020-11-16T20:58:18.827 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.827 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.827 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:18.827 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895274+0000", 2020-11-16T20:58:18.827 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032777323999999997 2020-11-16T20:58:18.828 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.828 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.828 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.828 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928052+0000", 2020-11-16T20:58:18.828 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000150321 2020-11-16T20:58:18.828 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.828 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.829 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:18.829 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928202+0000", 2020-11-16T20:58:18.829 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00035572199999999999 2020-11-16T20:58:18.829 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.829 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.829 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.829 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928558+0000", 2020-11-16T20:58:18.829 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.089078473000000005 2020-11-16T20:58:18.830 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.830 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.830 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.830 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.830 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.830 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:74 3.0 3:1e5364a0:::smithi16641208-320:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:58:18.830 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.839542+0000", 2020-11-16T20:58:18.831 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 58.822758071999999, 2020-11-16T20:58:18.831 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.093226218, 2020-11-16T20:58:18.831 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.831 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:18.831 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.831 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.831 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.832 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839542+0000", 2020-11-16T20:58:18.832 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.832 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.832 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.832 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.832 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839542+0000", 2020-11-16T20:58:18.832 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6640000000000002e-05 2020-11-16T20:58:18.832 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.833 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.833 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.833 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839578+0000", 2020-11-16T20:58:18.833 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.416e-06 2020-11-16T20:58:18.833 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.833 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.833 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.834 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839582+0000", 2020-11-16T20:58:18.834 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9070000000000001e-06 2020-11-16T20:58:18.834 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.834 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.834 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.834 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839589+0000", 2020-11-16T20:58:18.834 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.994e-06 2020-11-16T20:58:18.834 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.835 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.835 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.835 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839592+0000", 2020-11-16T20:58:18.835 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4881000000000001e-05 2020-11-16T20:58:18.835 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.835 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.835 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.836 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839617+0000", 2020-11-16T20:58:18.836 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4330000000000003e-06 2020-11-16T20:58:18.836 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.836 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.836 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:18.836 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839622+0000", 2020-11-16T20:58:18.836 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.055765016000000001 2020-11-16T20:58:18.836 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.837 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.837 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.837 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895387+0000", 2020-11-16T20:58:18.837 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000145926 2020-11-16T20:58:18.837 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.837 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.837 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:18.838 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895533+0000", 2020-11-16T20:58:18.838 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033078547999999999 2020-11-16T20:58:18.838 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.838 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.838 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.838 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928612+0000", 2020-11-16T20:58:18.838 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114621 2020-11-16T20:58:18.839 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.839 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.839 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:18.839 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928726+0000", 2020-11-16T20:58:18.839 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004041836 2020-11-16T20:58:18.839 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.839 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.839 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.840 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.932768+0000", 2020-11-16T20:58:18.840 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.093226218 2020-11-16T20:58:18.840 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.840 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.840 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.840 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.840 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.841 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3414 4.3 4:cf270c70:::smithi16641208-423:head [copy-from ver 586] snapc 4f=[4f,48] ondisk+write+known_if_redirected e120)", 2020-11-16T20:58:18.841 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:24.750833+0000", 2020-11-16T20:58:18.841 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 53.911466834999999, 2020-11-16T20:58:18.841 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.064670209000000006, 2020-11-16T20:58:18.841 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.841 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:18.841 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:18.842 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:18.842 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:18.842 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3414 2020-11-16T20:58:18.842 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.842 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.842 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.842 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.842 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750833+0000", 2020-11-16T20:58:18.843 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.843 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.843 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.843 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.843 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750833+0000", 2020-11-16T20:58:18.843 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4888e-05 2020-11-16T20:58:18.843 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.844 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.844 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.844 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750858+0000", 2020-11-16T20:58:18.844 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6359999999999997e-06 2020-11-16T20:58:18.844 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.844 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.844 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.844 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750865+0000", 2020-11-16T20:58:18.845 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4072e-05 2020-11-16T20:58:18.845 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.845 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.845 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.845 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750879+0000", 2020-11-16T20:58:18.845 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1409999999999994e-06 2020-11-16T20:58:18.845 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.846 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.846 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.846 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750888+0000", 2020-11-16T20:58:18.846 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000413664 2020-11-16T20:58:18.846 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.846 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.846 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.847 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751301+0000", 2020-11-16T20:58:18.847 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1214e-05 2020-11-16T20:58:18.847 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.847 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.847 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op must wait for map", 2020-11-16T20:58:18.847 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751313+0000", 2020-11-16T20:58:18.847 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078009489999999997 2020-11-16T20:58:18.847 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.848 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.848 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.848 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.759114+0000", 2020-11-16T20:58:18.848 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.056386372999999997 2020-11-16T20:58:18.848 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.848 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.848 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:18.849 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.815500+0000", 2020-11-16T20:58:18.849 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2720000000000002e-06 2020-11-16T20:58:18.849 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.849 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.849 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.849 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.815503+0000", 2020-11-16T20:58:18.849 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.064670209000000006 2020-11-16T20:58:18.849 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.850 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.850 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.850 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.850 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.850 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3415 4.3 4:cf270c70:::smithi16641208-423:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e120)", 2020-11-16T20:58:18.850 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:24.750930+0000", 2020-11-16T20:58:18.850 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 53.911370357000003, 2020-11-16T20:58:18.851 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.064785488000000002, 2020-11-16T20:58:18.851 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.851 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:18.851 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:18.851 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:18.851 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:18.851 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3415 2020-11-16T20:58:18.852 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.852 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.852 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.852 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.852 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750930+0000", 2020-11-16T20:58:18.852 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.852 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.852 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.853 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.853 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750930+0000", 2020-11-16T20:58:18.853 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7016e-05 2020-11-16T20:58:18.853 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.853 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.853 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.853 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750957+0000", 2020-11-16T20:58:18.854 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7379999999999999e-06 2020-11-16T20:58:18.854 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.854 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.854 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.854 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750962+0000", 2020-11-16T20:58:18.854 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0684e-05 2020-11-16T20:58:18.854 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.855 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.855 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.855 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750973+0000", 2020-11-16T20:58:18.855 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2089999999999996e-06 2020-11-16T20:58:18.855 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.855 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.855 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.855 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750978+0000", 2020-11-16T20:58:18.856 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00039269899999999999 2020-11-16T20:58:18.856 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.856 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.856 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.856 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751371+0000", 2020-11-16T20:58:18.856 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7460000000000003e-06 2020-11-16T20:58:18.856 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.857 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.857 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:58:18.857 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751378+0000", 2020-11-16T20:58:18.857 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092297239999999999 2020-11-16T20:58:18.857 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.857 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.857 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.857 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.760607+0000", 2020-11-16T20:58:18.858 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.055107672000000003 2020-11-16T20:58:18.858 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.858 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.858 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.858 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.815715+0000", 2020-11-16T20:58:18.858 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.064785488000000002 2020-11-16T20:58:18.858 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.859 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.859 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.859 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.859 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.859 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3416 4.3 4:f6d44bd7:::smithi16641208-454:48 [cache-flush] snapc 0=[] ondisk+read+ignore_cache+known_if_redirected e120)", 2020-11-16T20:58:18.859 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:24.751009+0000", 2020-11-16T20:58:18.859 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 53.911290567999998, 2020-11-16T20:58:18.859 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066511669999999995, 2020-11-16T20:58:18.860 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:18.860 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:18.860 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:18.860 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:18.860 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:18.860 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3416 2020-11-16T20:58:18.860 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.861 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:18.861 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.861 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:18.861 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751009+0000", 2020-11-16T20:58:18.861 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:18.861 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.861 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.861 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:18.862 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751009+0000", 2020-11-16T20:58:18.862 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2008999999999999e-05 2020-11-16T20:58:18.862 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.862 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.862 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:18.862 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751031+0000", 2020-11-16T20:58:18.862 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1550000000000004e-06 2020-11-16T20:58:18.863 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.863 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.863 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:18.863 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751038+0000", 2020-11-16T20:58:18.863 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1149999999999996e-06 2020-11-16T20:58:18.863 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.863 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.864 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:18.864 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751045+0000", 2020-11-16T20:58:18.864 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8959999999999996e-06 2020-11-16T20:58:18.864 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.864 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.864 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:18.864 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751049+0000", 2020-11-16T20:58:18.864 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000347373 2020-11-16T20:58:18.865 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.865 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.865 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.865 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751396+0000", 2020-11-16T20:58:18.865 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1729999999999997e-06 2020-11-16T20:58:18.865 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.865 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.866 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:58:18.866 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751400+0000", 2020-11-16T20:58:18.866 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094156940000000005 2020-11-16T20:58:18.866 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.866 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.866 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.866 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.760816+0000", 2020-11-16T20:58:18.866 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000195842 2020-11-16T20:58:18.867 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.867 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.867 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:18.867 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.761012+0000", 2020-11-16T20:58:18.867 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.056247153000000001 2020-11-16T20:58:18.867 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.867 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.868 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:18.868 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.817259+0000", 2020-11-16T20:58:18.868 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000154034 2020-11-16T20:58:18.868 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.868 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.868 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:18.868 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.817413+0000", 2020-11-16T20:58:18.868 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000108226 2020-11-16T20:58:18.869 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:18.869 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:18.869 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:18.869 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.817521+0000", 2020-11-16T20:58:18.869 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066511669999999995 2020-11-16T20:58:18.869 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.869 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.870 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.870 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:18.870 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:18.870 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:18.871 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:18.875+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:18.872 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:58:18.925 INFO:teuthology.orchestra.run.smithi166.stderr:noscrub is unset 2020-11-16T20:58:18.972 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:18.977+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:19.044 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:19.044 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:58:19.045 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.045 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4019 4.0 4:2e5644f4:::smithi16641208-410:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e164)", 2020-11-16T20:58:19.045 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.899863+0000", 2020-11-16T20:58:19.045 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.1492789070000002, 2020-11-16T20:58:19.045 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.149301951, 2020-11-16T20:58:19.045 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.045 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:19.046 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.046 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.046 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.046 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4019 2020-11-16T20:58:19.046 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.046 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.046 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.047 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.047 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899863+0000", 2020-11-16T20:58:19.047 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.047 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.047 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.047 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.047 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899863+0000", 2020-11-16T20:58:19.048 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5957999999999997e-05 2020-11-16T20:58:19.048 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.048 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.048 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.048 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899899+0000", 2020-11-16T20:58:19.048 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3890000000000002e-06 2020-11-16T20:58:19.048 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.049 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.049 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.049 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899905+0000", 2020-11-16T20:58:19.049 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1969e-05 2020-11-16T20:58:19.049 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.049 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.049 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.050 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899917+0000", 2020-11-16T20:58:19.050 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7440000000000004e-06 2020-11-16T20:58:19.050 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.050 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.050 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.050 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899923+0000", 2020-11-16T20:58:19.050 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1482000000000004e-05 2020-11-16T20:58:19.050 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.051 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.051 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.051 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899994+0000", 2020-11-16T20:58:19.051 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3801000000000001e-05 2020-11-16T20:58:19.051 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.051 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.051 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:19.052 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.900008+0000", 2020-11-16T20:58:19.052 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094666520000000007 2020-11-16T20:58:19.052 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.052 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.052 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.052 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909475+0000", 2020-11-16T20:58:19.052 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0629000000000001e-05 2020-11-16T20:58:19.053 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.053 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.053 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.053 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909505+0000", 2020-11-16T20:58:19.053 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0096426240000000007 2020-11-16T20:58:19.053 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.053 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.054 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.054 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.054 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.054 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4021 4.0 4:356864c0:::smithi16641208-150:head [write 615321~404523 in=404523b] snapc 75=[75,74,73,61] ondisk+write+known_if_redirected e165)", 2020-11-16T20:58:19.054 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.906351+0000", 2020-11-16T20:58:19.054 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.1427903239999999, 2020-11-16T20:58:19.054 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.142866046, 2020-11-16T20:58:19.054 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.055 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:19.055 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.055 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.055 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.055 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4021 2020-11-16T20:58:19.055 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.055 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.056 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.056 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.056 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.906351+0000", 2020-11-16T20:58:19.056 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.056 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.056 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.056 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.057 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.906351+0000", 2020-11-16T20:58:19.057 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034401499999999998 2020-11-16T20:58:19.057 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.057 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.057 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.057 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.906695+0000", 2020-11-16T20:58:19.057 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1609999999999992e-06 2020-11-16T20:58:19.058 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.058 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.058 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.058 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.906705+0000", 2020-11-16T20:58:19.058 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4191e-05 2020-11-16T20:58:19.058 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.058 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.059 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.059 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.906719+0000", 2020-11-16T20:58:19.059 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0259e-05 2020-11-16T20:58:19.059 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.059 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.059 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.059 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.906729+0000", 2020-11-16T20:58:19.060 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029139359999999998 2020-11-16T20:58:19.060 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.060 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.060 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.060 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909643+0000", 2020-11-16T20:58:19.060 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3890000000000001e-05 2020-11-16T20:58:19.060 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.060 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.061 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.061 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909697+0000", 2020-11-16T20:58:19.061 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033454520000000001 2020-11-16T20:58:19.061 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.061 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.061 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.061 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.062 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.062 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4022 4.0 4:356864c0:::smithi16641208-150:head [write 1804606~457240 in=457240b] snapc 75=[75,74,73,61] ondisk+write+known_if_redirected e165)", 2020-11-16T20:58:19.062 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.913486+0000", 2020-11-16T20:58:19.062 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.1356560670000002, 2020-11-16T20:58:19.062 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1357760399999997, 2020-11-16T20:58:19.062 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.062 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:19.063 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.063 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.063 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.063 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4022 2020-11-16T20:58:19.063 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.063 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.063 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.064 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.064 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.913486+0000", 2020-11-16T20:58:19.064 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.064 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.064 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.064 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.064 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.913486+0000", 2020-11-16T20:58:19.064 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00025596700000000001 2020-11-16T20:58:19.065 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.065 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.913742+0000", 2020-11-16T20:58:19.065 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9280000000000004e-06 2020-11-16T20:58:19.065 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.066 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.913749+0000", 2020-11-16T20:58:19.066 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1252e-05 2020-11-16T20:58:19.066 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.066 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.066 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.913760+0000", 2020-11-16T20:58:19.067 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7570000000000004e-06 2020-11-16T20:58:19.067 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.067 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.067 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.067 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.913768+0000", 2020-11-16T20:58:19.067 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5753000000000001e-05 2020-11-16T20:58:19.067 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.067 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.068 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.068 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.913813+0000", 2020-11-16T20:58:19.068 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3049000000000002e-05 2020-11-16T20:58:19.068 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.068 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.068 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.068 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.913846+0000", 2020-11-16T20:58:19.069 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00036070600000000003 2020-11-16T20:58:19.069 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.069 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.069 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.069 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.069 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.069 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4023 4.0 4:356864c0:::smithi16641208-150:head [write 2755658~726225 in=726225b] snapc 75=[75,74,73,61] ondisk+write+known_if_redirected e165)", 2020-11-16T20:58:19.070 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.920214+0000", 2020-11-16T20:58:19.070 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.1289280079999999, 2020-11-16T20:58:19.070 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.129085463, 2020-11-16T20:58:19.070 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.070 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:19.070 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.070 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.070 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.071 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4023 2020-11-16T20:58:19.071 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.071 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.071 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.071 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.071 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920214+0000", 2020-11-16T20:58:19.071 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.072 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.072 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.072 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.072 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920214+0000", 2020-11-16T20:58:19.072 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000472304 2020-11-16T20:58:19.072 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.072 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.073 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.073 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920686+0000", 2020-11-16T20:58:19.073 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2201999999999999e-05 2020-11-16T20:58:19.073 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.073 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.073 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.073 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920698+0000", 2020-11-16T20:58:19.074 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9103999999999999e-05 2020-11-16T20:58:19.074 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.074 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.074 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.074 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920717+0000", 2020-11-16T20:58:19.074 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0829000000000001e-05 2020-11-16T20:58:19.074 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.075 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.075 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.075 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920728+0000", 2020-11-16T20:58:19.075 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1413000000000003e-05 2020-11-16T20:58:19.075 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.075 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.075 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.075 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920790+0000", 2020-11-16T20:58:19.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1226e-05 2020-11-16T20:58:19.076 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.076 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.076 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.076 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920841+0000", 2020-11-16T20:58:19.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00062707799999999999 2020-11-16T20:58:19.076 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.077 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.077 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.077 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.077 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.077 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4024 4.0 4:356864c0:::smithi16641208-150:head [setxattr _header (58) in=65b,truncate 3815321] snapc 75=[75,74,73,61] ondisk+write+known_if_redirected e165)", 2020-11-16T20:58:19.077 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.920772+0000", 2020-11-16T20:58:19.077 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.1283698649999998, 2020-11-16T20:58:19.078 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1285737039999999, 2020-11-16T20:58:19.078 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.078 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:19.078 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.078 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.078 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.078 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4024 2020-11-16T20:58:19.079 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.079 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.079 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.079 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.079 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920772+0000", 2020-11-16T20:58:19.079 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.079 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.079 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.080 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.080 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920772+0000", 2020-11-16T20:58:19.080 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4885999999999997e-05 2020-11-16T20:58:19.080 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.080 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.080 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.080 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920817+0000", 2020-11-16T20:58:19.081 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6239999999999996e-06 2020-11-16T20:58:19.081 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.081 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.081 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.081 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920823+0000", 2020-11-16T20:58:19.081 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1484000000000001e-05 2020-11-16T20:58:19.081 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.082 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.082 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.082 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920835+0000", 2020-11-16T20:58:19.082 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0860000000000001e-06 2020-11-16T20:58:19.082 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.082 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.082 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.083 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920840+0000", 2020-11-16T20:58:19.083 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4150999999999999e-05 2020-11-16T20:58:19.083 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.083 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.083 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.083 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920874+0000", 2020-11-16T20:58:19.083 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0432000000000002e-05 2020-11-16T20:58:19.083 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.084 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.084 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.084 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920915+0000", 2020-11-16T20:58:19.084 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014266300000000001 2020-11-16T20:58:19.084 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.084 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.084 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.085 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.085 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.085 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4025 4.0 4:356864c0:::smithi16641208-150:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e165)", 2020-11-16T20:58:19.085 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.920880+0000", 2020-11-16T20:58:19.085 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.128261621, 2020-11-16T20:58:19.085 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1285051890000002, 2020-11-16T20:58:19.085 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.086 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:19.086 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.086 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.086 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.086 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4025 2020-11-16T20:58:19.086 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.086 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.086 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.087 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.087 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920880+0000", 2020-11-16T20:58:19.087 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.087 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.087 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.087 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.087 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920880+0000", 2020-11-16T20:58:19.088 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1866000000000003e-05 2020-11-16T20:58:19.088 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.088 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.088 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.088 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920912+0000", 2020-11-16T20:58:19.088 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5809999999999996e-06 2020-11-16T20:58:19.088 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.089 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.089 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.089 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920918+0000", 2020-11-16T20:58:19.089 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1153e-05 2020-11-16T20:58:19.089 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.089 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.089 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.089 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920929+0000", 2020-11-16T20:58:19.090 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3329999999999998e-06 2020-11-16T20:58:19.090 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.090 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.090 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.090 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920933+0000", 2020-11-16T20:58:19.090 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0123000000000002e-05 2020-11-16T20:58:19.090 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.091 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.091 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.091 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920973+0000", 2020-11-16T20:58:19.091 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6750999999999998e-05 2020-11-16T20:58:19.091 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.091 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.091 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.092 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.921000+0000", 2020-11-16T20:58:19.092 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000119807 2020-11-16T20:58:19.092 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.092 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.092 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.092 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.092 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.093 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3991 4.0 4:0152ee23:::smithi16641208-350:head [sparse-read 0~3865643,omap-get-vals-by-keys in=4b,omap-get-keys in=12b,omap-get-vals in=16b,omap-get-header,getxattrs] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e164)", 2020-11-16T20:58:19.093 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.897688+0000", 2020-11-16T20:58:19.093 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.1514537569999996, 2020-11-16T20:58:19.093 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1517386050000002, 2020-11-16T20:58:19.093 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.093 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:19.093 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.093 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.094 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.094 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3991 2020-11-16T20:58:19.094 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.094 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.094 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.094 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.094 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897688+0000", 2020-11-16T20:58:19.095 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.095 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.095 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.095 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.095 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897688+0000", 2020-11-16T20:58:19.095 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9966000000000002e-05 2020-11-16T20:58:19.095 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.096 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.096 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.096 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897738+0000", 2020-11-16T20:58:19.096 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.7780000000000002e-06 2020-11-16T20:58:19.096 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.096 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.096 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.097 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897748+0000", 2020-11-16T20:58:19.097 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5574e-05 2020-11-16T20:58:19.097 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.097 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.097 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.097 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897763+0000", 2020-11-16T20:58:19.097 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1400000000000006e-06 2020-11-16T20:58:19.098 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.098 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.098 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.098 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897772+0000", 2020-11-16T20:58:19.098 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8206000000000003e-05 2020-11-16T20:58:19.098 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.098 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.099 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.099 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897851+0000", 2020-11-16T20:58:19.099 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9283000000000002e-05 2020-11-16T20:58:19.099 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.099 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.099 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:19.099 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897870+0000", 2020-11-16T20:58:19.099 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010422219 2020-11-16T20:58:19.100 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.100 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.100 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.100 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.908292+0000", 2020-11-16T20:58:19.100 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1711999999999995e-05 2020-11-16T20:58:19.100 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.100 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.101 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.101 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.908354+0000", 2020-11-16T20:58:19.101 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010665878 2020-11-16T20:58:19.101 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.101 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.101 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.101 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.102 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.102 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3992 4.0 4:0152ee23:::smithi16641208-350:head [read 0~3865643,checksum in=4b] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e164)", 2020-11-16T20:58:19.102 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.897819+0000", 2020-11-16T20:58:19.102 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.1513229279999999, 2020-11-16T20:58:19.102 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1516514969999996, 2020-11-16T20:58:19.102 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.102 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:19.103 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.103 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.103 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.103 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3992 2020-11-16T20:58:19.103 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.103 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.103 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.104 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.104 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897819+0000", 2020-11-16T20:58:19.104 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.104 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.104 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.104 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.104 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897819+0000", 2020-11-16T20:58:19.104 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4625e-05 2020-11-16T20:58:19.105 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.105 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.105 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.105 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897873+0000", 2020-11-16T20:58:19.105 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5899999999999996e-06 2020-11-16T20:58:19.105 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.105 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.106 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.106 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897880+0000", 2020-11-16T20:58:19.106 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2564e-05 2020-11-16T20:58:19.106 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.106 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.106 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.106 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897893+0000", 2020-11-16T20:58:19.107 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8490000000000002e-06 2020-11-16T20:58:19.107 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.107 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.107 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.107 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897898+0000", 2020-11-16T20:58:19.107 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.231e-05 2020-11-16T20:58:19.107 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.108 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.108 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.108 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897941+0000", 2020-11-16T20:58:19.108 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3270000000000007e-06 2020-11-16T20:58:19.108 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.108 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.108 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:19.108 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897950+0000", 2020-11-16T20:58:19.109 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010996924999999999 2020-11-16T20:58:19.109 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.109 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.109 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.109 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.908947+0000", 2020-11-16T20:58:19.109 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6814000000000002e-05 2020-11-16T20:58:19.109 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.110 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.110 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.110 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909004+0000", 2020-11-16T20:58:19.110 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011185004 2020-11-16T20:58:19.110 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.110 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.110 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.111 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.111 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.111 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3993 4.0 4:0152ee23:::smithi16641208-350:head [sparse-read 0~3865643] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e164)", 2020-11-16T20:58:19.111 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.897944+0000", 2020-11-16T20:58:19.111 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.1511975850000002, 2020-11-16T20:58:19.111 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1515683110000001, 2020-11-16T20:58:19.111 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.111 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:19.112 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.112 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.112 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.112 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3993 2020-11-16T20:58:19.112 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.112 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.112 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.113 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897944+0000", 2020-11-16T20:58:19.113 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.113 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.113 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.113 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.113 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897944+0000", 2020-11-16T20:58:19.114 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6337999999999997e-05 2020-11-16T20:58:19.114 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.114 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.114 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.114 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897980+0000", 2020-11-16T20:58:19.114 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9330000000000004e-06 2020-11-16T20:58:19.114 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.115 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.115 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.115 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897987+0000", 2020-11-16T20:58:19.115 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.224e-05 2020-11-16T20:58:19.115 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.115 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.115 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.115 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898000+0000", 2020-11-16T20:58:19.116 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0040999999999999e-05 2020-11-16T20:58:19.116 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.116 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.116 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.116 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898010+0000", 2020-11-16T20:58:19.116 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0834000000000002e-05 2020-11-16T20:58:19.116 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.117 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.117 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.117 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898061+0000", 2020-11-16T20:58:19.117 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3489000000000001e-05 2020-11-16T20:58:19.117 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.117 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.117 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:19.118 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898074+0000", 2020-11-16T20:58:19.118 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011038678999999999 2020-11-16T20:58:19.118 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.118 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.118 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.118 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909113+0000", 2020-11-16T20:58:19.118 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3149000000000003e-05 2020-11-16T20:58:19.119 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.119 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.119 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.119 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909156+0000", 2020-11-16T20:58:19.119 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011211703 2020-11-16T20:58:19.119 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.119 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.119 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.120 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.120 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.120 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4015 4.0 4:2e5644f4:::smithi16641208-410:head [write 598514~729274 in=729274b,stat] snapc 74=[74,73,61] ondisk+write+known_if_redirected e164)", 2020-11-16T20:58:19.120 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.898056+0000", 2020-11-16T20:58:19.120 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.1510859680000003, 2020-11-16T20:58:19.120 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1514992209999999, 2020-11-16T20:58:19.120 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.121 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:19.121 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.121 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.121 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.121 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4015 2020-11-16T20:58:19.121 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.121 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.122 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.122 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.122 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898056+0000", 2020-11-16T20:58:19.122 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.122 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.122 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.122 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.123 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898056+0000", 2020-11-16T20:58:19.123 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00060280000000000002 2020-11-16T20:58:19.123 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.123 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.123 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.123 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898659+0000", 2020-11-16T20:58:19.123 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9290000000000004e-06 2020-11-16T20:58:19.123 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.124 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.124 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.124 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898667+0000", 2020-11-16T20:58:19.124 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8614000000000002e-05 2020-11-16T20:58:19.124 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.124 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.124 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.125 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898686+0000", 2020-11-16T20:58:19.125 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1258e-05 2020-11-16T20:58:19.125 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.125 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.125 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.125 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898697+0000", 2020-11-16T20:58:19.125 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6267000000000002e-05 2020-11-16T20:58:19.126 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.126 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.126 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.126 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898754+0000", 2020-11-16T20:58:19.126 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1922e-05 2020-11-16T20:58:19.126 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.126 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.126 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:19.127 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898766+0000", 2020-11-16T20:58:19.127 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010430432999999999 2020-11-16T20:58:19.127 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.127 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.127 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.127 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909196+0000", 2020-11-16T20:58:19.127 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9072999999999997e-05 2020-11-16T20:58:19.128 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.128 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.128 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.128 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909235+0000", 2020-11-16T20:58:19.128 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011179296 2020-11-16T20:58:19.128 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.128 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.129 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.129 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.129 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.129 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4016 4.0 4:2e5644f4:::smithi16641208-410:head [write 1746124~597229 in=597229b] snapc 74=[74,73,61] ondisk+write+known_if_redirected e164)", 2020-11-16T20:58:19.129 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.898743+0000", 2020-11-16T20:58:19.129 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.1503982559999999, 2020-11-16T20:58:19.129 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1508537390000004, 2020-11-16T20:58:19.129 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.130 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:19.130 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.130 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.130 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.130 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4016 2020-11-16T20:58:19.130 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.130 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.131 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.131 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.131 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898743+0000", 2020-11-16T20:58:19.131 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.131 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.131 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.131 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.132 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898743+0000", 2020-11-16T20:58:19.132 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00046414699999999999 2020-11-16T20:58:19.132 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.132 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.132 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.132 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899208+0000", 2020-11-16T20:58:19.132 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9149999999999996e-06 2020-11-16T20:58:19.133 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.133 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.133 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.133 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899216+0000", 2020-11-16T20:58:19.133 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5268999999999999e-05 2020-11-16T20:58:19.133 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.133 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.133 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.134 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899231+0000", 2020-11-16T20:58:19.134 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1559999999999998e-06 2020-11-16T20:58:19.134 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.134 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.134 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.134 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899238+0000", 2020-11-16T20:58:19.134 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2649999999999999e-05 2020-11-16T20:58:19.135 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.135 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.135 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.135 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899291+0000", 2020-11-16T20:58:19.135 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1956e-05 2020-11-16T20:58:19.135 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.135 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.136 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:19.136 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899303+0000", 2020-11-16T20:58:19.136 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0099621889999999998 2020-11-16T20:58:19.136 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.136 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.136 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.136 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909265+0000", 2020-11-16T20:58:19.136 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7721e-05 2020-11-16T20:58:19.137 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.137 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.137 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.137 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909302+0000", 2020-11-16T20:58:19.137 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010559003000000001 2020-11-16T20:58:19.137 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.137 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.138 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.138 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.138 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.138 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4017 4.0 4:2e5644f4:::smithi16641208-410:head [write 3128235~514953 in=514953b] snapc 74=[74,73,61] ondisk+write+known_if_redirected e164)", 2020-11-16T20:58:19.138 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.899277+0000", 2020-11-16T20:58:19.138 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.1498644000000002, 2020-11-16T20:58:19.138 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1503625419999999, 2020-11-16T20:58:19.139 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.139 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:19.139 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.139 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.139 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.139 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4017 2020-11-16T20:58:19.139 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.140 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.140 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.140 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.140 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899277+0000", 2020-11-16T20:58:19.140 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.140 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.140 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.140 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.141 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899277+0000", 2020-11-16T20:58:19.141 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00040012100000000003 2020-11-16T20:58:19.141 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.141 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.141 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.141 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899677+0000", 2020-11-16T20:58:19.141 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.0399999999999993e-06 2020-11-16T20:58:19.142 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.142 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.142 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.142 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899685+0000", 2020-11-16T20:58:19.142 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1985e-05 2020-11-16T20:58:19.142 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.142 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.143 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.143 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899697+0000", 2020-11-16T20:58:19.143 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.72e-06 2020-11-16T20:58:19.143 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.143 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.143 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.143 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899704+0000", 2020-11-16T20:58:19.143 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3680000000000001e-05 2020-11-16T20:58:19.144 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.144 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.144 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.144 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899758+0000", 2020-11-16T20:58:19.144 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2514000000000001e-05 2020-11-16T20:58:19.144 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.144 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.145 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:19.145 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899770+0000", 2020-11-16T20:58:19.145 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0095684949999999998 2020-11-16T20:58:19.145 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.145 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.145 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.145 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909339+0000", 2020-11-16T20:58:19.145 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5496e-05 2020-11-16T20:58:19.146 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.146 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.146 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.146 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909374+0000", 2020-11-16T20:58:19.146 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010097050999999999 2020-11-16T20:58:19.146 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.146 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.147 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.147 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.147 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.147 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4018 4.0 4:2e5644f4:::smithi16641208-410:head [setxattr _header (58) in=65b,truncate 3798514] snapc 74=[74,73,61] ondisk+write+known_if_redirected e164)", 2020-11-16T20:58:19.147 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.899746+0000", 2020-11-16T20:58:19.147 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 5.1493955570000001, 2020-11-16T20:58:19.147 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1499370799999999, 2020-11-16T20:58:19.148 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.148 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:19.148 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.148 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.148 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.148 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4018 2020-11-16T20:58:19.148 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.149 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.149 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.149 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.149 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899746+0000", 2020-11-16T20:58:19.149 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.149 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.149 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.150 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.150 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899746+0000", 2020-11-16T20:58:19.150 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3548999999999999e-05 2020-11-16T20:58:19.150 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.150 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.150 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.150 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899790+0000", 2020-11-16T20:58:19.151 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2519999999999996e-06 2020-11-16T20:58:19.151 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.151 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.151 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.151 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899796+0000", 2020-11-16T20:58:19.151 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0695e-05 2020-11-16T20:58:19.151 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.152 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.152 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.152 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899807+0000", 2020-11-16T20:58:19.152 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5749000000000001e-05 2020-11-16T20:58:19.152 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.152 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.152 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.152 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899822+0000", 2020-11-16T20:58:19.153 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1319999999999997e-05 2020-11-16T20:58:19.153 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.153 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.153 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.153 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899864+0000", 2020-11-16T20:58:19.153 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0456e-05 2020-11-16T20:58:19.153 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.154 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.154 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:19.154 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899874+0000", 2020-11-16T20:58:19.154 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0095292060000000001 2020-11-16T20:58:19.154 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.154 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.154 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.155 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909403+0000", 2020-11-16T20:58:19.155 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7051000000000002e-05 2020-11-16T20:58:19.155 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.155 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.155 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.155 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909440+0000", 2020-11-16T20:58:19.155 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0096942780000000006 2020-11-16T20:58:19.155 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.156 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.156 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.156 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.156 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:58:19.156 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 13 2020-11-16T20:58:19.156 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:19.158 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:58:19.158 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:19.161+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:19.259 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:19.263+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:19.285 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:19.285 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:58:19.285 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:58:19.285 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:58:19.286 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:19.294 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:58:19.360 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:58:19.364+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:58:19.422 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:19.423 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:58:19.423 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:58:19.423 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:58:19.423 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.423 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2979 4.0 4:1852173c:::smithi16641208-329:head [write 581674~637746,stat] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:19.423 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:58:19.424 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 90.622377807999996, 2020-11-16T20:58:19.424 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.009457398, 2020-11-16T20:58:19.424 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.424 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:19.424 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.424 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.425 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.425 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2979 2020-11-16T20:58:19.425 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.425 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.425 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.425 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.425 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:58:19.426 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.426 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.426 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.426 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.426 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:58:19.426 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030732300000000003 2020-11-16T20:58:19.426 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.427 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.427 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.427 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803965+0000", 2020-11-16T20:58:19.427 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0319999999999992e-06 2020-11-16T20:58:19.427 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.427 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.427 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.428 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803974+0000", 2020-11-16T20:58:19.428 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5930000000000002e-05 2020-11-16T20:58:19.428 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.428 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.428 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.428 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803990+0000", 2020-11-16T20:58:19.428 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1910000000000006e-06 2020-11-16T20:58:19.429 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.429 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.429 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.429 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803999+0000", 2020-11-16T20:58:19.429 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5637000000000003e-05 2020-11-16T20:58:19.429 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.430 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.430 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.430 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.804055+0000", 2020-11-16T20:58:19.430 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3769000000000001e-05 2020-11-16T20:58:19.430 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.430 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.430 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.431 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.804088+0000", 2020-11-16T20:58:19.431 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.995239140000001 2020-11-16T20:58:19.431 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.431 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.431 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.431 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799328+0000", 2020-11-16T20:58:19.431 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0137818 2020-11-16T20:58:19.432 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.432 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.432 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:19.432 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813109+0000", 2020-11-16T20:58:19.432 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5759999999999996e-06 2020-11-16T20:58:19.432 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.432 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.433 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:19.433 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813115+0000", 2020-11-16T20:58:19.433 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.009457398 2020-11-16T20:58:19.433 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.433 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.433 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.433 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.434 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.434 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2980 4.0 4:1852173c:::smithi16641208-329:head [write 1840873~558854] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:19.434 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:58:19.434 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 90.616112075999993, 2020-11-16T20:58:19.434 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.039347508000001, 2020-11-16T20:58:19.434 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.434 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:19.435 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.435 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.435 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.435 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2980 2020-11-16T20:58:19.435 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.435 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.435 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.436 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.436 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:58:19.436 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.436 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.436 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.436 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.436 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:58:19.437 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024810899999999999 2020-11-16T20:58:19.437 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.437 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.437 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.437 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810171+0000", 2020-11-16T20:58:19.437 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5610000000000001e-06 2020-11-16T20:58:19.437 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.438 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.438 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.438 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810179+0000", 2020-11-16T20:58:19.438 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7418000000000002e-05 2020-11-16T20:58:19.438 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.438 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.439 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.439 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810196+0000", 2020-11-16T20:58:19.439 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0079999999999996e-06 2020-11-16T20:58:19.439 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.439 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.439 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.439 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810203+0000", 2020-11-16T20:58:19.440 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3705000000000002e-05 2020-11-16T20:58:19.440 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.440 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.440 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.440 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810257+0000", 2020-11-16T20:58:19.440 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3656999999999998e-05 2020-11-16T20:58:19.440 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.441 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.441 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.441 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810311+0000", 2020-11-16T20:58:19.441 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.989427508 2020-11-16T20:58:19.441 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.441 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.441 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.442 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799738+0000", 2020-11-16T20:58:19.442 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2526000000000003e-05 2020-11-16T20:58:19.442 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.442 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.442 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:19.442 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799811+0000", 2020-11-16T20:58:19.442 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027934184000000001 2020-11-16T20:58:19.443 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.443 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.443 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.443 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827745+0000", 2020-11-16T20:58:19.443 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015776700000000001 2020-11-16T20:58:19.443 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.443 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.444 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:19.444 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827903+0000", 2020-11-16T20:58:19.444 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000185539 2020-11-16T20:58:19.444 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.444 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.444 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:19.444 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.828088+0000", 2020-11-16T20:58:19.445 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018143857999999999 2020-11-16T20:58:19.445 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.445 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.445 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:19.445 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846232+0000", 2020-11-16T20:58:19.445 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00074682199999999996 2020-11-16T20:58:19.445 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.446 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.446 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:19.446 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846979+0000", 2020-11-16T20:58:19.446 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021617530000000002 2020-11-16T20:58:19.446 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.446 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.446 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:19.447 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849141+0000", 2020-11-16T20:58:19.447 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4513999999999998e-05 2020-11-16T20:58:19.447 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.447 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.447 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:19.447 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849215+0000", 2020-11-16T20:58:19.447 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5578999999999998e-05 2020-11-16T20:58:19.448 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.448 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.448 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:19.448 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849271+0000", 2020-11-16T20:58:19.448 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.039347508000001 2020-11-16T20:58:19.448 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.448 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.449 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.449 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.449 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.449 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2981 4.0 4:1852173c:::smithi16641208-329:head [write 3066417~537135] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:19.449 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:58:19.449 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 90.609195779000004, 2020-11-16T20:58:19.449 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.032910677, 2020-11-16T20:58:19.450 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.450 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:19.450 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.450 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.450 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.450 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2981 2020-11-16T20:58:19.451 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.451 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.451 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.451 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.451 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:58:19.451 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.451 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.452 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.452 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.452 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:58:19.452 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024974099999999999 2020-11-16T20:58:19.452 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.452 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.452 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.453 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817089+0000", 2020-11-16T20:58:19.453 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3829999999999992e-06 2020-11-16T20:58:19.453 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.453 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.453 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.453 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817098+0000", 2020-11-16T20:58:19.453 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2118e-05 2020-11-16T20:58:19.454 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.454 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.454 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.454 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817110+0000", 2020-11-16T20:58:19.454 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6050000000000004e-06 2020-11-16T20:58:19.454 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.454 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.455 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.455 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817119+0000", 2020-11-16T20:58:19.455 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7204000000000003e-05 2020-11-16T20:58:19.455 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.455 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.455 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.455 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817177+0000", 2020-11-16T20:58:19.456 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9932999999999998e-05 2020-11-16T20:58:19.456 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.456 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.456 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.456 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817227+0000", 2020-11-16T20:58:19.456 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.98265286 2020-11-16T20:58:19.456 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.457 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.457 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.457 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799879+0000", 2020-11-16T20:58:19.457 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.737e-05 2020-11-16T20:58:19.457 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.457 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.457 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:19.458 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799947+0000", 2020-11-16T20:58:19.458 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029940584999999999 2020-11-16T20:58:19.458 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.458 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.458 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.458 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.829887+0000", 2020-11-16T20:58:19.458 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000217505 2020-11-16T20:58:19.459 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.459 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.459 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:19.459 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.830105+0000", 2020-11-16T20:58:19.459 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029022100000000001 2020-11-16T20:58:19.459 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.459 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.460 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:19.460 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.830395+0000", 2020-11-16T20:58:19.460 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015847953000000001 2020-11-16T20:58:19.460 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.460 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.460 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:19.460 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846243+0000", 2020-11-16T20:58:19.461 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0011558250000000001 2020-11-16T20:58:19.461 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.461 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.461 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:19.461 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847399+0000", 2020-11-16T20:58:19.461 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021524500000000002 2020-11-16T20:58:19.461 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.462 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.462 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:19.462 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849551+0000", 2020-11-16T20:58:19.462 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000138787 2020-11-16T20:58:19.462 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.462 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.462 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:19.463 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849690+0000", 2020-11-16T20:58:19.463 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0136999999999997e-05 2020-11-16T20:58:19.463 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.463 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.463 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:19.463 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849750+0000", 2020-11-16T20:58:19.463 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.032910677 2020-11-16T20:58:19.464 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.464 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.464 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.464 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.464 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.464 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2982 4.0 4:1852173c:::smithi16641208-329:head [setxattr _header (58) in=7b,truncate 3781674] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:19.464 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:58:19.465 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 90.608877464000003, 2020-11-16T20:58:19.465 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.035208633, 2020-11-16T20:58:19.465 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.465 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:19.465 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.465 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.465 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.466 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2982 2020-11-16T20:58:19.466 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.466 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.466 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.466 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.466 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:58:19.466 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.467 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.467 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.467 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.467 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:58:19.467 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8856000000000002e-05 2020-11-16T20:58:19.467 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.467 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.468 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.468 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817197+0000", 2020-11-16T20:58:19.468 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.93e-06 2020-11-16T20:58:19.468 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.468 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.468 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.468 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817203+0000", 2020-11-16T20:58:19.469 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0932e-05 2020-11-16T20:58:19.469 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.469 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.469 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.469 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817214+0000", 2020-11-16T20:58:19.469 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3470000000000001e-06 2020-11-16T20:58:19.469 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.470 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.470 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.470 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817218+0000", 2020-11-16T20:58:19.470 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4603e-05 2020-11-16T20:58:19.470 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.470 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.471 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.471 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817263+0000", 2020-11-16T20:58:19.471 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6387000000000002e-05 2020-11-16T20:58:19.471 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.471 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.471 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.471 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817309+0000", 2020-11-16T20:58:19.472 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.982698653 2020-11-16T20:58:19.472 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.472 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.472 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.472 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800008+0000", 2020-11-16T20:58:19.472 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5400000000000004e-05 2020-11-16T20:58:19.472 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.473 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.473 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:19.473 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800073+0000", 2020-11-16T20:58:19.473 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.044932818999999999 2020-11-16T20:58:19.473 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.473 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.473 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.474 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845006+0000", 2020-11-16T20:58:19.474 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017285099999999999 2020-11-16T20:58:19.474 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.474 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.474 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:19.474 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845179+0000", 2020-11-16T20:58:19.474 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023420900000000001 2020-11-16T20:58:19.475 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.475 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.475 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:19.475 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845413+0000", 2020-11-16T20:58:19.475 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0020276000000000001 2020-11-16T20:58:19.475 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.475 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.476 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:19.476 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847441+0000", 2020-11-16T20:58:19.476 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00050358800000000002 2020-11-16T20:58:19.476 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.476 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.476 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:19.476 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847944+0000", 2020-11-16T20:58:19.477 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042758900000000001 2020-11-16T20:58:19.477 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.477 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.477 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:19.477 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852220+0000", 2020-11-16T20:58:19.477 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9648999999999997e-05 2020-11-16T20:58:19.477 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.478 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.478 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:19.478 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852290+0000", 2020-11-16T20:58:19.478 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6919e-05 2020-11-16T20:58:19.478 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.478 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.478 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:19.479 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852367+0000", 2020-11-16T20:58:19.479 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.035208633 2020-11-16T20:58:19.479 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.479 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.479 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.479 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.479 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.480 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2983 4.0 4:1852173c:::smithi16641208-329:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e86)", 2020-11-16T20:58:19.480 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:58:19.480 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 90.608786996999996, 2020-11-16T20:58:19.480 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.037016812999999, 2020-11-16T20:58:19.480 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.480 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:19.480 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.481 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.481 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.481 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2983 2020-11-16T20:58:19.481 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.481 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.481 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.481 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.482 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:58:19.482 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.482 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.482 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.482 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.482 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:58:19.483 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7317999999999999e-05 2020-11-16T20:58:19.483 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.483 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.483 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.483 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817266+0000", 2020-11-16T20:58:19.483 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3519999999999998e-06 2020-11-16T20:58:19.483 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.484 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.484 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.484 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817269+0000", 2020-11-16T20:58:19.484 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7859999999999999e-06 2020-11-16T20:58:19.484 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.484 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.484 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.485 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817276+0000", 2020-11-16T20:58:19.485 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5620000000000002e-06 2020-11-16T20:58:19.485 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.485 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.485 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.485 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817278+0000", 2020-11-16T20:58:19.485 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3251999999999996e-05 2020-11-16T20:58:19.486 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.486 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.486 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.486 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817352+0000", 2020-11-16T20:58:19.486 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7966000000000001e-05 2020-11-16T20:58:19.486 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.486 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.487 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.487 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817400+0000", 2020-11-16T20:58:19.487 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.982734203 2020-11-16T20:58:19.487 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.487 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.487 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.487 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800134+0000", 2020-11-16T20:58:19.488 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9765999999999997e-05 2020-11-16T20:58:19.488 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.488 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.488 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:19.488 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800194+0000", 2020-11-16T20:58:19.488 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.046087276000000003 2020-11-16T20:58:19.488 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.489 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.489 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.489 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846281+0000", 2020-11-16T20:58:19.489 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000115396 2020-11-16T20:58:19.489 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.489 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.489 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:19.490 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846396+0000", 2020-11-16T20:58:19.490 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006004573 2020-11-16T20:58:19.490 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.490 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.490 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.490 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852401+0000", 2020-11-16T20:58:19.491 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013211599999999999 2020-11-16T20:58:19.491 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.491 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.491 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:19.491 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852533+0000", 2020-11-16T20:58:19.491 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0017322469999999999 2020-11-16T20:58:19.491 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.492 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.492 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:19.492 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.854265+0000", 2020-11-16T20:58:19.492 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.037016812999999 2020-11-16T20:58:19.492 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.492 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.492 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.493 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.493 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.493 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2984 4.0 4:033219d6:::smithi16641208-386:head [write 598481~712995,stat] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:19.493 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:58:19.493 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 90.601727155000006, 2020-11-16T20:58:19.493 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.003104742, 2020-11-16T20:58:19.493 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.494 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:19.494 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.494 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.494 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.494 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2984 2020-11-16T20:58:19.494 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.494 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.495 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.495 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.495 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:58:19.495 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.495 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.495 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.495 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.496 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:58:19.496 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00037173000000000002 2020-11-16T20:58:19.496 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.496 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.496 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.496 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824680+0000", 2020-11-16T20:58:19.496 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.146e-05 2020-11-16T20:58:19.497 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.497 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.497 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.497 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824691+0000", 2020-11-16T20:58:19.497 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6951000000000001e-05 2020-11-16T20:58:19.497 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.497 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.498 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.498 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824708+0000", 2020-11-16T20:58:19.498 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2082000000000001e-05 2020-11-16T20:58:19.498 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.498 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.498 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.498 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824720+0000", 2020-11-16T20:58:19.499 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0284000000000002e-05 2020-11-16T20:58:19.499 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.499 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.499 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.499 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824771+0000", 2020-11-16T20:58:19.499 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1241000000000001e-05 2020-11-16T20:58:19.499 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.500 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.500 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.500 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824802+0000", 2020-11-16T20:58:19.500 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.975455838 2020-11-16T20:58:19.500 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.500 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.500 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.501 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800258+0000", 2020-11-16T20:58:19.501 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027151194999999999 2020-11-16T20:58:19.501 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.501 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.501 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:19.501 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827409+0000", 2020-11-16T20:58:19.501 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9609999999999999e-06 2020-11-16T20:58:19.502 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.502 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.502 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:19.502 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827413+0000", 2020-11-16T20:58:19.502 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.003104742 2020-11-16T20:58:19.502 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.502 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.503 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.503 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.503 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.503 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2985 4.0 4:033219d6:::smithi16641208-386:head [write 1899355~418865] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:19.503 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:58:19.503 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 90.596115873000002, 2020-11-16T20:58:19.504 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.021091737000001, 2020-11-16T20:58:19.504 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.504 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:19.504 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.504 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.504 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.504 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2985 2020-11-16T20:58:19.505 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.505 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.505 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.505 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.505 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:58:19.505 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.505 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.506 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.506 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.506 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:58:19.506 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023221799999999999 2020-11-16T20:58:19.506 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.506 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.506 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.507 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830152+0000", 2020-11-16T20:58:19.507 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9769999999999995e-06 2020-11-16T20:58:19.507 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.507 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.507 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.507 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830162+0000", 2020-11-16T20:58:19.507 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5545000000000001e-05 2020-11-16T20:58:19.508 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.508 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.508 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.508 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830177+0000", 2020-11-16T20:58:19.508 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0334e-05 2020-11-16T20:58:19.508 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.508 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.509 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.509 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830188+0000", 2020-11-16T20:58:19.509 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3430999999999996e-05 2020-11-16T20:58:19.509 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.509 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.509 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.509 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830251+0000", 2020-11-16T20:58:19.510 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2651999999999997e-05 2020-11-16T20:58:19.510 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.510 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.510 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.510 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830304+0000", 2020-11-16T20:58:19.510 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.970289857999999 2020-11-16T20:58:19.510 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.511 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.511 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.511 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800594+0000", 2020-11-16T20:58:19.511 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8948999999999993e-05 2020-11-16T20:58:19.511 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.511 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.511 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:19.512 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800663+0000", 2020-11-16T20:58:19.512 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036018513000000002 2020-11-16T20:58:19.512 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.512 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.512 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.512 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836681+0000", 2020-11-16T20:58:19.512 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013201099999999999 2020-11-16T20:58:19.513 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.513 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.513 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:19.513 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836813+0000", 2020-11-16T20:58:19.513 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000126635 2020-11-16T20:58:19.513 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.513 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.514 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:19.514 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836940+0000", 2020-11-16T20:58:19.514 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010477907 2020-11-16T20:58:19.514 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.514 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.514 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:19.514 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847418+0000", 2020-11-16T20:58:19.515 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000158796 2020-11-16T20:58:19.515 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.515 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.515 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:19.515 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847576+0000", 2020-11-16T20:58:19.515 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033023729999999999 2020-11-16T20:58:19.515 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.516 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.516 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:19.516 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850879+0000", 2020-11-16T20:58:19.516 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6360999999999996e-05 2020-11-16T20:58:19.516 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.516 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.516 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:19.517 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850955+0000", 2020-11-16T20:58:19.517 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6177000000000001e-05 2020-11-16T20:58:19.517 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.517 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.517 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:19.517 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851011+0000", 2020-11-16T20:58:19.517 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.021091737000001 2020-11-16T20:58:19.518 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.518 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.518 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.518 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.518 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.518 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2986 4.0 4:033219d6:::smithi16641208-386:head [write 3093840~704641] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:19.518 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:58:19.519 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 90.587890170999998, 2020-11-16T20:58:19.519 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013155362999999, 2020-11-16T20:58:19.519 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.519 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:19.519 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.519 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.519 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.520 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2986 2020-11-16T20:58:19.520 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.520 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.520 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.520 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.520 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:58:19.520 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.521 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.521 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.521 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.521 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:58:19.521 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00038247200000000002 2020-11-16T20:58:19.521 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.521 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.522 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.522 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838528+0000", 2020-11-16T20:58:19.522 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3299999999999999e-06 2020-11-16T20:58:19.522 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.522 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.522 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.522 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838536+0000", 2020-11-16T20:58:19.523 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3438000000000001e-05 2020-11-16T20:58:19.523 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.523 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.523 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.523 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838549+0000", 2020-11-16T20:58:19.523 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0213e-05 2020-11-16T20:58:19.523 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.524 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.524 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.524 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838560+0000", 2020-11-16T20:58:19.524 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1894999999999997e-05 2020-11-16T20:58:19.524 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.524 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.524 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.525 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838612+0000", 2020-11-16T20:58:19.525 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8209e-05 2020-11-16T20:58:19.525 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.525 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.525 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.525 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838650+0000", 2020-11-16T20:58:19.525 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962061715000001 2020-11-16T20:58:19.526 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.526 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.526 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.526 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800712+0000", 2020-11-16T20:58:19.526 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6964e-05 2020-11-16T20:58:19.526 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.526 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.527 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:19.527 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800748+0000", 2020-11-16T20:58:19.527 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037209265999999998 2020-11-16T20:58:19.527 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.527 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.527 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.527 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.837958+0000", 2020-11-16T20:58:19.528 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000160304 2020-11-16T20:58:19.528 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.528 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.528 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:19.528 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.838118+0000", 2020-11-16T20:58:19.528 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022362799999999999 2020-11-16T20:58:19.528 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.529 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.529 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:19.529 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.838342+0000", 2020-11-16T20:58:19.529 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0090844710000000002 2020-11-16T20:58:19.529 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.529 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.529 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:19.530 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847426+0000", 2020-11-16T20:58:19.530 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000219199 2020-11-16T20:58:19.530 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.530 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.530 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:19.530 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847645+0000", 2020-11-16T20:58:19.530 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003411603 2020-11-16T20:58:19.531 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.531 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.531 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:19.531 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851057+0000", 2020-11-16T20:58:19.531 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014736799999999999 2020-11-16T20:58:19.531 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.531 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.532 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:19.532 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851204+0000", 2020-11-16T20:58:19.532 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6287999999999997e-05 2020-11-16T20:58:19.532 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.532 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.532 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:19.532 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851301+0000", 2020-11-16T20:58:19.533 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013155362999999 2020-11-16T20:58:19.533 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.533 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.533 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.533 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.533 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.533 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2987 4.0 4:033219d6:::smithi16641208-386:head [setxattr _header (58) in=7b,truncate 3798481] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:19.534 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:58:19.534 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 90.587431531999997, 2020-11-16T20:58:19.534 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.012971041, 2020-11-16T20:58:19.534 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.534 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:19.534 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.535 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.535 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.535 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2987 2020-11-16T20:58:19.535 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.535 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.535 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.535 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.536 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:58:19.536 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.536 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.536 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.536 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.536 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:58:19.536 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4530000000000002e-05 2020-11-16T20:58:19.537 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.537 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.537 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.537 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838648+0000", 2020-11-16T20:58:19.537 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8390000000000001e-06 2020-11-16T20:58:19.537 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.537 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.538 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.538 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838655+0000", 2020-11-16T20:58:19.538 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0341e-05 2020-11-16T20:58:19.538 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.538 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.538 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.538 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838666+0000", 2020-11-16T20:58:19.539 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0929999999999999e-06 2020-11-16T20:58:19.539 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.539 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.539 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.539 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838672+0000", 2020-11-16T20:58:19.539 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8074999999999997e-05 2020-11-16T20:58:19.539 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.540 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.540 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.540 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838710+0000", 2020-11-16T20:58:19.540 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1121000000000002e-05 2020-11-16T20:58:19.540 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.540 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.540 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.541 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838751+0000", 2020-11-16T20:58:19.541 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962044797000001 2020-11-16T20:58:19.541 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.541 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.541 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.541 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800796+0000", 2020-11-16T20:58:19.541 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6808999999999998e-05 2020-11-16T20:58:19.542 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.542 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.542 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:19.542 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800852+0000", 2020-11-16T20:58:19.542 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042964599999999999 2020-11-16T20:58:19.542 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.542 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.543 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.543 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843817+0000", 2020-11-16T20:58:19.543 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017807899999999999 2020-11-16T20:58:19.543 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.543 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.543 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:19.543 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843995+0000", 2020-11-16T20:58:19.544 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023680500000000001 2020-11-16T20:58:19.544 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.544 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.544 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:19.544 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844232+0000", 2020-11-16T20:58:19.544 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00320163 2020-11-16T20:58:19.544 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.545 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.545 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:19.545 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847434+0000", 2020-11-16T20:58:19.545 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00042527899999999998 2020-11-16T20:58:19.545 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.545 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.545 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:19.546 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847859+0000", 2020-11-16T20:58:19.546 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0034987920000000001 2020-11-16T20:58:19.546 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.546 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.546 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:19.546 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851358+0000", 2020-11-16T20:58:19.546 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014067300000000001 2020-11-16T20:58:19.547 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.547 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.547 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:19.547 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851498+0000", 2020-11-16T20:58:19.547 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6577999999999998e-05 2020-11-16T20:58:19.547 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.547 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.548 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:19.548 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851575+0000", 2020-11-16T20:58:19.548 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.012971041 2020-11-16T20:58:19.548 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.548 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.548 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.548 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.549 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.549 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2988 4.0 4:033219d6:::smithi16641208-386:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e86)", 2020-11-16T20:58:19.549 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:58:19.549 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 90.587329033000003, 2020-11-16T20:58:19.549 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013229791000001, 2020-11-16T20:58:19.549 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.549 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:19.550 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.550 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.550 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.550 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2988 2020-11-16T20:58:19.550 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.550 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.550 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.551 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.551 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:58:19.551 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.551 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.551 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.551 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.551 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:58:19.552 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9252999999999999e-05 2020-11-16T20:58:19.552 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.552 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.552 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.552 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838736+0000", 2020-11-16T20:58:19.552 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3980000000000004e-06 2020-11-16T20:58:19.552 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.553 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.553 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.553 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838742+0000", 2020-11-16T20:58:19.553 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1144999999999999e-05 2020-11-16T20:58:19.553 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.553 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.553 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.554 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838753+0000", 2020-11-16T20:58:19.554 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6229999999999996e-06 2020-11-16T20:58:19.554 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.554 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.554 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.554 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838758+0000", 2020-11-16T20:58:19.554 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5130000000000003e-05 2020-11-16T20:58:19.555 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.555 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.555 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.555 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838803+0000", 2020-11-16T20:58:19.555 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0132000000000001e-05 2020-11-16T20:58:19.555 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.555 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.556 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.556 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838843+0000", 2020-11-16T20:58:19.556 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962066786999999 2020-11-16T20:58:19.556 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.556 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.556 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.556 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800910+0000", 2020-11-16T20:58:19.557 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6925999999999997e-05 2020-11-16T20:58:19.557 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.557 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.557 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:19.557 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800967+0000", 2020-11-16T20:58:19.557 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.043837752000000001 2020-11-16T20:58:19.557 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.558 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.558 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.558 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844805+0000", 2020-11-16T20:58:19.558 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012337000000000001 2020-11-16T20:58:19.558 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.558 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.558 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:19.559 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844928+0000", 2020-11-16T20:58:19.559 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0066885149999999999 2020-11-16T20:58:19.559 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.559 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.559 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.559 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851616+0000", 2020-11-16T20:58:19.559 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5716000000000005e-05 2020-11-16T20:58:19.560 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.560 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.560 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:19.560 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851692+0000", 2020-11-16T20:58:19.560 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024404400000000001 2020-11-16T20:58:19.560 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.560 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.561 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:19.561 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851936+0000", 2020-11-16T20:58:19.561 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013229791000001 2020-11-16T20:58:19.562 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.562 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.562 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.562 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.562 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.562 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2992 4.0 4:0f4a2e46:::smithi16641208-399:head [cache-evict] snapc 0=[] ondisk+read+ignore_cache+known_if_redirected e86)", 2020-11-16T20:58:19.562 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:58:19.563 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 90.587242696000004, 2020-11-16T20:58:19.563 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962433468, 2020-11-16T20:58:19.563 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.563 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:19.563 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.563 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.563 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.564 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2992 2020-11-16T20:58:19.564 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.564 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.564 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.564 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.564 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:58:19.564 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.564 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.565 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.565 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.565 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:58:19.565 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7780000000000002e-05 2020-11-16T20:58:19.565 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.565 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.565 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.566 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838820+0000", 2020-11-16T20:58:19.566 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1200000000000001e-06 2020-11-16T20:58:19.566 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.566 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.566 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.566 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838826+0000", 2020-11-16T20:58:19.566 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0008e-05 2020-11-16T20:58:19.567 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.567 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.567 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.567 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838836+0000", 2020-11-16T20:58:19.567 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3749999999999996e-06 2020-11-16T20:58:19.567 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.567 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.568 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.568 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838840+0000", 2020-11-16T20:58:19.568 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0889000000000002e-05 2020-11-16T20:58:19.568 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.568 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.568 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.568 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838871+0000", 2020-11-16T20:58:19.569 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6891000000000003e-05 2020-11-16T20:58:19.569 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.569 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.569 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.569 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838908+0000", 2020-11-16T20:58:19.569 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962115045999999 2020-11-16T20:58:19.569 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.570 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.570 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.570 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801023+0000", 2020-11-16T20:58:19.570 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020335899999999999 2020-11-16T20:58:19.570 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.570 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.570 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:19.571 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801226+0000", 2020-11-16T20:58:19.571 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962433468 2020-11-16T20:58:19.571 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.571 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.571 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.571 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.571 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.572 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3051 4.0 4:2ceac9f9:::smithi16641208-61:head [write 699323~480842] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:58:19.572 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:58:19.572 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 85.585122389000006, 2020-11-16T20:58:19.572 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9728349610000002, 2020-11-16T20:58:19.572 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.572 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:19.573 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.573 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.573 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.573 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3051 2020-11-16T20:58:19.573 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.573 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.573 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.573 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.574 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:58:19.574 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.574 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.574 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.574 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.575 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:58:19.575 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032526199999999999 2020-11-16T20:58:19.575 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.575 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.575 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.576 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841238+0000", 2020-11-16T20:58:19.576 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9822000000000001e-05 2020-11-16T20:58:19.576 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.576 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.576 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.576 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841258+0000", 2020-11-16T20:58:19.577 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.507e-05 2020-11-16T20:58:19.577 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.577 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.577 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.577 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841273+0000", 2020-11-16T20:58:19.577 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8900000000000007e-06 2020-11-16T20:58:19.577 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.578 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.578 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.578 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841281+0000", 2020-11-16T20:58:19.578 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4356000000000003e-05 2020-11-16T20:58:19.578 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.578 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.578 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.579 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841365+0000", 2020-11-16T20:58:19.579 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0232000000000002e-05 2020-11-16T20:58:19.579 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.579 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.579 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.579 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841426+0000", 2020-11-16T20:58:19.579 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9604309439999996 2020-11-16T20:58:19.580 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.580 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.580 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.580 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801857+0000", 2020-11-16T20:58:19.580 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000164897 2020-11-16T20:58:19.580 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.580 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.581 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:19.581 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.802021+0000", 2020-11-16T20:58:19.581 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020576500000000001 2020-11-16T20:58:19.581 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.581 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.581 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:19.581 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.802227+0000", 2020-11-16T20:58:19.581 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0066237170000000003 2020-11-16T20:58:19.582 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.582 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.582 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:19.582 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808851+0000", 2020-11-16T20:58:19.582 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037712430000000001 2020-11-16T20:58:19.582 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.582 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.583 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:19.583 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812622+0000", 2020-11-16T20:58:19.583 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00099110800000000009 2020-11-16T20:58:19.583 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.583 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.583 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:19.583 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813613+0000", 2020-11-16T20:58:19.584 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1646e-05 2020-11-16T20:58:19.584 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.584 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.584 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:19.584 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813665+0000", 2020-11-16T20:58:19.584 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3009000000000004e-05 2020-11-16T20:58:19.584 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.584 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.585 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:19.585 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813748+0000", 2020-11-16T20:58:19.585 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9728349610000002 2020-11-16T20:58:19.585 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.585 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.585 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.585 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.586 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.586 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3052 4.0 4:2ceac9f9:::smithi16641208-61:head [write 1850247~429872] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:58:19.586 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:58:19.586 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 85.576931349999995, 2020-11-16T20:58:19.586 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9911138360000002, 2020-11-16T20:58:19.586 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.586 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:19.587 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.587 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.587 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.587 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3052 2020-11-16T20:58:19.587 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.587 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.587 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.587 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.588 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:58:19.588 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.588 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.588 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.588 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.588 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:58:19.588 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000296166 2020-11-16T20:58:19.589 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.589 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.589 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.589 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849400+0000", 2020-11-16T20:58:19.589 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0699999999999996e-06 2020-11-16T20:58:19.589 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.589 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.590 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.590 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849409+0000", 2020-11-16T20:58:19.590 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3725e-05 2020-11-16T20:58:19.590 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.590 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.590 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.590 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849423+0000", 2020-11-16T20:58:19.591 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9929999999999998e-06 2020-11-16T20:58:19.591 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.591 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.591 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.591 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849430+0000", 2020-11-16T20:58:19.592 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9708000000000002e-05 2020-11-16T20:58:19.592 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.592 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.592 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.592 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849520+0000", 2020-11-16T20:58:19.592 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2088000000000002e-05 2020-11-16T20:58:19.592 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.593 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.593 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.593 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849552+0000", 2020-11-16T20:58:19.593 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.954526692 2020-11-16T20:58:19.593 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.593 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.593 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.594 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804079+0000", 2020-11-16T20:58:19.594 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015456899999999999 2020-11-16T20:58:19.594 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.594 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.594 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:19.594 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804233+0000", 2020-11-16T20:58:19.594 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019627800000000001 2020-11-16T20:58:19.595 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.595 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.595 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:19.595 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804429+0000", 2020-11-16T20:58:19.595 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006762316 2020-11-16T20:58:19.595 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.596 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.596 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:19.596 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811192+0000", 2020-11-16T20:58:19.596 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002630467 2020-11-16T20:58:19.596 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.596 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.596 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:19.597 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813822+0000", 2020-11-16T20:58:19.597 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026302065999999999 2020-11-16T20:58:19.597 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.597 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.597 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:19.597 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840124+0000", 2020-11-16T20:58:19.597 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.274e-05 2020-11-16T20:58:19.598 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.598 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.598 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:19.598 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840177+0000", 2020-11-16T20:58:19.598 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0958000000000003e-05 2020-11-16T20:58:19.598 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.598 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.599 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:19.599 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840218+0000", 2020-11-16T20:58:19.599 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9911138360000002 2020-11-16T20:58:19.599 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.599 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.599 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.599 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.600 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.600 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3053 4.0 4:2ceac9f9:::smithi16641208-61:head [write 2858378~532392] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:58:19.600 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:58:19.600 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 85.568474019000007, 2020-11-16T20:58:19.600 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9828430529999999, 2020-11-16T20:58:19.600 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.600 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:19.600 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.601 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.601 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.601 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3053 2020-11-16T20:58:19.601 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.601 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.601 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.602 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.602 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:58:19.602 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.602 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.602 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.602 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.602 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:58:19.603 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000647082 2020-11-16T20:58:19.603 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.603 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.603 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.603 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858208+0000", 2020-11-16T20:58:19.603 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.269e-05 2020-11-16T20:58:19.604 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.604 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.604 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.604 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858221+0000", 2020-11-16T20:58:19.604 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0361e-05 2020-11-16T20:58:19.604 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.605 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.605 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.605 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858242+0000", 2020-11-16T20:58:19.605 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1184e-05 2020-11-16T20:58:19.605 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.605 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.605 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.606 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858253+0000", 2020-11-16T20:58:19.606 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7032000000000004e-05 2020-11-16T20:58:19.606 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.606 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.606 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.606 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858330+0000", 2020-11-16T20:58:19.606 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4135999999999998e-05 2020-11-16T20:58:19.607 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.607 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.607 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.607 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858384+0000", 2020-11-16T20:58:19.607 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9487614310000003 2020-11-16T20:58:19.607 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.607 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.607 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.608 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807145+0000", 2020-11-16T20:58:19.608 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9426000000000007e-05 2020-11-16T20:58:19.608 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.608 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.608 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:19.608 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807245+0000", 2020-11-16T20:58:19.608 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018410799999999999 2020-11-16T20:58:19.609 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.609 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.609 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:19.609 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807429+0000", 2020-11-16T20:58:19.609 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0064067339999999999 2020-11-16T20:58:19.609 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.609 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.609 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:19.610 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813836+0000", 2020-11-16T20:58:19.610 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001513267 2020-11-16T20:58:19.610 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.610 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.610 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:19.610 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815349+0000", 2020-11-16T20:58:19.610 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024962895999999998 2020-11-16T20:58:19.611 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.611 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.611 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:19.611 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840312+0000", 2020-11-16T20:58:19.611 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7781999999999997e-05 2020-11-16T20:58:19.611 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.612 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.612 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:19.612 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840370+0000", 2020-11-16T20:58:19.612 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4924e-05 2020-11-16T20:58:19.612 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.613 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.613 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:19.613 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840404+0000", 2020-11-16T20:58:19.613 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9828430529999999 2020-11-16T20:58:19.613 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.613 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.613 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.614 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.614 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.614 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3054 4.0 4:2ceac9f9:::smithi16641208-61:head [setxattr _header (57) in=7b,truncate 3899323] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:58:19.614 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:58:19.614 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 85.567721512000006, 2020-11-16T20:58:19.614 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9822430049999999, 2020-11-16T20:58:19.614 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.615 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:19.615 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.615 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.615 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.615 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3054 2020-11-16T20:58:19.615 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.615 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.616 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.616 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.616 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:58:19.616 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.616 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.616 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.616 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.617 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:58:19.617 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8208999999999999e-05 2020-11-16T20:58:19.617 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.617 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.617 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.617 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858362+0000", 2020-11-16T20:58:19.617 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5539999999999998e-06 2020-11-16T20:58:19.617 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.618 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.618 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.618 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858371+0000", 2020-11-16T20:58:19.618 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.005e-05 2020-11-16T20:58:19.618 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.618 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.618 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.619 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858381+0000", 2020-11-16T20:58:19.619 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8099999999999997e-06 2020-11-16T20:58:19.619 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.619 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.619 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.619 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858386+0000", 2020-11-16T20:58:19.619 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6168000000000005e-05 2020-11-16T20:58:19.620 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.620 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.620 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.620 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858482+0000", 2020-11-16T20:58:19.620 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7954999999999999e-05 2020-11-16T20:58:19.620 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.620 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.620 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.621 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858510+0000", 2020-11-16T20:58:19.621 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9498925639999998 2020-11-16T20:58:19.621 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.621 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.621 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.621 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808402+0000", 2020-11-16T20:58:19.621 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3084000000000005e-05 2020-11-16T20:58:19.622 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.622 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.622 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:19.622 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808495+0000", 2020-11-16T20:58:19.622 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114826 2020-11-16T20:58:19.622 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.622 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.623 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:19.623 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808610+0000", 2020-11-16T20:58:19.623 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052363219999999999 2020-11-16T20:58:19.623 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.623 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.623 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:19.623 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813846+0000", 2020-11-16T20:58:19.623 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0015700709999999999 2020-11-16T20:58:19.624 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.624 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.624 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:19.624 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815417+0000", 2020-11-16T20:58:19.624 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025048682999999999 2020-11-16T20:58:19.624 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.624 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.625 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:19.625 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840465+0000", 2020-11-16T20:58:19.625 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5473000000000003e-05 2020-11-16T20:58:19.625 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.625 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.625 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:19.625 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840511+0000", 2020-11-16T20:58:19.625 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6236000000000003e-05 2020-11-16T20:58:19.626 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.626 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.626 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:19.626 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840557+0000", 2020-11-16T20:58:19.626 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9822430049999999 2020-11-16T20:58:19.626 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.626 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.627 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.627 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.627 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.627 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3055 4.0 4:2ceac9f9:::smithi16641208-61:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e91)", 2020-11-16T20:58:19.627 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:58:19.627 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 85.567546316000005, 2020-11-16T20:58:19.627 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9852841799999998, 2020-11-16T20:58:19.628 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.628 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:19.628 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.628 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.628 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.628 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3055 2020-11-16T20:58:19.628 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.629 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.629 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.629 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.629 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:58:19.629 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.629 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.629 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.629 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.630 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:58:19.630 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4403000000000002e-05 2020-11-16T20:58:19.630 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.630 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.630 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.630 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858523+0000", 2020-11-16T20:58:19.630 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4670000000000001e-06 2020-11-16T20:58:19.631 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.631 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.631 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.631 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858530+0000", 2020-11-16T20:58:19.631 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2469999999999999e-05 2020-11-16T20:58:19.631 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.631 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.632 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.632 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858542+0000", 2020-11-16T20:58:19.632 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2449999999999998e-06 2020-11-16T20:58:19.632 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.632 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.633 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.633 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858548+0000", 2020-11-16T20:58:19.633 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9604000000000002e-05 2020-11-16T20:58:19.633 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.634 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.634 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.634 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858587+0000", 2020-11-16T20:58:19.634 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4863000000000001e-05 2020-11-16T20:58:19.634 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.634 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.634 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.635 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858632+0000", 2020-11-16T20:58:19.635 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9521692039999996 2020-11-16T20:58:19.635 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.635 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.635 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.635 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.810801+0000", 2020-11-16T20:58:19.635 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014886700000000001 2020-11-16T20:58:19.636 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.636 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.636 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:19.636 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.810950+0000", 2020-11-16T20:58:19.636 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029669781999999999 2020-11-16T20:58:19.636 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.636 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.637 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.637 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840620+0000", 2020-11-16T20:58:19.637 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010005699999999999 2020-11-16T20:58:19.637 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.637 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.637 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:19.637 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840720+0000", 2020-11-16T20:58:19.638 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030532179999999999 2020-11-16T20:58:19.638 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.638 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.638 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:19.638 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843773+0000", 2020-11-16T20:58:19.638 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9852841799999998 2020-11-16T20:58:19.638 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.638 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.639 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.639 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.639 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.639 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3065 4.0 4:2f657946:::smithi16641208-73:head [read 0~3210104,checksum] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:58:19.639 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:58:19.639 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 85.459271293, 2020-11-16T20:58:19.639 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8738324339999997, 2020-11-16T20:58:19.640 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.640 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:19.640 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.640 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.640 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.640 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3065 2020-11-16T20:58:19.640 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.641 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.641 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.641 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.641 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:58:19.641 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.641 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.641 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.641 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.642 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:58:19.642 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3065999999999999e-05 2020-11-16T20:58:19.642 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.642 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.642 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.642 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966787+0000", 2020-11-16T20:58:19.642 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8329999999999998e-06 2020-11-16T20:58:19.643 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.643 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.643 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.643 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966790+0000", 2020-11-16T20:58:19.643 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1780000000000002e-06 2020-11-16T20:58:19.643 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.643 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.644 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.644 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966795+0000", 2020-11-16T20:58:19.644 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3460000000000001e-06 2020-11-16T20:58:19.644 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.644 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.644 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.644 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966798+0000", 2020-11-16T20:58:19.645 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6675000000000003e-05 2020-11-16T20:58:19.645 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.645 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.645 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.645 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966844+0000", 2020-11-16T20:58:19.645 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5497999999999999e-05 2020-11-16T20:58:19.646 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.646 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.646 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.646 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966870+0000", 2020-11-16T20:58:19.646 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8445859479999998 2020-11-16T20:58:19.646 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.647 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.647 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.647 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811456+0000", 2020-11-16T20:58:19.647 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029140889999999999 2020-11-16T20:58:19.647 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.647 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.648 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:19.648 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840597+0000", 2020-11-16T20:58:19.648 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8738324339999997 2020-11-16T20:58:19.648 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.648 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.648 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.649 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.649 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.649 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3066 4.0 4:356864c0:::smithi16641208-150:head [read 0~2504243,checksum,omap-get-vals-by-keys,omap-get-keys,omap-get-vals,omap-get-header,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:58:19.649 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:58:19.649 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 85.459220067999993, 2020-11-16T20:58:19.649 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8778990499999999, 2020-11-16T20:58:19.649 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.650 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:19.650 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.650 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.650 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.650 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3066 2020-11-16T20:58:19.650 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.651 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.651 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.651 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.651 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:58:19.651 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.651 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.652 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.652 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.652 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:58:19.652 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1704000000000001e-05 2020-11-16T20:58:19.652 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.652 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.653 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.653 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966837+0000", 2020-11-16T20:58:19.653 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6850000000000001e-06 2020-11-16T20:58:19.653 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.653 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.653 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.653 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966840+0000", 2020-11-16T20:58:19.654 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7479999999999999e-06 2020-11-16T20:58:19.654 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.654 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.654 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.654 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966845+0000", 2020-11-16T20:58:19.655 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5059999999999998e-06 2020-11-16T20:58:19.655 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.655 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.655 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.655 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966848+0000", 2020-11-16T20:58:19.656 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4314000000000002e-05 2020-11-16T20:58:19.656 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.656 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.656 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.656 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966902+0000", 2020-11-16T20:58:19.656 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.561e-05 2020-11-16T20:58:19.656 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.656 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.657 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.657 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:58:19.657 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8448102110000004 2020-11-16T20:58:19.657 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.657 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.657 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.658 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811738+0000", 2020-11-16T20:58:19.658 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032976272000000001 2020-11-16T20:58:19.658 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.658 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.658 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:19.658 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844714+0000", 2020-11-16T20:58:19.658 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8778990499999999 2020-11-16T20:58:19.658 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.659 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.659 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.659 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.659 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.659 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3067 4.0 4:356864c0:::smithi16641208-150:head [sparse-read 0~2504243] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:58:19.659 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:58:19.659 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 85.459168610999996, 2020-11-16T20:58:19.660 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8780898150000001, 2020-11-16T20:58:19.660 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.660 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:19.660 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.660 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.660 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.660 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3067 2020-11-16T20:58:19.661 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.661 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.661 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.661 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.661 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:58:19.661 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.661 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.662 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.662 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.662 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:58:19.662 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2826e-05 2020-11-16T20:58:19.662 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.662 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.663 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.663 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966900+0000", 2020-11-16T20:58:19.663 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.694e-06 2020-11-16T20:58:19.663 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.663 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.663 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.663 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966902+0000", 2020-11-16T20:58:19.664 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0889999999999999e-06 2020-11-16T20:58:19.664 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.664 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.664 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.664 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966907+0000", 2020-11-16T20:58:19.664 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3910000000000001e-06 2020-11-16T20:58:19.664 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.664 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.665 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.665 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966910+0000", 2020-11-16T20:58:19.665 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2771000000000002e-05 2020-11-16T20:58:19.665 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.665 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.665 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.665 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966943+0000", 2020-11-16T20:58:19.666 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5301000000000001e-05 2020-11-16T20:58:19.666 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.666 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.666 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.666 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966968+0000", 2020-11-16T20:58:19.666 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.845055017 2020-11-16T20:58:19.666 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.666 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.667 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.667 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812023+0000", 2020-11-16T20:58:19.667 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032933726000000003 2020-11-16T20:58:19.667 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.667 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.667 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:19.667 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844957+0000", 2020-11-16T20:58:19.668 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8780898150000001 2020-11-16T20:58:19.668 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.668 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.668 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.668 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.668 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.668 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3068 4.0 4:356864c0:::smithi16641208-150:head [read 0~2504243,checksum] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:58:19.669 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:58:19.669 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 85.459107273000001, 2020-11-16T20:58:19.669 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8828719500000002, 2020-11-16T20:58:19.669 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:19.669 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:19.669 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:19.669 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:19.669 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:19.670 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3068 2020-11-16T20:58:19.670 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.670 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:19.670 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.670 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:19.670 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:58:19.670 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:19.671 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.671 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.671 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:19.671 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:58:19.671 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0942999999999999e-05 2020-11-16T20:58:19.671 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.671 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.671 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:19.672 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966949+0000", 2020-11-16T20:58:19.672 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.712e-06 2020-11-16T20:58:19.672 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.672 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.672 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:19.672 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966952+0000", 2020-11-16T20:58:19.672 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8479999999999997e-06 2020-11-16T20:58:19.673 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.673 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.673 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:19.673 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966958+0000", 2020-11-16T20:58:19.673 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9170000000000002e-06 2020-11-16T20:58:19.673 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.673 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.674 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:19.674 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966961+0000", 2020-11-16T20:58:19.674 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4105999999999999e-05 2020-11-16T20:58:19.674 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.674 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.674 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.674 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966985+0000", 2020-11-16T20:58:19.674 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2056e-05 2020-11-16T20:58:19.675 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.675 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.675 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:19.675 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.967007+0000", 2020-11-16T20:58:19.675 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8456606430000004 2020-11-16T20:58:19.675 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.675 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.676 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:19.676 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812667+0000", 2020-11-16T20:58:19.676 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037132724999999998 2020-11-16T20:58:19.676 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:19.676 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:19.677 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:19.677 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849800+0000", 2020-11-16T20:58:19.677 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8828719500000002 2020-11-16T20:58:19.677 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.678 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.678 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.678 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:19.678 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:19.678 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:19.680 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:58:19.684+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:58:19.680 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:58:19.737 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:58:19.781 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:19.785+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:19.854 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:19.854 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:58:19.855 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:58:19.855 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:19.865 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:58:19.881 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:19.885+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:19.917 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:58:19.937 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:58:19.957 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:58:19.977 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:58:19.982 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:19.986+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:19.998 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:58:20.002 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:20.003 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:20.013 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:58:20.020 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:58:20.041 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:58:20.062 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:58:20.063 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:58:20.063 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:58:20.063 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:58:20.064 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:58:20.064 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:58:20.064 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:58:20.064 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:58:20.064 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:58:20.084 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:58:20.087+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:58:20.142 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:20.142 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:20.152 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:58:20.195 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:20.199+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:20.285 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:20.289+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:20.300 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:20.300 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:20.310 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:58:20.385 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:20.390+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:20.485 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:20.485 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:20.486 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:20.489+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:20.495 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:58:20.586 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:58:20.591+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:58:20.670 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:20.670 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:20.679 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:58:20.687 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:58:20.692+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:58:20.785 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7, 1] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:58:20.785 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:58:20.785 INFO:tasks.thrashosds.thrasher:Setting osd 7 primary_affinity to 0.262979 2020-11-16T20:58:20.786 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 0.26297863882305594 2020-11-16T20:58:20.788 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:58:20.793+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:58:20.815 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:20.816 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:20.825 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:58:20.889 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:20.894+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:20.937 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2020-11-16T20:58:20.965 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:20.966 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:20.975 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:58:21.018 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:21.022+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:21.090 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:21.094+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:21.110 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:21.110 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:21.120 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:58:21.191 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:21.196+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:21.292 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:21.296+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:21.295 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:21.296 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:21.305 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:58:21.392 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:58:21.397+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:58:21.439 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:21.440 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:21.449 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:58:21.493 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:21.497+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:21.584 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:21.584 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:21.593 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:58:21.594 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:21.597+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:21.694 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:21.698+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:21.769 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:21.769 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:21.778 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:58:21.819 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:21.823+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:21.895 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:21.899+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:21.938 INFO:teuthology.orchestra.run.smithi166.stderr:set osd.7 primary-affinity to 0.262979 (8172342) 2020-11-16T20:58:21.941 INFO:teuthology.orchestra.run.smithi166.stderr:nodeep-scrub is unset 2020-11-16T20:58:21.956 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:21.956 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:21.966 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:58:21.997 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:22.002+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:22.074 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:58:22.097 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:22.101+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:22.141 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:22.141 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:22.151 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:58:22.199 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:58:22.203+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:58:22.241 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:58:22.262 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:58:22.281 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:58:22.297 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:22.297 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:58:22.297 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:58:22.297 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:22.300 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:58:22.304+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:58:22.301 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:58:22.307 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:58:22.323 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:58:22.343 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:58:22.363 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:58:22.383 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:58:22.384 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:58:22.385 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:58:22.385 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:58:22.385 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:58:22.385 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:58:22.385 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:58:22.385 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:58:22.386 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:58:22.400 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:22.405+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:22.436 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:22.437 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:58:22.437 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:58:22.437 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:58:22.437 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:22.446 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:58:22.501 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:58:22.506+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:58:22.573 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:22.574 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:58:22.574 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:58:22.574 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:58:22.574 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.574 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2424 4.3 4:c5716d1e:::smithi16641208-111:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e46)", 2020-11-16T20:58:22.574 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.026685+0000", 2020-11-16T20:58:22.575 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 133.550595273, 2020-11-16T20:58:22.575 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065304164999999997, 2020-11-16T20:58:22.575 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:22.575 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:22.575 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:22.575 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:22.575 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:22.576 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2424 2020-11-16T20:58:22.576 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.576 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:22.576 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.576 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:22.576 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026685+0000", 2020-11-16T20:58:22.577 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:22.577 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.577 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.577 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:22.577 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026685+0000", 2020-11-16T20:58:22.577 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4087000000000001e-05 2020-11-16T20:58:22.577 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.578 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.578 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:22.578 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026719+0000", 2020-11-16T20:58:22.578 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2298e-05 2020-11-16T20:58:22.578 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.578 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.579 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:22.579 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026731+0000", 2020-11-16T20:58:22.579 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1001e-05 2020-11-16T20:58:22.579 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.579 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.580 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:22.580 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026742+0000", 2020-11-16T20:58:22.580 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6129999999999997e-06 2020-11-16T20:58:22.580 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.580 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.580 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:22.581 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026747+0000", 2020-11-16T20:58:22.581 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00047150600000000001 2020-11-16T20:58:22.581 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.581 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.581 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.581 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.027219+0000", 2020-11-16T20:58:22.581 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5602999999999998e-05 2020-11-16T20:58:22.582 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.582 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.582 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:22.582 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.027254+0000", 2020-11-16T20:58:22.582 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050318838999999997 2020-11-16T20:58:22.583 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.583 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.583 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.583 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.077573+0000", 2020-11-16T20:58:22.583 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6290000000000001e-05 2020-11-16T20:58:22.583 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.584 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.584 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:22.584 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.077669+0000", 2020-11-16T20:58:22.584 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014149599000000001 2020-11-16T20:58:22.584 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.584 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.585 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.585 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.091819+0000", 2020-11-16T20:58:22.585 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6891000000000005e-05 2020-11-16T20:58:22.585 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.585 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.585 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:22.585 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.091906+0000", 2020-11-16T20:58:22.586 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3437999999999996e-05 2020-11-16T20:58:22.586 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.586 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.586 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:22.586 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.091989+0000", 2020-11-16T20:58:22.587 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065304164999999997 2020-11-16T20:58:22.587 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.587 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:22.587 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.587 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.588 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.588 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2589 4.3 4:f65e82cb:::smithi16641208-219:head [write 1800933~725518] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:58:22.588 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.782219+0000", 2020-11-16T20:58:22.588 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 122.795061477, 2020-11-16T20:58:22.588 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.069486665000000003, 2020-11-16T20:58:22.589 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:22.589 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:22.589 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:22.589 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:22.589 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:22.589 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2589 2020-11-16T20:58:22.590 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.590 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:22.590 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.590 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:22.590 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782219+0000", 2020-11-16T20:58:22.590 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:22.591 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.591 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.591 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:22.591 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782219+0000", 2020-11-16T20:58:22.591 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00038710600000000002 2020-11-16T20:58:22.591 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.592 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.592 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:22.592 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782606+0000", 2020-11-16T20:58:22.592 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.628e-06 2020-11-16T20:58:22.592 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.592 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.592 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:22.593 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782616+0000", 2020-11-16T20:58:22.593 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5631999999999999e-05 2020-11-16T20:58:22.593 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.593 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.593 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:22.593 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782631+0000", 2020-11-16T20:58:22.593 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6249999999999998e-06 2020-11-16T20:58:22.594 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.594 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.594 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:22.594 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782639+0000", 2020-11-16T20:58:22.594 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3213999999999997e-05 2020-11-16T20:58:22.594 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.594 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.595 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.595 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782672+0000", 2020-11-16T20:58:22.595 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9141000000000003e-05 2020-11-16T20:58:22.595 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.595 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.595 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:22.595 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782721+0000", 2020-11-16T20:58:22.596 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017807030000000001 2020-11-16T20:58:22.596 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.596 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.596 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.596 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800528+0000", 2020-11-16T20:58:22.596 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016577399999999999 2020-11-16T20:58:22.596 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.597 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.597 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:22.597 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800694+0000", 2020-11-16T20:58:22.597 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00026135900000000002 2020-11-16T20:58:22.597 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.597 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.597 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:58:22.598 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800955+0000", 2020-11-16T20:58:22.598 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0074407529999999996 2020-11-16T20:58:22.598 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.598 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.598 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:22.598 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808396+0000", 2020-11-16T20:58:22.598 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011788041000000001 2020-11-16T20:58:22.599 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.599 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.599 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:22.599 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.820184+0000", 2020-11-16T20:58:22.599 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031417394000000001 2020-11-16T20:58:22.599 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.599 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.600 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:22.600 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851602+0000", 2020-11-16T20:58:22.600 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0005e-05 2020-11-16T20:58:22.600 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.600 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.600 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:22.600 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851652+0000", 2020-11-16T20:58:22.601 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3962999999999998e-05 2020-11-16T20:58:22.601 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.601 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.601 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:22.601 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851705+0000", 2020-11-16T20:58:22.601 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.069486665000000003 2020-11-16T20:58:22.601 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.602 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:22.602 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.602 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.602 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.602 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2590 4.3 4:f65e82cb:::smithi16641208-219:head [write 2944601~232021] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:58:22.602 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.785957+0000", 2020-11-16T20:58:22.602 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 122.791323787, 2020-11-16T20:58:22.603 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065959045999999993, 2020-11-16T20:58:22.603 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:22.603 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:22.603 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:22.603 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:22.603 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:22.604 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2590 2020-11-16T20:58:22.604 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.604 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:22.604 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.604 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:22.604 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.785957+0000", 2020-11-16T20:58:22.604 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:22.605 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.605 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.605 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:22.605 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.785957+0000", 2020-11-16T20:58:22.605 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6058999999999998e-05 2020-11-16T20:58:22.605 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.605 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.605 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:22.606 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786033+0000", 2020-11-16T20:58:22.606 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1582999999999999e-05 2020-11-16T20:58:22.606 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.606 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.606 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:22.606 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786064+0000", 2020-11-16T20:58:22.606 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8099999999999992e-06 2020-11-16T20:58:22.607 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.607 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.607 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:22.607 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786074+0000", 2020-11-16T20:58:22.607 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.198e-06 2020-11-16T20:58:22.607 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.607 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.608 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:22.608 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786079+0000", 2020-11-16T20:58:22.608 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0587999999999997e-05 2020-11-16T20:58:22.608 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.608 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.608 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.608 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786130+0000", 2020-11-16T20:58:22.608 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5791000000000007e-05 2020-11-16T20:58:22.609 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.609 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.609 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:22.609 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786206+0000", 2020-11-16T20:58:22.609 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016623412000000001 2020-11-16T20:58:22.609 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.609 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.610 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.610 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.802829+0000", 2020-11-16T20:58:22.610 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012361699999999999 2020-11-16T20:58:22.610 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.610 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.610 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:22.610 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.802953+0000", 2020-11-16T20:58:22.611 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000161807 2020-11-16T20:58:22.611 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.611 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.611 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:58:22.611 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.803114+0000", 2020-11-16T20:58:22.611 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.005291535 2020-11-16T20:58:22.611 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.612 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.612 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:22.612 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808406+0000", 2020-11-16T20:58:22.612 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011819998999999999 2020-11-16T20:58:22.612 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.612 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.612 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:22.612 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.820226+0000", 2020-11-16T20:58:22.613 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031546375000000001 2020-11-16T20:58:22.613 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.613 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.613 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:22.613 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851772+0000", 2020-11-16T20:58:22.613 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9140000000000005e-05 2020-11-16T20:58:22.613 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.614 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.614 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:22.614 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851851+0000", 2020-11-16T20:58:22.614 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4132000000000002e-05 2020-11-16T20:58:22.614 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.614 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.614 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:22.615 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851916+0000", 2020-11-16T20:58:22.615 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065959045999999993 2020-11-16T20:58:22.615 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.615 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:22.615 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.615 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.615 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.615 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2591 4.3 4:f65e82cb:::smithi16641208-219:head [setxattr _header (58) in=7b,truncate 3176622] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:58:22.616 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.786110+0000", 2020-11-16T20:58:22.616 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 122.79117025399999, 2020-11-16T20:58:22.616 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066016654999999994, 2020-11-16T20:58:22.616 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:22.616 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:22.616 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:22.616 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:22.617 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:22.617 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2591 2020-11-16T20:58:22.617 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.617 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:22.617 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.617 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:22.617 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786110+0000", 2020-11-16T20:58:22.618 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:22.618 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.618 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.618 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:22.618 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786110+0000", 2020-11-16T20:58:22.618 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5616e-05 2020-11-16T20:58:22.619 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.619 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.619 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:22.619 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786136+0000", 2020-11-16T20:58:22.619 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5329999999999999e-06 2020-11-16T20:58:22.619 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.619 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.620 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:22.620 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786139+0000", 2020-11-16T20:58:22.620 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7440000000000004e-06 2020-11-16T20:58:22.620 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.620 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.620 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:22.620 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786145+0000", 2020-11-16T20:58:22.621 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0120000000000001e-06 2020-11-16T20:58:22.621 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.621 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.621 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:22.621 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786148+0000", 2020-11-16T20:58:22.621 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5617000000000004e-05 2020-11-16T20:58:22.621 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.621 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.622 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.622 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786234+0000", 2020-11-16T20:58:22.622 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0964000000000001e-05 2020-11-16T20:58:22.622 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.622 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.622 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:22.622 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786295+0000", 2020-11-16T20:58:22.623 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017673271000000001 2020-11-16T20:58:22.623 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.623 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.623 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.623 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.803968+0000", 2020-11-16T20:58:22.623 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000155272 2020-11-16T20:58:22.623 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.624 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.624 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:22.624 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.804123+0000", 2020-11-16T20:58:22.624 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00027357299999999999 2020-11-16T20:58:22.624 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.624 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.624 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:58:22.625 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.804397+0000", 2020-11-16T20:58:22.625 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040142659999999998 2020-11-16T20:58:22.625 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.625 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.625 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:22.625 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808411+0000", 2020-11-16T20:58:22.625 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011837194000000001 2020-11-16T20:58:22.625 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.626 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.626 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:22.626 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.820248+0000", 2020-11-16T20:58:22.626 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031735780999999998 2020-11-16T20:58:22.626 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.626 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.626 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:22.627 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851984+0000", 2020-11-16T20:58:22.627 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0603000000000001e-05 2020-11-16T20:58:22.627 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.627 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.627 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:22.627 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852054+0000", 2020-11-16T20:58:22.627 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2208999999999999e-05 2020-11-16T20:58:22.628 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.628 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.628 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:22.628 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852127+0000", 2020-11-16T20:58:22.628 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066016654999999994 2020-11-16T20:58:22.628 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.628 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:22.628 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.629 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.629 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.629 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2592 4.3 4:f65e82cb:::smithi16641208-219:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:58:22.629 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.786176+0000", 2020-11-16T20:58:22.629 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 122.79110477099999, 2020-11-16T20:58:22.629 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066389967999999994, 2020-11-16T20:58:22.630 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:22.630 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:22.630 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:22.630 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:22.630 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:22.630 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2592 2020-11-16T20:58:22.630 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.631 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:22.631 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.631 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:22.631 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786176+0000", 2020-11-16T20:58:22.631 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:22.631 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.631 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.631 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:22.632 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786176+0000", 2020-11-16T20:58:22.632 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1280999999999998e-05 2020-11-16T20:58:22.632 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.632 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.632 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:22.632 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786197+0000", 2020-11-16T20:58:22.632 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.349e-06 2020-11-16T20:58:22.633 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.633 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.633 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:22.633 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786200+0000", 2020-11-16T20:58:22.633 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4840000000000001e-06 2020-11-16T20:58:22.633 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.633 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.634 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:22.634 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786207+0000", 2020-11-16T20:58:22.634 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3390000000000001e-06 2020-11-16T20:58:22.634 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.634 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.634 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:22.634 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786210+0000", 2020-11-16T20:58:22.634 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000115748 2020-11-16T20:58:22.635 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.635 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.635 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.635 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786326+0000", 2020-11-16T20:58:22.635 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6062e-05 2020-11-16T20:58:22.635 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.636 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.636 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:22.636 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786372+0000", 2020-11-16T20:58:22.636 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021773975000000001 2020-11-16T20:58:22.636 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.636 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.636 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.637 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808146+0000", 2020-11-16T20:58:22.637 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014829900000000001 2020-11-16T20:58:22.637 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.637 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.637 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:22.637 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808294+0000", 2020-11-16T20:58:22.638 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.043877869999999999 2020-11-16T20:58:22.638 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.638 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.638 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.638 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852172+0000", 2020-11-16T20:58:22.638 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000145322 2020-11-16T20:58:22.638 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.639 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.639 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:22.639 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852317+0000", 2020-11-16T20:58:22.639 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024823899999999998 2020-11-16T20:58:22.639 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.639 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.639 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:22.639 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852565+0000", 2020-11-16T20:58:22.640 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066389967999999994 2020-11-16T20:58:22.640 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.640 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:22.640 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.640 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.640 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.640 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2593 4.3 4:f5f8fa2a:::smithi16641208-144:head [copy-from ver 64] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:58:22.641 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.786250+0000", 2020-11-16T20:58:22.641 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 122.79102999200001, 2020-11-16T20:58:22.641 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065186216000000005, 2020-11-16T20:58:22.641 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:22.641 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:22.641 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:22.641 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:22.642 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:22.642 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2593 2020-11-16T20:58:22.642 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.642 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:22.642 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.642 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:22.642 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786250+0000", 2020-11-16T20:58:22.643 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:22.643 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.643 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.643 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:22.643 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786250+0000", 2020-11-16T20:58:22.643 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2438999999999998e-05 2020-11-16T20:58:22.643 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.644 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.644 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:22.644 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786293+0000", 2020-11-16T20:58:22.644 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6840000000000001e-06 2020-11-16T20:58:22.644 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.644 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.644 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:22.645 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786298+0000", 2020-11-16T20:58:22.645 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4331999999999999e-05 2020-11-16T20:58:22.645 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.645 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.645 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:22.645 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786313+0000", 2020-11-16T20:58:22.645 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6460000000000001e-06 2020-11-16T20:58:22.646 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.646 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.646 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:22.646 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786317+0000", 2020-11-16T20:58:22.646 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5451999999999995e-05 2020-11-16T20:58:22.646 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.646 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.647 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.647 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786393+0000", 2020-11-16T20:58:22.647 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065041011999999995 2020-11-16T20:58:22.647 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.647 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.647 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:22.647 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851434+0000", 2020-11-16T20:58:22.647 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6510000000000001e-06 2020-11-16T20:58:22.648 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.648 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.648 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:22.648 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851437+0000", 2020-11-16T20:58:22.648 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065186216000000005 2020-11-16T20:58:22.648 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.648 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:22.649 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.649 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.649 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.649 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2594 4.3 4:f5f8fa2a:::smithi16641208-144:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:58:22.649 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.786352+0000", 2020-11-16T20:58:22.649 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 122.79092869900001, 2020-11-16T20:58:22.649 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.089305972999999997, 2020-11-16T20:58:22.650 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:22.650 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:22.650 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:22.650 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:22.650 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:22.650 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2594 2020-11-16T20:58:22.650 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.651 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:22.651 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.651 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:22.651 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786352+0000", 2020-11-16T20:58:22.651 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:22.651 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.651 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.651 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:22.652 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786352+0000", 2020-11-16T20:58:22.652 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5896000000000001e-05 2020-11-16T20:58:22.652 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.652 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.652 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:22.652 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786377+0000", 2020-11-16T20:58:22.653 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7700000000000004e-06 2020-11-16T20:58:22.653 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.653 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.653 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:22.653 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786384+0000", 2020-11-16T20:58:22.654 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.049e-05 2020-11-16T20:58:22.654 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.654 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.654 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:22.654 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786395+0000", 2020-11-16T20:58:22.654 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0440000000000003e-06 2020-11-16T20:58:22.654 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.655 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.655 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:22.655 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786400+0000", 2020-11-16T20:58:22.655 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000366771 2020-11-16T20:58:22.655 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.655 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.655 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.656 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786767+0000", 2020-11-16T20:58:22.656 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1366999999999998e-05 2020-11-16T20:58:22.656 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.656 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.656 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:22.656 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786818+0000", 2020-11-16T20:58:22.656 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.077259257999999997 2020-11-16T20:58:22.657 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.657 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.657 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.657 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.864077+0000", 2020-11-16T20:58:22.657 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018375499999999999 2020-11-16T20:58:22.657 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.657 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.658 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:22.658 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.864261+0000", 2020-11-16T20:58:22.658 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011122837 2020-11-16T20:58:22.658 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.659 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.659 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.659 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.875384+0000", 2020-11-16T20:58:22.659 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000135752 2020-11-16T20:58:22.659 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.660 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.660 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:22.660 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.875520+0000", 2020-11-16T20:58:22.660 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000138033 2020-11-16T20:58:22.660 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.660 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.660 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:22.661 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.875658+0000", 2020-11-16T20:58:22.661 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.089305972999999997 2020-11-16T20:58:22.661 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.661 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:22.661 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.661 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.661 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.661 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2872 4.3 4:d9c18080:::smithi16641208-173:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-11-16T20:58:22.662 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:34.745479+0000", 2020-11-16T20:58:22.662 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 107.831801435, 2020-11-16T20:58:22.662 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.059388271999999999, 2020-11-16T20:58:22.662 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:22.662 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:22.662 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:22.662 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:22.663 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:22.663 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2872 2020-11-16T20:58:22.663 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.663 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:22.663 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.663 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:22.663 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745479+0000", 2020-11-16T20:58:22.664 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:22.664 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.664 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.664 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:22.664 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745479+0000", 2020-11-16T20:58:22.664 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0491e-05 2020-11-16T20:58:22.664 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.664 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.665 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:22.665 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745509+0000", 2020-11-16T20:58:22.665 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9170000000000003e-06 2020-11-16T20:58:22.665 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.665 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.665 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:22.665 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745515+0000", 2020-11-16T20:58:22.666 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1267000000000001e-05 2020-11-16T20:58:22.666 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.666 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.666 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:22.666 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745527+0000", 2020-11-16T20:58:22.666 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.04e-06 2020-11-16T20:58:22.666 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.667 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.667 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:22.667 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745532+0000", 2020-11-16T20:58:22.667 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034800500000000003 2020-11-16T20:58:22.667 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.667 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.667 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.668 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745880+0000", 2020-11-16T20:58:22.668 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6010000000000003e-05 2020-11-16T20:58:22.668 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.668 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.668 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:22.668 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745916+0000", 2020-11-16T20:58:22.668 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042557927000000002 2020-11-16T20:58:22.668 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.669 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.669 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.669 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.788474+0000", 2020-11-16T20:58:22.669 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000160614 2020-11-16T20:58:22.669 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.669 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.669 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:22.670 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.788634+0000", 2020-11-16T20:58:22.670 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016066745 2020-11-16T20:58:22.670 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.670 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.670 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.670 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.804701+0000", 2020-11-16T20:58:22.670 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3805000000000001e-05 2020-11-16T20:58:22.670 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.671 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.671 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:22.671 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.804785+0000", 2020-11-16T20:58:22.671 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2451000000000001e-05 2020-11-16T20:58:22.671 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.671 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.671 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:22.672 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.804867+0000", 2020-11-16T20:58:22.672 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.059388271999999999 2020-11-16T20:58:22.672 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.672 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:22.672 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.672 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.672 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.673 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2962 4.3 4:c925a80f:::smithi16641208-375:head [write 1381780~411527] snapc 2d=[2d,25] ondisk+write+known_if_redirected e82)", 2020-11-16T20:58:22.673 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.749629+0000", 2020-11-16T20:58:22.673 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 97.827651677000006, 2020-11-16T20:58:22.673 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.052987905000000002, 2020-11-16T20:58:22.673 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:22.673 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:22.673 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:22.673 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:22.674 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:22.674 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2962 2020-11-16T20:58:22.674 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.674 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:22.674 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.674 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:22.674 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.749629+0000", 2020-11-16T20:58:22.675 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:22.675 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.675 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.675 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:22.675 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.749629+0000", 2020-11-16T20:58:22.675 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00039027700000000002 2020-11-16T20:58:22.675 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.676 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.676 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:22.676 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750019+0000", 2020-11-16T20:58:22.676 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0961000000000001e-05 2020-11-16T20:58:22.676 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.676 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.676 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:22.677 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750030+0000", 2020-11-16T20:58:22.677 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7931000000000002e-05 2020-11-16T20:58:22.677 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.677 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.677 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:22.677 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750048+0000", 2020-11-16T20:58:22.677 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3030000000000005e-06 2020-11-16T20:58:22.678 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.678 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.678 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:22.678 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750057+0000", 2020-11-16T20:58:22.678 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8351999999999999e-05 2020-11-16T20:58:22.678 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.678 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.679 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.679 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750125+0000", 2020-11-16T20:58:22.679 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010314000000000001 2020-11-16T20:58:22.679 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.679 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.679 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:22.679 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750229+0000", 2020-11-16T20:58:22.680 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039625369000000001 2020-11-16T20:58:22.680 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.680 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.680 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.681 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.789854+0000", 2020-11-16T20:58:22.681 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000153096 2020-11-16T20:58:22.681 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.681 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.681 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:22.681 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790007+0000", 2020-11-16T20:58:22.681 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022176699999999999 2020-11-16T20:58:22.682 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.682 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.682 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:58:22.682 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790229+0000", 2020-11-16T20:58:22.682 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0059379410000000004 2020-11-16T20:58:22.682 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.683 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.683 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:22.683 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.796167+0000", 2020-11-16T20:58:22.683 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0013346230000000001 2020-11-16T20:58:22.683 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.683 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.684 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:22.684 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.797501+0000", 2020-11-16T20:58:22.684 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0049809470000000003 2020-11-16T20:58:22.684 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.684 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.684 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:22.684 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802482+0000", 2020-11-16T20:58:22.685 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1831999999999998e-05 2020-11-16T20:58:22.685 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.685 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.685 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:22.685 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802574+0000", 2020-11-16T20:58:22.686 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2366000000000001e-05 2020-11-16T20:58:22.686 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.686 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.686 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:22.686 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802617+0000", 2020-11-16T20:58:22.686 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.052987905000000002 2020-11-16T20:58:22.687 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.687 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:22.687 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.687 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.687 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.687 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2997 4.3 4:f5e68fa8:::smithi16641208-361:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e86)", 2020-11-16T20:58:22.688 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838418+0000", 2020-11-16T20:58:22.688 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 93.738861966000002, 2020-11-16T20:58:22.688 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.056590020999999997, 2020-11-16T20:58:22.688 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:22.688 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:22.689 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:22.689 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:22.689 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:22.689 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2997 2020-11-16T20:58:22.689 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.690 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:22.690 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.690 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:22.690 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838418+0000", 2020-11-16T20:58:22.690 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:22.690 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.691 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.691 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:22.691 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838418+0000", 2020-11-16T20:58:22.691 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9998999999999999e-05 2020-11-16T20:58:22.691 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.691 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.691 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:22.692 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838448+0000", 2020-11-16T20:58:22.692 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3640000000000004e-06 2020-11-16T20:58:22.692 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.692 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.692 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:22.693 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838455+0000", 2020-11-16T20:58:22.693 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1902999999999999e-05 2020-11-16T20:58:22.693 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.693 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.693 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:22.693 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838467+0000", 2020-11-16T20:58:22.693 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1699999999999996e-06 2020-11-16T20:58:22.693 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.694 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.694 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:22.694 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838472+0000", 2020-11-16T20:58:22.694 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00047208200000000002 2020-11-16T20:58:22.694 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.695 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.695 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.695 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838944+0000", 2020-11-16T20:58:22.695 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6712000000000002e-05 2020-11-16T20:58:22.695 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.696 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.696 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:22.696 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.839001+0000", 2020-11-16T20:58:22.696 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038817664000000002 2020-11-16T20:58:22.696 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.696 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.696 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.697 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.877818+0000", 2020-11-16T20:58:22.697 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000119492 2020-11-16T20:58:22.697 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.697 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.697 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:22.697 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.877938+0000", 2020-11-16T20:58:22.697 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016797409999999999 2020-11-16T20:58:22.698 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.698 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.698 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.698 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.894735+0000", 2020-11-16T20:58:22.698 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015645500000000001 2020-11-16T20:58:22.698 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.698 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.699 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:22.699 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.894892+0000", 2020-11-16T20:58:22.699 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011677 2020-11-16T20:58:22.699 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.699 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.699 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:22.699 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.895008+0000", 2020-11-16T20:58:22.700 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.056590020999999997 2020-11-16T20:58:22.700 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.700 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:22.700 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.700 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.700 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.700 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3520 4.3 4:f686f74f:::smithi16641208-134:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e129)", 2020-11-16T20:58:22.700 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.027796+0000", 2020-11-16T20:58:22.701 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 48.549484305, 2020-11-16T20:58:22.701 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.051377742999999997, 2020-11-16T20:58:22.701 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:22.701 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:22.701 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:22.701 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:22.701 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:22.702 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3520 2020-11-16T20:58:22.702 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.702 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:22.702 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.702 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:22.702 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.027796+0000", 2020-11-16T20:58:22.702 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:22.703 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.703 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.703 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:22.703 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.027796+0000", 2020-11-16T20:58:22.703 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5429000000000001e-05 2020-11-16T20:58:22.703 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.703 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.704 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:22.704 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.027811+0000", 2020-11-16T20:58:22.704 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2150000000000001e-06 2020-11-16T20:58:22.704 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.704 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.704 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:22.705 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.027815+0000", 2020-11-16T20:58:22.705 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4620000000000001e-06 2020-11-16T20:58:22.705 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.705 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.705 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:22.705 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.027821+0000", 2020-11-16T20:58:22.705 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.602e-06 2020-11-16T20:58:22.706 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.706 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.706 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:22.706 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.027825+0000", 2020-11-16T20:58:22.706 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030451419999999998 2020-11-16T20:58:22.706 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.706 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.707 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.707 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.030870+0000", 2020-11-16T20:58:22.707 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8892000000000003e-05 2020-11-16T20:58:22.707 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.707 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.707 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:22.707 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.030949+0000", 2020-11-16T20:58:22.707 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036413867000000003 2020-11-16T20:58:22.708 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.708 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.708 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.708 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.067363+0000", 2020-11-16T20:58:22.708 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000102604 2020-11-16T20:58:22.708 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.708 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.709 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:22.709 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.067465+0000", 2020-11-16T20:58:22.709 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011558476999999999 2020-11-16T20:58:22.709 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.709 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.709 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.709 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.079024+0000", 2020-11-16T20:58:22.710 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5964999999999995e-05 2020-11-16T20:58:22.710 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.710 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.710 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:22.710 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.079100+0000", 2020-11-16T20:58:22.710 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4087999999999999e-05 2020-11-16T20:58:22.710 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.710 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.711 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:22.711 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.079174+0000", 2020-11-16T20:58:22.711 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.051377742999999997 2020-11-16T20:58:22.711 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.711 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:22.711 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.711 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.712 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.712 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.4.13:908 3.1 3:b7adb356:::smithi16641208-217:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e130)", 2020-11-16T20:58:22.712 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.754089+0000", 2020-11-16T20:58:22.712 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 47.823190932999999, 2020-11-16T20:58:22.712 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050485306000000001, 2020-11-16T20:58:22.712 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:22.712 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:22.713 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:22.713 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.713 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:22.713 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754089+0000", 2020-11-16T20:58:22.713 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:22.713 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.713 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.713 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:22.714 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754089+0000", 2020-11-16T20:58:22.714 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1849e-05 2020-11-16T20:58:22.714 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.714 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.714 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:22.714 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754111+0000", 2020-11-16T20:58:22.714 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.309e-06 2020-11-16T20:58:22.715 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.715 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.715 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:22.715 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754115+0000", 2020-11-16T20:58:22.715 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.784e-06 2020-11-16T20:58:22.715 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.715 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.716 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:22.716 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754120+0000", 2020-11-16T20:58:22.716 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4829999999999999e-06 2020-11-16T20:58:22.716 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.716 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.716 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:22.716 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754124+0000", 2020-11-16T20:58:22.717 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033225300000000002 2020-11-16T20:58:22.717 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.717 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.717 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.717 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754456+0000", 2020-11-16T20:58:22.717 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1177000000000001e-05 2020-11-16T20:58:22.717 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.717 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.718 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:22.718 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754507+0000", 2020-11-16T20:58:22.718 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033760357999999997 2020-11-16T20:58:22.718 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.718 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.718 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.718 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788268+0000", 2020-11-16T20:58:22.719 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0700999999999998e-05 2020-11-16T20:58:22.719 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.719 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.719 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:22.719 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788358+0000", 2020-11-16T20:58:22.719 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013027209999999999 2020-11-16T20:58:22.719 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.720 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.720 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.720 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801385+0000", 2020-11-16T20:58:22.720 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010369099999999999 2020-11-16T20:58:22.720 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.720 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.721 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:22.721 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801489+0000", 2020-11-16T20:58:22.721 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030854910000000001 2020-11-16T20:58:22.721 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.721 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.722 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:22.722 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.804575+0000", 2020-11-16T20:58:22.722 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050485306000000001 2020-11-16T20:58:22.722 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.722 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:22.722 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.723 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.723 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.723 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3960 4.2 4:792a5aa2:::smithi16641208-171:head [append 0~0] snapc 71=[71,61] RETRY=2 ondisk+retry+write+known_if_redirected e161)", 2020-11-16T20:58:22.723 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:10.766719+0000", 2020-11-16T20:58:22.723 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 11.810561452, 2020-11-16T20:58:22.723 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.294536568, 2020-11-16T20:58:22.723 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:22.723 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:22.724 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:22.724 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:22.724 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:22.724 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3960 2020-11-16T20:58:22.724 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.724 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:22.724 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.725 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:22.725 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766719+0000", 2020-11-16T20:58:22.725 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:22.725 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.725 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.725 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:22.725 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766719+0000", 2020-11-16T20:58:22.726 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1884000000000002e-05 2020-11-16T20:58:22.726 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.726 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.726 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:22.726 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766751+0000", 2020-11-16T20:58:22.726 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5009999999999998e-06 2020-11-16T20:58:22.726 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.727 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.727 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:22.727 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766758+0000", 2020-11-16T20:58:22.727 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3645999999999999e-05 2020-11-16T20:58:22.727 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.727 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.727 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:22.727 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766772+0000", 2020-11-16T20:58:22.728 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6020000000000002e-06 2020-11-16T20:58:22.728 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.728 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.728 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:22.728 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766779+0000", 2020-11-16T20:58:22.728 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016390299999999999 2020-11-16T20:58:22.728 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.729 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.729 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.729 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766943+0000", 2020-11-16T20:58:22.729 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0708e-05 2020-11-16T20:58:22.729 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.729 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.729 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:22.729 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766954+0000", 2020-11-16T20:58:22.730 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.280180449 2020-11-16T20:58:22.730 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.730 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.730 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.730 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.047135+0000", 2020-11-16T20:58:22.730 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023914300000000001 2020-11-16T20:58:22.730 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.731 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.731 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for missing object", 2020-11-16T20:58:22.731 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.047374+0000", 2020-11-16T20:58:22.731 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0022773590000000001 2020-11-16T20:58:22.731 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.731 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.732 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.732 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.049651+0000", 2020-11-16T20:58:22.732 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011596629000000001 2020-11-16T20:58:22.732 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.733 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.733 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:22.733 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.061248+0000", 2020-11-16T20:58:22.733 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7440000000000007e-06 2020-11-16T20:58:22.733 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.733 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.733 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:22.734 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.061255+0000", 2020-11-16T20:58:22.734 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.294536568 2020-11-16T20:58:22.734 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.734 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:22.734 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.734 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.734 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.735 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3961 4.2 4:792a5aa2:::smithi16641208-171:head [rollback 61] snapc 71=[71,61] RETRY=2 ondisk+retry+write+known_if_redirected e161)", 2020-11-16T20:58:22.735 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:10.766814+0000", 2020-11-16T20:58:22.735 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 11.810465900000001, 2020-11-16T20:58:22.735 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.33204910999999998, 2020-11-16T20:58:22.735 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:22.735 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:22.735 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:22.736 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:22.736 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:22.736 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3961 2020-11-16T20:58:22.736 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.736 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:22.736 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.736 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:22.737 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766814+0000", 2020-11-16T20:58:22.737 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:22.737 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.737 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.737 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:22.737 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766814+0000", 2020-11-16T20:58:22.738 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2356e-05 2020-11-16T20:58:22.738 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.738 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.738 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:22.738 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766847+0000", 2020-11-16T20:58:22.738 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7649999999999999e-06 2020-11-16T20:58:22.739 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.739 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.739 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:22.739 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766853+0000", 2020-11-16T20:58:22.739 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0635000000000001e-05 2020-11-16T20:58:22.739 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.739 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.740 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:22.740 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766863+0000", 2020-11-16T20:58:22.740 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7139999999999998e-06 2020-11-16T20:58:22.740 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.740 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.740 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:22.740 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766869+0000", 2020-11-16T20:58:22.740 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000113033 2020-11-16T20:58:22.741 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.741 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.741 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.741 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766982+0000", 2020-11-16T20:58:22.741 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4500000000000001e-06 2020-11-16T20:58:22.741 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.741 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.742 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:22.742 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766988+0000", 2020-11-16T20:58:22.742 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.28083836499999998 2020-11-16T20:58:22.742 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.742 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.742 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.742 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.047827+0000", 2020-11-16T20:58:22.743 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6771000000000001e-05 2020-11-16T20:58:22.743 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.743 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.743 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for missing object", 2020-11-16T20:58:22.743 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.047903+0000", 2020-11-16T20:58:22.743 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00228181 2020-11-16T20:58:22.743 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.744 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.744 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.744 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.050185+0000", 2020-11-16T20:58:22.744 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4109999999999994e-05 2020-11-16T20:58:22.744 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.744 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.745 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:22.745 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.050249+0000", 2020-11-16T20:58:22.745 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019491345 2020-11-16T20:58:22.745 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.745 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.745 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.745 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.069741+0000", 2020-11-16T20:58:22.746 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00021984000000000001 2020-11-16T20:58:22.746 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.746 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.746 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:22.746 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.069961+0000", 2020-11-16T20:58:22.746 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00028599400000000003 2020-11-16T20:58:22.746 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.746 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.747 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:22.747 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.070247+0000", 2020-11-16T20:58:22.747 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.826e-05 2020-11-16T20:58:22.747 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.747 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.747 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:22.747 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.070315+0000", 2020-11-16T20:58:22.748 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078169539999999992 2020-11-16T20:58:22.748 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.748 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.748 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.748 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.078132+0000", 2020-11-16T20:58:22.748 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000190836 2020-11-16T20:58:22.748 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.749 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.749 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:22.749 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.078323+0000", 2020-11-16T20:58:22.749 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00043319700000000002 2020-11-16T20:58:22.749 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.749 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.749 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 1,4,5", 2020-11-16T20:58:22.750 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.078756+0000", 2020-11-16T20:58:22.750 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0060120390000000003 2020-11-16T20:58:22.750 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.750 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.750 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.750 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.084768+0000", 2020-11-16T20:58:22.750 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7736000000000002e-05 2020-11-16T20:58:22.751 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.751 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.751 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for ondisk", 2020-11-16T20:58:22.751 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.084846+0000", 2020-11-16T20:58:22.751 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0074966049999999999 2020-11-16T20:58:22.751 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.751 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.751 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:22.752 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.092342+0000", 2020-11-16T20:58:22.752 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0058494810000000001 2020-11-16T20:58:22.752 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.752 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.752 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:22.752 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.098192+0000", 2020-11-16T20:58:22.752 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6997999999999995e-05 2020-11-16T20:58:22.753 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.753 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.753 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:22.753 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.098289+0000", 2020-11-16T20:58:22.753 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032133900000000002 2020-11-16T20:58:22.753 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.753 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.754 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:22.754 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.098610+0000", 2020-11-16T20:58:22.754 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8751999999999993e-05 2020-11-16T20:58:22.754 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.754 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.754 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:22.755 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.098699+0000", 2020-11-16T20:58:22.755 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016472500000000001 2020-11-16T20:58:22.755 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.755 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.755 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:22.755 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.098863+0000", 2020-11-16T20:58:22.755 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.33204910999999998 2020-11-16T20:58:22.756 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.756 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:22.756 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.756 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.756 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.756 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3962 4.2 4:792a5aa2:::smithi16641208-171:head [append 0~0] snapc 71=[71,61] RETRY=2 ondisk+retry+write+known_if_redirected e161)", 2020-11-16T20:58:22.756 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:10.766901+0000", 2020-11-16T20:58:22.756 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 11.810379449999999, 2020-11-16T20:58:22.757 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.35350222399999998, 2020-11-16T20:58:22.757 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:22.757 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:22.757 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:22.757 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:22.757 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:22.757 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3962 2020-11-16T20:58:22.758 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.758 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:22.758 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.758 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:22.758 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766901+0000", 2020-11-16T20:58:22.758 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:22.759 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.759 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.759 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:22.759 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766901+0000", 2020-11-16T20:58:22.760 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8690000000000001e-05 2020-11-16T20:58:22.760 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.760 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.760 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:22.760 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766930+0000", 2020-11-16T20:58:22.760 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6980000000000003e-06 2020-11-16T20:58:22.761 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.761 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.761 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:22.761 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766935+0000", 2020-11-16T20:58:22.761 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.908e-06 2020-11-16T20:58:22.761 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.761 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.762 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:22.762 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766941+0000", 2020-11-16T20:58:22.762 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7480000000000002e-06 2020-11-16T20:58:22.762 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.762 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.762 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:22.762 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766944+0000", 2020-11-16T20:58:22.763 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2626999999999995e-05 2020-11-16T20:58:22.763 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.763 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.763 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.763 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.767007+0000", 2020-11-16T20:58:22.763 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0340000000000002e-06 2020-11-16T20:58:22.764 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.764 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.764 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:22.764 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.767016+0000", 2020-11-16T20:58:22.764 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.28093276700000003 2020-11-16T20:58:22.764 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.764 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.765 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.765 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.047948+0000", 2020-11-16T20:58:22.765 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0480000000000003e-05 2020-11-16T20:58:22.765 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.765 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.765 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for missing object", 2020-11-16T20:58:22.766 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.048019+0000", 2020-11-16T20:58:22.766 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0022703580000000001 2020-11-16T20:58:22.766 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.766 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.766 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.767 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.050289+0000", 2020-11-16T20:58:22.767 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2658999999999997e-05 2020-11-16T20:58:22.767 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.767 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.767 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:22.767 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.050362+0000", 2020-11-16T20:58:22.768 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020014204000000001 2020-11-16T20:58:22.768 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.768 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.768 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.768 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.070376+0000", 2020-11-16T20:58:22.768 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2409999999999994e-05 2020-11-16T20:58:22.768 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.769 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.769 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:22.769 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.070438+0000", 2020-11-16T20:58:22.769 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014435586 2020-11-16T20:58:22.769 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.769 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.770 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.770 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.084874+0000", 2020-11-16T20:58:22.770 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000132924 2020-11-16T20:58:22.770 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.770 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.770 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:22.771 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.085007+0000", 2020-11-16T20:58:22.771 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019703200000000001 2020-11-16T20:58:22.771 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.771 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.771 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 1,4,5", 2020-11-16T20:58:22.771 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.085204+0000", 2020-11-16T20:58:22.772 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007388515 2020-11-16T20:58:22.772 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.772 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.772 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:22.772 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.092592+0000", 2020-11-16T20:58:22.772 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0056161220000000003 2020-11-16T20:58:22.773 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.773 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.773 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:22.773 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.098209+0000", 2020-11-16T20:58:22.773 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000711507 2020-11-16T20:58:22.773 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.773 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.774 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:22.774 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.098920+0000", 2020-11-16T20:58:22.774 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021120463999999999 2020-11-16T20:58:22.774 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.774 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.774 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:22.775 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.120041+0000", 2020-11-16T20:58:22.775 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000118075 2020-11-16T20:58:22.775 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.775 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.775 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:22.775 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.120159+0000", 2020-11-16T20:58:22.775 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024441600000000001 2020-11-16T20:58:22.776 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.776 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.776 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:22.776 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.120403+0000", 2020-11-16T20:58:22.776 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.35350222399999998 2020-11-16T20:58:22.776 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.776 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:22.777 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.777 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.777 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.777 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3963 4.0 4:3a07a2f4:::smithi16641208-265:head [cache-try-flush] snapc 0=[] RETRY=2 ondisk+retry+read+skiprwlocks+known_if_redirected e162)", 2020-11-16T20:58:22.777 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:10.773500+0000", 2020-11-16T20:58:22.777 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 11.803779864999999, 2020-11-16T20:58:22.777 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.33046096899999999, 2020-11-16T20:58:22.777 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:22.778 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:22.778 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:22.778 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:22.778 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:22.778 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3963 2020-11-16T20:58:22.778 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.779 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:22.779 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.779 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:22.779 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773500+0000", 2020-11-16T20:58:22.779 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:22.779 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.780 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.780 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:22.780 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773500+0000", 2020-11-16T20:58:22.780 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3399000000000001e-05 2020-11-16T20:58:22.780 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.781 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.781 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:22.781 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773524+0000", 2020-11-16T20:58:22.781 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4179999999999996e-06 2020-11-16T20:58:22.781 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.782 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.782 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:22.782 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773529+0000", 2020-11-16T20:58:22.782 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6570000000000003e-06 2020-11-16T20:58:22.782 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.783 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.783 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:22.783 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773538+0000", 2020-11-16T20:58:22.783 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3510000000000001e-06 2020-11-16T20:58:22.783 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.784 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.784 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:22.784 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773543+0000", 2020-11-16T20:58:22.784 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045181399999999998 2020-11-16T20:58:22.784 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.784 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.784 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.785 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773995+0000", 2020-11-16T20:58:22.785 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8842e-05 2020-11-16T20:58:22.785 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.785 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.785 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:22.785 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.774014+0000", 2020-11-16T20:58:22.786 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.28760152999999999 2020-11-16T20:58:22.786 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.786 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.786 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.786 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.061615+0000", 2020-11-16T20:58:22.786 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00090118499999999999 2020-11-16T20:58:22.787 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.787 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.787 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for degraded object", 2020-11-16T20:58:22.787 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.062517+0000", 2020-11-16T20:58:22.787 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.040906721 2020-11-16T20:58:22.788 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.788 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.788 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.788 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.103423+0000", 2020-11-16T20:58:22.788 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024524799999999999 2020-11-16T20:58:22.788 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.789 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.789 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:22.789 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.103669+0000", 2020-11-16T20:58:22.789 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029280400000000002 2020-11-16T20:58:22.789 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.789 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.790 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:22.790 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.103961+0000", 2020-11-16T20:58:22.790 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.33046096899999999 2020-11-16T20:58:22.790 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.790 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:22.791 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.791 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.791 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.791 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3965 4.0 4:3c624f0a:::smithi16641208-415:head [stat,delete] snapc 71=[61] RETRY=1 ondisk+retry+write+known_if_redirected e162)", 2020-11-16T20:58:22.791 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:10.773566+0000", 2020-11-16T20:58:22.791 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 11.803713931000001, 2020-11-16T20:58:22.792 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.34725477199999999, 2020-11-16T20:58:22.792 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:22.792 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:22.792 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:22.792 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:22.792 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:22.793 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3965 2020-11-16T20:58:22.793 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.793 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:22.793 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.793 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:22.793 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773566+0000", 2020-11-16T20:58:22.793 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:22.794 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.794 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.794 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:22.794 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773566+0000", 2020-11-16T20:58:22.794 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1405000000000002e-05 2020-11-16T20:58:22.794 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.795 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.795 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:22.795 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773598+0000", 2020-11-16T20:58:22.795 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6130000000000003e-06 2020-11-16T20:58:22.795 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.795 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.796 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:22.796 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773603+0000", 2020-11-16T20:58:22.796 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.163e-05 2020-11-16T20:58:22.796 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.796 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.796 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:22.796 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773615+0000", 2020-11-16T20:58:22.797 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.271e-06 2020-11-16T20:58:22.797 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.797 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.797 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:22.797 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773620+0000", 2020-11-16T20:58:22.797 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00051486000000000001 2020-11-16T20:58:22.797 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.797 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.798 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.774135+0000", 2020-11-16T20:58:22.798 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2503999999999999e-05 2020-11-16T20:58:22.798 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.798 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:22.798 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.774148+0000", 2020-11-16T20:58:22.799 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.29208424700000002 2020-11-16T20:58:22.799 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.799 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.799 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.799 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.066232+0000", 2020-11-16T20:58:22.799 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028906180000000002 2020-11-16T20:58:22.799 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.800 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.800 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for degraded object", 2020-11-16T20:58:22.800 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.069123+0000", 2020-11-16T20:58:22.800 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.046887930000000001 2020-11-16T20:58:22.801 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.801 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.801 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.801 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.116010+0000", 2020-11-16T20:58:22.801 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012060100000000001 2020-11-16T20:58:22.801 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.801 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.802 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:22.802 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.116131+0000", 2020-11-16T20:58:22.802 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000244694 2020-11-16T20:58:22.802 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.802 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.802 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 1,2", 2020-11-16T20:58:22.803 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.116376+0000", 2020-11-16T20:58:22.803 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029448370000000001 2020-11-16T20:58:22.803 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.803 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.803 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:22.803 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.119321+0000", 2020-11-16T20:58:22.803 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000901792 2020-11-16T20:58:22.803 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.804 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.804 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:22.804 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.120222+0000", 2020-11-16T20:58:22.804 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024859600000000002 2020-11-16T20:58:22.804 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.804 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.804 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:22.805 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.120471+0000", 2020-11-16T20:58:22.805 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3827999999999997e-05 2020-11-16T20:58:22.805 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.805 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.805 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:22.805 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.120565+0000", 2020-11-16T20:58:22.805 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00025634600000000002 2020-11-16T20:58:22.806 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.806 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.806 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:22.806 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.120821+0000", 2020-11-16T20:58:22.806 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.34725477199999999 2020-11-16T20:58:22.806 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.806 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:22.807 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.807 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.807 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.807 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "MOSDPGPushReply(4.0 163/161 [PushReplyOp(4:04ed47ba:::smithi16641208-462:head)])", 2020-11-16T20:58:22.807 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.008764+0000", 2020-11-16T20:58:22.807 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.568516448, 2020-11-16T20:58:22.807 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050833534999999999, 2020-11-16T20:58:22.808 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:22.808 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:22.808 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:22.808 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.808 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:22.808 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.008764+0000", 2020-11-16T20:58:22.808 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:22.809 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.809 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.809 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:22.809 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.008764+0000", 2020-11-16T20:58:22.809 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0648999999999997e-05 2020-11-16T20:58:22.809 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.809 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.810 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:22.810 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.008794+0000", 2020-11-16T20:58:22.810 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1911e-05 2020-11-16T20:58:22.810 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.810 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.810 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:22.810 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.008806+0000", 2020-11-16T20:58:22.811 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1381e-05 2020-11-16T20:58:22.811 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.811 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.811 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:22.811 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.008818+0000", 2020-11-16T20:58:22.811 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9460000000000003e-06 2020-11-16T20:58:22.811 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.811 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.812 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:22.812 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.008824+0000", 2020-11-16T20:58:22.812 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.048239439000000002 2020-11-16T20:58:22.812 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.812 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.812 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.812 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.057063+0000", 2020-11-16T20:58:22.813 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0025342089999999999 2020-11-16T20:58:22.813 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.813 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.813 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:22.813 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.059597+0000", 2020-11-16T20:58:22.813 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050833534999999999 2020-11-16T20:58:22.813 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.814 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:22.814 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.814 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.814 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.814 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "MOSDPGPushReply(4.0 163/161 [PushReplyOp(4:1e6cac27:::smithi16641208-165:head)])", 2020-11-16T20:58:22.814 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.011973+0000", 2020-11-16T20:58:22.814 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.565307202, 2020-11-16T20:58:22.815 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.055325996000000002, 2020-11-16T20:58:22.815 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:22.815 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:22.815 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:22.815 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.815 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:22.815 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.011973+0000", 2020-11-16T20:58:22.815 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:22.816 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.816 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.816 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:22.816 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.011973+0000", 2020-11-16T20:58:22.816 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8260999999999999e-05 2020-11-16T20:58:22.816 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.816 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.817 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:22.817 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.012001+0000", 2020-11-16T20:58:22.817 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9039999999999992e-06 2020-11-16T20:58:22.817 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.817 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.817 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:22.817 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.012009+0000", 2020-11-16T20:58:22.818 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2295e-05 2020-11-16T20:58:22.818 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.818 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.818 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:22.818 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.012022+0000", 2020-11-16T20:58:22.818 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0759999999999999e-06 2020-11-16T20:58:22.818 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.818 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.819 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:22.819 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.012028+0000", 2020-11-16T20:58:22.819 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.051366063000000003 2020-11-16T20:58:22.819 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.819 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.819 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.819 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.063394+0000", 2020-11-16T20:58:22.820 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039053970000000001 2020-11-16T20:58:22.820 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.820 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.820 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:22.820 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.067299+0000", 2020-11-16T20:58:22.820 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.055325996000000002 2020-11-16T20:58:22.820 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.821 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:22.821 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.821 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.821 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.821 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "MOSDPGPushReply(3.0 163/161 [PushReplyOp(3:2644dcd6:::smithi16641208-437:head)])", 2020-11-16T20:58:22.821 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.020962+0000", 2020-11-16T20:58:22.821 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.556318328, 2020-11-16T20:58:22.821 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.051574284999999997, 2020-11-16T20:58:22.822 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:22.822 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:22.822 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:22.822 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.822 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:22.822 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.020962+0000", 2020-11-16T20:58:22.823 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:22.823 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.823 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.823 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:22.823 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.020962+0000", 2020-11-16T20:58:22.823 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0400999999999999e-05 2020-11-16T20:58:22.823 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.823 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.824 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:22.824 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.020992+0000", 2020-11-16T20:58:22.824 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8589999999999999e-06 2020-11-16T20:58:22.824 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.824 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.824 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:22.824 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.020999+0000", 2020-11-16T20:58:22.825 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2777e-05 2020-11-16T20:58:22.825 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.825 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.825 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:22.825 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.021012+0000", 2020-11-16T20:58:22.825 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7560000000000002e-06 2020-11-16T20:58:22.825 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.826 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.826 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:22.826 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.021019+0000", 2020-11-16T20:58:22.826 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050137168000000003 2020-11-16T20:58:22.826 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.826 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.826 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:22.827 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.071156+0000", 2020-11-16T20:58:22.827 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001380324 2020-11-16T20:58:22.827 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:22.827 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:22.827 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:22.827 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.072536+0000", 2020-11-16T20:58:22.827 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.051574284999999997 2020-11-16T20:58:22.827 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.828 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:22.828 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.828 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:22.828 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:22.828 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:22.830 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:58:22.830 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:22.834+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:22.930 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:58:22.934+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:58:23.003 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:23.004 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:58:23.004 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.004 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3975 4.2 4:64b35751:::smithi16641208-112:head [cache-evict] snapc 0=[] RETRY=1 ondisk+retry+read+ignore_cache+known_if_redirected e164)", 2020-11-16T20:58:23.004 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.897176+0000", 2020-11-16T20:58:23.004 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.111545906, 2020-11-16T20:58:23.005 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 10.111563421, 2020-11-16T20:58:23.005 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.005 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.005 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.005 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.005 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.005 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3975 2020-11-16T20:58:23.006 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.006 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.006 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.006 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.006 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.897176+0000", 2020-11-16T20:58:23.006 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.007 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.007 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.007 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.007 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.897176+0000", 2020-11-16T20:58:23.007 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1625999999999999e-05 2020-11-16T20:58:23.007 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.007 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.008 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.008 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.897197+0000", 2020-11-16T20:58:23.008 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0810000000000001e-06 2020-11-16T20:58:23.008 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.008 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.008 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.008 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.897202+0000", 2020-11-16T20:58:23.009 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.5729999999999997e-06 2020-11-16T20:58:23.009 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.009 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.009 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.009 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.897212+0000", 2020-11-16T20:58:23.009 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5879999999999997e-06 2020-11-16T20:58:23.009 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.010 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.010 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.010 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.897217+0000", 2020-11-16T20:58:23.010 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1517e-05 2020-11-16T20:58:23.010 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.010 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.011 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.011 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.897289+0000", 2020-11-16T20:58:23.011 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7859999999999997e-06 2020-11-16T20:58:23.011 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.011 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.011 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:23.011 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.897297+0000", 2020-11-16T20:58:23.012 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0066684240000000001 2020-11-16T20:58:23.012 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.012 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.012 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.012 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.903965+0000", 2020-11-16T20:58:23.012 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5735999999999995e-05 2020-11-16T20:58:23.012 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.013 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.013 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.013 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.904041+0000", 2020-11-16T20:58:23.013 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0068653309999999997 2020-11-16T20:58:23.013 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.013 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.013 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.014 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.014 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.014 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3999 4.2 4:745e23d0:::smithi16641208-19:61 [sparse-read 0~2302526,omap-get-vals-by-keys in=4b,omap-get-keys in=12b,omap-get-vals in=16b,omap-get-header,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e164)", 2020-11-16T20:58:23.014 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.917926+0000", 2020-11-16T20:58:23.014 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.090795563, 2020-11-16T20:58:23.014 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 10.090865224, 2020-11-16T20:58:23.014 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.015 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.015 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.015 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.015 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.015 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3999 2020-11-16T20:58:23.015 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.016 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.016 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.016 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.917926+0000", 2020-11-16T20:58:23.016 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.016 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.016 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.017 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.017 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.917926+0000", 2020-11-16T20:58:23.017 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6408000000000001e-05 2020-11-16T20:58:23.017 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.017 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.017 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.017 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.917962+0000", 2020-11-16T20:58:23.018 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8800000000000002e-06 2020-11-16T20:58:23.018 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.018 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.018 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.018 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.917969+0000", 2020-11-16T20:58:23.018 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0138e-05 2020-11-16T20:58:23.018 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.019 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.019 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.019 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.917979+0000", 2020-11-16T20:58:23.019 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.559e-06 2020-11-16T20:58:23.019 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.019 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.019 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.020 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.917987+0000", 2020-11-16T20:58:23.020 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9042999999999995e-05 2020-11-16T20:58:23.020 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.020 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.020 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.020 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918066+0000", 2020-11-16T20:58:23.020 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6357000000000003e-05 2020-11-16T20:58:23.021 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.021 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.021 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.021 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918122+0000", 2020-11-16T20:58:23.021 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019638500000000001 2020-11-16T20:58:23.021 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.021 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.022 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.022 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.022 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.022 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4000 4.2 4:745e23d0:::smithi16641208-19:61 [read 0~2302526,checksum in=4b] snapc 0=[] ondisk+read+known_if_redirected e164)", 2020-11-16T20:58:23.022 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.918023+0000", 2020-11-16T20:58:23.022 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.090698519, 2020-11-16T20:58:23.022 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 10.09080471, 2020-11-16T20:58:23.023 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.023 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.023 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.023 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.023 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.023 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4000 2020-11-16T20:58:23.024 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.024 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.024 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.024 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.024 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918023+0000", 2020-11-16T20:58:23.024 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.024 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.025 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.025 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.025 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918023+0000", 2020-11-16T20:58:23.025 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0352999999999999e-05 2020-11-16T20:58:23.025 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.025 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.025 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.026 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918053+0000", 2020-11-16T20:58:23.026 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8310000000000003e-06 2020-11-16T20:58:23.026 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.026 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.026 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.026 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918057+0000", 2020-11-16T20:58:23.026 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8970000000000002e-06 2020-11-16T20:58:23.027 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.027 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.027 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.027 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918064+0000", 2020-11-16T20:58:23.027 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1930000000000002e-06 2020-11-16T20:58:23.027 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.027 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.028 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.028 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918067+0000", 2020-11-16T20:58:23.028 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2993999999999998e-05 2020-11-16T20:58:23.028 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.028 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.028 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.028 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918160+0000", 2020-11-16T20:58:23.029 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9496999999999999e-05 2020-11-16T20:58:23.029 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.029 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.029 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.029 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918190+0000", 2020-11-16T20:58:23.029 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016676500000000001 2020-11-16T20:58:23.029 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.030 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.030 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.030 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.030 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.030 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4001 4.2 4:745e23d0:::smithi16641208-19:61 [sparse-read 0~2302526] snapc 0=[] ondisk+read+known_if_redirected e164)", 2020-11-16T20:58:23.030 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.918095+0000", 2020-11-16T20:58:23.030 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.090626236, 2020-11-16T20:58:23.031 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 10.090767754, 2020-11-16T20:58:23.031 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.031 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.031 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.031 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.031 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.032 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4001 2020-11-16T20:58:23.032 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.032 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.032 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.032 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.032 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918095+0000", 2020-11-16T20:58:23.032 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.033 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.033 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.033 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.033 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918095+0000", 2020-11-16T20:58:23.033 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5238000000000001e-05 2020-11-16T20:58:23.033 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.033 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.034 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.034 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918120+0000", 2020-11-16T20:58:23.034 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9260000000000002e-06 2020-11-16T20:58:23.034 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.034 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.034 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.034 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918124+0000", 2020-11-16T20:58:23.035 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.0320000000000003e-06 2020-11-16T20:58:23.035 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.035 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.035 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.035 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918132+0000", 2020-11-16T20:58:23.035 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3240000000000002e-06 2020-11-16T20:58:23.036 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.036 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.036 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.036 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918138+0000", 2020-11-16T20:58:23.036 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5117000000000005e-05 2020-11-16T20:58:23.036 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.036 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.037 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.037 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918223+0000", 2020-11-16T20:58:23.037 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8767000000000002e-05 2020-11-16T20:58:23.037 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.037 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.037 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.037 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.918282+0000", 2020-11-16T20:58:23.038 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018640400000000001 2020-11-16T20:58:23.038 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.038 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.038 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.038 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.038 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.038 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4002 4.2 4:49e2d88b:::smithi16641208-294:head [write 564900~578776 in=578776b] snapc 74=[74,73,61] ondisk+write+known_if_redirected e164)", 2020-11-16T20:58:23.039 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.925477+0000", 2020-11-16T20:58:23.039 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.083244218000001, 2020-11-16T20:58:23.039 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 10.08342139, 2020-11-16T20:58:23.039 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.039 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.039 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.039 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.040 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.040 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4002 2020-11-16T20:58:23.040 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.040 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.040 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.040 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.040 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.925477+0000", 2020-11-16T20:58:23.041 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.041 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.041 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.041 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.041 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.925477+0000", 2020-11-16T20:58:23.041 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00036541600000000003 2020-11-16T20:58:23.041 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.042 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.042 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.042 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.925843+0000", 2020-11-16T20:58:23.042 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0791000000000001e-05 2020-11-16T20:58:23.042 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.042 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.042 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.043 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.925853+0000", 2020-11-16T20:58:23.043 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7586999999999999e-05 2020-11-16T20:58:23.043 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.043 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.043 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.043 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.925871+0000", 2020-11-16T20:58:23.043 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8099999999999992e-06 2020-11-16T20:58:23.044 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.044 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.044 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.044 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.925881+0000", 2020-11-16T20:58:23.044 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2830000000000006e-05 2020-11-16T20:58:23.044 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.044 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.045 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.045 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.925954+0000", 2020-11-16T20:58:23.045 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8269999999999997e-05 2020-11-16T20:58:23.045 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.045 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.045 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.045 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.926002+0000", 2020-11-16T20:58:23.046 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00052470399999999997 2020-11-16T20:58:23.046 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.046 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.046 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.046 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.046 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.047 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4003 4.2 4:49e2d88b:::smithi16641208-294:head [write 1629160~709913 in=709913b] snapc 74=[74,73,61] ondisk+write+known_if_redirected e164)", 2020-11-16T20:58:23.047 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.933381+0000", 2020-11-16T20:58:23.047 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.075340408000001, 2020-11-16T20:58:23.047 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 10.075553042999999, 2020-11-16T20:58:23.047 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.047 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.047 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.048 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.048 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.048 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4003 2020-11-16T20:58:23.048 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.048 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.048 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.048 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.049 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.933381+0000", 2020-11-16T20:58:23.049 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.049 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.049 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.049 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.049 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.933381+0000", 2020-11-16T20:58:23.049 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000205455 2020-11-16T20:58:23.050 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.050 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.050 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.050 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.933586+0000", 2020-11-16T20:58:23.050 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8999999999999995e-06 2020-11-16T20:58:23.050 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.051 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.051 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.051 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.933595+0000", 2020-11-16T20:58:23.051 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6484999999999999e-05 2020-11-16T20:58:23.051 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.051 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.051 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.052 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.933612+0000", 2020-11-16T20:58:23.052 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.5149999999999995e-06 2020-11-16T20:58:23.052 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.052 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.052 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.052 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.933621+0000", 2020-11-16T20:58:23.052 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2448999999999999e-05 2020-11-16T20:58:23.053 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.053 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.053 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.053 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.933674+0000", 2020-11-16T20:58:23.053 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4453999999999999e-05 2020-11-16T20:58:23.053 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.053 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.054 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.054 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.933708+0000", 2020-11-16T20:58:23.054 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032725799999999998 2020-11-16T20:58:23.054 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.054 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.054 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.054 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.055 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.055 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4004 4.2 4:49e2d88b:::smithi16641208-294:head [write 3073389~492409 in=492409b] snapc 74=[74,73,61] ondisk+write+known_if_redirected e164)", 2020-11-16T20:58:23.055 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.940933+0000", 2020-11-16T20:58:23.055 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.067788057, 2020-11-16T20:58:23.055 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 10.068036125000001, 2020-11-16T20:58:23.055 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.055 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.056 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.056 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.056 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.056 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4004 2020-11-16T20:58:23.056 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.056 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.056 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.057 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.057 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.940933+0000", 2020-11-16T20:58:23.057 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.057 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.057 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.057 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.057 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.940933+0000", 2020-11-16T20:58:23.058 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029702599999999998 2020-11-16T20:58:23.058 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.058 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.058 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.058 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941230+0000", 2020-11-16T20:58:23.058 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0472000000000001e-05 2020-11-16T20:58:23.058 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.059 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.059 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.059 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941241+0000", 2020-11-16T20:58:23.059 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7234000000000001e-05 2020-11-16T20:58:23.059 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.059 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.059 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.060 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941258+0000", 2020-11-16T20:58:23.060 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.4110000000000002e-06 2020-11-16T20:58:23.060 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.060 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.060 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.060 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941268+0000", 2020-11-16T20:58:23.060 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2966000000000001e-05 2020-11-16T20:58:23.061 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.061 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.061 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.061 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941320+0000", 2020-11-16T20:58:23.061 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1665999999999998e-05 2020-11-16T20:58:23.061 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.061 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.062 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.062 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941352+0000", 2020-11-16T20:58:23.062 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00041877499999999997 2020-11-16T20:58:23.062 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.062 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.062 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.062 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.063 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.063 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4005 4.2 4:49e2d88b:::smithi16641208-294:head [setxattr _header (58) in=65b,truncate 3764900] snapc 74=[74,73,61] ondisk+write+known_if_redirected e164)", 2020-11-16T20:58:23.063 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.941320+0000", 2020-11-16T20:58:23.063 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.067401335, 2020-11-16T20:58:23.063 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 10.067686166, 2020-11-16T20:58:23.063 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.064 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.064 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.064 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.064 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.064 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4005 2020-11-16T20:58:23.064 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.064 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.065 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941320+0000", 2020-11-16T20:58:23.065 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.065 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.065 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.065 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941320+0000", 2020-11-16T20:58:23.066 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8509e-05 2020-11-16T20:58:23.066 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.066 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.066 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.066 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941359+0000", 2020-11-16T20:58:23.066 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5609999999999998e-06 2020-11-16T20:58:23.067 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.067 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.067 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.067 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941364+0000", 2020-11-16T20:58:23.067 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2717999999999999e-05 2020-11-16T20:58:23.067 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.067 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.068 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.068 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941377+0000", 2020-11-16T20:58:23.068 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9110000000000001e-06 2020-11-16T20:58:23.068 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.068 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.068 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.068 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941382+0000", 2020-11-16T20:58:23.069 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7580999999999997e-05 2020-11-16T20:58:23.069 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.069 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.069 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.069 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941429+0000", 2020-11-16T20:58:23.069 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7358999999999998e-05 2020-11-16T20:58:23.069 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.070 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.070 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.070 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941477+0000", 2020-11-16T20:58:23.070 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000156639 2020-11-16T20:58:23.070 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.070 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.070 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.071 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.071 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.071 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4006 4.2 4:49e2d88b:::smithi16641208-294:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e164)", 2020-11-16T20:58:23.071 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.941414+0000", 2020-11-16T20:58:23.071 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.067307408, 2020-11-16T20:58:23.071 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 10.067627129, 2020-11-16T20:58:23.071 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.072 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.072 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.072 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.072 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.072 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4006 2020-11-16T20:58:23.072 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.072 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.073 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.073 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.073 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941414+0000", 2020-11-16T20:58:23.073 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.073 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.073 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.073 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.074 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941414+0000", 2020-11-16T20:58:23.074 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6101999999999998e-05 2020-11-16T20:58:23.074 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.074 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.074 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.074 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941440+0000", 2020-11-16T20:58:23.074 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6380000000000003e-06 2020-11-16T20:58:23.075 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.075 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.075 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.075 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941445+0000", 2020-11-16T20:58:23.075 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2040000000000003e-06 2020-11-16T20:58:23.075 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.076 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.076 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.076 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941454+0000", 2020-11-16T20:58:23.076 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.805e-06 2020-11-16T20:58:23.076 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.076 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.076 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.077 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941458+0000", 2020-11-16T20:58:23.077 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5073e-05 2020-11-16T20:58:23.077 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.077 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.077 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.077 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941503+0000", 2020-11-16T20:58:23.077 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5981e-05 2020-11-16T20:58:23.078 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.078 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.078 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.078 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941539+0000", 2020-11-16T20:58:23.078 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012480299999999999 2020-11-16T20:58:23.078 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.078 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.079 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.079 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.079 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.079 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4007 4.2 4:75836747:::smithi16641208-340:head [append 0~0] snapc 74=[74,73,61] ondisk+write+known_if_redirected e164)", 2020-11-16T20:58:23.079 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.941488+0000", 2020-11-16T20:58:23.079 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.067233313999999, 2020-11-16T20:58:23.079 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 10.067588223, 2020-11-16T20:58:23.080 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.080 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.080 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.080 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.080 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.080 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4007 2020-11-16T20:58:23.080 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.081 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.081 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.081 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.081 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941488+0000", 2020-11-16T20:58:23.081 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.081 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.081 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.082 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.082 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941488+0000", 2020-11-16T20:58:23.082 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6095e-05 2020-11-16T20:58:23.082 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.082 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.082 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.083 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941514+0000", 2020-11-16T20:58:23.083 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6500000000000004e-06 2020-11-16T20:58:23.083 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.083 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.083 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.083 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941519+0000", 2020-11-16T20:58:23.083 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4619999999999996e-06 2020-11-16T20:58:23.084 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.084 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.084 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.084 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941527+0000", 2020-11-16T20:58:23.084 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3100000000000002e-06 2020-11-16T20:58:23.084 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.084 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.085 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.085 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941532+0000", 2020-11-16T20:58:23.085 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4950999999999998e-05 2020-11-16T20:58:23.085 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.085 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.085 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.085 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941567+0000", 2020-11-16T20:58:23.086 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7274999999999998e-05 2020-11-16T20:58:23.086 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.086 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.086 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.086 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941604+0000", 2020-11-16T20:58:23.086 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011574300000000001 2020-11-16T20:58:23.086 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.087 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.087 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.087 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.087 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.087 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4008 4.2 4:75836747:::smithi16641208-340:head [rollback 73] snapc 74=[74,73,61] ondisk+write+known_if_redirected e164)", 2020-11-16T20:58:23.087 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.941561+0000", 2020-11-16T20:58:23.087 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.067160757, 2020-11-16T20:58:23.088 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 10.067550543999999, 2020-11-16T20:58:23.088 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.088 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.088 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.088 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.088 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.089 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4008 2020-11-16T20:58:23.089 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.089 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.089 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.089 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.089 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941561+0000", 2020-11-16T20:58:23.089 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.090 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.090 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.090 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.090 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941561+0000", 2020-11-16T20:58:23.090 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5449999999999999e-05 2020-11-16T20:58:23.090 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.090 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.091 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.091 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941586+0000", 2020-11-16T20:58:23.091 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4750000000000004e-06 2020-11-16T20:58:23.091 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.091 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.091 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.091 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941591+0000", 2020-11-16T20:58:23.092 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2190000000000004e-06 2020-11-16T20:58:23.092 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.092 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.092 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.092 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941599+0000", 2020-11-16T20:58:23.092 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.647e-06 2020-11-16T20:58:23.092 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.093 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.093 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.093 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941602+0000", 2020-11-16T20:58:23.093 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6807000000000002e-05 2020-11-16T20:58:23.093 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.093 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.093 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.094 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941639+0000", 2020-11-16T20:58:23.094 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4644999999999998e-05 2020-11-16T20:58:23.094 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.094 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.094 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.094 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941674+0000", 2020-11-16T20:58:23.094 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000113243 2020-11-16T20:58:23.095 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.095 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.095 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.095 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.095 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.095 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4009 4.2 4:75836747:::smithi16641208-340:head [append 0~0] snapc 74=[74,73,61] ondisk+write+known_if_redirected e164)", 2020-11-16T20:58:23.095 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.941638+0000", 2020-11-16T20:58:23.096 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 10.067083082, 2020-11-16T20:58:23.096 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 10.067508009999999, 2020-11-16T20:58:23.096 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.096 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.096 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.096 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.097 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.097 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4009 2020-11-16T20:58:23.097 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.097 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.097 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.097 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.097 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941638+0000", 2020-11-16T20:58:23.098 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.098 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.098 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.098 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.098 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941638+0000", 2020-11-16T20:58:23.098 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5511e-05 2020-11-16T20:58:23.098 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.099 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.099 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.099 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941664+0000", 2020-11-16T20:58:23.099 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4610000000000001e-06 2020-11-16T20:58:23.099 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.099 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.099 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.100 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941668+0000", 2020-11-16T20:58:23.100 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2810000000000008e-06 2020-11-16T20:58:23.100 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.100 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.100 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.100 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941677+0000", 2020-11-16T20:58:23.100 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4800000000000001e-06 2020-11-16T20:58:23.101 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.101 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.101 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.101 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941680+0000", 2020-11-16T20:58:23.101 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4869000000000001e-05 2020-11-16T20:58:23.101 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.101 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.102 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.102 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941715+0000", 2020-11-16T20:58:23.102 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1737999999999999e-05 2020-11-16T20:58:23.102 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.102 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.102 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.102 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.941757+0000", 2020-11-16T20:58:23.103 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011834 2020-11-16T20:58:23.103 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.103 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.103 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.103 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.103 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:58:23.103 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 12 2020-11-16T20:58:23.104 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:23.105 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:58:23.105 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:23.109+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:23.205 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:23.209+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:23.270 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:23.271 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:58:23.271 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:58:23.271 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:58:23.271 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:23.280 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-16T20:58:23.323 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:23.328+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:23.406 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:23.407 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:58:23.407 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:58:23.407 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:58:23.407 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.407 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2583 4.2 4:75836747:::smithi16641208-340:head [setxattr _header (58) in=7b,truncate 3159815] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:58:23.408 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.770345+0000", 2020-11-16T20:58:23.408 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 123.640110896, 2020-11-16T20:58:23.408 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.079764311000000004, 2020-11-16T20:58:23.408 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.408 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:23.408 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.408 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.409 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.409 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2583 2020-11-16T20:58:23.409 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.409 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.409 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.409 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.409 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770345+0000", 2020-11-16T20:58:23.410 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.410 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.410 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.410 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.410 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770345+0000", 2020-11-16T20:58:23.410 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9728999999999999e-05 2020-11-16T20:58:23.410 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.411 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.411 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.411 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770384+0000", 2020-11-16T20:58:23.411 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3849999999999999e-06 2020-11-16T20:58:23.411 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.411 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.411 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.412 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770391+0000", 2020-11-16T20:58:23.412 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0865e-05 2020-11-16T20:58:23.412 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.412 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.412 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.412 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770401+0000", 2020-11-16T20:58:23.412 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7599999999999999e-06 2020-11-16T20:58:23.413 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.413 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.413 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.413 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.770407+0000", 2020-11-16T20:58:23.413 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00082697999999999995 2020-11-16T20:58:23.413 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.413 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.413 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.414 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771234+0000", 2020-11-16T20:58:23.414 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8841000000000001e-05 2020-11-16T20:58:23.414 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.414 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.414 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:23.414 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771293+0000", 2020-11-16T20:58:23.414 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.028773502999999999 2020-11-16T20:58:23.415 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.415 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.415 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.415 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800067+0000", 2020-11-16T20:58:23.415 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011809199999999999 2020-11-16T20:58:23.415 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.415 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.416 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:23.416 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800185+0000", 2020-11-16T20:58:23.416 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00041150300000000002 2020-11-16T20:58:23.416 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.416 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.416 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 4,5", 2020-11-16T20:58:23.416 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800596+0000", 2020-11-16T20:58:23.416 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078037820000000004 2020-11-16T20:58:23.417 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.417 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.417 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:23.417 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808400+0000", 2020-11-16T20:58:23.417 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.040583162999999998 2020-11-16T20:58:23.417 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.417 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.418 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:23.418 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.848983+0000", 2020-11-16T20:58:23.418 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00096703299999999996 2020-11-16T20:58:23.418 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.418 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.418 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:23.418 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.849950+0000", 2020-11-16T20:58:23.419 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6266999999999994e-05 2020-11-16T20:58:23.419 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.419 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.419 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:23.419 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850016+0000", 2020-11-16T20:58:23.419 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.2408e-05 2020-11-16T20:58:23.419 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.419 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.420 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:23.420 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850109+0000", 2020-11-16T20:58:23.420 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.079764311000000004 2020-11-16T20:58:23.420 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.420 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.420 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.420 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.421 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.421 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2584 4.2 4:75836747:::smithi16641208-340:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:58:23.421 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.771084+0000", 2020-11-16T20:58:23.421 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 123.63937148300001, 2020-11-16T20:58:23.421 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.079415345999999998, 2020-11-16T20:58:23.421 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.421 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:23.422 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.422 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.422 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.422 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2584 2020-11-16T20:58:23.422 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.422 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.422 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.423 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.423 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771084+0000", 2020-11-16T20:58:23.423 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.423 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.423 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.423 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.423 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771084+0000", 2020-11-16T20:58:23.423 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3832999999999999e-05 2020-11-16T20:58:23.424 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.424 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.424 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.424 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771118+0000", 2020-11-16T20:58:23.424 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2299999999999996e-06 2020-11-16T20:58:23.424 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.424 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.425 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.425 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771124+0000", 2020-11-16T20:58:23.425 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1649e-05 2020-11-16T20:58:23.425 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.425 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.425 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.425 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771136+0000", 2020-11-16T20:58:23.425 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7389999999999996e-06 2020-11-16T20:58:23.426 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.426 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.426 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.426 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771141+0000", 2020-11-16T20:58:23.426 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000251332 2020-11-16T20:58:23.426 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.426 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.427 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.427 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771393+0000", 2020-11-16T20:58:23.427 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0130999999999997e-05 2020-11-16T20:58:23.427 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.427 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.427 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:23.427 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.771453+0000", 2020-11-16T20:58:23.428 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036790163000000001 2020-11-16T20:58:23.428 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.428 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.428 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.428 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808243+0000", 2020-11-16T20:58:23.428 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000122781 2020-11-16T20:58:23.428 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.429 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.429 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:23.429 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808366+0000", 2020-11-16T20:58:23.429 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.041793941000000001 2020-11-16T20:58:23.429 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.429 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.429 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.429 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850160+0000", 2020-11-16T20:58:23.430 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8177000000000005e-05 2020-11-16T20:58:23.430 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.430 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.430 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:23.430 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850258+0000", 2020-11-16T20:58:23.430 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024137 2020-11-16T20:58:23.430 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.431 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.431 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:23.431 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.850499+0000", 2020-11-16T20:58:23.431 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.079415345999999998 2020-11-16T20:58:23.431 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.431 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.431 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.432 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.432 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.432 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:14 3.0 3:3b92f709:::smithi16641208-69:head [copy-from ver 517] snapc 2b=[f] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e97)", 2020-11-16T20:58:23.432 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.813636+0000", 2020-11-16T20:58:23.432 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 81.596818952999996, 2020-11-16T20:58:23.432 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.068038797999999998, 2020-11-16T20:58:23.432 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.432 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:23.433 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.433 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.433 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.433 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813636+0000", 2020-11-16T20:58:23.433 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.433 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.433 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.434 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.434 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813636+0000", 2020-11-16T20:58:23.434 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4759000000000001e-05 2020-11-16T20:58:23.434 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.434 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.434 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.434 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813661+0000", 2020-11-16T20:58:23.435 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4690000000000002e-06 2020-11-16T20:58:23.435 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.435 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.435 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.435 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813665+0000", 2020-11-16T20:58:23.435 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0939999999999996e-06 2020-11-16T20:58:23.435 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.436 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.436 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.436 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813671+0000", 2020-11-16T20:58:23.436 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9490000000000001e-06 2020-11-16T20:58:23.436 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.436 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.436 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.436 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813674+0000", 2020-11-16T20:58:23.437 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035912158999999999 2020-11-16T20:58:23.437 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.437 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.437 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.437 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849586+0000", 2020-11-16T20:58:23.437 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000105225 2020-11-16T20:58:23.437 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.438 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.438 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:23.438 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849691+0000", 2020-11-16T20:58:23.438 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094697400000000008 2020-11-16T20:58:23.438 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.438 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.438 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,2", 2020-11-16T20:58:23.439 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.859161+0000", 2020-11-16T20:58:23.439 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.022310784 2020-11-16T20:58:23.439 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.439 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.439 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:23.439 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881472+0000", 2020-11-16T20:58:23.439 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7089000000000003e-05 2020-11-16T20:58:23.440 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.440 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.440 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:23.440 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881519+0000", 2020-11-16T20:58:23.440 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9331000000000004e-05 2020-11-16T20:58:23.440 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.440 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.440 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:23.441 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881588+0000", 2020-11-16T20:58:23.441 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9375000000000001e-05 2020-11-16T20:58:23.441 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.441 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.441 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:23.441 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881637+0000", 2020-11-16T20:58:23.441 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7824000000000002e-05 2020-11-16T20:58:23.442 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.442 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.442 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:23.442 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881675+0000", 2020-11-16T20:58:23.442 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.068038797999999998 2020-11-16T20:58:23.442 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.442 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.443 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.443 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.443 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.443 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3084 3.0 3:0eeb4688:::smithi16641208-459:head [copy-from ver 165] snapc 38=[38] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e97)", 2020-11-16T20:58:23.443 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.814118+0000", 2020-11-16T20:58:23.443 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 81.596337195000004, 2020-11-16T20:58:23.443 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.078238367000000003, 2020-11-16T20:58:23.444 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.444 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:23.444 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.444 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.444 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.444 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814118+0000", 2020-11-16T20:58:23.444 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.444 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.445 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.445 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.445 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814118+0000", 2020-11-16T20:58:23.445 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.262e-05 2020-11-16T20:58:23.445 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.445 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.445 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.446 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814141+0000", 2020-11-16T20:58:23.446 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.169e-05 2020-11-16T20:58:23.446 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.446 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.446 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.446 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814153+0000", 2020-11-16T20:58:23.446 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5350000000000004e-06 2020-11-16T20:58:23.446 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.447 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.447 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.447 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814161+0000", 2020-11-16T20:58:23.447 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1760000000000003e-06 2020-11-16T20:58:23.447 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.447 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.447 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.448 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814165+0000", 2020-11-16T20:58:23.448 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035740382000000001 2020-11-16T20:58:23.448 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.448 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.448 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.448 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849906+0000", 2020-11-16T20:58:23.448 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2356999999999999e-05 2020-11-16T20:58:23.449 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.449 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.449 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:23.449 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849978+0000", 2020-11-16T20:58:23.449 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016929244999999999 2020-11-16T20:58:23.449 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.449 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.449 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,2", 2020-11-16T20:58:23.450 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.866907+0000", 2020-11-16T20:58:23.450 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024555357 2020-11-16T20:58:23.450 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.450 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.450 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:23.450 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.891463+0000", 2020-11-16T20:58:23.450 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00067812000000000005 2020-11-16T20:58:23.451 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.451 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.451 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:23.451 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892141+0000", 2020-11-16T20:58:23.451 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3387999999999997e-05 2020-11-16T20:58:23.451 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.451 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.452 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:23.452 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892204+0000", 2020-11-16T20:58:23.452 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4189999999999994e-05 2020-11-16T20:58:23.452 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.452 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.452 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:23.452 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892268+0000", 2020-11-16T20:58:23.452 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8306999999999993e-05 2020-11-16T20:58:23.453 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.453 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.453 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:23.453 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892357+0000", 2020-11-16T20:58:23.453 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.078238367000000003 2020-11-16T20:58:23.453 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.453 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.454 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.454 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.454 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.454 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:16 3.0 3:0eeb4688:::smithi16641208-459:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e97)", 2020-11-16T20:58:23.454 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.814220+0000", 2020-11-16T20:58:23.454 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 81.596235265000004, 2020-11-16T20:58:23.454 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.078457661999999997, 2020-11-16T20:58:23.454 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.455 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:23.455 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.455 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.455 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.455 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814220+0000", 2020-11-16T20:58:23.455 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.455 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.456 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.456 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.456 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814220+0000", 2020-11-16T20:58:23.456 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6680999999999998e-05 2020-11-16T20:58:23.456 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.456 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.456 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.457 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814237+0000", 2020-11-16T20:58:23.457 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4029999999999999e-06 2020-11-16T20:58:23.457 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.457 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.457 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.457 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814240+0000", 2020-11-16T20:58:23.457 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5980000000000002e-06 2020-11-16T20:58:23.457 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.458 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.458 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.458 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814247+0000", 2020-11-16T20:58:23.458 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1489999999999998e-06 2020-11-16T20:58:23.458 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.458 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.458 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.459 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814250+0000", 2020-11-16T20:58:23.459 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035894660000000002 2020-11-16T20:58:23.459 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.459 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.459 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.459 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850145+0000", 2020-11-16T20:58:23.459 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2685000000000001e-05 2020-11-16T20:58:23.460 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.460 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.460 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:23.460 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850197+0000", 2020-11-16T20:58:23.460 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030551076999999999 2020-11-16T20:58:23.460 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.460 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.460 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.461 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.880748+0000", 2020-11-16T20:58:23.461 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011375900000000001 2020-11-16T20:58:23.461 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.461 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.461 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:23.461 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.880862+0000", 2020-11-16T20:58:23.461 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011676122000000001 2020-11-16T20:58:23.462 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.462 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.462 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.462 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892538+0000", 2020-11-16T20:58:23.462 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7021999999999997e-05 2020-11-16T20:58:23.462 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.462 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.463 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:23.463 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892595+0000", 2020-11-16T20:58:23.463 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2505999999999999e-05 2020-11-16T20:58:23.463 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.463 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.463 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:23.463 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892678+0000", 2020-11-16T20:58:23.463 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.078457661999999997 2020-11-16T20:58:23.464 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.464 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.464 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.464 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.464 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.464 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:17 3.0 3:0eeb4688:::smithi16641208-459:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e97)", 2020-11-16T20:58:23.464 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.814270+0000", 2020-11-16T20:58:23.465 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 81.596185895999994, 2020-11-16T20:58:23.465 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.082632504999999995, 2020-11-16T20:58:23.465 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.465 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:23.465 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.465 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.465 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.466 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814270+0000", 2020-11-16T20:58:23.466 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.466 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.466 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.466 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.466 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814270+0000", 2020-11-16T20:58:23.466 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3700999999999999e-05 2020-11-16T20:58:23.467 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.467 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.467 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.467 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814293+0000", 2020-11-16T20:58:23.467 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7879999999999998e-06 2020-11-16T20:58:23.467 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.467 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.467 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.468 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814296+0000", 2020-11-16T20:58:23.468 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6509999999999998e-06 2020-11-16T20:58:23.468 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.468 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.468 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.468 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814302+0000", 2020-11-16T20:58:23.468 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1039999999999996e-06 2020-11-16T20:58:23.469 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.469 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.469 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.469 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814311+0000", 2020-11-16T20:58:23.469 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.035912305999999998 2020-11-16T20:58:23.469 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.469 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.469 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.470 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850223+0000", 2020-11-16T20:58:23.470 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5476000000000003e-05 2020-11-16T20:58:23.470 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.470 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.470 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:23.470 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850269+0000", 2020-11-16T20:58:23.470 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.030645256999999999 2020-11-16T20:58:23.471 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.471 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.471 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.471 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.880914+0000", 2020-11-16T20:58:23.471 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3608000000000004e-05 2020-11-16T20:58:23.471 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.471 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.472 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:23.472 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.880987+0000", 2020-11-16T20:58:23.472 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011720252 2020-11-16T20:58:23.472 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.472 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.472 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.472 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892708+0000", 2020-11-16T20:58:23.473 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4710000000000003e-05 2020-11-16T20:58:23.473 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.473 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.473 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:23.473 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892762+0000", 2020-11-16T20:58:23.473 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0041396519999999997 2020-11-16T20:58:23.473 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.473 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.474 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:23.474 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.896902+0000", 2020-11-16T20:58:23.474 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.082632504999999995 2020-11-16T20:58:23.474 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.474 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.474 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.474 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.475 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.475 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:19 3.0 3:1e015f5d:::smithi16641208-120:head [copy-from ver 447] snapc e=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e97)", 2020-11-16T20:58:23.475 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.814940+0000", 2020-11-16T20:58:23.475 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 81.595515354, 2020-11-16T20:58:23.475 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.077559996000000006, 2020-11-16T20:58:23.475 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.475 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:23.475 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.476 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.476 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.476 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814940+0000", 2020-11-16T20:58:23.476 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.476 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.476 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.476 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.477 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.814940+0000", 2020-11-16T20:58:23.477 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0903000000000003e-05 2020-11-16T20:58:23.477 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.477 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.477 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.477 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815001+0000", 2020-11-16T20:58:23.477 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1119999999999998e-06 2020-11-16T20:58:23.478 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.478 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.478 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.478 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815008+0000", 2020-11-16T20:58:23.478 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1421e-05 2020-11-16T20:58:23.478 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.478 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.479 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.479 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815019+0000", 2020-11-16T20:58:23.479 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6509999999999998e-06 2020-11-16T20:58:23.479 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.479 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.479 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.479 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815025+0000", 2020-11-16T20:58:23.479 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036337921000000002 2020-11-16T20:58:23.480 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.480 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.480 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.480 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851363+0000", 2020-11-16T20:58:23.480 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012654300000000001 2020-11-16T20:58:23.480 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.480 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.481 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:23.481 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851490+0000", 2020-11-16T20:58:23.481 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025530690000000002 2020-11-16T20:58:23.481 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.481 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.481 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,2", 2020-11-16T20:58:23.481 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.877020+0000", 2020-11-16T20:58:23.482 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.01516898 2020-11-16T20:58:23.482 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.482 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.482 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:23.482 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892189+0000", 2020-11-16T20:58:23.482 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017819600000000001 2020-11-16T20:58:23.482 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.482 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.483 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:23.483 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892367+0000", 2020-11-16T20:58:23.483 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6916999999999999e-05 2020-11-16T20:58:23.483 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.483 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.483 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:23.483 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892404+0000", 2020-11-16T20:58:23.484 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1143999999999998e-05 2020-11-16T20:58:23.484 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.484 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.484 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:23.484 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892446+0000", 2020-11-16T20:58:23.484 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4518000000000002e-05 2020-11-16T20:58:23.484 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.485 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.485 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:23.485 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.892500+0000", 2020-11-16T20:58:23.485 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.077559996000000006 2020-11-16T20:58:23.485 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.485 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.485 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.485 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.486 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.486 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3105 3.0 3:1ccd20f3:::smithi16641208-424:head [stat,delete] snapc 38=[38] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e97)", 2020-11-16T20:58:23.486 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.815082+0000", 2020-11-16T20:58:23.486 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 81.595373688999999, 2020-11-16T20:58:23.486 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066146218000000007, 2020-11-16T20:58:23.486 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.486 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:23.487 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.487 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.487 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.487 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815082+0000", 2020-11-16T20:58:23.487 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.487 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.487 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.488 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.488 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815082+0000", 2020-11-16T20:58:23.488 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0209000000000002e-05 2020-11-16T20:58:23.488 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.488 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.488 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.488 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815112+0000", 2020-11-16T20:58:23.489 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7830000000000004e-06 2020-11-16T20:58:23.489 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.489 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.489 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.489 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815118+0000", 2020-11-16T20:58:23.489 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0927000000000001e-05 2020-11-16T20:58:23.489 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.489 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.490 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.490 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815129+0000", 2020-11-16T20:58:23.490 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3059999999999997e-06 2020-11-16T20:58:23.490 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.490 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.490 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.490 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815134+0000", 2020-11-16T20:58:23.491 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036502199999999999 2020-11-16T20:58:23.491 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.491 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.491 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.491 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851636+0000", 2020-11-16T20:58:23.491 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016290900000000001 2020-11-16T20:58:23.491 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.492 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.492 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:23.492 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851799+0000", 2020-11-16T20:58:23.492 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00028645999999999999 2020-11-16T20:58:23.492 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.492 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.492 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,2", 2020-11-16T20:58:23.492 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852086+0000", 2020-11-16T20:58:23.493 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003854007 2020-11-16T20:58:23.493 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.493 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.493 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:23.493 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.855940+0000", 2020-11-16T20:58:23.493 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0019815750000000002 2020-11-16T20:58:23.493 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.494 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.494 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:23.494 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.857921+0000", 2020-11-16T20:58:23.494 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.023126626000000001 2020-11-16T20:58:23.494 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.494 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.494 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:23.495 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881048+0000", 2020-11-16T20:58:23.495 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.0409999999999998e-05 2020-11-16T20:58:23.495 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.495 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.495 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:23.495 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881128+0000", 2020-11-16T20:58:23.495 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9806e-05 2020-11-16T20:58:23.495 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.496 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.496 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:23.496 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881228+0000", 2020-11-16T20:58:23.496 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066146218000000007 2020-11-16T20:58:23.496 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.496 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.496 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.497 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.497 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.497 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:21 3.0 3:1ccd20f3:::smithi16641208-424:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e97)", 2020-11-16T20:58:23.497 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.815178+0000", 2020-11-16T20:58:23.497 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 81.595277351999997, 2020-11-16T20:58:23.497 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066300320999999995, 2020-11-16T20:58:23.497 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.498 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:23.498 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.498 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.498 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.498 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815178+0000", 2020-11-16T20:58:23.498 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.498 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.499 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.499 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.499 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815178+0000", 2020-11-16T20:58:23.499 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8203000000000001e-05 2020-11-16T20:58:23.499 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.499 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.499 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.499 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815206+0000", 2020-11-16T20:58:23.500 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7729999999999996e-06 2020-11-16T20:58:23.500 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.500 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.500 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.500 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815212+0000", 2020-11-16T20:58:23.500 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.149e-05 2020-11-16T20:58:23.500 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.501 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.501 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.501 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815224+0000", 2020-11-16T20:58:23.501 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3900000000000001e-06 2020-11-16T20:58:23.501 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.501 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.501 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.502 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815229+0000", 2020-11-16T20:58:23.502 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039388232000000002 2020-11-16T20:58:23.502 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.502 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.502 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.502 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.854617+0000", 2020-11-16T20:58:23.502 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012693099999999999 2020-11-16T20:58:23.503 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.503 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.503 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:23.503 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.854744+0000", 2020-11-16T20:58:23.503 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026509525999999999 2020-11-16T20:58:23.503 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.503 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.503 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.504 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881254+0000", 2020-11-16T20:58:23.504 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2397000000000005e-05 2020-11-16T20:58:23.504 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.504 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.504 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:23.504 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881326+0000", 2020-11-16T20:58:23.504 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015237900000000001 2020-11-16T20:58:23.505 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.505 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.505 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:23.505 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881478+0000", 2020-11-16T20:58:23.505 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066300320999999995 2020-11-16T20:58:23.505 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.505 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.505 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.506 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.506 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.506 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:22 3.0 3:1ccd20f3:::smithi16641208-424:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e97)", 2020-11-16T20:58:23.506 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:01.815264+0000", 2020-11-16T20:58:23.506 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 81.595190912000007, 2020-11-16T20:58:23.506 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066644708999999996, 2020-11-16T20:58:23.506 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.507 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:23.507 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.507 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.507 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.507 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815264+0000", 2020-11-16T20:58:23.507 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.507 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.508 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.508 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.508 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815264+0000", 2020-11-16T20:58:23.508 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5266999999999999e-05 2020-11-16T20:58:23.508 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.508 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.508 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.508 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815310+0000", 2020-11-16T20:58:23.509 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3989999999999998e-06 2020-11-16T20:58:23.509 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.509 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.509 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.509 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815317+0000", 2020-11-16T20:58:23.509 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.082e-05 2020-11-16T20:58:23.509 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.510 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.510 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.510 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815328+0000", 2020-11-16T20:58:23.510 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0220000000000004e-06 2020-11-16T20:58:23.510 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.510 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.510 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.511 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815333+0000", 2020-11-16T20:58:23.511 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039899660000000003 2020-11-16T20:58:23.511 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.511 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.511 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.511 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.855233+0000", 2020-11-16T20:58:23.511 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2051000000000004e-05 2020-11-16T20:58:23.512 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.512 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.512 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:23.512 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.855315+0000", 2020-11-16T20:58:23.512 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026394424 2020-11-16T20:58:23.512 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.512 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.512 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.513 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881709+0000", 2020-11-16T20:58:23.513 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020006599999999999 2020-11-16T20:58:23.513 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.513 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.513 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:23.513 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.881909+0000", 2020-11-16T20:58:23.513 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066644708999999996 2020-11-16T20:58:23.514 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.514 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.514 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.514 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.514 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.514 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:68 3.0 3:266da985:::smithi16641208-406:head [copy-get max 8388608] snapc 0=[] RETRY=2 ondisk+retry+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:58:23.514 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.832133+0000", 2020-11-16T20:58:23.515 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 63.578321913000003, 2020-11-16T20:58:23.515 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054097583999999997, 2020-11-16T20:58:23.515 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.515 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:23.515 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.515 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.515 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.515 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832133+0000", 2020-11-16T20:58:23.516 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.516 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.516 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.516 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.516 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832133+0000", 2020-11-16T20:58:23.516 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1003e-05 2020-11-16T20:58:23.516 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.517 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.517 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.517 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832175+0000", 2020-11-16T20:58:23.517 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7960000000000001e-06 2020-11-16T20:58:23.517 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.517 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.517 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.518 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832180+0000", 2020-11-16T20:58:23.518 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0349e-05 2020-11-16T20:58:23.518 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.518 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.518 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.518 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832191+0000", 2020-11-16T20:58:23.518 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3000000000000001e-06 2020-11-16T20:58:23.518 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.519 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.519 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.519 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832196+0000", 2020-11-16T20:58:23.519 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6594000000000001e-05 2020-11-16T20:58:23.519 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.519 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.519 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.520 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832243+0000", 2020-11-16T20:58:23.520 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2993000000000001e-05 2020-11-16T20:58:23.520 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.520 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.520 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:23.520 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832256+0000", 2020-11-16T20:58:23.520 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.045506131999999998 2020-11-16T20:58:23.521 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.521 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.521 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.521 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.877762+0000", 2020-11-16T20:58:23.521 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010955600000000001 2020-11-16T20:58:23.521 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.521 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.521 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:23.522 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.877871+0000", 2020-11-16T20:58:23.522 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042134119999999997 2020-11-16T20:58:23.522 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.522 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.522 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.522 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.882085+0000", 2020-11-16T20:58:23.522 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014105699999999999 2020-11-16T20:58:23.523 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.523 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.523 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:23.523 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.882226+0000", 2020-11-16T20:58:23.523 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004005392 2020-11-16T20:58:23.523 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.523 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.524 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:23.524 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886231+0000", 2020-11-16T20:58:23.524 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054097583999999997 2020-11-16T20:58:23.524 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.524 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.524 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.524 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.524 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.525 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3327 3.0 3:2949283c:::smithi16641208-44:head [write 537989~722069,stat] snapc 49=[49,48,44,41] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e115)", 2020-11-16T20:58:23.525 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.832232+0000", 2020-11-16T20:58:23.525 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 63.578223432000001, 2020-11-16T20:58:23.525 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054524729000000001, 2020-11-16T20:58:23.525 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.525 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:23.525 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.526 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.526 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.526 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832232+0000", 2020-11-16T20:58:23.526 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.526 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.526 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.526 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.527 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832232+0000", 2020-11-16T20:58:23.527 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00040025400000000001 2020-11-16T20:58:23.527 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.527 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.527 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.527 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832632+0000", 2020-11-16T20:58:23.527 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5050000000000004e-06 2020-11-16T20:58:23.527 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.528 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.528 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.528 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832639+0000", 2020-11-16T20:58:23.528 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1299e-05 2020-11-16T20:58:23.528 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.528 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.528 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.529 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832650+0000", 2020-11-16T20:58:23.529 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8030000000000002e-06 2020-11-16T20:58:23.529 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.529 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.529 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.529 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832656+0000", 2020-11-16T20:58:23.529 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8779000000000003e-05 2020-11-16T20:58:23.530 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.530 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.530 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.530 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832695+0000", 2020-11-16T20:58:23.530 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9789999999999993e-06 2020-11-16T20:58:23.530 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.530 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.530 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:23.531 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832703+0000", 2020-11-16T20:58:23.531 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.045361931000000001 2020-11-16T20:58:23.531 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.531 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.531 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.531 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.878065+0000", 2020-11-16T20:58:23.531 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000221418 2020-11-16T20:58:23.532 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.532 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.532 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:23.532 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.878286+0000", 2020-11-16T20:58:23.532 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023917099999999999 2020-11-16T20:58:23.532 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.532 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.533 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 2,6", 2020-11-16T20:58:23.533 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.878525+0000", 2020-11-16T20:58:23.533 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003510988 2020-11-16T20:58:23.533 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.533 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.533 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:23.533 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.882036+0000", 2020-11-16T20:58:23.533 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0044535720000000003 2020-11-16T20:58:23.534 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.534 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.534 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:23.534 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886490+0000", 2020-11-16T20:58:23.534 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0692999999999996e-05 2020-11-16T20:58:23.534 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.534 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.535 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:23.535 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886560+0000", 2020-11-16T20:58:23.535 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5710000000000001e-05 2020-11-16T20:58:23.535 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.535 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.535 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:23.535 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886606+0000", 2020-11-16T20:58:23.536 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015062699999999999 2020-11-16T20:58:23.536 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.536 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.536 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:23.536 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886757+0000", 2020-11-16T20:58:23.536 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054524729000000001 2020-11-16T20:58:23.536 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.536 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.537 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.537 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.537 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.537 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:70 3.0 3:2949283c:::smithi16641208-44:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:58:23.537 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.832688+0000", 2020-11-16T20:58:23.537 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 63.577767012999999, 2020-11-16T20:58:23.537 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054473900999999998, 2020-11-16T20:58:23.538 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.538 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:23.538 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.538 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.538 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.538 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832688+0000", 2020-11-16T20:58:23.538 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.539 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.539 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.539 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.539 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832688+0000", 2020-11-16T20:58:23.539 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5730999999999999e-05 2020-11-16T20:58:23.539 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.539 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.539 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.540 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832704+0000", 2020-11-16T20:58:23.540 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0690000000000002e-06 2020-11-16T20:58:23.540 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.540 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.540 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.540 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832707+0000", 2020-11-16T20:58:23.540 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9719999999999997e-06 2020-11-16T20:58:23.541 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.541 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.541 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.541 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832713+0000", 2020-11-16T20:58:23.541 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8650000000000001e-06 2020-11-16T20:58:23.541 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.541 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.542 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.542 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832716+0000", 2020-11-16T20:58:23.542 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8541999999999998e-05 2020-11-16T20:58:23.542 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.542 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.542 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.542 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832755+0000", 2020-11-16T20:58:23.543 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.153e-05 2020-11-16T20:58:23.543 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.543 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.543 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:23.543 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832766+0000", 2020-11-16T20:58:23.543 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.047763647999999999 2020-11-16T20:58:23.543 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.543 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.544 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.544 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.880530+0000", 2020-11-16T20:58:23.544 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016090599999999999 2020-11-16T20:58:23.544 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.544 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.544 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:23.544 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.880691+0000", 2020-11-16T20:58:23.545 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0061198809999999998 2020-11-16T20:58:23.545 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.545 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.545 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.545 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886811+0000", 2020-11-16T20:58:23.545 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012478200000000001 2020-11-16T20:58:23.545 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.546 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.546 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:23.546 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886935+0000", 2020-11-16T20:58:23.546 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000226975 2020-11-16T20:58:23.546 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.546 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.546 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:23.547 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.887162+0000", 2020-11-16T20:58:23.547 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.054473900999999998 2020-11-16T20:58:23.547 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.547 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.547 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.547 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.547 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.547 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:71 3.0 3:2949283c:::smithi16641208-44:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:58:23.548 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.832747+0000", 2020-11-16T20:58:23.548 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 63.577708164999997, 2020-11-16T20:58:23.548 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.057126753000000002, 2020-11-16T20:58:23.548 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.548 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:23.548 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.548 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.549 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.549 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832747+0000", 2020-11-16T20:58:23.549 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.549 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.549 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.549 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.549 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832747+0000", 2020-11-16T20:58:23.549 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3911000000000001e-05 2020-11-16T20:58:23.550 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.550 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.550 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.550 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832781+0000", 2020-11-16T20:58:23.550 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2480000000000001e-06 2020-11-16T20:58:23.550 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.550 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.551 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.551 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832784+0000", 2020-11-16T20:58:23.551 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2040000000000002e-06 2020-11-16T20:58:23.551 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.551 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.551 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.551 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832791+0000", 2020-11-16T20:58:23.552 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2399999999999999e-06 2020-11-16T20:58:23.552 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.552 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.552 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.552 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832794+0000", 2020-11-16T20:58:23.552 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2548000000000002e-05 2020-11-16T20:58:23.552 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.552 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.553 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.553 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832816+0000", 2020-11-16T20:58:23.553 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4160000000000003e-06 2020-11-16T20:58:23.553 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.553 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.553 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:23.553 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.832822+0000", 2020-11-16T20:58:23.554 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.053459245000000002 2020-11-16T20:58:23.554 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.554 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.554 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.554 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886281+0000", 2020-11-16T20:58:23.554 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018665399999999999 2020-11-16T20:58:23.554 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.555 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.555 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:23.555 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.886468+0000", 2020-11-16T20:58:23.555 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00075232499999999998 2020-11-16T20:58:23.555 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.555 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.555 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.556 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.887220+0000", 2020-11-16T20:58:23.556 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000152974 2020-11-16T20:58:23.556 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.556 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.556 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:23.556 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.887373+0000", 2020-11-16T20:58:23.556 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002500988 2020-11-16T20:58:23.556 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.557 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.557 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:23.557 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.889874+0000", 2020-11-16T20:58:23.557 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.057126753000000002 2020-11-16T20:58:23.557 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.557 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.557 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.558 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.558 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.558 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3346 3.0 3:1e5364a0:::smithi16641208-320:head [write 588410~547816,stat] snapc 4a=[4a,49,48,44,41] ondisk+write+ignore_cache+ignore_overlay+known_if_redirected e115)", 2020-11-16T20:58:23.558 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.839179+0000", 2020-11-16T20:58:23.558 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 63.571276410999999, 2020-11-16T20:58:23.558 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.084752201999999999, 2020-11-16T20:58:23.558 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.558 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:23.559 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.559 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.559 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.559 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839179+0000", 2020-11-16T20:58:23.559 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.559 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.559 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.560 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.560 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839179+0000", 2020-11-16T20:58:23.560 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000250175 2020-11-16T20:58:23.560 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.560 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.560 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.560 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839429+0000", 2020-11-16T20:58:23.561 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.22e-06 2020-11-16T20:58:23.561 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.561 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.561 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.561 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839434+0000", 2020-11-16T20:58:23.561 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0258000000000001e-05 2020-11-16T20:58:23.561 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.561 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.562 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.562 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839445+0000", 2020-11-16T20:58:23.562 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8019999999999999e-06 2020-11-16T20:58:23.562 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.562 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.562 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.562 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839449+0000", 2020-11-16T20:58:23.563 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1084999999999997e-05 2020-11-16T20:58:23.563 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.563 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.563 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.563 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839491+0000", 2020-11-16T20:58:23.563 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4239999999999993e-06 2020-11-16T20:58:23.563 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.564 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.564 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:23.564 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839499+0000", 2020-11-16T20:58:23.564 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050428550000000003 2020-11-16T20:58:23.564 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.564 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.564 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.564 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.889928+0000", 2020-11-16T20:58:23.565 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030713000000000002 2020-11-16T20:58:23.565 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.565 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.565 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:23.565 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.890235+0000", 2020-11-16T20:58:23.565 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00047229800000000001 2020-11-16T20:58:23.565 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.566 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.566 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 2,6", 2020-11-16T20:58:23.566 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.890707+0000", 2020-11-16T20:58:23.566 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0046488600000000003 2020-11-16T20:58:23.566 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.566 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.566 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:23.567 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895356+0000", 2020-11-16T20:58:23.567 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.028228664000000001 2020-11-16T20:58:23.567 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.567 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.567 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:23.567 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.923584+0000", 2020-11-16T20:58:23.567 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3496e-05 2020-11-16T20:58:23.567 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.568 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.568 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:23.568 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.923608+0000", 2020-11-16T20:58:23.568 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0390999999999997e-05 2020-11-16T20:58:23.568 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.568 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.568 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:23.569 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.923678+0000", 2020-11-16T20:58:23.569 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00025284899999999998 2020-11-16T20:58:23.569 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.569 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.569 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:23.569 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.923931+0000", 2020-11-16T20:58:23.569 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.084752201999999999 2020-11-16T20:58:23.569 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.570 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.570 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.570 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.570 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.570 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:73 3.0 3:1e5364a0:::smithi16641208-320:snapdir [list-snaps] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:58:23.570 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.839479+0000", 2020-11-16T20:58:23.570 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 63.570976180000002, 2020-11-16T20:58:23.571 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.089078473000000005, 2020-11-16T20:58:23.571 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.571 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:23.571 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.571 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.571 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.571 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839479+0000", 2020-11-16T20:58:23.572 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.572 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.572 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.572 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.572 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839479+0000", 2020-11-16T20:58:23.572 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8124000000000001e-05 2020-11-16T20:58:23.572 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.572 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.573 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.573 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839497+0000", 2020-11-16T20:58:23.573 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1580000000000001e-06 2020-11-16T20:58:23.573 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.573 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.573 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.573 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839501+0000", 2020-11-16T20:58:23.574 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6579999999999996e-06 2020-11-16T20:58:23.574 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.574 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.574 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.574 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839507+0000", 2020-11-16T20:58:23.574 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9720000000000001e-06 2020-11-16T20:58:23.574 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.575 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.575 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.575 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839510+0000", 2020-11-16T20:58:23.575 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1950000000000003e-05 2020-11-16T20:58:23.575 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.575 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.575 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.576 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839552+0000", 2020-11-16T20:58:23.576 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2225999999999999e-05 2020-11-16T20:58:23.576 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.576 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.576 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:23.576 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839564+0000", 2020-11-16T20:58:23.576 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.055483693000000001 2020-11-16T20:58:23.576 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.577 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.577 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.577 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895048+0000", 2020-11-16T20:58:23.577 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022632500000000001 2020-11-16T20:58:23.577 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.577 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.577 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:23.578 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895274+0000", 2020-11-16T20:58:23.578 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032777323999999997 2020-11-16T20:58:23.578 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.578 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.578 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.578 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928052+0000", 2020-11-16T20:58:23.578 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000150321 2020-11-16T20:58:23.578 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.579 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.579 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:23.579 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928202+0000", 2020-11-16T20:58:23.579 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00035572199999999999 2020-11-16T20:58:23.579 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.579 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.579 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:23.580 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928558+0000", 2020-11-16T20:58:23.580 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.089078473000000005 2020-11-16T20:58:23.580 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.580 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.580 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.580 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.580 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.581 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.2.13:74 3.0 3:1e5364a0:::smithi16641208-320:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e115)", 2020-11-16T20:58:23.581 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:19.839542+0000", 2020-11-16T20:58:23.581 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 63.570913550999997, 2020-11-16T20:58:23.581 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.093226218, 2020-11-16T20:58:23.581 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.581 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:23.581 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.581 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.582 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.582 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839542+0000", 2020-11-16T20:58:23.582 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.582 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.582 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.582 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.582 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839542+0000", 2020-11-16T20:58:23.583 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6640000000000002e-05 2020-11-16T20:58:23.583 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.583 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.583 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.583 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839578+0000", 2020-11-16T20:58:23.583 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.416e-06 2020-11-16T20:58:23.583 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.584 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.584 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.584 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839582+0000", 2020-11-16T20:58:23.584 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9070000000000001e-06 2020-11-16T20:58:23.584 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.584 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.584 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.584 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839589+0000", 2020-11-16T20:58:23.585 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.994e-06 2020-11-16T20:58:23.585 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.585 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.585 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.585 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839592+0000", 2020-11-16T20:58:23.585 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4881000000000001e-05 2020-11-16T20:58:23.585 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.586 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.586 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.586 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839617+0000", 2020-11-16T20:58:23.586 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4330000000000003e-06 2020-11-16T20:58:23.586 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.586 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.586 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:23.587 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.839622+0000", 2020-11-16T20:58:23.587 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.055765016000000001 2020-11-16T20:58:23.587 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.587 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.587 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.587 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895387+0000", 2020-11-16T20:58:23.587 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000145926 2020-11-16T20:58:23.587 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.588 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.588 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:23.588 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.895533+0000", 2020-11-16T20:58:23.588 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033078547999999999 2020-11-16T20:58:23.588 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.588 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.588 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.589 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928612+0000", 2020-11-16T20:58:23.589 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114621 2020-11-16T20:58:23.589 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.589 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.589 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:23.589 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.928726+0000", 2020-11-16T20:58:23.589 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.004041836 2020-11-16T20:58:23.590 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.590 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.590 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:23.590 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:19.932768+0000", 2020-11-16T20:58:23.590 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.093226218 2020-11-16T20:58:23.590 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.590 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.590 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.591 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.591 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.591 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3414 4.3 4:cf270c70:::smithi16641208-423:head [copy-from ver 586] snapc 4f=[4f,48] ondisk+write+known_if_redirected e120)", 2020-11-16T20:58:23.591 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:24.750833+0000", 2020-11-16T20:58:23.591 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 58.659622314000003, 2020-11-16T20:58:23.591 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.064670209000000006, 2020-11-16T20:58:23.591 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.592 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:23.592 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.592 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.592 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.592 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3414 2020-11-16T20:58:23.592 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.592 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.592 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.593 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.593 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750833+0000", 2020-11-16T20:58:23.593 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.593 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.593 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.593 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.593 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750833+0000", 2020-11-16T20:58:23.594 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4888e-05 2020-11-16T20:58:23.594 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.594 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.594 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.594 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750858+0000", 2020-11-16T20:58:23.594 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6359999999999997e-06 2020-11-16T20:58:23.594 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.595 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.595 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.595 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750865+0000", 2020-11-16T20:58:23.595 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4072e-05 2020-11-16T20:58:23.595 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.595 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.595 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.596 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750879+0000", 2020-11-16T20:58:23.596 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1409999999999994e-06 2020-11-16T20:58:23.596 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.596 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.596 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.596 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750888+0000", 2020-11-16T20:58:23.596 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000413664 2020-11-16T20:58:23.596 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.597 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.597 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.597 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751301+0000", 2020-11-16T20:58:23.597 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1214e-05 2020-11-16T20:58:23.597 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.597 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.597 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op must wait for map", 2020-11-16T20:58:23.598 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751313+0000", 2020-11-16T20:58:23.598 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078009489999999997 2020-11-16T20:58:23.598 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.598 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.598 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.598 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.759114+0000", 2020-11-16T20:58:23.598 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.056386372999999997 2020-11-16T20:58:23.598 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.599 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.599 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:23.599 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.815500+0000", 2020-11-16T20:58:23.599 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2720000000000002e-06 2020-11-16T20:58:23.599 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.599 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.599 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:23.600 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.815503+0000", 2020-11-16T20:58:23.600 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.064670209000000006 2020-11-16T20:58:23.600 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.600 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.600 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.600 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.600 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.601 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3415 4.3 4:cf270c70:::smithi16641208-423:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e120)", 2020-11-16T20:58:23.601 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:24.750930+0000", 2020-11-16T20:58:23.601 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 58.659525836, 2020-11-16T20:58:23.601 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.064785488000000002, 2020-11-16T20:58:23.601 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.601 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:23.601 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.601 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.602 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.602 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3415 2020-11-16T20:58:23.602 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.602 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.602 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.602 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.602 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750930+0000", 2020-11-16T20:58:23.603 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.603 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.603 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.603 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.603 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750930+0000", 2020-11-16T20:58:23.603 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7016e-05 2020-11-16T20:58:23.603 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.604 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.604 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.604 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750957+0000", 2020-11-16T20:58:23.604 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7379999999999999e-06 2020-11-16T20:58:23.604 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.604 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.604 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.604 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750962+0000", 2020-11-16T20:58:23.605 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0684e-05 2020-11-16T20:58:23.605 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.605 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.605 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.605 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750973+0000", 2020-11-16T20:58:23.605 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2089999999999996e-06 2020-11-16T20:58:23.605 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.606 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.606 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.606 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.750978+0000", 2020-11-16T20:58:23.606 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00039269899999999999 2020-11-16T20:58:23.606 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.606 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.606 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.607 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751371+0000", 2020-11-16T20:58:23.607 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7460000000000003e-06 2020-11-16T20:58:23.607 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.607 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.607 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:58:23.607 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751378+0000", 2020-11-16T20:58:23.607 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0092297239999999999 2020-11-16T20:58:23.607 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.608 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.608 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.608 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.760607+0000", 2020-11-16T20:58:23.608 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.055107672000000003 2020-11-16T20:58:23.608 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.608 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.608 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:23.609 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.815715+0000", 2020-11-16T20:58:23.609 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.064785488000000002 2020-11-16T20:58:23.609 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.609 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.609 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.609 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.609 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.609 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3416 4.3 4:f6d44bd7:::smithi16641208-454:48 [cache-flush] snapc 0=[] ondisk+read+ignore_cache+known_if_redirected e120)", 2020-11-16T20:58:23.610 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:24.751009+0000", 2020-11-16T20:58:23.610 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 58.659446047000003, 2020-11-16T20:58:23.610 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066511669999999995, 2020-11-16T20:58:23.610 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.610 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:23.610 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.610 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.611 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.611 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3416 2020-11-16T20:58:23.611 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.611 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.611 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.611 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.611 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751009+0000", 2020-11-16T20:58:23.612 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.612 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.612 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.612 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.612 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751009+0000", 2020-11-16T20:58:23.612 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2008999999999999e-05 2020-11-16T20:58:23.612 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.612 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.613 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.613 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751031+0000", 2020-11-16T20:58:23.613 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1550000000000004e-06 2020-11-16T20:58:23.613 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.613 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.613 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.613 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751038+0000", 2020-11-16T20:58:23.614 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1149999999999996e-06 2020-11-16T20:58:23.614 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.614 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.614 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.614 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751045+0000", 2020-11-16T20:58:23.614 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8959999999999996e-06 2020-11-16T20:58:23.614 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.615 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.615 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.615 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751049+0000", 2020-11-16T20:58:23.615 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000347373 2020-11-16T20:58:23.615 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.615 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.615 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.615 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751396+0000", 2020-11-16T20:58:23.616 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1729999999999997e-06 2020-11-16T20:58:23.616 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.616 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.616 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting_for_map not empty", 2020-11-16T20:58:23.616 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.751400+0000", 2020-11-16T20:58:23.616 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094156940000000005 2020-11-16T20:58:23.616 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.617 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.617 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.617 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.760816+0000", 2020-11-16T20:58:23.617 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000195842 2020-11-16T20:58:23.617 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.617 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.617 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:23.617 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.761012+0000", 2020-11-16T20:58:23.618 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.056247153000000001 2020-11-16T20:58:23.618 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.618 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.618 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.618 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.817259+0000", 2020-11-16T20:58:23.618 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000154034 2020-11-16T20:58:23.618 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.619 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.619 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:23.619 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.817413+0000", 2020-11-16T20:58:23.619 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000108226 2020-11-16T20:58:23.619 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.619 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.619 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:23.620 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:24.817521+0000", 2020-11-16T20:58:23.620 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066511669999999995 2020-11-16T20:58:23.620 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.620 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.620 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.620 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.620 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.621 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:23.621 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:23.411+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:23.622 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:58:23.627+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:58:23.622 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-16T20:58:23.723 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:23.726+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:23.790 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:23.790 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:58:23.790 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.790 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4019 4.0 4:2e5644f4:::smithi16641208-410:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e164)", 2020-11-16T20:58:23.790 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.899863+0000", 2020-11-16T20:58:23.790 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.8947451060000002, 2020-11-16T20:58:23.791 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8947611799999997, 2020-11-16T20:58:23.791 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.791 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.791 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.791 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.791 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.792 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4019 2020-11-16T20:58:23.792 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.792 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.792 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.792 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.792 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899863+0000", 2020-11-16T20:58:23.792 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.792 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.793 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.793 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.793 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899863+0000", 2020-11-16T20:58:23.793 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5957999999999997e-05 2020-11-16T20:58:23.793 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.793 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.793 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.794 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899899+0000", 2020-11-16T20:58:23.794 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3890000000000002e-06 2020-11-16T20:58:23.794 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.794 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.794 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.794 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899905+0000", 2020-11-16T20:58:23.794 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1969e-05 2020-11-16T20:58:23.795 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.795 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.795 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.795 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899917+0000", 2020-11-16T20:58:23.795 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7440000000000004e-06 2020-11-16T20:58:23.795 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.795 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.796 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.796 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899923+0000", 2020-11-16T20:58:23.796 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1482000000000004e-05 2020-11-16T20:58:23.796 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.796 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.796 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.796 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899994+0000", 2020-11-16T20:58:23.797 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3801000000000001e-05 2020-11-16T20:58:23.797 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.797 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.797 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:23.797 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.900008+0000", 2020-11-16T20:58:23.797 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0094666520000000007 2020-11-16T20:58:23.797 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.797 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.798 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909475+0000", 2020-11-16T20:58:23.798 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0629000000000001e-05 2020-11-16T20:58:23.798 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.798 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.798 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.798 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909505+0000", 2020-11-16T20:58:23.799 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0096426240000000007 2020-11-16T20:58:23.799 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.799 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.799 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.799 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.799 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.799 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4021 4.0 4:356864c0:::smithi16641208-150:head [write 615321~404523 in=404523b] snapc 75=[75,74,73,61] ondisk+write+known_if_redirected e165)", 2020-11-16T20:58:23.800 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.906351+0000", 2020-11-16T20:58:23.800 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.8882565230000008, 2020-11-16T20:58:23.800 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8883222330000002, 2020-11-16T20:58:23.800 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.800 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.800 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.800 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.801 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.801 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4021 2020-11-16T20:58:23.801 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.801 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.801 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.801 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.801 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.906351+0000", 2020-11-16T20:58:23.801 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.802 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.802 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.802 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.802 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.906351+0000", 2020-11-16T20:58:23.802 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034401499999999998 2020-11-16T20:58:23.802 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.802 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.803 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.803 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.906695+0000", 2020-11-16T20:58:23.803 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1609999999999992e-06 2020-11-16T20:58:23.803 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.803 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.803 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.803 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.906705+0000", 2020-11-16T20:58:23.804 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4191e-05 2020-11-16T20:58:23.804 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.804 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.804 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.804 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.906719+0000", 2020-11-16T20:58:23.804 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0259e-05 2020-11-16T20:58:23.804 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.805 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.805 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.805 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.906729+0000", 2020-11-16T20:58:23.805 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029139359999999998 2020-11-16T20:58:23.805 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.805 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.805 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.805 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909643+0000", 2020-11-16T20:58:23.806 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3890000000000001e-05 2020-11-16T20:58:23.806 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.806 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.806 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.806 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909697+0000", 2020-11-16T20:58:23.806 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033454520000000001 2020-11-16T20:58:23.806 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.807 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.807 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.807 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.807 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.807 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4022 4.0 4:356864c0:::smithi16641208-150:head [write 1804606~457240 in=457240b] snapc 75=[75,74,73,61] ondisk+write+known_if_redirected e165)", 2020-11-16T20:58:23.807 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.913486+0000", 2020-11-16T20:58:23.807 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.8811222660000002, 2020-11-16T20:58:23.808 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8812234790000009, 2020-11-16T20:58:23.808 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.808 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.808 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.808 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.808 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.808 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4022 2020-11-16T20:58:23.809 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.809 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.809 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.809 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.809 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.913486+0000", 2020-11-16T20:58:23.809 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.809 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.809 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.810 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.810 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.913486+0000", 2020-11-16T20:58:23.810 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00025596700000000001 2020-11-16T20:58:23.810 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.810 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.810 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.810 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.913742+0000", 2020-11-16T20:58:23.811 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9280000000000004e-06 2020-11-16T20:58:23.811 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.811 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.811 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.811 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.913749+0000", 2020-11-16T20:58:23.811 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1252e-05 2020-11-16T20:58:23.811 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.812 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.812 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.812 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.913760+0000", 2020-11-16T20:58:23.812 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7570000000000004e-06 2020-11-16T20:58:23.812 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.812 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.812 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.812 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.913768+0000", 2020-11-16T20:58:23.813 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5753000000000001e-05 2020-11-16T20:58:23.813 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.813 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.813 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.813 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.913813+0000", 2020-11-16T20:58:23.813 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3049000000000002e-05 2020-11-16T20:58:23.813 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.814 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.814 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.814 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.913846+0000", 2020-11-16T20:58:23.814 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00036070600000000003 2020-11-16T20:58:23.814 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.814 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.814 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.815 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.815 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.815 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4023 4.0 4:356864c0:::smithi16641208-150:head [write 2755658~726225 in=726225b] snapc 75=[75,74,73,61] ondisk+write+known_if_redirected e165)", 2020-11-16T20:58:23.815 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.920214+0000", 2020-11-16T20:58:23.815 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.8743942069999999, 2020-11-16T20:58:23.815 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8745298389999991, 2020-11-16T20:58:23.815 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.815 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.816 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.816 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.816 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.816 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4023 2020-11-16T20:58:23.816 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.816 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.816 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.817 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.817 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920214+0000", 2020-11-16T20:58:23.817 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.817 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.817 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.817 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.817 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920214+0000", 2020-11-16T20:58:23.818 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000472304 2020-11-16T20:58:23.818 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.818 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.818 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.818 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920686+0000", 2020-11-16T20:58:23.818 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2201999999999999e-05 2020-11-16T20:58:23.818 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.819 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.819 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.819 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920698+0000", 2020-11-16T20:58:23.819 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9103999999999999e-05 2020-11-16T20:58:23.819 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.819 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.819 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.820 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920717+0000", 2020-11-16T20:58:23.820 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0829000000000001e-05 2020-11-16T20:58:23.820 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.820 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.820 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.820 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920728+0000", 2020-11-16T20:58:23.820 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1413000000000003e-05 2020-11-16T20:58:23.820 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.821 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.821 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.821 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920790+0000", 2020-11-16T20:58:23.821 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1226e-05 2020-11-16T20:58:23.821 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.821 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.821 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.822 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920841+0000", 2020-11-16T20:58:23.822 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00062707799999999999 2020-11-16T20:58:23.822 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.822 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.822 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.822 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.822 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.823 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4024 4.0 4:356864c0:::smithi16641208-150:head [setxattr _header (58) in=65b,truncate 3815321] snapc 75=[75,74,73,61] ondisk+write+known_if_redirected e165)", 2020-11-16T20:58:23.823 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.920772+0000", 2020-11-16T20:58:23.823 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.8738360640000007, 2020-11-16T20:58:23.823 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8740066280000001, 2020-11-16T20:58:23.823 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.823 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.823 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.824 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.824 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.824 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4024 2020-11-16T20:58:23.824 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.824 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.824 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.824 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.824 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920772+0000", 2020-11-16T20:58:23.825 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.825 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.825 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.825 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.825 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920772+0000", 2020-11-16T20:58:23.825 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4885999999999997e-05 2020-11-16T20:58:23.825 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.826 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.826 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.826 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920817+0000", 2020-11-16T20:58:23.826 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.6239999999999996e-06 2020-11-16T20:58:23.826 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.826 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.826 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.827 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920823+0000", 2020-11-16T20:58:23.827 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1484000000000001e-05 2020-11-16T20:58:23.827 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.827 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.827 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.827 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920835+0000", 2020-11-16T20:58:23.827 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0860000000000001e-06 2020-11-16T20:58:23.827 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.828 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.828 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.828 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920840+0000", 2020-11-16T20:58:23.828 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4150999999999999e-05 2020-11-16T20:58:23.828 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.828 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.828 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.829 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920874+0000", 2020-11-16T20:58:23.829 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0432000000000002e-05 2020-11-16T20:58:23.829 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.829 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.829 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.829 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920915+0000", 2020-11-16T20:58:23.829 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014266300000000001 2020-11-16T20:58:23.830 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.830 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.830 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.830 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.830 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.830 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4025 4.0 4:356864c0:::smithi16641208-150:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e165)", 2020-11-16T20:58:23.830 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.920880+0000", 2020-11-16T20:58:23.831 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.8737278199999992, 2020-11-16T20:58:23.831 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8739323649999999, 2020-11-16T20:58:23.831 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.831 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.831 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.831 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.831 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.831 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4025 2020-11-16T20:58:23.832 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.832 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.832 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.832 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.832 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920880+0000", 2020-11-16T20:58:23.832 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.832 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.833 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.833 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.833 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920880+0000", 2020-11-16T20:58:23.833 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1866000000000003e-05 2020-11-16T20:58:23.833 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.833 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.833 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.834 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920912+0000", 2020-11-16T20:58:23.834 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5809999999999996e-06 2020-11-16T20:58:23.834 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.834 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.834 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.834 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920918+0000", 2020-11-16T20:58:23.834 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1153e-05 2020-11-16T20:58:23.835 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.835 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.835 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.835 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920929+0000", 2020-11-16T20:58:23.835 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3329999999999998e-06 2020-11-16T20:58:23.835 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.835 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.835 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.836 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920933+0000", 2020-11-16T20:58:23.836 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0123000000000002e-05 2020-11-16T20:58:23.836 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.836 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.836 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.836 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.920973+0000", 2020-11-16T20:58:23.836 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6750999999999998e-05 2020-11-16T20:58:23.837 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.837 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.837 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.837 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.921000+0000", 2020-11-16T20:58:23.837 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000119807 2020-11-16T20:58:23.837 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.837 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.837 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.838 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.838 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.838 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3991 4.0 4:0152ee23:::smithi16641208-350:head [sparse-read 0~3865643,omap-get-vals-by-keys in=4b,omap-get-keys in=12b,omap-get-vals in=16b,omap-get-header,getxattrs] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e164)", 2020-11-16T20:58:23.838 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.897688+0000", 2020-11-16T20:58:23.838 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.8969199559999996, 2020-11-16T20:58:23.838 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8971608999999994, 2020-11-16T20:58:23.838 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.839 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.839 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.839 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.839 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.839 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3991 2020-11-16T20:58:23.839 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.839 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.840 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.840 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.840 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897688+0000", 2020-11-16T20:58:23.840 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.840 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.840 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.840 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.840 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897688+0000", 2020-11-16T20:58:23.841 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9966000000000002e-05 2020-11-16T20:58:23.841 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.841 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.841 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.841 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897738+0000", 2020-11-16T20:58:23.841 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.7780000000000002e-06 2020-11-16T20:58:23.841 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.842 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.842 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.842 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897748+0000", 2020-11-16T20:58:23.842 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5574e-05 2020-11-16T20:58:23.842 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.842 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.842 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.843 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897763+0000", 2020-11-16T20:58:23.843 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1400000000000006e-06 2020-11-16T20:58:23.843 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.843 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.843 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.843 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897772+0000", 2020-11-16T20:58:23.843 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8206000000000003e-05 2020-11-16T20:58:23.844 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.844 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.844 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.844 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897851+0000", 2020-11-16T20:58:23.844 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9283000000000002e-05 2020-11-16T20:58:23.844 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.844 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.845 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:23.845 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897870+0000", 2020-11-16T20:58:23.845 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010422219 2020-11-16T20:58:23.845 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.845 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.845 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.845 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.908292+0000", 2020-11-16T20:58:23.845 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.1711999999999995e-05 2020-11-16T20:58:23.846 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.846 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.846 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.846 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.908354+0000", 2020-11-16T20:58:23.846 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010665878 2020-11-16T20:58:23.846 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.846 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.847 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.847 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.847 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.847 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3992 4.0 4:0152ee23:::smithi16641208-350:head [read 0~3865643,checksum in=4b] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e164)", 2020-11-16T20:58:23.847 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.897819+0000", 2020-11-16T20:58:23.847 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.8967891269999999, 2020-11-16T20:58:23.847 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8970713739999994, 2020-11-16T20:58:23.848 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.848 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.848 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.848 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.848 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.848 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3992 2020-11-16T20:58:23.848 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.848 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.849 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.849 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.849 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897819+0000", 2020-11-16T20:58:23.849 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.849 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.849 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.849 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.850 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897819+0000", 2020-11-16T20:58:23.850 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4625e-05 2020-11-16T20:58:23.850 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.850 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.850 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.850 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897873+0000", 2020-11-16T20:58:23.850 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5899999999999996e-06 2020-11-16T20:58:23.851 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.851 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.851 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.851 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897880+0000", 2020-11-16T20:58:23.851 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2564e-05 2020-11-16T20:58:23.851 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.851 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.852 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.852 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897893+0000", 2020-11-16T20:58:23.852 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8490000000000002e-06 2020-11-16T20:58:23.852 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.852 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.852 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.852 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897898+0000", 2020-11-16T20:58:23.852 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.231e-05 2020-11-16T20:58:23.853 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.853 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.853 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.853 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897941+0000", 2020-11-16T20:58:23.853 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3270000000000007e-06 2020-11-16T20:58:23.853 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.853 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.854 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:23.854 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897950+0000", 2020-11-16T20:58:23.854 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010996924999999999 2020-11-16T20:58:23.854 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.854 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.854 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.854 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.908947+0000", 2020-11-16T20:58:23.855 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6814000000000002e-05 2020-11-16T20:58:23.855 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.855 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.855 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.855 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909004+0000", 2020-11-16T20:58:23.855 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011185004 2020-11-16T20:58:23.855 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.855 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.856 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.856 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.856 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.856 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3993 4.0 4:0152ee23:::smithi16641208-350:head [sparse-read 0~3865643] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e164)", 2020-11-16T20:58:23.856 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.897944+0000", 2020-11-16T20:58:23.856 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.8966637839999994, 2020-11-16T20:58:23.856 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8969867639999993, 2020-11-16T20:58:23.857 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.857 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.857 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.857 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.857 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.857 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3993 2020-11-16T20:58:23.857 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.858 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.858 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.858 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.858 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897944+0000", 2020-11-16T20:58:23.858 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.858 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.858 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.858 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.859 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897944+0000", 2020-11-16T20:58:23.859 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6337999999999997e-05 2020-11-16T20:58:23.859 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.859 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.859 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.859 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897980+0000", 2020-11-16T20:58:23.860 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9330000000000004e-06 2020-11-16T20:58:23.860 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.860 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.860 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.860 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.897987+0000", 2020-11-16T20:58:23.860 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.224e-05 2020-11-16T20:58:23.860 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.860 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.861 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.861 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898000+0000", 2020-11-16T20:58:23.861 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0040999999999999e-05 2020-11-16T20:58:23.861 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.861 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.861 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.861 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898010+0000", 2020-11-16T20:58:23.862 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0834000000000002e-05 2020-11-16T20:58:23.862 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.862 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.862 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.862 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898061+0000", 2020-11-16T20:58:23.862 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3489000000000001e-05 2020-11-16T20:58:23.862 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.863 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.863 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:23.863 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898074+0000", 2020-11-16T20:58:23.863 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011038678999999999 2020-11-16T20:58:23.863 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.863 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.863 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.863 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909113+0000", 2020-11-16T20:58:23.864 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3149000000000003e-05 2020-11-16T20:58:23.864 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.864 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.864 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.864 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909156+0000", 2020-11-16T20:58:23.864 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011211703 2020-11-16T20:58:23.864 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.865 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.865 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.865 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.865 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.865 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4015 4.0 4:2e5644f4:::smithi16641208-410:head [write 598514~729274 in=729274b,stat] snapc 74=[74,73,61] ondisk+write+known_if_redirected e164)", 2020-11-16T20:58:23.865 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.898056+0000", 2020-11-16T20:58:23.865 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.8965521669999994, 2020-11-16T20:58:23.865 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8969151760000003, 2020-11-16T20:58:23.866 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.866 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.866 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.866 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.866 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.866 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4015 2020-11-16T20:58:23.866 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.867 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.867 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.867 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.867 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898056+0000", 2020-11-16T20:58:23.867 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.867 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.867 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.868 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.868 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898056+0000", 2020-11-16T20:58:23.868 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00060280000000000002 2020-11-16T20:58:23.868 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.868 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.868 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.868 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898659+0000", 2020-11-16T20:58:23.869 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9290000000000004e-06 2020-11-16T20:58:23.869 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.869 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.869 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.869 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898667+0000", 2020-11-16T20:58:23.869 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8614000000000002e-05 2020-11-16T20:58:23.869 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.869 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.870 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.870 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898686+0000", 2020-11-16T20:58:23.870 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1258e-05 2020-11-16T20:58:23.870 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.870 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.870 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.870 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898697+0000", 2020-11-16T20:58:23.871 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6267000000000002e-05 2020-11-16T20:58:23.871 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.871 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.871 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.871 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898754+0000", 2020-11-16T20:58:23.871 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1922e-05 2020-11-16T20:58:23.871 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.872 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.872 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:23.872 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898766+0000", 2020-11-16T20:58:23.872 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010430432999999999 2020-11-16T20:58:23.872 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.872 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.872 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.872 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909196+0000", 2020-11-16T20:58:23.873 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9072999999999997e-05 2020-11-16T20:58:23.873 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.873 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.873 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.873 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909235+0000", 2020-11-16T20:58:23.873 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011179296 2020-11-16T20:58:23.873 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.874 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.874 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.874 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.874 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.874 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4016 4.0 4:2e5644f4:::smithi16641208-410:head [write 1746124~597229 in=597229b] snapc 74=[74,73,61] ondisk+write+known_if_redirected e164)", 2020-11-16T20:58:23.874 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.898743+0000", 2020-11-16T20:58:23.874 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.8958644549999999, 2020-11-16T20:58:23.875 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.896267795, 2020-11-16T20:58:23.875 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.875 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.875 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.875 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.875 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.875 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4016 2020-11-16T20:58:23.875 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.876 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.876 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.876 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.876 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898743+0000", 2020-11-16T20:58:23.876 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.876 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.876 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.877 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.877 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.898743+0000", 2020-11-16T20:58:23.877 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00046414699999999999 2020-11-16T20:58:23.877 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.877 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.877 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.877 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899208+0000", 2020-11-16T20:58:23.878 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9149999999999996e-06 2020-11-16T20:58:23.878 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.878 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.878 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.878 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899216+0000", 2020-11-16T20:58:23.878 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5268999999999999e-05 2020-11-16T20:58:23.878 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.878 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.879 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.879 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899231+0000", 2020-11-16T20:58:23.879 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.1559999999999998e-06 2020-11-16T20:58:23.879 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.879 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.879 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.879 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899238+0000", 2020-11-16T20:58:23.880 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2649999999999999e-05 2020-11-16T20:58:23.880 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.880 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.880 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.880 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899291+0000", 2020-11-16T20:58:23.880 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1956e-05 2020-11-16T20:58:23.880 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.881 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.881 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:23.881 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899303+0000", 2020-11-16T20:58:23.881 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0099621889999999998 2020-11-16T20:58:23.881 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.881 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.881 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.881 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909265+0000", 2020-11-16T20:58:23.882 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7721e-05 2020-11-16T20:58:23.882 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.882 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.882 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.882 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909302+0000", 2020-11-16T20:58:23.882 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010559003000000001 2020-11-16T20:58:23.882 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.883 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.883 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.883 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.883 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.883 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4017 4.0 4:2e5644f4:::smithi16641208-410:head [write 3128235~514953 in=514953b] snapc 74=[74,73,61] ondisk+write+known_if_redirected e164)", 2020-11-16T20:58:23.883 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.899277+0000", 2020-11-16T20:58:23.883 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.8953305989999993, 2020-11-16T20:58:23.884 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8957743570000005, 2020-11-16T20:58:23.884 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.884 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.884 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.884 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.884 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.884 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4017 2020-11-16T20:58:23.884 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.885 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.885 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.885 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.885 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899277+0000", 2020-11-16T20:58:23.885 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.885 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.885 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.886 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.886 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899277+0000", 2020-11-16T20:58:23.886 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00040012100000000003 2020-11-16T20:58:23.886 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.886 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.886 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.886 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899677+0000", 2020-11-16T20:58:23.887 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.0399999999999993e-06 2020-11-16T20:58:23.887 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.887 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.887 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.887 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899685+0000", 2020-11-16T20:58:23.887 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1985e-05 2020-11-16T20:58:23.887 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.887 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.888 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.888 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899697+0000", 2020-11-16T20:58:23.888 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.72e-06 2020-11-16T20:58:23.888 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.888 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.888 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.888 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899704+0000", 2020-11-16T20:58:23.889 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3680000000000001e-05 2020-11-16T20:58:23.889 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.889 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.889 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.889 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899758+0000", 2020-11-16T20:58:23.889 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2514000000000001e-05 2020-11-16T20:58:23.889 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.890 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.890 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:23.890 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899770+0000", 2020-11-16T20:58:23.890 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0095684949999999998 2020-11-16T20:58:23.890 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.890 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.890 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.890 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909339+0000", 2020-11-16T20:58:23.891 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5496e-05 2020-11-16T20:58:23.891 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.891 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.891 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.891 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909374+0000", 2020-11-16T20:58:23.891 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010097050999999999 2020-11-16T20:58:23.891 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.892 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.892 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.892 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.892 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.892 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:4018 4.0 4:2e5644f4:::smithi16641208-410:head [setxattr _header (58) in=65b,truncate 3798514] snapc 74=[74,73,61] ondisk+write+known_if_redirected e164)", 2020-11-16T20:58:23.892 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:13.899746+0000", 2020-11-16T20:58:23.892 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 9.8948617559999992, 2020-11-16T20:58:23.893 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8953461130000004, 2020-11-16T20:58:23.893 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:23.893 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "delayed", 2020-11-16T20:58:23.893 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:23.893 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:23.893 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:23.893 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 4018 2020-11-16T20:58:23.893 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.894 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:23.894 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.894 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:23.894 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899746+0000", 2020-11-16T20:58:23.894 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:23.894 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.894 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.895 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:23.895 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899746+0000", 2020-11-16T20:58:23.895 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3548999999999999e-05 2020-11-16T20:58:23.895 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.895 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.895 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:23.895 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899790+0000", 2020-11-16T20:58:23.896 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2519999999999996e-06 2020-11-16T20:58:23.896 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.896 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.896 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:23.896 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899796+0000", 2020-11-16T20:58:23.896 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0695e-05 2020-11-16T20:58:23.896 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.896 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.897 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:23.897 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899807+0000", 2020-11-16T20:58:23.897 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5749000000000001e-05 2020-11-16T20:58:23.897 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.897 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.897 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:23.897 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899822+0000", 2020-11-16T20:58:23.898 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1319999999999997e-05 2020-11-16T20:58:23.898 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.898 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.898 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.898 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899864+0000", 2020-11-16T20:58:23.898 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0456e-05 2020-11-16T20:58:23.898 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.899 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.899 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:23.899 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.899874+0000", 2020-11-16T20:58:23.899 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0095292060000000001 2020-11-16T20:58:23.899 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.899 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.899 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:23.899 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909403+0000", 2020-11-16T20:58:23.900 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.7051000000000002e-05 2020-11-16T20:58:23.900 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:23.900 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:23.900 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:23.900 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:13.909440+0000", 2020-11-16T20:58:23.900 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0096942780000000006 2020-11-16T20:58:23.900 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.901 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:23.901 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.901 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:23.901 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:58:23.901 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 13 2020-11-16T20:58:23.901 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:23.902 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-16T20:58:23.903 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:23.907+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:23.955 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2020-11-16T20:58:24.003 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:24.008+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:24.035 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:24.035 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:58:24.035 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:58:24.036 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:58:24.036 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:24.045 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-16T20:58:24.104 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:58:24.109+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:58:24.205 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:58:24.209+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:58:24.228 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:24.229 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:58:24.229 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:58:24.229 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:58:24.229 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.229 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2979 4.0 4:1852173c:::smithi16641208-329:head [write 581674~637746,stat] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:24.229 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:58:24.229 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 95.428450570999999, 2020-11-16T20:58:24.230 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.009457398, 2020-11-16T20:58:24.230 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:24.230 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:24.230 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:24.230 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:24.230 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:24.231 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2979 2020-11-16T20:58:24.231 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.231 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:24.231 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.231 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:24.231 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:58:24.231 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:24.232 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.232 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.232 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:24.232 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803658+0000", 2020-11-16T20:58:24.232 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00030732300000000003 2020-11-16T20:58:24.232 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.232 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.232 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:24.233 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803965+0000", 2020-11-16T20:58:24.233 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0319999999999992e-06 2020-11-16T20:58:24.233 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.233 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.233 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:24.233 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803974+0000", 2020-11-16T20:58:24.233 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5930000000000002e-05 2020-11-16T20:58:24.234 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.234 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.234 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:24.234 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803990+0000", 2020-11-16T20:58:24.234 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1910000000000006e-06 2020-11-16T20:58:24.234 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.234 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.235 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:24.235 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.803999+0000", 2020-11-16T20:58:24.235 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5637000000000003e-05 2020-11-16T20:58:24.235 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.235 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.235 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.235 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.804055+0000", 2020-11-16T20:58:24.235 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3769000000000001e-05 2020-11-16T20:58:24.236 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.236 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.236 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:24.236 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.804088+0000", 2020-11-16T20:58:24.236 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.995239140000001 2020-11-16T20:58:24.236 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.236 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.237 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.237 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799328+0000", 2020-11-16T20:58:24.237 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0137818 2020-11-16T20:58:24.237 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.237 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.237 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:24.237 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813109+0000", 2020-11-16T20:58:24.238 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5759999999999996e-06 2020-11-16T20:58:24.238 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.238 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.238 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:24.238 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813115+0000", 2020-11-16T20:58:24.238 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.009457398 2020-11-16T20:58:24.238 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.238 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:24.239 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.239 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.239 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.239 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2980 4.0 4:1852173c:::smithi16641208-329:head [write 1840873~558854] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:24.239 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:58:24.239 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 95.422184838999996, 2020-11-16T20:58:24.239 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.039347508000001, 2020-11-16T20:58:24.240 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:24.240 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:24.240 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:24.240 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:24.240 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:24.240 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2980 2020-11-16T20:58:24.240 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.241 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:24.241 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.241 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:24.241 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:58:24.241 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:24.241 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.241 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.241 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:24.242 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.809923+0000", 2020-11-16T20:58:24.242 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024810899999999999 2020-11-16T20:58:24.242 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.242 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.242 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:24.242 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810171+0000", 2020-11-16T20:58:24.242 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5610000000000001e-06 2020-11-16T20:58:24.243 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.243 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.243 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:24.243 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810179+0000", 2020-11-16T20:58:24.243 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7418000000000002e-05 2020-11-16T20:58:24.243 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.243 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.243 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:24.244 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810196+0000", 2020-11-16T20:58:24.244 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0079999999999996e-06 2020-11-16T20:58:24.244 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.244 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.244 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:24.244 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810203+0000", 2020-11-16T20:58:24.244 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3705000000000002e-05 2020-11-16T20:58:24.245 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.245 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.245 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.245 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810257+0000", 2020-11-16T20:58:24.245 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3656999999999998e-05 2020-11-16T20:58:24.245 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.245 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.246 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:24.246 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.810311+0000", 2020-11-16T20:58:24.246 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.989427508 2020-11-16T20:58:24.246 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.246 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.246 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.246 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799738+0000", 2020-11-16T20:58:24.246 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2526000000000003e-05 2020-11-16T20:58:24.247 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.247 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.247 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:24.247 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799811+0000", 2020-11-16T20:58:24.247 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027934184000000001 2020-11-16T20:58:24.247 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.247 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.248 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.248 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827745+0000", 2020-11-16T20:58:24.248 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015776700000000001 2020-11-16T20:58:24.248 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.248 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.248 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:24.248 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827903+0000", 2020-11-16T20:58:24.248 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000185539 2020-11-16T20:58:24.249 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.249 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.249 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:24.249 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.828088+0000", 2020-11-16T20:58:24.249 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.018143857999999999 2020-11-16T20:58:24.249 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.249 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.250 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:24.250 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846232+0000", 2020-11-16T20:58:24.250 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00074682199999999996 2020-11-16T20:58:24.250 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.250 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.250 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:24.250 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846979+0000", 2020-11-16T20:58:24.251 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021617530000000002 2020-11-16T20:58:24.251 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.251 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.251 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:24.251 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849141+0000", 2020-11-16T20:58:24.251 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4513999999999998e-05 2020-11-16T20:58:24.251 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.252 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.252 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:24.252 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849215+0000", 2020-11-16T20:58:24.252 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.5578999999999998e-05 2020-11-16T20:58:24.252 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.252 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.252 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:24.252 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849271+0000", 2020-11-16T20:58:24.253 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.039347508000001 2020-11-16T20:58:24.253 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.253 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:24.253 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.253 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.253 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.253 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2981 4.0 4:1852173c:::smithi16641208-329:head [write 3066417~537135] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:24.254 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:58:24.254 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 95.415268542000007, 2020-11-16T20:58:24.254 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.032910677, 2020-11-16T20:58:24.254 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:24.254 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:24.254 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:24.254 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:24.255 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:24.255 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2981 2020-11-16T20:58:24.255 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.255 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:24.255 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.255 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:24.255 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:58:24.255 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:24.256 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.256 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.256 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:24.256 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.816840+0000", 2020-11-16T20:58:24.256 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024974099999999999 2020-11-16T20:58:24.256 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.256 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.257 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:24.257 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817089+0000", 2020-11-16T20:58:24.257 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3829999999999992e-06 2020-11-16T20:58:24.257 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.257 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.257 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:24.257 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817098+0000", 2020-11-16T20:58:24.258 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2118e-05 2020-11-16T20:58:24.258 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.258 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.258 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:24.258 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817110+0000", 2020-11-16T20:58:24.258 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6050000000000004e-06 2020-11-16T20:58:24.258 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.258 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.259 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:24.259 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817119+0000", 2020-11-16T20:58:24.259 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7204000000000003e-05 2020-11-16T20:58:24.259 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.259 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.259 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.259 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817177+0000", 2020-11-16T20:58:24.260 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9932999999999998e-05 2020-11-16T20:58:24.260 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.260 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.260 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:24.260 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817227+0000", 2020-11-16T20:58:24.260 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.98265286 2020-11-16T20:58:24.260 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.260 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.261 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.261 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799879+0000", 2020-11-16T20:58:24.261 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.737e-05 2020-11-16T20:58:24.261 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.261 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.261 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:24.261 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.799947+0000", 2020-11-16T20:58:24.262 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029940584999999999 2020-11-16T20:58:24.262 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.262 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.262 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.262 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.829887+0000", 2020-11-16T20:58:24.262 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000217505 2020-11-16T20:58:24.262 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.262 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.263 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:24.263 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.830105+0000", 2020-11-16T20:58:24.263 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029022100000000001 2020-11-16T20:58:24.263 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.263 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.263 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:24.263 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.830395+0000", 2020-11-16T20:58:24.264 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.015847953000000001 2020-11-16T20:58:24.264 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.264 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.264 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:24.264 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846243+0000", 2020-11-16T20:58:24.264 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0011558250000000001 2020-11-16T20:58:24.264 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.265 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.265 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:24.265 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847399+0000", 2020-11-16T20:58:24.265 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0021524500000000002 2020-11-16T20:58:24.265 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.265 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.265 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:24.265 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849551+0000", 2020-11-16T20:58:24.266 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000138787 2020-11-16T20:58:24.266 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.266 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.266 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:24.266 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849690+0000", 2020-11-16T20:58:24.266 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0136999999999997e-05 2020-11-16T20:58:24.266 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.267 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.267 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:24.267 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849750+0000", 2020-11-16T20:58:24.267 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.032910677 2020-11-16T20:58:24.267 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.267 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:24.267 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.267 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.268 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.268 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2982 4.0 4:1852173c:::smithi16641208-329:head [setxattr _header (58) in=7b,truncate 3781674] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:24.268 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:58:24.268 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 95.414950227000006, 2020-11-16T20:58:24.268 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.035208633, 2020-11-16T20:58:24.268 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:24.268 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:24.269 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:24.269 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:24.269 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:24.269 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2982 2020-11-16T20:58:24.269 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.269 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:24.269 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.270 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:24.270 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:58:24.270 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:24.270 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.270 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.270 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:24.270 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817158+0000", 2020-11-16T20:58:24.270 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8856000000000002e-05 2020-11-16T20:58:24.271 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.271 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.271 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:24.271 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817197+0000", 2020-11-16T20:58:24.271 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.93e-06 2020-11-16T20:58:24.271 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.271 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.272 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:24.272 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817203+0000", 2020-11-16T20:58:24.272 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0932e-05 2020-11-16T20:58:24.272 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.272 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.272 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:24.272 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817214+0000", 2020-11-16T20:58:24.273 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3470000000000001e-06 2020-11-16T20:58:24.273 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.273 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.273 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:24.273 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817218+0000", 2020-11-16T20:58:24.273 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4603e-05 2020-11-16T20:58:24.273 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.273 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.274 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.274 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817263+0000", 2020-11-16T20:58:24.274 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6387000000000002e-05 2020-11-16T20:58:24.274 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.274 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.274 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:24.274 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817309+0000", 2020-11-16T20:58:24.275 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.982698653 2020-11-16T20:58:24.275 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.275 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.275 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.275 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800008+0000", 2020-11-16T20:58:24.275 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.5400000000000004e-05 2020-11-16T20:58:24.275 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.275 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.276 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:24.276 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800073+0000", 2020-11-16T20:58:24.276 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.044932818999999999 2020-11-16T20:58:24.276 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.276 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.276 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.276 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845006+0000", 2020-11-16T20:58:24.277 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017285099999999999 2020-11-16T20:58:24.277 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.277 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.277 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:24.277 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845179+0000", 2020-11-16T20:58:24.277 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023420900000000001 2020-11-16T20:58:24.277 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.277 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.278 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:24.278 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.845413+0000", 2020-11-16T20:58:24.278 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0020276000000000001 2020-11-16T20:58:24.278 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.278 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.278 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:24.278 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847441+0000", 2020-11-16T20:58:24.279 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00050358800000000002 2020-11-16T20:58:24.279 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.279 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.279 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:24.279 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847944+0000", 2020-11-16T20:58:24.279 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0042758900000000001 2020-11-16T20:58:24.279 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.280 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.280 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:24.280 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852220+0000", 2020-11-16T20:58:24.280 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9648999999999997e-05 2020-11-16T20:58:24.280 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.280 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.280 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:24.281 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852290+0000", 2020-11-16T20:58:24.281 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6919e-05 2020-11-16T20:58:24.281 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.281 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.281 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:24.281 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852367+0000", 2020-11-16T20:58:24.281 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.035208633 2020-11-16T20:58:24.282 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.282 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:24.282 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.282 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.282 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.282 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2983 4.0 4:1852173c:::smithi16641208-329:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e86)", 2020-11-16T20:58:24.282 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:58:24.283 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 95.414859759999999, 2020-11-16T20:58:24.283 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.037016812999999, 2020-11-16T20:58:24.283 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:24.283 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:24.283 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:24.283 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:24.283 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:24.283 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2983 2020-11-16T20:58:24.284 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.284 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:24.284 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.284 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:24.284 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:58:24.284 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:24.284 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.285 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.285 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:24.285 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817248+0000", 2020-11-16T20:58:24.285 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7317999999999999e-05 2020-11-16T20:58:24.285 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.285 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.285 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:24.285 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817266+0000", 2020-11-16T20:58:24.286 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3519999999999998e-06 2020-11-16T20:58:24.286 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.291 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.291 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:24.291 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817269+0000", 2020-11-16T20:58:24.292 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7859999999999999e-06 2020-11-16T20:58:24.292 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.292 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.292 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:24.292 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817276+0000", 2020-11-16T20:58:24.292 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5620000000000002e-06 2020-11-16T20:58:24.292 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.292 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.293 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:24.293 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817278+0000", 2020-11-16T20:58:24.293 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.3251999999999996e-05 2020-11-16T20:58:24.293 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.293 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.293 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.293 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817352+0000", 2020-11-16T20:58:24.294 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.7966000000000001e-05 2020-11-16T20:58:24.294 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.294 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.294 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:24.294 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.817400+0000", 2020-11-16T20:58:24.294 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.982734203 2020-11-16T20:58:24.294 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.295 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.295 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.295 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800134+0000", 2020-11-16T20:58:24.295 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9765999999999997e-05 2020-11-16T20:58:24.295 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.295 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.295 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:24.295 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800194+0000", 2020-11-16T20:58:24.296 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.046087276000000003 2020-11-16T20:58:24.296 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.296 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.296 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.296 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846281+0000", 2020-11-16T20:58:24.296 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000115396 2020-11-16T20:58:24.296 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.297 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.297 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:24.297 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.846396+0000", 2020-11-16T20:58:24.297 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006004573 2020-11-16T20:58:24.297 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.297 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.297 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.297 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852401+0000", 2020-11-16T20:58:24.298 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013211599999999999 2020-11-16T20:58:24.298 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.298 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.298 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:24.298 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.852533+0000", 2020-11-16T20:58:24.298 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0017322469999999999 2020-11-16T20:58:24.298 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.299 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.299 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:24.299 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.854265+0000", 2020-11-16T20:58:24.299 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.037016812999999 2020-11-16T20:58:24.299 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.299 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:24.299 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.300 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.300 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.300 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2984 4.0 4:033219d6:::smithi16641208-386:head [write 598481~712995,stat] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:24.300 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:58:24.300 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 95.407799917999995, 2020-11-16T20:58:24.300 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.003104742, 2020-11-16T20:58:24.300 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:24.300 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:24.301 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:24.301 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:24.301 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:24.301 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2984 2020-11-16T20:58:24.301 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.301 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:24.301 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.302 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:24.302 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:58:24.302 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:24.302 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.302 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.302 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:24.302 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824308+0000", 2020-11-16T20:58:24.303 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00037173000000000002 2020-11-16T20:58:24.303 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.303 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.303 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:24.303 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824680+0000", 2020-11-16T20:58:24.303 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.146e-05 2020-11-16T20:58:24.303 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.303 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.304 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:24.304 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824691+0000", 2020-11-16T20:58:24.304 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.6951000000000001e-05 2020-11-16T20:58:24.304 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.304 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.304 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:24.304 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824708+0000", 2020-11-16T20:58:24.305 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2082000000000001e-05 2020-11-16T20:58:24.305 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.305 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.305 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:24.305 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824720+0000", 2020-11-16T20:58:24.305 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0284000000000002e-05 2020-11-16T20:58:24.305 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.306 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.306 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.306 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824771+0000", 2020-11-16T20:58:24.306 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1241000000000001e-05 2020-11-16T20:58:24.306 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.306 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.306 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:24.306 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.824802+0000", 2020-11-16T20:58:24.307 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.975455838 2020-11-16T20:58:24.307 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.307 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.307 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.307 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800258+0000", 2020-11-16T20:58:24.307 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.027151194999999999 2020-11-16T20:58:24.307 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.308 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.308 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:24.308 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827409+0000", 2020-11-16T20:58:24.308 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9609999999999999e-06 2020-11-16T20:58:24.308 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.308 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.308 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:24.308 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.827413+0000", 2020-11-16T20:58:24.309 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.003104742 2020-11-16T20:58:24.309 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.309 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:24.309 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.309 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.309 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.309 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2985 4.0 4:033219d6:::smithi16641208-386:head [write 1899355~418865] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:24.310 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:58:24.310 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 95.402188636000005, 2020-11-16T20:58:24.310 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.021091737000001, 2020-11-16T20:58:24.310 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:24.310 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:24.310 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:24.310 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:24.311 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:24.311 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2985 2020-11-16T20:58:24.311 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.311 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:24.311 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.311 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:24.311 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:58:24.312 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:24.312 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.312 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.312 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:24.312 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.829920+0000", 2020-11-16T20:58:24.312 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023221799999999999 2020-11-16T20:58:24.312 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.313 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:24.313 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830152+0000", 2020-11-16T20:58:24.313 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9769999999999995e-06 2020-11-16T20:58:24.313 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.313 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:24.313 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830162+0000", 2020-11-16T20:58:24.314 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5545000000000001e-05 2020-11-16T20:58:24.314 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.314 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.314 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:24.314 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830177+0000", 2020-11-16T20:58:24.314 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0334e-05 2020-11-16T20:58:24.314 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.315 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.315 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:24.315 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830188+0000", 2020-11-16T20:58:24.315 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3430999999999996e-05 2020-11-16T20:58:24.315 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.315 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.315 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.316 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830251+0000", 2020-11-16T20:58:24.316 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2651999999999997e-05 2020-11-16T20:58:24.316 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.316 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.316 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:24.316 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.830304+0000", 2020-11-16T20:58:24.316 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.970289857999999 2020-11-16T20:58:24.316 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.317 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.317 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.317 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800594+0000", 2020-11-16T20:58:24.317 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8948999999999993e-05 2020-11-16T20:58:24.317 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.317 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.317 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:24.318 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800663+0000", 2020-11-16T20:58:24.318 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036018513000000002 2020-11-16T20:58:24.318 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.318 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.318 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.318 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836681+0000", 2020-11-16T20:58:24.318 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00013201099999999999 2020-11-16T20:58:24.318 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.319 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.319 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:24.319 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836813+0000", 2020-11-16T20:58:24.319 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000126635 2020-11-16T20:58:24.319 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.319 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.319 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:24.320 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.836940+0000", 2020-11-16T20:58:24.320 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.010477907 2020-11-16T20:58:24.320 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.320 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.320 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:24.320 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847418+0000", 2020-11-16T20:58:24.320 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000158796 2020-11-16T20:58:24.321 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.321 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.321 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:24.321 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847576+0000", 2020-11-16T20:58:24.321 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0033023729999999999 2020-11-16T20:58:24.321 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.321 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.321 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:24.322 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850879+0000", 2020-11-16T20:58:24.322 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6360999999999996e-05 2020-11-16T20:58:24.322 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.322 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.322 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:24.322 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.850955+0000", 2020-11-16T20:58:24.322 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6177000000000001e-05 2020-11-16T20:58:24.323 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.323 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.323 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:24.323 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851011+0000", 2020-11-16T20:58:24.323 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.021091737000001 2020-11-16T20:58:24.323 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.323 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:24.323 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.324 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.324 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.324 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2986 4.0 4:033219d6:::smithi16641208-386:head [write 3093840~704641] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:24.324 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:58:24.324 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 95.393962934000001, 2020-11-16T20:58:24.324 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013155362999999, 2020-11-16T20:58:24.324 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:24.325 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:24.325 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:24.325 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:24.325 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:24.325 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2986 2020-11-16T20:58:24.325 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.325 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:24.325 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.326 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:24.326 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:58:24.326 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:24.326 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.326 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.326 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:24.326 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838145+0000", 2020-11-16T20:58:24.327 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00038247200000000002 2020-11-16T20:58:24.327 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.327 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.327 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:24.327 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838528+0000", 2020-11-16T20:58:24.327 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3299999999999999e-06 2020-11-16T20:58:24.327 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.328 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.328 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:24.328 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838536+0000", 2020-11-16T20:58:24.328 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3438000000000001e-05 2020-11-16T20:58:24.328 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.328 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.328 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:24.328 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838549+0000", 2020-11-16T20:58:24.329 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0213e-05 2020-11-16T20:58:24.329 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.329 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.329 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:24.329 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838560+0000", 2020-11-16T20:58:24.329 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1894999999999997e-05 2020-11-16T20:58:24.329 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.330 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.330 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.330 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838612+0000", 2020-11-16T20:58:24.330 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8209e-05 2020-11-16T20:58:24.330 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.330 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.330 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:24.330 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838650+0000", 2020-11-16T20:58:24.331 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962061715000001 2020-11-16T20:58:24.331 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.331 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.331 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.331 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800712+0000", 2020-11-16T20:58:24.331 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6964e-05 2020-11-16T20:58:24.331 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.332 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.332 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:24.332 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800748+0000", 2020-11-16T20:58:24.332 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037209265999999998 2020-11-16T20:58:24.332 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.332 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.332 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.332 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.837958+0000", 2020-11-16T20:58:24.333 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000160304 2020-11-16T20:58:24.333 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.333 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.333 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:24.333 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.838118+0000", 2020-11-16T20:58:24.333 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022362799999999999 2020-11-16T20:58:24.333 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.334 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.334 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:24.334 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.838342+0000", 2020-11-16T20:58:24.334 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0090844710000000002 2020-11-16T20:58:24.334 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.334 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.334 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:24.335 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847426+0000", 2020-11-16T20:58:24.335 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000219199 2020-11-16T20:58:24.335 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:24.335 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847645+0000", 2020-11-16T20:58:24.335 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.003411603 2020-11-16T20:58:24.335 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.336 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.336 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:24.336 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851057+0000", 2020-11-16T20:58:24.336 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014736799999999999 2020-11-16T20:58:24.336 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.336 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.336 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:24.337 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851204+0000", 2020-11-16T20:58:24.337 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6287999999999997e-05 2020-11-16T20:58:24.337 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.337 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.337 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:24.337 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851301+0000", 2020-11-16T20:58:24.337 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013155362999999 2020-11-16T20:58:24.337 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.338 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:24.338 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.338 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.338 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.338 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2987 4.0 4:033219d6:::smithi16641208-386:head [setxattr _header (58) in=7b,truncate 3798481] snapc 30=[25] ondisk+write+known_if_redirected e86)", 2020-11-16T20:58:24.338 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:58:24.338 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 95.393504295, 2020-11-16T20:58:24.339 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.012971041, 2020-11-16T20:58:24.339 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:24.339 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:24.339 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:24.339 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:24.339 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:24.339 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2987 2020-11-16T20:58:24.340 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.340 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:24.340 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.340 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:24.340 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:58:24.340 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:24.340 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.341 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.341 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:24.341 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838604+0000", 2020-11-16T20:58:24.341 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4530000000000002e-05 2020-11-16T20:58:24.341 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.341 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.341 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:24.341 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838648+0000", 2020-11-16T20:58:24.342 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8390000000000001e-06 2020-11-16T20:58:24.342 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.342 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.342 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:24.342 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838655+0000", 2020-11-16T20:58:24.342 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0341e-05 2020-11-16T20:58:24.342 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.343 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.343 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:24.343 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838666+0000", 2020-11-16T20:58:24.343 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0929999999999999e-06 2020-11-16T20:58:24.343 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.343 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.343 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:24.343 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838672+0000", 2020-11-16T20:58:24.344 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.8074999999999997e-05 2020-11-16T20:58:24.344 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.344 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.344 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.344 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838710+0000", 2020-11-16T20:58:24.344 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.1121000000000002e-05 2020-11-16T20:58:24.344 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.345 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.345 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:24.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838751+0000", 2020-11-16T20:58:24.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962044797000001 2020-11-16T20:58:24.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.345 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.345 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800796+0000", 2020-11-16T20:58:24.346 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6808999999999998e-05 2020-11-16T20:58:24.346 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.346 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.346 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:24.346 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800852+0000", 2020-11-16T20:58:24.346 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042964599999999999 2020-11-16T20:58:24.346 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.347 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.347 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.347 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843817+0000", 2020-11-16T20:58:24.347 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00017807899999999999 2020-11-16T20:58:24.347 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.347 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.347 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:24.348 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843995+0000", 2020-11-16T20:58:24.348 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023680500000000001 2020-11-16T20:58:24.348 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.348 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.348 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:24.348 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844232+0000", 2020-11-16T20:58:24.348 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00320163 2020-11-16T20:58:24.348 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.349 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.349 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:24.349 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847434+0000", 2020-11-16T20:58:24.349 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00042527899999999998 2020-11-16T20:58:24.349 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.349 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.349 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:24.350 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.847859+0000", 2020-11-16T20:58:24.350 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0034987920000000001 2020-11-16T20:58:24.350 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.350 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:24.350 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851358+0000", 2020-11-16T20:58:24.350 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014067300000000001 2020-11-16T20:58:24.351 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.351 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.351 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:24.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851498+0000", 2020-11-16T20:58:24.351 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6577999999999998e-05 2020-11-16T20:58:24.351 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.351 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.351 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:24.352 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851575+0000", 2020-11-16T20:58:24.352 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.012971041 2020-11-16T20:58:24.352 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.352 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:24.352 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.352 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.353 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2988 4.0 4:033219d6:::smithi16641208-386:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e86)", 2020-11-16T20:58:24.353 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:58:24.353 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 95.393401796000006, 2020-11-16T20:58:24.353 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013229791000001, 2020-11-16T20:58:24.353 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:24.353 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:24.353 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:24.354 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:24.354 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:24.354 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2988 2020-11-16T20:58:24.354 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.354 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:24.354 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.354 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:24.354 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:58:24.355 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:24.355 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.355 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.355 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:24.355 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838706+0000", 2020-11-16T20:58:24.355 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9252999999999999e-05 2020-11-16T20:58:24.355 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.356 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.356 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:24.356 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838736+0000", 2020-11-16T20:58:24.356 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3980000000000004e-06 2020-11-16T20:58:24.356 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.356 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.356 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:24.357 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838742+0000", 2020-11-16T20:58:24.357 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1144999999999999e-05 2020-11-16T20:58:24.357 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.357 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.357 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:24.357 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838753+0000", 2020-11-16T20:58:24.357 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6229999999999996e-06 2020-11-16T20:58:24.357 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.358 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.358 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:24.358 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838758+0000", 2020-11-16T20:58:24.358 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5130000000000003e-05 2020-11-16T20:58:24.358 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.358 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.358 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.359 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838803+0000", 2020-11-16T20:58:24.359 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0132000000000001e-05 2020-11-16T20:58:24.359 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.359 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.359 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:24.359 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838843+0000", 2020-11-16T20:58:24.359 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962066786999999 2020-11-16T20:58:24.360 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.360 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.360 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.360 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800910+0000", 2020-11-16T20:58:24.360 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6925999999999997e-05 2020-11-16T20:58:24.360 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.360 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.360 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:24.361 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.800967+0000", 2020-11-16T20:58:24.361 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.043837752000000001 2020-11-16T20:58:24.361 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.361 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.361 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.361 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844805+0000", 2020-11-16T20:58:24.361 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012337000000000001 2020-11-16T20:58:24.362 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.362 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.362 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:24.362 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844928+0000", 2020-11-16T20:58:24.362 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0066885149999999999 2020-11-16T20:58:24.362 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.362 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.363 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.363 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851616+0000", 2020-11-16T20:58:24.363 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5716000000000005e-05 2020-11-16T20:58:24.363 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.363 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.363 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:24.363 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851692+0000", 2020-11-16T20:58:24.364 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024404400000000001 2020-11-16T20:58:24.364 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.364 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.364 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:24.364 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.851936+0000", 2020-11-16T20:58:24.364 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 13.013229791000001 2020-11-16T20:58:24.364 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.364 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:24.365 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.365 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.365 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.365 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2992 4.0 4:0f4a2e46:::smithi16641208-399:head [cache-evict] snapc 0=[] ondisk+read+ignore_cache+known_if_redirected e86)", 2020-11-16T20:58:24.365 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:58:24.365 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 95.393315458999993, 2020-11-16T20:58:24.365 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962433468, 2020-11-16T20:58:24.366 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:24.366 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:24.366 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:24.366 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:24.366 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:24.366 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2992 2020-11-16T20:58:24.366 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.366 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:24.367 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.367 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:24.367 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:58:24.367 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:24.367 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.367 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.367 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:24.368 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838793+0000", 2020-11-16T20:58:24.368 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7780000000000002e-05 2020-11-16T20:58:24.368 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.368 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.368 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:24.368 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838820+0000", 2020-11-16T20:58:24.368 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1200000000000001e-06 2020-11-16T20:58:24.369 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.369 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.369 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:24.369 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838826+0000", 2020-11-16T20:58:24.369 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0008e-05 2020-11-16T20:58:24.369 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.369 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.369 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:24.370 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838836+0000", 2020-11-16T20:58:24.370 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.3749999999999996e-06 2020-11-16T20:58:24.370 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.370 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.370 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:24.370 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838840+0000", 2020-11-16T20:58:24.370 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0889000000000002e-05 2020-11-16T20:58:24.371 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.371 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.371 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.371 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838871+0000", 2020-11-16T20:58:24.371 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6891000000000003e-05 2020-11-16T20:58:24.371 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.371 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.371 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:24.372 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838908+0000", 2020-11-16T20:58:24.372 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962115045999999 2020-11-16T20:58:24.372 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.372 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.372 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.372 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801023+0000", 2020-11-16T20:58:24.372 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020335899999999999 2020-11-16T20:58:24.373 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.373 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.373 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:24.373 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801226+0000", 2020-11-16T20:58:24.373 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 12.962433468 2020-11-16T20:58:24.373 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.373 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:24.373 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.374 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.374 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.374 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3051 4.0 4:2ceac9f9:::smithi16641208-61:head [write 699323~480842] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:58:24.374 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:58:24.374 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 90.391195151999995, 2020-11-16T20:58:24.374 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9728349610000002, 2020-11-16T20:58:24.374 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:24.375 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:24.375 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:24.375 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:24.375 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:24.375 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3051 2020-11-16T20:58:24.375 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.375 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:24.376 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.376 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:24.376 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:58:24.376 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:24.376 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.376 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.376 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:24.376 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.840913+0000", 2020-11-16T20:58:24.377 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032526199999999999 2020-11-16T20:58:24.377 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.377 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.377 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:24.377 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841238+0000", 2020-11-16T20:58:24.377 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.9822000000000001e-05 2020-11-16T20:58:24.377 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.378 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.378 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:24.378 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841258+0000", 2020-11-16T20:58:24.378 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.507e-05 2020-11-16T20:58:24.378 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.378 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.378 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:24.379 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841273+0000", 2020-11-16T20:58:24.379 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8900000000000007e-06 2020-11-16T20:58:24.379 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.379 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.379 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:24.379 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841281+0000", 2020-11-16T20:58:24.379 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.4356000000000003e-05 2020-11-16T20:58:24.379 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.380 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.380 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.380 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841365+0000", 2020-11-16T20:58:24.380 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0232000000000002e-05 2020-11-16T20:58:24.380 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.380 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.380 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:24.381 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.841426+0000", 2020-11-16T20:58:24.381 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9604309439999996 2020-11-16T20:58:24.381 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.381 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.381 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.381 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.801857+0000", 2020-11-16T20:58:24.381 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000164897 2020-11-16T20:58:24.382 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.382 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:24.382 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.802021+0000", 2020-11-16T20:58:24.382 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00020576500000000001 2020-11-16T20:58:24.382 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.382 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:24.383 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.802227+0000", 2020-11-16T20:58:24.383 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0066237170000000003 2020-11-16T20:58:24.383 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.383 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.383 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:24.383 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808851+0000", 2020-11-16T20:58:24.383 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0037712430000000001 2020-11-16T20:58:24.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.384 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:24.384 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812622+0000", 2020-11-16T20:58:24.384 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00099110800000000009 2020-11-16T20:58:24.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.384 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:24.385 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813613+0000", 2020-11-16T20:58:24.385 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1646e-05 2020-11-16T20:58:24.385 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.385 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.385 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:24.385 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813665+0000", 2020-11-16T20:58:24.385 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3009000000000004e-05 2020-11-16T20:58:24.386 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.386 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.386 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:24.386 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813748+0000", 2020-11-16T20:58:24.386 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9728349610000002 2020-11-16T20:58:24.386 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.386 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:24.387 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.387 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.387 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.387 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3052 4.0 4:2ceac9f9:::smithi16641208-61:head [write 1850247~429872] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:58:24.387 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:58:24.387 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 90.383004112999998, 2020-11-16T20:58:24.387 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9911138360000002, 2020-11-16T20:58:24.387 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:24.388 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:24.388 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:24.388 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:24.388 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:24.388 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3052 2020-11-16T20:58:24.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.388 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:24.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.389 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:24.389 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:58:24.389 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:24.389 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.389 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:24.390 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849104+0000", 2020-11-16T20:58:24.390 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000296166 2020-11-16T20:58:24.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.390 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.390 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:24.390 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849400+0000", 2020-11-16T20:58:24.390 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0699999999999996e-06 2020-11-16T20:58:24.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.391 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:24.391 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849409+0000", 2020-11-16T20:58:24.391 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3725e-05 2020-11-16T20:58:24.391 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.391 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:24.392 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849423+0000", 2020-11-16T20:58:24.392 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.9929999999999998e-06 2020-11-16T20:58:24.392 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.392 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.392 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:24.392 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849430+0000", 2020-11-16T20:58:24.392 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.9708000000000002e-05 2020-11-16T20:58:24.392 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.393 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.393 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.393 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849520+0000", 2020-11-16T20:58:24.393 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2088000000000002e-05 2020-11-16T20:58:24.393 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.393 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.393 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:24.394 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.849552+0000", 2020-11-16T20:58:24.394 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.954526692 2020-11-16T20:58:24.394 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.394 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.394 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.394 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804079+0000", 2020-11-16T20:58:24.394 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015456899999999999 2020-11-16T20:58:24.395 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.395 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.395 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:24.395 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804233+0000", 2020-11-16T20:58:24.395 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019627800000000001 2020-11-16T20:58:24.395 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.395 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.395 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:24.396 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.804429+0000", 2020-11-16T20:58:24.396 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.006762316 2020-11-16T20:58:24.396 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.396 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.396 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:24.396 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811192+0000", 2020-11-16T20:58:24.396 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.002630467 2020-11-16T20:58:24.397 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.397 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.397 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:24.397 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813822+0000", 2020-11-16T20:58:24.397 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.026302065999999999 2020-11-16T20:58:24.397 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.397 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.397 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:24.398 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840124+0000", 2020-11-16T20:58:24.398 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.274e-05 2020-11-16T20:58:24.398 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.398 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.398 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:24.398 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840177+0000", 2020-11-16T20:58:24.398 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.0958000000000003e-05 2020-11-16T20:58:24.399 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.399 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.399 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:24.399 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840218+0000", 2020-11-16T20:58:24.399 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9911138360000002 2020-11-16T20:58:24.399 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.399 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:24.399 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.400 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.400 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.400 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3053 4.0 4:2ceac9f9:::smithi16641208-61:head [write 2858378~532392] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:58:24.400 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:58:24.400 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 90.374546781999996, 2020-11-16T20:58:24.400 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9828430529999999, 2020-11-16T20:58:24.400 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:24.401 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:24.401 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:24.401 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:24.401 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:24.401 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3053 2020-11-16T20:58:24.401 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.401 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:24.401 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.402 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:24.402 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:58:24.402 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:24.402 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.402 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.402 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:24.402 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.857561+0000", 2020-11-16T20:58:24.403 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000647082 2020-11-16T20:58:24.403 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.403 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.403 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:24.403 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858208+0000", 2020-11-16T20:58:24.403 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.269e-05 2020-11-16T20:58:24.403 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.404 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.404 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:24.404 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858221+0000", 2020-11-16T20:58:24.404 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0361e-05 2020-11-16T20:58:24.404 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.404 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.404 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:24.404 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858242+0000", 2020-11-16T20:58:24.405 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1184e-05 2020-11-16T20:58:24.405 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.405 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.405 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:24.405 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858253+0000", 2020-11-16T20:58:24.405 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7032000000000004e-05 2020-11-16T20:58:24.405 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.406 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.406 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.406 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858330+0000", 2020-11-16T20:58:24.406 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4135999999999998e-05 2020-11-16T20:58:24.406 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.406 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.406 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:24.406 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858384+0000", 2020-11-16T20:58:24.407 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9487614310000003 2020-11-16T20:58:24.407 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.407 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.407 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.407 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807145+0000", 2020-11-16T20:58:24.407 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.9426000000000007e-05 2020-11-16T20:58:24.407 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.408 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.408 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:24.408 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807245+0000", 2020-11-16T20:58:24.408 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018410799999999999 2020-11-16T20:58:24.408 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.408 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.408 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:24.408 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.807429+0000", 2020-11-16T20:58:24.409 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0064067339999999999 2020-11-16T20:58:24.409 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.409 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.409 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:24.409 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813836+0000", 2020-11-16T20:58:24.409 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001513267 2020-11-16T20:58:24.409 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.410 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.410 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:24.410 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815349+0000", 2020-11-16T20:58:24.410 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.024962895999999998 2020-11-16T20:58:24.410 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.410 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.410 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:24.410 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840312+0000", 2020-11-16T20:58:24.411 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7781999999999997e-05 2020-11-16T20:58:24.411 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.411 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.411 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:24.411 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840370+0000", 2020-11-16T20:58:24.411 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4924e-05 2020-11-16T20:58:24.411 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.412 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.412 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:24.412 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840404+0000", 2020-11-16T20:58:24.412 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9828430529999999 2020-11-16T20:58:24.412 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.412 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:24.412 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.412 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.413 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.413 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3054 4.0 4:2ceac9f9:::smithi16641208-61:head [setxattr _header (57) in=7b,truncate 3899323] snapc 35=[] ondisk+write+known_if_redirected e91)", 2020-11-16T20:58:24.413 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:58:24.413 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 90.373794274999995, 2020-11-16T20:58:24.413 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9822430049999999, 2020-11-16T20:58:24.413 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:24.413 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:24.413 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:24.414 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:24.414 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:24.414 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3054 2020-11-16T20:58:24.414 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.414 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:24.414 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.414 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:24.415 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:58:24.415 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:24.415 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.415 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.415 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:24.415 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858314+0000", 2020-11-16T20:58:24.415 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8208999999999999e-05 2020-11-16T20:58:24.416 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.416 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.416 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:24.416 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858362+0000", 2020-11-16T20:58:24.416 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5539999999999998e-06 2020-11-16T20:58:24.416 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.416 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.417 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:24.417 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858371+0000", 2020-11-16T20:58:24.417 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.005e-05 2020-11-16T20:58:24.417 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.417 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.417 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:24.417 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858381+0000", 2020-11-16T20:58:24.417 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.8099999999999997e-06 2020-11-16T20:58:24.418 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.418 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.418 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:24.418 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858386+0000", 2020-11-16T20:58:24.418 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6168000000000005e-05 2020-11-16T20:58:24.418 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.418 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.419 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.419 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858482+0000", 2020-11-16T20:58:24.419 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7954999999999999e-05 2020-11-16T20:58:24.419 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.419 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.419 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:24.419 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858510+0000", 2020-11-16T20:58:24.419 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9498925639999998 2020-11-16T20:58:24.420 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.420 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.420 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.420 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808402+0000", 2020-11-16T20:58:24.420 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3084000000000005e-05 2020-11-16T20:58:24.420 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.420 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.421 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:24.421 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808495+0000", 2020-11-16T20:58:24.421 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000114826 2020-11-16T20:58:24.421 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.421 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.421 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 0,1", 2020-11-16T20:58:24.421 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.808610+0000", 2020-11-16T20:58:24.421 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0052363219999999999 2020-11-16T20:58:24.422 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.422 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.422 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:24.422 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.813846+0000", 2020-11-16T20:58:24.422 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0015700709999999999 2020-11-16T20:58:24.422 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.422 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.423 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:24.423 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.815417+0000", 2020-11-16T20:58:24.423 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.025048682999999999 2020-11-16T20:58:24.423 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.423 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.423 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:24.423 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840465+0000", 2020-11-16T20:58:24.423 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.5473000000000003e-05 2020-11-16T20:58:24.424 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.424 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.424 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:24.424 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840511+0000", 2020-11-16T20:58:24.424 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6236000000000003e-05 2020-11-16T20:58:24.424 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.424 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.425 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:24.425 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840557+0000", 2020-11-16T20:58:24.425 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9822430049999999 2020-11-16T20:58:24.425 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.425 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:24.425 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.425 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.425 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.426 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3055 4.0 4:2ceac9f9:::smithi16641208-61:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e91)", 2020-11-16T20:58:24.426 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:58:24.426 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 90.373619078999994, 2020-11-16T20:58:24.426 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9852841799999998, 2020-11-16T20:58:24.426 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:24.426 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:24.426 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:24.427 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:24.427 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:24.427 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3055 2020-11-16T20:58:24.427 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.427 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:24.427 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.427 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:24.427 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:58:24.428 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:24.428 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.428 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.428 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:24.428 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858489+0000", 2020-11-16T20:58:24.428 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4403000000000002e-05 2020-11-16T20:58:24.428 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.429 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.429 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:24.429 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858523+0000", 2020-11-16T20:58:24.429 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4670000000000001e-06 2020-11-16T20:58:24.429 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.429 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.429 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:24.430 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858530+0000", 2020-11-16T20:58:24.430 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2469999999999999e-05 2020-11-16T20:58:24.430 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.430 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.430 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:24.430 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858542+0000", 2020-11-16T20:58:24.430 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.2449999999999998e-06 2020-11-16T20:58:24.430 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.431 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.431 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:24.431 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858548+0000", 2020-11-16T20:58:24.431 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.9604000000000002e-05 2020-11-16T20:58:24.431 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.431 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.431 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.432 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858587+0000", 2020-11-16T20:58:24.432 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.4863000000000001e-05 2020-11-16T20:58:24.432 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.432 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.432 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:24.432 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.858632+0000", 2020-11-16T20:58:24.432 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9521692039999996 2020-11-16T20:58:24.432 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.433 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.433 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.433 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.810801+0000", 2020-11-16T20:58:24.433 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014886700000000001 2020-11-16T20:58:24.433 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.433 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.433 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:24.434 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.810950+0000", 2020-11-16T20:58:24.434 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029669781999999999 2020-11-16T20:58:24.434 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.434 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.434 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.434 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840620+0000", 2020-11-16T20:58:24.434 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010005699999999999 2020-11-16T20:58:24.434 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.435 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.435 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:24.435 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840720+0000", 2020-11-16T20:58:24.435 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030532179999999999 2020-11-16T20:58:24.435 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.435 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.435 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:24.436 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.843773+0000", 2020-11-16T20:58:24.436 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9852841799999998 2020-11-16T20:58:24.436 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.436 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:24.436 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.436 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.436 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.436 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3065 4.0 4:2f657946:::smithi16641208-73:head [read 0~3210104,checksum] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:58:24.437 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:58:24.437 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 90.265344056000004, 2020-11-16T20:58:24.437 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8738324339999997, 2020-11-16T20:58:24.437 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:24.437 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:24.437 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:24.437 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:24.438 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:24.438 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3065 2020-11-16T20:58:24.438 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.438 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:24.438 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.438 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:24.438 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:58:24.438 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:24.439 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.439 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.439 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:24.439 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966764+0000", 2020-11-16T20:58:24.439 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3065999999999999e-05 2020-11-16T20:58:24.439 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.439 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.440 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:24.440 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966787+0000", 2020-11-16T20:58:24.440 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8329999999999998e-06 2020-11-16T20:58:24.440 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.440 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.440 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:24.440 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966790+0000", 2020-11-16T20:58:24.441 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1780000000000002e-06 2020-11-16T20:58:24.441 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.441 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.441 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:24.441 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966795+0000", 2020-11-16T20:58:24.441 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3460000000000001e-06 2020-11-16T20:58:24.441 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.441 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.442 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:24.442 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966798+0000", 2020-11-16T20:58:24.442 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6675000000000003e-05 2020-11-16T20:58:24.442 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.442 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.442 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.442 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966844+0000", 2020-11-16T20:58:24.443 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5497999999999999e-05 2020-11-16T20:58:24.443 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.443 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.443 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:24.443 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966870+0000", 2020-11-16T20:58:24.443 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8445859479999998 2020-11-16T20:58:24.443 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.443 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.444 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.444 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811456+0000", 2020-11-16T20:58:24.444 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.029140889999999999 2020-11-16T20:58:24.444 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.444 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.444 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:24.444 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.840597+0000", 2020-11-16T20:58:24.445 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8738324339999997 2020-11-16T20:58:24.445 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.445 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:24.445 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.445 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.445 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.445 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3066 4.0 4:356864c0:::smithi16641208-150:head [read 0~2504243,checksum,omap-get-vals-by-keys,omap-get-keys,omap-get-vals,omap-get-header,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:58:24.446 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:58:24.446 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 90.265292830999996, 2020-11-16T20:58:24.446 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8778990499999999, 2020-11-16T20:58:24.446 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:24.446 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:24.446 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:24.446 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:24.446 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:24.447 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3066 2020-11-16T20:58:24.447 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.447 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:24.447 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.447 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:24.447 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:58:24.447 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:24.448 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.448 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.448 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:24.448 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966815+0000", 2020-11-16T20:58:24.448 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1704000000000001e-05 2020-11-16T20:58:24.448 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.448 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.448 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:24.449 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966837+0000", 2020-11-16T20:58:24.449 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6850000000000001e-06 2020-11-16T20:58:24.449 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.449 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.449 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:24.449 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966840+0000", 2020-11-16T20:58:24.449 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7479999999999999e-06 2020-11-16T20:58:24.450 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.450 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.450 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:24.450 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966845+0000", 2020-11-16T20:58:24.450 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5059999999999998e-06 2020-11-16T20:58:24.450 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.450 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.450 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:24.451 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966848+0000", 2020-11-16T20:58:24.451 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4314000000000002e-05 2020-11-16T20:58:24.451 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.451 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.451 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.451 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966902+0000", 2020-11-16T20:58:24.451 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.561e-05 2020-11-16T20:58:24.452 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.452 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.452 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:24.452 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:58:24.452 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8448102110000004 2020-11-16T20:58:24.452 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.452 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.452 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.453 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.811738+0000", 2020-11-16T20:58:24.453 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032976272000000001 2020-11-16T20:58:24.453 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.453 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.453 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:24.453 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844714+0000", 2020-11-16T20:58:24.453 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8778990499999999 2020-11-16T20:58:24.454 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.454 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:24.454 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.454 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.454 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.454 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3067 4.0 4:356864c0:::smithi16641208-150:head [sparse-read 0~2504243] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:58:24.454 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:58:24.455 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 90.265241373999999, 2020-11-16T20:58:24.455 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8780898150000001, 2020-11-16T20:58:24.455 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:24.455 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:24.455 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:24.455 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:24.455 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:24.455 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3067 2020-11-16T20:58:24.456 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.456 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:24.456 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.456 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:24.456 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:58:24.456 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:24.456 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.457 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.457 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:24.457 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966867+0000", 2020-11-16T20:58:24.457 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2826e-05 2020-11-16T20:58:24.457 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.457 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.457 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:24.457 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966900+0000", 2020-11-16T20:58:24.458 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.694e-06 2020-11-16T20:58:24.458 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.458 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.458 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:24.458 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966902+0000", 2020-11-16T20:58:24.458 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0889999999999999e-06 2020-11-16T20:58:24.458 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.459 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.459 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:24.459 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966907+0000", 2020-11-16T20:58:24.459 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3910000000000001e-06 2020-11-16T20:58:24.459 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.459 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.459 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:24.460 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966910+0000", 2020-11-16T20:58:24.460 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2771000000000002e-05 2020-11-16T20:58:24.621 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.621 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.622 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.622 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966943+0000", 2020-11-16T20:58:24.622 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5301000000000001e-05 2020-11-16T20:58:24.622 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.622 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.622 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:24.622 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966968+0000", 2020-11-16T20:58:24.623 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.845055017 2020-11-16T20:58:24.623 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.623 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.623 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.623 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812023+0000", 2020-11-16T20:58:24.623 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.032933726000000003 2020-11-16T20:58:24.623 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.624 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.624 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:24.624 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.844957+0000", 2020-11-16T20:58:24.624 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8780898150000001 2020-11-16T20:58:24.624 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.624 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:24.624 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.624 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.625 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.625 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3068 4.0 4:356864c0:::smithi16641208-150:head [read 0~2504243,checksum] snapc 0=[] ondisk+read+known_if_redirected e91)", 2020-11-16T20:58:24.625 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:58:24.625 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 90.265180036000004, 2020-11-16T20:58:24.625 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8828719500000002, 2020-11-16T20:58:24.625 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:24.625 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:24.626 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:24.626 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:24.626 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:24.626 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3068 2020-11-16T20:58:24.626 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.626 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:24.626 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.627 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:24.627 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:58:24.627 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:24.627 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.627 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.627 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:24.627 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966928+0000", 2020-11-16T20:58:24.628 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.0942999999999999e-05 2020-11-16T20:58:24.628 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.628 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.628 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:24.628 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966949+0000", 2020-11-16T20:58:24.628 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.712e-06 2020-11-16T20:58:24.628 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.628 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.629 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:24.629 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966952+0000", 2020-11-16T20:58:24.629 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.8479999999999997e-06 2020-11-16T20:58:24.629 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.629 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.629 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:24.629 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966958+0000", 2020-11-16T20:58:24.630 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9170000000000002e-06 2020-11-16T20:58:24.630 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.630 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.630 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:24.630 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966961+0000", 2020-11-16T20:58:24.630 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.4105999999999999e-05 2020-11-16T20:58:24.630 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.631 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.631 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.631 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.966985+0000", 2020-11-16T20:58:24.631 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.2056e-05 2020-11-16T20:58:24.631 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.631 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.631 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for readable", 2020-11-16T20:58:24.631 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:53.967007+0000", 2020-11-16T20:58:24.632 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8456606430000004 2020-11-16T20:58:24.632 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.632 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.632 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:24.632 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.812667+0000", 2020-11-16T20:58:24.632 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.037132724999999998 2020-11-16T20:58:24.632 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:24.633 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:24.633 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:24.633 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:01.849800+0000", 2020-11-16T20:58:24.633 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8828719500000002 2020-11-16T20:58:24.633 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.633 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:24.633 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.633 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:24.634 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:24.634 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:24.634 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:58:24.636 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-16T20:58:24.636 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:24.640+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:24.736 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:24.741+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:24.760 INFO:teuthology.orchestra.run.smithi166.stderr:noscrub is set 2020-11-16T20:58:24.814 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:24.814 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:58:24.814 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:58:24.814 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:24.824 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-16T20:58:24.827 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:58:24.837 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:24.841+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:24.850 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:58:24.869 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:58:24.889 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:58:24.910 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:58:24.930 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:58:24.938 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:24.942+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:24.951 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:58:24.957 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:24.957 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:24.967 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-16T20:58:24.972 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:58:24.973 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:58:24.974 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:58:24.974 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:58:24.974 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:58:24.974 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:58:24.974 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:58:24.975 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:58:24.975 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:58:25.039 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:25.044+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:25.099 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:25.099 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:25.108 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-16T20:58:25.152 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:25.156+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:25.240 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:58:25.243+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:58:25.256 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:25.256 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:25.266 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-16T20:58:25.350 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:25.354+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:25.442 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:25.442 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:25.442 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:58:25.445+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:58:25.451 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-16T20:58:25.543 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:58:25.547+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:58:25.627 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:25.627 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:25.637 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-16T20:58:25.643 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:25.648+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:25.744 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:25.748+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:25.772 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:25.772 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:25.781 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-16T20:58:25.845 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:25.850+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:25.946 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:25.950+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:25.957 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:25.957 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:25.967 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-16T20:58:26.047 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:26.052+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:26.142 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:26.142 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:26.148 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:58:26.153+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:58:26.151 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-16T20:58:26.249 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:26.253+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:26.286 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:26.286 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:26.296 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-16T20:58:26.350 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:26.355+0000 7f86a4e0c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 35284) UID: 0 2020-11-16T20:58:26.451 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:26.454+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:26.470 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:26.471 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:26.480 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-16T20:58:26.563 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:26.567+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:26.651 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:26.655+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:26.655 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:26.655 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:26.665 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-16T20:58:26.752 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:26.757+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:26.773 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2020-11-16T20:58:26.840 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:26.841 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:26.850 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-16T20:58:26.852 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:26.857+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:26.951 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7, 1] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:58:26.951 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:58:26.951 INFO:tasks.thrashosds.thrasher:inject_pause on 2 2020-11-16T20:58:26.952 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2020-11-16T20:58:26.952 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2020-11-16T20:58:26.952 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2020-11-16T20:58:26.953 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:26.957+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:26.985 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-16T20:58:26.986 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:26.986 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:26.994 INFO:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-16T20:58:27.042 INFO:tasks.rados.rados.0.smithi166.stdout:1275: got (2) No such file or directory 2020-11-16T20:58:27.046 INFO:tasks.rados.rados.0.smithi166.stdout:1285: expect (ObjNum 18 snap 0 seq_num 18) 2020-11-16T20:58:27.077 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:58:27.081+0000 7f185707d700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31577) UID: 0 2020-11-16T20:58:27.127 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:27.127 INFO:teuthology.orchestra.run.smithi166.stdout: "success": "" 2020-11-16T20:58:27.127 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:31.284 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:31.284 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:31.285 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:31.280+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:31.285 INFO:tasks.rados.rados.0.smithi166.stdout:1275: done (12 left) 2020-11-16T20:58:31.285 INFO:tasks.rados.rados.0.smithi166.stdout:1285: done (11 left) 2020-11-16T20:58:31.285 INFO:tasks.rados.rados.0.smithi166.stdout:1295: done (10 left) 2020-11-16T20:58:31.285 INFO:tasks.rados.rados.0.smithi166.stdout:1297: done (9 left) 2020-11-16T20:58:31.286 INFO:tasks.rados.rados.0.smithi166.stdout:1300: done (8 left) 2020-11-16T20:58:31.286 INFO:tasks.rados.rados.0.smithi166.stdout:1301: write (excl) oid 432 current snap is 60 2020-11-16T20:58:31.286 INFO:tasks.rados.rados.0.smithi166.stdout:1301: seq_num 707 ranges {682549=705519,1922181=464578,3148997=487666} 2020-11-16T20:58:31.286 INFO:tasks.rados.rados.0.smithi166.stdout:1301: writing smithi16641208-432 from 682549 to 1388068 tid 1 2020-11-16T20:58:31.286 INFO:tasks.rados.rados.0.smithi166.stdout:1301: writing smithi16641208-432 from 1922181 to 2386759 tid 2 2020-11-16T20:58:31.286 INFO:tasks.rados.rados.0.smithi166.stdout:1301: writing smithi16641208-432 from 3148997 to 3636663 tid 3 2020-11-16T20:58:31.286 INFO:tasks.rados.rados.0.smithi166.stdout:1302: write (excl) oid 434 current snap is 60 2020-11-16T20:58:31.287 INFO:tasks.rados.rados.0.smithi166.stdout:1302: seq_num 708 ranges {699356=497121,1980663=608236,3176420=415291} 2020-11-16T20:58:31.287 INFO:tasks.rados.rados.0.smithi166.stdout:1302: writing smithi16641208-434 from 699356 to 1196477 tid 1 2020-11-16T20:58:31.287 INFO:tasks.rados.rados.0.smithi166.stdout:1302: writing smithi16641208-434 from 1980663 to 2588899 tid 2 2020-11-16T20:58:31.287 INFO:tasks.rados.rados.0.smithi166.stdout:1302: writing smithi16641208-434 from 3176420 to 3591711 tid 3 2020-11-16T20:58:31.287 INFO:tasks.rados.rados.0.smithi166.stdout:1303: delete oid 4 current snap is 60 2020-11-16T20:58:31.287 INFO:tasks.rados.rados.0.smithi166.stdout:1287: finishing rollback tid 0 to smithi16641208-340 2020-11-16T20:58:31.287 INFO:tasks.rados.rados.0.smithi166.stdout:1296: got (2) No such file or directory 2020-11-16T20:58:31.288 INFO:tasks.rados.rados.0.smithi166.stdout:1299: expect (ObjNum 261 snap 0 seq_num 261) 2020-11-16T20:58:31.288 INFO:tasks.rados.rados.0.smithi166.stdout:1286: finishing write tid 1 to smithi16641208-294 2020-11-16T20:58:31.288 INFO:tasks.rados.rados.0.smithi166.stdout:1287: finishing rollback tid 1 to smithi16641208-340 2020-11-16T20:58:31.288 INFO:tasks.rados.rados.0.smithi166.stdout:1296: done (10 left) 2020-11-16T20:58:31.288 INFO:tasks.rados.rados.0.smithi166.stdout:1299: done (9 left) 2020-11-16T20:58:31.288 INFO:tasks.rados.rados.0.smithi166.stdout:1303: done (8 left) 2020-11-16T20:58:31.288 INFO:tasks.rados.rados.0.smithi166.stdout:1304: read oid 494 snap -1 2020-11-16T20:58:31.289 INFO:tasks.rados.rados.0.smithi166.stdout:1304: expect (ObjNum 683 snap 54 seq_num 683) 2020-11-16T20:58:31.289 INFO:tasks.rados.rados.0.smithi166.stdout:1305: read oid 354 snap -1 2020-11-16T20:58:31.289 INFO:tasks.rados.rados.0.smithi166.stdout:1305: expect (ObjNum 670 snap 48 seq_num 670) 2020-11-16T20:58:31.289 INFO:tasks.rados.rados.0.smithi166.stdout:1306: cache_try_flush oid 65 snap -1 2020-11-16T20:58:31.289 INFO:tasks.rados.rados.0.smithi166.stdout:1287: finishing rollback tid 2 to smithi16641208-340 2020-11-16T20:58:31.289 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 340 v 783 (ObjNum 545 snap 12 seq_num 545) dirty exists 2020-11-16T20:58:31.289 INFO:tasks.rados.rados.0.smithi166.stdout:1283: expect (ObjNum 349 snap 0 seq_num 349) 2020-11-16T20:58:31.290 INFO:tasks.rados.rados.0.smithi166.stdout:1289: finishing write tid 1 to smithi16641208-410 2020-11-16T20:58:31.290 INFO:tasks.rados.rados.0.smithi166.stdout:1291: finishing write tid 1 to smithi16641208-150 2020-11-16T20:58:31.290 INFO:tasks.rados.rados.0.smithi166.stdout:1286: finishing write tid 2 to smithi16641208-294 2020-11-16T20:58:31.290 INFO:tasks.rados.rados.0.smithi166.stdout:1286: finishing write tid 3 to smithi16641208-294 2020-11-16T20:58:31.290 INFO:tasks.rados.rados.0.smithi166.stdout:1286: finishing write tid 4 to smithi16641208-294 2020-11-16T20:58:31.290 INFO:tasks.rados.rados.0.smithi166.stdout:1286: finishing write tid 5 to smithi16641208-294 2020-11-16T20:58:31.290 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 294 v 786 (ObjNum 700 snap 59 seq_num 700) dirty exists 2020-11-16T20:58:31.291 INFO:tasks.rados.rados.0.smithi166.stdout:1286: left oid 294 (ObjNum 700 snap 59 seq_num 700) 2020-11-16T20:58:31.291 INFO:tasks.rados.rados.0.smithi166.stdout:1289: finishing write tid 2 to smithi16641208-410 2020-11-16T20:58:31.291 INFO:tasks.rados.rados.0.smithi166.stdout:1289: finishing write tid 3 to smithi16641208-410 2020-11-16T20:58:31.291 INFO:tasks.rados.rados.0.smithi166.stdout:1289: finishing write tid 4 to smithi16641208-410 2020-11-16T20:58:31.291 INFO:tasks.rados.rados.0.smithi166.stdout:1291: finishing write tid 2 to smithi16641208-150 2020-11-16T20:58:31.291 INFO:tasks.rados.rados.0.smithi166.stdout:1289: finishing write tid 5 to smithi16641208-410 2020-11-16T20:58:31.291 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 410 v 880 (ObjNum 702 snap 59 seq_num 702) dirty exists 2020-11-16T20:58:31.291 INFO:tasks.rados.rados.0.smithi166.stdout:1289: left oid 410 (ObjNum 702 snap 59 seq_num 702) 2020-11-16T20:58:31.292 INFO:tasks.rados.rados.0.smithi166.stdout:1283: done (10 left) 2020-11-16T20:58:31.292 INFO:tasks.rados.rados.0.smithi166.stdout:1286: done (9 left) 2020-11-16T20:58:31.292 INFO:tasks.rados.rados.0.smithi166.stdout:1287: done (8 left) 2020-11-16T20:58:31.292 INFO:tasks.rados.rados.0.smithi166.stdout:1289: done (7 left) 2020-11-16T20:58:31.292 INFO:tasks.rados.rados.0.smithi166.stdout:1307: rollback oid 165 current snap is 60 2020-11-16T20:58:31.292 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 165 to 48 2020-11-16T20:58:31.292 INFO:tasks.rados.rados.0.smithi166.stdout:1298: finishing copy_from to smithi16641208-57 2020-11-16T20:58:31.293 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 57 v 132 (ObjNum 252 snap 0 seq_num 252) dirty exists 2020-11-16T20:58:31.293 INFO:tasks.rados.rados.0.smithi166.stdout:1291: finishing write tid 3 to smithi16641208-150 2020-11-16T20:58:31.293 INFO:tasks.rados.rados.0.smithi166.stdout:1291: finishing write tid 4 to smithi16641208-150 2020-11-16T20:58:31.293 INFO:tasks.rados.rados.0.smithi166.stdout:1291: finishing write tid 5 to smithi16641208-150 2020-11-16T20:58:31.293 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 150 v 883 (ObjNum 703 snap 60 seq_num 703) dirty exists 2020-11-16T20:58:31.293 INFO:tasks.rados.rados.0.smithi166.stdout:1291: left oid 150 (ObjNum 703 snap 60 seq_num 703) 2020-11-16T20:58:31.293 INFO:tasks.rados.rados.0.smithi166.stdout:1298: finishing copy_from racing read to smithi16641208-57 2020-11-16T20:58:31.294 INFO:tasks.rados.rados.0.smithi166.stdout:1301: finishing write tid 1 to smithi16641208-432 2020-11-16T20:58:31.294 INFO:tasks.rados.rados.0.smithi166.stdout:1301: finishing write tid 2 to smithi16641208-432 2020-11-16T20:58:31.294 INFO:tasks.rados.rados.0.smithi166.stdout:1301: finishing write tid 3 to smithi16641208-432 2020-11-16T20:58:31.294 INFO:tasks.rados.rados.0.smithi166.stdout:1301: finishing write tid 4 to smithi16641208-432 2020-11-16T20:58:31.294 INFO:tasks.rados.rados.0.smithi166.stdout:1301: finishing write tid 5 to smithi16641208-432 2020-11-16T20:58:31.294 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 432 v 922 (ObjNum 707 snap 60 seq_num 707) dirty exists 2020-11-16T20:58:31.294 INFO:tasks.rados.rados.0.smithi166.stdout:1301: left oid 432 (ObjNum 707 snap 60 seq_num 707) 2020-11-16T20:58:31.295 INFO:tasks.rados.rados.0.smithi166.stdout:1302: finishing write tid 1 to smithi16641208-434 2020-11-16T20:58:31.295 INFO:tasks.rados.rados.0.smithi166.stdout:1302: finishing write tid 2 to smithi16641208-434 2020-11-16T20:58:31.295 INFO:tasks.rados.rados.0.smithi166.stdout:1302: finishing write tid 3 to smithi16641208-434 2020-11-16T20:58:31.295 INFO:tasks.rados.rados.0.smithi166.stdout:1302: finishing write tid 4 to smithi16641208-434 2020-11-16T20:58:31.295 INFO:tasks.rados.rados.0.smithi166.stdout:1302: finishing write tid 5 to smithi16641208-434 2020-11-16T20:58:31.295 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 434 v 889 (ObjNum 708 snap 60 seq_num 708) dirty exists 2020-11-16T20:58:31.295 INFO:tasks.rados.rados.0.smithi166.stdout:1302: left oid 434 (ObjNum 708 snap 60 seq_num 708) 2020-11-16T20:58:31.295 INFO:tasks.rados.rados.0.smithi166.stdout:1291: done (7 left) 2020-11-16T20:58:31.296 INFO:tasks.rados.rados.0.smithi166.stdout:1298: done (6 left) 2020-11-16T20:58:31.296 INFO:tasks.rados.rados.0.smithi166.stdout:1301: done (5 left) 2020-11-16T20:58:31.296 INFO:tasks.rados.rados.0.smithi166.stdout:1302: done (4 left) 2020-11-16T20:58:31.296 INFO:tasks.rados.rados.0.smithi166.stdout:1308: cache_flush oid 357 snap -1 2020-11-16T20:58:31.296 INFO:tasks.rados.rados.0.smithi166.stdout:1306: got (2) No such file or directory 2020-11-16T20:58:31.296 INFO:tasks.rados.rados.0.smithi166.stdout:1306: done (4 left) 2020-11-16T20:58:31.296 INFO:tasks.rados.rados.0.smithi166.stdout:1309: rollback oid 95 current snap is 60 2020-11-16T20:58:31.297 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 95 to 57 2020-11-16T20:58:31.297 INFO:tasks.rados.rados.0.smithi166.stdout:1305: expect (ObjNum 670 snap 48 seq_num 670) 2020-11-16T20:58:31.297 INFO:tasks.rados.rados.0.smithi166.stdout:1304: expect (ObjNum 683 snap 54 seq_num 683) 2020-11-16T20:58:31.297 INFO:tasks.rados.rados.0.smithi166.stdout:1308: got (0) Success 2020-11-16T20:58:31.297 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 357 v 0 (ObjNum 605 snap 30 seq_num 605) dirty exists 2020-11-16T20:58:31.297 INFO:tasks.rados.rados.0.smithi166.stdout:1309: finishing rollback tid 1 to smithi16641208-95 2020-11-16T20:58:31.297 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 95 v 855 (ObjNum 1728042752 snap 22090 seq_num 0) dirty dne 2020-11-16T20:58:31.298 INFO:tasks.rados.rados.0.smithi166.stdout:1307: finishing rollback tid 0 to smithi16641208-165 2020-11-16T20:58:31.298 INFO:tasks.rados.rados.0.smithi166.stdout:1307: finishing rollback tid 1 to smithi16641208-165 2020-11-16T20:58:31.298 INFO:tasks.rados.rados.0.smithi166.stdout:1307: finishing rollback tid 2 to smithi16641208-165 2020-11-16T20:58:31.298 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 165 v 892 (ObjNum 164 snap 0 seq_num 164) dirty exists 2020-11-16T20:58:31.298 INFO:tasks.rados.rados.0.smithi166.stdout:1304: done (4 left) 2020-11-16T20:58:31.298 INFO:tasks.rados.rados.0.smithi166.stdout:1305: done (3 left) 2020-11-16T20:58:31.298 INFO:tasks.rados.rados.0.smithi166.stdout:1307: done (2 left) 2020-11-16T20:58:31.299 INFO:tasks.rados.rados.0.smithi166.stdout:1308: done (1 left) 2020-11-16T20:58:31.299 INFO:tasks.rados.rados.0.smithi166.stdout:1309: done (0 left) 2020-11-16T20:58:31.299 INFO:tasks.rados.rados.0.smithi166.stdout:1310: copy_from oid 328 from oid 413 current snap is 60 2020-11-16T20:58:31.299 INFO:tasks.rados.rados.0.smithi166.stdout:1311: write (excl) oid 349 current snap is 60 2020-11-16T20:58:31.299 INFO:tasks.rados.rados.0.smithi166.stdout:1311: seq_num 710 ranges {732970=647619,2097627=611905,3231266=437835} 2020-11-16T20:58:31.299 INFO:tasks.rados.rados.0.smithi166.stdout:1311: writing smithi16641208-349 from 732970 to 1380589 tid 1 2020-11-16T20:58:31.299 INFO:tasks.rados.rados.0.smithi166.stdout:1311: writing smithi16641208-349 from 2097627 to 2709532 tid 2 2020-11-16T20:58:31.299 INFO:tasks.rados.rados.0.smithi166.stdout:1311: writing smithi16641208-349 from 3231266 to 3669101 tid 3 2020-11-16T20:58:31.300 INFO:tasks.rados.rados.0.smithi166.stdout:1312: cache_evict oid 245 snap 57 2020-11-16T20:58:31.300 INFO:tasks.rados.rados.0.smithi166.stdout:1311: finishing write tid 1 to smithi16641208-349 2020-11-16T20:58:31.300 INFO:tasks.rados.rados.0.smithi166.stdout:1310: finishing copy_from to smithi16641208-328 2020-11-16T20:58:31.300 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 328 v 620 (ObjNum 412 snap 0 seq_num 412) dirty exists 2020-11-16T20:58:31.300 INFO:tasks.rados.rados.0.smithi166.stdout:1312: got (2) No such file or directory 2020-11-16T20:58:31.300 INFO:tasks.rados.rados.0.smithi166.stdout:1312: done (2 left) 2020-11-16T20:58:31.300 INFO:tasks.rados.rados.0.smithi166.stdout:1313: read oid 186 snap -1 2020-11-16T20:58:31.301 INFO:tasks.rados.rados.0.smithi166.stdout:1313: expect (ObjNum 185 snap 0 seq_num 185) 2020-11-16T20:58:31.301 INFO:tasks.rados.rados.0.smithi166.stdout:1314: cache_evict oid 500 snap 57 2020-11-16T20:58:31.301 INFO:tasks.rados.rados.0.smithi166.stdout:1315: copy_from oid 87 from oid 184 current snap is 60 2020-11-16T20:58:31.301 INFO:tasks.rados.rados.0.smithi166.stdout:1316: snap_remove snap 48 2020-11-16T20:58:31.301 INFO:tasks.rados.rados.0.smithi166.stdout:1316: done (5 left) 2020-11-16T20:58:31.301 INFO:tasks.rados.rados.0.smithi166.stdout:1317: snap_create 2020-11-16T20:58:31.301 INFO:tasks.rados.rados.0.smithi166.stdout:1314: got (2) No such file or directory 2020-11-16T20:58:31.302 INFO:tasks.rados.rados.0.smithi166.stdout:1313: expect (ObjNum 185 snap 0 seq_num 185) 2020-11-16T20:58:31.302 INFO:tasks.rados.rados.0.smithi166.stdout:1310: finishing copy_from racing read to smithi16641208-328 2020-11-16T20:58:31.302 INFO:tasks.rados.rados.0.smithi166.stdout:1311: finishing write tid 2 to smithi16641208-349 2020-11-16T20:58:31.302 INFO:tasks.rados.rados.0.smithi166.stdout:1311: finishing write tid 3 to smithi16641208-349 2020-11-16T20:58:31.302 INFO:tasks.rados.rados.0.smithi166.stdout:1311: finishing write tid 4 to smithi16641208-349 2020-11-16T20:58:31.302 INFO:tasks.rados.rados.0.smithi166.stdout:1311: finishing write tid 5 to smithi16641208-349 2020-11-16T20:58:31.302 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 349 v 925 (ObjNum 710 snap 60 seq_num 710) dirty exists 2020-11-16T20:58:31.303 INFO:tasks.rados.rados.0.smithi166.stdout:1311: left oid 349 (ObjNum 710 snap 60 seq_num 710) 2020-11-16T20:58:31.303 INFO:tasks.rados.rados.0.smithi166.stdout:1315: finishing copy_from to smithi16641208-87 2020-11-16T20:58:31.303 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 87 v 112 (ObjNum 183 snap 0 seq_num 183) dirty exists 2020-11-16T20:58:31.303 INFO:tasks.rados.rados.0.smithi166.stdout:1315: finishing copy_from racing read to smithi16641208-87 2020-11-16T20:58:31.303 INFO:tasks.rados.rados.0.smithi166.stdout:1310: done (5 left) 2020-11-16T20:58:31.303 INFO:tasks.rados.rados.0.smithi166.stdout:1311: done (4 left) 2020-11-16T20:58:31.303 INFO:tasks.rados.rados.0.smithi166.stdout:1313: done (3 left) 2020-11-16T20:58:31.303 INFO:tasks.rados.rados.0.smithi166.stdout:1314: done (2 left) 2020-11-16T20:58:31.304 INFO:tasks.rados.rados.0.smithi166.stdout:1315: done (1 left) 2020-11-16T20:58:31.304 INFO:tasks.rados.rados.0.smithi166.stdout:1317: done (0 left) 2020-11-16T20:58:31.304 INFO:tasks.rados.rados.0.smithi166.stdout:1318: write oid 238 current snap is 61 2020-11-16T20:58:31.304 INFO:tasks.rados.rados.0.smithi166.stdout:1318: seq_num 711 ranges {749777=722868,2156109=471916,3258689=649107} 2020-11-16T20:58:31.304 INFO:tasks.rados.rados.0.smithi166.stdout:1318: writing smithi16641208-238 from 749777 to 1472645 tid 1 2020-11-16T20:58:31.304 INFO:tasks.rados.rados.0.smithi166.stdout:1318: writing smithi16641208-238 from 2156109 to 2628025 tid 2 2020-11-16T20:58:31.304 INFO:tasks.rados.rados.0.smithi166.stdout:1318: writing smithi16641208-238 from 3258689 to 3907796 tid 3 2020-11-16T20:58:31.305 INFO:tasks.rados.rados.0.smithi166.stdout:1319: write oid 457 current snap is 61 2020-11-16T20:58:31.305 INFO:tasks.rados.rados.0.smithi166.stdout:1318: finishing write tid 1 to smithi16641208-238 2020-11-16T20:58:31.305 INFO:tasks.rados.rados.0.smithi166.stdout:1319: seq_num 712 ranges {766584=798117,2098238=615574,3169759=460379} 2020-11-16T20:58:31.305 INFO:tasks.rados.rados.0.smithi166.stdout:1319: writing smithi16641208-457 from 766584 to 1564701 tid 1 2020-11-16T20:58:31.305 INFO:tasks.rados.rados.0.smithi166.stdout:1319: writing smithi16641208-457 from 2098238 to 2713812 tid 2 2020-11-16T20:58:31.305 INFO:tasks.rados.rados.0.smithi166.stdout:1319: writing smithi16641208-457 from 3169759 to 3630138 tid 3 2020-11-16T20:58:31.305 INFO:tasks.rados.rados.0.smithi166.stdout:1320: read oid 103 snap -1 2020-11-16T20:58:31.306 INFO:tasks.rados.rados.0.smithi166.stdout:1320: expect (ObjNum 102 snap 0 seq_num 102) 2020-11-16T20:58:31.306 INFO:tasks.rados.rados.0.smithi166.stdout:1321: copy_from oid 453 from oid 43 current snap is 61 2020-11-16T20:58:31.306 INFO:tasks.rados.rados.0.smithi166.stdout:1318: finishing write tid 2 to smithi16641208-238 2020-11-16T20:58:31.306 INFO:tasks.rados.rados.0.smithi166.stdout:1318: finishing write tid 3 to smithi16641208-238 2020-11-16T20:58:31.306 INFO:tasks.rados.rados.0.smithi166.stdout:1318: finishing write tid 4 to smithi16641208-238 2020-11-16T20:58:31.306 INFO:tasks.rados.rados.0.smithi166.stdout:1318: finishing write tid 5 to smithi16641208-238 2020-11-16T20:58:31.306 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 238 v 923 (ObjNum 711 snap 61 seq_num 711) dirty exists 2020-11-16T20:58:31.307 INFO:tasks.rados.rados.0.smithi166.stdout:1318: left oid 238 (ObjNum 711 snap 61 seq_num 711) 2020-11-16T20:58:31.307 INFO:tasks.rados.rados.0.smithi166.stdout:1319: finishing write tid 1 to smithi16641208-457 2020-11-16T20:58:31.307 INFO:tasks.rados.rados.0.smithi166.stdout:1318: done (3 left) 2020-11-16T20:58:31.307 INFO:tasks.rados.rados.0.smithi166.stdout:1322: cache_evict oid 371 snap 57 2020-11-16T20:58:31.307 INFO:tasks.rados.rados.0.smithi166.stdout:1323: cache_evict oid 195 snap -1 2020-11-16T20:58:31.307 INFO:tasks.rados.rados.0.smithi166.stdout:1324: snap_create 2020-11-16T20:58:31.307 INFO:tasks.rados.rados.0.smithi166.stdout:1319: finishing write tid 2 to smithi16641208-457 2020-11-16T20:58:31.308 INFO:tasks.rados.rados.0.smithi166.stdout:1322: got (16) Device or resource busy 2020-11-16T20:58:31.308 INFO:tasks.rados.rados.0.smithi166.stdout:1323: got (2) No such file or directory 2020-11-16T20:58:31.308 INFO:tasks.rados.rados.0.smithi166.stdout:1320: expect (ObjNum 102 snap 0 seq_num 102) 2020-11-16T20:58:31.308 INFO:tasks.rados.rados.0.smithi166.stdout:1319: finishing write tid 3 to smithi16641208-457 2020-11-16T20:58:31.308 INFO:tasks.rados.rados.0.smithi166.stdout:1319: finishing write tid 4 to smithi16641208-457 2020-11-16T20:58:31.308 INFO:tasks.rados.rados.0.smithi166.stdout:1321: finishing copy_from to smithi16641208-453 2020-11-16T20:58:31.308 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 453 v 13 (ObjNum 42 snap 0 seq_num 42) dirty exists 2020-11-16T20:58:31.308 INFO:tasks.rados.rados.0.smithi166.stdout:1319: finishing write tid 5 to smithi16641208-457 2020-11-16T20:58:31.309 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 457 v 952 (ObjNum 712 snap 61 seq_num 712) dirty exists 2020-11-16T20:58:31.309 INFO:tasks.rados.rados.0.smithi166.stdout:1319: left oid 457 (ObjNum 712 snap 61 seq_num 712) 2020-11-16T20:58:31.309 INFO:tasks.rados.rados.0.smithi166.stdout:1321: finishing copy_from racing read to smithi16641208-453 2020-11-16T20:58:31.309 INFO:tasks.rados.rados.0.smithi166.stdout:1319: done (5 left) 2020-11-16T20:58:31.309 INFO:tasks.rados.rados.0.smithi166.stdout:1320: done (4 left) 2020-11-16T20:58:31.309 INFO:tasks.rados.rados.0.smithi166.stdout:1321: done (3 left) 2020-11-16T20:58:31.309 INFO:tasks.rados.rados.0.smithi166.stdout:1322: done (2 left) 2020-11-16T20:58:31.310 INFO:tasks.rados.rados.0.smithi166.stdout:1323: done (1 left) 2020-11-16T20:58:31.310 INFO:tasks.rados.rados.0.smithi166.stdout:1324: done (0 left) 2020-11-16T20:58:31.310 INFO:tasks.rados.rados.0.smithi166.stdout:1325: write (excl) oid 469 current snap is 62 2020-11-16T20:58:31.310 INFO:tasks.rados.rados.0.smithi166.stdout:1325: seq_num 713 ranges {783391=473366,1756720=475585,2797182=788004} 2020-11-16T20:58:31.310 INFO:tasks.rados.rados.0.smithi166.stdout:1325: writing smithi16641208-469 from 783391 to 1256757 tid 1 2020-11-16T20:58:31.310 INFO:tasks.rados.rados.0.smithi166.stdout:1325: writing smithi16641208-469 from 1756720 to 2232305 tid 2 2020-11-16T20:58:31.310 INFO:tasks.rados.rados.0.smithi166.stdout:1325: writing smithi16641208-469 from 2797182 to 3585186 tid 3 2020-11-16T20:58:31.311 INFO:tasks.rados.rados.0.smithi166.stdout:1326: read oid 353 snap 60 2020-11-16T20:58:31.311 INFO:tasks.rados.rados.0.smithi166.stdout:1326: expect (ObjNum 352 snap 0 seq_num 352) 2020-11-16T20:58:31.311 INFO:tasks.rados.rados.0.smithi166.stdout:1327: write oid 80 current snap is 62 2020-11-16T20:58:31.311 INFO:tasks.rados.rados.0.smithi166.stdout:1325: finishing write tid 1 to smithi16641208-469 2020-11-16T20:58:31.311 INFO:tasks.rados.rados.0.smithi166.stdout:1327: seq_num 714 ranges {400198=548615,1415202=584996} 2020-11-16T20:58:31.311 INFO:tasks.rados.rados.0.smithi166.stdout:1327: writing smithi16641208-80 from 400198 to 948813 tid 1 2020-11-16T20:58:31.311 INFO:tasks.rados.rados.0.smithi166.stdout:1327: writing smithi16641208-80 from 1415202 to 2000198 tid 2 2020-11-16T20:58:31.312 INFO:tasks.rados.rados.0.smithi166.stdout:1328: rollback oid 351 current snap is 62 2020-11-16T20:58:31.312 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 351 to 57 2020-11-16T20:58:31.312 INFO:tasks.rados.rados.0.smithi166.stdout:1325: finishing write tid 2 to smithi16641208-469 2020-11-16T20:58:31.312 INFO:tasks.rados.rados.0.smithi166.stdout:1326: expect (ObjNum 352 snap 0 seq_num 352) 2020-11-16T20:58:31.312 INFO:tasks.rados.rados.0.smithi166.stdout:1325: finishing write tid 3 to smithi16641208-469 2020-11-16T20:58:31.312 INFO:tasks.rados.rados.0.smithi166.stdout:1325: finishing write tid 4 to smithi16641208-469 2020-11-16T20:58:31.312 INFO:tasks.rados.rados.0.smithi166.stdout:1325: finishing write tid 5 to smithi16641208-469 2020-11-16T20:58:31.313 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 469 v 955 (ObjNum 713 snap 62 seq_num 713) dirty exists 2020-11-16T20:58:31.313 INFO:tasks.rados.rados.0.smithi166.stdout:1325: left oid 469 (ObjNum 713 snap 62 seq_num 713) 2020-11-16T20:58:31.313 INFO:tasks.rados.rados.0.smithi166.stdout:1325: done (3 left) 2020-11-16T20:58:31.313 INFO:tasks.rados.rados.0.smithi166.stdout:1326: done (2 left) 2020-11-16T20:58:31.313 INFO:tasks.rados.rados.0.smithi166.stdout:1329: read oid 385 snap -1 2020-11-16T20:58:31.313 INFO:tasks.rados.rados.0.smithi166.stdout:1329: expect (ObjNum 640 snap 40 seq_num 640) 2020-11-16T20:58:31.313 INFO:tasks.rados.rados.0.smithi166.stdout:1330: write (excl) oid 190 current snap is 62 2020-11-16T20:58:31.313 INFO:tasks.rados.rados.0.smithi166.stdout:1327: finishing write tid 1 to smithi16641208-80 2020-11-16T20:58:31.314 INFO:tasks.rados.rados.0.smithi166.stdout:1330: seq_num 715 ranges {417005=740217,1590037=426968} 2020-11-16T20:58:31.314 INFO:tasks.rados.rados.0.smithi166.stdout:1330: writing smithi16641208-190 from 417005 to 1157222 tid 1 2020-11-16T20:58:31.314 INFO:tasks.rados.rados.0.smithi166.stdout:1330: writing smithi16641208-190 from 1590037 to 2017005 tid 2 2020-11-16T20:58:31.314 INFO:tasks.rados.rados.0.smithi166.stdout:1331: read oid 495 snap -1 2020-11-16T20:58:31.314 INFO:tasks.rados.rados.0.smithi166.stdout:1331: expect deleted 2020-11-16T20:58:31.314 INFO:tasks.rados.rados.0.smithi166.stdout:1332: rollback oid 373 current snap is 62 2020-11-16T20:58:31.314 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 373 to 60 2020-11-16T20:58:31.315 INFO:tasks.rados.rados.0.smithi166.stdout:1328: finishing rollback tid 0 to smithi16641208-351 2020-11-16T20:58:31.315 INFO:tasks.rados.rados.0.smithi166.stdout:1327: finishing write tid 2 to smithi16641208-80 2020-11-16T20:58:31.315 INFO:tasks.rados.rados.0.smithi166.stdout:1327: finishing write tid 3 to smithi16641208-80 2020-11-16T20:58:31.315 INFO:tasks.rados.rados.0.smithi166.stdout:1327: finishing write tid 4 to smithi16641208-80 2020-11-16T20:58:31.315 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 80 v 959 (ObjNum 714 snap 62 seq_num 714) dirty exists 2020-11-16T20:58:31.315 INFO:tasks.rados.rados.0.smithi166.stdout:1327: left oid 80 (ObjNum 714 snap 62 seq_num 714) 2020-11-16T20:58:31.315 INFO:tasks.rados.rados.0.smithi166.stdout:1328: finishing rollback tid 1 to smithi16641208-351 2020-11-16T20:58:31.316 INFO:tasks.rados.rados.0.smithi166.stdout:1328: finishing rollback tid 2 to smithi16641208-351 2020-11-16T20:58:31.316 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 351 v 961 (ObjNum 350 snap 0 seq_num 350) dirty exists 2020-11-16T20:58:31.316 INFO:tasks.rados.rados.0.smithi166.stdout:1329: expect (ObjNum 640 snap 40 seq_num 640) 2020-11-16T20:58:31.316 INFO:tasks.rados.rados.0.smithi166.stdout:1330: finishing write tid 1 to smithi16641208-190 2020-11-16T20:58:31.316 INFO:tasks.rados.rados.0.smithi166.stdout:1330: finishing write tid 2 to smithi16641208-190 2020-11-16T20:58:31.316 INFO:tasks.rados.rados.0.smithi166.stdout:1332: finishing rollback tid 0 to smithi16641208-373 2020-11-16T20:58:31.316 INFO:tasks.rados.rados.0.smithi166.stdout:1330: finishing write tid 3 to smithi16641208-190 2020-11-16T20:58:31.317 INFO:tasks.rados.rados.0.smithi166.stdout:1327: done (5 left) 2020-11-16T20:58:31.317 INFO:tasks.rados.rados.0.smithi166.stdout:1328: done (4 left) 2020-11-16T20:58:31.317 INFO:tasks.rados.rados.0.smithi166.stdout:1329: done (3 left) 2020-11-16T20:58:31.317 INFO:tasks.rados.rados.0.smithi166.stdout:1331: done (2 left) 2020-11-16T20:58:31.317 INFO:tasks.rados.rados.0.smithi166.stdout:1333: snap_remove snap 61 2020-11-16T20:58:31.317 INFO:tasks.rados.rados.0.smithi166.stdout:1333: done (2 left) 2020-11-16T20:58:31.317 INFO:tasks.rados.rados.0.smithi166.stdout:1334: snap_create 2020-11-16T20:58:31.318 INFO:tasks.rados.rados.0.smithi166.stdout:1330: finishing write tid 4 to smithi16641208-190 2020-11-16T20:58:31.318 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 190 v 926 (ObjNum 715 snap 62 seq_num 715) dirty exists 2020-11-16T20:58:31.318 INFO:tasks.rados.rados.0.smithi166.stdout:1330: left oid 190 (ObjNum 715 snap 62 seq_num 715) 2020-11-16T20:58:31.318 INFO:tasks.rados.rados.0.smithi166.stdout:1332: finishing rollback tid 1 to smithi16641208-373 2020-11-16T20:58:31.318 INFO:tasks.rados.rados.0.smithi166.stdout:1332: finishing rollback tid 2 to smithi16641208-373 2020-11-16T20:58:31.318 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 373 v 813 (ObjNum 372 snap 0 seq_num 372) dirty exists 2020-11-16T20:58:31.318 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:58:31.319 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:58:31.319 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:58:31.319 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:58:31.319 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:58:31.319 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:58:31.319 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:58:31.319 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:58:31.320 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-16T20:58:31.320 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-16T20:58:31.320 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-16T20:58:31.320 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-16T20:58:31.320 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-16T20:58:31.320 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-16T20:58:31.321 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-16T20:58:31.321 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-16T20:58:31.321 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:27.969+0000 7ff3c9a43700 -1 osd.0 pg_epoch: 175 pg[3.1( v 175'929 (0'0,175'929] local-lis/les=19/20 n=143 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [0,4,3] r=0 lpr=19 luod=175'927 crt=175'929 lcod 175'925 mlcod 175'925 active+clean+snaptrim trimq=[61~1]] removing snap head 2020-11-16T20:58:31.321 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:27.982+0000 7ff3cda4b700 -1 osd.0 pg_epoch: 175 pg[3.1( v 175'933 (0'0,175'933] local-lis/les=19/20 n=140 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [0,4,3] r=0 lpr=19 luod=175'931 crt=175'933 lcod 175'929 mlcod 175'929 active+clean+snaptrim trimq=[61~1]] removing snap head 2020-11-16T20:58:31.321 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:28.006+0000 7ff3cda4b700 -1 osd.0 pg_epoch: 175 pg[3.1( v 175'941 (0'0,175'941] local-lis/les=19/20 n=136 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [0,4,3] r=0 lpr=19 luod=175'939 crt=175'941 lcod 175'937 mlcod 175'937 active+clean+snaptrim trimq=[61~1]] removing snap head 2020-11-16T20:58:31.321 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:28.011+0000 7ff3cca49700 -1 osd.0 pg_epoch: 175 pg[3.3( v 175'908 (0'0,175'908] local-lis/les=167/168 n=128 ec=19/19 lis/c=167/167 les/c/f=168/168/0 sis=167) [0,4,6] r=0 lpr=167 crt=175'908 lcod 175'906 mlcod 175'906 active+clean+snaptrim trimq=[61~1]] removing snap head 2020-11-16T20:58:31.322 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:28.012+0000 7ff3cca49700 -1 osd.0 pg_epoch: 175 pg[3.3( v 175'910 (0'0,175'910] local-lis/les=167/168 n=126 ec=19/19 lis/c=167/167 les/c/f=168/168/0 sis=167) [0,4,6] r=0 lpr=167 luod=175'908 crt=175'910 lcod 175'906 mlcod 175'906 active+clean+snaptrim trimq=[61~1]] removing snap head 2020-11-16T20:58:31.322 INFO:teuthology.orchestra.run.smithi166.stderr:nodeep-scrub is set 2020-11-16T20:58:31.322 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:58:28.006+0000 7f1d7eff6700 -1 osd.3 pg_epoch: 175 pg[4.1( v 175'589 (0'0,175'589] local-lis/les=167/168 n=45 ec=22/22 lis/c=167/167 les/c/f=168/168/0 sis=167) [3,4,6] r=0 lpr=167 luod=175'587 crt=175'589 lcod 175'585 mlcod 175'585 active+clean+snaptrim trimq=[61~1]] removing snap head 2020-11-16T20:58:31.323 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-16T20:58:31.376 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:31.381+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:31.455 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:31.456 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:58:31.456 INFO:teuthology.orchestra.run.smithi166.stdout: "num_ops": 0 2020-11-16T20:58:31.456 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:31.465 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-16T20:58:31.508 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:58:31.513+0000 7f011d37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 35286) UID: 0 2020-11-16T20:58:31.577 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:31.582+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:35.726 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-16T20:58:35.727 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2020-11-16T20:58:35.731 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:35.731 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [], 2020-11-16T20:58:35.731 INFO:teuthology.orchestra.run.smithi166.stdout: "complaint_time": 30, 2020-11-16T20:58:35.731 INFO:teuthology.orchestra.run.smithi166.stdout: "num_blocked_ops": 0 2020-11-16T20:58:35.731 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:35.732 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-16T20:58:35.732 INFO:tasks.rados.rados.0.smithi166.stdout:1330: done (2 left) 2020-11-16T20:58:35.732 INFO:tasks.rados.rados.0.smithi166.stdout:1332: done (1 left) 2020-11-16T20:58:35.733 INFO:tasks.rados.rados.0.smithi166.stdout:1334: done (0 left) 2020-11-16T20:58:35.733 INFO:tasks.rados.rados.0.smithi166.stdout:1335: rollback oid 131 current snap is 63 2020-11-16T20:58:35.733 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 131 to 62 2020-11-16T20:58:35.733 INFO:tasks.rados.rados.0.smithi166.stdout:1336: read oid 323 snap -1 2020-11-16T20:58:35.733 INFO:tasks.rados.rados.0.smithi166.stdout:1336: expect (ObjNum 322 snap 0 seq_num 322) 2020-11-16T20:58:35.733 INFO:tasks.rados.rados.0.smithi166.stdout:1337: read oid 384 snap -1 2020-11-16T20:58:35.733 INFO:tasks.rados.rados.0.smithi166.stdout:1337: expect (ObjNum 383 snap 0 seq_num 383) 2020-11-16T20:58:35.734 INFO:tasks.rados.rados.0.smithi166.stdout:1338: cache_try_flush oid 87 snap -1 2020-11-16T20:58:35.734 INFO:tasks.rados.rados.0.smithi166.stdout:1339: cache_flush oid 446 snap -1 2020-11-16T20:58:35.734 INFO:tasks.rados.rados.0.smithi166.stdout:1340: rollback oid 163 current snap is 63 2020-11-16T20:58:35.734 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 163 to 62 2020-11-16T20:58:35.734 INFO:tasks.rados.rados.0.smithi166.stdout:1341: snap_remove snap 60 2020-11-16T20:58:35.734 INFO:tasks.rados.rados.0.smithi166.stdout:1338: got (0) Success 2020-11-16T20:58:35.734 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 87 v 0 (ObjNum 183 snap 0 seq_num 183) dirty exists 2020-11-16T20:58:35.735 INFO:tasks.rados.rados.0.smithi166.stdout:1339: got (2) No such file or directory 2020-11-16T20:58:35.735 INFO:tasks.rados.rados.0.smithi166.stdout:1337: expect (ObjNum 383 snap 0 seq_num 383) 2020-11-16T20:58:35.735 INFO:tasks.rados.rados.0.smithi166.stdout:1335: finishing rollback tid 0 to smithi16641208-131 2020-11-16T20:58:35.735 INFO:tasks.rados.rados.0.smithi166.stdout:1336: expect (ObjNum 322 snap 0 seq_num 322) 2020-11-16T20:58:35.735 INFO:tasks.rados.rados.0.smithi166.stdout:1340: finishing rollback tid 0 to smithi16641208-163 2020-11-16T20:58:35.735 INFO:tasks.rados.rados.0.smithi166.stdout:1335: finishing rollback tid 1 to smithi16641208-131 2020-11-16T20:58:35.735 INFO:tasks.rados.rados.0.smithi166.stdout:1335: finishing rollback tid 2 to smithi16641208-131 2020-11-16T20:58:35.736 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 131 v 928 (ObjNum 633 snap 39 seq_num 633) dirty exists 2020-11-16T20:58:35.736 INFO:tasks.rados.rados.0.smithi166.stdout:1340: finishing rollback tid 1 to smithi16641208-163 2020-11-16T20:58:35.736 INFO:tasks.rados.rados.0.smithi166.stdout:1340: finishing rollback tid 2 to smithi16641208-163 2020-11-16T20:58:35.736 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 163 v 969 (ObjNum 162 snap 0 seq_num 162) dirty exists 2020-11-16T20:58:35.736 INFO:tasks.rados.rados.0.smithi166.stdout:1335: done (6 left) 2020-11-16T20:58:35.736 INFO:tasks.rados.rados.0.smithi166.stdout:1336: done (5 left) 2020-11-16T20:58:35.736 INFO:tasks.rados.rados.0.smithi166.stdout:1337: done (4 left) 2020-11-16T20:58:35.737 INFO:tasks.rados.rados.0.smithi166.stdout:1338: done (3 left) 2020-11-16T20:58:35.737 INFO:tasks.rados.rados.0.smithi166.stdout:1339: done (2 left) 2020-11-16T20:58:35.737 INFO:tasks.rados.rados.0.smithi166.stdout:1340: done (1 left) 2020-11-16T20:58:35.737 INFO:tasks.rados.rados.0.smithi166.stdout:1341: done (0 left) 2020-11-16T20:58:35.737 INFO:tasks.rados.rados.0.smithi166.stdout:1342: snap_create 2020-11-16T20:58:35.737 INFO:tasks.rados.rados.0.smithi166.stdout:1342: done (0 left) 2020-11-16T20:58:35.737 INFO:tasks.rados.rados.0.smithi166.stdout:1343: write oid 220 current snap is 64 2020-11-16T20:58:35.738 INFO:tasks.rados.rados.0.smithi166.stdout:1343: seq_num 716 ranges {433812=415466,1648519=385293} 2020-11-16T20:58:35.738 INFO:tasks.rados.rados.0.smithi166.stdout:1343: writing smithi16641208-220 from 433812 to 849278 tid 1 2020-11-16T20:58:35.738 INFO:tasks.rados.rados.0.smithi166.stdout:1343: writing smithi16641208-220 from 1648519 to 2033812 tid 2 2020-11-16T20:58:35.738 INFO:tasks.rados.rados.0.smithi166.stdout:1344: copy_from oid 349 from oid 66 current snap is 64 2020-11-16T20:58:35.738 INFO:tasks.rados.rados.0.smithi166.stdout:1345: snap_remove snap 63 2020-11-16T20:58:35.738 INFO:tasks.rados.rados.0.smithi166.stdout:1343: finishing write tid 1 to smithi16641208-220 2020-11-16T20:58:35.738 INFO:tasks.rados.rados.0.smithi166.stdout:1343: finishing write tid 2 to smithi16641208-220 2020-11-16T20:58:35.738 INFO:tasks.rados.rados.0.smithi166.stdout:1343: finishing write tid 3 to smithi16641208-220 2020-11-16T20:58:35.739 INFO:tasks.rados.rados.0.smithi166.stdout:1343: finishing write tid 4 to smithi16641208-220 2020-11-16T20:58:35.739 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 220 v 933 (ObjNum 716 snap 64 seq_num 716) dirty exists 2020-11-16T20:58:35.739 INFO:tasks.rados.rados.0.smithi166.stdout:1343: left oid 220 (ObjNum 716 snap 64 seq_num 716) 2020-11-16T20:58:35.739 INFO:tasks.rados.rados.0.smithi166.stdout:1344: finishing copy_from to smithi16641208-349 2020-11-16T20:58:35.739 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 349 v 39 (ObjNum 65 snap 0 seq_num 65) dirty exists 2020-11-16T20:58:35.739 INFO:tasks.rados.rados.0.smithi166.stdout:1344: finishing copy_from racing read to smithi16641208-349 2020-11-16T20:58:35.739 INFO:tasks.rados.rados.0.smithi166.stdout:1343: done (2 left) 2020-11-16T20:58:35.740 INFO:tasks.rados.rados.0.smithi166.stdout:1344: done (1 left) 2020-11-16T20:58:35.740 INFO:tasks.rados.rados.0.smithi166.stdout:1345: done (0 left) 2020-11-16T20:58:35.740 INFO:tasks.rados.rados.0.smithi166.stdout:1346: write (excl) oid 18 current snap is 64 2020-11-16T20:58:35.740 INFO:tasks.rados.rados.0.smithi166.stdout:1346: seq_num 717 ranges {450619=490715,1590648=459971} 2020-11-16T20:58:35.740 INFO:tasks.rados.rados.0.smithi166.stdout:1346: writing smithi16641208-18 from 450619 to 941334 tid 1 2020-11-16T20:58:35.740 INFO:tasks.rados.rados.0.smithi166.stdout:1346: writing smithi16641208-18 from 1590648 to 2050619 tid 2 2020-11-16T20:58:35.740 INFO:tasks.rados.rados.0.smithi166.stdout:1347: delete oid 44 current snap is 64 2020-11-16T20:58:35.740 INFO:tasks.rados.rados.0.smithi166.stdout:1346: finishing write tid 1 to smithi16641208-18 2020-11-16T20:58:35.741 INFO:tasks.rados.rados.0.smithi166.stdout:1347: done (1 left) 2020-11-16T20:58:35.741 INFO:tasks.rados.rados.0.smithi166.stdout:1348: snap_create 2020-11-16T20:58:35.741 INFO:tasks.rados.rados.0.smithi166.stdout:1346: finishing write tid 2 to smithi16641208-18 2020-11-16T20:58:35.741 INFO:tasks.rados.rados.0.smithi166.stdout:1346: finishing write tid 3 to smithi16641208-18 2020-11-16T20:58:35.741 INFO:tasks.rados.rados.0.smithi166.stdout:1346: finishing write tid 4 to smithi16641208-18 2020-11-16T20:58:35.741 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 18 v 917 (ObjNum 717 snap 64 seq_num 717) dirty exists 2020-11-16T20:58:35.741 INFO:tasks.rados.rados.0.smithi166.stdout:1346: left oid 18 (ObjNum 717 snap 64 seq_num 717) 2020-11-16T20:58:35.742 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:35.732+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:35.768 INFO:tasks.rados.rados.0.smithi166.stdout:1346: done (1 left) 2020-11-16T20:58:35.769 INFO:tasks.rados.rados.0.smithi166.stdout:1348: done (0 left) 2020-11-16T20:58:35.769 INFO:tasks.rados.rados.0.smithi166.stdout:1349: write (excl) oid 251 current snap is 65 2020-11-16T20:58:35.769 INFO:tasks.rados.rados.0.smithi166.stdout:1349: seq_num 719 ranges {484233=641213,1707612=376621} 2020-11-16T20:58:35.774 INFO:tasks.rados.rados.0.smithi166.stdout:1349: writing smithi16641208-251 from 484233 to 1125446 tid 1 2020-11-16T20:58:35.781 INFO:tasks.rados.rados.0.smithi166.stdout:1349: writing smithi16641208-251 from 1707612 to 2084233 tid 2 2020-11-16T20:58:35.781 INFO:tasks.rados.rados.0.smithi166.stdout:1350: read oid 119 snap -1 2020-11-16T20:58:35.781 INFO:tasks.rados.rados.0.smithi166.stdout:1350: expect (ObjNum 650 snap 44 seq_num 650) 2020-11-16T20:58:35.781 INFO:tasks.rados.rados.0.smithi166.stdout:1351: cache_evict oid 294 snap 64 2020-11-16T20:58:35.781 INFO:tasks.rados.rados.0.smithi166.stdout:1352: write (excl) oid 469 current snap is 65 2020-11-16T20:58:35.781 INFO:tasks.rados.rados.0.smithi166.stdout:1352: seq_num 720 ranges {501040=716462,1766094=334946} 2020-11-16T20:58:35.789 INFO:tasks.rados.rados.0.smithi166.stdout:1352: writing smithi16641208-469 from 501040 to 1217502 tid 1 2020-11-16T20:58:35.794 INFO:tasks.rados.rados.0.smithi166.stdout:1352: writing smithi16641208-469 from 1766094 to 2101040 tid 2 2020-11-16T20:58:35.795 INFO:tasks.rados.rados.0.smithi166.stdout:1353: delete oid 401 current snap is 65 2020-11-16T20:58:35.795 INFO:tasks.rados.rados.0.smithi166.stdout:1349: finishing write tid 1 to smithi16641208-251 2020-11-16T20:58:35.796 INFO:tasks.rados.rados.0.smithi166.stdout:1351: got (16) Device or resource busy 2020-11-16T20:58:35.796 INFO:tasks.rados.rados.0.smithi166.stdout:1350: expect (ObjNum 650 snap 44 seq_num 650) 2020-11-16T20:58:35.831 INFO:tasks.ceph.osd.5.smithi059.stderr:2020-11-16T20:58:35.834+0000 7fa1a1e66700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31578) UID: 0 2020-11-16T20:58:35.931 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:58:35.936+0000 7f1d998e0700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 35288) UID: 0 2020-11-16T20:58:35.938 INFO:tasks.rados.rados.0.smithi166.stdout:1350: done (4 left) 2020-11-16T20:58:35.938 INFO:tasks.rados.rados.0.smithi166.stdout:1351: done (3 left) 2020-11-16T20:58:35.938 INFO:tasks.rados.rados.0.smithi166.stdout:1353: done (2 left) 2020-11-16T20:58:35.939 INFO:tasks.rados.rados.0.smithi166.stdout:1354: snap_remove snap 57 2020-11-16T20:58:35.956 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:35.957 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 20, 2020-11-16T20:58:35.957 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 600, 2020-11-16T20:58:35.957 INFO:teuthology.orchestra.run.smithi166.stdout: "ops": [ 2020-11-16T20:58:35.957 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.958 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2424 4.3 4:c5716d1e:::smithi16641208-111:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e46)", 2020-11-16T20:58:35.958 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:09.026685+0000", 2020-11-16T20:58:35.958 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 146.933491989, 2020-11-16T20:58:35.958 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065304164999999997, 2020-11-16T20:58:35.958 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:35.958 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:35.958 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:35.959 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:35.959 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:35.959 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2424 2020-11-16T20:58:35.959 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.959 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:35.959 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.959 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:35.960 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026685+0000", 2020-11-16T20:58:35.960 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:35.960 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.960 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.960 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:35.960 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026685+0000", 2020-11-16T20:58:35.960 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4087000000000001e-05 2020-11-16T20:58:35.961 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.961 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.961 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:35.961 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026719+0000", 2020-11-16T20:58:35.961 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2298e-05 2020-11-16T20:58:35.961 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.961 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.961 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:35.962 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026731+0000", 2020-11-16T20:58:35.962 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1001e-05 2020-11-16T20:58:35.962 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.962 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.962 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:35.962 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026742+0000", 2020-11-16T20:58:35.962 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6129999999999997e-06 2020-11-16T20:58:35.963 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.963 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.963 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:35.963 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.026747+0000", 2020-11-16T20:58:35.963 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00047150600000000001 2020-11-16T20:58:35.963 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.963 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.964 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:35.964 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.027219+0000", 2020-11-16T20:58:35.964 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5602999999999998e-05 2020-11-16T20:58:35.964 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.964 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.964 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:35.964 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.027254+0000", 2020-11-16T20:58:35.965 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050318838999999997 2020-11-16T20:58:35.965 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.965 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.965 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:35.965 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.077573+0000", 2020-11-16T20:58:35.965 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6290000000000001e-05 2020-11-16T20:58:35.966 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.966 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.966 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:35.966 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.077669+0000", 2020-11-16T20:58:35.966 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014149599000000001 2020-11-16T20:58:35.966 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.966 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.967 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:35.967 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.091819+0000", 2020-11-16T20:58:35.967 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6891000000000005e-05 2020-11-16T20:58:35.967 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.967 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.967 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:35.967 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.091906+0000", 2020-11-16T20:58:35.968 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3437999999999996e-05 2020-11-16T20:58:35.968 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.968 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.968 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:35.968 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:09.091989+0000", 2020-11-16T20:58:35.969 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065304164999999997 2020-11-16T20:58:35.969 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:35.969 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:35.969 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:35.969 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.969 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.969 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2589 4.3 4:f65e82cb:::smithi16641208-219:head [write 1800933~725518] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:58:35.970 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.782219+0000", 2020-11-16T20:58:35.970 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 136.17795819299999, 2020-11-16T20:58:35.970 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.069486665000000003, 2020-11-16T20:58:35.970 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:35.970 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:35.970 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:35.971 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:35.971 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:35.971 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2589 2020-11-16T20:58:35.971 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.971 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:35.971 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.971 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:35.972 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782219+0000", 2020-11-16T20:58:35.972 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:35.972 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.972 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.972 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:35.972 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782219+0000", 2020-11-16T20:58:35.972 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00038710600000000002 2020-11-16T20:58:35.972 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.973 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.973 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:35.973 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782606+0000", 2020-11-16T20:58:35.973 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.628e-06 2020-11-16T20:58:35.973 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.973 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.973 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:35.974 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782616+0000", 2020-11-16T20:58:35.974 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5631999999999999e-05 2020-11-16T20:58:35.974 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.974 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.975 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:35.975 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782631+0000", 2020-11-16T20:58:35.975 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6249999999999998e-06 2020-11-16T20:58:35.975 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.975 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.975 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:35.976 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782639+0000", 2020-11-16T20:58:35.976 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3213999999999997e-05 2020-11-16T20:58:35.976 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.976 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.976 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:35.976 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782672+0000", 2020-11-16T20:58:35.976 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.9141000000000003e-05 2020-11-16T20:58:35.976 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.977 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.977 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:35.977 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.782721+0000", 2020-11-16T20:58:35.977 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017807030000000001 2020-11-16T20:58:35.977 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.977 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.977 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:35.978 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800528+0000", 2020-11-16T20:58:35.978 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016577399999999999 2020-11-16T20:58:35.978 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.978 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.978 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:35.978 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800694+0000", 2020-11-16T20:58:35.978 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00026135900000000002 2020-11-16T20:58:35.979 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:35.979 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:35.979 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:58:35.979 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.800955+0000", 2020-11-16T20:58:35.979 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0074407529999999996 2020-11-16T20:58:40.246 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.246 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.246 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:40.247 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808396+0000", 2020-11-16T20:58:40.247 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011788041000000001 2020-11-16T20:58:40.247 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.247 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.247 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:40.247 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.820184+0000", 2020-11-16T20:58:40.247 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031417394000000001 2020-11-16T20:58:40.248 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.248 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.248 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:40.248 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851602+0000", 2020-11-16T20:58:40.248 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0005e-05 2020-11-16T20:58:40.248 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.248 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.249 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:40.249 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851652+0000", 2020-11-16T20:58:40.249 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3962999999999998e-05 2020-11-16T20:58:40.249 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.249 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.249 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:40.249 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851705+0000", 2020-11-16T20:58:40.250 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.069486665000000003 2020-11-16T20:58:40.250 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.250 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.250 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.250 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.250 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.251 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2590 4.3 4:f65e82cb:::smithi16641208-219:head [write 2944601~232021] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:58:40.251 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.785957+0000", 2020-11-16T20:58:40.251 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 136.17422050299999, 2020-11-16T20:58:40.251 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065959045999999993, 2020-11-16T20:58:40.251 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:40.251 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:40.251 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:40.252 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:40.252 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:40.252 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2590 2020-11-16T20:58:40.252 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.252 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:40.252 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.253 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:40.253 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.785957+0000", 2020-11-16T20:58:40.253 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:40.253 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.253 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.253 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:40.253 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.785957+0000", 2020-11-16T20:58:40.254 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6058999999999998e-05 2020-11-16T20:58:40.254 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.254 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.254 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:40.254 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786033+0000", 2020-11-16T20:58:40.254 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1582999999999999e-05 2020-11-16T20:58:40.254 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.255 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.255 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:40.255 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786064+0000", 2020-11-16T20:58:40.255 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.8099999999999992e-06 2020-11-16T20:58:40.255 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.255 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.255 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:40.256 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786074+0000", 2020-11-16T20:58:40.256 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.198e-06 2020-11-16T20:58:40.256 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.256 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.256 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:40.256 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786079+0000", 2020-11-16T20:58:40.256 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0587999999999997e-05 2020-11-16T20:58:40.257 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.257 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.257 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.257 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786130+0000", 2020-11-16T20:58:40.257 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5791000000000007e-05 2020-11-16T20:58:40.257 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.257 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.258 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:40.258 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786206+0000", 2020-11-16T20:58:40.258 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016623412000000001 2020-11-16T20:58:40.258 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.258 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.258 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.258 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.802829+0000", 2020-11-16T20:58:40.259 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012361699999999999 2020-11-16T20:58:40.259 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.259 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.259 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:40.259 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.802953+0000", 2020-11-16T20:58:40.259 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000161807 2020-11-16T20:58:40.259 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.260 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.260 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:58:40.260 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.803114+0000", 2020-11-16T20:58:40.260 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.005291535 2020-11-16T20:58:40.260 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.260 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.260 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:40.261 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808406+0000", 2020-11-16T20:58:40.261 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011819998999999999 2020-11-16T20:58:40.261 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.261 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.261 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:40.261 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.820226+0000", 2020-11-16T20:58:40.261 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031546375000000001 2020-11-16T20:58:40.262 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.262 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.262 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:40.262 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851772+0000", 2020-11-16T20:58:40.262 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9140000000000005e-05 2020-11-16T20:58:40.262 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.262 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.263 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:40.263 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851851+0000", 2020-11-16T20:58:40.263 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4132000000000002e-05 2020-11-16T20:58:40.263 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.263 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.263 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:40.263 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851916+0000", 2020-11-16T20:58:40.264 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065959045999999993 2020-11-16T20:58:40.264 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.264 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.264 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.264 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.264 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.264 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2591 4.3 4:f65e82cb:::smithi16641208-219:head [setxattr _header (58) in=7b,truncate 3176622] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:58:40.265 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.786110+0000", 2020-11-16T20:58:40.265 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 136.17406697000001, 2020-11-16T20:58:40.265 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066016654999999994, 2020-11-16T20:58:40.265 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:40.265 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:40.265 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:40.265 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:40.266 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:40.266 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2591 2020-11-16T20:58:40.266 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.266 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:40.266 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.266 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:40.266 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786110+0000", 2020-11-16T20:58:40.267 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:40.267 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.267 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.267 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:40.267 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786110+0000", 2020-11-16T20:58:40.267 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5616e-05 2020-11-16T20:58:40.267 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.268 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.268 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:40.268 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786136+0000", 2020-11-16T20:58:40.268 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.5329999999999999e-06 2020-11-16T20:58:40.268 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.268 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.268 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:40.269 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786139+0000", 2020-11-16T20:58:40.269 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7440000000000004e-06 2020-11-16T20:58:40.269 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.269 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.269 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:40.269 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786145+0000", 2020-11-16T20:58:40.269 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0120000000000001e-06 2020-11-16T20:58:40.270 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.270 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.270 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:40.270 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786148+0000", 2020-11-16T20:58:40.270 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.5617000000000004e-05 2020-11-16T20:58:40.270 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.271 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.271 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.271 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786234+0000", 2020-11-16T20:58:40.271 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0964000000000001e-05 2020-11-16T20:58:40.271 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.271 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.271 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:40.272 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786295+0000", 2020-11-16T20:58:40.272 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.017673271000000001 2020-11-16T20:58:40.272 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.272 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.272 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.272 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.803968+0000", 2020-11-16T20:58:40.272 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000155272 2020-11-16T20:58:40.273 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.273 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.273 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:40.273 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.804123+0000", 2020-11-16T20:58:40.273 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00027357299999999999 2020-11-16T20:58:40.273 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.273 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.274 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:58:40.274 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.804397+0000", 2020-11-16T20:58:40.274 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0040142659999999998 2020-11-16T20:58:40.274 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.274 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.274 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:40.274 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808411+0000", 2020-11-16T20:58:40.275 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011837194000000001 2020-11-16T20:58:40.275 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.275 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.275 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:40.275 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.820248+0000", 2020-11-16T20:58:40.275 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.031735780999999998 2020-11-16T20:58:40.275 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.276 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.276 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:40.276 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851984+0000", 2020-11-16T20:58:40.276 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0603000000000001e-05 2020-11-16T20:58:40.276 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.276 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.276 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:40.277 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852054+0000", 2020-11-16T20:58:40.277 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2208999999999999e-05 2020-11-16T20:58:40.277 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.277 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.277 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:40.277 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852127+0000", 2020-11-16T20:58:40.277 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066016654999999994 2020-11-16T20:58:40.278 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.278 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.278 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.278 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.278 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.278 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2592 4.3 4:f65e82cb:::smithi16641208-219:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:58:40.278 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.786176+0000", 2020-11-16T20:58:40.279 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 136.174001487, 2020-11-16T20:58:40.279 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066389967999999994, 2020-11-16T20:58:40.279 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:40.279 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:40.279 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:40.279 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:40.279 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:40.280 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2592 2020-11-16T20:58:40.280 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.280 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:40.280 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.280 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:40.280 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786176+0000", 2020-11-16T20:58:40.280 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:40.281 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.281 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.281 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:40.281 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786176+0000", 2020-11-16T20:58:40.281 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1280999999999998e-05 2020-11-16T20:58:40.281 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.281 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.282 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:40.282 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786197+0000", 2020-11-16T20:58:40.282 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.349e-06 2020-11-16T20:58:40.282 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.282 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.282 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:40.282 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786200+0000", 2020-11-16T20:58:40.283 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4840000000000001e-06 2020-11-16T20:58:40.283 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.283 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.283 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:40.283 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786207+0000", 2020-11-16T20:58:40.283 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.3390000000000001e-06 2020-11-16T20:58:40.283 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.284 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.284 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:40.284 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786210+0000", 2020-11-16T20:58:40.284 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000115748 2020-11-16T20:58:40.284 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.284 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.284 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.285 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786326+0000", 2020-11-16T20:58:40.285 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6062e-05 2020-11-16T20:58:40.285 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.285 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.285 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:40.285 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786372+0000", 2020-11-16T20:58:40.285 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021773975000000001 2020-11-16T20:58:40.286 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.286 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.286 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.286 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808146+0000", 2020-11-16T20:58:40.286 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00014829900000000001 2020-11-16T20:58:40.286 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.286 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.287 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:40.287 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.808294+0000", 2020-11-16T20:58:40.287 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.043877869999999999 2020-11-16T20:58:40.287 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.287 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.287 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.287 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852172+0000", 2020-11-16T20:58:40.288 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000145322 2020-11-16T20:58:40.288 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.288 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.288 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:40.288 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852317+0000", 2020-11-16T20:58:40.288 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024823899999999998 2020-11-16T20:58:40.288 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.289 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.289 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:40.289 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.852565+0000", 2020-11-16T20:58:40.289 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.066389967999999994 2020-11-16T20:58:40.289 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.289 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.289 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.290 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.290 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.290 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2593 4.3 4:f5f8fa2a:::smithi16641208-144:head [copy-from ver 64] snapc 14=[12,f,5] ondisk+write+known_if_redirected e57)", 2020-11-16T20:58:40.290 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.786250+0000", 2020-11-16T20:58:40.290 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 136.17392670800001, 2020-11-16T20:58:40.290 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065186216000000005, 2020-11-16T20:58:40.291 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:40.291 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:40.291 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:40.291 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:40.291 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:40.291 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2593 2020-11-16T20:58:40.291 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.292 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:40.292 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.292 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:40.292 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786250+0000", 2020-11-16T20:58:40.292 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:40.292 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.292 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.292 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:40.293 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786250+0000", 2020-11-16T20:58:40.293 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2438999999999998e-05 2020-11-16T20:58:40.293 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.293 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.293 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:40.293 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786293+0000", 2020-11-16T20:58:40.294 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6840000000000001e-06 2020-11-16T20:58:40.294 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.294 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.294 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:40.294 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786298+0000", 2020-11-16T20:58:40.294 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.4331999999999999e-05 2020-11-16T20:58:40.294 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.295 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.295 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:40.295 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786313+0000", 2020-11-16T20:58:40.295 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.6460000000000001e-06 2020-11-16T20:58:40.295 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.295 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.295 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:40.296 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786317+0000", 2020-11-16T20:58:40.296 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5451999999999995e-05 2020-11-16T20:58:40.296 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.296 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.296 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.296 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786393+0000", 2020-11-16T20:58:40.296 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065041011999999995 2020-11-16T20:58:40.297 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.297 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.297 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:40.297 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851434+0000", 2020-11-16T20:58:40.297 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.6510000000000001e-06 2020-11-16T20:58:40.297 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.297 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.297 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:40.298 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.851437+0000", 2020-11-16T20:58:40.298 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.065186216000000005 2020-11-16T20:58:40.298 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.298 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.298 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.298 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.299 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.299 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2594 4.3 4:f5f8fa2a:::smithi16641208-144:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-11-16T20:58:40.299 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:19.786352+0000", 2020-11-16T20:58:40.299 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 136.17382541500001, 2020-11-16T20:58:40.299 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.089305972999999997, 2020-11-16T20:58:40.299 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:40.299 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:40.300 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:40.300 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:40.300 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:40.300 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2594 2020-11-16T20:58:40.300 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.300 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:40.300 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.301 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:40.301 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786352+0000", 2020-11-16T20:58:40.301 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:40.301 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.301 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.301 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:40.301 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786352+0000", 2020-11-16T20:58:40.302 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.5896000000000001e-05 2020-11-16T20:58:40.302 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.302 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.302 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:40.302 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786377+0000", 2020-11-16T20:58:40.302 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7700000000000004e-06 2020-11-16T20:58:40.302 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.303 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.303 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:40.303 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786384+0000", 2020-11-16T20:58:40.303 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.049e-05 2020-11-16T20:58:40.303 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.303 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.303 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:40.304 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786395+0000", 2020-11-16T20:58:40.304 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.0440000000000003e-06 2020-11-16T20:58:40.304 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.304 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.304 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:40.304 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786400+0000", 2020-11-16T20:58:40.304 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000366771 2020-11-16T20:58:40.305 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.305 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.305 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.305 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786767+0000", 2020-11-16T20:58:40.305 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1366999999999998e-05 2020-11-16T20:58:40.305 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.305 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.306 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:40.306 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.786818+0000", 2020-11-16T20:58:40.306 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.077259257999999997 2020-11-16T20:58:40.306 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.306 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.306 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.306 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.864077+0000", 2020-11-16T20:58:40.307 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00018375499999999999 2020-11-16T20:58:40.307 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.307 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.307 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:40.307 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.864261+0000", 2020-11-16T20:58:40.307 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011122837 2020-11-16T20:58:40.307 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.308 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.308 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.308 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.875384+0000", 2020-11-16T20:58:40.308 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000135752 2020-11-16T20:58:40.308 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.308 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.308 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:40.309 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.875520+0000", 2020-11-16T20:58:40.309 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000138033 2020-11-16T20:58:40.309 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.309 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.309 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:40.309 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:19.875658+0000", 2020-11-16T20:58:40.309 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.089305972999999997 2020-11-16T20:58:40.310 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.310 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.310 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.310 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.310 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.310 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2872 4.3 4:d9c18080:::smithi16641208-173:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-11-16T20:58:40.310 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:34.745479+0000", 2020-11-16T20:58:40.311 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 121.21469815099999, 2020-11-16T20:58:40.311 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.059388271999999999, 2020-11-16T20:58:40.311 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:40.311 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:40.311 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:40.311 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:40.311 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:40.312 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2872 2020-11-16T20:58:40.312 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.312 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:40.312 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.312 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:40.312 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745479+0000", 2020-11-16T20:58:40.312 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:40.313 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.313 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:40.313 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745479+0000", 2020-11-16T20:58:40.313 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0491e-05 2020-11-16T20:58:40.313 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.313 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.314 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:40.314 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745509+0000", 2020-11-16T20:58:40.314 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9170000000000003e-06 2020-11-16T20:58:40.314 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.314 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.314 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:40.314 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745515+0000", 2020-11-16T20:58:40.315 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1267000000000001e-05 2020-11-16T20:58:40.315 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.315 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.315 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:40.315 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745527+0000", 2020-11-16T20:58:40.315 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.04e-06 2020-11-16T20:58:40.315 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.316 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.316 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:40.316 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745532+0000", 2020-11-16T20:58:40.316 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00034800500000000003 2020-11-16T20:58:40.316 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.316 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.316 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.317 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745880+0000", 2020-11-16T20:58:40.317 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.6010000000000003e-05 2020-11-16T20:58:40.317 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.317 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.317 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:40.317 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.745916+0000", 2020-11-16T20:58:40.317 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.042557927000000002 2020-11-16T20:58:40.318 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.318 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.318 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.318 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.788474+0000", 2020-11-16T20:58:40.318 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000160614 2020-11-16T20:58:40.318 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.318 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.319 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:40.319 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.788634+0000", 2020-11-16T20:58:40.319 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016066745 2020-11-16T20:58:40.319 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.319 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.319 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.319 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.804701+0000", 2020-11-16T20:58:40.320 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.3805000000000001e-05 2020-11-16T20:58:40.320 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.320 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.320 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:40.320 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.804785+0000", 2020-11-16T20:58:40.320 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.2451000000000001e-05 2020-11-16T20:58:40.320 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.321 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.321 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:40.321 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:34.804867+0000", 2020-11-16T20:58:40.321 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.059388271999999999 2020-11-16T20:58:40.321 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.321 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.321 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.322 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.322 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.322 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2962 4.3 4:c925a80f:::smithi16641208-375:head [write 1381780~411527] snapc 2d=[2d,25] ondisk+write+known_if_redirected e82)", 2020-11-16T20:58:40.322 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:44.749629+0000", 2020-11-16T20:58:40.322 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 111.210548393, 2020-11-16T20:58:40.322 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.052987905000000002, 2020-11-16T20:58:40.323 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:40.323 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:40.323 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:40.323 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:40.323 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:40.323 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2962 2020-11-16T20:58:40.323 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.324 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:40.324 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.324 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:40.324 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.749629+0000", 2020-11-16T20:58:40.324 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:40.324 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.324 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.325 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:40.325 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.749629+0000", 2020-11-16T20:58:40.325 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00039027700000000002 2020-11-16T20:58:40.325 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.325 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.325 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:40.325 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750019+0000", 2020-11-16T20:58:40.326 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0961000000000001e-05 2020-11-16T20:58:40.326 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.326 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.326 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:40.326 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750030+0000", 2020-11-16T20:58:40.326 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.7931000000000002e-05 2020-11-16T20:58:40.326 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.327 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.327 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:40.327 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750048+0000", 2020-11-16T20:58:40.327 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3030000000000005e-06 2020-11-16T20:58:40.327 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.327 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.327 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:40.328 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750057+0000", 2020-11-16T20:58:40.328 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8351999999999999e-05 2020-11-16T20:58:40.328 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.328 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.328 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.328 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750125+0000", 2020-11-16T20:58:40.328 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010314000000000001 2020-11-16T20:58:40.329 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.329 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.329 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:40.329 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.750229+0000", 2020-11-16T20:58:40.329 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.039625369000000001 2020-11-16T20:58:40.329 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.329 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.330 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.330 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.789854+0000", 2020-11-16T20:58:40.330 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000153096 2020-11-16T20:58:40.330 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.330 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.330 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:40.330 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790007+0000", 2020-11-16T20:58:40.331 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00022176699999999999 2020-11-16T20:58:40.331 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.331 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.331 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 5,7", 2020-11-16T20:58:40.331 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.790229+0000", 2020-11-16T20:58:40.331 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0059379410000000004 2020-11-16T20:58:40.331 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.332 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.332 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:40.332 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.796167+0000", 2020-11-16T20:58:40.332 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0013346230000000001 2020-11-16T20:58:40.332 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.332 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.332 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:40.333 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.797501+0000", 2020-11-16T20:58:40.333 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0049809470000000003 2020-11-16T20:58:40.333 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.333 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.333 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:40.333 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802482+0000", 2020-11-16T20:58:40.333 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.1831999999999998e-05 2020-11-16T20:58:40.334 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.334 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.334 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:40.334 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802574+0000", 2020-11-16T20:58:40.334 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 4.2366000000000001e-05 2020-11-16T20:58:40.334 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.335 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.335 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:40.335 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:44.802617+0000", 2020-11-16T20:58:40.335 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.052987905000000002 2020-11-16T20:58:40.335 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.335 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.335 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.336 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.336 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.336 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:2997 4.3 4:f5e68fa8:::smithi16641208-361:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e86)", 2020-11-16T20:58:40.336 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:56:48.838418+0000", 2020-11-16T20:58:40.336 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 107.12175868200001, 2020-11-16T20:58:40.336 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.056590020999999997, 2020-11-16T20:58:40.336 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:40.337 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:40.337 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:40.337 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:40.337 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:40.337 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 2997 2020-11-16T20:58:40.337 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.337 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:40.337 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.338 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:40.338 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838418+0000", 2020-11-16T20:58:40.338 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:40.338 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.338 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.338 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:40.339 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838418+0000", 2020-11-16T20:58:40.339 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.9998999999999999e-05 2020-11-16T20:58:40.339 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.339 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.339 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:40.339 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838448+0000", 2020-11-16T20:58:40.339 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.3640000000000004e-06 2020-11-16T20:58:40.340 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.340 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.340 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:40.340 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838455+0000", 2020-11-16T20:58:40.340 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1902999999999999e-05 2020-11-16T20:58:40.340 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.340 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.341 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:40.341 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838467+0000", 2020-11-16T20:58:40.341 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1699999999999996e-06 2020-11-16T20:58:40.341 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.341 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.341 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:40.341 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838472+0000", 2020-11-16T20:58:40.341 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00047208200000000002 2020-11-16T20:58:40.342 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.342 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.342 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.342 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.838944+0000", 2020-11-16T20:58:40.342 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6712000000000002e-05 2020-11-16T20:58:40.342 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.343 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.343 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:40.343 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.839001+0000", 2020-11-16T20:58:40.343 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.038817664000000002 2020-11-16T20:58:40.343 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.343 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.343 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.344 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.877818+0000", 2020-11-16T20:58:40.344 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000119492 2020-11-16T20:58:40.344 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.344 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.344 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:40.344 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.877938+0000", 2020-11-16T20:58:40.344 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.016797409999999999 2020-11-16T20:58:40.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.345 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.345 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.345 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.894735+0000", 2020-11-16T20:58:40.345 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00015645500000000001 2020-11-16T20:58:40.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.345 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.346 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:40.346 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.894892+0000", 2020-11-16T20:58:40.346 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00011677 2020-11-16T20:58:40.346 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.346 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.346 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:40.346 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:56:48.895008+0000", 2020-11-16T20:58:40.347 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.056590020999999997 2020-11-16T20:58:40.347 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.347 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.347 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.347 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.347 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.347 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3520 4.3 4:f686f74f:::smithi16641208-134:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e129)", 2020-11-16T20:58:40.348 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.027796+0000", 2020-11-16T20:58:40.348 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 61.932381020999998, 2020-11-16T20:58:40.348 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.051377742999999997, 2020-11-16T20:58:40.348 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:40.348 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:40.348 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:40.348 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:40.349 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:40.349 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3520 2020-11-16T20:58:40.349 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.349 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:40.349 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.349 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:40.349 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.027796+0000", 2020-11-16T20:58:40.350 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:40.350 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.350 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.350 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:40.350 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.027796+0000", 2020-11-16T20:58:40.350 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.5429000000000001e-05 2020-11-16T20:58:40.350 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.351 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.351 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:40.351 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.027811+0000", 2020-11-16T20:58:40.351 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2150000000000001e-06 2020-11-16T20:58:40.351 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.351 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.351 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:40.352 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.027815+0000", 2020-11-16T20:58:40.352 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4620000000000001e-06 2020-11-16T20:58:40.352 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.352 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.352 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:40.352 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.027821+0000", 2020-11-16T20:58:40.352 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.602e-06 2020-11-16T20:58:40.353 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.353 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.353 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:40.353 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.027825+0000", 2020-11-16T20:58:40.353 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030451419999999998 2020-11-16T20:58:40.353 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.353 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.354 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.354 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.030870+0000", 2020-11-16T20:58:40.354 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.8892000000000003e-05 2020-11-16T20:58:40.354 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.354 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.354 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:40.354 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.030949+0000", 2020-11-16T20:58:40.355 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.036413867000000003 2020-11-16T20:58:40.355 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.355 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.355 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.355 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.067363+0000", 2020-11-16T20:58:40.355 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000102604 2020-11-16T20:58:40.355 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.356 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.356 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:40.356 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.067465+0000", 2020-11-16T20:58:40.356 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011558476999999999 2020-11-16T20:58:40.356 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.356 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.356 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.357 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.079024+0000", 2020-11-16T20:58:40.357 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5964999999999995e-05 2020-11-16T20:58:40.357 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.357 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.357 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:40.357 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.079100+0000", 2020-11-16T20:58:40.357 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.4087999999999999e-05 2020-11-16T20:58:40.358 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.358 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.358 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:40.358 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.079174+0000", 2020-11-16T20:58:40.358 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.051377742999999997 2020-11-16T20:58:40.358 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.358 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.359 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.359 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.359 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.359 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(osd.4.13:908 3.1 3:b7adb356:::smithi16641208-217:head [copy-get max 8388608] snapc 0=[] ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected e130)", 2020-11-16T20:58:40.359 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:57:34.754089+0000", 2020-11-16T20:58:40.359 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 61.206087648999997, 2020-11-16T20:58:40.359 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050485306000000001, 2020-11-16T20:58:40.360 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:40.360 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:40.360 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:40.360 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.360 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:40.360 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754089+0000", 2020-11-16T20:58:40.360 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:40.361 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.361 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.361 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:40.361 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754089+0000", 2020-11-16T20:58:40.361 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.1849e-05 2020-11-16T20:58:40.361 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.361 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.362 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:40.362 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754111+0000", 2020-11-16T20:58:40.362 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.309e-06 2020-11-16T20:58:40.362 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.362 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.362 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:40.363 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754115+0000", 2020-11-16T20:58:40.363 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.784e-06 2020-11-16T20:58:40.363 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.363 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.363 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:40.363 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754120+0000", 2020-11-16T20:58:40.363 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.4829999999999999e-06 2020-11-16T20:58:40.364 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.364 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.364 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:40.364 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754124+0000", 2020-11-16T20:58:40.364 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00033225300000000002 2020-11-16T20:58:40.364 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.364 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.365 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.365 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754456+0000", 2020-11-16T20:58:40.365 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.1177000000000001e-05 2020-11-16T20:58:40.365 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.365 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.365 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:40.365 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.754507+0000", 2020-11-16T20:58:40.366 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.033760357999999997 2020-11-16T20:58:40.366 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.366 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.366 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.366 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788268+0000", 2020-11-16T20:58:40.366 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0700999999999998e-05 2020-11-16T20:58:40.366 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.367 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.367 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for rw locks", 2020-11-16T20:58:40.367 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.788358+0000", 2020-11-16T20:58:40.367 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.013027209999999999 2020-11-16T20:58:40.367 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.367 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.367 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.368 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801385+0000", 2020-11-16T20:58:40.368 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00010369099999999999 2020-11-16T20:58:40.368 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.368 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.368 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:40.368 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.801489+0000", 2020-11-16T20:58:40.368 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0030854910000000001 2020-11-16T20:58:40.369 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.369 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.369 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:40.369 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:57:34.804575+0000", 2020-11-16T20:58:40.369 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050485306000000001 2020-11-16T20:58:40.369 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.369 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.370 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.370 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.370 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.370 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3960 4.2 4:792a5aa2:::smithi16641208-171:head [append 0~0] snapc 71=[71,61] RETRY=2 ondisk+retry+write+known_if_redirected e161)", 2020-11-16T20:58:40.370 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:10.766719+0000", 2020-11-16T20:58:40.370 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 25.193458167999999, 2020-11-16T20:58:40.370 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.294536568, 2020-11-16T20:58:40.371 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:40.371 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:40.371 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:40.371 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:40.371 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:40.371 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3960 2020-11-16T20:58:40.371 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.372 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:40.372 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.372 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:40.372 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766719+0000", 2020-11-16T20:58:40.372 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:40.372 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.372 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.373 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:40.373 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766719+0000", 2020-11-16T20:58:40.373 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1884000000000002e-05 2020-11-16T20:58:40.373 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.373 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.373 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:40.373 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766751+0000", 2020-11-16T20:58:40.374 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.5009999999999998e-06 2020-11-16T20:58:40.374 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.374 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.374 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:40.374 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766758+0000", 2020-11-16T20:58:40.374 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.3645999999999999e-05 2020-11-16T20:58:40.374 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.375 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.375 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:40.375 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766772+0000", 2020-11-16T20:58:40.375 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6020000000000002e-06 2020-11-16T20:58:40.375 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.375 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.375 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:40.376 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766779+0000", 2020-11-16T20:58:40.376 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016390299999999999 2020-11-16T20:58:40.376 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.376 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.376 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.376 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766943+0000", 2020-11-16T20:58:40.376 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0708e-05 2020-11-16T20:58:40.377 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.377 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.377 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:40.377 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766954+0000", 2020-11-16T20:58:40.377 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.280180449 2020-11-16T20:58:40.377 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.377 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.378 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.378 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.047135+0000", 2020-11-16T20:58:40.378 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00023914300000000001 2020-11-16T20:58:40.378 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.378 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.378 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for missing object", 2020-11-16T20:58:40.379 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.047374+0000", 2020-11-16T20:58:40.379 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0022773590000000001 2020-11-16T20:58:40.379 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.379 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.379 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.379 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.049651+0000", 2020-11-16T20:58:40.379 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.011596629000000001 2020-11-16T20:58:40.380 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.380 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.380 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:40.380 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.061248+0000", 2020-11-16T20:58:40.380 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7440000000000007e-06 2020-11-16T20:58:40.380 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.380 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.380 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:40.381 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.061255+0000", 2020-11-16T20:58:40.381 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.294536568 2020-11-16T20:58:40.381 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.381 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.381 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.381 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.382 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.382 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3961 4.2 4:792a5aa2:::smithi16641208-171:head [rollback 61] snapc 71=[71,61] RETRY=2 ondisk+retry+write+known_if_redirected e161)", 2020-11-16T20:58:40.382 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:10.766814+0000", 2020-11-16T20:58:40.382 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 25.193362616000002, 2020-11-16T20:58:40.382 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.33204910999999998, 2020-11-16T20:58:40.382 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:40.382 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:40.383 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:40.383 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:40.383 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:40.383 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3961 2020-11-16T20:58:40.383 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.383 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:40.383 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.384 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:40.384 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766814+0000", 2020-11-16T20:58:40.384 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:40.384 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.384 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.384 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:40.384 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766814+0000", 2020-11-16T20:58:40.385 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.2356e-05 2020-11-16T20:58:40.385 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.385 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.385 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:40.385 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766847+0000", 2020-11-16T20:58:40.385 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7649999999999999e-06 2020-11-16T20:58:40.385 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.386 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.386 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:40.386 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766853+0000", 2020-11-16T20:58:40.386 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.0635000000000001e-05 2020-11-16T20:58:40.386 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.386 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.386 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:40.387 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766863+0000", 2020-11-16T20:58:40.387 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.7139999999999998e-06 2020-11-16T20:58:40.387 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.387 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.387 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:40.387 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766869+0000", 2020-11-16T20:58:40.387 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000113033 2020-11-16T20:58:40.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.388 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.388 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.388 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766982+0000", 2020-11-16T20:58:40.388 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4500000000000001e-06 2020-11-16T20:58:40.388 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.388 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.389 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:40.389 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766988+0000", 2020-11-16T20:58:40.389 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.28083836499999998 2020-11-16T20:58:40.389 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.389 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.389 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.390 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.047827+0000", 2020-11-16T20:58:40.390 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.6771000000000001e-05 2020-11-16T20:58:40.390 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.390 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.390 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for missing object", 2020-11-16T20:58:40.390 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.047903+0000", 2020-11-16T20:58:40.390 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00228181 2020-11-16T20:58:40.391 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.391 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.391 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.050185+0000", 2020-11-16T20:58:40.391 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.4109999999999994e-05 2020-11-16T20:58:40.391 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.391 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.392 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:40.392 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.050249+0000", 2020-11-16T20:58:40.392 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.019491345 2020-11-16T20:58:40.392 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.392 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.392 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.392 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.069741+0000", 2020-11-16T20:58:40.393 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00021984000000000001 2020-11-16T20:58:40.393 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.393 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.393 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:40.393 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.069961+0000", 2020-11-16T20:58:40.393 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00028599400000000003 2020-11-16T20:58:40.393 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.394 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.394 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:40.394 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.070247+0000", 2020-11-16T20:58:40.394 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.826e-05 2020-11-16T20:58:40.394 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.394 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.394 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:40.395 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.070315+0000", 2020-11-16T20:58:40.395 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0078169539999999992 2020-11-16T20:58:40.395 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.395 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.395 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.395 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.078132+0000", 2020-11-16T20:58:40.395 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000190836 2020-11-16T20:58:40.396 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.396 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.396 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:40.396 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.078323+0000", 2020-11-16T20:58:40.396 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00043319700000000002 2020-11-16T20:58:40.396 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.396 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.397 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 1,4,5", 2020-11-16T20:58:40.397 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.078756+0000", 2020-11-16T20:58:40.397 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0060120390000000003 2020-11-16T20:58:40.397 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.397 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.397 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.397 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.084768+0000", 2020-11-16T20:58:40.398 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.7736000000000002e-05 2020-11-16T20:58:40.398 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.398 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.398 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for ondisk", 2020-11-16T20:58:40.398 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.084846+0000", 2020-11-16T20:58:40.398 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0074966049999999999 2020-11-16T20:58:40.399 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.399 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.399 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:40.399 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.092342+0000", 2020-11-16T20:58:40.399 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0058494810000000001 2020-11-16T20:58:40.399 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.399 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.400 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:40.400 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.098192+0000", 2020-11-16T20:58:40.400 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.6997999999999995e-05 2020-11-16T20:58:40.400 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.400 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.400 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:40.400 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.098289+0000", 2020-11-16T20:58:40.401 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00032133900000000002 2020-11-16T20:58:40.401 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.401 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.401 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:40.401 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.098610+0000", 2020-11-16T20:58:40.401 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.8751999999999993e-05 2020-11-16T20:58:40.401 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.402 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.402 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:40.402 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.098699+0000", 2020-11-16T20:58:40.402 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00016472500000000001 2020-11-16T20:58:40.402 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.402 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.402 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:40.403 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.098863+0000", 2020-11-16T20:58:40.403 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.33204910999999998 2020-11-16T20:58:40.403 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.403 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.403 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.403 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.403 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.404 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3962 4.2 4:792a5aa2:::smithi16641208-171:head [append 0~0] snapc 71=[71,61] RETRY=2 ondisk+retry+write+known_if_redirected e161)", 2020-11-16T20:58:40.404 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:10.766901+0000", 2020-11-16T20:58:40.404 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 25.193276166, 2020-11-16T20:58:40.404 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.35350222399999998, 2020-11-16T20:58:40.404 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:40.404 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:40.404 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:40.405 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:40.405 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:40.405 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3962 2020-11-16T20:58:40.405 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.405 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:40.405 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.405 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:40.406 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766901+0000", 2020-11-16T20:58:40.406 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:40.406 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.406 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.406 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:40.406 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766901+0000", 2020-11-16T20:58:40.406 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8690000000000001e-05 2020-11-16T20:58:40.407 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.407 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.407 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:40.407 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766930+0000", 2020-11-16T20:58:40.407 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6980000000000003e-06 2020-11-16T20:58:40.407 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.407 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.408 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:40.408 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766935+0000", 2020-11-16T20:58:40.408 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.908e-06 2020-11-16T20:58:40.408 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.408 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.408 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:40.408 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766941+0000", 2020-11-16T20:58:40.409 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.7480000000000002e-06 2020-11-16T20:58:40.409 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.409 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.409 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:40.409 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.766944+0000", 2020-11-16T20:58:40.409 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2626999999999995e-05 2020-11-16T20:58:40.409 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.410 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.410 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.410 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.767007+0000", 2020-11-16T20:58:40.410 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.0340000000000002e-06 2020-11-16T20:58:40.410 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.410 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.410 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:40.411 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.767016+0000", 2020-11-16T20:58:40.411 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.28093276700000003 2020-11-16T20:58:40.411 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.411 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.411 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.411 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.047948+0000", 2020-11-16T20:58:40.411 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.0480000000000003e-05 2020-11-16T20:58:40.412 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.412 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.412 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for missing object", 2020-11-16T20:58:40.412 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.048019+0000", 2020-11-16T20:58:40.412 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0022703580000000001 2020-11-16T20:58:40.412 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.413 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.413 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.413 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.050289+0000", 2020-11-16T20:58:40.413 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.2658999999999997e-05 2020-11-16T20:58:40.413 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.413 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.413 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:40.414 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.050362+0000", 2020-11-16T20:58:40.414 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.020014204000000001 2020-11-16T20:58:40.414 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.414 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.414 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.414 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.070376+0000", 2020-11-16T20:58:40.414 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.2409999999999994e-05 2020-11-16T20:58:40.415 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.415 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.415 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for blocked object", 2020-11-16T20:58:40.415 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.070438+0000", 2020-11-16T20:58:40.415 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.014435586 2020-11-16T20:58:40.415 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.415 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.416 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.416 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.084874+0000", 2020-11-16T20:58:40.416 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000132924 2020-11-16T20:58:40.416 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.416 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.416 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:40.416 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.085007+0000", 2020-11-16T20:58:40.417 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00019703200000000001 2020-11-16T20:58:40.417 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.417 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.417 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 1,4,5", 2020-11-16T20:58:40.417 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.085204+0000", 2020-11-16T20:58:40.417 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.007388515 2020-11-16T20:58:40.417 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.418 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.418 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:40.418 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.092592+0000", 2020-11-16T20:58:40.418 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0056161220000000003 2020-11-16T20:58:40.418 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.418 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.419 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:40.419 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.098209+0000", 2020-11-16T20:58:40.419 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000711507 2020-11-16T20:58:40.419 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.419 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.419 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:40.419 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.098920+0000", 2020-11-16T20:58:40.420 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.021120463999999999 2020-11-16T20:58:40.420 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.420 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.420 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:40.420 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.120041+0000", 2020-11-16T20:58:40.420 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000118075 2020-11-16T20:58:40.420 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.421 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.421 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:40.421 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.120159+0000", 2020-11-16T20:58:40.421 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024441600000000001 2020-11-16T20:58:40.421 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.421 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.422 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:40.422 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.120403+0000", 2020-11-16T20:58:40.422 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.35350222399999998 2020-11-16T20:58:40.422 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.422 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.422 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.422 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.423 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.423 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3963 4.0 4:3a07a2f4:::smithi16641208-265:head [cache-try-flush] snapc 0=[] RETRY=2 ondisk+retry+read+skiprwlocks+known_if_redirected e162)", 2020-11-16T20:58:40.423 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:10.773500+0000", 2020-11-16T20:58:40.423 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 25.186676581, 2020-11-16T20:58:40.423 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.33046096899999999, 2020-11-16T20:58:40.423 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:40.423 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "started", 2020-11-16T20:58:40.424 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:40.424 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:40.424 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:40.424 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3963 2020-11-16T20:58:40.424 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.424 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:40.424 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.425 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:40.425 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773500+0000", 2020-11-16T20:58:40.425 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:40.425 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.425 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.425 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:40.425 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773500+0000", 2020-11-16T20:58:40.426 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.3399000000000001e-05 2020-11-16T20:58:40.426 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.426 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.426 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:40.426 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773524+0000", 2020-11-16T20:58:40.426 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.4179999999999996e-06 2020-11-16T20:58:40.426 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.427 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.427 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:40.427 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773529+0000", 2020-11-16T20:58:40.427 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 8.6570000000000003e-06 2020-11-16T20:58:40.427 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.427 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.428 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:40.428 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773538+0000", 2020-11-16T20:58:40.428 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.3510000000000001e-06 2020-11-16T20:58:40.428 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.428 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.428 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:40.428 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773543+0000", 2020-11-16T20:58:40.429 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00045181399999999998 2020-11-16T20:58:40.429 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.429 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.429 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.429 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773995+0000", 2020-11-16T20:58:40.429 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.8842e-05 2020-11-16T20:58:40.429 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.430 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.430 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:40.430 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.774014+0000", 2020-11-16T20:58:40.430 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.28760152999999999 2020-11-16T20:58:40.430 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.430 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.430 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.431 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.061615+0000", 2020-11-16T20:58:40.431 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00090118499999999999 2020-11-16T20:58:40.431 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.431 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.431 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for degraded object", 2020-11-16T20:58:40.431 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.062517+0000", 2020-11-16T20:58:40.431 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.040906721 2020-11-16T20:58:40.432 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.432 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.432 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.432 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.103423+0000", 2020-11-16T20:58:40.432 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024524799999999999 2020-11-16T20:58:40.432 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.433 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.433 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:40.433 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.103669+0000", 2020-11-16T20:58:40.433 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00029280400000000002 2020-11-16T20:58:40.433 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.433 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.433 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:40.434 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.103961+0000", 2020-11-16T20:58:40.434 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.33046096899999999 2020-11-16T20:58:40.434 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.434 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.434 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.434 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.434 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.435 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "osd_op(client.4535.0:3965 4.0 4:3c624f0a:::smithi16641208-415:head [stat,delete] snapc 71=[61] RETRY=1 ondisk+retry+write+known_if_redirected e162)", 2020-11-16T20:58:40.435 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:10.773566+0000", 2020-11-16T20:58:40.435 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 25.186610646999998, 2020-11-16T20:58:40.435 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.34725477199999999, 2020-11-16T20:58:40.435 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:40.435 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-16T20:58:40.435 INFO:teuthology.orchestra.run.smithi166.stdout: "client_info": { 2020-11-16T20:58:40.436 INFO:teuthology.orchestra.run.smithi166.stdout: "client": "client.4535", 2020-11-16T20:58:40.436 INFO:teuthology.orchestra.run.smithi166.stdout: "client_addr": "172.21.15.166:0/2006587339", 2020-11-16T20:58:40.436 INFO:teuthology.orchestra.run.smithi166.stdout: "tid": 3965 2020-11-16T20:58:40.436 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.436 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:40.436 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.436 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:40.437 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773566+0000", 2020-11-16T20:58:40.437 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:40.437 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.437 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.437 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:40.437 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773566+0000", 2020-11-16T20:58:40.437 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.1405000000000002e-05 2020-11-16T20:58:40.438 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.438 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.438 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:40.438 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773598+0000", 2020-11-16T20:58:40.438 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.6130000000000003e-06 2020-11-16T20:58:40.438 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.439 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.439 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:40.439 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773603+0000", 2020-11-16T20:58:40.439 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.163e-05 2020-11-16T20:58:40.439 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.439 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.439 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:40.440 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773615+0000", 2020-11-16T20:58:40.440 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.271e-06 2020-11-16T20:58:40.440 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.440 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.440 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:40.440 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.773620+0000", 2020-11-16T20:58:40.440 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00051486000000000001 2020-11-16T20:58:40.441 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.441 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.441 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.441 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.774135+0000", 2020-11-16T20:58:40.441 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2503999999999999e-05 2020-11-16T20:58:40.441 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.442 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.442 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for peered", 2020-11-16T20:58:40.442 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:10.774148+0000", 2020-11-16T20:58:40.442 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.29208424700000002 2020-11-16T20:58:40.442 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.442 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.442 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.443 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.066232+0000", 2020-11-16T20:58:40.443 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0028906180000000002 2020-11-16T20:58:40.443 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.443 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.443 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for degraded object", 2020-11-16T20:58:40.443 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.069123+0000", 2020-11-16T20:58:40.443 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.046887930000000001 2020-11-16T20:58:40.444 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.444 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.444 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.444 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.116010+0000", 2020-11-16T20:58:40.444 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00012060100000000001 2020-11-16T20:58:40.444 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.444 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.445 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "started", 2020-11-16T20:58:40.445 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.116131+0000", 2020-11-16T20:58:40.445 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000244694 2020-11-16T20:58:40.445 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.445 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.445 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "waiting for subops from 1,2", 2020-11-16T20:58:40.445 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.116376+0000", 2020-11-16T20:58:40.446 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0029448370000000001 2020-11-16T20:58:40.446 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.446 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.446 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:40.446 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.119321+0000", 2020-11-16T20:58:40.446 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.000901792 2020-11-16T20:58:40.446 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.447 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.447 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "op_commit", 2020-11-16T20:58:40.447 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.120222+0000", 2020-11-16T20:58:40.447 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00024859600000000002 2020-11-16T20:58:40.447 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.447 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.447 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "sub_op_commit_rec", 2020-11-16T20:58:40.448 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.120471+0000", 2020-11-16T20:58:40.448 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 9.3827999999999997e-05 2020-11-16T20:58:40.448 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.448 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.448 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "commit_sent", 2020-11-16T20:58:40.448 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.120565+0000", 2020-11-16T20:58:40.449 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.00025634600000000002 2020-11-16T20:58:40.449 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.449 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.449 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:40.449 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:11.120821+0000", 2020-11-16T20:58:40.449 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.34725477199999999 2020-11-16T20:58:40.449 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.450 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.450 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.450 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.450 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.450 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "MOSDPGPushReply(4.0 163/161 [PushReplyOp(4:04ed47ba:::smithi16641208-462:head)])", 2020-11-16T20:58:40.450 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.008764+0000", 2020-11-16T20:58:40.450 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 23.951413164000002, 2020-11-16T20:58:40.451 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050833534999999999, 2020-11-16T20:58:40.451 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:40.451 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:40.451 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:40.451 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.451 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:40.451 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.008764+0000", 2020-11-16T20:58:40.452 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:40.452 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.452 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.452 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:40.452 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.008764+0000", 2020-11-16T20:58:40.452 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0648999999999997e-05 2020-11-16T20:58:40.452 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.453 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.453 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:40.453 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.008794+0000", 2020-11-16T20:58:40.453 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1911e-05 2020-11-16T20:58:40.453 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.453 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.453 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:40.454 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.008806+0000", 2020-11-16T20:58:40.454 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.1381e-05 2020-11-16T20:58:40.454 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.454 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.454 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:40.454 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.008818+0000", 2020-11-16T20:58:40.454 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 5.9460000000000003e-06 2020-11-16T20:58:40.455 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.455 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.455 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:40.455 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.008824+0000", 2020-11-16T20:58:40.455 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.048239439000000002 2020-11-16T20:58:40.455 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.455 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.456 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.456 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.057063+0000", 2020-11-16T20:58:40.456 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0025342089999999999 2020-11-16T20:58:40.456 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.456 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.456 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:40.456 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.059597+0000", 2020-11-16T20:58:40.457 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050833534999999999 2020-11-16T20:58:40.457 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.457 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.457 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.457 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.457 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.457 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "MOSDPGPushReply(4.0 163/161 [PushReplyOp(4:1e6cac27:::smithi16641208-165:head)])", 2020-11-16T20:58:40.458 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.011973+0000", 2020-11-16T20:58:40.458 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 23.948203918000001, 2020-11-16T20:58:40.458 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.055325996000000002, 2020-11-16T20:58:40.458 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:40.458 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:40.458 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:40.458 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.459 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:40.459 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.011973+0000", 2020-11-16T20:58:40.459 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:40.459 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.459 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.459 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:40.459 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.011973+0000", 2020-11-16T20:58:40.460 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 2.8260999999999999e-05 2020-11-16T20:58:40.460 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.460 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.460 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:40.460 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.012001+0000", 2020-11-16T20:58:40.460 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 7.9039999999999992e-06 2020-11-16T20:58:40.460 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.461 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.461 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:40.461 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.012009+0000", 2020-11-16T20:58:40.461 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2295e-05 2020-11-16T20:58:40.461 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.461 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.461 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:40.462 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.012022+0000", 2020-11-16T20:58:40.462 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.0759999999999999e-06 2020-11-16T20:58:40.462 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.462 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.462 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:40.462 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.012028+0000", 2020-11-16T20:58:40.462 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.051366063000000003 2020-11-16T20:58:40.463 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.463 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.463 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.463 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.063394+0000", 2020-11-16T20:58:40.463 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.0039053970000000001 2020-11-16T20:58:40.463 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.463 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.464 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:40.464 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.067299+0000", 2020-11-16T20:58:40.464 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.055325996000000002 2020-11-16T20:58:40.464 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.464 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.464 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.464 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.465 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.465 INFO:teuthology.orchestra.run.smithi166.stdout: "description": "MOSDPGPushReply(3.0 163/161 [PushReplyOp(3:2644dcd6:::smithi16641208-437:head)])", 2020-11-16T20:58:40.465 INFO:teuthology.orchestra.run.smithi166.stdout: "initiated_at": "2020-11-16T20:58:12.020962+0000", 2020-11-16T20:58:40.465 INFO:teuthology.orchestra.run.smithi166.stdout: "age": 23.939215044000001, 2020-11-16T20:58:40.465 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.051574284999999997, 2020-11-16T20:58:40.465 INFO:teuthology.orchestra.run.smithi166.stdout: "type_data": { 2020-11-16T20:58:40.465 INFO:teuthology.orchestra.run.smithi166.stdout: "flag_point": "reached pg", 2020-11-16T20:58:40.466 INFO:teuthology.orchestra.run.smithi166.stdout: "events": [ 2020-11-16T20:58:40.466 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.466 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "initiated", 2020-11-16T20:58:40.466 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.020962+0000", 2020-11-16T20:58:40.466 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0 2020-11-16T20:58:40.466 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.467 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.467 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "throttled", 2020-11-16T20:58:40.467 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.020962+0000", 2020-11-16T20:58:40.467 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 3.0400999999999999e-05 2020-11-16T20:58:40.467 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.467 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.467 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "header_read", 2020-11-16T20:58:40.468 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.020992+0000", 2020-11-16T20:58:40.468 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.8589999999999999e-06 2020-11-16T20:58:40.468 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.468 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.468 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "all_read", 2020-11-16T20:58:40.468 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.020999+0000", 2020-11-16T20:58:40.468 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 1.2777e-05 2020-11-16T20:58:40.469 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.469 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.469 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "dispatched", 2020-11-16T20:58:40.469 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.021012+0000", 2020-11-16T20:58:40.469 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 6.7560000000000002e-06 2020-11-16T20:58:40.469 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.469 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.470 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "queued_for_pg", 2020-11-16T20:58:40.470 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.021019+0000", 2020-11-16T20:58:40.470 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.050137168000000003 2020-11-16T20:58:40.470 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.470 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.470 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "reached_pg", 2020-11-16T20:58:40.470 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.071156+0000", 2020-11-16T20:58:40.471 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.001380324 2020-11-16T20:58:40.471 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.471 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.471 INFO:teuthology.orchestra.run.smithi166.stdout: "event": "done", 2020-11-16T20:58:40.471 INFO:teuthology.orchestra.run.smithi166.stdout: "time": "2020-11-16T20:58:12.072536+0000", 2020-11-16T20:58:40.471 INFO:teuthology.orchestra.run.smithi166.stdout: "duration": 0.051574284999999997 2020-11-16T20:58:40.471 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.472 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.472 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.472 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.472 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.472 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:40.473 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7, 1] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-16T20:58:40.473 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-16T20:58:40.473 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2020-11-16T20:58:40.479 INFO:teuthology.orchestra.run.smithi166.stdout:osd.0: {} 2020-11-16T20:58:40.480 INFO:teuthology.orchestra.run.smithi166.stdout:osd.1: {} 2020-11-16T20:58:40.480 INFO:teuthology.orchestra.run.smithi166.stdout:osd.2: {} 2020-11-16T20:58:40.480 INFO:teuthology.orchestra.run.smithi166.stdout:osd.3: {} 2020-11-16T20:58:40.480 INFO:teuthology.orchestra.run.smithi166.stdout:osd.4: {} 2020-11-16T20:58:40.480 INFO:teuthology.orchestra.run.smithi166.stdout:osd.5: {} 2020-11-16T20:58:40.480 INFO:teuthology.orchestra.run.smithi166.stdout:osd.6: {} 2020-11-16T20:58:40.480 INFO:teuthology.orchestra.run.smithi166.stdout:osd.7: {} 2020-11-16T20:58:40.481 INFO:teuthology.orchestra.run.smithi166.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-16T20:58:40.481 INFO:teuthology.orchestra.run.smithi166.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-16T20:58:40.481 INFO:teuthology.orchestra.run.smithi166.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-16T20:58:40.481 INFO:teuthology.orchestra.run.smithi166.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-16T20:58:40.481 INFO:teuthology.orchestra.run.smithi166.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-16T20:58:40.482 INFO:teuthology.orchestra.run.smithi166.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-16T20:58:40.482 INFO:teuthology.orchestra.run.smithi166.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-16T20:58:40.482 INFO:teuthology.orchestra.run.smithi166.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-16T20:58:40.482 INFO:tasks.rados.rados.0.smithi166.stdout:1354: done (2 left) 2020-11-16T20:58:40.482 INFO:tasks.rados.rados.0.smithi166.stdout:1355: write oid 107 current snap is 65 2020-11-16T20:58:40.483 INFO:tasks.rados.rados.0.smithi166.stdout:1352: finishing write tid 1 to smithi16641208-469 2020-11-16T20:58:40.483 INFO:tasks.rados.rados.0.smithi166.stdout:1349: finishing write tid 2 to smithi16641208-251 2020-11-16T20:58:40.483 INFO:tasks.rados.rados.0.smithi166.stdout:1349: finishing write tid 3 to smithi16641208-251 2020-11-16T20:58:40.483 INFO:tasks.rados.rados.0.smithi166.stdout:1355: seq_num 722 ranges {534654=466960,1766705=367949} 2020-11-16T20:58:40.483 INFO:tasks.rados.rados.0.smithi166.stdout:1355: writing smithi16641208-107 from 534654 to 1001614 tid 1 2020-11-16T20:58:40.483 INFO:tasks.rados.rados.0.smithi166.stdout:1355: writing smithi16641208-107 from 1766705 to 2134654 tid 2 2020-11-16T20:58:40.483 INFO:tasks.rados.rados.0.smithi166.stdout:1349: finishing write tid 4 to smithi16641208-251 2020-11-16T20:58:40.484 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 251 v 937 (ObjNum 719 snap 65 seq_num 719) dirty exists 2020-11-16T20:58:40.484 INFO:tasks.rados.rados.0.smithi166.stdout:1349: left oid 251 (ObjNum 719 snap 65 seq_num 719) 2020-11-16T20:58:40.484 INFO:tasks.rados.rados.0.smithi166.stdout:1352: finishing write tid 2 to smithi16641208-469 2020-11-16T20:58:40.484 INFO:tasks.rados.rados.0.smithi166.stdout:1352: finishing write tid 3 to smithi16641208-469 2020-11-16T20:58:40.484 INFO:tasks.rados.rados.0.smithi166.stdout:1352: finishing write tid 4 to smithi16641208-469 2020-11-16T20:58:40.484 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 469 v 981 (ObjNum 720 snap 65 seq_num 720) dirty exists 2020-11-16T20:58:40.484 INFO:tasks.rados.rados.0.smithi166.stdout:1352: left oid 469 (ObjNum 720 snap 65 seq_num 720) 2020-11-16T20:58:40.485 INFO:tasks.rados.rados.0.smithi166.stdout:1349: done (2 left) 2020-11-16T20:58:40.485 INFO:tasks.rados.rados.0.smithi166.stdout:1352: done (1 left) 2020-11-16T20:58:40.485 INFO:tasks.rados.rados.0.smithi166.stdout:1356: read oid 156 snap 64 2020-11-16T20:58:40.485 INFO:tasks.rados.rados.0.smithi166.stdout:1356: expect (ObjNum 674 snap 50 seq_num 674) 2020-11-16T20:58:40.485 INFO:tasks.rados.rados.0.smithi166.stdout:1357: snap_create 2020-11-16T20:58:40.485 INFO:tasks.rados.rados.0.smithi166.stdout:1356: expect (ObjNum 674 snap 50 seq_num 674) 2020-11-16T20:58:40.485 INFO:tasks.rados.rados.0.smithi166.stdout:1355: finishing write tid 1 to smithi16641208-107 2020-11-16T20:58:40.486 INFO:tasks.rados.rados.0.smithi166.stdout:1355: finishing write tid 2 to smithi16641208-107 2020-11-16T20:58:40.486 INFO:tasks.rados.rados.0.smithi166.stdout:1355: finishing write tid 3 to smithi16641208-107 2020-11-16T20:58:40.486 INFO:tasks.rados.rados.0.smithi166.stdout:1355: finishing write tid 4 to smithi16641208-107 2020-11-16T20:58:40.486 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 107 v 940 (ObjNum 722 snap 65 seq_num 722) dirty exists 2020-11-16T20:58:40.486 INFO:tasks.rados.rados.0.smithi166.stdout:1355: left oid 107 (ObjNum 722 snap 65 seq_num 722) 2020-11-16T20:58:40.486 INFO:tasks.rados.rados.0.smithi166.stdout:1355: done (2 left) 2020-11-16T20:58:40.486 INFO:tasks.rados.rados.0.smithi166.stdout:1356: done (1 left) 2020-11-16T20:58:40.487 INFO:tasks.rados.rados.0.smithi166.stdout:1357: done (0 left) 2020-11-16T20:58:40.487 INFO:tasks.rados.rados.0.smithi166.stdout:1358: read oid 112 snap -1 2020-11-16T20:58:40.487 INFO:tasks.rados.rados.0.smithi166.stdout:1358: expect (ObjNum 111 snap 0 seq_num 111) 2020-11-16T20:58:40.487 INFO:tasks.rados.rados.0.smithi166.stdout:1359: cache_flush oid 476 snap -1 2020-11-16T20:58:40.487 INFO:tasks.rados.rados.0.smithi166.stdout:1360: read oid 235 snap -1 2020-11-16T20:58:40.487 INFO:tasks.rados.rados.0.smithi166.stdout:1360: expect (ObjNum 588 snap 26 seq_num 588) 2020-11-16T20:58:40.487 INFO:tasks.rados.rados.0.smithi166.stdout:1361: snap_remove snap 65 2020-11-16T20:58:40.488 INFO:tasks.rados.rados.0.smithi166.stdout:1361: done (3 left) 2020-11-16T20:58:40.488 INFO:tasks.rados.rados.0.smithi166.stdout:1362: rollback oid 125 current snap is 66 2020-11-16T20:58:40.488 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 125 to 62 2020-11-16T20:58:40.488 INFO:tasks.rados.rados.0.smithi166.stdout:1359: got (2) No such file or directory 2020-11-16T20:58:40.488 INFO:tasks.rados.rados.0.smithi166.stdout:1360: expect (ObjNum 588 snap 26 seq_num 588) 2020-11-16T20:58:40.488 INFO:tasks.rados.rados.0.smithi166.stdout:1358: expect (ObjNum 111 snap 0 seq_num 111) 2020-11-16T20:58:40.489 INFO:tasks.rados.rados.0.smithi166.stdout:1362: finishing rollback tid 0 to smithi16641208-125 2020-11-16T20:58:40.489 INFO:tasks.rados.rados.0.smithi166.stdout:1362: finishing rollback tid 1 to smithi16641208-125 2020-11-16T20:58:40.489 INFO:tasks.rados.rados.0.smithi166.stdout:1362: finishing rollback tid 2 to smithi16641208-125 2020-11-16T20:58:40.489 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 125 v 816 (ObjNum 665 snap 47 seq_num 665) dirty exists 2020-11-16T20:58:40.489 INFO:tasks.rados.rados.0.smithi166.stdout:1358: done (3 left) 2020-11-16T20:58:40.489 INFO:tasks.rados.rados.0.smithi166.stdout:1359: done (2 left) 2020-11-16T20:58:40.489 INFO:tasks.rados.rados.0.smithi166.stdout:1360: done (1 left) 2020-11-16T20:58:40.490 INFO:tasks.rados.rados.0.smithi166.stdout:1362: done (0 left) 2020-11-16T20:58:40.490 INFO:tasks.rados.rados.0.smithi166.stdout:1363: rollback oid 272 current snap is 66 2020-11-16T20:58:40.490 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 272 to 64 2020-11-16T20:58:40.490 INFO:tasks.rados.rados.0.smithi166.stdout:1364: copy_from oid 415 from oid 238 current snap is 66 2020-11-16T20:58:40.490 INFO:tasks.rados.rados.0.smithi166.stdout:1365: cache_flush oid 72 snap -1 2020-11-16T20:58:40.490 INFO:tasks.rados.rados.0.smithi166.stdout:1366: cache_try_flush oid 357 snap -1 2020-11-16T20:58:40.490 INFO:tasks.rados.rados.0.smithi166.stdout:1367: delete oid 70 current snap is 66 2020-11-16T20:58:40.491 INFO:tasks.rados.rados.0.smithi166.stdout:1366: got (0) Success 2020-11-16T20:58:40.491 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 357 v 0 (ObjNum 605 snap 30 seq_num 605) dirty exists 2020-11-16T20:58:40.491 INFO:tasks.rados.rados.0.smithi166.stdout:1365: got (2) No such file or directory 2020-11-16T20:58:40.491 INFO:tasks.rados.rados.0.smithi166.stdout:1365: done (4 left) 2020-11-16T20:58:40.491 INFO:tasks.rados.rados.0.smithi166.stdout:1366: done (3 left) 2020-11-16T20:58:40.491 INFO:tasks.rados.rados.0.smithi166.stdout:1367: done (2 left) 2020-11-16T20:58:40.491 INFO:tasks.rados.rados.0.smithi166.stdout:1368: rollback oid 68 current snap is 66 2020-11-16T20:58:40.492 INFO:tasks.rados.rados.0.smithi166.stdout:rollback oid 68 to 64 2020-11-16T20:58:40.492 INFO:tasks.rados.rados.0.smithi166.stdout:1369: cache_flush oid 77 snap -1 2020-11-16T20:58:40.492 INFO:tasks.rados.rados.0.smithi166.stdout:1370: cache_try_flush oid 204 snap 64 2020-11-16T20:58:40.492 INFO:tasks.rados.rados.0.smithi166.stdout:1371: snap_remove snap 62 2020-11-16T20:58:40.492 INFO:tasks.rados.rados.0.smithi166.stdout:1371: done (5 left) 2020-11-16T20:58:40.492 INFO:tasks.rados.rados.0.smithi166.stdout:1372: cache_try_flush oid 152 snap 64 2020-11-16T20:58:40.492 INFO:tasks.rados.rados.0.smithi166.stdout:1369: got (2) No such file or directory 2020-11-16T20:58:40.493 INFO:tasks.rados.rados.0.smithi166.stdout:1370: got (2) No such file or directory 2020-11-16T20:58:40.493 INFO:tasks.rados.rados.0.smithi166.stdout:1363: finishing rollback tid 0 to smithi16641208-272 2020-11-16T20:58:40.493 INFO:tasks.rados.rados.0.smithi166.stdout:1363: finishing rollback tid 1 to smithi16641208-272 2020-11-16T20:58:40.493 INFO:tasks.rados.rados.0.smithi166.stdout:1368: finishing rollback tid 0 to smithi16641208-68 2020-11-16T20:58:40.493 INFO:tasks.rados.rados.0.smithi166.stdout:1363: finishing rollback tid 2 to smithi16641208-272 2020-11-16T20:58:40.493 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 272 v 943 (ObjNum 696 snap 57 seq_num 696) dirty exists 2020-11-16T20:58:40.493 INFO:tasks.rados.rados.0.smithi166.stdout:1368: finishing rollback tid 1 to smithi16641208-68 2020-11-16T20:58:40.494 INFO:tasks.rados.rados.0.smithi166.stdout:1368: finishing rollback tid 2 to smithi16641208-68 2020-11-16T20:58:40.494 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 68 v 973 (ObjNum 258 snap 0 seq_num 258) dirty exists 2020-11-16T20:58:40.494 INFO:tasks.rados.rados.0.smithi166.stdout:1364: finishing copy_from to smithi16641208-415 2020-11-16T20:58:40.494 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 415 v 923 (ObjNum 711 snap 61 seq_num 711) dirty exists 2020-11-16T20:58:40.494 INFO:tasks.rados.rados.0.smithi166.stdout:1364: finishing copy_from racing read to smithi16641208-415 2020-11-16T20:58:40.494 INFO:tasks.rados.rados.0.smithi166.stdout:1363: done (5 left) 2020-11-16T20:58:40.494 INFO:tasks.rados.rados.0.smithi166.stdout:1364: done (4 left) 2020-11-16T20:58:40.495 INFO:tasks.rados.rados.0.smithi166.stdout:1368: done (3 left) 2020-11-16T20:58:40.495 INFO:tasks.rados.rados.0.smithi166.stdout:1369: done (2 left) 2020-11-16T20:58:40.495 INFO:tasks.rados.rados.0.smithi166.stdout:1370: done (1 left) 2020-11-16T20:58:40.495 INFO:tasks.rados.rados.0.smithi166.stdout:1373: read oid 289 snap -1 2020-11-16T20:58:40.495 INFO:tasks.rados.rados.0.smithi166.stdout:1373: expect (ObjNum 655 snap 45 seq_num 655) 2020-11-16T20:58:40.495 INFO:tasks.rados.rados.0.smithi166.stdout:1374: cache_try_flush oid 61 snap -1 2020-11-16T20:58:40.495 INFO:tasks.rados.rados.0.smithi166.stdout:1375: cache_try_flush oid 108 snap -1 2020-11-16T20:58:40.496 INFO:tasks.rados.rados.0.smithi166.stdout:1376: read oid 430 snap 64 2020-11-16T20:58:40.496 INFO:tasks.rados.rados.0.smithi166.stdout:1376: expect (ObjNum 270 snap 0 seq_num 270) 2020-11-16T20:58:40.496 INFO:tasks.rados.rados.0.smithi166.stdout:1377: delete oid 243 current snap is 66 2020-11-16T20:58:40.496 INFO:tasks.rados.rados.0.smithi166.stdout:1374: got (0) Success 2020-11-16T20:58:40.496 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 61 v 0 (ObjNum 589 snap 27 seq_num 589) dirty exists 2020-11-16T20:58:40.496 INFO:tasks.rados.rados.0.smithi166.stdout:1375: got (0) Success 2020-11-16T20:58:40.496 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 108 v 0 (ObjNum 107 snap 0 seq_num 107) dirty exists 2020-11-16T20:58:40.497 INFO:tasks.rados.rados.0.smithi166.stdout:1373: expect (ObjNum 655 snap 45 seq_num 655) 2020-11-16T20:58:40.497 INFO:tasks.rados.rados.0.smithi166.stdout:1376: expect (ObjNum 270 snap 0 seq_num 270) 2020-11-16T20:58:40.497 INFO:tasks.rados.rados.0.smithi166.stdout:1372: got (0) Success 2020-11-16T20:58:40.497 INFO:tasks.rados.rados.0.smithi166.stdout:update_object_version oid 152 v 0 (ObjNum 651 snap 44 seq_num 651) dirty exists 2020-11-16T20:58:40.497 INFO:tasks.rados.rados.0.smithi166.stdout:1372: done (5 left) 2020-11-16T20:58:40.497 INFO:tasks.rados.rados.0.smithi166.stdout:1373: done (4 left) 2020-11-16T20:58:40.497 INFO:tasks.rados.rados.0.smithi166.stdout:1374: done (3 left) 2020-11-16T20:58:40.498 INFO:tasks.rados.rados.0.smithi166.stdout:1375: done (2 left) 2020-11-16T20:58:40.498 INFO:tasks.rados.rados.0.smithi166.stdout:1376: done (1 left) 2020-11-16T20:58:40.498 INFO:tasks.rados.rados.0.smithi166.stdout:1377: done (0 left) 2020-11-16T20:58:40.498 INFO:tasks.rados.rados.0.smithi166.stdout:1378: snap_remove snap 64 2020-11-16T20:58:40.498 INFO:tasks.ceph.osd.2.smithi166.stderr:2020-11-16T20:58:36.779+0000 7f00ff289700 -1 osd.2 pg_epoch: 184 pg[4.0( v 182'579 (0'0,182'579] local-lis/les=164/165 n=46 ec=22/22 lis/c=164/164 les/c/f=165/165/0 sis=164) [2,1,0] r=0 lpr=164 crt=182'579 lcod 182'578 mlcod 182'578 active+clean+snaptrim trimq=[73~1] ps=[79~1,7e~1]] removing snap head 2020-11-16T20:58:40.498 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:36.783+0000 7f8686d1b700 -1 osd.1 pg_epoch: 184 pg[3.0( v 182'917 (0'0,182'917] local-lis/les=164/165 n=119 ec=19/19 lis/c=164/164 les/c/f=165/165/0 sis=164) [1,2,6] r=0 lpr=164 crt=182'917 lcod 182'915 mlcod 182'915 active+clean+snaptrim trimq=[73~1] ps=[79~1,7e~1]] removing snap head 2020-11-16T20:58:40.499 INFO:tasks.ceph.osd.1.smithi166.stderr:2020-11-16T20:58:39.776+0000 7f8686d1b700 -1 osd.1 pg_epoch: 187 pg[3.0( v 187'935 (0'0,187'935] local-lis/les=164/165 n=113 ec=19/19 lis/c=164/164 les/c/f=165/165/0 sis=164) [1,2,6] r=0 lpr=164 luod=184'933 crt=187'935 lcod 184'931 mlcod 184'931 active+clean+snaptrim trimq=[7c~1] ps=[73~1,7e~1,82~1]] removing snap head 2020-11-16T20:58:40.499 INFO:teuthology.orchestra.run.smithi166.stderr:noscrub is unset 2020-11-16T20:58:40.499 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:36.804+0000 7ff3cca49700 -1 osd.0 pg_epoch: 184 pg[3.3( v 184'951 (0'0,184'951] local-lis/les=167/168 n=124 ec=19/19 lis/c=167/167 les/c/f=168/168/0 sis=167) [0,4,6] r=0 lpr=167 luod=184'949 crt=184'951 lcod 184'947 mlcod 184'947 active+clean+snaptrim trimq=[73~1] ps=[79~1,7e~1]] removing snap head 2020-11-16T20:58:40.499 INFO:tasks.ceph.osd.7.smithi059.stderr:2020-11-16T20:58:40.478+0000 7fa705de7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31583) UID: 0 2020-11-16T20:58:40.500 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-16T20:58:40.575 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:40.580+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:40.648 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:40.649 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:40.659 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-16T20:58:40.676 INFO:tasks.ceph.osd.6.smithi059.stderr:2020-11-16T20:58:40.681+0000 7f37a13e5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31581) UID: 0 2020-11-16T20:58:40.777 INFO:tasks.ceph.osd.0.smithi166.stderr:2020-11-16T20:58:40.782+0000 7ff3e8335700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35281) UID: 0 2020-11-16T20:58:40.800 INFO:tasks.rados.rados.0.smithi166.stdout:1378: done (0 left) 2020-11-16T20:58:40.801 INFO:tasks.rados.rados.0.smithi166.stdout:1379: cache_flush oid 236 snap -1 2020-11-16T20:58:40.801 INFO:tasks.rados.rados.0.smithi166.stdout:1380: read oid 417 snap -1 2020-11-16T20:58:40.801 INFO:tasks.rados.rados.0.smithi166.stdout:1380: expect (ObjNum 673 snap 49 seq_num 673) 2020-11-16T20:58:40.801 INFO:tasks.rados.rados.0.smithi166.stdout:1381: snap_create 2020-11-16T20:58:40.802 INFO:tasks.rados.rados.0.smithi166.stdout:1379: got (2) No such file or directory 2020-11-16T20:58:40.811 INFO:tasks.rados.rados.0.smithi166.stdout:1380: expect (ObjNum 673 snap 49 seq_num 673) 2020-11-16T20:58:40.813 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:58:40.819+0000 7f1d7e7f5700 -1 osd.3 pg_epoch: 188 pg[3.2( v 187'829 (0'0,187'829] local-lis/les=19/20 n=110 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [3,5,6] r=0 lpr=19 crt=187'829 lcod 187'827 mlcod 187'827 active+clean+snaptrim trimq=[80~1] ps=[73~1,7c~1,7e~1,82~1]] removing snap head 2020-11-16T20:58:40.815 INFO:tasks.ceph.osd.3.smithi166.stderr:2020-11-16T20:58:40.820+0000 7f1d7e7f5700 -1 osd.3 pg_epoch: 188 pg[3.2( v 188'831 (0'0,188'831] local-lis/les=19/20 n=108 ec=19/19 lis/c=19/19 les/c/f=20/20/0 sis=19) [3,5,6] r=0 lpr=19 luod=187'829 crt=188'831 lcod 187'827 mlcod 187'827 active+clean+snaptrim trimq=[80~1] ps=[73~1,7c~1,7e~1,82~1]] removing snap head 2020-11-16T20:58:40.838 INFO:teuthology.orchestra.run.smithi166.stdout: 2020-11-16T20:58:40.838 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2020-11-16T20:58:40.838 INFO:teuthology.orchestra.run.smithi166.stdout: "epoch": 188, 2020-11-16T20:58:40.839 INFO:teuthology.orchestra.run.smithi166.stdout: "fsid": "a14fd848-4cfe-4cd9-9140-5b3c4b4e904d", 2020-11-16T20:58:40.839 INFO:teuthology.orchestra.run.smithi166.stdout: "created": "2020-11-16T20:54:44.938121+0000", 2020-11-16T20:58:40.839 INFO:teuthology.orchestra.run.smithi166.stdout: "modified": "2020-11-16T20:58:40.801854+0000", 2020-11-16T20:58:40.840 INFO:teuthology.orchestra.run.smithi166.stdout: "last_up_change": "2020-11-16T20:54:52.080163+0000", 2020-11-16T20:58:40.840 INFO:teuthology.orchestra.run.smithi166.stdout: "last_in_change": "2020-11-16T20:58:08.763046+0000", 2020-11-16T20:58:40.840 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-11-16T20:58:40.840 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_num": 5804032, 2020-11-16T20:58:40.841 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_set": [ 2020-11-16T20:58:40.841 INFO:teuthology.orchestra.run.smithi166.stdout: "nodeep-scrub", 2020-11-16T20:58:40.841 INFO:teuthology.orchestra.run.smithi166.stdout: "pglog_hardlimit", 2020-11-16T20:58:40.842 INFO:teuthology.orchestra.run.smithi166.stdout: "purged_snapdirs", 2020-11-16T20:58:40.842 INFO:teuthology.orchestra.run.smithi166.stdout: "recovery_deletes", 2020-11-16T20:58:40.842 INFO:teuthology.orchestra.run.smithi166.stdout: "sortbitwise" 2020-11-16T20:58:40.842 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:58:40.843 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_version": 8, 2020-11-16T20:58:40.843 INFO:teuthology.orchestra.run.smithi166.stdout: "full_ratio": 0.94999998807907104, 2020-11-16T20:58:40.843 INFO:teuthology.orchestra.run.smithi166.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-11-16T20:58:40.844 INFO:teuthology.orchestra.run.smithi166.stdout: "nearfull_ratio": 0.85000002384185791, 2020-11-16T20:58:40.844 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_snapshot": "", 2020-11-16T20:58:40.844 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_max": 4, 2020-11-16T20:58:40.844 INFO:teuthology.orchestra.run.smithi166.stdout: "max_osd": 8, 2020-11-16T20:58:40.845 INFO:teuthology.orchestra.run.smithi166.stdout: "require_min_compat_client": "luminous", 2020-11-16T20:58:40.845 INFO:teuthology.orchestra.run.smithi166.stdout: "min_compat_client": "luminous", 2020-11-16T20:58:40.845 INFO:teuthology.orchestra.run.smithi166.stdout: "require_osd_release": "pacific", 2020-11-16T20:58:40.846 INFO:teuthology.orchestra.run.smithi166.stdout: "pools": [ 2020-11-16T20:58:40.846 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.846 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 1, 2020-11-16T20:58:40.846 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "device_health_metrics", 2020-11-16T20:58:40.847 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:54:49.109999+0000", 2020-11-16T20:58:40.847 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 1, 2020-11-16T20:58:40.847 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool", 2020-11-16T20:58:40.848 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:58:40.848 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:58:40.848 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:58:40.849 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:58:40.849 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:58:40.849 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:58:40.850 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:58:40.850 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:58:40.851 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:58:40.851 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:58:40.851 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 11, 2020-11-16T20:58:40.852 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 11, 2020-11-16T20:58:40.852 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 11, 2020-11-16T20:58:40.853 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 11, 2020-11-16T20:58:40.853 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 11, 2020-11-16T20:58:40.853 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:58:40.854 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:58:40.854 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:58:40.855 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:58:40.855 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:58:40.855 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:58:40.856 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:58:40.856 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.856 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "157", 2020-11-16T20:58:40.857 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "0", 2020-11-16T20:58:40.857 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-16T20:58:40.858 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "155", 2020-11-16T20:58:40.858 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:58:40.858 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:58:40.859 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 0, 2020-11-16T20:58:40.859 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 0, 2020-11-16T20:58:40.860 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:58:40.860 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:58:40.860 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:58:40.861 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:58:40.861 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:58:40.861 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:58:40.862 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:58:40.862 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:58:40.863 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:58:40.863 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:58:40.863 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:58:40.864 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:58:40.864 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:58:40.864 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:58:40.865 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:58:40.865 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:58:40.866 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:58:40.866 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:58:40.866 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:58:40.867 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.867 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:58:40.867 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:58:40.868 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:58:40.868 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:58:40.868 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:58:40.869 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:58:40.869 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:58:40.869 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:58:40.870 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:58:40.870 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:58:40.870 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:58:40.871 INFO:teuthology.orchestra.run.smithi166.stdout: "options": { 2020-11-16T20:58:40.871 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_min": 1 2020-11-16T20:58:40.871 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.872 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:58:40.872 INFO:teuthology.orchestra.run.smithi166.stdout: "mgr_devicehealth": {} 2020-11-16T20:58:40.872 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.873 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.873 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.874 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 2, 2020-11-16T20:58:40.874 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "rbd", 2020-11-16T20:58:40.874 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:54:53.253680+0000", 2020-11-16T20:58:40.875 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 1, 2020-11-16T20:58:40.875 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool", 2020-11-16T20:58:40.875 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:58:40.876 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:58:40.876 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:58:40.876 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:58:40.876 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:58:40.877 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:58:40.877 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:58:40.877 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:58:40.878 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:58:40.878 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:58:40.878 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 18, 2020-11-16T20:58:40.879 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 18, 2020-11-16T20:58:40.879 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 18, 2020-11-16T20:58:40.879 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 18, 2020-11-16T20:58:40.880 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 18, 2020-11-16T20:58:40.880 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:58:40.880 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:58:40.880 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:58:40.881 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:58:40.881 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:58:40.881 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:58:40.882 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:58:40.882 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.882 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "34", 2020-11-16T20:58:40.882 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "0", 2020-11-16T20:58:40.883 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-16T20:58:40.883 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "32", 2020-11-16T20:58:40.883 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:58:40.884 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:58:40.884 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 0, 2020-11-16T20:58:40.884 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 0, 2020-11-16T20:58:40.884 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:58:40.885 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:58:40.885 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:58:40.885 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:58:40.886 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:58:40.886 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:58:40.886 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:58:40.887 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:58:40.887 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:58:40.887 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:58:40.887 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:58:40.888 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:58:40.888 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:58:40.888 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:58:40.888 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:58:40.889 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:58:40.889 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:58:40.889 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:58:40.890 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:58:40.890 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.890 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:58:40.890 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:58:40.891 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:58:40.891 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:58:40.891 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:58:40.892 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:58:40.892 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:58:40.892 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:58:40.892 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:58:40.893 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:58:40.893 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:58:40.893 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:58:40.894 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:58:40.894 INFO:teuthology.orchestra.run.smithi166.stdout: "rbd": {} 2020-11-16T20:58:40.894 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.894 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.895 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.895 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 3, 2020-11-16T20:58:40.895 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "base", 2020-11-16T20:58:40.896 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:55:23.597952+0000", 2020-11-16T20:58:40.896 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 8193, 2020-11-16T20:58:40.896 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2020-11-16T20:58:40.896 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:58:40.897 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:58:40.897 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:58:40.897 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:58:40.897 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:58:40.898 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:58:40.898 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:58:40.898 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:58:40.899 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:58:40.899 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:58:40.899 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 4, 2020-11-16T20:58:40.899 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 4, 2020-11-16T20:58:40.900 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 4, 2020-11-16T20:58:40.900 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 4, 2020-11-16T20:58:40.900 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 4, 2020-11-16T20:58:40.900 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:58:40.901 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:58:40.901 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:58:40.901 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:58:40.901 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:58:40.901 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:58:40.901 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:58:40.901 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.902 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "188", 2020-11-16T20:58:40.902 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "27", 2020-11-16T20:58:40.902 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "27", 2020-11-16T20:58:40.902 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "27", 2020-11-16T20:58:40.902 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:58:40.902 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:58:40.902 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 133, 2020-11-16T20:58:40.903 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 188, 2020-11-16T20:58:40.903 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:58:40.903 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:58:40.903 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:58:40.903 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:58:40.903 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [ 2020-11-16T20:58:40.903 INFO:teuthology.orchestra.run.smithi166.stdout: 4 2020-11-16T20:58:40.904 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:58:40.904 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": -1, 2020-11-16T20:58:40.904 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": 4, 2020-11-16T20:58:40.904 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": 4, 2020-11-16T20:58:40.904 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "none", 2020-11-16T20:58:40.904 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:58:40.904 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 0, 2020-11-16T20:58:40.905 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:58:40.905 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:58:40.905 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:58:40.905 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:58:40.905 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:58:40.905 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:58:40.905 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:58:40.906 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "none" 2020-11-16T20:58:40.906 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.906 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 0, 2020-11-16T20:58:40.906 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 0, 2020-11-16T20:58:40.906 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:58:40.906 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 0, 2020-11-16T20:58:40.906 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:58:40.907 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:58:40.907 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:58:40.907 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [], 2020-11-16T20:58:40.907 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:58:40.907 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:58:40.907 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:58:40.907 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:58:40.908 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": { 2020-11-16T20:58:40.908 INFO:teuthology.orchestra.run.smithi166.stdout: "rados": {} 2020-11-16T20:58:40.908 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.908 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.908 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.908 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 4, 2020-11-16T20:58:40.908 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_name": "cache", 2020-11-16T20:58:40.908 INFO:teuthology.orchestra.run.smithi166.stdout: "create_time": "2020-11-16T20:55:28.901773+0000", 2020-11-16T20:58:40.909 INFO:teuthology.orchestra.run.smithi166.stdout: "flags": 8201, 2020-11-16T20:58:40.909 INFO:teuthology.orchestra.run.smithi166.stdout: "flags_names": "hashpspool,incomplete_clones,selfmanaged_snaps", 2020-11-16T20:58:40.909 INFO:teuthology.orchestra.run.smithi166.stdout: "type": 1, 2020-11-16T20:58:40.909 INFO:teuthology.orchestra.run.smithi166.stdout: "size": 3, 2020-11-16T20:58:40.909 INFO:teuthology.orchestra.run.smithi166.stdout: "min_size": 2, 2020-11-16T20:58:40.909 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_rule": 0, 2020-11-16T20:58:40.909 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_count": 0, 2020-11-16T20:58:40.910 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_target": 0, 2020-11-16T20:58:40.910 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_barrier": 0, 2020-11-16T20:58:40.910 INFO:teuthology.orchestra.run.smithi166.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2020-11-16T20:58:40.910 INFO:teuthology.orchestra.run.smithi166.stdout: "object_hash": 2, 2020-11-16T20:58:40.910 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_autoscale_mode": "off", 2020-11-16T20:58:40.910 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num": 4, 2020-11-16T20:58:40.910 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num": 4, 2020-11-16T20:58:40.911 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_placement_num_target": 4, 2020-11-16T20:58:40.911 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_target": 4, 2020-11-16T20:58:40.911 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_num_pending": 4, 2020-11-16T20:58:40.911 INFO:teuthology.orchestra.run.smithi166.stdout: "last_pg_merge_meta": { 2020-11-16T20:58:40.911 INFO:teuthology.orchestra.run.smithi166.stdout: "source_pgid": "0.0", 2020-11-16T20:58:40.911 INFO:teuthology.orchestra.run.smithi166.stdout: "ready_epoch": 0, 2020-11-16T20:58:40.911 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_started": 0, 2020-11-16T20:58:40.912 INFO:teuthology.orchestra.run.smithi166.stdout: "last_epoch_clean": 0, 2020-11-16T20:58:40.912 INFO:teuthology.orchestra.run.smithi166.stdout: "source_version": "0'0", 2020-11-16T20:58:40.912 INFO:teuthology.orchestra.run.smithi166.stdout: "target_version": "0'0" 2020-11-16T20:58:40.912 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.912 INFO:teuthology.orchestra.run.smithi166.stdout: "last_change": "188", 2020-11-16T20:58:40.912 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend": "27", 2020-11-16T20:58:40.912 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_prenautilus": "27", 2020-11-16T20:58:40.912 INFO:teuthology.orchestra.run.smithi166.stdout: "last_force_op_resend_preluminous": "27", 2020-11-16T20:58:40.913 INFO:teuthology.orchestra.run.smithi166.stdout: "auid": 0, 2020-11-16T20:58:40.913 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_mode": "selfmanaged", 2020-11-16T20:58:40.913 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_seq": 133, 2020-11-16T20:58:40.913 INFO:teuthology.orchestra.run.smithi166.stdout: "snap_epoch": 188, 2020-11-16T20:58:40.913 INFO:teuthology.orchestra.run.smithi166.stdout: "pool_snaps": [], 2020-11-16T20:58:40.913 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps": "[]", 2020-11-16T20:58:40.913 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_bytes": 0, 2020-11-16T20:58:40.914 INFO:teuthology.orchestra.run.smithi166.stdout: "quota_max_objects": 0, 2020-11-16T20:58:40.914 INFO:teuthology.orchestra.run.smithi166.stdout: "tiers": [], 2020-11-16T20:58:40.914 INFO:teuthology.orchestra.run.smithi166.stdout: "tier_of": 3, 2020-11-16T20:58:40.914 INFO:teuthology.orchestra.run.smithi166.stdout: "read_tier": -1, 2020-11-16T20:58:40.914 INFO:teuthology.orchestra.run.smithi166.stdout: "write_tier": -1, 2020-11-16T20:58:40.914 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_mode": "writeback", 2020-11-16T20:58:40.914 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_bytes": 0, 2020-11-16T20:58:40.914 INFO:teuthology.orchestra.run.smithi166.stdout: "target_max_objects": 250, 2020-11-16T20:58:40.915 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-16T20:58:40.915 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-16T20:58:40.915 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-16T20:58:40.915 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_flush_age": 0, 2020-11-16T20:58:40.915 INFO:teuthology.orchestra.run.smithi166.stdout: "cache_min_evict_age": 0, 2020-11-16T20:58:40.915 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profile": "", 2020-11-16T20:58:40.915 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_params": { 2020-11-16T20:58:40.916 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "bloom", 2020-11-16T20:58:40.916 INFO:teuthology.orchestra.run.smithi166.stdout: "false_positive_probability": 0.050000000000000003, 2020-11-16T20:58:40.916 INFO:teuthology.orchestra.run.smithi166.stdout: "target_size": 0, 2020-11-16T20:58:40.916 INFO:teuthology.orchestra.run.smithi166.stdout: "seed": 0 2020-11-16T20:58:40.916 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.916 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_period": 3600, 2020-11-16T20:58:40.916 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_count": 8, 2020-11-16T20:58:40.917 INFO:teuthology.orchestra.run.smithi166.stdout: "use_gmt_hitset": true, 2020-11-16T20:58:40.917 INFO:teuthology.orchestra.run.smithi166.stdout: "min_read_recency_for_promote": 2, 2020-11-16T20:58:40.917 INFO:teuthology.orchestra.run.smithi166.stdout: "min_write_recency_for_promote": 0, 2020-11-16T20:58:40.917 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_grade_decay_rate": 0, 2020-11-16T20:58:40.917 INFO:teuthology.orchestra.run.smithi166.stdout: "hit_set_search_last_n": 0, 2020-11-16T20:58:40.917 INFO:teuthology.orchestra.run.smithi166.stdout: "grade_table": [ 2020-11-16T20:58:40.917 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:58:40.917 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:58:40.918 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:58:40.918 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:58:40.918 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:58:40.918 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:58:40.918 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000, 2020-11-16T20:58:40.918 INFO:teuthology.orchestra.run.smithi166.stdout: 1000000 2020-11-16T20:58:40.918 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:58:40.919 INFO:teuthology.orchestra.run.smithi166.stdout: "stripe_width": 0, 2020-11-16T20:58:40.919 INFO:teuthology.orchestra.run.smithi166.stdout: "expected_num_objects": 0, 2020-11-16T20:58:40.919 INFO:teuthology.orchestra.run.smithi166.stdout: "fast_read": false, 2020-11-16T20:58:40.919 INFO:teuthology.orchestra.run.smithi166.stdout: "options": {}, 2020-11-16T20:58:40.919 INFO:teuthology.orchestra.run.smithi166.stdout: "application_metadata": {} 2020-11-16T20:58:40.919 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.919 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:58:40.919 INFO:teuthology.orchestra.run.smithi166.stdout: "osds": [ 2020-11-16T20:58:40.920 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.920 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 0, 2020-11-16T20:58:40.920 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "35950122-efbd-420e-b07a-f5730f26df17", 2020-11-16T20:58:40.920 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:58:40.920 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:58:40.920 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:58:40.920 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:58:40.921 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:58:40.921 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:58:40.921 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:58:40.921 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 172, 2020-11-16T20:58:40.921 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:58:40.921 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:58:40.921 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:58:40.921 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.922 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.922 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.922 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6800", 2020-11-16T20:58:40.922 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:58:40.922 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.922 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.922 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.923 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:58:40.923 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.923 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.923 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.923 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6802", 2020-11-16T20:58:40.923 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:58:40.923 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.924 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.924 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.924 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:58:40.924 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.924 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.924 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.924 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6806", 2020-11-16T20:58:40.925 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:58:40.925 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.925 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.925 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.925 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:58:40.925 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.925 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.925 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.926 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6804", 2020-11-16T20:58:40.926 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35293 2020-11-16T20:58:40.926 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.926 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.926 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.926 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6800/35293", 2020-11-16T20:58:40.926 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6802/35293", 2020-11-16T20:58:40.927 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6806/35293", 2020-11-16T20:58:40.927 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6804/35293", 2020-11-16T20:58:40.927 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:58:40.927 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:58:40.927 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:58:40.927 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.927 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.927 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.928 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 1, 2020-11-16T20:58:40.928 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "f768a1ff-3e8a-4131-a6ed-10f93b3ca900", 2020-11-16T20:58:40.928 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:58:40.928 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:58:40.928 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:58:40.928 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:58:40.928 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:58:40.929 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:58:40.929 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:58:40.929 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 172, 2020-11-16T20:58:40.929 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:58:40.929 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:58:40.929 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:58:40.929 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.929 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.930 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.930 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6808", 2020-11-16T20:58:40.930 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:58:40.930 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.930 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.930 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.930 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:58:40.931 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.931 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.931 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.931 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6809", 2020-11-16T20:58:40.931 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:58:40.931 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.931 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.931 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.932 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:58:40.932 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.932 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.932 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.932 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6811", 2020-11-16T20:58:40.932 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:58:40.932 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.933 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.933 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.933 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:58:40.933 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.933 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.933 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.933 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6810", 2020-11-16T20:58:40.934 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35323 2020-11-16T20:58:40.934 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.934 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.934 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.934 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6808/35323", 2020-11-16T20:58:40.934 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6809/35323", 2020-11-16T20:58:40.934 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6811/35323", 2020-11-16T20:58:40.934 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6810/35323", 2020-11-16T20:58:40.935 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:58:40.935 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:58:40.935 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:58:40.935 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.935 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.935 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.935 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 2, 2020-11-16T20:58:40.936 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "88734179-84a6-4a9b-8af0-692805815875", 2020-11-16T20:58:40.936 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:58:40.936 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:58:40.936 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:58:40.936 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:58:40.936 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:58:40.936 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:58:40.936 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:58:40.937 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 167, 2020-11-16T20:58:40.937 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:58:40.937 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:58:40.937 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:58:40.937 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.937 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.937 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.938 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6801", 2020-11-16T20:58:40.938 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:58:40.938 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.938 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.938 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.938 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:58:40.938 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.938 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.939 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.939 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6803", 2020-11-16T20:58:40.939 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:58:40.939 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.939 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.939 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.939 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:58:40.940 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.940 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.940 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.940 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6807", 2020-11-16T20:58:40.940 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:58:40.940 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.940 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.940 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.941 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:58:40.941 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.941 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.941 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.941 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6805", 2020-11-16T20:58:40.941 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35294 2020-11-16T20:58:40.941 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.942 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.942 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.942 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6801/35294", 2020-11-16T20:58:40.942 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6803/35294", 2020-11-16T20:58:40.942 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6807/35294", 2020-11-16T20:58:40.942 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6805/35294", 2020-11-16T20:58:40.942 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:58:40.943 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:58:40.943 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:58:40.943 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.943 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.943 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.943 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 3, 2020-11-16T20:58:40.943 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "319e54e8-3f03-4388-8de6-678d148e25d4", 2020-11-16T20:58:40.944 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:58:40.944 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:58:40.944 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:58:40.944 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:58:40.944 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:58:40.944 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:58:40.944 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:58:40.944 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 172, 2020-11-16T20:58:40.945 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:58:40.945 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:58:40.945 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:58:40.945 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.945 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.945 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.945 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6812", 2020-11-16T20:58:40.945 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:58:40.946 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.946 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.946 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.946 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:58:40.946 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.946 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.946 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.947 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6813", 2020-11-16T20:58:40.947 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:58:40.947 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.947 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.947 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.947 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:58:40.947 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.948 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.948 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.948 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6815", 2020-11-16T20:58:40.948 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:58:40.948 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.948 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.948 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.948 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:58:40.949 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.949 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.949 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.949 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:6814", 2020-11-16T20:58:40.949 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 35324 2020-11-16T20:58:40.949 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.949 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.950 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.950 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.166:6812/35324", 2020-11-16T20:58:40.950 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.166:6813/35324", 2020-11-16T20:58:40.950 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.166:6815/35324", 2020-11-16T20:58:40.950 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.166:6814/35324", 2020-11-16T20:58:40.950 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:58:40.950 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:58:40.950 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:58:40.951 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.951 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.951 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.951 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 4, 2020-11-16T20:58:40.951 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "3edbb68e-e030-4379-891e-2412f1235ffb", 2020-11-16T20:58:40.951 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:58:40.951 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:58:40.952 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:58:40.952 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 0, 2020-11-16T20:58:40.952 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:58:40.952 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:58:40.952 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:58:40.952 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 160, 2020-11-16T20:58:40.952 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:58:40.952 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:58:40.953 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:58:40.953 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.953 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.953 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.953 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6804", 2020-11-16T20:58:40.953 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:58:40.953 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.954 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.954 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.954 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:58:40.954 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.954 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.954 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.954 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6805", 2020-11-16T20:58:40.955 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:58:40.955 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.955 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.955 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.955 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:58:40.955 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.955 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.955 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.956 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6807", 2020-11-16T20:58:40.956 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:58:40.956 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.956 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.956 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.956 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:58:40.956 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.957 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.957 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.957 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6806", 2020-11-16T20:58:40.957 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31586 2020-11-16T20:58:40.957 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.957 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.957 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.957 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6804/31586", 2020-11-16T20:58:40.958 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6805/31586", 2020-11-16T20:58:40.958 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6807/31586", 2020-11-16T20:58:40.958 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6806/31586", 2020-11-16T20:58:40.958 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:58:40.958 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:58:40.958 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:58:40.958 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.959 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.959 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.959 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 5, 2020-11-16T20:58:40.959 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "44fbf5ac-4484-48a8-a846-1f5c01a6ec2c", 2020-11-16T20:58:40.959 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:58:40.959 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:58:40.959 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:58:40.959 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:58:40.960 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:58:40.960 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:58:40.960 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:58:40.960 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 172, 2020-11-16T20:58:40.960 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:58:40.960 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:58:40.960 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:58:40.961 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.961 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.961 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.961 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6808", 2020-11-16T20:58:40.961 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:58:40.961 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.961 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.961 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.962 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:58:40.962 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.962 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.962 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.962 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6810", 2020-11-16T20:58:40.962 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:58:40.962 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.963 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.963 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.963 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:58:40.963 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.963 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.963 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.963 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6813", 2020-11-16T20:58:40.964 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:58:40.964 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.964 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.964 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.964 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:58:40.964 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.964 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.964 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.965 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6812", 2020-11-16T20:58:40.965 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31610 2020-11-16T20:58:40.965 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.965 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.965 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.965 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6808/31610", 2020-11-16T20:58:40.965 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6810/31610", 2020-11-16T20:58:40.966 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6813/31610", 2020-11-16T20:58:40.966 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6812/31610", 2020-11-16T20:58:40.966 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:58:40.966 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:58:40.966 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:58:40.966 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.966 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.966 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.967 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 6, 2020-11-16T20:58:40.967 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "f93b82df-f537-4601-8247-388bf100b5b5", 2020-11-16T20:58:40.967 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:58:40.967 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:58:40.967 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 0.5976104736328125, 2020-11-16T20:58:40.967 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 1, 2020-11-16T20:58:40.967 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:58:40.968 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:58:40.968 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:58:40.968 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 157, 2020-11-16T20:58:40.968 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:58:40.968 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:58:40.968 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:58:40.968 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.968 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.969 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.969 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6800", 2020-11-16T20:58:40.969 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:58:40.969 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.969 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.969 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.969 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:58:40.970 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.970 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.970 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.970 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6801", 2020-11-16T20:58:40.970 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:58:40.970 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.970 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.970 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.971 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:58:40.971 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.971 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.971 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.971 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6803", 2020-11-16T20:58:40.971 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:58:40.971 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.972 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.972 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.972 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:58:40.972 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.972 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.972 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.972 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6802", 2020-11-16T20:58:40.972 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31587 2020-11-16T20:58:40.973 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.973 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.973 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.973 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6800/31587", 2020-11-16T20:58:40.973 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6801/31587", 2020-11-16T20:58:40.973 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6803/31587", 2020-11-16T20:58:40.973 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6802/31587", 2020-11-16T20:58:40.974 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:58:40.974 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:58:40.974 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:58:40.974 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.974 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.974 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.974 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 7, 2020-11-16T20:58:40.974 INFO:teuthology.orchestra.run.smithi166.stdout: "uuid": "e5485c88-d267-4a6a-b9b6-15d869d28f28", 2020-11-16T20:58:40.975 INFO:teuthology.orchestra.run.smithi166.stdout: "up": 1, 2020-11-16T20:58:40.975 INFO:teuthology.orchestra.run.smithi166.stdout: "in": 1, 2020-11-16T20:58:40.975 INFO:teuthology.orchestra.run.smithi166.stdout: "weight": 1, 2020-11-16T20:58:40.975 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_affinity": 0.262969970703125, 2020-11-16T20:58:40.975 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_begin": 0, 2020-11-16T20:58:40.975 INFO:teuthology.orchestra.run.smithi166.stdout: "last_clean_end": 0, 2020-11-16T20:58:40.975 INFO:teuthology.orchestra.run.smithi166.stdout: "up_from": 13, 2020-11-16T20:58:40.976 INFO:teuthology.orchestra.run.smithi166.stdout: "up_thru": 160, 2020-11-16T20:58:40.976 INFO:teuthology.orchestra.run.smithi166.stdout: "down_at": 0, 2020-11-16T20:58:40.976 INFO:teuthology.orchestra.run.smithi166.stdout: "lost_at": 0, 2020-11-16T20:58:40.976 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addrs": { 2020-11-16T20:58:40.976 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.976 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.976 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.977 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6809", 2020-11-16T20:58:40.977 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:58:40.977 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.977 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.977 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.977 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addrs": { 2020-11-16T20:58:40.977 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.977 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.978 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.978 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6811", 2020-11-16T20:58:40.978 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:58:40.978 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.978 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.978 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.978 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addrs": { 2020-11-16T20:58:40.979 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.979 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.979 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.979 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6815", 2020-11-16T20:58:40.979 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:58:40.979 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.979 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.980 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.980 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addrs": { 2020-11-16T20:58:40.980 INFO:teuthology.orchestra.run.smithi166.stdout: "addrvec": [ 2020-11-16T20:58:40.980 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.980 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v2", 2020-11-16T20:58:40.980 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.59:6814", 2020-11-16T20:58:40.980 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 31617 2020-11-16T20:58:40.980 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.981 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.981 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.981 INFO:teuthology.orchestra.run.smithi166.stdout: "public_addr": "172.21.15.59:6809/31617", 2020-11-16T20:58:40.981 INFO:teuthology.orchestra.run.smithi166.stdout: "cluster_addr": "172.21.15.59:6811/31617", 2020-11-16T20:58:40.981 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_back_addr": "172.21.15.59:6815/31617", 2020-11-16T20:58:40.981 INFO:teuthology.orchestra.run.smithi166.stdout: "heartbeat_front_addr": "172.21.15.59:6814/31617", 2020-11-16T20:58:40.981 INFO:teuthology.orchestra.run.smithi166.stdout: "state": [ 2020-11-16T20:58:40.982 INFO:teuthology.orchestra.run.smithi166.stdout: "exists", 2020-11-16T20:58:40.982 INFO:teuthology.orchestra.run.smithi166.stdout: "up" 2020-11-16T20:58:40.982 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.982 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.982 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:58:40.982 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_xinfo": [ 2020-11-16T20:58:40.982 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.982 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 0, 2020-11-16T20:58:40.983 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:58:40.983 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:58:40.983 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:58:40.983 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:58:40.983 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:58:40.983 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:57:51.069501+0000", 2020-11-16T20:58:40.983 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:58:40.984 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.984 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.984 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 1, 2020-11-16T20:58:40.984 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:58:40.984 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:58:40.984 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:58:40.984 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:58:40.984 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:58:40.985 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:57:50.587440+0000", 2020-11-16T20:58:40.985 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:58:40.985 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.985 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.985 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 2, 2020-11-16T20:58:40.985 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:58:40.985 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:58:40.986 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:58:40.986 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:58:40.986 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:58:40.986 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:57:51.478402+0000", 2020-11-16T20:58:40.986 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:58:40.986 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.986 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.987 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 3, 2020-11-16T20:58:40.987 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:58:40.987 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:58:40.987 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:58:40.987 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:58:40.987 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:58:40.987 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:57:52.168613+0000", 2020-11-16T20:58:40.987 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:58:40.988 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.988 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.988 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 4, 2020-11-16T20:58:40.988 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:58:40.988 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:58:40.988 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:58:40.988 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:58:40.989 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:58:40.989 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:57:51.043436+0000", 2020-11-16T20:58:40.989 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:58:40.989 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.989 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.989 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 5, 2020-11-16T20:58:40.989 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:58:40.989 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:58:40.990 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:58:40.990 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:58:40.990 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:58:40.990 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:57:53.018080+0000", 2020-11-16T20:58:40.990 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:58:40.990 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.990 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.991 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 6, 2020-11-16T20:58:40.991 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:58:40.991 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:58:40.991 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:58:40.991 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:58:40.991 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:58:40.991 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:57:51.672856+0000", 2020-11-16T20:58:40.992 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:58:40.992 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.992 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.992 INFO:teuthology.orchestra.run.smithi166.stdout: "osd": 7, 2020-11-16T20:58:40.992 INFO:teuthology.orchestra.run.smithi166.stdout: "down_stamp": "0.000000", 2020-11-16T20:58:40.992 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_probability": 0, 2020-11-16T20:58:40.992 INFO:teuthology.orchestra.run.smithi166.stdout: "laggy_interval": 0, 2020-11-16T20:58:40.992 INFO:teuthology.orchestra.run.smithi166.stdout: "features": 4540138297136906239, 2020-11-16T20:58:40.993 INFO:teuthology.orchestra.run.smithi166.stdout: "old_weight": 0, 2020-11-16T20:58:40.993 INFO:teuthology.orchestra.run.smithi166.stdout: "last_purged_snaps_scrub": "2020-11-16T20:57:51.523906+0000", 2020-11-16T20:58:40.993 INFO:teuthology.orchestra.run.smithi166.stdout: "dead_epoch": 0 2020-11-16T20:58:40.993 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.993 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:58:40.993 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_upmap": [ 2020-11-16T20:58:40.993 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.994 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "2.c", 2020-11-16T20:58:40.994 INFO:teuthology.orchestra.run.smithi166.stdout: "osds": [ 2020-11-16T20:58:40.994 INFO:teuthology.orchestra.run.smithi166.stdout: 4, 2020-11-16T20:58:40.994 INFO:teuthology.orchestra.run.smithi166.stdout: 5, 2020-11-16T20:58:40.994 INFO:teuthology.orchestra.run.smithi166.stdout: 6 2020-11-16T20:58:40.994 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.994 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.995 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.995 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "4.0", 2020-11-16T20:58:40.995 INFO:teuthology.orchestra.run.smithi166.stdout: "osds": [ 2020-11-16T20:58:40.995 INFO:teuthology.orchestra.run.smithi166.stdout: 2, 2020-11-16T20:58:40.995 INFO:teuthology.orchestra.run.smithi166.stdout: 1, 2020-11-16T20:58:40.995 INFO:teuthology.orchestra.run.smithi166.stdout: 0 2020-11-16T20:58:40.995 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.995 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.996 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.996 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "4.3", 2020-11-16T20:58:40.996 INFO:teuthology.orchestra.run.smithi166.stdout: "osds": [ 2020-11-16T20:58:40.996 INFO:teuthology.orchestra.run.smithi166.stdout: 4, 2020-11-16T20:58:40.996 INFO:teuthology.orchestra.run.smithi166.stdout: 3, 2020-11-16T20:58:40.996 INFO:teuthology.orchestra.run.smithi166.stdout: 2 2020-11-16T20:58:40.996 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.997 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.997 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:58:40.997 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_upmap_items": [ 2020-11-16T20:58:40.997 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.997 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "4.1", 2020-11-16T20:58:40.997 INFO:teuthology.orchestra.run.smithi166.stdout: "mappings": [ 2020-11-16T20:58:40.997 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.997 INFO:teuthology.orchestra.run.smithi166.stdout: "from": 5, 2020-11-16T20:58:40.998 INFO:teuthology.orchestra.run.smithi166.stdout: "to": 3 2020-11-16T20:58:40.998 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.998 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.998 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:40.998 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.998 INFO:teuthology.orchestra.run.smithi166.stdout: "pgid": "4.3", 2020-11-16T20:58:40.998 INFO:teuthology.orchestra.run.smithi166.stdout: "mappings": [ 2020-11-16T20:58:40.999 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:40.999 INFO:teuthology.orchestra.run.smithi166.stdout: "from": 5, 2020-11-16T20:58:40.999 INFO:teuthology.orchestra.run.smithi166.stdout: "to": 7 2020-11-16T20:58:40.999 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.999 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:40.999 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:40.999 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:58:40.999 INFO:teuthology.orchestra.run.smithi166.stdout: "pg_temp": [], 2020-11-16T20:58:41.000 INFO:teuthology.orchestra.run.smithi166.stdout: "primary_temp": [], 2020-11-16T20:58:41.000 INFO:teuthology.orchestra.run.smithi166.stdout: "blocklist": {}, 2020-11-16T20:58:41.000 INFO:teuthology.orchestra.run.smithi166.stdout: "erasure_code_profiles": { 2020-11-16T20:58:41.000 INFO:teuthology.orchestra.run.smithi166.stdout: "default": { 2020-11-16T20:58:41.000 INFO:teuthology.orchestra.run.smithi166.stdout: "crush-failure-domain": "osd", 2020-11-16T20:58:41.000 INFO:teuthology.orchestra.run.smithi166.stdout: "k": "2", 2020-11-16T20:58:41.000 INFO:teuthology.orchestra.run.smithi166.stdout: "m": "1", 2020-11-16T20:58:41.000 INFO:teuthology.orchestra.run.smithi166.stdout: "plugin": "jerasure", 2020-11-16T20:58:41.001 INFO:teuthology.orchestra.run.smithi166.stdout: "ruleset-failure-domain": "osd", 2020-11-16T20:58:41.001 INFO:teuthology.orchestra.run.smithi166.stdout: "technique": "reed_sol_van" 2020-11-16T20:58:41.001 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:41.001 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:41.001 INFO:teuthology.orchestra.run.smithi166.stdout: "removed_snaps_queue": [ 2020-11-16T20:58:41.001 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:41.001 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 3, 2020-11-16T20:58:41.002 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:58:41.002 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:41.002 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 115, 2020-11-16T20:58:41.002 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:58:41.002 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:41.002 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:41.002 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 124, 2020-11-16T20:58:41.002 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:58:41.003 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:41.003 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:41.003 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 126, 2020-11-16T20:58:41.003 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:58:41.003 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:41.003 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:41.003 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 128, 2020-11-16T20:58:41.004 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:58:41.004 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:41.004 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:41.004 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 130, 2020-11-16T20:58:41.004 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:58:41.004 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:41.004 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:41.004 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:41.005 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:41.005 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 4, 2020-11-16T20:58:41.005 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:58:41.005 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:41.005 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 115, 2020-11-16T20:58:41.005 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:58:41.005 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:41.006 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:41.006 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 121, 2020-11-16T20:58:41.006 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:58:41.006 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:41.006 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:41.006 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 124, 2020-11-16T20:58:41.006 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:58:41.006 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:41.007 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:41.007 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 126, 2020-11-16T20:58:41.007 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:58:41.007 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:41.007 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:41.007 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 128, 2020-11-16T20:58:41.007 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:58:41.008 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:41.008 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:41.008 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 130, 2020-11-16T20:58:41.008 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:58:41.008 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:41.008 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:41.008 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:41.008 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:58:41.009 INFO:teuthology.orchestra.run.smithi166.stdout: "new_removed_snaps": [ 2020-11-16T20:58:41.009 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:41.009 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 3, 2020-11-16T20:58:41.009 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:58:41.009 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:41.009 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 128, 2020-11-16T20:58:41.009 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:58:41.010 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:41.010 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:41.010 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2020-11-16T20:58:41.010 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:41.010 INFO:teuthology.orchestra.run.smithi166.stdout: "pool": 4, 2020-11-16T20:58:41.010 INFO:teuthology.orchestra.run.smithi166.stdout: "snaps": [ 2020-11-16T20:58:41.010 INFO:teuthology.orchestra.run.smithi166.stdout: { 2020-11-16T20:58:41.010 INFO:teuthology.orchestra.run.smithi166.stdout: "begin": 128, 2020-11-16T20:58:41.011 INFO:teuthology.orchestra.run.smithi166.stdout: "length": 1 2020-11-16T20:58:41.011 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:41.011 INFO:teuthology.orchestra.run.smithi166.stdout: ] 2020-11-16T20:58:41.011 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:41.011 INFO:teuthology.orchestra.run.smithi166.stdout: ], 2020-11-16T20:58:41.011 INFO:teuthology.orchestra.run.smithi166.stdout: "new_purged_snaps": [], 2020-11-16T20:58:41.011 INFO:teuthology.orchestra.run.smithi166.stdout: "crush_node_flags": {}, 2020-11-16T20:58:41.012 INFO:teuthology.orchestra.run.smithi166.stdout: "device_class_flags": {}, 2020-11-16T20:58:41.012 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode": { 2020-11-16T20:58:41.012 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode_enabled": false, 2020-11-16T20:58:41.012 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_bucket_count": 0, 2020-11-16T20:58:41.012 INFO:teuthology.orchestra.run.smithi166.stdout: "degraded_stretch_mode": 0, 2020-11-16T20:58:41.012 INFO:teuthology.orchestra.run.smithi166.stdout: "recovering_stretch_mode": 0, 2020-11-16T20:58:41.012 INFO:teuthology.orchestra.run.smithi166.stdout: "stretch_mode_bucket": 0 2020-11-16T20:58:41.012 INFO:teuthology.orchestra.run.smithi166.stdout: } 2020-11-16T20:58:41.013 INFO:teuthology.orchestra.run.smithi166.stdout:} 2020-11-16T20:58:41.014 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument 2020-11-16T20:58:41.014 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-16T20:58:41.015 INFO:tasks.thrashosds.thrasher:j is {'epoch': 188, 'fsid': 'a14fd848-4cfe-4cd9-9140-5b3c4b4e904d', 'created': '2020-11-16T20:54:44.938121+0000', 'modified': '2020-11-16T20:58:40.801854+0000', 'last_up_change': '2020-11-16T20:54:52.080163+0000', 'last_in_change': '2020-11-16T20:58:08.763046+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 8, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-16T20:54:49.109999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 11, 'pg_placement_num': 11, 'pg_placement_num_target': 11, 'pg_num_target': 11, 'pg_num_pending': 11, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '155', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-16T20:54:53.253680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 18, 'pg_placement_num': 18, 'pg_placement_num_target': 18, 'pg_num_target': 18, 'pg_num_pending': 18, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '32', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'base', 'create_time': '2020-11-16T20:55:23.597952+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 4, 'pg_placement_num': 4, 'pg_placement_num_target': 4, 'pg_num_target': 4, 'pg_num_pending': 4, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '188', 'last_force_op_resend': '27', 'last_force_op_resend_prenautilus': '27', 'last_force_op_resend_preluminous': '27', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 133, 'snap_epoch': 188, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [4], 'tier_of': -1, 'read_tier': 4, 'write_tier': 4, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 4, 'pool_name': 'cache', 'create_time': '2020-11-16T20:55:28.901773+0000', 'flags': 8201, 'flags_names': 'hashpspool,incomplete_clones,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 4, 'pg_placement_num': 4, 'pg_placement_num_target': 4, 'pg_num_target': 4, 'pg_num_pending': 4, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '188', 'last_force_op_resend': '27', 'last_force_op_resend_prenautilus': '27', 'last_force_op_resend_preluminous': '27', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 133, 'snap_epoch': 188, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': 3, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'writeback', 'target_max_bytes': 0, 'target_max_objects': 250, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'bloom', 'false_positive_probability': 0.05, 'target_size': 0, 'seed': 0}, 'hit_set_period': 3600, 'hit_set_count': 8, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 2, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [1000000, 1000000, 1000000, 1000000, 1000000, 1000000, 1000000, 1000000], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}}], 'osds': [{'osd': 0, 'uuid': '35950122-efbd-420e-b07a-f5730f26df17', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 172, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6800', 'nonce': 35293}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6802', 'nonce': 35293}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6806', 'nonce': 35293}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6804', 'nonce': 35293}]}, 'public_addr': '172.21.15.166:6800/35293', 'cluster_addr': '172.21.15.166:6802/35293', 'heartbeat_back_addr': '172.21.15.166:6806/35293', 'heartbeat_front_addr': '172.21.15.166:6804/35293', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f768a1ff-3e8a-4131-a6ed-10f93b3ca900', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 172, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6808', 'nonce': 35323}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6809', 'nonce': 35323}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6811', 'nonce': 35323}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6810', 'nonce': 35323}]}, 'public_addr': '172.21.15.166:6808/35323', 'cluster_addr': '172.21.15.166:6809/35323', 'heartbeat_back_addr': '172.21.15.166:6811/35323', 'heartbeat_front_addr': '172.21.15.166:6810/35323', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '88734179-84a6-4a9b-8af0-692805815875', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 167, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6801', 'nonce': 35294}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6803', 'nonce': 35294}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6807', 'nonce': 35294}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6805', 'nonce': 35294}]}, 'public_addr': '172.21.15.166:6801/35294', 'cluster_addr': '172.21.15.166:6803/35294', 'heartbeat_back_addr': '172.21.15.166:6807/35294', 'heartbeat_front_addr': '172.21.15.166:6805/35294', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '319e54e8-3f03-4388-8de6-678d148e25d4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 172, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6812', 'nonce': 35324}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6813', 'nonce': 35324}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6815', 'nonce': 35324}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.166:6814', 'nonce': 35324}]}, 'public_addr': '172.21.15.166:6812/35324', 'cluster_addr': '172.21.15.166:6813/35324', 'heartbeat_back_addr': '172.21.15.166:6815/35324', 'heartbeat_front_addr': '172.21.15.166:6814/35324', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '3edbb68e-e030-4379-891e-2412f1235ffb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 160, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6804', 'nonce': 31586}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6805', 'nonce': 31586}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6807', 'nonce': 31586}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6806', 'nonce': 31586}]}, 'public_addr': '172.21.15.59:6804/31586', 'cluster_addr': '172.21.15.59:6805/31586', 'heartbeat_back_addr': '172.21.15.59:6807/31586', 'heartbeat_front_addr': '172.21.15.59:6806/31586', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '44fbf5ac-4484-48a8-a846-1f5c01a6ec2c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 172, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6808', 'nonce': 31610}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6810', 'nonce': 31610}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6813', 'nonce': 31610}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6812', 'nonce': 31610}]}, 'public_addr': '172.21.15.59:6808/31610', 'cluster_addr': '172.21.15.59:6810/31610', 'heartbeat_back_addr': '172.21.15.59:6813/31610', 'heartbeat_front_addr': '172.21.15.59:6812/31610', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'f93b82df-f537-4601-8247-388bf100b5b5', 'up': 1, 'in': 1, 'weight': 0.5976104736328125, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 157, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6800', 'nonce': 31587}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6801', 'nonce': 31587}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6803', 'nonce': 31587}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6802', 'nonce': 31587}]}, 'public_addr': '172.21.15.59:6800/31587', 'cluster_addr': '172.21.15.59:6801/31587', 'heartbeat_back_addr': '172.21.15.59:6803/31587', 'heartbeat_front_addr': '172.21.15.59:6802/31587', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'e5485c88-d267-4a6a-b9b6-15d869d28f28', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.262969970703125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 160, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6809', 'nonce': 31617}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6811', 'nonce': 31617}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6815', 'nonce': 31617}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6814', 'nonce': 31617}]}, 'public_addr': '172.21.15.59:6809/31617', 'cluster_addr': '172.21.15.59:6811/31617', 'heartbeat_back_addr': '172.21.15.59:6815/31617', 'heartbeat_front_addr': '172.21.15.59:6814/31617', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:57:51.069501+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:57:50.587440+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:57:51.478402+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:57:52.168613+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:57:51.043436+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:57:53.018080+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:57:51.672856+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138297136906239, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-16T20:57:51.523906+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.c', 'osds': [4, 5, 6]}, {'pgid': '4.0', 'osds': [2, 1, 0]}, {'pgid': '4.3', 'osds': [4, 3, 2]}], 'pg_upmap_items': [{'pgid': '4.1', 'mappings': [{'from': 5, 'to': 3}]}, {'pgid': '4.3', 'mappings': [{'from': 5, 'to': 7}]}], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 115, 'length': 1}, {'begin': 124, 'length': 1}, {'begin': 126, 'length': 1}, {'begin': 128, 'length': 1}, {'begin': 130, 'length': 1}]}, {'pool': 4, 'snaps': [{'begin': 115, 'length': 1}, {'begin': 121, 'length': 1}, {'begin': 124, 'length': 1}, {'begin': 126, 'length': 1}, {'begin': 128, 'length': 1}, {'begin': 130, 'length': 1}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 128, 'length': 1}]}, {'pool': 4, 'snaps': [{'begin': 128, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2020-11-16T20:58:41.016 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 2.c 2020-11-16T20:58:41.016 INFO:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 2.c 2020-11-16T20:58:41.016 INFO:tasks.ceph.osd.4.smithi059.stderr:2020-11-16T20:58:41.019+0000 7f185707d700 -1 received signal: Hangup